A Delphi Study: Exploring Faculty Perceptions of the Best Practices Influencing Student Persistence in Blended Courses

ERIC Educational Resources Information Center

Manning, Kim Elise

2010-01-01

This Delphi study explored the instructional practices of community college faculty who were teaching blended or Web-assisted courses and how these practices influenced student persistence. The Delphi method provided qualitative data in the form of expert advice through consensus building on the instructional practices most likely to influence…

Career and Technical Education at a Crossroads: A Delphi Study

ERIC Educational Resources Information Center

Cutright, Michael W.

2011-01-01

Career and technical education in the United States has reached a critical juncture. A three round Delphi method was used to determine a consensus on the future events of career and technical education to better inform educational decision makers. Forty-one individual experts in the field were invited to serve as panelists for the Delphi study and…

A Delphi Study on Staff Bereavement Training in the Intellectual and Developmental Disabilities Field

ERIC Educational Resources Information Center

Gray, Jennifer A.; Truesdale, Jesslyn

2015-01-01

The Delphi technique was used to obtain expert panel consensus to prioritize content areas and delivery methods for developing staff grief and bereavement curriculum training in the intellectual and developmental disabilities (IDD) field. The Delphi technique was conducted with a panel of 18 experts from formal and informal disability caregiving,…

Expert Consensus on Characteristics of Wisdom: A Delphi Method Study

ERIC Educational Resources Information Center

Jeste, Dilip V.; Ardelt, Monika; Blazer, Dan; Kraemer, Helena C.; Vaillant, George; Meeks, Thomas W.

2010-01-01

Purpose: Wisdom has received increasing attention in empirical research in recent years, especially in gerontology and psychology, but consistent definitions of wisdom remain elusive. We sought to better characterize this concept via an expert consensus panel using a 2-phase Delphi method. Design and Methods: A survey questionnaire comprised 53…

Application of the Delphi technique in healthcare maintenance.

PubMed

Njuangang, Stanley; Liyanage, Champika; Akintoye, Akintola

2017-10-09

Purpose The purpose of this paper is to examine the research design, issues and considerations in the application of the Delphi technique to identify, refine and rate the critical success factors and performance measures in maintenance-associated infections. Design/methodology/approach In-depth literature review through the application of open and axial coding were applied to formulate the interview and research questions. These were used to conduct an exploratory case study of two healthcare maintenance managers, randomly selected from two National Health Service Foundation Trusts in England. The results of exploratory case study provided the rationale for the application of the Delphi technique in this research. The different processes in the application of the Delphi technique in healthcare research are examined thoroughly. Findings This research demonstrates the need to apply and integrate different research methods to enhance the validity of the Delphi technique. The rationale for the application of the Delphi technique in this research is because some healthcare maintenance managers lack knowledge about basic infection control (IC) principles to make hospitals safe for patient care. The result of first round of the Delphi exercise is a useful contribution in its own rights. It identified a number of salient issues and differences in the opinions of the Delphi participants, noticeably between healthcare maintenance managers and members of the infection control team. It also resulted in useful suggestions and comments to improve the quality and presentation of the second- and third-round Delphi instruments. Practical implications This research provides a research methodology that can be adopted by researchers investigating new and emerging issues in the healthcare sector. As this research demonstrates, the Delphi technique is relevant in soliciting expert knowledge and opinion to identify performance measures to control maintenance-associated infections in hospitals. The methodology provided here could be applied by other researchers elsewhere to probe, investigate and generate rich information about new and emerging healthcare research topics. Originality/value The authors demonstrate how different research methods can be integrated to enhance the validity of the Delphi technique. For example, the results of an exploratory case study provided the rationale for the application of the Delphi technique investigating the key performance measures in maintenance-associated infections. The different processes involved in the application of the Delphi technique are also carefully explored and discussed in depth.

Examining the Roles of Blended Learning Approaches in Computer-Supported Collaborative Learning (CSCL) Environments: A Delphi Study

ERIC Educational Resources Information Center

So, Hyo-Jeong; Bonk, Curtis J.

2010-01-01

In this study, a Delphi method was used to identify and predict the roles of blended learning approaches in computer-supported collaborative learning (CSCL) environments. The Delphi panel consisted of experts in online learning from different geographic regions of the world. This study discusses findings related to (a) pros and cons of blended…

Highly efficient and exact method for parallelization of grid-based algorithms and its implementation in DelPhi

PubMed Central

Li, Chuan; Li, Lin; Zhang, Jie; Alexov, Emil

2012-01-01

The Gauss-Seidel method is a standard iterative numerical method widely used to solve a system of equations and, in general, is more efficient comparing to other iterative methods, such as the Jacobi method. However, standard implementation of the Gauss-Seidel method restricts its utilization in parallel computing due to its requirement of using updated neighboring values (i.e., in current iteration) as soon as they are available. Here we report an efficient and exact (not requiring assumptions) method to parallelize iterations and to reduce the computational time as a linear/nearly linear function of the number of CPUs. In contrast to other existing solutions, our method does not require any assumptions and is equally applicable for solving linear and nonlinear equations. This approach is implemented in the DelPhi program, which is a finite difference Poisson-Boltzmann equation solver to model electrostatics in molecular biology. This development makes the iterative procedure on obtaining the electrostatic potential distribution in the parallelized DelPhi several folds faster than that in the serial code. Further we demonstrate the advantages of the new parallelized DelPhi by computing the electrostatic potential and the corresponding energies of large supramolecular structures. PMID:22674480

[Modified Delphi method in the constitution of school sanitation standard].

PubMed

Yin, Xunqiang; Liang, Ying; Tan, Hongzhuan; Gong, Wenjie; Deng, Jing; Luo, Jiayou; Di, Xiaokang; Wu, Yue

2012-11-01

To constitute school sanitation standard using modified Delphi method, and to explore the feasibility and the predominance of Delphi method in the constitution of school sanitation standard. Two rounds of expert consultations were adopted in this study. The data were analyzed with SPSS15.0 to screen indices of school sanitation standard. Thirty-two experts accomplished the 2 rounds of consultations. The average length of expert service was (24.69 ±8.53) years. The authority coefficient was 0.729 ±0.172. The expert positive coefficient was 94.12% (32/34) in the first round and 100% (32/32) in the second round. The harmonious coefficients of importance, feasibility and rationality in the second round were 0.493 (P<0.05), 0.527 (P<0.01), and 0.535 (P<0.01), respectively, suggesting unanimous expert opinions. According to the second round of consultation, 38 indices were included in the framework. Theoretical analysis, literature review, investigation and so on are generally used in health standard constitution currently. Delphi method is a rapid, effective and feasible method in this field.

The Delphi Method in Rehabilitation Counseling Research

ERIC Educational Resources Information Center

Vazquez-Ramos, Robinson; Leahy, Michael; Estrada Hernandez, Noel

2007-01-01

Rehabilitation researchers have found in the application of the Delphi method a more sophisticated way of obtaining consensus from experts in the field on certain matters. The application of this research methodology has affected and certainly advanced the body of knowledge of the rehabilitation counseling practice. However, the rehabilitation…

Application of Delphi-AHP methods to select the priorities of WEEE for recycling in a waste management decision-making tool.

PubMed

Kim, Mincheol; Jang, Yong-Chul; Lee, Seunguk

2013-10-15

The management of waste electrical and electronic equipment (WEEE) or electronic waste (e-waste) has become a major issue of concern for solid waste communities due to the large volumes of waste being generated from the consumption of modern electrical and electronic products. In 2003, Korea introduced the extended producer responsibility (EPR) system to reduce the amount of electronic products to be disposed and to promote resource recovery from WEEE. The EPR currently regulates a total of 10 electrical and electronic products. This paper presents the results of the application of the Delphi method and analytical hierarchy process (AHP) modeling to the WEEE management tool in the policy-making process. Specifically, this paper focuses on the application of the Delphi-AHP technique to determine the WEEE priority to be included in the EPR system. Appropriate evaluation criteria were derived using the Delphi method to assess the potential selection and priority among electrical and electronic products that will be regulated by the EPR system. Quantitative weightings from the AHP model were calculated to identify the priorities of electrical and electronic products to be potentially regulated. After applying all the criteria using the AHP model, the results indicate that the top 10 target recycling products for the expansion of the WEEE list were found to be vacuum cleaners, electric fans, rice cookers, large freezers, microwave ovens, water purifiers, air purifiers, humidifiers, dryers, and telephones in order from the first to last. The proposed Delphi-AHP method can offer a more efficient means of selecting WEEE than subjective assessment methods that are often based on professional judgment or limited available data. By providing WEEE items to be regulated, the proposed Delphi-AHP method can eliminate uncertainty and subjective assessment and enable WEEE management policy-makers to identify the priority of potential WEEE. More generally, the work performed in this study is an example of how Delphi-AHP modeling can be used as a decision-making process tool in WEEE management. Crown Copyright © 2013. Published by Elsevier Ltd. All rights reserved.

The Use of the Delphi and Other Consensus Group Methods in Medical Education Research: A Review.

PubMed

Humphrey-Murto, Susan; Varpio, Lara; Wood, Timothy J; Gonsalves, Carol; Ufholz, Lee-Anne; Mascioli, Kelly; Wang, Carol; Foth, Thomas

2017-10-01

Consensus group methods, such as the Delphi method and nominal group technique (NGT), are used to synthesize expert opinions when evidence is lacking. Despite their extensive use, these methods are inconsistently applied. Their use in medical education research has not been well studied. The authors set out to describe the use of consensus methods in medical education research and to assess the reporting quality of these methods and results. Using scoping review methods, the authors searched the Medline, Embase, PsycInfo, PubMed, Scopus, and ERIC databases for 2009-2016. Full-text articles that focused on medical education and the keywords Delphi, RAND, NGT, or other consensus group methods were included. A standardized extraction form was used to collect article demographic data and features reflecting methodological rigor. Of the articles reviewed, 257 met the inclusion criteria. The Modified Delphi (105/257; 40.8%), Delphi (91/257; 35.4%), and NGT (23/257; 8.9%) methods were most often used. The most common study purpose was curriculum development or reform (68/257; 26.5%), assessment tool development (55/257; 21.4%), and defining competencies (43/257; 16.7%). The reporting quality varied, with 70.0% (180/257) of articles reporting a literature review, 27.2% (70/257) reporting what background information was provided to participants, 66.1% (170/257) describing the number of participants, 40.1% (103/257) reporting if private decisions were collected, 37.7% (97/257) reporting if formal feedback of group ratings was shared, and 43.2% (111/257) defining consensus a priori. Consensus methods are poorly standardized and inconsistently used in medical education research. Improved criteria for reporting are needed.

Using the Delphi Method for Selecting Effective Rehabilitation Practices for Case Study Research: Methods, Challenges, and Solutions and Implications for Future Research

ERIC Educational Resources Information Center

Fleming, Allison R.; Boeltzig-Brown, Heike; Foley, Susan M.

2015-01-01

Purpose: We describe a modified Delphi method used to select effective state vocational rehabilitation agency practices to prioritize rehabilitation services for individuals with most significant disabilities within the context of Order of Selection, an area where there is little known and published. Specifically, we describe how we applied the…

A Research Study Using the Delphi Method to Define Essential Competencies for a High School Game Art and Design Course Framework at the National Level

ERIC Educational Resources Information Center

Mack, Nayo Corenus-Geneva

2011-01-01

This research study reports the findings of a Delphi study conducted to determine the essential competencies and objectives for a high school Game Art and Design course framework at the national level. The Delphi panel consisted of gaming, industry and educational experts from all over the world who were members of the International Game…

Determining e-Portfolio Elements in Learning Process Using Fuzzy Delphi Analysis

ERIC Educational Resources Information Center

Mohamad, Syamsul Nor Azlan; Embi, Mohamad Amin; Nordin, Norazah

2015-01-01

The present article introduces the Fuzzy Delphi method results obtained in the study on determining e-Portfolio elements in learning process for art and design context. This method bases on qualified experts that assure the validity of the collected information. In particular, the confirmation of elements is based on experts' opinion and…

Comparing Management Models of Secondary Schools in Tamaulipas, Mexico: An Exploration with a Delphi Method

ERIC Educational Resources Information Center

Navarro-Leal, Marco Aurelio; Garcia, Concepcion Nino; Saldivar, Luisa Caballero

2012-01-01

For a preliminary exploration of management models between two secondary schools, a Delphi method was used in order to identify and focus relevant topics for a larger research. A first approximation with this method proved to be a heuristic tool to focus and define some categories and guidelines of enquiry. It was found that in both of the schools…

Expert Consensus for Discharge Referral Decisions Using Online Delphi

PubMed Central

Bowles, Kathy H.; Holmes, John H.; Naylor, Mary D.; Liberatore, Matthew; Nydick, Robert

2003-01-01

This paper describes the results of using a modified Delphi approach designed to achieve consensus from eight discharge planning experts regarding the decision to refer hospitalized older adults for post-discharge follow-up. Experts reviewed 150 cases using an online website designed to facilitate their interaction and efforts to reach agreement on the need for a referral for post-discharge care and the appropriate site for such care. In contrast to an average of eight weeks to complete just 50 cases using the traditional mail method, the first online Delphi round for 150 cases were completed in six weeks. Data provided by experts suggest that online Delphi is a time efficient and acceptable methodology for reaching group consensus. Other benefits include instant access to Delphi decision results, live knowledge of the time requirements and progress of each expert, and cost savings in postage, paper, copying, and storage of paper documents. This online Delphi methodology is highly recommended. PMID:14728143

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

A Delphi Investigation into the Research Needs in Swedish Librarianship

ERIC Educational Resources Information Center

Maceviciute, Elena; Wilson, T. D.

2009-01-01

Introduction: Reports the conduct of a national survey in Sweden to establish the desired research priorities for libraries. The research sought to establish what evidence-base is needed for evidence-based practice. Method: The Delphi method was employed to solicit opinions on the kinds of research needed by libraries of all kinds in Sweden.…

An Empirical Investigation of Entrepreneurship Intensity in Iranian State Universities

ERIC Educational Resources Information Center

Mazdeh, Mohammad Mahdavi; Razavi, Seyed-Mostafa; Hesamamiri, Roozbeh; Zahedi, Mohammad-Reza; Elahi, Behin

2013-01-01

The purpose of this study is to propose a framework to evaluate the entrepreneurship intensity (EI) of Iranian state universities. In order to determine EI, a hybrid multi-method framework consisting of Delphi, Analytic Network Process (ANP), and VIKOR is proposed. The Delphi method is used to localize and reduce the number of criteria extracted…

Idea Generation and Exploration: Benefits and Limitations of the Policy Delphi Research Method

ERIC Educational Resources Information Center

Franklin, Kathy K.; Hart, Jan K.

2007-01-01

Researchers use the policy Delphi method to explore a complex topic with little historical context that requires expert opinion to fully understand underlying issues. The benefit of this research technique is the use of experts who have more timely information than can be gleamed from extant literature. Additionally, those experts place…

Cost estimation: An expert-opinion approach. [cost analysis of research projects using the Delphi method (forecasting)

NASA Technical Reports Server (NTRS)

Buffalano, C.; Fogleman, S.; Gielecki, M.

1976-01-01

A methodology is outlined which can be used to estimate the costs of research and development projects. The approach uses the Delphi technique a method developed by the Rand Corporation for systematically eliciting and evaluating group judgments in an objective manner. The use of the Delphi allows for the integration of expert opinion into the cost-estimating process in a consistent and rigorous fashion. This approach can also signal potential cost-problem areas. This result can be a useful tool in planning additional cost analysis or in estimating contingency funds. A Monte Carlo approach is also examined.

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique.

PubMed

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method.

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique

PubMed Central

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method. PMID:25948132

Consulting the oracle: ten lessons from using the Delphi technique in nursing research.

PubMed

Keeney, Sinead; Hasson, Felicity; McKenna, Hugh

2006-01-01

The aim of this paper was to provide insight into the Delphi technique by outlining our personal experiences during its use over a 10-year period in a variety of applications. As a means of achieving consensus on an issue, the Delphi research method has become widely used in healthcare research generally and nursing research in particular. The literature on this technique is expanding, mainly addressing what it is and how it should be used. However, there is still much confusion and uncertainty surrounding it, particularly about issues such as modifications, consensus, anonymity, definition of experts, how 'experts' are selected and how non-respondents are pursued. This issues that arise when planning and carrying out a Delphi study include the definition of consensus; the issue of anonymity vs. quasi-anonymity for participants; how to estimate the time needed to collect the data, analyse each 'round', feed back results to participants, and gain their responses to this feedback; how to define and select the 'experts' who will be asked to participate; how to enhance response rates; and how many 'rounds' to conduct. Many challenges and questions are raised when using the Delphi technique, but there is no doubt that it is an important method for achieving consensus on issues where none previously existed. Researchers need to adapt the method to suit their particular study.

Successful and Unsuccessful Multicultural Supervisory Behaviors: A Delphi Poll

ERIC Educational Resources Information Center

Dressel, Jeana L.; Consoli, Andres J.; Kim, Bryan S.K.; Atkinson, Donald R.

2007-01-01

Using the Delphi method, university counseling center supervisors with significant experience in multicultural supervision generated and ranked elements of successful and unsuccessful multicultural supervision. Twenty-seven of 35 successful elements and 24 of 33 unsuccessful elements involved cultural considerations. Multicultural supervision was…

Distribution network connection pricing framework and methodology: identification of areas of improvement for Sarawak Energy Berhad Connection Charges Guidelines through modified delphi method

NASA Astrophysics Data System (ADS)

Tan, J. K.; Abas, N.

2017-07-01

Complaints on issues and matters related to connection charges have been very common for electricity supply utility companies around the world including Sarawak Energy Berhad. In order to identify the areas that can be improved, a mixed method of exploratory research involving qualitative and quantitative methods have been designed and undertaken rather than a single method of survey. This will ensure a more comprehensive and detailed understanding of the issues from various target groups. The method is designed under three phases, employing Modified Delphi Technique for phase 1 through a series of stake holder engagements, online and offline survey questionnaires to be filled by internal wiring contractors for phase 2 whilst under phase 3, case studies shall be carried out on the issues identified from phase 1 and phase 2 of the study. This paper presented the findings from the Modified Delphi Technique. The findings revealed that there are areas of improvement for Sarawak Energy Berhad connection guidelines in term of differentiation of dedicated and shared assets which leads to unfairness to the connecting customers, inconsistency and non-transparent in charging. The findings of Modified Delphi Technique shall be used for implementation of phase 2 and phase 3 of the study.

What works for wellbeing in culture and sport? Report of a DELPHI process to support coproduction and establish principles and parameters of an evidence review

PubMed Central

Daykin, Norma; Mansfield, Louise; Payne, Annette; Kay, Tess; Meads, Catherine; D’Innocenzo, Giorgia; Burnett, Adele; Dolan, Paul; Julier, Guy; Longworth, Louise; Tomlinson, Alan; Testoni, Stefano; Victor, Christina

2016-01-01

Aims: There is a growing recognition of the ways in which culture and sport can contribute to wellbeing. A strong evidence base is needed to support innovative service development and a 3-year research programme is being undertaken to capture best evidence of wellbeing impacts and outcomes of cultural and sporting activities in order to inform UK policy and practice. This article provides an overview of methods and findings from an initial coproduction process with key stakeholders that sought to explore and agree principles and parameters of the evidence review for culture, sport and wellbeing (CSW). Methods: A two-stage DELPHI process was conducted with a purposeful sample of 57 stakeholders between August and December 2015. Participants were drawn from a range of culture and sport organisations and included commissioners and managers, policy makers, representatives of service delivery organisations (SDOs) and scholars. The DELPHI 1 questionnaire was developed from extensive consultation in July and August 2015. It explored definitions of wellbeing, the role of evidence, quality assessment, and the culture and sport populations, settings and interventions that are most likely to deliver wellbeing outcomes. Following further consultation, the results, presented as a series of ranked statements, were sent back to participants (DELPHI 2), which allowed them to reflect on and, if they wished, express agreement or disagreement with the emerging consensus. Results: A total of 40 stakeholders (70.02%) responded to the DELPHI questionnaires. DELPHI 1 mapped areas of agreement and disagreement, confirmed in DELPHI 2. The exercise drew together the key priorities for the CSW evidence review. Conclusion: The DELPHI process, in combination with face-to-face deliberation, enabled stakeholders to engage in complex discussion and express nuanced priorities while also allowing the group to come to an overall consensus and agree outcomes. The results will inform the CSW evidence review programme until its completion in March 2018. PMID:27789779

Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies.

PubMed

Diamond, Ivan R; Grant, Robert C; Feldman, Brian M; Pencharz, Paul B; Ling, Simon C; Moore, Aideen M; Wales, Paul W

2014-04-01

To investigate how consensus is operationalized in Delphi studies and to explore the role of consensus in determining the results of these studies. Systematic review of a random sample of 100 English language Delphi studies, from two large multidisciplinary databases [ISI Web of Science (Thompson Reuters, New York, NY) and Scopus (Elsevier, Amsterdam, NL)], published between 2000 and 2009. About 98 of the Delphi studies purported to assess consensus, although a definition for consensus was only provided in 72 of the studies (64 a priori). The most common definition for consensus was percent agreement (25 studies), with 75% being the median threshold to define consensus. Although the authors concluded in 86 of the studies that consensus was achieved, consensus was only specified a priori (with a threshold value) in 42 of these studies. Achievement of consensus was related to the decision to stop the Delphi study in only 23 studies, with 70 studies terminating after a specified number of rounds. Although consensus generally is felt to be of primary importance to the Delphi process, definitions of consensus vary widely and are poorly reported. Improved criteria for reporting of methods of Delphi studies are required. Copyright © 2014 Elsevier Inc. All rights reserved.

Use of a Computer-Mediated Delphi Process to Validate a Mass Casualty Conceptual Model

PubMed Central

CULLEY, JOAN M.

2012-01-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters. PMID:21076283

Use of a computer-mediated Delphi process to validate a mass casualty conceptual model.

PubMed

Culley, Joan M

2011-05-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters.

Competencies Needed by Korean HRD Master's Graduates: A Comparison between the ASTD WLP Competency Model and the Korean Study

ERIC Educational Resources Information Center

Lee, Yonghak

2009-01-01

The primary purpose of this study was to identify competencies needed by current human resource development (HRD) master's degree graduate students in Korea. The study used a quantitative method, the Delphi technique, in combination with a qualitative method consisting of a series of in-depth interviews. The Delphi technique was conducted using a…

African American Faculty Expressing Concerns: Breaking the Silence at Predominantly White Research Oriented Universities

ERIC Educational Resources Information Center

Ross, Henry H.; Edwards, Willie J.

2016-01-01

A Delphi method was used with a panel of 24 African American faculty employed at 43 predominantly white doctoral extensive universities to arrive at a group consensus on a list of concerns that African American faculty in general experienced or held. Using the Delphi method a panel of African American faculty initially worked from a list of eight…

The use of qualitative methods to inform Delphi surveys in core outcome set development.

PubMed

Keeley, T; Williamson, P; Callery, P; Jones, L L; Mathers, J; Jones, J; Young, B; Calvert, M

2016-05-04

Core outcome sets (COS) help to minimise bias in trials and facilitate evidence synthesis. Delphi surveys are increasingly being used as part of a wider process to reach consensus about what outcomes should be included in a COS. Qualitative research can be used to inform the development of Delphi surveys. This is an advance in the field of COS development and one which is potentially valuable; however, little guidance exists for COS developers on how best to use qualitative methods and what the challenges are. This paper aims to provide early guidance on the potential role and contribution of qualitative research in this area. We hope the ideas we present will be challenged, critiqued and built upon by others exploring the role of qualitative research in COS development. This paper draws upon the experiences of using qualitative methods in the pre-Delphi stage of the development of three different COS. Using these studies as examples, we identify some of the ways that qualitative research might contribute to COS development, the challenges in using such methods and areas where future research is required. Qualitative research can help to identify what outcomes are important to stakeholders; facilitate understanding of why some outcomes may be more important than others, determine the scope of outcomes; identify appropriate language for use in the Delphi survey and inform comparisons between stakeholder data and other sources, such as systematic reviews. Developers need to consider a number of methodological points when using qualitative research: specifically, which stakeholders to involve, how to sample participants, which data collection methods are most appropriate, how to consider outcomes with stakeholders and how to analyse these data. A number of areas for future research are identified. Qualitative research has the potential to increase the research community's confidence in COS, although this will be dependent upon using rigorous and appropriate methodology. We have begun to identify some issues for COS developers to consider in using qualitative methods to inform the development of Delphi surveys in this article.

[Study on commercial specification of atractylodes based on Delphi method].

PubMed

Wang, Hao; Chen, Li-Xiao; Huang, Lu-Qi; Zhang, Tian-Tian; Li, Ying; Zheng, Yu-Guang

2016-03-01

This research adopts "Delphi method" to evaluate atractylodes traditional traits and rank correlation. By using methods of mathematical statistics the relationship of the traditional identification indicators and atractylodes goods rank correlation was analyzed, It is found that the main characteristics affectingatractylodes commodity specifications and grades of main characters wereoil points of transaction,color of transaction,color of surface,grain of transaction,texture of transaction andspoilage. The study points out that the original "seventy-six kinds of medicinal materials commodity specification standards of atractylodes differentiate commodity specification" is not in conformity with the actual market situation, we need to formulate corresponding atractylodes medicinal products specifications and grades.This study combined with experimental results "Delphi method" and the market actual situation, proposed the new draft atractylodes commodity specifications and grades, as the new atractylodes commodity specifications and grades standards. It provides a reference and theoretical basis. Copyright© by the Chinese Pharmaceutical Association.

A Delphi-matrix approach to SEA and its application within the tourism sector in Taiwan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kuo, N.-W.; Hsiao, T.-Y.; Yu, Y.-H.

Strategic Environmental Assessment (SEA) is a procedural tool and within the framework of SEA, several different types of analytical methods can be used in the assessment. However, the impact matrix used currently in Taiwan has some disadvantages. Hence, a Delphi-matrix approach to SEA is proposed here to improve the performance of Taiwan's SEA. This new approach is based on the impact matrix combination with indicators of sustainability, and then the Delphi method is employed to collect experts' opinions. In addition, the assessment of National Floriculture Park Plan and Taiwan Flora 2008 Program is taken as an example to examine thismore » new method. Although international exhibition is one of the important tourism (economic) activities, SEA is seldom about tourism sector. Finally, the Delphi-matrix approach to SEA for tourism development plan is established containing eight assessment topics and 26 corresponding categories. In summary, three major types of impacts: resources' usages, pollution emissions, and local cultures change are found. Resources' usages, such as water, electricity, and natural gas demand, are calculated on a per capita basis. Various forms of pollution resulting from this plan, such as air, water, soil, waste, and noise, are also identified.« less

Computer Technology and Education: A Policy Delphi.

ERIC Educational Resources Information Center

Steier, Lloyd P.

Realizing the educational potential of computer technology largely depends on developing appropriate policies related to the technology. A Policy Delphi method was used to identify changes in education that are both probable and possible on account of the introduction of computers, and to explore potential patterns for arriving at a desired…

Identifying Dispositions That Matter: Reaching for Consensus Using a Delphi Study

ERIC Educational Resources Information Center

Bair, Mary Antony

2017-01-01

This article describes how one institution used the Delphi technique to identify and operationalize key professional dispositions to be addressed in its teacher education program. Participants included teacher educators, methods course instructors, and school administrators. Data collection occurred in three phases, with the results of each phase…

Using Delphi Methodology to Design Assessments of Teachers' Pedagogical Content Knowledge

ERIC Educational Resources Information Center

Manizade, Agida Gabil; Mason, Marguerite M.

2011-01-01

Descriptions of methodologies that can be used to create items for assessing teachers' "professionally situated" knowledge are lacking in mathematics education research literature. In this study, researchers described and used the Delphi method to design an instrument to measure teachers' pedagogical content knowledge. The instrument focused on a…

Assessment Leaders' Perspectives of Institutional Cultures of Assessment: A Delphi Study

ERIC Educational Resources Information Center

Fuller, Matthew; Henderson, Susan; Bustamante, Rebecca

2015-01-01

Institutional cultures of assessment are praised as beneficial to student learning. Yet, extant studies have not explored the theoretical foundations and pragmatic approaches to shaping cultures of assessment. The researchers used the Delphi method to explore 10 higher education assessment leaders' attitudes and theoretical perspectives regarding…

Single-Parent Nontraditional Students: Faculty Support within the Classroom Environment

ERIC Educational Resources Information Center

Allen-Drewry, Lisa M.

2017-01-01

Purpose: The purpose of this Delphi study was to explore single-parent nontraditional student experiences within nontraditional university classroom environments and to determine methods for providing better support within the classroom setting. Methodology: The Delphi technique was conducted through 3 survey rounds to explore ways professors and…

Identifying Competencies for Volunteer Administrators for the Coming Decade: A National Delphi Study.

ERIC Educational Resources Information Center

Boyd, Barry L.

2003-01-01

A Delphi panel of 13 experts categorized 33 competencies for volunteer administration into 5 constructs: organizational leadership, systems leadership, organizational culture, personal skills, and management skills. Twelve barriers to acquiring competencies and 21 methods to address them were identified. (Contains 24 references.) (SK)

Use of the Delphi method for determining community growth goals inventory: the Nashville experience

Treesearch

Vishwa K. Varma

1977-01-01

The author discusses the growth-inducing pressures on Nashville, Tennessee, describes the application of the Delphi technique to develop an inventory of the community's growth goals, and suggests that the development of a list of community goals is a necessary first step toward growth management.

A Delphi Study and Initial Validation of Counselor Supervision Competencies

ERIC Educational Resources Information Center

Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

2016-01-01

The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Military Medical Leadership in Uniformed Medical Students: Creating a New Assessment Instrument Using the Delphi Method

DTIC Science & Technology

2015-12-17

healthcare management and have not focused on assessing leadership among student physicians. A systematic review of 80 Delphi method studies by...medical students ( Research Question 1), to create a leadership assessment instrument based on those important components ( Research Question 2), and... research question 2 (RQ2) saw the creation of a three page assessment instrument to assess medical leadership in student physicians. Based on critical

Future Directions for Business Education: A Delphi Study

ERIC Educational Resources Information Center

Kesten, Cyril A.; Lambrecht, Judith J.

2010-01-01

Purpose: The purpose of this study was to synthesize perceptions from the field about current issues and to propose future directions for the field of business education. Method: A modified three-stage Delphi study was carried out with business educators who attended national conferences and/or belonged to national professional organizations.…

Helping Competencies of Student Affairs Professionals: A Delphi Study

ERIC Educational Resources Information Center

Reynolds, Amy L.

2011-01-01

The purpose of this study was to gather student affairs professionals' perceptions of the knowledge and skills needed to effectively help students. Using the Delphi method, 159 entry-level and mid-level student affairs administrators from institutions across the United States were surveyed regarding their perceptions of the helping skills they use…

The Policy Delphi: A Method for Identifying Intended and Unintended Consequences of Educational Policy

ERIC Educational Resources Information Center

Manley, R. Adam

2013-01-01

This article highlights a rarely utilized but effective technique for identifying intended and unintended consequences of past or current policy or policy change. The author guides the reader through the process of identifying potential participants, contacting participants, developing the policy Delphi instrument, and analyzing the findings by…

Rehabilitation Counselor Competencies When Working With Hispanic/Latino Immigrant Injured Workers: A Delphi Study

ERIC Educational Resources Information Center

Santos Román, Leslie M.; Estrada-Hernández, Noel

2017-01-01

Purpose: To explore and identify attitudes, knowledge, and skills rehabilitation practitioners in the private sector need when working with Hispanic/Latino immigrant injured workers. Methods: This study employed a 3-round Delphi study to obtain a consensus of 8 rehabilitation practitioners who had experience and expertise working with…

The Stammering Information Programme: A Delphi Study

ERIC Educational Resources Information Center

Berquez, Ali E.; Cook, Frances M.; Millard, Sharon K.; Jarvis, Effie

2011-01-01

Purpose: To find out what information children, parents and education staff feel would be important to know to support a child who stutters in the educational environment, in order to develop appropriate resources. Method: A Delphi study was carried out to seek the opinions of experts about the information to include. A structured six stage…

Multidisciplinary Delphi Development of a Scale to Evaluate Team Function in Obstetric Emergencies: The PETRA Scale.

PubMed

Balki, Mrinalini; Hoppe, David; Monks, David; Cooke, Mary Ellen; Sharples, Lynn; Windrim, Rory

2017-06-01

The objective of this study was to develop a new interdisciplinary teamwork scale, the Perinatal Emergency: Team Response Assessment (PETRA), for the management of obstetric crises, through consensus agreement of obstetric caregivers. This prospective study was performed using expert consensus, based on a Delphi method. The study investigators developed a new PETRA tool, specifically related to obstetric crisis management, based on the existing literature and discussions among themselves. The scale was distributed to a selected panel of experts in the field for the Delphi process. After each round of Delphi, every component of the scale was analyzed quantitatively by the percentage of agreement ratings and each comment reviewed by the blinded investigators. The assessment scale was then modified, with components of less than 80% agreement removed from the scale. The process was repeated on three occasions to reach a consensus and final PETRA scale. Fourteen of 24 invited experts participated in the Delphi process. The original PETRA scale included six categories and 48 items, one global scale item, and a 3-point rubric for rating. The overall percentage agreement by experts in the first, second, and third rounds was 95.0%, 93.2%, and 98.5%, respectively. The final scale after the third round of Delphi consisted of the following seven categories: shared mental model, communication, situational awareness, leadership, followership, workload management, and positive/effective behaviours and attitudes. There were 34 individual items within these categories, each with a 5-point rating rubric (1 = unacceptable to 5 = perfect). Using a structured Delphi method, we established the face and content validity of this assessment scale that focuses on important aspects of interdisciplinary teamwork in the management of obstetric crises. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

PubMed

Turner, S; Ollerhead, E; Cook, A

2017-10-09

In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and logistically challenging. Identifying such research priorities can be particularly challenging for complex public health problems as there is a need to consult a number of experts across disciplines and with a range of expertise. This study investigated the use of Delphi-like survey methods in identifying important research priorities relating to health inequalities and framing tractable research questions for topic areas identified. The study was conducted in two phases, both using Delphi-like survey methods. Firstly, public health professionals with an interest in health inequalities were asked to identify research priorities. Secondly academic researchers were asked to frame tractable research questions relating to the priorities identified. These research priorities identified using Delphi-like survey methods were subsequently compared to those identified using different methods. A total of 52 public health professionals and 21 academics across the United Kingdom agreed to take part. The response rates were high, from public health professionals across three survey rounds (69%, 50% and 40%) and from academics across one round (52%), indicating that participants were receptive to the method and motivated to respond. The themes identified as encompassing the most important research priorities were mental health, healthy environment and health behaviours. Within these themes, the topic areas that emerged most strongly included community interventions for prevention of mental health problems and the food and alcohol environment. Some responses received from academic researchers were (as requested) in the form of tractable research questions, whereas others contributed further potential topic areas instead. Delphi-like survey methods are practical and productive as a means of obtaining opinions from a wide number of relevant experts identifying potential priority topic areas for research; however, this method is less appropriate for framing tractable research questions.

Effective self-management strategies for bipolar disorder: A community-engaged Delphi Consensus Consultation study.

PubMed

Michalak, Erin E; Suto, Melinda J; Barnes, Steven J; Hou, Sharon; Lapsley, Sara; Scott, Mike W; Murray, Greg; Austin, Jehannine; Elliott, Nusha Balram; Berk, Lesley; Crest Bd

2016-12-01

Self-management represents an important complement to psychosocial treatments for bipolar disorder (BD), but research is limited. Specifically, little is known about self-management approaches for elevated mood states; this study investigated self-management strategies for: (1) maintaining balance in mood, and (2) stopping progression into hypomania/mania. To identify the common components of BD self-management, Delphi Consensus Consultation methods were combined with a Community-Based Participatory Research (CBPR) approach across five study phases: (1) Qualitative dataset content analysis; (2) Academic/grey literature reviews; (3) Content analysis; (4) Two Delphi rounds (rating strategies on a 5-point Likert scale, Very Unhelpful-Very Helpful), and; (5) Quantitative analysis and interpretation. Participants were people with BD and healthcare providers. Phases 1 and 2 identified 262 and 3940 candidate strategies, respectively; 3709 were discarded as duplicates/unintelligible. The remaining 493 were assessed via Delphi methods in Phase 4: 101 people with BD and 52 healthcare providers participated in Round 1; 83 of the BD panel (82%) and 43 of the healthcare provider panel (83%) participated in Round 2-exploratory factor analysis (EFA) was conducted on Round 2 results. EFA was underpowered and sample was not ethnically diverse, limiting generalizability. High concordance was observed in ratings of strategy effectiveness between the two panels. Future research could usefully investigate the provisional discovery here of underlying factors which link individual strategies. For example, 'maintaining hope' underpinned strategies for maintaining balance, and 'decreasing use of stimulants' underpinned strategies to interrupt hypo/manic ascent. There is merit in combining CBPR and Delphi methods. Copyright © 2016 Elsevier B.V. All rights reserved.

Development of the Assessment Items of Debris Flow Using the Delphi Method

NASA Astrophysics Data System (ADS)

Byun, Yosep; Seong, Joohyun; Kim, Mingi; Park, Kyunghan; Yoon, Hyungkoo

2016-04-01

In recent years in Korea, Typhoon and the localized extreme rainfall caused by the abnormal climate has increased. Accordingly, debris flow is becoming one of the most dangerous natural disaster. This study aimed to develop the assessment items which can be used for conducting damage investigation of debris flow. Delphi method was applied to classify the realms of assessment items. As a result, 29 assessment items which can be classified into 6 groups were determined.

A Delphi forecast of technology in education

NASA Technical Reports Server (NTRS)

Robinson, B. E.

1973-01-01

The results are reported of a Delphi forecast of the utilization and social impacts of large-scale educational telecommunications technology. The focus is on both forecasting methodology and educational technology. The various methods of forecasting used by futurists are analyzed from the perspective of the most appropriate method for a prognosticator of educational technology, and review and critical analysis are presented of previous forecasts and studies. Graphic responses, summarized comments, and a scenario of education in 1990 are presented.

Using a Delphi process to establish consensus on emergency medicine clerkship competencies.

PubMed

Penciner, Rick; Langhan, Trevor; Lee, Richard; McEwen, Jill; Woods, Robert A; Bandiera, Glen

2011-01-01

Currently, there is no consensus on the core competencies required for emergency medicine (EM) clerkships in Canada. Existing EM curricula have been developed through informal consensus or local efforts. The Delphi process has been used extensively as a means for establishing consensus. The purpose of this project was to define core competencies for EM clerkships in Canada, to validate a Delphi process in the context of national curriculum development, and to demonstrate the adoption of the CanMEDS physician competency paradigm in the undergraduate medical education realm. Using a modified Delphi process, we developed a consensus amongst a panel of expert emergency physicians from across Canada utilizing the CanMEDS 2005 Physician Competency Framework. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). This study demonstrated that a modified Delphi process can result in a strong consensus around a realistic number of core competencies for EM clerkships. We propose that such a method could be used by other medical specialties and health professions to develop rotation-specific core competencies.

Application of Delphi expert panel in joint venture projects

NASA Astrophysics Data System (ADS)

Adnan, H.; Rosman, M. R.; Rashid, Z. Z. Ahmad; Mohamad Yusuwan, N.; Bakhary, N. A.

2018-02-01

This study was conducted with the aim to identify the application of the Delphi Technique in validating findings obtained from questionnaire surveys and interviews done in- depth on the subject of joint venture projects in Malaysia. The Delphi technique aims to achieve a consensus of opinion amongst expert panellist that were selected on the primary factors in JV projects. To achieve research objectives, a progressive series of questions was designed where a selected panel of expert to confirm and validate the final findings. The rationale, benefits, limitations and recommendations for the use of Delphi were given in this study. From the literature review done, twenty-one factors were identified as critical factors to the making any joint venture project successful. Detail information from contractors were obtained by using the questionnaire survey method and forty-three in-depth interviews were carried out. Trust between partners, mutual understanding, partner selection criteria, agreement of contract, objective compatibility, conflict, and commitment were confirmed by the Delphi panel to be the critical success factors besides another fourteen factors which were found to be the Failure Reduction Criteria. Delphi techniques has proven to successfully assist in recognising the main factors and would be beneficial in supplementing the success of joint venture arrangements application for construction projects in Malaysia.

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists

PubMed Central

2017-01-01

Purpose This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. Methods A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects’ responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Results Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Conclusion Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience. PMID:28900069

Development of quality indicators for physiotherapy for patients with PAOD in the Netherlands: a Delphi study.

PubMed

Gijsbers, H J H; Lauret, G J; van Hofwegen, A; van Dockum, T A; Teijink, J A W; Hendriks, H J M

2016-06-01

The aim of the study was to develop quality indicators (QIs) for physiotherapy management of patients with intermittent claudication (IC) in the Netherlands. As part of an international six-step method to develop QIs, an online survey Delphi-procedure was completed. After two Delphi-rounds a validation round was performed. Twenty-six experts were recruited to participate in this study. Twenty-four experts completed two Delphi-rounds. A third round was conducted inviting 1200 qualified and registered physiotherapists of the Dutch integrated care network 'Claudicationet' to validate a draft set of quality indicators. Out of 83 potential QIs in the Dutch physiotherapy guideline on 'Intermittent claudication', consensus among the experts selected nine indicators. All nine quality indicators were validated by 300 physiotherapists. A final set of nine indicators was derived from (1) a Dutch evidence-based physiotherapy guideline, (2) an expert Delphi procedure and (3) a validation by 300 physiotherapists. This set of indicators should be validated in clinical practice. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

A Delphi Investigation into Future Trends in E-Learning in Israel

ERIC Educational Resources Information Center

Aharony, Noa; Bronstein, Jenny

2014-01-01

The purpose of this study is to investigate the views and opinions of e-learning experts regarding future trends in the e-learning arena. The Delphi technique was chosen as a method of study. This technique is an efficient and effective group communication process designed to systematically elicit judgments from experts in their selected area of…

Views and Dreams: A Delphi Investigation into Library 2.0 Applications

ERIC Educational Resources Information Center

Bronstein, Jenny; Aharony, Noa

2009-01-01

The study's purpose was to investigate the views and opinions of librarians about the implementation of Web 2.0 technologies into library operations and services. The Delphi technique was chosen as the method of inquiry in this study, in which a group of panelists graded the desirability and probability of a list of statements. Thirty-nine…

Designing Graduate-Level Plant Breeding Curriculum: A Delphi Study of Private Sector Stakeholder Opinions

ERIC Educational Resources Information Center

Miller, Jane K.; Repinski, Shelby L.; Hayes, Kathryn N.; Bliss, Frederick A.; Trexler, Cary J.

2011-01-01

A broad-based survey using the Delphi method was conducted to garner current information from private sector stakeholders and build consensus opinions supporting key ideas for enhancing plant breeder education and training. This study asked respondents to suggest and rate topics and content they deemed most important to plant breeding graduate…

Identification of Core Competencies for an Undergraduate Food Safety Curriculum Using a Modified Delphi Approach

ERIC Educational Resources Information Center

Johnston, Lynette M.; Wiedmann, Martin; Orta-Ramirez, Alicia; Oliver, Haley F.; Nightingale, Kendra K.; Moore, Christina M.; Stevenson, Clinton D.; Jaykus, Lee-Ann

2014-01-01

Identification of core competencies for undergraduates in food safety is critical to assure courses and curricula are appropriate in maintaining a well-qualified food safety workforce. The purpose of this study was to identify and refine core competencies relevant to postsecondary food safety education using a modified Delphi method. Twenty-nine…

The Underutilization of Information and Communication Technology-Assisted Collaborative Project-Based Learning among International Educators: A Delphi Study

ERIC Educational Resources Information Center

Kramer, Barry S.; Walker, Andrew E.; Brill, Jennifer M.

2007-01-01

This study explores the barriers associated with teachers implementing information and communication technology-assisted collaborative project-based learning (ICTCPrjBL) as a classroom teaching methodology with students. We used a Web-based Delphi method to engage experienced educators in anonymous consensus building consisting of three rounds of…

Greenhouse Facility Management Experts Identification of Competencies and Teaching Methods to Support Secondary Agricultural Education Instructors: A Modified Delphi Study

ERIC Educational Resources Information Center

Franklin, Edward A.

2011-01-01

In this study the Delphi technique has been used to develop a list of educational competencies for preparing secondary agricultural education instructors to effectively manage their school greenhouse facilities. The use of specialized facilities in agricultural education requires appropriate preparation of agricultural education teachers. The…

A Delphi Study on Technology Enhanced Learning (TEL) Applied on Computer Science (CS) Skills

ERIC Educational Resources Information Center

Porta, Marcela; Mas-Machuca, Marta; Martinez-Costa, Carme; Maillet, Katherine

2012-01-01

Technology Enhanced Learning (TEL) is a new pedagogical domain aiming to study the usage of information and communication technologies to support teaching and learning. The following study investigated how this domain is used to increase technical skills in Computer Science (CS). A Delphi method was applied, using three-rounds of online survey…

77 FR 2773 - Proposed Information Collection Request; Notice of New Requirements and Procedures for Grant...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-01-19

... the Office of Management and Budget (OMB). You may submit comments by the following methods: Email... required to have electronic Internet access to register in the Delphi eInvoicing system. Grantees will be.... The identities of system users must be verified prior to receiving access to the Delphi eInvoicing...

Identifying Threshold Concepts for Information Literacy: A Delphi Study

ERIC Educational Resources Information Center

Townsend, Lori; Hofer, Amy R.; Hanick, Silvia Lin; Brunetti, Korey

2016-01-01

This study used the Delphi method to engage expert practitioners on the topic of threshold concepts--core ideas and processes in a discipline that students need to grasp in order to progress in their learning, but that are often unspoken or unrecognized by expert practitioners--for information literacy. A panel of experts considered two questions:…

Emerging Issues in the Utilization of Weblogs in Higher Education Classrooms

ERIC Educational Resources Information Center

Ayao-ao, Shirley

2014-01-01

This paper examines the emerging issues in the utilization of weblogs in Philippine higher education and how these issues affect the performance of students. This study used a modified Delphi method. The Delphi panel consisted of 12 experts in the integration of technology, particularly blogs, in their teaching. The study yielded the following…

Trends that FCS Education Should Address: A Delphi Study Reveals Top 16

ERIC Educational Resources Information Center

Alexander, Karen L.; Davis, Kimberlee

2011-01-01

This study used the Delphi method to identify trends of importance to family and consumer sciences (FCS) education. A panel of 21 FCS education experts identified 16 trends and evaluated them by importance, desirability, feasibility, and confidence in validity of the trend. Nutrition appeared as a top priority, followed by consumer economics. The…

Delphi in Criminal Justice Policy: A Case Study on Judgmental Forecasting

ERIC Educational Resources Information Center

Loyens, Kim; Maesschalck, Jeroen; Bouckaert, Geert

2011-01-01

This article provides an in-depth case study analysis of a pilot project organized by the section "Strategic Analysis" of the Belgian Federal Police. Using the Delphi method, which is a judgmental forecasting technique, a panel of experts was questioned about future developments of crime, based on their expertise in criminal or social…

Research Priorities for YouTube and Video-Sharing Technologies: A Delphi Study

ERIC Educational Resources Information Center

Snelson, Chareen; Rice, Kerry; Wyzard, Constance

2012-01-01

Online video-sharing services, particularly YouTube, have gained an audience of billions of users including educators and scholars. While the academic literature provides some evidence that YouTube has been studied and written about, little is known about priorities for YouTube research. The study employed the Delphi method to obtain a consensus…

The Essential Components of Coach Training for Mental Health Professionals: A Delphi Study

ERIC Educational Resources Information Center

Moriarity, Marlene Therese

2010-01-01

Purpose. The purpose of this study was to discover how coach training experts define coaching and what they would identify to be the essential components of a coach training program for mental health professionals. Methods. A panel of nine experts, through an iterative Delphi process of responding to three rounds of questionnaires, provided…

Financial Leadership Competencies for Public College and University Presidential Leaders in Georgia: A Delphi Study

ERIC Educational Resources Information Center

Jones, Susan M.

2011-01-01

The purpose of the mixed-method Delphi study is to identify the financial leadership competencies considered most important in operating public higher education institutions. The current study also determined whether differences existed in the perceptions of participants' age, level of education, years of service as a president, the number of…

The Semiconductor Industry and Emerging Technologies: A Study Using a Modified Delphi Method

ERIC Educational Resources Information Center

Jordan, Edgar A.

2010-01-01

The purpose of this qualitative descriptive study was to determine what leaders in the semiconductor industry thought the future of computing would look like and what emerging materials showed the most promise to overcome the current theoretical limit of 10 nanometers for silicon dioxide. The researcher used a modified Delphi technique in two…

Verification of a Quality Management Theory: Using a Delphi Study

PubMed Central

Mosadeghrad, Ali Mohammad

2013-01-01

Background: A model of quality management called Strategic Collaborative Quality Management (SCQM) model was developed based on the quality management literature review, the findings of a survey on quality management assessment in healthcare organisations, semi-structured interviews with healthcare stakeholders, and a Delphi study on healthcare quality management experts. The purpose of this study was to verify the SCQM model. Methods: The proposed model was further developed using feedback from thirty quality management experts using a Delphi method. Further, a guidebook for its implementation was prepared including a road map and performance measurement. Results: The research led to the development of a context-specific model of quality management for healthcare organisations and a series of guidelines for its implementation. Conclusion: A proper model of quality management should be developed and implemented properly in healthcare organisations to achieve business excellence. PMID:24596883

Assessment of critical thinking: a Delphi study.

PubMed

Paul, Sheila A

2014-11-01

Nurse educators are responsible for preparing nurses who critically analyze patient information and provide meaningful interventions in today's complex health care system. By using the Delphi research method, this study, utilized the specialized and experiential knowledge of Certified Nurse Educators. This original Delphi research study asked Certified Nurse Educators how to assess the critical-thinking ability of nursing students in the clinical setting. The results showed that nurse educators need time, during the clinical experience, to accurately assess each individual nursing student. This study demonstrated the need for extended student clinical time, and a variety of clinical learning assessment tools. Copyright © 2014 Elsevier Ltd. All rights reserved.

Using the Delphi method to develop nursing-sensitive quality indicators for the NICU.

PubMed

Chen, Lin; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-02-01

To develop nursing-sensitive quality indicators consistent with current medical practices in Chinese neonatal intensive care units. The development of nursing-sensitive quality indicators has become a top priority in nursing management. To the best of our knowledge, there has been no objective, scientific and sensitive evaluation of the quality of neonatal intensive care unit nursing in China. A modified Delphi technique was used to seek opinions from experts about what should be used and prioritised as indicators of quality care in neonatal intensive care unit nursing. Based on a literature review, we identified 21 indicators of nursing-sensitive quality in the neonatal intensive care unit. Our group of 11 consultants chose 13 indicators to be discussed using the Delphi method. In October and November 2014, 39 neonatal intensive care unit experts in 18 tertiary hospitals spread across six provinces participated in two rounds of Delphi panels. Of the 13 indicators discussed, 11 were identified as indicators of nursing-sensitive quality in the neonatal intensive care unit: rate of nosocomial infections, rate of accidental endotracheal extubation, rate of errors in medication administration, rate of treatment for pain, rate of peripheral venous extravasation, rate of compliance with handwashing techniques, incidence of pressure ulcers, incidence of noise, the bed-to-care ratio, the proportion of nurses with greater than five years neonatal intensive care unit experience and incidence of retinopathy. The 11 neonatal intensive care unit nursing-sensitive indicators identified by the Delphi method integrated with basic Chinese practices provide a basis for nursing management and the monitoring of nursing quality. This study identified nursing-sensitive quality indicators for neonatal intensive care unit care that are suitable for current clinical practice in China. © 2016 John Wiley & Sons Ltd.

Evaluating the construct of triage acuity against a set of reference vignettes developed via modified Delphi method.

PubMed

Twomey, Michèle; Wallis, Lee A; Myers, Jonathan E

2014-07-01

To evaluate the construct of triage acuity as measured by the South African Triage Scale (SATS) against a set of reference vignettes. A modified Delphi method was used to develop a set of reference vignettes. Delphi participants completed a 2-round consensus-building process, and independently assigned triage acuity ratings to 100 written vignettes unaware of the ratings given by others. Triage acuity ratings were summarised for all vignettes, and only those that reached 80% consensus during round 2 were included in the reference set. Triage ratings for the reference vignettes given by two independent experts using the SATS were compared with the ratings given by the international Delphi panel. Measures of sensitivity, specificity, associated percentages for over-triage/under-triage were used to evaluate the construct of triage acuity (as measured by the SATS) by examining the association between the ratings by the two experts and the international panel. On completion of the Delphi process, 42 of the 100 vignettes reached 80% consensus on their acuity rating and made up the reference set. On average, over all acuity levels, sensitivity was 74% (CI 64% to 82%), specificity 92% (CI 87% to 94%), under-triage occurred 14% (CI 8% to 23%) and over-triage 12% (CI 8% to 23%) of the time. The results of this study provide an alternative to evaluating triage scales against the construct of acuity as measured with the SATS. This method of using 80% consensus vignettes may, however, systematically bias the validity estimate towards better performance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Phase 2 of CATALISE: A Multinational and Multidisciplinary Delphi Consensus Study of Problems with Language Development--Terminology

ERIC Educational Resources Information Center

Bishop, Dorothy V. M.; Snowling, Margaret J.; Thompson, Paul A.; Greenhalgh, Trisha

2017-01-01

Background: Lack of agreement about criteria and terminology for children's language problems affects access to services as well as hindering research and practice. We report the second phase of a study using an online Delphi method to address these issues. In the first phase, we focused on criteria for language disorder. Here we consider…

Teacher Leadership: A Delphi Study of Factors in Building Teacher Leadership Capacity in Elementary Educational Organizations

ERIC Educational Resources Information Center

Castilleja Gray, Beatrice

2016-01-01

Purpose: The purpose of this qualitative study was to identify and describe the most important factors that motivate or deter teachers in deciding to take on the informal or formal role of teacher-leader in Riverside County elementary school districts. Methodology: Endemic of a Delphi method, the instruments used within this study collected data…

Development of an Adolescent Alcohol Misuse Intervention Based on the Prototype Willingness Model: A Delphi Study

ERIC Educational Resources Information Center

Davies, Emma; Martin, Jilly; Foxcroft, David

2016-01-01

Purpose: The purpose of this paper is to report on the use of the Delphi method to gain expert feedback on the identification of behaviour change techniques (BCTs) and development of a novel intervention to reduce adolescent alcohol misuse, based on the Prototype Willingness Model (PWM) of health risk behaviour. Design/methodology/approach: Four…

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

[Construction of a physiological aging scale for healthy people based on a modified Delphi method].

PubMed

Long, Yao; Zhou, Xuan; Deng, Pengfei; Liao, Xiong; Wu, Lei; Zhou, Jianming; Huang, Helang

2016-04-01

To build a physiological aging scale for healthy people.
 We collected age-related physiologic items through literature screening and expert interview. Two rounds of Delphi were implemented. The importance, feasibility and the degree of authority for the physiological index system were graded. Using analytic hierarchy process, we determined the weight of dimensions and items.
 Using Delphy mothod, 17 physiological and other professional experts offered the results as follow: coefficient of expert authorities Cr was 0.86±0.03, coordination coefficients for the first and second round were 0.264(χ2=229.691, P<0.001) and 0.293(χ2=228.474，P<0.001), respectively. The consistency was good. The aging scale for healthy people included 3 dimensions, namely physical form, feeling movement and functional status. Each dimension had 8 items. The weight coefficients for the 3 dimensions were 0.54, 0.16, and 0.30, respectively. The Cronbach's α coefficient of the scale was 0.893, the reliability was 0.796, and the variance of the common factor was 58.17%.
 The improved Delphi method or physiological aging scale is satisfied, which can provide reference for the evaluation of aging.

Defining the role of a forensic hospital registered nurse using the Delphi method.

PubMed

Newman, Claire; Patterson, Karen; Eason, Michelle; Short, Ben

2016-11-01

A Delphi survey was undertaken to refine the position description of a registered nurse working in a forensic hospital, in New South Wales, Australia. Prior to commencing operation in 2008, position descriptions were developed from a review of legislation, as well as policies and procedures used by existing forensic mental health services in Australia. With an established workforce and an evolving model of care, a review of the initial registered nurse position description was required. An online Delphi survey was undertaken. Eight executive (88.9%) and 12 (58.3%) senior nursing staff participated in the first survey round. A total of four survey rounds were completed. At the final round, there was consensus (70%) that the revised position description was either very or somewhat suitable. There were a total of nine statements, from 31 originally produced in round 1, that did not reach consensus. The Delphi survey enabled a process for refining the Forensic Hospital registered nurse position description. Methods that facilitate executive and senior nursing staff consensus in the development and review of position descriptions should be considered in nursing management. © 2016 John Wiley & Sons Ltd.

Anatomical Society core regional anatomy syllabus for undergraduate medicine: the Delphi process.

PubMed

Smith, C F; Finn, G M; Stewart, J; McHanwell, S

2016-01-01

A modified Delphi method was employed to seek consensus when revising the UK and Ireland's core syllabus for regional anatomy in undergraduate medicine. A Delphi panel was constructed involving 'expert' (individuals with at least 5 years' experience in teaching medical students anatomy at the level required for graduation). The panel (n = 39) was selected and nominated by members of Council and/or the Education Committee of the Anatomical Society and included a range of specialists including surgeons, radiologists and anatomists. The experts were asked in two stages to 'accept', 'reject' or 'modify' (first stage only) each learning outcome. A third stage, which was not part of the Delphi method, then allowed the original authors of the syllabus to make changes either to correct any anatomical errors or to make minor syntax changes. From the original syllabus of 182 learning outcomes, removing the neuroanatomy component (163), 23 learning outcomes (15%) remained unchanged, seven learning outcomes were removed and two new learning outcomes added. The remaining 133 learning outcomes were modified. All learning outcomes on the new core syllabus achieved over 90% acceptance by the panel. © 2015 Anatomical Society.

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study.

PubMed

Blackwood, Bronagh; Ringrow, Suzanne; Clarke, Mike; Marshall, John; Rose, Louise; Williamson, Paula; McAuley, Danny

2015-08-20

Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children. We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes. The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

A modified Delphi method toward multidisciplinary consensus on functional convalescence recommendations after abdominal surgery.

PubMed

van Vliet, Daphne C R; van der Meij, Eva; Bouwsma, Esther V A; Vonk Noordegraaf, Antonie; van den Heuvel, Baukje; Meijerink, Wilhelmus J H J; van Baal, W Marchien; Huirne, Judith A F; Anema, Johannes R

2016-12-01

Evidence-based information on the resumption of daily activities following uncomplicated abdominal surgery is scarce and not yet standardized in medical guidelines. As a consequence, convalescence recommendations are generally not provided after surgery, leading to patients' insecurity, needlessly delayed recovery and prolonged sick leave. The aim of this study was to generate consensus-based multidisciplinary convalescence recommendations, including advice on return to work, applicable for both patients and physicians. Using a modified Delphi method among a multidisciplinary panel of 13 experts consisting of surgeons, occupational physicians and general practitioners, detailed recommendations were developed for graded resumption of 34 activities after uncomplicated laparoscopic cholecystectomy, laparoscopic and open appendectomy, laparoscopic and open colectomy and laparoscopic and open inguinal hernia repair. A sample of occupational physicians, general practitioners and surgeons assessed the recommendations on feasibility in daily practice. The response of this group of care providers was discussed with the experts in the final Delphi questionnaire round. Out of initially 56 activities, the expert panel selected 34 relevant activities for which convalescence recommendations were developed. After four Delphi rounds, consensus was reached for all of the 34 activities for all the surgical procedures. A sample of occupational physicians, general practitioners and surgeons regarded the recommendations as feasible in daily practice. Multidisciplinary convalescence recommendations regarding uncomplicated laparoscopic cholecystectomy, appendectomy (laparoscopic, open), colectomy (laparoscopic, open) and inguinal hernia repair (laparoscopic, open) were developed by a modified Delphi procedure. Further research is required to evaluate whether these recommendations are realistic and effective in daily practice.

Standardizing hysteroscopy teaching: development of a curriculum using the Delphi method.

PubMed

Neveu, Marie-Emmanuelle; Debras, Elodie; Niro, Julien; Fernandez, Hervé; Panel, Pierre

2017-12-01

Hysteroscopy is performed often and in many indications but is challenging to learn. Hands-on training in live patients faces ethical, legal, and economic obstacles. Virtual reality simulation may hold promise as a hysteroscopy training tool. No validated curriculum specific in hysteroscopy exists. The aim of this study was to develop a hysteroscopy curriculum, using the Delphi method to identify skill requirements. Based on a literature review using the key words "curriculum," "simulation," and "hysteroscopy," we identified five technical and non-technical areas in which skills were required. Twenty hysteroscopy experts from different French hospital departments participated in Delphi rounds to select items in these five areas. The rounds were to be continued until 80-100% agreement was obtained for at least 60% of items. A curriculum was built based on the selected items and was evaluated in residents. From November 2014 to April 2015, 18 of 20 invited experts participated in three Delphi rounds. Of the 51 items selected during the first round, only 25 (49%) had 80-100% agreement during the second round, and a third round was therefore conducted. During this last round, 80-100% agreement was achieved for 31 (61%) items, which were used to create the curriculum. All 14 residents tested felt that a simulator training session was acceptable and helped them to improve their skills. We describe a simulation-based hysteroscopy curriculum focusing on skill requirements identified by a Delphi procedure. Its development allows standardization of training programs offered to residents.

Designing a Standardized Laparoscopy Curriculum for Gynecology Residents: A Delphi Approach

PubMed Central

Shore, Eliane M.; Lefebvre, Guylaine G.; Husslein, Heinrich; Bjerrum, Flemming; Sorensen, Jette Led; Grantcharov, Teodor P.

2015-01-01

Background Evidence suggests that simulation leads to improved operative skill, shorter operating room time, and better patient outcomes. Currently, no standardized laparoscopy curriculum exists for gynecology residents. Objective To design a structured laparoscopy curriculum for gynecology residents using Delphi consensus methodology. Methods This study began with Delphi methodology to determine expert consensus on the components of a gynecology laparoscopic skills curriculum. We generated a list of cognitive content, technical skills, and nontechnical skills for training in laparoscopic surgery, and asked 39 experts in gynecologic education to rate the items on a Likert scale (1–5) for inclusion in the curriculum. Consensus was predefined as Cronbach α of ≥ 0.80. We then conducted another Delphi survey with 9 experienced users of laparoscopic virtual reality simulators to delineate relevant curricular tasks. Finally, a cross-sectional design defined benchmark scores for all identified tasks, with 10 experienced gynecologic surgeons performing the identified tasks at basic, intermediate, and advanced levels. Results Consensus (Cronbach α = 0.85) was achieved in the first round of the curriculum Delphi, and after 2 rounds (Cronbach α = 0.80) in the virtual reality curriculum Delphi. Consensus was reached for cognitive, technical, and nontechnical skills as well as for 6 virtual reality tasks. Median time and economy of movement scores defined benchmarks for all tasks. Conclusions This study used Delphi consensus to develop a comprehensive curriculum for teaching gynecologic laparoscopy. The curriculum conforms to current educational standards of proficiency-based training, and is suggested as a standard in residency programs. PMID:26221434

[Identification of the scope of practice for dental nurses with Delphi method].

PubMed

Li, Yu-Hong; Lu, Yue-Cen; Huang, Yao; Ruan, Hong; Wu, Zheng-Yi

2016-10-01

To identify the practice scope of dental nurses under the new situations. The draft of scope of practice for dental nurses was based on theoretical analysis, literature review and consultation of advisory panel, and the final scope of practice for dental nurses was established by using the Delphi method. Statistical analysis was implemented using coefficient of variation, Kendall W with SPSS 17.0 software package. Thirty experts were consulted twice by using the Delphi method. The effective rates of two rounds of questionnaire were 100% and 73.3%, respectively. The authority coefficient was 0.837, and the P value of expert coordination coefficients W was less than 0.05. There were totally 116 suggestions from the experts, and 96 were accepted. The scope of practice for dental nurses was finally established, including 4 primary indexes and 25 secondary indexes. The scope of practice for dental nurses under the new situations is established in China through scientific methods. It is favorable for position management of dental nurses and may promote the development of nurse specialists in dental clinic.

Use of the Delphi method in resolving complex water resources issues

USGS Publications Warehouse

Taylor, J.G.; Ryder, S.D.

2003-01-01

The tri-state river basins, shared by Georgia, Alabama, and Florida, are being modeled by the U.S. Fish and Wildlife Service and the U.S. Army Corps of Engineers to help facilitate agreement in an acrimonious water dispute among these different state governments. Modeling of such basin reservoir operations requires parallel understanding of several river system components: hydropower production, flood control, municipal and industrial water use, navigation, and reservoir fisheries requirements. The Delphi method, using repetitive surveying of experts, was applied to determine fisheries' water and lake-level requirements on 25 reservoirs in these interstate basins. The Delphi technique allowed the needs and requirements of fish populations to be brought into the modeling effort on equal footing with other water supply and demand components. When the subject matter is concisely defined and limited, this technique can rapidly assess expert opinion on any natural resource issue, and even move expert opinion toward greater agreement.

Creation and Delphi-method refinement of pediatric disaster triage simulations.

PubMed

Cicero, Mark X; Brown, Linda; Overly, Frank; Yarzebski, Jorge; Meckler, Garth; Fuchs, Susan; Tomassoni, Anthony; Aghababian, Richard; Chung, Sarita; Garrett, Andrew; Fagbuyi, Daniel; Adelgais, Kathleen; Goldman, Ran; Parker, James; Auerbach, Marc; Riera, Antonio; Cone, David; Baum, Carl R

2014-01-01

There is a need for rigorously designed pediatric disaster triage (PDT) training simulations for paramedics. First, we sought to design three multiple patient incidents for EMS provider training simulations. Our second objective was to determine the appropriate interventions and triage level for each victim in each of the simulations and develop evaluation instruments for each simulation. The final objective was to ensure that each simulation and evaluation tool was free of bias toward any specific PDT strategy. We created mixed-methods disaster simulation scenarios with pediatric victims: a school shooting, a school bus crash, and a multiple-victim house fire. Standardized patients, high-fidelity manikins, and low-fidelity manikins were used to portray the victims. Each simulation had similar acuity of injuries and 10 victims. Examples include children with special health-care needs, gunshot wounds, and smoke inhalation. Checklist-based evaluation tools and behaviorally anchored global assessments of function were created for each simulation. Eight physicians and paramedics from areas with differing PDT strategies were recruited as Subject Matter Experts (SMEs) for a modified Delphi iterative critique of the simulations and evaluation tools. The modified Delphi was managed with an online survey tool. The SMEs provided an expected triage category for each patient. The target for modified Delphi consensus was ≥85%. Using Likert scales and free text, the SMEs assessed the validity of the simulations, including instances of bias toward a specific PDT strategy, clarity of learning objectives, and the correlation of the evaluation tools to the learning objectives and scenarios. After two rounds of the modified Delphi, consensus for expected triage level was >85% for 28 of 30 victims, with the remaining two achieving >85% consensus after three Delphi iterations. To achieve consensus, we amended 11 instances of bias toward a specific PDT strategy and corrected 10 instances of noncorrelation between evaluations and simulation. The modified Delphi process, used to derive novel PDT simulation and evaluation tools, yielded a high degree of consensus among the SMEs, and eliminated biases toward specific PDT strategies in the evaluations. The simulations and evaluation tools may now be tested for reliability and validity as part of a prehospital PDT curriculum.

75 FR 16513 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-01

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8th, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture... location of Delphi Packard Electrical/Electronic Architecture, a subsidiary of Delphi Corporation. The...

Reflections of Tomorrow: Lifelong Learning and the Public Library (A Delphi Study). Excerpts.

ERIC Educational Resources Information Center

Weingand, Darlene E.

This study focuses on the question of whether the public library can or will be one of the non-formal providers of lifelong learning in Minnesota, and uses the Delphi method to discover in what way the public library as it is perceived by various publics could become an active participant in this dimension of the educational process. Five groups…

A Modified Delphi to Identify the Significant Works Pertaining to the Understanding of Reading Comprehension and Content Analysis of the Identified Works

ERIC Educational Resources Information Center

Zunker, Norma D.; Pearce, Daniel L.

2012-01-01

The first part of this study explored the significant works pertaining to the understanding of reading comprehension using a Modified Delphi Method. A panel of reading comprehension experts identified 19 works they considered to be significant to the understanding of reading comprehension. The panel of experts identified the reasons they…

What works for wellbeing in culture and sport? Report of a DELPHI process to support coproduction and establish principles and parameters of an evidence review.

PubMed

Daykin, Norma; Mansfield, Louise; Payne, Annette; Kay, Tess; Meads, Catherine; D'Innocenzo, Giorgia; Burnett, Adele; Dolan, Paul; Julier, Guy; Longworth, Louise; Tomlinson, Alan; Testoni, Stefano; Victor, Christina

2017-09-01

There is a growing recognition of the ways in which culture and sport can contribute to wellbeing. A strong evidence base is needed to support innovative service development and a 3-year research programme is being undertaken to capture best evidence of wellbeing impacts and outcomes of cultural and sporting activities in order to inform UK policy and practice. This article provides an overview of methods and findings from an initial coproduction process with key stakeholders that sought to explore and agree principles and parameters of the evidence review for culture, sport and wellbeing (CSW). A two-stage DELPHI process was conducted with a purposeful sample of 57 stakeholders between August and December 2015. Participants were drawn from a range of culture and sport organisations and included commissioners and managers, policy makers, representatives of service delivery organisations (SDOs) and scholars. The DELPHI 1 questionnaire was developed from extensive consultation in July and August 2015. It explored definitions of wellbeing, the role of evidence, quality assessment, and the culture and sport populations, settings and interventions that are most likely to deliver wellbeing outcomes. Following further consultation, the results, presented as a series of ranked statements, were sent back to participants (DELPHI 2), which allowed them to reflect on and, if they wished, express agreement or disagreement with the emerging consensus. A total of 40 stakeholders (70.02%) responded to the DELPHI questionnaires. DELPHI 1 mapped areas of agreement and disagreement, confirmed in DELPHI 2. The exercise drew together the key priorities for the CSW evidence review. The DELPHI process, in combination with face-to-face deliberation, enabled stakeholders to engage in complex discussion and express nuanced priorities while also allowing the group to come to an overall consensus and agree outcomes. The results will inform the CSW evidence review programme until its completion in March 2018.

Preliminary identification of key clinical domains for outcome evaluation in fibromyalgia using the Delphi method: the Italian experience.

PubMed

Salaffi, F; Ciapetti, A; Sarzi Puttini, P; Atzeni, F; Iannuccelli, C; Di Franco, M; Cazzola, M; Bazzichi, L

2012-03-19

Fibromyalgia (FM) is a complex syndrome that, in Italy, affects at least 2% of the adult population. It is characterized by chronic widespread musculoskeletal pain often accompanied by multiple other symptoms. The aim of this study was to identify a set of clinical domains for FM considered relevant by both clinicians and patients using a consensus process. Consensus was achieved using the Delphi method based on questionnaires and systematic, controlled opinion feedback. The Delphi exercise involved a panel of 252 rheumatologists and 86 patients with FM as defined by the American College of Rheumatology criteria. All of the patients and clinicians were asked to rank the relative different domains of FM in order of priority. The content validity index (CVI) was used to establish the percentage agreement. The importance of each item was ranked on a 0-3 Likert scale. The frequency, mean relevance scores, and frequency importance product were also calculated. The Delphi exercise showed that the domains ranked highest by patients were similar to those of the clinicians, with the exception of tender point intensity (considered relevant by the clinicians but not by the patients) and environmental sensitivity (considered important by the patients but not by the clinicians). A final 8-item model was developed which was considered to demonstrate adequate validity. The Delphi exercises identified and ranked relevant key clinical domains that need to be assessed in FM research. On the basis of these results, a new patient-reported composite outcome index can be developed and used in clinical trials.

Delphi Rating on the Internet

PubMed Central

Deshpande, Aniruddha M.; Shiffman, Richard N.

2003-01-01

We designed an application to allow respondents to rate components of clinical guidelines on the Internet. Twenty-three invited experts completed the rating followed by a satisfaction survey using a 5-level Likert scale. The experts felt that Web data entry was convenient, acceptable and easily accessible. We conclude that Web-based Delphi rating for consensus development is a convenient and acceptable alternative to the traditional paper-based method. PMID:14728333

Summary of Research 1997, Department of Mechanical Engineering.

DTIC Science & Technology

1999-01-01

Maintenance for Diesel Engines 49 Control Architectures and Non-Linear Controllers for Unmanned Underwater Vehicles 38 Creep of Fiber Reinforced Metal...Technology Demonstration (ATD) 50 Development of Delphi Visual Performance Model 25 Diffraction Methods for the Accurate Measurement of Structure Factors...literature. If this could be done, a U.S. version of ORACLE (to be called DELPHI ) could be developed and used. The result has been the development of a

Metadata-driven Delphi rating on the Internet.

PubMed

Deshpande, Aniruddha M; Shiffman, Richard N; Nadkarni, Prakash M

2005-01-01

Paper-based data collection and analysis for consensus development is inefficient and error-prone. Computerized techniques that could improve efficiency, however, have been criticized as costly, inconvenient and difficult to use. We designed and implemented a metadata-driven Web-based Delphi rating and analysis tool, employing the flexible entity-attribute-value schema to create generic, reusable software. The software can be applied to various domains by altering the metadata; the programming code remains intact. This approach greatly reduces the marginal cost of re-using the software. We implemented our software to prepare for the Conference on Guidelines Standardization. Twenty-three invited experts completed the first round of the Delphi rating on the Web. For each participant, the software generated individualized reports that described the median rating and the disagreement index (calculated from the Interpercentile Range Adjusted for Symmetry) as defined by the RAND/UCLA Appropriateness Method. We evaluated the software with a satisfaction survey using a five-level Likert scale. The panelists felt that Web data entry was convenient (median 4, interquartile range [IQR] 4.0-5.0), acceptable (median 4.5, IQR 4.0-5.0) and easily accessible (median 5, IQR 4.0-5.0). We conclude that Web-based Delphi rating for consensus development is a convenient and acceptable alternative to the traditional paper-based method.

Application of Fuzzy Delphi in the Selection of COPD Risk Factors among Steel Industry Workers

PubMed Central

Ismail, Halim; Ismail, Rosnah; Ismail, Noor Hassim

2017-01-01

Background: The Delphi method has been widely applied in many study areas to systematically gather experts’ input on particular topic. Recently, it has become increasingly well known in health related research. This paper applied the Fuzzy Delphi method to enhance the validation of a questionnaire pertaining chronic obstructive pulmonary disease (COPD) risk factors among metal industry workers. Materials and Methods: A detailed, predefined list of possible risk factors for COPD among metal industry workers was created through a comprehensive and exhaustive review of literature from 1995 to 2015. The COPD questionnaire were distributed among people identified as occupational, environmental, and hygiene experts. Linguistic variable using Likert scale was used by the expert to indicate their expert judgment of each item. Subsequently, the linguistic variable was converted into a triangular fuzzy number. The average score of the fuzzy number will be used to determine whether the item will be removed or retained. Results: Ten experts were involved in evaluating 26 items. The experts were in agreement with most of the items, with an average fuzzy number range between 0.429 and 0.800. Two items were removed and three items were added, leaving a total 26 items selected for the COPD risk factors questionnaire. The experts were in disagreement with each other for items F10 and F11 where most of the experts claimed that the question is too subjective and based on self-perception only. Conclusion: The fuzzy Delphi method enhanced the accuracy of the questionnaire pertaining to COPD risk factors, and decreased the length of the established tools. PMID:28638424

Designing Excellence and Quality Model for Training Centers of Primary Health Care: A Delphi Method Study.

PubMed

Tabrizi, Jafar-Sadegh; Farahbakhsh, Mostafa; Shahgoli, Javad; Rahbar, Mohammad Reza; Naghavi-Behzad, Mohammad; Ahadi, Hamid-Reza; Azami-Aghdash, Saber

2015-10-01

Excellence and quality models are comprehensive methods for improving the quality of healthcare. The aim of this study was to design excellence and quality model for training centers of primary health care using Delphi method. In this study, Delphi method was used. First, comprehensive information were collected using literature review. In extracted references, 39 models were identified from 34 countries and related sub-criteria and standards were extracted from 34 models (from primary 39 models). Then primary pattern including 8 criteria, 55 sub-criteria, and 236 standards was developed as a Delphi questionnaire and evaluated in four stages by 9 specialists of health care system in Tabriz and 50 specialists from all around the country. Designed primary model (8 criteria, 55 sub-criteria, and 236 standards) were concluded with 8 criteria, 45 sub-criteria, and 192 standards after 4 stages of evaluations by specialists. Major criteria of the model are leadership, strategic and operational planning, resource management, information analysis, human resources management, process management, costumer results, and functional results, where the top score was assigned as 1000 by specialists. Functional results had the maximum score of 195 whereas planning had the minimum score of 60. Furthermore the most and the least sub-criteria was for leadership with 10 sub-criteria and strategic planning with 3 sub-criteria, respectively. The model that introduced in this research has been designed following 34 reference models of the world. This model could provide a proper frame for managers of health system in improving quality.

The development of ethical guidelines for nurses' collegiality using the Delphi method.

PubMed

Kangasniemi, Mari; Arala, Katariina; Becker, Eve; Suutarla, Anna; Haapa, Toni; Korhonen, Anne

2017-08-01

Nurses' collegiality is topical because patient care is complicated, requiring shared knowledge and working methods. Nurses' collaboration has been supported by a number of different working models, but there has been less focus on ethics. This study aimed to develop nurses' collegiality guidelines using the Delphi method. Two online panels of Finnish experts, with 35 and 40 members, used the four-step Delphi method in December 2013 and January 2014. They reformulated the items of nurses' collegiality identified by the literature and rated based on validity and importance. Content analysis and descriptive statistical methods were used to analyze the data, and the nurses' collegiality guidelines were formulated. Ethical considerations: Organizational approval was received, and an informed consent was obtained from all participants. Information about the voluntary nature of participation was provided. During the first Delphi panel round, a number of items were reformulated and added, resulting in 32 reformulated items. As a result of the second round, 8 of the 32 items scored an agreement rate of more than 75%, with the most rated item being collegiality means that professionals respect each other. The item with second highest rating was collegiality has a common objective: what is best for patients, followed by the third highest which was professional ethics is the basis of collegiality. Nurses' collegiality and its content are well recognized in clinical practice but seldom studied. Collegiality can be supported by guidelines, and nurses working in clinical practice, together with teachers and managers, have shared responsibilities to support and develop it. More research in different nursing environments is needed to improve understanding of the content and practice of nursing collegiality.

Pathological diagnostic criterion of blood and lymphatic vessel invasion in colorectal cancer: a framework for developing an objective pathological diagnostic system using the Delphi method, from the Pathology Working Group of the Japanese Society for Cancer of the Colon and Rectum

PubMed Central

Kojima, Motohiro; Shimazaki, Hideyuki; Iwaya, Keiichi; Kage, Masayoshi; Akiba, Jun; Ohkura, Yasuo; Horiguchi, Shinichiro; Shomori, Kohei; Kushima, Ryoji; Ajioka, Yoichi; Nomura, Shogo; Ochiai, Atsushi

2013-01-01

Aims The goal of this study is to create an objective pathological diagnostic system for blood and lymphatic vessel invasion (BLI). Methods 1450 surgically resected colorectal cancer specimens from eight hospitals were reviewed. Our first step was to compare the current practice of pathology assessment among eight hospitals. Then, H&E stained slides with or without histochemical/immunohistochemical staining were assessed by eight pathologists and concordance of BLI diagnosis was checked. In addition, histological findings associated with BLI having good concordance were reviewed. Based on these results, framework for developing diagnostic criterion was developed, using the Delphi method. The new criterion was evaluated using 40 colorectal cancer specimens. Results Frequency of BLI diagnoses, number of blocks obtained and stained for assessment of BLI varied among eight hospitals. Concordance was low for BLI diagnosis and was not any better when histochemical/immunohistochemical staining was provided. All histological findings associated with BLI from H&E staining were poor in agreement. However, observation of elastica-stained internal elastic membrane covering more than half of the circumference surrounding the tumour cluster as well as the presence of D2-40-stained endothelial cells covering more than half of the circumference surrounding the tumour cluster showed high concordance. Based on this observation, we developed a framework for pathological diagnostic criterion, using the Delphi method. This criterion was found to be useful in improving concordance of BLI diagnosis. Conclusions A framework for pathological diagnostic criterion was developed by reviewing concordance and using the Delphi method. The criterion developed may serve as the basis for creating a standardised procedure for pathological diagnosis. PMID:23592799

Development of a quality instrument for assessing the spontaneous reports of ADR/ADE using Delphi method in China.

PubMed

Chen, Lixun; Jiang, Ling; Shen, Aizong; Wei, Wei

2016-09-01

The frequently low quality of submitted spontaneous reports is of an increasing concern; to our knowledge, no validated instrument exists for assessing case reports' quality comprehensively enough. This work was conducted to develop such a quality instrument for assessing the spontaneous reports of adverse drug reaction (ADR)/adverse drug event (ADE) in China. Initial evaluation indicators were generated using systematic and literature data analysis. Final indicators and their weights were identified using Delphi method. The final quality instrument was developed by adopting the synthetic scoring method. A consensus was reached after four rounds of Delphi survey. The developed quality instrument consisted of 6 first-rank indicators, 18 second-rank indicators, and 115 third-rank indicators, and each rank indicator has been weighted. It evaluates the quality of spontaneous reports of ADR/ADE comprehensively and quantitatively on six parameters: authenticity, duplication, regulatory, completeness, vigilance level, and reporting time frame. The developed instrument was tested with good reliability and validity, which can be used to comprehensively and quantitatively assess the submitted spontaneous reports of ADR/ADE in China.

[The application of Delphi method in improving the score table for the hygienic quantifying and classification of hotels].

PubMed

Wang, Zi-yun; Liu, Yong-quan; Wang, Hong-bo; Zheng, Yang; Wu, Qi; Yang, Xia; Wu, Yong-wei; Zhao, Yi-ming

2009-04-01

By means of Delphi method and expert panel consultations, to choose suitable indicators and improve the score table for classifying the hygienic condition of hotels so that it can be widely used at nationwide. A two-round Delphi consultation was held to choose suitable indicators among 78 experts from 18 provinces, municipalities and autonomous regions. The suitable indicators were selected according to the importance recognized by experts. The average length of service in public health of the experts was (21.08 +/- 5.78) years and the average coefficient of experts' authorities C(r) was 0.89 +/- 0.07. The response rates of the two-round consultation were 98.72% (77/78) and 100.00% (77/77). The average feedback time were (8.49 +/- 4.48) d, (5.86 +/- 2.28) d, and the difference between two rounds was statistically significant (t = 4.60, P < 0.01). Kendall's coefficient were 0.26 (chi(2) = 723.63, P < 0.01), 0.32 (chi(2) = 635.65, P < 0.01) and opinions among experts became consistent. The score table for the hygienic quantifying and classification of hotels was composed of three first-class indicators (hygienic management, hygienic facilities and hygienic practices) and 36 second-class indicators. The weight coefficients of the three first-class indicators were 0.35, 0.34, 0.31. Delphi method might be used in a large-scale consultation among experts and be propitious to improve the score table for the hygienic quantifying and classification.

Habitat suitability index curves for paddlefish, developed by the delphi technique

USGS Publications Warehouse

Crance, John H.

1987-01-01

A Delphi exercise conducted with a panel of 11 experts on paddlefish (Polyodon spathula) and an evaluator resulted in 14 riverine habitat suitability index curves associating various life stages or activities of paddlefish with four variables: velocity, depth, substrate type, and temperature. The panel reached a consensus on six of the curves and eight to 10 panelists agreed on the others. Several panelists reported that they found the Delphi exercise to be a good learning experience, and they believed the technique is an appropriate interim method for developing suitability index curves when available data are inadequate for more conventional statistical analyses. Documentation of good paddlefish spawning habitat was the data need most commonly identified by the panelists.

DIET@NET: Best Practice Guidelines for dietary assessment in health research.

PubMed

Cade, Janet E; Warthon-Medina, Marisol; Albar, Salwa; Alwan, Nisreen A; Ness, Andrew; Roe, Mark; Wark, Petra A; Greathead, Katharine; Burley, Victoria J; Finglas, Paul; Johnson, Laura; Page, Polly; Roberts, Katharine; Steer, Toni; Hooson, Jozef; Greenwood, Darren C; Robinson, Sian

2017-11-15

Dietary assessment is complex, and strategies to select the most appropriate dietary assessment tool (DAT) in epidemiological research are needed. The DIETary Assessment Tool NETwork (DIET@NET) aimed to establish expert consensus on Best Practice Guidelines (BPGs) for dietary assessment using self-report. The BPGs were developed using the Delphi technique. Two Delphi rounds were conducted. A total of 131 experts were invited, and of these 65 accepted, with 48 completing Delphi round I and 51 completing Delphi round II. In all, a total of 57 experts from North America, Europe, Asia and Australia commented on the 47 suggested guidelines. Forty-three guidelines were generated, grouped into the following four stages: Stage I. Define what is to be measured in terms of dietary intake (what? who? and when?); Stage II. Investigate different types of DATs; Stage III. Evaluate existing tools to select the most appropriate DAT by evaluating published validation studies; Stage IV. Think through the implementation of the chosen DAT and consider sources of potential biases. The Delphi technique consolidated expert views on best practice in assessing dietary intake. The BPGs provide a valuable guide for health researchers to choose the most appropriate dietary assessment method for their studies. These guidelines will be accessible through the Nutritools website, www.nutritools.org .

Improving the care of older persons in Australian prisons using the Policy Delphi method.

PubMed

Patterson, Karen; Newman, Claire; Doona, Katherine

2016-09-01

There are currently no internationally recognised and approved processes relating to the care of older persons with dementia in prison. This research aimed to develop tools and procedures related to managing the care of, including the identification and assessment of, older persons with dementia who are imprisoned in New South Wales, Australia. A modified approach to the Policy Delphi method, using both surveys and facilitated discussion groups, enabled experts to come together to discuss improving the quality of care provision for older persons with dementia in prison and achieve research aims. © The Author(s) 2014.

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

75 FR 28655 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-21

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture, a.../Electronic Architecture, a subsidiary of Delphi Corporation, including on-site leased [[Page 28656

Youth injury prevention in Canada: use of the Delphi method to develop recommendations.

PubMed

Pike, Ian; Piedt, Shannon; Davison, Colleen M; Russell, Kelly; Macpherson, Alison K; Pickett, William

2015-12-22

The Health Behaviour in School-aged Children Survey is one of very few cross-national health surveys that includes information on injury occurrence and prevention within adolescent populations. A collaboration to develop a Canadian youth injury report using these data resulted in, Injury among Young Canadians: A national study of contextual determinants. The objective of this study was to develop specific evidence-based, policy-oriented recommendations arising from the national report, using a modified-Delphi process with a panel of expert stakeholders. Eight injury prevention experts and a 3-person youth advisory team associated with a Canadian injury prevention organization (Parachute Canada) reviewed, edited and commented on report recommendations through a three-stage iterative modified-Delphi process. From an initial list of 27 draft recommendations, the modified-Delphi process resulted in a final list of 19 specific recommendations, worded to resonate with the group(s) responsible to lead or take the recommended action. Two recommendations were rated as "extremely important" or "very important" by 100 % of the expert panel, two were deleted, a further two recommendations were deleted but the content included as text in the report, and four were merged with other existing recommendations. The modified-Delphi process was an appropriate method to achieve agreement on 19 specific evidence-based, policy-oriented recommendations to complement the national youth injury report. In providing their input, it is noted that the injury stakeholders each acted as individual experts, unattached to any organizational position or policy. These recommendations will require multidisciplinary collaborations in order to support the proposed policy development, additional research, programming and clear decision-making for youth injury prevention.

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

PubMed

Bank, Ilana; Cheng, Adam; McLeod, Peter; Bhanji, Farhan

2015-11-01

By the end of residency training, pediatric emergency medicine (PEM) residents are expected to have developed the confidence and abilities required to manage acutely ill children. Acquisition of competence requires exposure and/or supplemental formal education for critical and noncritical medical clinical presentations. Simulation can provide experiential learning and can improve trainees' knowledge, skills, and attitudes. The primary objective of this project was to identify the content for a simulation-based national curriculum for PEM training. We recruited participants for the Delphi study by contacting current PEM program directors and immediate past program directors as well as simulation experts at all of the Canadian PEM fellowship sites. We determined the appropriate core content for the Delphi study by combining the PEM core content requirements of the Royal College of Physicians and Surgeons of Canada (RCPSC) and the American Board of Pediatrics (ABP). Using the Delphi method, we achieved consensus amongst the national group of PEM and simulation experts. The participants completed a three-round Delphi (using a four-point Likert scale). Response rates for the Delphi were 85% for the first round and 77% for second and third rounds. From the initial 224 topics, 53 were eliminated (scored <2). Eighty-five topics scored between 2 and 3, and 87 scored between 3 and 4. The 48 topics, which were scored between 3.5 and 4.0, were labeled as "key curriculum topics." We have iteratively identified a consensus for the content of a national simulation-based curriculum.

Practical Considerations for Conducting Delphi Studies: The Oracle Enters a New Age.

ERIC Educational Resources Information Center

Eggers, Renee M.; Jones, Charles M.

1998-01-01

In addition to giving an overview of Delphi methodology and describing the methodology used by the researchers in two Delphi studies, the authors provide information about electronic communication in Delphi studies. Also provided are suggestions that can be used in a Delphi study involving any form of communication. (SLD)

Competency model for dentists in China: Results of a Delphi study

PubMed Central

Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

Objective With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Methods Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Results Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. Conclusion In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China. PMID:29566048

Pathological diagnostic criterion of blood and lymphatic vessel invasion in colorectal cancer: a framework for developing an objective pathological diagnostic system using the Delphi method, from the Pathology Working Group of the Japanese Society for Cancer of the Colon and Rectum.

PubMed

Kojima, Motohiro; Shimazaki, Hideyuki; Iwaya, Keiichi; Kage, Masayoshi; Akiba, Jun; Ohkura, Yasuo; Horiguchi, Shinichiro; Shomori, Kohei; Kushima, Ryoji; Ajioka, Yoichi; Nomura, Shogo; Ochiai, Atsushi

2013-07-01

The goal of this study is to create an objective pathological diagnostic system for blood and lymphatic vessel invasion (BLI). 1450 surgically resected colorectal cancer specimens from eight hospitals were reviewed. Our first step was to compare the current practice of pathology assessment among eight hospitals. Then, H&E stained slides with or without histochemical/immunohistochemical staining were assessed by eight pathologists and concordance of BLI diagnosis was checked. In addition, histological findings associated with BLI having good concordance were reviewed. Based on these results, framework for developing diagnostic criterion was developed, using the Delphi method. The new criterion was evaluated using 40 colorectal cancer specimens. Frequency of BLI diagnoses, number of blocks obtained and stained for assessment of BLI varied among eight hospitals. Concordance was low for BLI diagnosis and was not any better when histochemical/immunohistochemical staining was provided. All histological findings associated with BLI from H&E staining were poor in agreement. However, observation of elastica-stained internal elastic membrane covering more than half of the circumference surrounding the tumour cluster as well as the presence of D2-40-stained endothelial cells covering more than half of the circumference surrounding the tumour cluster showed high concordance. Based on this observation, we developed a framework for pathological diagnostic criterion, using the Delphi method. This criterion was found to be useful in improving concordance of BLI diagnosis. A framework for pathological diagnostic criterion was developed by reviewing concordance and using the Delphi method. The criterion developed may serve as the basis for creating a standardised procedure for pathological diagnosis.

Evaluating methods to establish habitat suitability criteria: A case study in the upper Delaware River Basin, USA

USGS Publications Warehouse

Galbraith, Heather S.; Blakeslee, Carrie J.; Cole, Jeffrey C.; Talbert, Colin; Maloney, Kelly O.

2016-01-01

Defining habitat suitability criteria (HSC) of aquatic biota can be a key component to environmental flow science. HSC can be developed through numerous methods; however, few studies have evaluated the consistency of HSC developed by different methodologies. We directly compared HSC for depth and velocity developed by the Delphi method (expert opinion) and by two primary literature meta-analyses (literature-derived range and interquartile range) to assess whether these independent methods produce analogous criteria for multiple species (rainbow trout, brown trout, American shad, and shallow fast guild) and life stages. We further evaluated how these two independently developed HSC affect calculations of habitat availability under three alternative reservoir management scenarios in the upper Delaware River at a mesohabitat (main channel, stream margins, and flood plain), reach, and basin scale. In general, literature-derived HSC fell within the range of the Delphi HSC, with highest congruence for velocity habitat. Habitat area predicted using the Delphi HSC fell between the habitat area predicted using two literature-derived HSC, both at the basin and the site scale. Predicted habitat increased in shallow regions (stream margins and flood plain) using literature-derived HSC while Delphi-derived HSC predicted increased channel habitat. HSC generally favoured the same reservoir management scenario; however, no favoured reservoir management scenario was the most common outcome when applying the literature range HSC. The differences found in this study lend insight into how different methodologies can shape HSC and their consequences for predicted habitat and water management decisions. Published 2016. This article is a U.S. Government work and is in the public domain in the USA.

Using the modified Delphi method to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy.

PubMed

Zang, Lei; Fan, Ning; Hai, Yong; Lu, S B; Su, Q J; Yang, J C; Du, Peng; Gao, Y J

2015-06-01

Although cervical radiculopathy is very common, there is no standard treatment for this condition, with little high-level evidence available to guide the treatment choice. Thus, this study aimed to review the current data on the management of cervical radiculopathy; and, further, to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy using the Delphi method. First, a systematic review of the previously established treatment guidelines and of articles related to cervical radiculopathy was conducted to establish a protocol for the clinical consensus of the treatment for cervical radiculopathy. Second, from February 2012 to June 2014, we performed a modified Delphi survey in which the current professional opinions from 30 experienced experts, representing almost all of the Chinese provinces, were gathered. Three rounds were performed, and consensus was defined as ≥70% agreement. Consensus of the treatments for cervical radiculopathy was reached on seven aspects, including the proportion of patients requiring only non-surgical therapies; the effectiveness of neck immobilization, physiotherapy, pharmacologic treatment; surgical indications; contraindications; surgery. The modified Delphi study conducted herein reached a consensus concerning several treatment issues for cervical radiculopathy. In the absence of high-level evidence, at present, these expert opinion findings will help guide health care providers to define the appropriate treatment in their regions. Items with no consensus provide excellent areas for future research.

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study

PubMed Central

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-01

Objectives To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Setting Hospitals and community health centres in Taiwan. Method A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. Participants 15 Chinese healthcare practitioners with more than 6 months’ experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Results Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. Conclusions The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. PMID:28093428

Application of Fuzzy Delphi in the Selection of COPD Risk Factors among Steel Industry Workers.

PubMed

Dapari, Rahmat; Ismail, Halim; Ismail, Rosnah; Ismail, Noor Hassim

2017-01-01

The Delphi method has been widely applied in many study areas to systematically gather experts' input on particular topic. Recently, it has become increasingly well known in health related research. This paper applied the Fuzzy Delphi method to enhance the validation of a questionnaire pertaining chronic obstructive pulmonary disease (COPD) risk factors among metal industry workers. A detailed, predefined list of possible risk factors for COPD among metal industry workers was created through a comprehensive and exhaustive review of literature from 1995 to 2015. The COPD questionnaire were distributed among people identified as occupational, environmental, and hygiene experts. Linguistic variable using Likert scale was used by the expert to indicate their expert judgment of each item. Subsequently, the linguistic variable was converted into a triangular fuzzy number. The average score of the fuzzy number will be used to determine whether the item will be removed or retained. Ten experts were involved in evaluating 26 items. The experts were in agreement with most of the items, with an average fuzzy number range between 0.429 and 0.800. Two items were removed and three items were added, leaving a total 26 items selected for the COPD risk factors questionnaire. The experts were in disagreement with each other for items F10 and F11 where most of the experts claimed that the question is too subjective and based on self-perception only. The fuzzy Delphi method enhanced the accuracy of the questionnaire pertaining to COPD risk factors, and decreased the length of the established tools.

A checklist to assess the quality of reports on spa therapy and balneotherapy trials was developed using the Delphi consensus method: the SPAC checklist.

PubMed

Kamioka, Hiroharu; Kawamura, Yoichi; Tsutani, Kiichiro; Maeda, Masaharu; Hayasaka, Shinya; Okuizum, Hiroyasu; Okada, Shinpei; Honda, Takuya; Iijima, Yuichi

2013-08-01

The purpose of this study was to develop a checklist of items that describes and measures the quality of reports of interventional trials assessing spa therapy. The Delphi consensus method was used to select the number of items in the checklist. A total of eight individuals participated, including an epidemiologist, a clinical research methodologist, clinical researchers, a medical journalist, and a health fitness programmer. Participants ranked on a 9-point Likert scale whether an item should be included in the checklist. Three rounds of the Delphi method were conducted to achieve consensus. The final checklist contained 19 items, with items related to title, place of implementation (specificity of spa), care provider influence, and additional measures to minimize the potential bias from withdrawals, loss to follow-up, and low treatment adherence. This checklist is simple and quick to complete, and should help clinicians and researchers critically appraise the medical and healthcare literature, reviewers assess the quality of reports included in systematic reviews, and researchers plan interventional trials of spa therapy. Copyright © 2013 Elsevier Ltd. All rights reserved.

Ontology Development for Patient Education Documents Using a Professional- and Patient-Oriented Delphi Method.

PubMed

Heimonen, Juho; Danielsson-Ojala, Riitta; Salakoski, Tapio; Lundgrén-Laine, Heljä; Salanterä, Sanna

2018-04-12

Written patient education materials are essential to motivate and help patients to participate in their own care, but the production and management of a large collection of high-quality and easily accessible patient education documents can be challenging. Ontologies can aid in these tasks, but the existing resources are not directly applicable to patient education. An ontology that models patient education documents and their readers was constructed. The Delphi method was used to identify a compact but sufficient set of entities with which the topics of documents may be described. The preferred terms of the entities were also considered to ensure their understandability. In the ontology, readers may be characterized by gender, age group, language, and role (patient or professional), whereas documents may be characterized by audience, topic(s), and content, as well as the time and place of use. The Delphi method yielded 265 unique document topics that are organized into seven hierarchies. Advantages and disadvantages of the ontology design, as well as possibilities for improvements, were identified. The patient education material ontology can enhance many applications, but further development is needed to reach its full potential.

Malaria chemoprophylaxis recommendations for immigrants to Europe, visiting relatives and friends - a Delphi method study

PubMed Central

2011-01-01

Background Numbers of travellers visiting friends and relatives (VFRs) from Europe to malaria endemic countries are increasing and include long-term and second generation immigrants, who represent the major burden of malaria cases imported back into Europe. Most recommendations for malaria chemoprophylaxis lack a solid evidence base, and often fail to address the cultural, social and economic needs of VFRs. Methods European travel medicine experts, who are members of TropNetEurop, completed a sequential series of questionnaires according to the Delphi method. This technique aims at evaluating and developing a consensus through repeated iterations of questionnaires. The questionnaires in this study included questions about professional experience with VFRs, controversial issues in malaria prophylaxis, and 16 scenarios exploring indications for prescribing and choice of chemoprophylaxis. Results The experience of participants was rather diverse as was their selection of chemoprophylaxis regimen. A significant consensus was observed in only seven of 16 scenarios. The analysis revealed a wide variation in prescribing choices with preferences grouped by region of practice and increased prescribing seen in Northern Europe compared to Central Europe. Conclusions Improving the evidence base on efficacy, adherence to chemoprophylaxis and risk of malaria and encouraging discussion among experts, using techniques such as the Delphi method, may reduce the variability in prescription in European travel clinics. PMID:21599909

Gaining consensus on family carer needs when caring for someone dying at home to develop the Carers' Alert Thermometer (CAT): a modified Delphi study.

PubMed

Knighting, Katherine; O'Brien, Mary R; Roe, Brenda; Gandy, Rob; Lloyd-Williams, Mari; Nolan, Mike; Jack, Barbara A

2016-01-01

To report a multi-phase modified Delphi study conducted with carers and professionals to identify the priority areas for inclusion in an alert screening tool for carers providing support to someone dying at home. Internationally, there is a growing emphasis on increasing choice for patients who wish to die at home which relies heavily on care provided by the unpaid family carers. Family carers can have high levels of unmet needs comprising their psychological and physical health and their ability to provide effective care and support. Development of an alert tool to identify carers' needs in everyday practice required identification and consensus of the priority areas of need for inclusion. Multi-phase modified Delphi study and instrument development. Qualitative and quantitative data collection took place between 2011-2013 with 111 carers and 93 professionals to identify carers' needs and gain consensus on the priority areas for inclusion in the alert tool. An expert panel stage and final evidence review post-Delphi were used. The Delphi panels had high levels of agreement and consensus. Ten areas of carer need across two themes of 'the current caring situation' and 'the carer's own health and well-being' were prioritized for inclusion in the alert tool. An optional end-of-life planning question was included following the final stages. The results provide evidence of carers' needs to be assessed, areas for consideration in the education of those who support carers and someone dying at home and targeting of services, while demonstrating the usefulness and adaptability of the Delphi method. © 2015 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Verification of a quality management theory: using a delphi study.

PubMed

Mosadeghrad, Ali Mohammad

2013-11-01

A model of quality management called Strategic Collaborative Quality Management (SCQM) model was developed based on the quality management literature review, the findings of a survey on quality management assessment in healthcare organisations, semi-structured interviews with healthcare stakeholders, and a Delphi study on healthcare quality management experts. The purpose of this study was to verify the SCQM model. The proposed model was further developed using feedback from thirty quality management experts using a Delphi method. Further, a guidebook for its implementation was prepared including a road map and performance measurement. The research led to the development of a context-specific model of quality management for healthcare organisations and a series of guidelines for its implementation. A proper model of quality management should be developed and implemented properly in healthcare organisations to achieve business excellence.

A cross-validation Delphi method approach to the diagnosis and treatment of personality disorders in older adults.

PubMed

Rosowsky, Erlene; Young, Alexander S; Malloy, Mary C; van Alphen, S P J; Ellison, James M

2018-03-01

The Delphi method is a consensus-building technique using expert opinion to formulate a shared framework for understanding a topic with limited empirical support. This cross-validation study replicates one completed in the Netherlands and Belgium, and explores US experts' views on the diagnosis and treatment of older adults with personality disorders (PD). Twenty-one geriatric PD experts participated in a Delphi survey addressing diagnosis and treatment of older adults with PD. The European survey was translated and administered electronically. First-round consensus was reached for 16 out of 18 items relevant to diagnosis and specific mental health programs for personality disorders in older adults. Experts agreed on the usefulness of establishing criteria for specific types of treatments. The majority of psychologists did not initially agree on the usefulness of pharmacotherapy. Expert consensus was reached following two subsequent rounds after clarification addressing medication use. Study results suggest consensus among regarding psychosocial treatments. Limited acceptance amongst US psychologists about the suitability of pharmacotherapy for late-life PDs contrasted with the views expressed by experts surveyed in Netherlands and Belgium studies.

Nursing Information Systems Requirements: A Milestone for Patient Outcome and Patient Safety Improvement.

PubMed

Farzandipour, Mehrdad; Meidani, Zahra; Riazi, Hossein; Sadeqi Jabali, Monireh

2016-12-01

Considering the integral role of understanding users' requirements in information system success, this research aimed to determine functional requirements of nursing information systems through a national survey. Delphi technique method was applied to conduct this study through three phases: focus group method modified Delphi technique and classic Delphi technique. A cross-sectional study was conducted to evaluate the proposed requirements within 15 general hospitals in Iran. Forty-three of 76 approved requirements were clinical, and 33 were administrative ones. Nurses' mean agreements for clinical requirements were higher than those of administrative requirements; minimum and maximum means of clinical requirements were 3.3 and 3.88, respectively. Minimum and maximum means of administrative requirements were 3.1 and 3.47, respectively. Research findings indicated that those information system requirements that support nurses in doing tasks including direct care, medicine prescription, patient treatment management, and patient safety have been the target of special attention. As nurses' requirements deal directly with patient outcome and patient safety, nursing information systems requirements should not only address automation but also nurses' tasks and work processes based on work analysis.

Internet-Based Delphi Research: Case Based Discussion

PubMed Central

Donohoe, Holly M.; Stellefson, Michael L.

2013-01-01

The interactive capacity of the Internet offers benefits that are intimately linked with contemporary research innovation in the natural resource and environmental studies domains. However, e-research methodologies, such as the e-Delphi technique, have yet to undergo critical review. This study advances methodological discourse on the e-Delphi technique by critically assessing an e-Delphi case study. The analysis suggests that the benefits of using e-Delphi are noteworthy but the authors acknowledge that researchers are likely to face challenges that could potentially compromise research validity and reliability. To ensure that these issues are sufficiently considered when planning and designing an e-Delphi, important facets of the technique are discussed and recommendations are offered to help the environmental researcher avoid potential pitfalls associated with coordinating e-Delphi research. PMID:23288149

Acne severity grading: determining essential clinical components and features using a Delphi consensus.

PubMed

Tan, Jerry; Wolfe, Barat; Weiss, Jonathan; Stein-Gold, Linda; Bikowski, Joseph; Del Rosso, James; Webster, Guy F; Lucky, Anne; Thiboutot, Diane; Wilkin, Jonathan; Leyden, James; Chren, Mary-Margaret

2012-08-01

There are multiple global scales for acne severity grading but no singular standard. Our objective was to determine the essential clinical components (content items) and features (property-related items) for an acne global grading scale for use in research and clinical practice using an iterative method, the Delphi process. Ten acne experts were invited to participate in a Web-based Delphi survey comprising 3 iterative rounds of questions. In round 1, the experts identified the following clinical components (primary acne lesions, number of lesions, extent, regional involvement, secondary lesions, and patient experiences) and features (clinimetric properties, ease of use, categorization of severity based on photographs or text, and acceptance by all stakeholders). In round 2, consensus for inclusion in the scale was established for primary lesions, number, sites, and extent; as well as clinimetric properties and ease of use. In round 3, consensus for inclusion was further established for categorization and acceptance. Patient experiences were excluded and no consensus was achieved for secondary lesions. The Delphi panel consisted solely of the United States (U.S.)-based acne experts. Using an established method for achieving consensus, experts in acne vulgaris concluded that an ideal acne global grading scale would comprise the essential clinical components of primary acne lesions, their quantity, extent, and facial and extrafacial sites of involvement; with features of clinimetric properties, categorization, efficiency, and acceptance. Copyright © 2011 American Academy of Dermatology, Inc. Published by Mosby, Inc. All rights reserved.

Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

PubMed

Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

2014-06-25

The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our study. Based upon this consultation process, a guideline will be developed on instrument selection for outcomes to be included in a COS.

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method

PubMed Central

Yeh, James S.; Van Hoof, Thomas J.; Fischer, Michael A.

2016-01-01

Background Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. Objective To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. Methods This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. Results The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Conclusion Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process. PMID:27066195

Competency model for dentists in China: Results of a Delphi study.

PubMed

Geng, Yunxia; Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China.

[Evaluation of the standard application of Delphi in the diagnosis of chronic obstructive pulmonary disease caused by occupational irritant chemicals].

PubMed

Zhao, L; Yan, Y J

2017-11-20

Objective: To investigate the problems encountered in the application of the standard (hereinafter referred to as standard) for the diagnosis of chronic obstructive pulmonary disease caused by occu-pational irritant chemicals, to provide reference for the revision of the new standard, to reduce the number of missed patients in occupational COPD, and to get rid of the working environment of those who suffer from chronic respiratory diseases due to long-term exposure to poisons., slowing the progression of the disease. Methods: Using Delphi (Delphi) Expert research method, after the senior experts to demonstrate, to under-stand the GBZ 237-2011 "occupational irritant chemicals to the diagnosis of chronic obstructive pulmonary dis-ease" standard evaluation of the system encountered problems, to seek expert advice, The problems encoun-tered during the clinical implementation of the standards promulgated in 2011 are presented. Results: Through the Delphi Expert investigation method, it is found that experts agree on the content evaluation and implemen-tation evaluation in the standard, but the operational evaluation of the standard is disputed. According to the clinical experience, the experts believe that the range of occupational irritant gases should be expanded, and the operation of the problem of smoking, seniority determination and occupational contact history should be challenged during the diagnosis. Conclusions: Since the promulgation in 2011 of the criteria for the diagnosis of chronic obstructive pulmonary disease caused by occupational stimulant chemicals, there have been some problems in the implementation process, which have caused many occupationally exposed to irritating gases to suffer from "occupational chronic respiratory Diseases" without a definitive diagnosis.

Research priorities in medical education at Shiraz University of Medical Sciences:categories and subcategories in the Iranian context

PubMed Central

NABEIEI, PARISA; AMINI, MITRA; GHANAVATI, SHIRIN; MARHAMATI, SAADAT

2016-01-01

Introduction Research in education is a globally significant issue without a long history. Due to the importance of the issue in Health System Development programs, this study intended to determine research priorities in medical education, considering their details and functions. By determining barriers existing in research in education progress, it is tried to make research priorities more functional by recommending acceptable strategies. Methods This is a qualitative-descriptive study in two descriptive phases. The goal of these phases was to determine research priorities subcategories in medical education by Nominal Group Technique (NGT) and two rounds of Delphi method. Through the first phase, subcategories of research priorities were determined, using Nominal Group Technique under medical education experts’ supervision. Through two rounds of Delphi, a questionnaire was constructed based on the subcategories. Eventually, research priorities were determined based on their highest score (scores more than 7 out of 10). Results In the first phase (NGT), 35 priorities in 5 major fields of medical education were presented. In the second phase, priorities were scored, using Delphi method. Medical Ethics and professionalism gained the highest scores (7.63±1.26) and educational evaluation the lowest (7.28±1.52). In this stage, 7 items were omitted but 2 of them were added again after experts’ revision in the third round of Delphi. Conclusion According to the results of the present study and based on previous studies, it really seems that the fields of “Learning and Teaching Approaches” and “Medical Ethics and Professionalism” were more important. Because of financial and resource limitations in our country and the importance of research priorities, it is recommended to frequently study “research priorities determination program” at universities. PMID:26793723

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature.

PubMed

Moreira, Danilo Gomes; Costello, Joseph T; Brito, Ciro J; Adamczyk, Jakub G; Ammer, Kurt; Bach, Aaron J E; Costa, Carlos M A; Eglin, Clare; Fernandes, Alex A; Fernández-Cuevas, Ismael; Ferreira, José J A; Formenti, Damiano; Fournet, Damien; Havenith, George; Howell, Kevin; Jung, Anna; Kenny, Glen P; Kolosovas-Machuca, Eleazar S; Maley, Matthew J; Merla, Arcangelo; Pascoe, David D; Priego Quesada, Jose I; Schwartz, Robert G; Seixas, Adérito R D; Selfe, James; Vainer, Boris G; Sillero-Quintana, Manuel

2017-10-01

The importance of using infrared thermography (IRT) to assess skin temperature (t sk ) is increasing in clinical settings. Recently, its use has been increasing in sports and exercise medicine; however, no consensus guideline exists to address the methods for collecting data in such situations. The aim of this study was to develop a checklist for the collection of t sk using IRT in sports and exercise medicine. We carried out a Delphi study to set a checklist based on consensus agreement from leading experts in the field. Panelists (n = 24) representing the areas of sport science (n = 8; 33%), physiology (n = 7; 29%), physiotherapy (n = 3; 13%) and medicine (n = 6; 25%), from 13 different countries completed the Delphi process. An initial list of 16 points was proposed which was rated and commented on by panelists in three rounds of anonymous surveys following a standard Delphi procedure. The panel reached consensus on 15 items which encompassed the participants' demographic information, camera/room or environment setup and recording/analysis of t sk using IRT. The results of the Delphi produced the checklist entitled "Thermographic Imaging in Sports and Exercise Medicine (TISEM)" which is a proposal to standardize the collection and analysis of t sk data using IRT. It is intended that the TISEM can also be applied to evaluate bias in thermographic studies and to guide practitioners in the use of this technique. Copyright © 2017 Elsevier Ltd. All rights reserved.

Developing the E-Delphi System: A Web-Based Forecasting Tool for Educational Research.

ERIC Educational Resources Information Center

Chou, Chien

2002-01-01

Discusses use of the Delphi technique and describes the development of an electronic version, called e-Delphi, in which questionnaire construction and communication with panel members was accomplished using the Web. Explains system function and interface and discusses evaluation of the e-Delphi system. (Author/LRW)

Survey indicated that core outcome set development is increasingly including patients, being conducted internationally and using Delphi surveys.

PubMed

Biggane, Alice M; Brading, Lucy; Ravaud, Philippe; Young, Bridget; Williamson, Paula R

2018-02-17

There are numerous challenges in including patients in a core outcome set (COS) study, these can vary depending on the patient group. This study describes current efforts to include patients in the development of COS, with the aim of identifying areas for further improvement and study. Using the COMET database, corresponding authors of COS projects registered or published from 1 January 2013 to 2 February 2017 were invited via a personalised email to participate in a short online survey. The survey and emails were constructed to maximise the response rate by following the academic literature on enhancing survey responses. Personalised reminder emails were sent to non-responders. This survey explored the frequency of patient input in COS studies, who was involved, what methods were used and whether or not the COS development was international. One hundred and ninety-two COS developers were sent the survey. Responses were collected from 21 February 2017 until 7 May 2017. One hundred and forty-six unique developers responded, yielding a 76% response rate and data in relation to 195 unique COSs (as some developers had worked on multiple COSs). Of focus here are their responses regarding 162 COSs at the published, completed or ongoing stages of development. Inclusion of patient participants was indicated in 87% (141/162) of COSs in the published completed or ongoing stages and over 94% (65/69) of ongoing COS projects. Nearly half (65/135) of COSs included patient participants from two or more countries and 22% (30/135) included patient participants from five or more countries. The Delphi survey was reported as being used singularly or in combination with other methods in 85% (119/140) of projects. Almost a quarter (16/65) of ongoing studies reported using a combination of qualitative interviews, Delphi survey and consensus meeting. These findings indicated that the Delphi survey is the most popular method of facilitating patient participation, while the combination of qualitative interviews, Delphi survey and consensus meetings is the most popular combination of methods. The increased inclusion of patient participants in the development of COSs is encouraging, as is the international approach to COS development that some developers are adopting.

Improving University Ranking to Achieve University Competitiveness by Management Information System

NASA Astrophysics Data System (ADS)

Dachyar, M.; Dewi, F.

2015-05-01

One way to increase university competitiveness is through information system management. A literature review was done to find information system factors that affect university performance in Quacquarelli Symonds (QS) University Ranking: Asia evaluation. Information system factors were then eliminated using Delphi method through consensus of 7 experts. Result from Delphi method was used as measured variables in PLS-SEM. Estimation with PLS-SEM method through 72 respondents shows that the latent variable academic reputation and citation per paper have significant correlation to university competitiveness. In University of Indonesia (UI) the priority to increase university competitiveness as follow: (i) network building in international conference, (ii) availability of research data to public, (iii) international conference information, (iv) information on achievements and accreditations of each major, (v) ease of employment for alumni.

Identifying Psychological Contract Breaches to Guide Improvements in Faculty Recruitment, Retention, and Development

PubMed Central

Desselle, Shane P.; Draugalis, JoLaine R.; Spies, Alan R.; Davis, Tamra S.; Bolino, Mark

2012-01-01

Objective. To identify pharmacy faculty members’ perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. Methods. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Results. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. Conclusion. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development. PMID:22919084

Algorithms for monitoring warfarin use: Results from Delphi Method.

PubMed

Kano, Eunice Kazue; Borges, Jessica Bassani; Scomparini, Erika Burim; Curi, Ana Paula; Ribeiro, Eliane

2017-10-01

Warfarin stands as the most prescribed oral anticoagulant. New oral anticoagulants have been approved recently; however, their use is limited and the reversibility techniques of the anticoagulation effect are little known. Thus, our study's purpose was to develop algorithms for therapeutic monitoring of patients taking warfarin based on the opinion of physicians who prescribe this medicine in their clinical practice. The development of the algorithm was performed in two stages, namely: (i) literature review and (ii) algorithm evaluation by physicians using a Delphi Method. Based on the articles analyzed, two algorithms were developed: "Recommendations for the use of warfarin in anticoagulation therapy" and "Recommendations for the use of warfarin in anticoagulation therapy: dose adjustment and bleeding control." Later, these algorithms were analyzed by 19 medical doctors that responded to the invitation and agreed to participate in the study. Of these, 16 responded to the first round, 11 to the second and eight to the third round. A 70% consensus or higher was reached for most issues and at least 50% for six questions. We were able to develop algorithms to monitor the use of warfarin by physicians using a Delphi Method. The proposed method is inexpensive and involves the participation of specialists, and it has proved adequate for the intended purpose. Further studies are needed to validate these algorithms, enabling them to be used in clinical practice.

Practical state of health estimation of power batteries based on Delphi method and grey relational grade analysis

NASA Astrophysics Data System (ADS)

Sun, Bingxiang; Jiang, Jiuchun; Zheng, Fangdan; Zhao, Wei; Liaw, Bor Yann; Ruan, Haijun; Han, Zhiqiang; Zhang, Weige

2015-05-01

The state of health (SOH) estimation is very critical to battery management system to ensure the safety and reliability of EV battery operation. Here, we used a unique hybrid approach to enable complex SOH estimations. The approach hybridizes the Delphi method known for its simplicity and effectiveness in applying weighting factors for complicated decision-making and the grey relational grade analysis (GRGA) for multi-factor optimization. Six critical factors were used in the consideration for SOH estimation: peak power at 30% state-of-charge (SOC), capacity, the voltage drop at 30% SOC with a C/3 pulse, the temperature rises at the end of discharge and charge at 1C; respectively, and the open circuit voltage at the end of charge after 1-h rest. The weighting of these factors for SOH estimation was scored by the 'experts' in the Delphi method, indicating the influencing power of each factor on SOH. The parameters for these factors expressing the battery state variations are optimized by GRGA. Eight battery cells were used to illustrate the principle and methodology to estimate the SOH by this hybrid approach, and the results were compared with those based on capacity and power capability. The contrast among different SOH estimations is discussed.

How to Choose? Using the Delphi Method to Develop Consensus Triggers and Indicators for Disaster Response.

PubMed

Lis, Rebecca; Sakata, Vicki; Lien, Onora

2017-08-01

To identify key decisions along the continuum of care (conventional, contingency, and crisis) and the critical triggers and data elements used to inform those decisions concerning public health and health care response during an emergency. A classic Delphi method, a consensus-building survey technique, was used with clinicians around Washington State to identify regional triggers and indicators. Additionally, using a modified Delphi method, we combined a workshop and single-round survey with panelists from public health (state and local) and health care coalitions to identify consensus state-level triggers and indicators. In the clinical survey, 122 of 223 proposed triggers or indicators (43.7%) reached consensus and were deemed important in regional decision-making during a disaster. In the state-level survey, 110 of 140 proposed triggers or indicators (78.6%) reached consensus and were deemed important in state-level decision-making during a disaster. The identification of consensus triggers and indicators for health care emergency response is crucial in supporting a comprehensive health care situational awareness process. This can inform the creation of standardized questions to ask health care, public health, and other partners to support decision-making during a response. (Disaster Med Public Health Preparedness. 2017;11:467-472).

Current opinion and consensus statement regarding the diagnosis, prognosis, and treatment of patients with essential thrombocythemia: a survey of the Spanish Group of Ph-negative Myeloproliferative Neoplasms (GEMFIN) using the Delphi method.

PubMed

Besses, C; Hernández-Boluda, J C; Pérez Encinas, M; Raya, J M; Hernández-Rivas, J M; Jiménez Velasco, A; Martínez Lopez, J; Vicente, V; Burgaleta, C

2016-04-01

The current consensus on the diagnosis, prognosis, and treatment of essential thrombocythemia (ET) is based on experts' recommendations. However, several aspects of the diagnosis of, prognosis of, and therapy for ET are still controversial. The Delphi method was employed with an expert panel of members of the Spanish Group of Ph-negative Myeloproliferative Neoplasms in order to identify the degree of agreement on the diagnosis, prognosis, and treatment of ET. Nine leading experts selected a total of 41 clinical hematologists with well-known expertise in ET. An electronic questionnaire was used to collect the questions rated in a four-step scale. The questions were grouped into four blocks: diagnosis, risk stratification, goals of therapy, and treatment strategy. After the first round consisting of 80 questions, a second round including 14 additional questions focused on the recommendations advocated by experts of the European LeukemiaNet in 2011 was analyzed. The median and mean values for the first and second rounds were calculated. A summary of the conclusions considered as the most representative of each block of questions is presented. The Delphi method is a powerful instrument to address the current approaches and controversies surrounding ET.

Cross-cultural adaptation of the delphi definitions of low back pain prevalence (German DOLBaPP).

PubMed

Leonhardt, Marja; Liebers, Falk; Dionne, Clermont E; Latza, Ute

2014-11-25

Assessed dimensions of low back pain (LBP) vary in prevalence studies. This may explain the heterogeneity in frequency estimates. To standardize definitions of LBP, an English consensus with 28 experts from 12 countries developed the "Delphi Definitions of Low Back Pain Prevalence" (DOLBaPP). The optimal definition and the shorter minimal definition with the related questionnaires for online, paper, and face-to-face use and telephone surveys are suitable for population-based studies. The definitions have to be adapted to different languages and cultures to provide comparable frequency estimates. The objective was to culturally adapt and pre-test the English definitions and corresponding Delphi DOLBaPP questionnaire forms into German. The German DOLBaPP adaptation was conducted using the systematic approach suggested by Beaton et al. A pre-test of the Delphi DOLBaPP optimal paper questionnaire including an additional evaluation form was conducted in a sample of 121 employees (mainly office workers). In order to evaluate the comprehensibility, usability, applicability, and completeness of the adapted questionnaire, response to the questionnaire and 6 closed evaluation questions were analyzed descriptively. Qualitative methods were used for the 3 open questions of the evaluation form. The cultural adaptation of the DOLBaPP for a German-speaking audience required little linguistic adaptation. Conceptual equivalence was difficult for the expression "low back pain". The expert committee considered the face validity of the pre-final version of the related Delphi DOLBaPP questionnaires as good. In the pre-test, most participants (95%) needed less than 5 minutes to fill in the optimal Delphi DOLBaPP questionnaire. They were generally positive regarding length, wording, diagram, and composition. All subjects with LBP (n=61 out of 121 - 50.4%) answered the questions on functional limitation, sciatic pain, frequency and duration of symptoms as well as pain severity. The results indicate that the cross-cultural German adaptation of the DOLBaPP Definitions and the corresponding questionnaires was successful. The definitions can be used in epidemiological studies to measure the prevalence of LBP. Some critical issues were raised regarding the general features of the Delphi DOLBaPP questionnaires. Future research is needed to evaluate these instruments.

Development of criteria for evaluating clinical response in thyroid eye disease using a modified Delphi technique.

PubMed

Douglas, Raymond S; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A; Cahill, Kenneth; Dolman, Peter J; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J; Khanna, Dinesh

2009-09-01

To identify components of a provisional clinical response index for thyroid eye disease using a modified Delphi technique. The International Thyroid Eye Disease Society conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in thyroid eye disease. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty-four respondents participated in the Delphi 1 survey, providing 220 unique items. Ninety-two members (100% of the respondents from Delphi 1 plus 8 new participants) responded in Delphi 2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi 3 (67 criteria were excluded because of redundancy). Criteria with a mean greater than 6 (1 = least appropriate to 9 = most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for thyroid eye disease. These measures will be iteratively refined for use in multicenter clinical trials.

Development of criteria for evaluating clinical response in thyroid eye disease (CRI-TED) using a modified Delphi technique

PubMed Central

Douglas, Raymond S.; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A.; Cahill, Kenneth; Dolman, Peter J.; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J.; Khanna, Dinesh

2014-01-01

To identify components of a provisional clinical response index for thyroid eye disease (CRI-TED) using a modified Delphi technique. The International Thyroid Eye Disease Society (ITEDS) conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in TED. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty four respondents participated in the Delphi-1 survey, providing 220 unique items. Ninety- two members (100% of the respondents from Delphi 1 plus eight new participants) responded in Delphi-2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi-3 (67 criteria were excluded due to redundancy). Criteria with a mean greater than 6 (1 least appropriate to 9 most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for TED. These measures will be iteratively refined for use in multicenter clinical trials. PMID:19752424

Defining the activities of publicness for Korea's public community hospitals using the Delphi method.

PubMed

Lee, Kunsei; Kim, Hyun Joo; You, Myoungsoon; Lee, Jin-Seok; Eun, Sang Jun; Jeong, Hyoseon; Ahn, Hye Mi; Lee, Jin Yong

2017-03-01

This study aims to identify which activities of a public community hospital (PHC) should be included in their definition of publicness and tries to achieve a consensus among experts using the Delphi method. We conduct 2 rounds of the Delphi process with 17 panel members using a developed draft of tentative activities for publicness including 5 main categories covering 27 items. The questions remain the same in both rounds and the applicability of each of the 27 items to publicness is measured on a 9-point scale. If the participants believe government funding is needed, we ask how much they think the government should support each item on a 0% to 100% scale. After conducting 2 rounds of the Delphi process, 22 out of the 27 items reached a consensus as activities defining the publicness of the PHCs. Among the 5 major categories, in category C, activities preventing market failure, all 10 items were considered activities of publicness. Nine of these were evaluated as items that should be compensated at 100% of total financial loss by the Korean government. Throughout results, we were able to define the activities of the PCH that encompassed its publicness and confirm that there are "good deficits" in the context of the PCHs. Thus, some PCH deficits are unavoidable and not wasted as these monies support a necessary role and function in providing public health. The Korean government should therefore consider taking actions such as exempting such "good deficits" or providing additional financial aid to reimburse the PHCs for "good deficits."

Emerging Technologies Program Integration Report. Volume 2. Background, Delphi and Workshop Data. Appendices

DTIC Science & Technology

1987-05-04

FTIILE COP’ AD-A196 840 EMERGING TECHNOLOGIES PROGRAM INTEGRATION REPORT VOLUME II BACKGROUND, DELPHI AND WORKSHOP DATA, APPENDICES . -- PREPARED...Security Classification) Emerging Technologies Program Integration Report Volume II: Background, Delphi and Workshop Data; Appendices (U) 12 PERSONAL...volumes of this integration report assess and synthesize information gathered through a Delphi survey, defense needs prioritization workshops, and

Using the Delphi technique in economic evaluation: time to revisit the oracle?

PubMed

Simoens, S

2006-12-01

Although the Delphi technique has been commonly used as a data source in medical and health services research, its application in economic evaluation of medicines has been more limited. The aim of this study was to describe the methodology of the Delphi technique, to present a case for using the technique in economic evaluation, and to provide recommendations to improve such use. The literature was accessed through MEDLINE focusing on studies discussing the methodology of the Delphi technique and economic evaluations of medicines using the Delphi technique. The Delphi technique can be used to provide estimates of health care resources required and to modify such estimates when making inter-country comparisons. The Delphi technique can also contribute to mapping the treatment process under investigation, to identifying the appropriate comparator to be used, and to ensuring that the economic evaluation estimates cost-effectiveness rather than cost-efficacy. Ideally, economic evaluations of medicines should be based on real-patient data. In the absence of such data, evaluations need to incorporate the best evidence available by employing approaches such as the Delphi technique. Evaluations based on this approach should state the limitations, and explore the impact of the associated uncertainty in the results.

Incorporating Information Value into Navy Tactical Data System: System Configuration Management Through the Delphi Method

DTIC Science & Technology

1989-03-01

e"-s tcc,: -e .- r reverse of necessary an., ice-tfy by bi.-:’ ru-’ce," 5uz"ou configuration management. Delphi method. Command and Control 19 Ac-s:’a...Aos!,ac: 21 Aostraczt Security Classitcator : R uncassf~’! i~e sa-e as renc- E 0orC users Unclassified 22a Na-e of Respon’s :e iro, v c a 22o Te’eo’one...i!r’ciule A’ea coce’ 22: C’" ce . Thomnas 1’. Mitchell (4081 646-2620 155k.11i DD FORI, 1473.6.: VAR 63 A-- R e-.!c- rnay be usec~ unti exhausted se

Community Engagement in the CTSA Program: Stakeholder Responses from a National Delphi Process

PubMed Central

Seifer, Sarena D.; Stupak, Matthew; Martinez, Linda Sprague

2014-01-01

Abstract In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community‐Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. PMID:24841362

Community engagement in the CTSA program: stakeholder responses from a national Delphi process.

PubMed

Freeman, Elmer; Seifer, Sarena D; Stupak, Matthew; Martinez, Linda Sprague

2014-06-01

In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community-Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. © 2014 Wiley Periodicals, Inc.

DelPhi Web Server: A comprehensive online suite for electrostatic calculations of biological macromolecules and their complexes

PubMed Central

Sarkar, Subhra; Witham, Shawn; Zhang, Jie; Zhenirovskyy, Maxim; Rocchia, Walter; Alexov, Emil

2011-01-01

Here we report a web server, the DelPhi web server, which utilizes DelPhi program to calculate electrostatic energies and the corresponding electrostatic potential and ionic distributions, and dielectric map. The server provides extra services to fix structural defects, as missing atoms in the structural file and allows for generation of missing hydrogen atoms. The hydrogen placement and the corresponding DelPhi calculations can be done with user selected force field parameters being either Charmm22, Amber98 or OPLS. Upon completion of the calculations, the user is given option to download fixed and protonated structural file, together with the parameter and Delphi output files for further analysis. Utilizing Jmol viewer, the user can see the corresponding structural file, to manipulate it and to change the presentation. In addition, if the potential map is requested to be calculated, the potential can be mapped onto the molecule surface. The DelPhi web server is available from http://compbio.clemson.edu/delphi_webserver. PMID:24683424

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study

PubMed Central

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D.

2017-01-01

ABSTRACT Introduction As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. Materials and methods We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Results Panelist’s responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Conclusions Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. PMID:28379668

Identifying the features of an exercise addiction: A Delphi study

PubMed Central

Macfarlane, Lucy; Owens, Glynn; Cruz, Borja del Pozo

2016-01-01

Objectives There remains limited consensus regarding the definition and conceptual basis of exercise addiction. An understanding of the factors motivating maintenance of addictive exercise behavior is important for appropriately targeting intervention. The aims of this study were twofold: first, to establish consensus on features of an exercise addiction using Delphi methodology and second, to identify whether these features are congruous with a conceptual model of exercise addiction adapted from the Work Craving Model. Methods A three-round Delphi process explored the views of participants regarding the features of an exercise addiction. The participants were selected from sport and exercise relevant domains, including physicians, physiotherapists, coaches, trainers, and athletes. Suggestions meeting consensus were considered with regard to the proposed conceptual model. Results and discussion Sixty-three items reached consensus. There was concordance of opinion that exercising excessively is an addiction, and therefore it was appropriate to consider the suggestions in light of the addiction-based conceptual model. Statements reaching consensus were consistent with all three components of the model: learned (negative perfectionism), behavioral (obsessive–compulsive drive), and hedonic (self-worth compensation and reduction of negative affect and withdrawal). Conclusions Delphi methodology allowed consensus to be reached regarding the features of an exercise addiction, and these features were consistent with our hypothesized conceptual model of exercise addiction. This study is the first to have applied Delphi methodology to the exercise addiction field, and therefore introduces a novel approach to exercise addiction research that can be used as a template to stimulate future examination using this technique. PMID:27554504

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique

PubMed Central

Barry, Emma; O'Brien, Kirsty; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-01-01

Objective There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Design Two-round modified Delphi consensus method. Setting Irish and UK general practice. Participants A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. Results 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). Conclusions The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. PMID:27601499

Medication dispensing errors in Palestinian community pharmacy practice: a formal consensus using the Delphi technique.

PubMed

Shawahna, Ramzi; Haddad, Aseel; Khawaja, Baraa; Raie, Rand; Zaneen, Sireen; Edais, Tasneem

2016-10-01

Background Medication dispensing errors (MDEs) are frequent in community pharmacy practice. A definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice were not previously approached using formal consensus techniques. Objective This study was conducted to achieve consensus on a definition of MDEs and a wide range of scenarios that should or should not be considered as MDEs in Palestinian community pharmacy practice by a panel of community pharmacists. Setting Community pharmacy practice in Palestine. Method This was a descriptive study using the Delphi technique. A panel of fifty community pharmacists was recruited from different geographical locations of the West Bank of Palestine. A three round Delphi technique was followed to achieve consensus on a proposed definition of MDEs and 83 different scenarios representing potential MDEs using a nine-point scale. Main outcome measure Agreement or disagreement of a panel of community pharmacists on a proposed definition of MDEs and a series of scenarios representing potential MDEs. Results In the first Delphi round, views of key contact community pharmacists on MDEs were explored and situations representing potential MDEs were collected. In the second Delphi round, consensus was achieved to accept the proposed definition and to include 49 (59 %) of the 83 proposed scenarios as MDEs. In the third Delphi round, consensus was achieved to include further 13 (15.7 %) scenarios as MDEs, exclude 9 (10.8 %) scenarios and the rest of 12 (14.5 %) scenarios were considered equivocal based on the opinions of the panelists. Conclusion Consensus on a definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice was achieved using a formal consensus technique. The use of consensual definitions and scenarios representing MDE situations in community pharmacy practice might minimize methodological variations and their significant effects on the number and rate of MDEs reported in different studies.

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique.

PubMed

Barry, Emma; O'Brien, Kirsty; Moriarty, Frank; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-09-06

There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Two-round modified Delphi consensus method. Irish and UK general practice. A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Constructing post-surgical discharge instructions through a Delphi consensus methodology.

PubMed

Scott, Aaron R; Sanderson, Cody J; Rush, Augustus J; Alore, Elizabeth A; Naik, Aanand D; Berger, David H; Suliburk, James W

2018-05-01

Patient education materials are a crucial part of physician-patient communication. We hypothesize that available discharge instructions are difficult to read and fail to address necessary topics. Our objective is to evaluate readability and content of surgical discharge instructions using thyroidectomy to develop standardized discharge materials. Thyroidectomy discharge materials were analyzed for readability and assessed for content. Fifteen endocrine surgeons participated in a modified Delphi consensus panel to select necessary topics. Using readability best practices, we created standardized discharge instructions which included all selected topics. The panel evaluated 40 topics, selected 23, deemed 4 inappropriate, consolidated 5, and did not reach consensus on 8 topics after 4 rounds. The evaluated instructions' reading levels ranged from grade 6.5 to 13.2; none contained all consensus topics. Current post surgical thyroidectomy discharge instructions are more difficult to read than recommended by literacy standards and omit consensus warning signs of major complications. Our easy-to-read discharge instructions cover pertinent topics and may enhance patient education. Delphi methodology is useful for developing post-surgical instructions. Patient education materials need appropriate readability levels and content. We recommend the Delphi method to select content using consensus expert opinion whenever higher level data is lacking. Copyright © 2017 Elsevier B.V. All rights reserved.

Development of post-disaster psychosocial evaluation and intervention for children: Results of a South Korean delphi panel survey

PubMed Central

Lee, Mi-Sun; Hwang, Jun-Won; Lee, Cheol-Soon; Kim, Ji-Youn; Lee, Ju-Hyun; Kim, Eunji; Chang, Hyoung Yoon; Bae, SeungMin; Park, Jang-Ho

2018-01-01

Objective This study aimed to administer a Delphi panel survey and provide evidence for the development of a psychological intervention protocol for use after disasters in South Korea. Method A three-round Delphi survey was conducted. In all rounds, respondents answered open- or closed-ended questions regarding their views on i) the concept of disaster, ii) evaluation, iii) intervention, and iv) considerations in a disaster. Data from Round 1 were subjected to content analysis. In Round 2, items with content validity ratios (CVRs) greater than 0.49 were included, and in Round 3, items with a CVR≥0.38 were accepted. Results The response rates for the Delphi survey were high: 83% (n = 15, Round 1), 80% (n = 16, Round 2), and 86% (n = 24, Round 3). The data collected during this survey showed a need for a support system for children; for preventive strategies, including disaster readiness plans; for the protection of children's safety; and for the development of post-disaster psychosocial care. Conclusions The panel experts reached a consensus regarding the steps they considered critical in post-disaster evaluation and intervention. The findings suggest a unified model for advancing the development of the Korean version of an intervention protocol for children and adolescents exposed to traumatic events. PMID:29596483

Initiation of biological agents in patients with ankylosing spondylitis: results of a Delphi study by the ASAS Group

PubMed Central

Pham, T; van der Heijde, D; Calin, A; Khan, M; van der Linden, S.; Bellamy, N; Dougados, M

2003-01-01

Background: There is ample evidence of important symptomatic efficacy of tumour necrosis factor α (TNFα) inhibition in ankylosing spondylitis (AS). Moreover, studies suggest that anti-TNF could be considered as the first disease controlling antirheumatic treatment (DC-ART) for AS. Objective: To determine precisely which patients with AS are most likely to benefit from anti-TNFα treatment because of the cost and possible long term side effects of such treatment. Methods: Assessment in Ankylosing Spondylitis (ASAS) members were asked to use a Delphi technique to name the characteristics of patients with AS for whom they would start DC-ART, in three different clinical presentations (isolated axial involvement, peripheral arthritis, enthesitis). Results: Among the 62 invited ASAS members, more than 50% actively participated in the four phases of definition according to the Delphi technique. For each of the three clinical presentations, a combination of five to six domains was proposed, with an evaluation instrument and a cut off point defining a minimum level of activity for each domain. Conclusion: This study provides a profile for a patient with AS for considering initiation of biological agents that reflects the opinion of the ASAS members, using a Delphi exercise. Further studies are required to assess their relevance and their consistency with clinical practice. PMID:12922951

A proposed minimum data set for international primary care optometry: a modified Delphi study.

PubMed

Davey, Christopher J; Slade, Sarah V; Shickle, Darren

2017-07-01

To identify a minimum list of metrics of international relevance to public health, research and service development which can be extracted from practice management systems and electronic patient records in primary optometric practice. A two stage modified Delphi technique was used. Stage 1 categorised metrics that may be recorded as being part of a primary eye examination by their importance to research using the results from a previous survey of 40 vision science and public health academics. Delphi stage 2 then gauged the opinion of a panel of seven vision science academics and achieved consensus on contentious metrics and methods of grading/classification. A consensus regarding inclusion and response categories was achieved for nearly all metrics. A recommendation was made of 53 metrics which would be appropriate in a minimum data set. This minimum data set should be easily integrated into clinical practice yet allow vital data to be collected internationally from primary care optometry. It should not be mistaken for a clinical guideline and should not add workload to the optometrist. A pilot study incorporating an additional Delphi stage prior to implementation is advisable to refine some response categories. © 2017 The Authors. Ophthalmic and Physiological Optics published by John Wiley & Sons Ltd on behalf of College of Optometrists.

Patient Involvement as Experts in the Development and Assessment of a Smartphone App as a Patient Education Tool for the Management of Thalassemia and Iron Overload Syndromes.

PubMed

Ward, Richard; Taha, Karim M

2016-09-01

Our aim was to develop and assess the feasibility of an education tool to improve health outcomes of patients with thalassemia. Thirty-five patients attending a Canadian thalassemia clinic were enrolled. Acting in an expert role, they participated in a Delphi method to reach consensus as to what tools and information should be incorporated in the development of a self management Smartphone app. One- and 6-month usability and health impact feedback surveys were built-in. Sixty percent of responders were 18-34 years old, over 50.0% had a college degree. The Delphi method successfully generated a comprehensive list of features important to patients. The app has been downloaded 147 times globally. Between March 2015 and January 2016, 19 responses for the 1-month survey were collected and the trends described. Responders reported improved medication adherence. The personal adherence pledge feature supports gamification of health apps to individualize goals of therapy. The impact of tracking iron levels was highly favorable. The Delphi method was an effective way to introduce a patient education and empowerment tool to the thalassemia population. The long-term impact requires data maturation. Use of validated methodology is essential to ensure ehealth interventions are positively contributing to patient education and disease outcomes.

[Competency requirements for executives in healthcare and social services organizations: Results of a Delphi study].

PubMed

Pielach, Martin; Schubert, Hans-Joachim

2018-02-07

Leadership in social services and healthcare organizations is marked by high levels of complexity and contradiction, which cannot be fully explained by politically, economically, and socially induced changes. Rather, it is the particularities of service provision in healthcare and social services that confront executives with specific demands. This study aimed to capture and prioritize required leadership competencies in healthcare and social services organizations. A three-step Delphi study was conducted with executives and managerial staff, who are job holders and thus experts on their occupation. For the first step, an explorative qualitative approach was chosen to record general opinion without prior assumptions. The following two steps weighted and selected the competency requirements in step one using rating- and ranking procedures. Results of the Delphi inquiry imply high relevance of social and personal competencies. Approximately 66 % of the competencies assessed in round three were social and personal competencies. 12 out of the 15 highest rated competencies in Delphi step three can be assigned to these two competency categories. In contrast, the importance of professional as well as methodical competencies was rated as less important. Only two methodical competencies and one professional competency were rated as very important by the panel. Nevertheless, the importance of executive professional and methodical competencies in healthcare and social services organizations is emphasized by high ratings of the competencies "Sector-specific expertise" and "Analytical skills". The methodical competency "Analytical skills" was identified by the Delphi respondents as the most important competency requirement. Social and personal requirements are of primary importance for leadership in healthcare and social services organizations. These results mostly correspond to leadership requirements posited in the literature on leadership skills. Emphasis should be on the specific relevance of professionalism, which can be traced back to the high proportion of professional activities in everyday working practices, the self-conception of executive staff based on professional qualifications and profession as well as the organizational form as expert organization. Healthcare and social services organizations are expert organizations with a strong emphasis on professional expertise. Professional knowledge is the most important means of production of expert organizations and imperative to leadership in healthcare and social services organization, given the high integration of executives into the professional system. Despite the dominance of social and personal competency requirements, the most important competency requirement is "Analytical skills", which can be described as the basis of every action. Copyright © 2018. Published by Elsevier GmbH.

Evaluation Criteria for Nursing Student Application of Evidence-Based Practice: A Delphi Study.

PubMed

Bostwick, Lina; Linden, Lois

2016-06-01

Core clinical evaluation criteria do not exist for measuring prelicensure baccalaureate nursing students' application of evidence-based practice (EBP) during direct care assignments. The study objective was to achieve consensus among EBP nursing experts to create clinical criteria for faculty to use in evaluating students' application of EBP principles. A three-round Delphi method was used. Experts were invited to participate in Web-based surveys. Data were analyzed using qualitative coding and categorizing. Quantitative analyses were descriptive calculations for rating and ranking. Expert consensus occurred in the Delphi rounds. The study provides a set of 10 core clinical evaluation criteria for faculty evaluating students' progression toward competency in their application of EBP. A baccalaureate program curriculum requiring the use of Bostwick's EBP Core Clinical Evaluation Criteria will provide a clear definition for understanding basic core EBP competence as expected for the assessment of student learning. [J Nurs Educ. 2016;55(5):336-341.]. Copyright 2016, SLACK Incorporated.

DelPhi web server v2: incorporating atomic-style geometrical figures into the computational protocol.

PubMed

Smith, Nicholas; Witham, Shawn; Sarkar, Subhra; Zhang, Jie; Li, Lin; Li, Chuan; Alexov, Emil

2012-06-15

A new edition of the DelPhi web server, DelPhi web server v2, is released to include atomic presentation of geometrical figures. These geometrical objects can be used to model nano-size objects together with real biological macromolecules. The position and size of the object can be manipulated by the user in real time until desired results are achieved. The server fixes structural defects, adds hydrogen atoms and calculates electrostatic energies and the corresponding electrostatic potential and ionic distributions. The web server follows a client-server architecture built on PHP and HTML and utilizes DelPhi software. The computation is carried out on supercomputer cluster and results are given back to the user via http protocol, including the ability to visualize the structure and corresponding electrostatic potential via Jmol implementation. The DelPhi web server is available from http://compbio.clemson.edu/delphi_webserver.

Operationalising elaboration theory for simulation instruction design: a Delphi study.

PubMed

Haji, Faizal A; Khan, Rabia; Regehr, Glenn; Ng, Gary; de Ribaupierre, Sandrine; Dubrowski, Adam

2015-06-01

The aim of this study was to assess the feasibility of incorporating the Delphi process within the simplifying conditions method (SCM) described in elaboration theory (ET) to identify conditions impacting the complexity of procedural skills for novice learners. We generated an initial list of conditions impacting the complexity of lumbar puncture (LP) from key informant interviews (n = 5) and a literature review. Eighteen clinician-educators from six different medical specialties were subsequently recruited as expert panellists. Over three Delphi rounds, these panellists rated: (i) their agreement with the inclusion of the simple version of the conditions in a representative ('epitome') training scenario, and (ii) how much the inverse (complex) version increases LP complexity for a novice. Cronbach's α-values were used to assess inter-rater agreement. All panellists completed Rounds 1 and 2 of the survey and 17 completed Round 3. In Round 1, Cronbach's α-values were 0.89 and 0.94 for conditions that simplify and increase LP complexity, respectively; both values increased to 0.98 in Rounds 2 and 3. With the exception of 'high CSF (cerebral spinal fluid) pressure', panellists agreed with the inclusion of all conditions in the simplest (epitome) training scenario. Panellists rated patient movement, spinal anatomy, patient cooperativeness, body habitus, and the presence or absence of an experienced assistant as having the greatest impact on the complexity of LP. This study demonstrated the feasibility of using expert consensus to establish conditions impacting the complexity of procedural skills, and the benefits of incorporating the Delphi method into the SCM. These data can be used to develop and sequence simulation scenarios in a progressively challenging manner. If the theorised learning gains associated with ET are realised, the methods described in this study may be applied to the design of simulation training for other procedural and non-procedural skills, thereby advancing the agenda of theoretically based instruction design in health care simulation. © 2015 John Wiley & Sons Ltd.

Rating scale for the assessment of competence in ultrasound-guided peripheral vascular access - a Delphi Consensus Study.

PubMed

Primdahl, Stine C; Todsen, Tobias; Clemmesen, Louise; Knudsen, Lars; Weile, Jesper

2016-09-21

Peripheral vascular access is vital for treatment and diagnostics of hospitalized patients. Ultrasound-guided vascular access (UGVA) is superior to the landmark technique. To ensure competence-based education, an assessment tool of UGVA competence is needed. We aimed to develop a global rating scale (RS) for assessment of UGVA competence based on opinions on the content from ultrasound experts in a modified Delphi consensus study. We included experts from anesthesiology, emergency medicine and radiology across university hospitals in Denmark. Nine elements were drafted based on existing literature and recommendations from international societies. In a multi-round survey, the experts rated the elements on a five-point Likert scale according to importance, and suggested missing elements. The final Delphi round occurred when >80% of the experts rated all elements ≥4 on the Likert scale. Sixteen experts consented to participate in the study, one withdrew consent prior to the first Delphi round, and 14 completed all three Delphi rounds. In the first Delphi round the experts excluded one element from the scale and changed the content of two elements. In the second Delphi round, the experts excluded one element from the scale. In the third Delphi round, consensus was obtained on the eight elements: preparation of utensils, ergonomics, preparation of the ultrasound device, identification of blood vessels, anatomy, hygiene, coordination of the needle, and completion of the procedure. We developed an RS for assessment of UGVA competence based on opinions of ultrasound experts through a modified Delphi consensus study.

An international survey and modified Delphi process revealed editors’ perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals

PubMed Central

Galipeau, James; Cobey, Kelly D.; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants’ list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 “highly rated” competency-related statements and another 86 “included” items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future. PMID:28979768

An international survey and modified Delphi process revealed editors' perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals.

PubMed

Galipeau, James; Cobey, Kelly D; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants' list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 "highly rated" competency-related statements and another 86 "included" items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future.

Use of cultural consensus analysis to evaluate expert feedback of median safety.

PubMed

Kim, Tae-Gyu; Donnell, Eric T; Lee, Dongmin

2008-07-01

Cultural consensus analysis is a statistical method that can be used to assess participant responses to survey questions. The technique concurrently estimates the knowledge of each survey participant and estimates the culturally correct answer to each question asked, based on the existence of consensus among survey participants. The main objectives of this paper are to present the cultural consensus methodology and apply it to a set of median design and safety survey data that were collected using the Delphi method. A total of 21 Delphi survey participants were asked to answer research questions related to cross-median crashes. It was found that the Delphi panel had agreeable opinions with respect to the association of average daily traffic (ADT) and heavy vehicle percentage combination on the risk of cross-median crashes; relative importance of additional factors, other than ADT, median width, and crash history that may contribute to cross-median crashes; and, the relative importance of geometric factors that may be associated with the likelihood of cross-median crashes. Therefore, the findings from the cultural consensus analysis indicate that the expert panel selected to participate in the Delphi survey shared a common knowledge pool relative to the association between median design and safety. There were, however, diverse opinions regarding median barrier type and its preferred placement location. The panel showed a higher level of knowledge on the relative importance regarding the association of geometric factors on cross-median crashes likelihood than on other issues considered. The results of the cultural consensus analysis of the present median design and safety survey data could be used to design a focused field study of median safety.

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study.

PubMed

Mascherek, Anna C; Schwappach, David L B

2016-08-05

Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Developing consensus-based policy solutions for medicines adherence for Europe: a delphi study

PubMed Central

2012-01-01

Background Non-adherence to prescribed medication is a pervasive problem that can incur serious effects on patients’ health outcomes and well-being, and the availability of resources in healthcare systems. This study aimed to develop practical consensus-based policy solutions to address medicines non-adherence for Europe. Methods A four-round Delphi study was conducted. The Delphi Expert Panel comprised 50 participants from 14 countries and was representative of: patient/carers organisations; healthcare providers and professionals; commissioners and policy makers; academics; and industry representatives. Participants engaged in the study remotely, anonymously and electronically. Participants were invited to respond to open questions about the causes, consequences and solutions to medicines non-adherence. Subsequent rounds refined responses, and sought ratings of the relative importance, and operational and political feasibility of each potential solution to medicines non-adherence. Feedback of individual and group responses was provided to participants after each round. Members of the Delphi Expert Panel and members of the research group participated in a consensus meeting upon completion of the Delphi study to discuss and further refine the proposed policy solutions. Results 43 separate policy solutions to medication non-adherence were agreed by the Panel. 25 policy solutions were prioritised based on composite scores for importance, and operational and political feasibility. Prioritised policy solutions focused on interventions for patients, training for healthcare professionals, and actions to support partnership between patients and healthcare professionals. Few solutions concerned actions by governments, healthcare commissioners, or interventions at the system level. Conclusions Consensus about practical actions necessary to address non-adherence to medicines has been developed for Europe. These actions are also applicable to other regions. Prioritised policy solutions for medicines non-adherence offer a benefit to policymakers and healthcare providers seeking to address this multifaceted, complex problem. PMID:23176439

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study

PubMed Central

Mascherek, Anna C

2016-01-01

Objective Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. Design As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Results Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Conclusions Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. PMID:27496233

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method.

PubMed

Yeh, James S; Van Hoof, Thomas J; Fischer, Michael A

2016-02-01

Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process.

Remediation System Evaluation, Delphi Corporation Site in Vandalia, Ohio

EPA Pesticide Factsheets

This RSE pertains to aspects of the corrective action underway at two neighboring plants, the Delphi Energy and Chassis Systems Plant and Delphi Safety and Interior Systems Plant, collectively referred to as the “facility” in this report.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.

PubMed

Birko, Stanislav; Dove, Edward S; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts' variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions. PMID:26270647

An international survey and modified Delphi approach revealed numerous rapid review methods.

PubMed

Tricco, Andrea C; Zarin, Wasifa; Antony, Jesmin; Hutton, Brian; Moher, David; Sherifali, Diana; Straus, Sharon E

2016-02-01

To solicit experiences with and perceptions of rapid reviews from stakeholders, including researchers, policy makers, industry, journal editors, and health care providers. An international survey of rapid review producers and modified Delphi. Forty rapid review producers responded on our survey (63% response rate). Eighty-eight rapid reviews with 31 different names were reported. Rapid review commissioning organizations were predominantly government (78%) and health care (58%) organizations. Several rapid review approaches were identified, including updating the literature search of previous reviews (92%); limiting the search strategy by date of publication (88%); and having only one reviewer screen (85%), abstract data (84%), and assess the quality of studies (86%). The modified Delphi included input from 113 stakeholders on the rapid review approaches from the survey. Approach 1 (search limited by date and language; study selection by one reviewer only, and data abstraction and quality appraisal conducted by one reviewer and one verifier) was ranked the most feasible (72%, 81/113 responses), with the lowest perceived risk of bias (12%, 12/103); it also ranked second in timeliness (37%, 38/102) and fifth in comprehensiveness (5%, 5/100). Rapid reviews have many names and approaches, and some methods might be more desirable than others. Copyright © 2016 Elsevier Inc. All rights reserved.

What makes a competent clinical teacher?

PubMed Central

Wealthall, Stephen; Henning, Marcus

2012-01-01

Background Clinical teaching competency is a professional necessity ensuring that clinicians’ knowledge, skills and attitudes are effectively transmitted from experts to novices. The aim of this paper is to consider how clinical skills are transmitted from a historical and reflective perspective and to link these ideas with student and teacher perceptions of competence in clinical teaching. Methods The reflections are informed by a Delphi process and professional development survey designed to capture students’ and clinicians’ ideas about the attributes of a competent clinical teacher. In addition, the survey process obtained information on the importance and ‘teachability’ of these characteristics. Results Four key characteristics of the competent teacher emerged from the Delphi process: clinically competent, efficient organizer, group communicator and person–centred. In a subsequent survey, students were found to be more optimistic about the ‘teachability’ of these characteristics than clinicians and scored the attribute of person-centredness higher than clinicians. Clinicians, on the other hand, ascribed higher levels of importance to clinical competency, efficient organization and group communication than students. Conclusions The Delphi process created a non-threatening system for gathering student and clinician expectations of teachers and created a foundation for developing methods for evaluating clinical competency. This provided insights into differences between teachers’ and students’ expectations, their importance, and professional development. PMID:26451184

Guidelines for using the Delphi Technique to develop habitat suitability index curves

USGS Publications Warehouse

Crance, Johnie H.

1987-01-01

Habitat Suitability Index (SI) curves are one method of presenting species habitat suitability criteria. The curves are often used with the Habitat Evaluation Procedures (HEP) and are necessary components of the Instream Flow Incremental Methodology (IFIM) (Armour et al. 1984). Bovee (1986) described three categories of SI curves or habitat suitability criteria based on the procedures and data used to develop the criteria. Category I curves are based on professional judgment, with 1ittle or no empirical data. Both Category II (utilization criteria) and Category III (preference criteria) curves have as their source data collected at locations where target species are observed or collected. Having Category II and Category III curves for all species of concern would be ideal. In reality, no SI curves are available for many species, and SI curves that require intensive field sampling often cannot be developed under prevailing constraints on time and costs. One alternative under these circumstances is the development and interim use of SI curves based on expert opinion. The Delphi technique (Pill 1971; Delbecq et al. 1975; Linstone and Turoff 1975) is one method used for combining the knowledge and opinions of a group of experts. The purpose of this report is to describe how the Delphi technique may be used to develop expert-opinion-based SI curves.

Scientific framework for research on disaster and mass casualty incident in Korea: building consensus using Delphi method.

PubMed

Kim, Chu Hyun; Park, Ju Ok; Park, Chang Bae; Kim, Seong Chun; Kim, Soo Jin; Hong, Ki Jeong

2014-01-01

We aimed to determine the scientific framework for research on disaster and mass casualty incident (MCI) in Korea, especially Korean terminology, feasible definition, and epidemiologic indices. The two staged policy Delphi method was performed by instructors of National Disaster Life Support (NDLS®) with the constructed questionnaire containing items based on the literature review. The first-stage survey was conducted by 11 experts through two rounds of survey for making issue and option. The second-stage survey was conducted by 35 experts for making a generalized group based consensus. Experts were selected among instructors of National Disaster Life Support Course. Through two staged Delphi survey experts made consensus: 1) the Korean terminology "jaenan" with "disaster" and "dajung-sonsang-sago" with "MCI"; 2) the feasible definition of "disaster" as the events that have an effect on one or more municipal local government area (city-county-district) or results in ≥ 10 of death or ≥ 50 injured victims; 3) the feasible definition of MCI as the events that result in ≥ 6 casualties including death; 4) essential 31 epidemiologic indices. Experts could determine the scientific framework in Korea for research on disaster medicine, considering the distinct characteristics of Korea and current research trends.

Developing a Canadian Curriculum for Simulation-Based Education in Obstetrics and Gynaecology: A Delphi Study.

PubMed

Craig, Catherine; Posner, Glenn D

2017-09-01

As obstetrics and gynaecology (Ob/Gyn) residency training programs move towards a competence-based approach to training and assessment, the development of a national standardized simulation curriculum is essential. The primary goal of this study was to define the fundamental content for the Canadian Obstetrics and Gynecology Simulation curriculum. A modified Delphi technique was used to achieve consensus in three rounds by surveying residency program directors or their local simulation educator delegates in 16 accredited Canadian Ob/Gyn residency programs. A consensus rate of 80% was agreed upon. Survey results were collected over 11 months in 2016. Response rates for the Delphi were 50% for the first round, 81% for the second round, and 94% for the third round. The first survey resulted in 84 suggested topics. These were organized into four categories: obstetrics high acuity low frequency events, obstetrics common events, gynaecology high acuity low frequency events, and gynaecology common events. Using the modified Delphi method, consensus was reached on 6 scenarios. This study identified the content for a national simulation-based curriculum for Ob/Gyn residency training programs and is the first step in the development of this curriculum. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

European undergraduate curriculum in geriatric medicine developed using an international modified Delphi technique

PubMed Central

Masud, Tahir; Blundell, Adrian; Gordon, Adam Lee; Mulpeter, Ken; Roller, Regina; Singler, Katrin; Goeldlin, Adrian; Stuck, Andreas

2014-01-01

Introduction: the rise in the number of older, frail adults necessitates that future doctors are adequately trained in the skills of geriatric medicine. Few countries have dedicated curricula in geriatric medicine at the undergraduate level. The aim of this project was to develop a consensus among geriatricians on a curriculum with the minimal requirements that a medical student should achieve by the end of medical school. Methods: a modified Delphi process was used. First, educational experts and geriatricians proposed a set of learning objectives based on a literature review. Second, three Delphi rounds involving a panel with 49 experts representing 29 countries affiliated to the European Union of Medical Specialists (UEMS) was used to gain consensus for a final curriculum. Results: the number of disagreements following Delphi Rounds 1 and 2 were 81 and 53, respectively. Complete agreement was reached following the third round. The final curriculum consisted of detailed objectives grouped under 10 overarching learning outcomes. Discussion: a consensus on the minimum requirements of geriatric learning objectives for medical students has been agreed by European geriatricians. Major efforts will be needed to implement these requirements, given the large variation in the quality of geriatric teaching in medical schools. This curriculum is a first step to help improve teaching of geriatrics in medical schools, and will also serve as a basis for advancing postgraduate training in geriatrics across Europe. PMID:24603283

Determination of Problematic ICD-9-CM Subcategories for Further Study of Coding Performance: Delphi Method

PubMed Central

Zeng, Xiaoming; Bell, Paul D

2011-01-01

In this study, we report on a qualitative method known as the Delphi method, used in the first part of a research study for improving the accuracy and reliability of ICD-9-CM coding. A panel of independent coding experts interacted methodically to determine that the three criteria to identify a problematic ICD-9-CM subcategory for further study were cost, volume, and level of coding confusion caused. The Medicare Provider Analysis and Review (MEDPAR) 2007 fiscal year data set as well as suggestions from the experts were used to identify coding subcategories based on cost and volume data. Next, the panelists performed two rounds of independent ranking before identifying Excisional Debridement as the subcategory that causes the most confusion among coders. As a result, they recommended it for further study aimed at improving coding accuracy and variation. This framework can be adopted at different levels for similar studies in need of a schema for determining problematic subcategories of code sets. PMID:21796264

Pathways to Lean Software Development: An Analysis of Effective Methods of Change

ERIC Educational Resources Information Center

Hanson, Richard D.

2014-01-01

This qualitative Delphi study explored the challenges that exist in delivering software on time, within budget, and with the original scope identified. The literature review identified many attempts over the past several decades to reform the methods used to develop software. These attempts found that the classical waterfall method, which is…

Global priorities for research and the relative importance of different research outcomes: an international Delphi survey of malaria research experts.

PubMed

Mulligan, Jo-Ann; Conteh, Lesong

2016-12-06

As global research investment increases, attention inevitably turns to assessing and measuring the outcomes and impact from research programmes. Research can have many different outcomes such as producing advances in scientific knowledge, building research capacity and, ultimately, health and broader societal benefits. The aim of this study was to test the use of a Delphi methodology as a way of gathering views from malaria research experts on research priorities and eliciting relative valuations of the different types of health research impact. An international Delphi survey of 60 malaria research experts was used to understand views on research outcomes and priorities within malaria and across global health more widely. The study demonstrated the application of the Delphi technique to eliciting views on malaria specific research priorities, wider global health research priorities and the values assigned to different types of research impact. In terms of the most important past research successes, the development of new anti-malarial drugs and insecticide-treated bed nets were rated as the most important. When asked about research priorities for future funding, respondents ranked tackling emerging drug and insecticide resistance the highest. With respect to research impact, the panel valued research that focuses on health and health sector benefits and informing policy and product development. Contributions to scientific knowledge, although highly valued, came lower down the ranking, suggesting that efforts to move research discoveries to health products and services are valued more highly than pure advances in scientific knowledge. Although the Delphi technique has been used to elicit views on research questions in global health this was the first time it has been used to assess how a group of research experts value or rank different types of research impact. The results suggest it is feasible to inject the views of a key stakeholder group into the research prioritization process and the Delphi approach is a useful tool for eliciting views on the value or importance of research impact. Future work will explore other methods for assessing and valuing research impact and test the feasibility of developing a composite tool for measuring research outcomes weighted by the values of different stakeholders.

Establishing key components of yoga interventions for musculoskeletal conditions: a Delphi survey

PubMed Central

2014-01-01

Background Evidence suggests yoga is a safe and effective intervention for the management of physical and psychosocial symptoms associated with musculoskeletal conditions. However, heterogeneity in the components and reporting of clinical yoga trials impedes both the generalization of study results and the replication of study protocols. The aim of this Delphi survey was to address these issues of heterogeneity, by developing a list of recommendations of key components for the design and reporting of yoga interventions for musculoskeletal conditions. Methods Recognised experts involved in the design, conduct, and teaching of yoga for musculoskeletal conditions were identified from a systematic review, and invited to contribute to the Delphi survey. Forty-one of the 58 experts contacted, representing six countries, agreed to participate. A three-round Delphi was conducted via electronic surveys. Round 1 presented an open-ended question, allowing panellists to individually identify components they considered key to the design and reporting of yoga interventions for musculoskeletal conditions. Thematic analysis of Round 1 identified items for quantitative rating in Round 2; items not reaching consensus were forwarded to Round 3 for re-rating. Results Thirty-six panellists (36/41; 88%) completed the three rounds of the Delphi survey. Panellists provided 348 comments to the Round 1 question. These comments were reduced to 49 items, grouped under five themes, for rating in subsequent rounds. A priori group consensus of ≥80% was reached on 28 items related to five themes concerning defining the yoga intervention, types of yoga practices to include in an intervention, delivery of the yoga protocol, domains of outcome measures, and reporting of yoga interventions for musculoskeletal conditions. Additionally, a priori consensus of ≥50% was reached on five items relating to minimum values for intervention parameters. Conclusions Expert consensus has provided a non-prescriptive reference list for the design and reporting of yoga interventions for musculoskeletal conditions. It is anticipated future research incorporating the Delphi guidelines will facilitate high quality international research in this field, increase homogeneity of intervention components and parameters, and enhance the comparison and reproducibility of research into the use of yoga for the management of musculoskeletal conditions. PMID:24942270

Project evaluation and selection using fuzzy Delphi method and zero - one goal programming

NASA Astrophysics Data System (ADS)

Alias, Suriana; Adna, Nofarziah; Arsad, Roslah; Soid, Siti Khuzaimah; Ali, Zaileha Md

2014-12-01

Project evaluation and selection is a factor affecting the impotence of board director in which is trying to maximize all the possible goals. Assessment of the problem occurred in organization plan is the first phase for decision making process. The company needs a group of expert to evaluate the problems. The Fuzzy Delphi Method (FDM) is a systematic procedure to evoke the group's opinion in order to get the best result to evaluate the project performance. This paper proposes an evaluation and selection of the best alternative project based on combination of FDM and Zero - One Goal Programming (ZOGP) formulation. ZOGP is used to solve the multi-criteria decision making for final decision part by using optimization software LINDO 6.1. An empirical example on an ongoing decision making project in Johor, Malaysia is implemented for case study.

Core competency model for the family planning public health nurse.

PubMed

Hewitt, Caroline M; Roye, Carol; Gebbie, Kristine M

2014-01-01

A core competency model for family planning public health nurses has been developed, using a three stage Delphi Method with an expert panel of 40 family planning senior administrators, community/public health nursing faculty and seasoned family planning public health nurses. The initial survey was developed from the 2011 Title X Family Planning program priorities. The 32-item survey was distributed electronically via SurveyMonkey(®). Panelist attrition was low, and participation robust resulting in the final 28-item model, suggesting that the Delphi Method was a successful technique through which to achieve consensus. Competencies with at least 75% consensus were included in the model and those competencies were primarily related to education/counseling and administration of medications and contraceptives. The competencies identified have implications for education/training, certification and workplace performance. © 2014 Wiley Periodicals, Inc.

78 FR 48468 - Delphi Corporation, Electronics and Safety Division, Including On-Site Leased Workers From...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-08

..., Electronics and Safety Division, Including On-Site Leased Workers From Securitas, Bartech, Flint Janitorial... Adjustment Assistance on May 20, 2013, applicable to workers of Delphi Corporation, Electronics and Safety... on- site at the Flint, Michigan location of Delphi Corporation, Electronics and Safety Division. The...

75 FR 20383 - Delphi Thermal Systems Currently Known as General Motors Components Holdings LLC, Lockport...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-19

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-63,818] Delphi Thermal Systems... 25, 2008, applicable to workers of Delphi Thermal Systems, Lockport Operations, Lockport, New York... workers are engaged in activities related to the production of automotive heat exchanger products and HVAC...

Climate Change Impacts and Vulnerability Assessment in Industrial Complexes

NASA Astrophysics Data System (ADS)

Lee, H. J.; Lee, D. K.

2016-12-01

Climate change has recently caused frequent natural disasters, such as floods, droughts, and heat waves. Such disasters have also increased industrial damages. We must establish climate change adaptation policies to reduce the industrial damages. It is important to make accurate vulnerability assessment to establish climate change adaptation policies. Thus, this study aims at establishing a new index to assess vulnerability level in industrial complexes. Most vulnerability indices have been developed with subjective approaches, such as the Delphi survey and the Analytic Hierarchy Process(AHP). The subjective approaches rely on the knowledge of a few experts, which provokes the lack of the reliability of the indices. To alleviate the problem, we have designed a vulnerability index incorporating objective approaches. We have investigated 42 industrial complex sites in Republic of Korea (ROK). To calculate weights of variables, we used entropy method as an objective method integrating the Delphi survey as a subjective method. Finally, we found our method integrating both subjective method and objective method could generate result. The integration of the entropy method enables us to assess the vulnerability objectively. Our method will be useful to establish climate change adaptation policies by reducing the uncertainties of the methods based on the subjective approaches.

DELPHI: An introduction to output layout and data content

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, C.F.

1994-08-16

DELPHI was the data summary and interpretation code used by gas diagnostics personnel during the period from 1968 through 1986. It was written by Floyd Momyer, and went through several revisions during its period of use. Described here is the final version, which provided the most extensive set of summary tables. Earlier versions of the code lacked some of the capabilities of the final version, but what they did include was of substantially the same format. DELPHI was run against most available input decks in the mid 1980s. Microfiche and hardcopy output were generated. Both now reside in our archives.more » These reruns used modified input decks, which may not have had the proper {open_quotes}trigger{close_quotes} to instruct DELPHI to output some tables. These tables could, therefore be missing from a printout even though the necessary data was present. Also, modifications to DELPHI did, in some instances, eliminate DELPHIs` capability to correctly output some of the earlier optional tables. This monologue is intended to compliment the archived printout, and to provide enough insight so that someone unfamiliar with the techniques of Gas Diagnostics can retrieve the results at some future date. DELPHI last ran on the CDC-7600 machines, and was not converted to run on the Crays when the CDC-7600`s were decommissioned. DELPHI accepted data from various analytical systems, set up data summary tables, and combined preshot tracer and detector data with these results to calculate the total production of measured species and the indicated fission yields and detector conversions.« less

Environmental initiative prioritization with a Delphi approach: a case study.

PubMed

Gokhale, A A

2001-08-01

India is fast finding its place in the industrialized world and that is beginning to raise its environmental consciousness. The Delphi technique was used to prioritize specific needs and articulate a sustainable urban improvement strategy for the city of Mumbai (formerly Bombay). The Delphi technique is a means of achieving consensual validity among raters by providing them feedback regarding other raters' responses. Mumbai has several indigenous environmental groups that were tapped for activists and leaders; the study was conducted using ten environmentalists. In the initial phases the responses resulted in a range of possible program alternatives. The last two stages helped to seek out information that generated a consensus on the part of the respondent group. Statistical analysis methods included a hierarchical cluster analysis, mean, median, mode, and percent of agreement calculations using SPSS software. The face-to-face discussion in phase 4 clarified some issues and helped the group as a whole to outline the strategy for putting in place the essential elements of a framework to improve the quality of life in an urban environment.

Communication and social competencies in medical education in German-speaking countries: the Basel consensus statement. Results of a Delphi survey.

PubMed

Kiessling, Claudia; Dieterich, Anja; Fabry, Götz; Hölzer, Henrike; Langewitz, Wolf; Mühlinghaus, Isabel; Pruskil, Susanne; Scheffer, Simone; Schubert, Sebastian

2010-11-01

To propose a comprehensive set of competencies and educational objectives for communication and social competencies in undergraduate medical education and to support the nationwide implementation of these issues in all medical schools. Thirty experts from different medical and psychosocial disciplines participated in a 2-day workshop using the Nominal Group Technique (NGT) to develop an initial set of educational objectives. These were refined, structured, and rated according to their importance by means of a two-step Delphi Survey involving additional experts in medical education. The initial workshop resulted in 188 educational objectives assigned to 26 different topics. After the Delphi Survey, 131 objectives remained, assigned to 19 different topics. Some objectives that could be assigned to more than one topic were subsumed under a new more general category. The described consensus process proved successful as one method to develop a set of educational objectives. The Basel consensus statement can be used to orientate curriculum reform and development in medical education. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Japanese Clinical Guidelines for Endoscopic Treatment of Pancreatolithiasis.

PubMed

Inui, Kazuo; Igarashi, Yoshinori; Irisawa, Atsushi; Ohara, Hirotaka; Tazuma, Susumu; Hirooka, Yoshiki; Fujita, Naotaka; Miyakawa, Hiroyuki; Sata, Naohiro; Shimosegawa, Tooru; Tanaka, Masao; Shiratori, Keiko; Sugiyama, Masanori; Takeyama, Yoshifumi

2015-10-01

In addition to surgery, procedures for patients with pancreatolithiasis are developing; therefore, establishing practical guidelines for the management of pancreatolithiasis is required. Three committees (the professional committee for asking clinical questions (CQs) and statements by Japanese endoscopists, the expert panel committee for rating statements by the modified Delphi method, and the evaluating committee by moderators) were organized. Eight endoscopists and a surgeon for pancreatolithiasis made the CQs and statements from a total of 694 reports of published literature by PubMed search (from 1983 to 2012). The expert panelists individually rated these clinical statements using a modified Delphi approach, in which a clinical statement receiving a median score greater than 7 on a 9-point scale from the panel was regarded as valid. The professional committee made 3, 7, and 10 CQs and statements for the concept and pathogenesis, diagnosis, and treatment, respectively. The expert panelists regarded them as valid after a 2-round modified Delphi approach. After evaluation by the moderators, the Japanese clinical guidelines for pancreatolithiasis were established. Further discussions and studies for international guidelines are needed.

Using the Delphi Technique to Support Curriculum Development

ERIC Educational Resources Information Center

Sitlington, Helen Barbara; Coetzer, Alan John

2015-01-01

Purpose: The purpose of this paper is to present an analysis of the use of the Delphi technique to support curriculum development with a view to enhancing existing literature on use of the technique for renewal of business course curricula. Design/methodology/approach: The authors outline the Delphi process for obtaining consensus amongst a…

The Delphi Predictions of Pathology Chairmen: A Six-Year Retrospective View.

ERIC Educational Resources Information Center

Hill, Rolla B.; Goodale, Fairfield

1981-01-01

A retrospective review is reported of progress in academic pathology since 1974, when the Association of Pathology Chairmen undertook a Delphi study of pathology chairmen's expectations and desires for the future. The Delphi study was useful in alerting academic pathologists to opportunities and in coalescing activities toward achievement of…

Identifying Core Concepts of Cybersecurity: Results of Two Delphi Processes

ERIC Educational Resources Information Center

Parekh, Geet; DeLatte, David; Herman, Geoffrey L.; Oliva, Linda; Phatak, Dhananjay; Scheponik, Travis; Sherman, Alan T.

2018-01-01

This paper presents and analyzes results of two Delphi processes that polled cybersecurity experts to rate cybersecurity topics based on importance, difficulty, and timelessness. These ratings can be used to identify core concepts--cross-cutting ideas that connect knowledge in the discipline. The first Delphi process identified core concepts that…

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors

PubMed Central

Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

Background The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Methods Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. Findings All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. Conclusions This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention. PMID:26726801

From the Medical Board of the National Psoriasis Foundation: Treatment targets for plaque psoriasis.

PubMed

Armstrong, April W; Siegel, Michael P; Bagel, Jerry; Boh, Erin E; Buell, Megan; Cooper, Kevin D; Callis Duffin, Kristina; Eichenfield, Lawrence F; Garg, Amit; Gelfand, Joel M; Gottlieb, Alice B; Koo, John Y M; Korman, Neil J; Krueger, Gerald G; Lebwohl, Mark G; Leonardi, Craig L; Mandelin, Arthur M; Menter, M Alan; Merola, Joseph F; Pariser, David M; Prussick, Ronald B; Ryan, Caitriona; Shah, Kara N; Weinberg, Jeffrey M; Williams, MaryJane O U; Wu, Jashin J; Yamauchi, Paul S; Van Voorhees, Abby S

2017-02-01

An urgent need exists in the United States to establish treatment goals in psoriasis. We aim to establish defined treatment targets toward which clinicians and patients with psoriasis can strive to inform treatment decisions, reduce disease burden, and improve outcomes in practice. The National Psoriasis Foundation conducted a consensus-building study among psoriasis experts using the Delphi method. The process consisted of: (1) literature review, (2) pre-Delphi question selection and input from general dermatologists and patients, and (3) 4 Delphi rounds. A total of 25 psoriasis experts participated in the Delphi process. The most preferred instrument was body surface area (BSA). The most preferred time for evaluating patient response after starting new therapies was at 3 months. The acceptable response at 3 months postinitiation was either BSA 3% or less or BSA improvement 75% or more from baseline. The target response at 3 months postinitiation was BSA 1% or less. During the maintenance period, evaluation every 6 months was most preferred. The target response at every 6 months maintenance evaluation is BSA 1% or less. Although BSA is feasible in practice, it does not encompass health-related quality of life, costs, and risks of side effects. With defined treatment targets, clinicians and patients can regularly evaluate treatment responses and perform benefit-risk assessments of therapeutic options individualized to the patient. Copyright © 2016 American Academy of Dermatology, Inc. Published by Elsevier Inc. All rights reserved.

Delphi Method Validation of a Procedural Performance Checklist for Insertion of an Ultrasound-Guided Internal Jugular Central Line.

PubMed

Hartman, Nicholas; Wittler, Mary; Askew, Kim; Manthey, David

2016-01-01

Placement of ultrasound-guided central lines is a critical skill for physicians in several specialties. Improving the quality of care delivered surrounding this procedure demands rigorous measurement of competency, and validated tools to assess performance are essential. Using the iterative, modified Delphi technique and experts in multiple disciplines across the United States, the study team created a 30-item checklist designed to assess competency in the placement of ultrasound-guided internal jugular central lines. Cronbach α was .94, indicating an excellent degree of internal consistency. Further validation of this checklist will require its implementation in simulated and clinical environments. © The Author(s) 2014.

Expert Opinion Is Necessary: Delphi Panel Methodology Facilitates a Scientific Approach to Consensus.

PubMed

Hohmann, Erik; Brand, Jefferson C; Rossi, Michael J; Lubowitz, James H

2018-02-01

Our current trend and focus on evidence-based medicine is biased in favor of randomized controlled trials, which are ranked highest in the hierarchy of evidence while devaluing expert opinion, which is ranked lowest in the hierarchy. However, randomized controlled trials have weaknesses as well as strengths, and no research method is flawless. Moreover, stringent application of scientific research techniques, such as the Delphi Panel methodology, allows survey of experts in a high quality and scientific manner. Level V evidence (expert opinion) remains a necessary component in the armamentarium used to determine the answer to a clinical question. Copyright © 2017 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Study plan to identify long term national telecommunications need and priorities applying Delphi techniques (handbook). [technological forecasting - United States of America

NASA Technical Reports Server (NTRS)

1974-01-01

A handbook that explains the basic Delphi methodology and discusses modified Delphi techniques is presented. The selection of communications experts to participate in a study, the construction of questionnaires on potential communications developments, and requisite technology is treated. No two modified Delphi studies were the same, which reflects the flexibility and adaptability of the technique. Each study must be specifically tailored to a particular case, and consists of seeking a consensus of opinion among experts about a particular subject and attendant conditions that may prevail in the future.

A Delphi survey on diagnosis and management of stress velopharyngeal insufficiency in wind musicians.

PubMed

Evans, Alison; Driscoll, Tim; Ackermann, Bronwen

2014-10-01

The aim of this study was to identify current trends in clinical assessment and management of stress velopharyngeal insufficiency (VPI) in wind musicians. This was an online two-round Delphi survey of health practitioners familiar with assessing and treating musicians with stress VPI. Fourteen specialists (seven otolaryngologists and seven speech-language pathologists) from four countries participated in the Delphi survey. From the first round questionnaire, 32 items were identified as being causes, assessment tools, diagnostic indicators, and treatment methods for stress VPI. The second round questionnaire revealed that prolonged exposure to high intra-oral pressures was important in determining the cause of stress VPI. The most important assessment tools for stress VPI were case history and nasendoscopy. The most important indicator for stress VPI was self-reported symptoms. There was no clear agreement identified on the management methods for stress VPI for musicians. However, the trend followed by most of the survey participants was a combination of conservative management approaches (including rest or watch and wait, speech-language pathology intervention, velopharyngeal muscle training, and changes to the instrument or reed), and then, if symptoms persist, to use injection pharyngoplasty or pharyngeal flap. This survey demonstrates that no standard management protocol currently exists for musicians diagnosed with stress VPI, but provides current trends in the assessment and management which can be used in future guidelines for health professionals who treat wind musicians.

Alternative method of highway traffic safety analysis for developing countries using delphi technique and Bayesian network.

PubMed

Mbakwe, Anthony C; Saka, Anthony A; Choi, Keechoo; Lee, Young-Jae

2016-08-01

Highway traffic accidents all over the world result in more than 1.3 million fatalities annually. An alarming number of these fatalities occurs in developing countries. There are many risk factors that are associated with frequent accidents, heavy loss of lives, and property damage in developing countries. Unfortunately, poor record keeping practices are very difficult obstacle to overcome in striving to obtain a near accurate casualty and safety data. In light of the fact that there are numerous accident causes, any attempts to curb the escalating death and injury rates in developing countries must include the identification of the primary accident causes. This paper, therefore, seeks to show that the Delphi Technique is a suitable alternative method that can be exploited in generating highway traffic accident data through which the major accident causes can be identified. In order to authenticate the technique used, Korea, a country that underwent similar problems when it was in its early stages of development in addition to the availability of excellent highway safety records in its database, is chosen and utilized for this purpose. Validation of the methodology confirms the technique is suitable for application in developing countries. Furthermore, the Delphi Technique, in combination with the Bayesian Network Model, is utilized in modeling highway traffic accidents and forecasting accident rates in the countries of research. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development of quality indicators to evaluate antibiotic treatment of patients with community-acquired pneumonia in Indonesia.

PubMed

Farida, Helmia; Rondags, Angelique; Gasem, M Hussein; Leong, Katharina; Adityana, A; van den Broek, Peterhans J; Keuter, Monique; Natsch, Stephanie

2015-04-01

To develop an instrument for evaluating the quality of antibiotic management of patients with community-acquired pneumonia (CAP) applicable in a middle-income developing country. A previous study and Indonesian guidelines were reviewed to derive potential quality of care indicators (QIs). An expert panel performed a two-round Delphi consensus procedure on the QI's relevance to patient recovery, reduction of antimicrobial resistance and cost containment. Applicability in practice, including reliability, feasibility and opportunity for improvement, was determined in a data set of 128 patients hospitalised with CAP in Semarang, Indonesia. Fifteen QIs were selected by the consensus procedure. Five QIs did not pass feasibility criteria, because of inappropriate documentation, inefficient laboratory services or patient factors. Three QIs provided minor opportunity for improvement. Two QIs contradicted each other; one of these was considered not valid and excluded. A final set of six QIs was defined for use in the Indonesian setting. Using the Delphi method, we defined a list of QIs for assessing the quality of care, in particular antibiotic treatment, for CAP in Indonesia. For further improvement, a modified Delphi method that includes discussion, a sound medical documentation system, improvement of microbiology laboratory services, and multi-center applicability tests are needed to develop a valid and applicable QI list for the Indonesian setting. © 2014 John Wiley & Sons Ltd.

76 FR 46852 - Workers From Kelly Services, Working On-Site at Delphi Automotive Systems, LLC, Powertrain...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-03

... Services, Working On-Site at Delphi Automotive Systems, LLC, Powertrain Division, El Paso, TX; Amended..., 2011, applicable to leased workers from Kelly Services working on-site at Delphi Automotive Systems... automotive components. The notice will be published soon in the Federal Register. At the request of the State...

Lessons Learned from Teaching Scratch as an Introduction to Object-Oriented Programming in Delphi

ERIC Educational Resources Information Center

van Zyl, Sukie; Mentz, Elsa; Havenga, Marietjie

2016-01-01

As part of curriculum changes in South Africa, an introductory programming language, Scratch, must first be taught before switching to the well-established teaching of Delphi. The nature of programming in Scratch is considerably different from that in Delphi. It was assumed that the teaching of Scratch as introductory programming language could…

What Is Next for Functional Requirements for Bibliographic Records? A Delphi Study

ERIC Educational Resources Information Center

Zhang, Yin; Salaba, Athena

2009-01-01

This article reports on a Delphi study conducted to determine key issues and challenges facing Functional Requirements for Bibliographic Records (FRBR) research and practice. The Delphi panel consisted of thirty-three experts in the field who participated in a three-round issue-raising and consensus-building process via a Web-based survey…

Advantages and Limitations of the e-Delphi Technique: Implications for Health Education Researchers

ERIC Educational Resources Information Center

Donohoe, Holly; Stellefson, Michael; Tennant, Bethany

2012-01-01

In the last 30 years, the application of the Delphi technique has been increasing. With the recent availability and established popularity of Internet-based research tools, the Internet has been identified as a means for mitigating Delphi limitations, maximizing its advantages, and expanding the breadth of its application. The discourse on the…

75 FR 41521 - Delphi Corporation, Automotive Holding Group, Plant 6, Currently Known as General Motors...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-16

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-62,069; TA-W-62,069A] Delphi Corporation, Automotive Holding Group, Plant 6, Currently Known as General Motors Corporation Including On-Site Leased Workers From Securitas, EDS, Bartech, Mays Chemicals, Interim Physicians, LLC and HSS Material Management, Flint, MI; Delphi...

Working towards consensus on methods used to elicit participant-reported safety data in uncomplicated malaria clinical drug studies: a Delphi technique study.

PubMed

Mandimika, Nyaradzo; Barnes, Karen I; Chandler, Clare I R; Pace, Cheryl; Allen, Elizabeth N

2017-01-28

Eliciting adverse event (AE) and non-study medication data reports from clinical research participants is integral to evaluating drug safety. However, using different methods to question participants yields inconsistent results, compromising the interpretation, comparison and pooling of data across studies. This is particularly important given the widespread use of anti-malarials in vulnerable populations, and their increasing use in healthy, but at-risk individuals, as preventive treatment or to reduce malaria transmission. Experienced and knowledgeable anti-malarial drug clinical researchers were invited to participate in a Delphi technique study, to facilitate consensus on what are considered optimal (relevant, important and feasible) methods, tools, and approaches for detecting participant-reported AE and non-study medication data in uncomplicated malaria treatment studies. Of 72 invited, 25, 16 and 10 panellists responded to the first, second and third rounds of the Delphi, respectively. Overall, 68% (68/100) of all questioning items presented for rating achieved consensus. When asking general questions about health, panellists agreed on the utility of a question/concept about any change in health, taking care to ensure that such questions/concepts do not imply causality. Eighty-nine percent (39/44) of specific signs and symptoms questions were rated as optimal. For non-study medications, a general question and most structured questioning items were considered an optimal approach. The use of mobile phones, patient diaries, rating scales as well as openly engaging with participants to discuss concerns were also considered optimal complementary data-elicitation tools. This study succeeded in reaching consensus within a section of the anti-malarial drug clinical research community about using a general question concept, and structured questions for eliciting data about AEs and non-study medication reports. The concepts and items considered in this Delphi to be relevant, important and feasible should be further investigated for potential inclusion in a harmonized approach to collect participant-elicited anti-malarial drug safety data. This, in turn, should improve understanding of anti-malarial drug safety.

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists.

PubMed

Hwang, Yoon-Sook; Kang, Hyun-Sook; Kim, Soo-Hwa; Moon, Hee-Jung; Lee, Sun-Mi; Jung, Jae-Yeon; Hwang, Su-Jeong; Ha, Jung-Eun

2017-01-01

This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects' responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience.

Nursing process decision support system for urology ward.

PubMed

Hao, Angelica Te-Hui; Wu, Lee-Pin; Kumar, Ajit; Jian, Wen-Shan; Huang, Li-Fang; Kao, Ching-Chiu; Hsu, Chien-Yeh

2013-07-01

We developed a nursing process decision support system (NPDSS) based on three clinical pathways, including benign prostatic hypertrophy, inguinal hernia, and urinary tract stone. NPDSS included six major nursing diagnoses - acute pain, impaired urinary elimination, impaired skin integrity, anxiety, infection risk, and risk of falling. This paper aims to describe the design, development and validation process of the NPDSS. We deployed the Delphi method to reach consensus for decision support rules of NPDSS. A team of nine-member expert nurses from a medical center in Taiwan was involved in Delphi method. The Cronbach's α method was used for examining the reliability of the questionnaire used in the Delphi method. The Visual Basic 6.0 as front-end and Microsoft Access 2003 as back-end was used to develop the system. A team of six nursing experts was asked to evaluate the usability of the developed systems. A 5-point Likert scale questionnaire was used for the evaluation. The sensitivity and specificity of NPDSS were validated using 150 nursing chart. The study showed a consistency between the diagnoses of the developed system (NPDSS) and the nursing charts. The sensitivities of the nursing diagnoses including acute pain, impaired urinary elimination, risk of infection, and risk of falling were 96.9%, 98.1%, 94.9%, and 89.9% respectively; and the specificities were 88%, 49.5%, 62%, and 88% respectively. We did not calculate the sensitivity and specificity of impaired skin integrity and anxiety due to non-availability of enough sample size. NPDSS can help nurses in decision making of nursing diagnoses. Besides, it can help them to generate nursing diagnoses based on patient-specific data, individualized care plans, and implementation within their usual nursing workflow. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration

PubMed Central

Chan, David; Lawrence, Ben; Pavlakis, Nick; Kennecke, Hagen F.; Jackson, Christopher; Law, Calvin; Singh, Simron

2017-01-01

Purpose Neuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan. Methods A three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan. Results The Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established. Conclusion This modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field. PMID:28831446

Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment.

PubMed

Hepworth, Lauren R; Rowe, Fiona J

2018-02-01

The aim of this study was to ascertain what items stroke survivors and stroke care professionals think are important when assessing quality of life for stroke survivors with visual impairment for inclusion in the new patient-reported outcome measure. A reactive Delphi process was used in a three-round electronic-based survey. The items presented consisted of 62 items originally sourced from a systematic review of existing vision-related quality of life instruments and stroke survivor interviews, reduced and refined following a ranking exercise and pilot with stroke survivors with visual impairment. Stakeholders (stroke survivors/clinicians) were invited to take part in the process. A consensus definition of ≥70% was decided a priori. Participants were asked to rank importance on a 9-point scale and categorize the items by relevance to types of visual impairment following stroke or not relevant. Analysis of consensus, stability, and agreement was conducted. In total, 113 participants registered for the Delphi survey of which 47 (41.6%) completed all three rounds. Response rates to the three rounds were 78/113 (69.0%), 61/76 (81.3%), and 49/64 (76.6%), respectively. The participants included orthoptists (45.4%), occupational therapists (44.3%), and stroke survivors (10.3%). Consensus was reached on 56.5% of items in the three-round process, all for inclusion. A consensus was reached for 83.8% in the categorization of items. The majority (82.6%) of consensus were for relevant to 'all visual impairment following stroke'; two items were deemed 'not relevant'. The lack of item reduction achieved by this Delphi process highlights the need for additional methods of item reduction in the development of a new PROM for visual impairment following stroke. These results will be considered alongside Rasch analysis to achieve further item reduction. However, the Delphi survey remains important as it provides clinical and patient insight into each item rather than purely relying on the psychometric data.

Defining and identifying concepts of medication literacy: An international perspective.

PubMed

Pouliot, Annie; Vaillancourt, Régis; Stacey, Danielle; Suter, Philippe

2017-11-08

Multiple concepts to define health literacy in the context of medication use exist, such as medication literacy, pharmacotherapy literacy, pharmacy health literacy; however, no studies have looked at consensus among experts internationally. A Delphi process was used to achieve consensus on the statements about medication literacy. Experts for the Delphi were selected from a review of the literature and suggestions from an international survey conducted with members of the International Pharmaceutical Federation on medication literacy. The preliminary Delphi questionnaire was built using the statements about medication literacy found in the scientific literature. Responses and comments were analyzed using a pre-established method and communicated to the experts after each round of Delphi. Statements with an agreement of at least 80% were accepted and used to develop a definition of medication literacy. The Delphi process started with 21 experts and included 4 rounds. Overall, 30 statements regarding medication literacy were accepted and divided into 4 clusters representing: (1) type of information necessary for optimal and safe use of medication, (2) skills and abilities, (3) format of information, and (4) outcomes. These statements were used to propose 2 different definitions of medication literacy. One of the definitions was preferred by 75% of the expert panel, which provided further comments for improvements. Of the 11 experts who answered the final questionnaire, nine strongly agreed with the refined definition. Medication literacy is the degree to which individuals can obtain, comprehend, communicate, calculate and process patient-specific information about their medications to make informed medication and health decisions in order to safely and effectively use their medications, regardless of the mode by which the content is delivered (e.g. written, oral and visual). Future studies should focus on how this definition can be operationalized to support the role that pharmacists and other healthcare providers. Copyright © 2017 Elsevier Inc. All rights reserved.

Towards an operational definition of pharmacy clinical competency

NASA Astrophysics Data System (ADS)

Douglas, Charles Allen

The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

The STAR Data Reporting Guidelines for Clinical High Altitude Research.

PubMed

Brodmann Maeder, Monika; Brugger, Hermann; Pun, Matiram; Strapazzon, Giacomo; Dal Cappello, Tomas; Maggiorini, Marco; Hackett, Peter; Bärtsch, Peter; Swenson, Erik R; Zafren, Ken

2018-03-01

Brodmann Maeder, Monika, Hermann Brugger, Matiram Pun, Giacomo Strapazzon, Tomas Dal Cappello, Marco Maggiorini, Peter Hackett, Peter Baärtsch, Erik R. Swenson, Ken Zafren (STAR Core Group), and the STAR Delphi Expert Group. The STARdata reporting guidelines for clinical high altitude research. High AltMedBiol. 19:7-14, 2018. The goal of the STAR (STrengthening Altitude Research) initiative was to produce a uniform set of key elements for research and reporting in clinical high-altitude (HA) medicine. The STAR initiative was inspired by research on treatment of cardiac arrest, in which the establishment of the Utstein Style, a uniform data reporting protocol, substantially contributed to improving data reporting and subsequently the quality of scientific evidence. The STAR core group used the Delphi method, in which a group of experts reaches a consensus over multiple rounds using a formal method. We selected experts in the field of clinical HA medicine based on their scientific credentials and identified an initial set of parameters for evaluation by the experts. Of 51 experts in HA research who were identified initially, 21 experts completed both rounds. The experts identified 42 key parameters in 5 categories (setting, individual factors, acute mountain sickness and HA cerebral edema, HA pulmonary edema, and treatment) that were considered essential for research and reporting in clinical HA research. An additional 47 supplemental parameters were identified that should be reported depending on the nature of the research. The STAR initiative, using the Delphi method, identified a set of key parameters essential for research and reporting in clinical HA medicine.

Achieving 90% Adoption of Clinical Practice Guidelines Using the Delphi Consensus Method in a Large Orthopedic Group.

PubMed

Bini, Stefano A; Mahajan, John

2016-11-01

Little is known about the implementation rate of clinical practice guidelines (CPGs). Our purpose was to report on the adoption rate of CPGs created and implemented by a large orthopedic group using the Delphi consensus method. The draft CPGs were created before the group's annual meeting by 5 teams each assigned a subset of topics. The draft guidelines included a statement and a summary of the available evidence. Each guideline was debated in both small-group and plenary sessions. Voting was anonymous and a 75% supermajority was required for passage. A Likert scale was used to survey the patient's experience with the process at 1 week, and the Kirkpatrick evaluation model was used to gauge the efficacy of the process over a 6-month time frame. Eighty-five orthopedic surgeons attended the meeting. Fifteen guidelines grouped into 5 topics were created. All passed. Eighty-six percent of attendees found the process effective and 84% felt that participating in the process made it more likely that they would adopt the guidelines. At 1 week, an average of 62% of attendees stated they were practicing the guideline as written (range: 35%-72%), and at 6 months, 96% stated they were practicing them (range: 82%-100%). We have demonstrated that a modified Delphi method for reaching consensus can be very effective in both creating CPGs and leading to their adoption. Further we have shown that the process is well received by participants and that an inclusionary approach can be highly successful. Copyright © 2016 Elsevier Inc. All rights reserved.

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach

PubMed Central

Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-01-01

Abstract Introduction There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and ‘change making’ should become an intrinsic part of everyone’s job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. Methods This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. Results A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: ‘Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.’ Conclusions The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science. PMID:28289467

Phase 2 of CATALISE: a multinational and multidisciplinary Delphi consensus study of problems with language development: Terminology.

PubMed

Bishop, Dorothy V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2017-10-01

Lack of agreement about criteria and terminology for children's language problems affects access to services as well as hindering research and practice. We report the second phase of a study using an online Delphi method to address these issues. In the first phase, we focused on criteria for language disorder. Here we consider terminology. The Delphi method is an iterative process in which an initial set of statements is rated by a panel of experts, who then have the opportunity to view anonymised ratings from other panel members. On this basis they can either revise their views or make a case for their position. The statements are then revised based on panel feedback, and again rated by and commented on by the panel. In this study, feedback from a second round was used to prepare a final set of statements in narrative form. The panel included 57 individuals representing a range of professions and nationalities. We achieved at least 78% agreement for 19 of 21 statements within two rounds of ratings. These were collapsed into 12 statements for the final consensus reported here. The term 'Language Disorder' is recommended to refer to a profile of difficulties that causes functional impairment in everyday life and is associated with poor prognosis. The term, 'Developmental Language Disorder' (DLD) was endorsed for use when the language disorder was not associated with a known biomedical aetiology. It was also agreed that (a) presence of risk factors (neurobiological or environmental) does not preclude a diagnosis of DLD, (b) DLD can co-occur with other neurodevelopmental disorders (e.g. ADHD) and (c) DLD does not require a mismatch between verbal and nonverbal ability. This Delphi exercise highlights reasons for disagreements about terminology for language disorders and proposes standard definitions and nomenclature. © 2017 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

Development of an Index of Engagement in HIV Care: An Adapted Internet-Based Delphi Process

PubMed Central

Koester, Kimberly A; Wood, Troy; Neilands, Torsten B; Pomeranz, Jamie L; Christopoulos, Katerina A

2017-01-01

Background Improving engagement in medical care among persons living with human immunodeficiency virus (HIV) is critical to optimizing clinical outcomes and reducing onward transmission of HIV. However, a clear conceptualization of what it means to be engaged in HIV care is lacking, and thus efforts to measure and enhance engagement in care are limited. Objective This paper describes the use of a modified online Delphi process of consensus building to solicit input from a range of HIV and non-HIV researchers and providers, and to integrate that input with focus group data conducted with HIV-infected patients. The overarching goal was to generate items for a patient-centered measure of engagement in HIV care for use in future research and clinical practice. Methods We recruited 66 expert panelists from around the United States. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. Results We recruited 66 expert panelists from around the United States and 64 (97%) were retained for four rounds of data collection. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. The process resulted in an expansion to 120 topics that were subsequently reduced to 13 candidate items for the planned assessment measure. Conclusions The process was an efficient method of soliciting input from geographically separated and busy experts across a range of disciplines and professional roles with the aim of arriving at a coherent definition of engagement in HIV care and a manageable set of survey items to assess it. Next steps are to validate the utility of the new measure in predicting retention in care, adherence to treatment, and clinical outcomes among patients living with HIV. PMID:29208589

Development of an Electronic Pediatric All-Cause Harm Measurement Tool Using a Modified Delphi Method.

PubMed

Stockwell, David Christopher; Bisarya, Hema; Classen, David C; Kirkendall, Eric S; Lachman, Peter I; Matlow, Anne G; Tham, Eric; Hyman, Dan; Lehman, Samuel M; Searles, Elizabeth; Muething, Stephen E; Sharek, Paul J

2016-12-01

To have impact on reducing harm in pediatric inpatients, an efficient and reliable process for harm detection is needed. This work describes the first step toward the development of a pediatric all-cause harm measurement tool by recognized experts in the field. An international group of leaders in pediatric patient safety and informatics were charged with developing a comprehensive pediatric inpatient all-cause harm measurement tool using a modified Delphi technique. The process was conducted in 5 distinct steps: (1) literature review of triggers (elements from a medical record that assist in identifying patient harm) for inclusion; (2) translation of triggers to likely associated harm, improving the ability for expert prioritization; (3) 2 applications of a modified Delphi selection approach with consensus criteria using severity and frequency of harm as well as detectability of the associated trigger as criteria to rate each trigger and associated harm; (4) developing specific trigger logic and relevant values when applicable; and (5) final vetting of the entire trigger list for pilot testing. Literature and expert panel review identified 108 triggers and associated harms suitable for consideration (steps 1 and 2). This list was pared to 64 triggers and their associated harms after the first of the 2 independent expert reviews. The second independent expert review led to further refinement of the trigger package, resulting in 46 items for inclusion (step 3). Adding in specific trigger logic expanded the list. Final review and voting resulted in a list of 51 triggers (steps 4 and 5). Application of a modified Delphi method on an expert-constructed list of 108 triggers, focusing on severity and frequency of harms as well as detectability of triggers in an electronic medical record, resulted in a final list of 51 pediatric triggers. Pilot testing this list of pediatric triggers to identify all-cause harm for pediatric inpatients is the next step to establish the appropriateness of each trigger for inclusion in a global pediatric safety measurement tool.

Reducing Energy Cost and Greenhouse Gas Emission in the Corporate Sector, a Delphi Study

ERIC Educational Resources Information Center

Kramer, Maxim L.

2013-01-01

The study is titled "Reducing energy cost and GreenHouse Gas emission in the corporate sector, A Delphi Study". The study applied the Delphi methodology and focused on the Green IT solutions that can help the modern corporate organizations with less than 1000 employees to decrease their energy costs and GHG emissions. The study presents…

Projecting Agricultural Education Programs for the 21st Century Using a Modified Delphi Technique.

ERIC Educational Resources Information Center

Iverson, Maynard J.

A modified three-step Delphi procedure was used to conduct a series of national studies of futurists regarded by their peers as top experts in agricultural education. The primary objective was to project enrollments in agricultural education programs for the 21st century. Other study objectives were to ascertain whether the Delphi technique could…

Concepts and Contexts in Engineering and Technology Education: An International and Interdisciplinary Delphi Study

ERIC Educational Resources Information Center

Rossouw, Ammeret; Hacker, Michael; de Vries, Marc J.

2011-01-01

Inspired by a similar study by Osborne et al. we have conducted a Delphi study among experts to identify key concepts to be taught in engineering and technology education and relevant and meaningful contexts through which these concepts can be taught and learnt. By submitting the outcomes of the Delphi study to a panel of experts in a two-day…

Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis Standard Reporting and Evaluation Guidelines: Results of a National Institutes of Health Working Group.

PubMed

Maverakis, Emanual; Wang, Elizabeth A; Shinkai, Kanade; Mahasirimongkol, Surakameth; Margolis, David J; Avigan, Mark; Chung, Wen-Hung; Goldman, Jennifer; La Grenade, Lois; Pirmohamed, Munir; Shear, Neil H; Tassaeeyakul, Wichittra; Hoetzenecker, Wolfram; Klaewsongkram, Jettanong; Rerkpattanapipat, Ticha; Manuyakorn, Wiparat; Yasuda, Sally Usdin; Sharon, Victoria R; Sukhov, Andrea; Micheletti, Robert; Struewing, Jeff; French, Lars E; Cheng, Michelle Y

2017-06-01

Toxic epidermal necrolysis (TEN) and Stevens-Johnson Syndrome (SJS) are rare, acute, life-threatening dermatologic disorders involving the skin and mucous membranes. Research into these conditions is hampered by a lack of standardization of case reporting and data collection. To establish a standardized case report form to facilitate comparisons and maintain data quality based on an international panel of SJS/TEN experts who performed a Delphi consensus-building exercise. The elements presented for committee scrutiny were adapted from previous case report forms and from PubMed literature searches of highly cited manuscripts pertaining to SJS/TEN. The expert opinions and experience of the members of the consensus group were included in the discussion. Overall, 21 out of 29 experts who were invited to participate in the online Delphi exercise agreed to participate. Surveys at each stage were administered via an online survery software tool. For the first 2 Delphi rounds, results were analyzed using the Interpercentile Range Adjusted for Symmetry method and statements that passed consensus formulated a new case report form. For the third Delphi round, the case report form was presented to the committee, who agreed that it was "appropriate and useful" for documenting cases of SJS/TEN, making it more reliable and valuable for future research endeavors. With the consensus of international experts, a case report form for SJS/TEN has been created to help standardize the collection of patient information in future studies and the documentation of individual cases.

Defining Advance Care Planning for Adults: A Consensus Definition from a Multidisciplinary Delphi Panel

PubMed Central

Sudore, Rebecca L.; Lum, Hillary D.; You, John J.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Matlock, Daniel D.; Rietjens, Judith A. C.; Korfage, Ida J.; Ritchie, Christine S.; Kutner, Jean S.; Teno, Joan M.; Thomas, Judy; McMahan, Ryan D.; Heyland, Daren K.

2017-01-01

Background Despite increasing interest in advance care planning (ACP) and prior ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. Objective To develop a consensus definition of ACP for adults. Design Delphi Panel Setting/Participants Participants included a multidisciplinary panel of international ACP experts consisting of 52 clinicians, researchers, and policy leaders from 4 countries, and a patient/surrogate advisory committee. Measurements We conducted 10 rounds of a modified Delphi method and qualitatively analyzed panelists’ input. Panelists identified several themes lacking consensus, and iteratively discussed and developed a final consensus definition. Results Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients’ values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: “Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness.” The panel also described strategies to best support adults in ACP. Conclusions A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. PMID:28062339

Developing standards for the development of glaucoma virtual clinics using a modified Delphi approach.

PubMed

Kotecha, Aachal; Longstaff, Simon; Azuara-Blanco, Augusto; Kirwan, James F; Morgan, James Edwards; Spencer, Anne Fiona; Foster, Paul J

2018-04-01

To obtain consensus opinion for the development of a standards framework for the development and implementation of virtual clinics for glaucoma monitoring in the UK using a modified Delphi methodology. A modified Delphi technique was used that involved sampling members of the UK Glaucoma and Eire Society (UKEGS). The first round scored the strength of agreement to a series of standards statements using a 9-point Likert scale. The revised standards were subjected to a second round of scoring and free-text comment. The final standards were discussed and agreed by an expert panel consisting of seven glaucoma subspecialists from across the UK. A version of the standards was submitted to external stakeholders for a 3-month consultation. There was a 44% response rate of UKEGS members to rounds 1 and 2, consisting largely of consultant ophthalmologists with a specialist interest in glaucoma. The final version of the standards document was validated by stakeholder consultation and contains four sections pertaining to the patient groups, testing methods, staffing requirements and governance structure of NHS secondary care glaucoma virtual clinic models. Use of a modified Delphi approach has provided consensus agreement for the standards required for the development of virtual clinics to monitor glaucoma in the UK. It is anticipated that this document will be useful as a guide for those implementing this model of service delivery. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Defining Advance Care Planning for Adults: A Consensus Definition From a Multidisciplinary Delphi Panel.

PubMed

Sudore, Rebecca L; Lum, Hillary D; You, John J; Hanson, Laura C; Meier, Diane E; Pantilat, Steven Z; Matlock, Daniel D; Rietjens, Judith A C; Korfage, Ida J; Ritchie, Christine S; Kutner, Jean S; Teno, Joan M; Thomas, Judy; McMahan, Ryan D; Heyland, Daren K

2017-05-01

Despite increasing interest in advance care planning (ACP) and previous ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. The aim of this study was to develop a consensus definition of ACP for adults. We convened a Delphi panel of multidisciplinary, international ACP experts consisting of 52 clinicians, researchers, and policy leaders from four countries and a patient/surrogate advisory committee. We conducted 10 rounds using a modified Delphi method and qualitatively analyzed panelists' input. Panelists identified several themes lacking consensus and iteratively discussed and developed a final consensus definition. Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients' values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: "Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness." The panel also described strategies to best support adults in ACP. A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. Published by Elsevier Inc.

[Prioritization and Consentation of Criteria for the Appraisal, Funding and Evaluation of Projects from the German Innovationsfonds: A multi-perspective Delphi study].

PubMed

Schmitt, J; Petzold, T; Nellessen-Martens, G; Pfaff, H

2015-09-01

The German Innovationsfonds provides the chance for evidence-based developments of the German healthcare system. Prioritization of recommendations for an effective, efficient, fair, transparent, and sustainable granting of funds through a transparent, evidence-driven consensus-process involving all relevant stakeholder groups. Representatives from health and research policy, payers, patient representatives, healthcare providers, and scientists were invited to nominate participants for an electronic 3 round iterative Delphi-study to prioritize the thematic focus, requirements concerning study methods, the team of applicants, evaluation, utilization of study results, and for the selection of reviewers. Criteria considered as relevant by at least 60% of the panel (consensus definition) in the first 2 Delphi rounds were rated as facultative, preferable, or obligatory criteria for project funding. Data were analyzed descriptively. ( Datenbank Versorgungsforschung Deutschland VfD_15_003561). All invited stakeholder groups except payers participated. 34 (85%) of 40 nominated representatives participated in the Delphi-study. A total of 64 criteria were consented as relevant for project review and funding concerning the thematic focus (n=28), methodological requirements (n=13), requirements for applicants (n=4), for the evaluation (n=4), utilization (n=6), and selection of peer reviewers (n=9). It is the collective responsibility of all stakeholders to spend the designated funds as efficient and sustainable as possible. The consented recommendations shall serve decision makers as a resource for the granting of funds and the evaluation of the Innovationsfonds. © Georg Thieme Verlag KG Stuttgart · New York.

Core neurological examination items for neurology clerks: A modified Delphi study with a grass-roots approach

PubMed Central

Liu, Chi-Hung; Hsu, Li-Ling; Hsiao, Cheng-Ting; Hsieh, Suh-Ing; Chang, Chun-Wei; Huang, Elaine Shinwei; Chang, Yeu-Jhy

2018-01-01

Background With the evolution of treatments for neurological diseases, the contents of core neurological examinations (NEs) for medical students may need to be modified. We aimed to establish a consensus on the core NE items for neurology clerks and compare viewpoints between different groups of panelists. Methods First, a pilot group proposed the core contents of NEs for neurology clerks. The proposed core NE items were then subject to a modified web-based Delphi process using the online software “SurveyMonkey”. A total of 30 panelists from different backgrounds (tutors or learners, neurologists or non-neurologists, community hospitals or medical centers, and different academic positions) participated in the modified Delphi process. Each panelist was asked to agree or disagree on the inclusion of each item using a 9-point Likert scale and was encouraged to provide feedback. We also compared viewpoints between different groups of panelists using the Mann-Whitney U test. Results Eighty-three items were used for the first round of the Delphi process. Of them, 18 without consensus of being a core NE item for the neurology clerks in the first round and another 14 items suggested by the panelists were further discussed in the second round. Finally, 75 items with different grades were included in the recommended NE items for neurology clerks. Conclusions Our findings provide a reference regarding the core NE items for milestone development for neurology clerkships. We hope that prioritizing the NE items in this order can help medical students to learn NE more efficiently. PMID:29771997

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Using a Delphi Method to Identify Human Factors Contributing to Nursing Errors.

PubMed

Roth, Cheryl; Brewer, Melanie; Wieck, K Lynn

2017-07-01

The purpose of this study was to identify human factors associated with nursing errors. Using a Delphi technique, this study used feedback from a panel of nurse experts (n = 25) on an initial qualitative survey questionnaire followed by summarizing the results with feedback and confirmation. Synthesized factors regarding causes of errors were incorporated into a quantitative Likert-type scale, and the original expert panel participants were queried a second time to validate responses. The list identified 24 items as most common causes of nursing errors, including swamping and errors made by others that nurses are expected to recognize and fix. The responses provided a consensus top 10 errors list based on means with heavy workload and fatigue at the top of the list. The use of the Delphi survey established consensus and developed a platform upon which future study of nursing errors can evolve as a link to future solutions. This list of human factors in nursing errors should serve to stimulate dialogue among nurses about how to prevent errors and improve outcomes. Human and system failures have been the subject of an abundance of research, yet nursing errors continue to occur. © 2016 Wiley Periodicals, Inc.

A True Delphi Approach: Developing a Tailored Curriculum in Response to Local Agriscience Need

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rubenstein, Eric; Thoron, Andrew; Burleson, Sarah

2012-02-07

The Delphi approach is a structured communication technique, developed as a systematic, interactive forecasting method which relies on a panel of experts. In this specific case experts from Industry, Education and Extension fields addressed needs for educational programs in a traditional agriculturally-based community, environmentally conscious practices in order to restore environmental integrity and multi-disciplinary approach to solve sustainability problems facing the agricultural industry. The experts were divided into two main groups, (A) Secondary and (B) Post-secondary, and answered questionnaires in three rounds: • 1st Round – Participants generated a list of knowledge, skills, and competencies followed • 2nd Round –more » Panelists rated each item • 3rd Round – Panelists were given the opportunity to combine and add additional items As a result, top six items from both groups were not found similar, secondary panelists centralized around employment skills and post-secondary panelists focused on content areas. Implications include a need for content-based curriculum for post-secondary graduates, utilization of true-Delphi technique for future curriculum development research and further examination of students that complete secondary and post-secondary programs in biofuels/sustainable agriculture.« less

Neutron noise measurements at the Delphi subcritical assembly

DOE Office of Scientific and Technical Information (OSTI.GOV)

Szieberth, M.; Klujber, G.; Kloosterman, J. L.

2012-07-01

The paper presents the results and evaluations of a comprehensive set of neutron noise measurements on the Delphi subcritical assembly of the Delft Univ. of Technology. The measurements investigated the effect of different source distributions (inherent spontaneous fission and {sup 252}Cf) and the position of the detectors applied (both radially and vertically). The evaluation of the measured data has been performed by the variance-to-mean ratio (VTMR, Feynman-{alpha}), the autocorrelation (ACF, Rossi-{alpha}) and the cross-correlation (CCF) methods. The values obtained for the prompt decay constant show a strong bias, which depends both on the detector position and on the source distribution.more » This is due to the presence of higher modes in the system. It has been observed that the {alpha} value fitted is higher when the detector is close to the boundary of the core or to the {sup 252}Cf point-source. The higher alpha-modes have also been observed by fitting functions describing two alpha-modes. The successful set of measurement also provides a good basis for further theoretical investigations including the Monte Carlo simulation of the noise measurements and the calculation of the alpha-modes in the Delphi subcritical assembly. (authors)« less

Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure

PubMed Central

2013-01-01

Background The quantity and quality of studies in child and adolescent physical activity and sedentary behaviour have rapidly increased, but research directions are often pursued in a reactive and uncoordinated manner. Aim To arrive at an international consensus on research priorities in the area of child and adolescent physical activity and sedentary behaviour. Methods Two independent panels, each consisting of 12 experts, undertook three rounds of a Delphi methodology. The Delphi methodology required experts to anonymously answer questions put forward by the researchers with feedback provided between each round. Results The primary outcome of the study was a ranked set of 29 research priorities that aimed to be applicable for the next 10 years. The top three ranked priorities were: developing effective and sustainable interventions to increase children’s physical activity long-term; policy and/or environmental change and their influence on children’s physical activity and sedentary behaviour; and prospective, longitudinal studies of the independent effects of physical activity and sedentary behaviour on health. Conclusions These research priorities can help to guide decisions on future research directions. PMID:24228891

The Delphi Method: An Approach for Facilitating Evidence Based Practice in Athletic Training

ERIC Educational Resources Information Center

Sandrey, Michelle A.; Bulger, Sean M.

2008-01-01

Objective: The growing importance of evidence based practice in athletic training is necessitating academics and clinicians to be able to make judgments about the quality or lack of the body of research evidence and peer-reviewed standards pertaining to clinical questions. To assist in the judgment process, consensus methods, namely brainstorming,…

Professional Task-Based Curriculum Development for Distance Education Practitioners at Master's Level: A Design-Based Research

ERIC Educational Resources Information Center

Feng, Xiaoying; Lu, Guangxin; Yao, Zhihong

2015-01-01

Curriculum development for distance education (DE) practitioners is more and more focusing on practical requirements and competence development. Delphi and DACUM methods have been used at some universities. However, in the competency-based development area, these methods have been taken over by professional-task-based development in the last…

Report of Activities and Accomplishments: March 1, 1968 to February 28, 1969. Final Report.

ERIC Educational Resources Information Center

Green, Thomas F.; And Others

From 1968 to 1969 the EPRC focused on: staff development, definition of a specific research program, and development of methods to deal with educational policy issues in the context of longrange futures. The research program of the center is organized around educational futures and policy planning. Specific methods include Delphi techniques, goal…

Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement

ERIC Educational Resources Information Center

Hatcher, Tim; Colton, Sharon

2007-01-01

Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an…

Delphi`s DETOXSM process: Preparing to treat high organic content hazardous and mixed wastes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robertson, D.T.; Rogers, T.W.; Goldblatt, S.D.

1998-12-31

The US Department of Energy (DOE) Federal Energy Technology Center is sponsoring a full-scale technology demonstration of Delphi Research, Inc.`s patented DETOX{sup SM} catalytic wet chemical oxidation waste treatment process at the Savannah River Site (SRS) in South Carolina. The process is being developed primarily to treat hazardous and mixed wastes within the DOE complex as an alternative to incineration, but it has significant potential to treat wastes in the commercial sector. The results of the demonstration will be intensively studied and used to validate the technology. A critical objective in preparing for the demonstration was the successful completion ofmore » a programmatic Operational Readiness Review. Readiness Reviews are required by DOE for all new process startups. The Readiness Review provided the vehicle to ensure that Delphi was ready to start up and operate the DETOX{sup SM} process in the safest manner possible by implementing industry accepted management practices for safe operation. This paper provides an overview of the DETOX{sup SM} demonstration at SRS, and describes the crucial areas of the Readiness Review that marked the first steps in Delphi`s transition from a technology developer to an operating waste treatment services provider.« less

Developing clinical practice guidelines for Chinese herbal treatment of polycystic ovary syndrome: A mixed-methods modified Delphi study.

PubMed

Lai, Lily; Flower, Andrew; Moore, Michael; Lewith, George

2015-06-01

Preliminary evidence suggests Chinese herbal medicine (CHM) could be a viable treatment option for polycystic ovary syndrome (PCOS). Prior to conducting a clinical trial it is important to consider the characteristics of good clinical practice. This study aims to use professional consensus to establish good clinical practice guidelines for the CHM treatment of PCOS. CHM practitioners participated in a mixed-methods modified Delphi study involving three rounds of structured group communication. Round 1 involved qualitative interviews with practitioners to generate statements regarding good clinical practice. In round 2, these statements were distributed online to the same practitioners to rate their agreement using a 7-point Likert scale, where group consensus was defined as a median rating of ≥5. Statements reaching consensus were accepted for consideration onto the guideline whilst those not reaching consensus were re-distributed for consideration in round 3. Statements presented in the guidelines were graded from A (strong consensus) to D (no consensus) determined by median score and interquartile range. 11 CHM practitioners in the UK were recruited. After three Delphi rounds, 91 statement items in total had been considered, of which 89 (97.8%) reached consensus and 2 (2.2%) did not. The concluding set of guidelines consists of 85 items representing key features of CHM prescribing for PCOS. These guidelines can be viewed as an initial framework that captures fundamental principles of good clinical practice for CHM. Copyright © 2015 Elsevier Ltd. All rights reserved.

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach.

PubMed

Skela-Savič, Brigita; Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-06-01

There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and 'change making' should become an intrinsic part of everyone's job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: 'Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.' The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science.

Constructing the Indicators of Assessing Human Vulnerability to Industrial Chemical Accidents: A Consensus-based Fuzzy Delphi and Fuzzy AHP Approach

PubMed Central

Fatemi, Farin; Ardalan, Ali; Aguirre, Benigno; Mansouri, Nabiollah; Mohammadfam, Iraj

2017-01-01

Introduction: Industrial chemical accidents have been increased in developing countries. Assessing the human vulnerability in the residents of industrial areas is necessary for reducing the injuries and causalities of chemical hazards. The aim of this study was to explore the key indicators for the assessment of human vulnerability in the residents living near chemical installations. Methods: The indicators were established in the present study based on the Fuzzy Delphi method (FDM) and Fuzzy Analytic Hierarchy Process (FAHP). The reliability of FDM and FAHP was calculated. The indicators of human vulnerability were explored in two sets of social and physical domains. Thirty-five relevant experts participated in this study during March-July 2015. Results: According to experts, the top three indicators of human vulnerability according to the FDM and FAHP were vulnerable groups, population density, and awareness. Detailed sub-vulnerable groups and awareness were developed based on age, chronic or severe diseases, disability, first responders, and residents, respectively. Each indicator and sub-indicator was weighted and ranked and had an acceptable consistency ratio. Conclusions: The importance of social vulnerability indicators are about 7 times more than physical vulnerability indicators. Among the extracted indicators, vulnerable groups had the highest weight and the greatest impact on human vulnerability. however, further research is needed to investigate the applicability of established indicators and generalizability of the results to other studies. Key words: Fuzzy Delphi; Fuzzy AHP; Human vulnerability; Chemical hazards PMID:28480124

A Delphi study to determine the European core curriculum for Master programmes in genetic counselling.

PubMed

Skirton, Heather; Barnoy, Sivia; Ingvoldstad, Charlotta; van Kessel, Ingrid; Patch, Christine; O'Connor, Anita; Serra-Juhe, Clara; Stayner, Barbara; Voelckel, Marie-Antoinette

2013-10-01

Genetic counsellors have been working in some European countries for at least 30 years. Although there are great disparities between the numbers, education, practice and acceptance of these professionals across Europe, it is evident that genetic counsellors and genetic nurses in Europe are working autonomously within teams to deliver patient care. The aim of this study was to use the Delphi research method to develop a core curriculum to guide the educational preparation of these professionals in Europe. The Delphi method enables the researcher to utilise the views and opinions of a group of recognised experts in the field of study; this study consisted of four phases. Phases 1 and 4 consisted of expert workshops, whereas data were collected in phases 2 and 3 (n=35) via online surveys. All participants in the study were considered experts in the field of genetic counselling. The topics considered essential for genetic counsellor training have been organised under the following headings: (1) counselling; (2) psychological issues; (3) medical genetics; (4) human genetics; (5) ethics, law and sociology; (6) professional practice; and (7) education and research. Each topic includes the knowledge, skills and attitudes required to enable genetic counsellors to develop competence. In addition, it was considered by the experts that clinical practice should comprise 50% of the educational programme. The core Master programme curriculum will enable current courses to be assessed and inform the design of future educational programmes for European genetic counsellors.

Seeking an oracle: using the Delphi process to develop practice guidelines for the treatment of endometriosis with Chinese herbal medicine.

PubMed

Flower, Andrew; Lewith, George T; Little, Paul

2007-11-01

For most complementary and alternative medicine interventions, the absence of a high-quality evidence base to define good practice presents a serious problem for clinicians, educators, and researchers. The Delphi process may offer a pragmatic way to establish good practice guidelines until more rigorous forms of assessment can be undertaken. To use a modified Delphi to develop good practice guidelines for a feasibility study exploring the role of Chinese herbal medicine (CHM) in the treatment of endometriosis. To compare the outcomes from Delphi with data derived from a systematic review of the Chinese language database. An expert group was convened for a three-round Delphi that initially produced key statements relating to the CHM diagnosis and treatment of endometriosis (round 1) and then anonymously rated these on a 1-7 Likert scale (rounds 2 and 3). Statements with a median score of 5 and above were regarded as demonstrating positive group consensus. The differential diagnoses within Chinese Medicine and rating of the clinical value of individual herbs were then contrasted with comparable data from a review of Chinese language reports in the Chinese Biomedical Retrieval System (1978-2002), and China Academy of Traditional Chinese Medicine (1985-2002) databases and the Chinese TCM and magazine literature (1984-2004) databases. Consensus (good practice) guidelines for the CHM treatment of endometriosis relating to common diagnostic patterns, herb selection, dosage, and patient management were produced. The Delphi guidelines demonstrated a high degree of congruence with the information from the Chinese language databases. In the absence of rigorous evidence, Delphi offers a way to synthesize expert knowledge relating to diagnosis, patient management, and herbal selection in the treatment of endometriosis. The limitations of the expert group and the inability of Delphi to capture the subtle nuances of individualized clinical decision-making limit the usefulness of this approach.

Applying Quality Function Deployment Model in Burn Unit Service Improvement.

PubMed

Keshtkaran, Ali; Hashemi, Neda; Kharazmi, Erfan; Abbasi, Mehdi

2016-01-01

Quality function deployment (QFD) is one of the most effective quality design tools. This study applies QFD technique to improve the quality of the burn unit services in Ghotbedin Hospital in Shiraz, Iran. First, the patients' expectations of burn unit services and their priorities were determined through Delphi method. Thereafter, burn unit service specifications were determined through Delphi method. Further, the relationships between the patients' expectations and service specifications and also the relationships between service specifications were determined through an expert group's opinion. Last, the final importance scores of service specifications were calculated through simple additive weighting method. The findings show that burn unit patients have 40 expectations in six different areas. These expectations are in 16 priority levels. Burn units also have 45 service specifications in six different areas. There are four-level relationships between the patients' expectations and service specifications and four-level relationships between service specifications. The most important burn unit service specifications have been identified in this study. The QFD model developed in the study can be a general guideline for QFD planners and executives.

Experiences and wisdom behind the numbers: qualitative analysis of the National Action Alliance for Suicide Prevention's Research Prioritization Task Force stakeholder survey.

PubMed

Booth, Chelsea L

2014-09-01

The Research Prioritization Task Force of the National Action Alliance for Suicide Prevention conducted a stakeholder survey including 716 respondents from 49 U.S. states and 18 foreign countries. To conduct a qualitative analysis on responses from individuals representing four main stakeholder groups: attempt and loss survivors, researchers, providers, and policy/administrators. This article focuses on a qualitative analysis of the early-round, open-ended responses collected in a modified online Delphi process, and, as an illustration of the research method, focuses on analysis of respondents' views of the role of life and emotional skills in suicide prevention. Content analysis was performed using both inductive and deductive code and category development and systematic qualitative methods. After the inductive coding was completed, the same data set was re-coded using the 12 Aspirational Goals (AGs) identified by the Delphi process. Codes and thematic categories produced from the inductive coding process were, in some cases, very similar or identical to the 12 AGs (i.e., those dealing with risk and protective factors, provider training, preventing reattempts, and stigma). Other codes highlighted areas that were not identified as important in the Delphi process (e.g., cultural/social factors of suicide, substance use). Qualitative and mixed-methods research are essential to the future of suicide prevention work. By design, qualitative research is explorative and appropriate for complex, culturally embedded social issues such as suicide. Such research can be used to generate hypotheses for testing and, as in this analysis, illuminate areas that would be missed in an approach that imposed predetermined categories on data. Published by Elsevier Inc.

A Time-Out Checklist for Pediatric Regional Anesthetics

NASA Technical Reports Server (NTRS)

Clebone, Anna; Burian, Barbara K.; Polaner, David M.

2017-01-01

Although pediatric regional anesthesia has a demonstrated record of safety, adverse events, especially those related to block performance issues, still may occur. To reduce the frequency of those events, we developed a Regional Anesthesia Time-Out Checklist using expert opinion and the Delphi method.

Testing an Adapted Modified Delphi Method: Synthesizing Multiple Stakeholder Ratings of Health Care Service Effectiveness.

PubMed

Escaron, Anne L; Chang Weir, Rosy; Stanton, Petra; Vangala, Sitaram; Grogan, Tristan R; Clarke, Robin M

2016-03-01

The Affordable Care Act incentivizes health systems for better meeting patient needs, but often guidance about patient preferences for particular health services is limited. All too often vulnerable patient populations are excluded from these decision-making settings. A community-based participatory approach harnesses the in-depth knowledge of those experiencing barriers to health care. We made three modifications to the RAND-UCLA appropriateness method, a modified Delphi approach, involving patients, adding an advisory council group to characterize existing knowledge in this little studied area, and using effectiveness rather than "appropriateness" as the basis for rating. As a proof of concept, we tested this method by examining the broadly delivered but understudied nonmedical services that community health centers provide. This method created discrete, new knowledge about these services by defining 6 categories and 112 unique services and by prioritizing among these services based on effectiveness using a 9-point scale. Consistent with the appropriateness method, we found statistical convergence of ratings among the panelists. Challenges include time commitment and adherence to a clear definition of effectiveness of services. This diverse stakeholder engagement method efficiently addresses gaps in knowledge about the effectiveness of health care services to inform population health management. © 2015 Society for Public Health Education.

A Delphi Method Study on Triggering Transactional Distance to Improve Students' Learning: The Instructor's Rubric

ERIC Educational Resources Information Center

Maston, Heidi L.

2011-01-01

The 21st century ushered in change with the increased use of technology in educational delivery methods and opened doors for a new generation of students. While the debate over pedagogy, content design and overall effectiveness of this delivery format continues, scholars have not attended to the lessons of earlier theorists. This study examined a…

A Comparative Study of the Perceptions of Professional Staff on Their Contribution to Student Outcomes

ERIC Educational Resources Information Center

Regan, Julie-Anne; Dollard, Emma; Banks, Nicci

2014-01-01

This study examined the perceptions of professional staff on their contribution to student outcomes. An online Delphi survey method was used to collect data from two expert panels: professional staff based in faculties and professional staff based in central university departments. The aim of this method is for the panels to reach consensus. The…

Determining the Essential Components of State and Institution Dual Credit Program Policy in New Mexico: A Delphi Study with High School and College Experts

ERIC Educational Resources Information Center

Carlson, Gregory Dean

2013-01-01

The purpose of this Delphi study was to determine the essential components of dual credit in New Mexico. Dual credit experts from colleges and high schools in New Mexico were asked to participate in a three-round Delphi study to determine what the future policy of dual credit should be, and why it should be that way. Definitions of dual credit may…

Final Report of the AMC Committee-Armament. Armament Development Center Concept Plan. Volume 2

DTIC Science & Technology

1974-12-01

Considerations 111-22 Section C Operational Considerations 111-26 Section D Community Economic Impact 111-35 Statements Section E Delphi Benefit Analysis 111-37...Cost Analysis 111-3 B Personnel Considerations III-22 C Operational Considerations 111-26 D Community Economic Impact Statements 111-35 E Delphi ...sidered to be minimal. 111-36 S SECTION E. Delphi Benefit Analysis 1. Introduction. The assessment and comparison of the relative benefits of the various

Delphi based consensus study into planning for chemical incidents.

PubMed

Crawford, I W F; Mackway-Jones, K; Russell, D R; Carley, S D

2004-01-01

To achieve consensus in all phases of chemical incident planning and response. A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required.

Taxonomy of the common dolphins of the Eastern Pacific Ocean

USGS Publications Warehouse

Banks, R.C.; Brownell, R.

1969-01-01

Delphinus bairdii Dall is a species of dolphin distinct from D. delphis Linnaeus, with which it has usually been synonymized. D. bairdii has a longer rostrum relative to the zygomatic width of the skull; the ratio of these measurements falls at 1.55 or above for bairdii and 1.53 and below for delphis. In the eastern Pacific Ocean, D. bairdii is found in the Gulf of California and along the west coast of Baja California, Mexico; D. delphis is presently found in the waters off California. Until approximately the beginning of the present century, bairdii occurred farther north in the eastern Pacific Ocean, at least to the Monterey Bay area of California. Restriction of bairdii to more southerly waters, probably as an indirect result of a change in water temperature, may have permitted delphis to move into inshore Californian waters. The Pacific population of D. delphis has a somewhat shorter rostrum than the Atlantic population, and is perhaps subspecifically different. A thorough analysis of the entire genus Delphinus is needed before the relationship of all the populations can be understood and names properly applied.

Delphi based consensus study into planning for chemical incidents

PubMed Central

Crawford, I; Mackway-Jones, K; Russell, D; Carley, S

2004-01-01

Objective: To achieve consensus in all phases of chemical incident planning and response. Design: A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. Results: A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. Conclusions: The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required. PMID:14734369

Developing a guideline for clinical trial protocol content: Delphi consensus survey

PubMed Central

2012-01-01

Background Recent evidence has highlighted deficiencies in clinical trial protocols, having implications for many groups. Existing guidelines for randomized clinical trial (RCT) protocol content vary substantially and most do not describe systematic methodology for their development. As one of three prespecified steps for the systematic development of a guideline for trial protocol content, the objective of this study was to conduct a three-round Delphi consensus survey to develop and refine minimum content for RCT protocols. Methods Panellists were identified using a multistep iterative approach, met prespecified minimum criteria and represented key stakeholders who develop or use clinical trial protocols. They were asked to rate concepts for importance in a minimum set of items for RCT protocols. The main outcome measures were degree of importance (scale of 1 to 10; higher scores indicating higher importance) and level of consensus for items. Results were presented as medians, interquartile ranges, counts and percentages. Results Ninety-six expert panellists participated in the Delphi consensus survey including trial investigators, methodologists, research ethics board members, funders, industry, regulators and journal editors. Response rates were between 88 and 93% per round. Overall, panellists rated 63 of 88 concepts of high importance (of which 50 had a 25th percentile rating of 8 or greater), 13 of moderate importance (median 6 or 7) and 12 of low importance (median less than or equal to 5) for minimum trial protocol content. General and item-specific comments and subgroup results provided valuable insight for further discussions. Conclusions This Delphi process achieved consensus from a large panel of experts from diverse stakeholder groups on essential content for RCT protocols. It also highlights areas of divergence. These results, complemented by other empirical research and consensus meetings, are helping guide the development of a guideline for protocol content. PMID:23006145

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study

PubMed Central

2017-01-01

Background Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. Objective The aim of this study was to develop and prioritize measures of digital patient engagement based on patients’ use of the US Department of Veterans Affairs (VA)’s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. Methods We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. Results All 12 experts completed the study’s three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian’s three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). Conclusions This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients’ use of VA’s My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. PMID:28550008

Expert consensus for performing right heart catheterisation for suspected pulmonary arterial hypertension in systemic sclerosis: a Delphi consensus study with cluster analysis.

PubMed

Avouac, Jérôme; Huscher, Dörte; Furst, Daniel E; Opitz, Christian F; Distler, Oliver; Allanore, Yannick

2014-01-01

To establish an expert consensus on which criteria are the most appropriate in clinical practice to refer patients with systemic sclerosis (SSc) for right heart catheterisation (RHC) when pulmonary hypertension (PH) is suspected. A three stage internet based Delphi consensus exercise involving worldwide PH experts was designed. In the first stage, a comprehensive list of domains and items combining evidence based indications and expert opinions were obtained. In the second and third stages, experts were asked to rate each item selected in the list. After each of stages 2 and 3, the number of items and criteria were reduced according to a cluster analysis. A literature search and the opinions of 47 experts participating in Delphi stage 1 provided a list of seven domains containing 142 criteria. After stages 2 and 3, these domains and tools were reduced to three domains containing eight tools: clinical (progressive dyspnoea over the past 3 months, unexplained dyspnoea, worsening of WHO dyspnoea functional class, any finding on physical examination suggestive of elevated right heart pressures and any sign of right heart failure), echocardiography (systolic pulmonary artery pressure >45 mm Hg and right ventricle dilation) and pulmonary function tests (diffusion lung capacity for carbon monoxide <50% without pulmonary fibrosis). Among experts in pulmonary arterial hypertension-SSc, a core set of criteria for clinical practice to refer SSc patients for RHC has been defined by Delphi consensus methods. Although these indications are recommended by this expert group to be used as an interim tool, it will be necessary to formally validate the present tools in further studies.

Terminology and definitions on groin pain in athletes: building agreement using a short Delphi method.

PubMed

Weir, Adam; Hölmich, Per; Schache, Anthony G; Delahunt, Eamonn; de Vos, Robert-Jan

2015-06-01

Groin pain in athletes occurs frequently and can be difficult to treat, which may partly be due to the lack of agreement on diagnostic terminology. To perform a short Delphi survey on terminology agreement for groin pain in athletes by a group of experts. A selected number of experts were invited to participate in a Delphi questionnaire. The study coordinator sent a questionnaire, which consisted of demographic questions and two 'real-life' case reports of athletes with groin pain. The experts were asked to complete the questionnaire and to provide the most likely diagnosis for each case. Questionnaire responses were analysed by an independent researcher. The Cohen's κ statistic was used to evaluate the level of agreement between the diagnostic terms provided by the experts. Twenty-three experts participated (96% of those invited). For case 1, experts provided 9 different terms to describe the most likely diagnosis; for case 2, 11 different terms were provided to describe the most likely diagnosis. With respect to the terms provided for the most likely diagnosis, the Cohen's κ was 0.06 and 0.002 for case 1 and 2, respectively. This heterogeneous taxonomy reflects only a slight agreement between the various diagnostic terms provided by the selected experts. This short Delphi survey of two 'typical, straightforward' cases demonstrated major inconsistencies in the diagnostic terminology used by experts for groin pain in athletes. These results underscore the need for consensus on definitions and terminology on groin pain in athletes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Outcomes that Define Successful Advance Care Planning: A Delphi Panel Consensus

PubMed Central

Sudore, Rebecca L.; Heyland, Daren K.; Lum, Hillary D.; Rietjens, Judith A.C.; Korfage, Ida J.; Ritchie, Christine S.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Lorenz, Karl; Howard, Michelle; Green, Michael J.; Simon, Jessica E.; Feuz, Mariko A.; You, John J.

2017-01-01

Context Standardized outcomes that define successful advance care planning (ACP) are lacking. Objective To create an Organizing Framework of ACP outcome constructs and rate the importance of these outcomes. Methods This study convened a Delphi panel consisting of 52 multidisciplinary, international ACP experts including clinicians, researchers, and policy leaders from four countries. We conducted literature reviews and solicited attendee input from 5 international ACP conferences to identify initial ACP outcome constructs. In 5 Delphi rounds, we asked panelists to rate patient-centered outcomes on a 7-point “not-at-all” to “extremely important” scale. We calculated means and analyzed panelists’ input to finalize an Organizing Framework and outcome rankings. Results Organizing Framework outcome domains included process (e.g., attitudes), actions (e.g., discussions), quality of care (e.g., satisfaction), and healthcare (e.g., utilization). The top 5 outcomes included (1) care consistent with goals, mean 6.71 (±SD 0.04); (2) surrogate designation, 6.55 (0.45); (3) surrogate documentation, 6.50 (0.11); (4) discussions with surrogates, 6.40 (0.19); and (5) documents and recorded wishes are accessible when needed 6.27 (0.11). Advance directive documentation was ranked 10th, 6.01 (0.21). Panelists raised caution about whether “care consistent with goals” 6.01 (0.21). Panelists raised can be reliably measured. Conclusion A large, multidisciplinary Delphi panel developed an Organizing Framework and rated the importance of ACP outcome constructs. Top rated outcomes should be used to evaluate the success of ACP initiatives. More research is needed to create reliable and valid measurement tools for the highest rated outcomes, particularly “care consistent with goals.” PMID:28865870

The Simulation of Vibrations of Railway Beam Bridges in the Object-oriented Environment Delphi

NASA Astrophysics Data System (ADS)

Raspopov, Alexander; Artyomov, Vitaly; Rusu, Sergey

2010-01-01

The peculiarities of combination of finite-element method and equations of solid dynamics, the basic stages of development of the program complex Belinda for calculation of statics and dynamics of the rods constructions as applied to railway bridges are described.

Kentucky Workforce Pathways Development

ERIC Educational Resources Information Center

Coburn, Karen L.

2017-01-01

The purpose of the study was to determine whether the advent of healthcare information technology was a viable career pathway for the people of northeastern Kentucky. The qualitative study used the Delphi Method to conduct and examine interviews with nine experts in Kentucky's workforce development, economic development, education, and healthcare…

Alchemy of the Oracle: The Delphi Technique.

ERIC Educational Resources Information Center

Wilhelm, William J.

2001-01-01

Discusses the origins and foundations of the Delphi technique. Outlines procedures for using it in research to obtain the insights of experts. Addresses limitations of the technique. (Contains 44 references.) (SK)

A Delphi study and ranking exercise to support commissioning services: future delivery of Thrombectomy services in England.

PubMed

Halvorsrud, Kristoffer; Flynn, Darren; Ford, Gary A; McMeekin, Peter; Bhalla, Ajay; Balami, Joyce; Craig, Dawn; White, Phil

2018-02-22

Intra-arterial thrombectomy is the gold standard treatment for large artery occlusive stroke. However, the evidence of its benefits is almost entirely based on trials delivered by experienced neurointerventionists working in established teams in neuroscience centres. Those responsible for the design and prospective reconfiguration of services need access to a comprehensive and complementary array of information on which to base their decisions. This will help to ensure the demonstrated effects from trials may be realised in practice and account for regional/local variations in resources and skill-sets. One approach to elucidate the implementation preferences and considerations of key experts is a Delphi survey. In order to support commissioning decisions, we aimed using an electronic Delphi survey to establish consensus on the options for future organisation of thrombectomy services among physicians with clinical experience in managing large artery occlusive stroke. A Delphi survey was developed with 12 options for future organisation of thrombectomy services in England. A purposive sampling strategy established an expert panel of stroke physicians from the British Association of Stroke Physicians (BASP) Clinical Standards and/or Executive Membership that deliver 24/7 intravenous thrombolysis. Options with aggregate scores falling within the lowest quartile were removed from the subsequent Delphi round. Options reaching consensus following the two Delphi rounds were then ranked in a final exercise by both the wider BASP membership and the British Society of Neuroradiologists (BSNR). Eleven stroke physicians from BASP completed the initial two Delphi rounds. Three options achieved consensus, with subsequently wider BASP (97%, n = 43) and BSNR members (86%, n = 21) assigning the highest approval rankings in the final exercise for transferring large artery occlusive stroke patients to nearest neuroscience centre for thrombectomy based on local CT/CT Angiography. The initial Delphi rounds ensured optimal reduction of options by an expert panel of stroke physicians, while subsequent ranking exercises allowed remaining options to be ranked by a wider group of experts within stroke to reach consensus. The preferred implementation option for thrombectomy is investigating suspected acute stroke patients by CT/CT Angiography and secondary transfer of large artery occlusive stroke patients to the nearest neuroscience (thrombectomy) centre.

Use of a Web-based Delphi for identifying critical components of a professional science master's program in biotechnology

NASA Astrophysics Data System (ADS)

Kantz, Jeannine Wells

The primary purpose of this research was to develop a model for a professional science master's program combining biotechnology and business. The objectives were to identify stakeholder preferences for various dimensions of a professional science master's program combining biotechnology and business and to identify differences in priorities between subgroups. A secondary purpose was to examine user preferences between Web-based and traditional methods of conducting a Delphi study and the panelist's impressions of its usefulness for program development. Prior to the first round, demographic data were collected on panelists regarding their gender, age, years experience in their current field, position title and education levels. Round 1 started with eight open-ended questions designed to investigate (a) learning objectives, (b) internships, (c) thesis vs. non-thesis degrees, (d) program focus (e) possible entry level positions, (f) roles for the industry advisory board, (g) recommended hours of hands-on experience and (h) other issues of importance. The final round ended with three questions to assess the panelists' perception of the usefulness of the Delphi for program development in higher education. Twenty-four panelists started Round 1 and participation in subsequent rounds varied from 17 in Round 2 to 11 in Round 4. Education level varied and included all levels of education in science and business. Issues emerged early in the study regarding development of different program tracks and the program goals, which were clarified in subsequent rounds. Significant differences occurred between industry and academic subgroups for two tracks, six skills designated for tracks, method of evaluating the internship, and entry-level positions appropriate for new graduates. When analyzed by level of confidence (high confidence vs. low confidence), significant differences occurred for (a) the number of semesters of hands-on experience students should have upon graduation, (b) skills recommended for core curriculum, (c) skills recommended for tracks, (d) compensation level and (e) entry level positions for new graduates. Perceived usefulness of the Delphi for program development was varied with only 10 panelists responding---five in favor, three undecided, and two against.

Framework of behavioral indicators evaluating TB health promotion outcomes: a modified Delphi study of TB policymakers and health workers.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Oren, Eyal; Cao, Jia

2015-12-15

Although TB health promotion directed at policy makers and healthcare workers (HCWs) is considered important to tuberculosis (TB) control, no indicators currently assess the impact of such promotional activities. This article is the second in a series of papers that seek to establish a framework of behavioral indicators for outcome evaluation of TB health promotion, using the Delphi method. In the first article, we sought to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. The objective of this second article is to present an indicator framework that can be used to assess behavioral outcomes of TB health promotion directed at policy makers and HCWs. A two-round, modified Delphi method was used to establish the indicators. Sixteen experts who were knowledgeable and experienced in the field of TB control were consulted in Delphi surveys. A questionnaire was developed following 4 steps, and involved ranking indicators on a five-point Likert scale. The consensus level was 70 %. Median, mode, and Coefficient of variation (CV) were used to describe expert responses. An authority coefficient (Cr) was used to assess the degree of each expert's authority. Consensus was achieved following the two survey rounds and several iterations among the experts. For TB health-promotion activities directed at policymakers, the experts reached consensus on 2 domains ("Resource inputs" and "Policymaking and monitoring behaviors"), 4 subdomains ("Human resources" among others), and 13 indicators ("Human resources per 100,000 person" among others). For TB health-promotion activities directed at HCWs, the experts reached consensus on 5 domains ("Self-protective behaviors" among others), 6 sub-domains ("Preventing infection" among others), and 15 indicators ("Average hours of daily workplace disinfection by ultraviolet radiation" among others). This study identified a conceptual framework of core behavioral indicators to evaluate TB health-promotion activities directed at policymakers and HCWs involved in TB control. Validation in other parts of the world could lead to global consensus on behavioral indicators to evaluate TB health promotion targeted at policymakers and HCWs.

Use of the Delphi process in paediatric cataract management.

PubMed

Serafino, Massimiliano; Trivedi, Rupal H; Levin, Alex V; Wilson, M Edward; Nucci, Paolo; Lambert, Scott R; Nischal, Ken K; Plager, David A; Bremond-Gignac, Dominique; Kekunnaya, Ramesh; Nishina, Sachiko; Tehrani, Nasrin N; Ventura, Marcelo C

2016-05-01

To identify areas of consensus and disagreement in the management of paediatric cataract using a modified Delphi approach among individuals recognised for publishing in this field. A modified Delphi method. International paediatric cataract experts with a publishing record in paediatric cataract management. The process consisted of three rounds of anonymous electronic questionnaires followed by a face-to-face meeting, followed by a fourth anonymous electronic questionnaire. The executive committee created questions to be used for the electronic questionnaires. Questions were designed to have unit-based, multiple choice or true-false answers. The questionnaire included issues related to the preoperative, intraoperative and postoperative management of paediatric cataract. Consensus based on 85% of panellists being in agreement for electronic questionnaires or 80% for the face-to-face meeting, and near consensus based on 70%. Sixteen of 22 invited paediatric cataract surgeons agreed to participate. We arrived at consensus or near consensus for 85/108 (78.7%) questions and non-consensus for the remaining 23 (21.3%) questions. Those questions where consensus was not reached highlight areas of either poor evidence or contradicting evidence, and may help investigators identify possible research questions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

The development of a consensus-based nutritional pathway for infants with CHD before surgery using a modified Delphi process.

PubMed

Marino, Luise V; Johnson, Mark J; Hall, Nigel J; Davies, Natalie J; Kidd, Catherine S; Daniels, M Lowri; Robinson, Julia E; Richens, Trevor; Bharucha, Tara; Darlington, Anne-Sophie E

2018-04-29

IntroductionDespite improvements in the medical and surgical management of infants with CHD, growth failure before surgery in many infants continues to be a significant concern. A nutritional pathway was developed, the aim of which was to provide a structured approach to nutritional care for infants with CHD awaiting surgery.Materials and methodsThe modified Delphi process was development of a nutritional pathway; initial stakeholder meeting to finalise draft guidelines and develop questions; round 1 anonymous online survey; round 2 online survey; regional cardiac conference and pathway revision; and final expert meeting and pathway finalisation. Paediatric Dietitians from all 11 of the paediatric cardiology surgical centres in the United Kingdom contributed to the guideline development. In all, 33% of participants had 9 or more years of experience working with infants with CHD. By the end of rounds 1 and 2, 76 and 96% of participants, respectively, were in agreement with the statements. Three statements where consensus was not achieved by the end of round 2 were discussed and agreed at the final expert group meeting. Nutrition guidelines were developed for infants with CHD awaiting surgery, using a modified Delphi process, incorporating the best available evidence and expert opinion with regard to nutritional support in this group.

A consensus exercise identifying priorities for research into clinical effectiveness among children's orthopaedic surgeons in the United Kingdom.

PubMed

Perry, D C; Wright, J G; Cooke, S; Roposch, A; Gaston, M S; Nicolaou, N; Theologis, T

2018-05-01

Aims High-quality clinical research in children's orthopaedic surgery has lagged behind other surgical subspecialties. This study used a consensus-based approach to identify research priorities for clinical trials in children's orthopaedics. Methods A modified Delphi technique was used, which involved an initial scoping survey, a two-round Delphi process and an expert panel formed of members of the British Society of Children's Orthopaedic Surgery. The survey was conducted amongst orthopaedic surgeons treating children in the United Kingdom and Ireland. Results A total of 86 clinicians contributed to both rounds of the Delphi process, scoring priorities from one (low priority) to five (high priority). Elective topics were ranked higher than those relating to trauma, with the top ten elective research questions scoring higher than the top question for trauma. Ten elective, and five trauma research priorities were identified, with the three highest ranked questions relating to the treatment of slipped capital femoral epiphysis (mean score 4.6/ 5), Perthes' disease (4.5) and bone infection (4.5). Conclusion This consensus-based research agenda will guide surgeons, academics and funders to improve the evidence in children's orthopaedic surgery and encourage the development of multicentre clinical trials. Cite this article: Bone Joint J 2018;100-B:680-4.

Improving Patient Safety in Public Hospitals: Developing Standard Measures to Track Medical Errors and Process Breakdowns.

PubMed

Ackerman, Sara L; Gourley, Gato; Le, Gem; Williams, Pamela; Yazdany, Jinoos; Sarkar, Urmimala

2018-03-14

The aim of the study was to develop standards for tracking patient safety gaps in ambulatory care in safety net health systems. Leaders from five California safety net health systems were invited to participate in a modified Delphi process sponsored by the Safety Promotion Action Research and Knowledge Network (SPARKNet) and the California Safety Net Institute in 2016. During each of the three Delphi rounds, the feasibility and validity of 13 proposed patient safety measures were discussed and prioritized. Surveys and transcripts from the meetings were analyzed to understand the decision-making process. The Delphi process included eight panelists. Consensus was reached to adopt 9 of 13 proposed measures. All 9 measures were unanimously considered valid, but concern was expressed about the feasibility of implementing several of the measures. Although safety net health systems face high barriers to standardized measurement, our study demonstrates that consensus can be reached on acceptable and feasible methods for tracking patient safety gaps in safety net health systems. If accompanied by the active participation key stakeholder groups, including patients, clinicians, staff, data system professionals, and health system leaders, the consensus measures reported here represent one step toward improving ambulatory patient safety in safety net health systems.

Expert surgical consensus for prenatal counseling using the Delphi method.

PubMed

Berman, Loren; Jackson, Jordan; Miller, Kristen; Kowalski, Rebecca; Kolm, Paul; Luks, Francois I

2017-11-28

Pediatric surgeons frequently offer prenatal consultation for congenital pulmonary airway malformation (CPAM) and congenital diaphragmatic hernia (CDH); however, there is no evidence-based consensus to guide prenatal decision making and counseling for these conditions. Eliciting feedback from experts is integral to defining best practice regarding prenatal counseling and intervention. A Delphi consensus process was undertaken using a panel of pediatric surgeons identified as experts in fetal therapy to address current limitations. Areas of discrepancy in the literature on CPAM and CDH were identified and used to generate a list of content and intervention questions. Experts were invited to participate in an online Delphi survey. Items that did not reach first-round consensus were broken down into additional questions, and consensus was achieved in the second round. Fifty-four surgeons (69%) responded to at least one of the two survey rounds. During round one, consensus was reached on 54 of 89 survey questions (61%), and 45 new questions were developed. During round two, consensus was reached on 53 of 60 survey questions (88%). We determined expert consensus to establish guidelines regarding perinatal management of CPAM and CDH. Our results can help educate pediatric surgeons participating in perinatal care of these patients. V. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of a decision aid for the treatment of benign prostatic hyperplasia: A four stage method using a Delphi consensus study.

PubMed

Lamers, Romy E D; Cuypers, Maarten; Garvelink, Mirjam M; de Vries, Marieke; Bosch, J L H Ruud; Kil, Paul J M

2016-07-01

To develop a web-based decision aid (DA) for the treatment of lower urinary tract symptoms due to benign prostatic hyperplasia (LUTS/BPH). From February-September 2014 we performed a four-stage development method: 1: Two-round Delphi consensus method among urologists, 2: Identifying patients' needs and expectations, 3: Development of DA content and structure, 4: Usability testing with LUTS/BPH patients. 1 (N=15): Dutch urologists reached consensus on 61% of the statements concerning users' criteria, decision options, structure, and medical content. 2 (N=24): Consensus was reached in 69% on statements concerning the need for improvement of information provision, the need for DA development and that the DA should clarify patients' preferences. 3: DA development based on results from stage 1 and stage 2. 4 (N=10): Pros of the DA were clear information provision, systematic design and easy to read and re-read. A LUTS/BPH DA containing VCEs(**) was developed in cooperation with urologists and patients following a structured 4 stage method and was stated to be well accepted. This method can be adopted for the development of DAs to support other medical decision issues. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Consensus definitions of 14 severe acute toxic effects for childhood lymphoblastic leukaemia treatment: a Delphi consensus.

PubMed

Schmiegelow, Kjeld; Attarbaschi, Andishe; Barzilai, Shlomit; Escherich, Gabriele; Frandsen, Thomas Leth; Halsey, Christina; Hough, Rachael; Jeha, Sima; Kato, Motohiro; Liang, Der-Cherng; Mikkelsen, Torben Stamm; Möricke, Anja; Niinimäki, Riitta; Piette, Caroline; Putti, Maria Caterina; Raetz, Elizabeth; Silverman, Lewis B; Skinner, Roderick; Tuckuviene, Ruta; van der Sluis, Inge; Zapotocka, Ester

2016-06-01

Although there are high survival rates for children with acute lymphoblastic leukaemia, their outcome is often counterbalanced by the burden of toxic effects. This is because reported frequencies vary widely across studies, partly because of diverse definitions of toxic effects. Using the Delphi method, 15 international childhood acute lymphoblastic leukaemia study groups assessed acute lymphoblastic leukaemia protocols to address toxic effects that were to be considered by the Ponte di Legno working group. 14 acute toxic effects (hypersensitivity to asparaginase, hyperlipidaemia, osteonecrosis, asparaginase-associated pancreatitis, arterial hypertension, posterior reversible encephalopathy syndrome, seizures, depressed level of consciousness, methotrexate-related stroke-like syndrome, peripheral neuropathy, high-dose methotrexate-related nephrotoxicity, sinusoidal obstructive syndrome, thromboembolism, and Pneumocystis jirovecii pneumonia) that are serious but too rare to be addressed comprehensively within any single group, or are deemed to need consensus definitions for reliable incidence comparisons, were selected for assessment. Our results showed that none of the protocols addressed all 14 toxic effects, that no two protocols shared identical definitions of all toxic effects, and that no toxic effect definition was shared by all protocols. Using the Delphi method over three face-to-face plenary meetings, consensus definitions were obtained for all 14 toxic effects. In the overall assessment of outcome of acute lymphoblastic leukaemia treatment, these expert opinion-based definitions will allow reliable comparisons of frequencies and severities of acute toxic effects across treatment protocols, and facilitate international research on cause, guidelines for treatment adaptation, preventive strategies, and development of consensus algorithms for reporting on acute lymphoblastic leukaemia treatment. Copyright © 2016 Elsevier Ltd. All rights reserved.

Consensus in controversy: The modified Delphi method applied to Gynecologic Oncology practice.

PubMed

Cohn, David E; Havrilesky, Laura J; Osann, Kathryn; Lipscomb, Joseph; Hsieh, Susie; Walker, Joan L; Wright, Alexi A; Alvarez, Ronald D; Karlan, Beth Y; Bristow, Robert E; DiSilvestro, Paul A; Wakabayashi, Mark T; Morgan, Robert; Mukamel, Dana B; Wenzel, Lari

2015-09-01

To determine the degree of consensus regarding the probabilities of outcomes associated with IP/IV and IV chemotherapy. A survey was administered to an expert panel using the Delphi method. Ten ovarian cancer experts were asked to estimate outcomes for patients receiving IP/IV or IV chemotherapy. The clinical estimates were: 1) probability of completing six cycles of chemotherapy, 2) probability of surviving five years, 3) median survival, and 4) probability of ER/hospital visits during treatment. Estimates for two patients, one with a low comorbidity index (patient 1) and the other with a moderate index (patient 2), were included. The survey was administered in three rounds, and panelists could revise their subsequent responses based on review of the anonymous opinions of their peers. The ranges were smaller for IV compared with IP/IV therapy. Ranges decreased with each round. Consensus converged around outcomes related to IP/IV chemotherapy for: 1) completion of 6 cycles of therapy (type 1 patient, 62%, type 2 patient, 43%); 2) percentage of patients surviving 5 years (type 1 patient, 66%, type 2 patient, 47%); and 3) median survival (type 1 patient, 83 months, type 2 patient, 58 months). The group required three rounds to achieve consensus on the probabilities of ER/hospital visits (type 1 patient, 24%, type 2 patient, 35%). Initial estimates of survival and adverse events associated with IP/IV chemotherapy differ among experts. The Delphi process works to build consensus and may be a pragmatic tool to inform patients of their expected outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

Early Field Experience in Career and Technical Education

ERIC Educational Resources Information Center

Smalley, Scott Walter

2011-01-01

The purpose of the three studies in this dissertation was to enhance career and technical education in the area of agriculture, business, and family and consumer sciences. This dissertation contains three papers: (1) a Delphi study identifying the purpose, expected outcomes, and methods of documenting preservice teacher early field experience…

College Student Concerns: Perceptions of Student Affairs Practitioners

ERIC Educational Resources Information Center

Reynolds, Amy L.

2013-01-01

The purpose of this study was to increase awareness of the perceptions of student affairs professionals regarding the most frequent and challenging concerns facing college students today. Using the Delphi method, 159 entry-level and mid-level student affairs administrators from institutions across the country were surveyed about their perceptions…

Construct Validation of Content Standards for Teaching

ERIC Educational Resources Information Center

van der Schaaf, Marieke F.; Stokking, Karel M.

2011-01-01

Current international demands to strengthen the teaching profession have led to an increased development and use of professional content standards. The study aims to provide insight in the construct validity of content standards by researching experts' underlying assumptions and preferences when participating in a delphi method. In three rounds 21…

Colliding Scopes: Seeing Academic Library Leadership through a Lens of Complexity

ERIC Educational Resources Information Center

Baird, Lynn N.

2010-01-01

Academic libraries routinely negotiate layers of change as embedded organizations in higher education institutions. Facing competing demands with limited resources gave rise to the question: how do academic library deans effectively lead their organizations in times of change? A Delphi Method study was conducted to identify successful leadership…

Measuring and Assessing Technical Training Performance in the Army’s Schools and Units: A Survey of Current Methods

DTIC Science & Technology

1988-10-01

Madey and Stenner , 1981) and the Delphi Technique (Dalkey, 1969). These techniques are used by management analysts, industrial-organizational...Personnel Research Laboratory, Aerospace Medical Division, Lackland AFB, TX, May 1963. Madey, D, & Stenner , J. (1980). Policy implications analysis: A

Expert Perspectives on the Future of Physical Education in Higher Education

ERIC Educational Resources Information Center

Lorusso, Jenna R.; Richards, K. Andrew R.

2018-01-01

Despite physical education teacher education/physical education sport pedagogy's (PETE/PESP's) significant strides in the past century, there are concerns about its future. Grounded in participatory research, and through an interview-Delphi method, this study purposefully sampled five male PETE/PESP scholars' expert critiques of current threats,…

The National Health Educator Job Analysis 2010: Process and Outcomes

ERIC Educational Resources Information Center

Doyle, Eva I.; Caro, Carla M.; Lysoby, Linda; Auld, M. Elaine; Smith, Becky J.; Muenzen, Patricia M.

2012-01-01

The National Health Educator Job Analysis 2010 was conducted to update the competencies model for entry- and advanced-level health educators. Qualitative and quantitative methods were used. Structured interviews, focus groups, and a modified Delphi technique were implemented to engage 59 health educators from diverse work settings and experience…

Use of expert judgment elicitation to estimate seismic vulnerability of selected building types

USGS Publications Warehouse

Jaiswal, K.S.; Aspinall, W.; Perkins, D.; Wald, D.; Porter, K.A.

2012-01-01

Pooling engineering input on earthquake building vulnerability through an expert judgment elicitation process requires careful deliberation. This article provides an overview of expert judgment procedures including the Delphi approach and the Cooke performance-based method to estimate the seismic vulnerability of a building category.

The Relative Noncognitive Traits of Sonographers: A Delphi Study

ERIC Educational Resources Information Center

Hagerty, Christina A.

2012-01-01

As the entrance to sonography programs continues to be competitive, community colleges are seeking methods to select students who will complete the program successfully and practice the standards of the profession. Although researchers have investigated the use of cognitive admission criteria in the selection of sonography candidates, more studies…

Modified Delphi Investigation of Lesson Planning Concepts for Physical Education Teacher Education

ERIC Educational Resources Information Center

Sager, Jack W.

2012-01-01

Improving the methods of instructing future educators, through program evaluation and improvement, should be a goal of all teacher education programs. In physical education, the National Association for Sport & Physical Education created standards for initial preparation of physical education teachers. The six standards for preparation include…

Threshold Concepts in Entrepreneurship--The Entrepreneurs' Perspective

ERIC Educational Resources Information Center

Hatt, Lucy

2018-01-01

Purpose: The purpose of this paper is to present research into the entrepreneurs' perspective of concepts critical to thinking as an entrepreneur, in order to inform enterprise and entrepreneurship course design in higher education. Design/methodology/approach: Taking a social constructivist approach, using a Delphi-style method, semi-structured…

Defining a Bobath clinical framework - A modified e-Delphi study.

PubMed

Vaughan-Graham, Julie; Cott, Cheryl

2016-11-01

To gain consensus within the expert International Bobath Instructors Training Association (IBITA) on a Bobath clinical framework on which future efficacy studies can be based. A three-round modified e-Delphi approach was used with 204 full members of the IBITA. Twenty-one initial statements were generated from the literature. Consensus was defined a priori as at least 80% of the respondents with a level of agreement on a Likert scale of 4 or 5. The Delphi questionnaire for each round was available online for two weeks. Summary reports and subsequent questionnaires were posted within four weeks. Ninety-four IBITA members responded, forming the Delphi panel, of which 68 and 66 responded to Rounds Two and Three, respectively. The 21 initial statements were revised to 17 statements and five new statements in Round Two in which eight statements were accepted and two statements were eliminated. Round Three presented 12 revised statements, all reaching consensus. The Delphi was successful in gaining consensus on a Bobath clinical framework in a geographically diverse expert association, identifying the unique components of Bobath clinical practice. Discussion throughout all three Rounds revolved primarily around the terminology of atypical and compensatory motor behavior and balance.

Feasibility of multi-sector policy measures that create activity-friendly environments for children: results of a Delphi study.

PubMed

Aarts, Marie-Jeanne; Schuit, Albertine J; van de Goor, Ien Am; van Oers, Hans Am

2011-12-15

Although multi-sector policy is a promising strategy to create environments that stimulate physical activity among children, little is known about the feasibility of such a multi-sector policy approach. The aims of this study were: to identify a set of tangible (multi-sector) policy measures at the local level that address environmental characteristics related to physical activity among children; and to assess the feasibility of these measures, as perceived by local policy makers. In four Dutch municipalities, a Delphi study was conducted among local policy makers of different policy sectors (public health, sports, youth and education, spatial planning/public space, traffic and transportation, and safety). In the first Delphi round, respondents generated a list of possible policy measures addressing three environmental correlates of physical activity among children (social cohesion, accessibility of facilities, and traffic safety). In the second Delphi round, policy makers weighted different feasibility aspects (political feasibility, cultural/community acceptability, technical feasibility, cost feasibility, and legal feasibility) and assessed the feasibility of the policy measures derived from the first round. The third Delphi round was aimed at reaching consensus by feedback of group results. Finally, one overall feasibility score was calculated for each policy measure. Cultural/community acceptability, political feasibility, and cost feasibility were considered most important feasibility aspects. The Delphi studies yielded 16 feasible policy measures aimed at physical and social environmental correlates of physical activity among children. Less drastic policy measures were considered more feasible, whereas environmental policy measures were considered less feasible. This study showed that the Delphi technique can be a useful tool in reaching consensus about feasible multi-sector policy measures. The study yielded several feasible policy measures aimed at physical and social environmental correlates of physical activity among children and can assist local policy makers in designing multi-sector policies aimed at an activity-friendly environment for children.

Development of the Learning Health System Researcher Core Competencies.

PubMed

Forrest, Christopher B; Chesley, Francis D; Tregear, Michelle L; Mistry, Kamila B

2017-08-04

To develop core competencies for learning health system (LHS) researchers to guide the development of training programs. Data were obtained from literature review, expert interviews, a modified Delphi process, and consensus development meetings. The competencies were developed from August to December 2016 using qualitative methods. The literature review formed the basis for the initial draft of a competency domain framework. Key informant semi-structured interviews, a modified Delphi survey, and three expert panel (n = 19 members) consensus development meetings produced the final set of competencies. The iterative development process yielded seven competency domains: (1) systems science; (2) research questions and standards of scientific evidence; (3) research methods; (4) informatics; (5) ethics of research and implementation in health systems; (6) improvement and implementation science; and (7) engagement, leadership, and research management. A total of 33 core competencies were prioritized across these seven domains. The real-world milieu of LHS research, the embeddedness of the researcher within the health system, and engagement of stakeholders are distinguishing characteristics of this emerging field. The LHS researcher core competencies can be used to guide the development of learning objectives, evaluation methods, and curricula for training programs. © Health Research and Educational Trust.

Guidelines for the development of social marketing programmes for sun protection among adolescents and young adults.

PubMed

Johnson, K M; Jones, S C; Iverson, D

2009-09-01

To formulate 'best practice' guidelines for social marketing programmes for adolescents' and young adults' sun protection. A Delphi consensus process. Eleven experts in sun protection and social marketing participated in a Delphi consensus process, where they were asked to provide up to 10 key points, based on their knowledge and practical experience, which they felt were most important in developing social marketing interventions for the primary prevention of skin cancer among adolescents and young adults. After reaching consensus, the evidence base for each guideline was determined and graded via the Scottish Intercollegiate Guideline Network grading system. Participants were then asked to indicate how strongly they rated the finalized 15 recommendations based on all aspects relating to their knowledge and practical opinion, as well as the research evidence, on a visual analogue scale. The resultant 15 guidelines offer general principles for sun protection interventions utilizing a social marketing approach. This method of guideline development brought the expertise of practitioners to the forefront of guideline development, whilst still utilizing established methods of evidence confirmation. It thus offers a useful method for guideline development in a public health context.

Optimising a curriculum for clinical haematology and biochemistry in sports medicine: a Delphi approach

PubMed Central

Fallon, K E; Trevitt, A C

2006-01-01

Objectives To investigate issues of curriculum in the context of a postgraduate sports medicine training programme, specifically in the field of clinical biochemistry and haematology. Methods Following the Delphi methodology, a series of sequential questionnaires was administered to curriculum developers, clinical teachers, examiners, and registrars. Results Agreement on a core syllabus for this subject with an indication of the core aims and objectives of teaching and learning in this field and the associated required skills and competencies. An indication of current and ideal teaching and learning methods and reasons for these preferences. A consensus of key features of a teaching module for this field and of appropriate methods of examination. Conclusions The data derived from this study, as well as the experience of engaging in it, will better inform curriculum developers, teachers, and students of one another's perceptions as to what is important in and appropriate to teaching and learning in this field of sports medicine. Engagement in the exercise and broader consideration of the outcomes by those who develop the curriculum, teach, and formulate the examination process will facilitate attainment of the ideal of well aligned teaching, learning, and examination in this specific field. PMID:16432001

A practical guideline for examining a uterine niche using ultrasonography in non-pregnant women: a modified Delphi method amongst European experts.

PubMed

Jordans, I P M; de Leeuw, R; Stegwee, S I; Amso, N N; Barri-Soldevila, P N; van den Bosch, T; Bourne, T; Brolmann, H A M; Donnez, O; Dueholm, M; Hehenkamp, W J K; Jastrow, N; Jurkovic, D; Mashiach, R; Naji, O; Streuli, I; Timmerman, D; Vd Voet, L F; Huirne, J A F

2018-03-14

To generate a uniform, internationally recognized guideline for detailed uterine niche evaluation by ultrasonography in non-pregnant women using a modified Delphi method amongst international experts. Fifteen international gynecological experts were recruited by their membership of the European niche taskforce group. All experts were physicians with extensive experience in niche evaluation in clinical practice and/or authors of niche studies. Relevant items for niche measurement were determined based on the results of a literature search and recommendations of a focus group. Two online questionnaires were sent to the expert panel and one group meeting was organized. Consensus was predefined as a consensus rate of at least 70%. In total 15 experts participated in this study. Consensus was reached for a total of 42 items on niche evaluation, including definitions, relevance, method of measurement and tips for visualization of the niche. All experts agreed on the proposed guideline for niche evaluation in non-pregnant women as presented in this paper. Consensus between niche experts was achieved on all items regarding ultrasonographic niche measurement. This article is protected by copyright. All rights reserved.

Development and pilot test of a process to identify research needs from a systematic review.

PubMed

Saldanha, Ian J; Wilson, Lisa M; Bennett, Wendy L; Nicholson, Wanda K; Robinson, Karen A

2013-05-01

To ensure appropriate allocation of research funds, we need methods for identifying high-priority research needs. We developed and pilot tested a process to identify needs for primary clinical research using a systematic review in gestational diabetes mellitus. We conducted eight steps: abstract research gaps from a systematic review using the Population, Intervention, Comparison, Outcomes, and Settings (PICOS) framework; solicit feedback from the review authors; translate gaps into researchable questions using the PICOS framework; solicit feedback from multidisciplinary stakeholders at our institution; establish consensus among multidisciplinary external stakeholders on the importance of the research questions using the Delphi method; prioritize outcomes; develop conceptual models to highlight research needs; and evaluate the process. We identified 19 research questions. During the Delphi method, external stakeholders established consensus for 16 of these 19 questions (15 with "high" and 1 with "medium" clinical benefit/importance). We pilot tested an eight-step process to identify clinically important research needs. Before wider application of this process, it should be tested using systematic reviews of other diseases. Further evaluation should include assessment of the usefulness of the research needs generated using this process for primary researchers and funders. Copyright © 2013 Elsevier Inc. All rights reserved.

Professional Competencies of Cuban Specialists in Intensive Care and Emergency Medicine.

PubMed

Véliz-Martínez, Pedro L; Jorna-Calixto, Ana R; Oramas-González, René

2016-10-01

INTRODUCTION The quality of medical training and practice reflects the competency level of the professionals involved. The intensive care and emergency medicine specialty in Cuba has not defined its competencies. OBJECTIVE Identify the competencies required for specialty practice in intensive care and emergency medicine. METHODS The study was conducted from January 2014 to December 2015, using qualitative techniques; 48 professionals participated. We undertook functional occupational analysis, based on functions defined in a previous study. Three expert groups were utilized: the first used various group techniques; the second, the Delphi method; and the third, the Delphi method and a Likert questionnaire. RESULTS A total of 73 specific competencies were defined, grouped in 11 units: 44 in the patient care function, 16 in management, 7 in teaching and 6 in research. A competency map is provided. CONCLUSIONS The intensive care and emergency medicine specialty competencies identified will help improve professional standards, ensure health workforce quality, improve patient care and academic performance, and enable objective evaluation of specialists' competence and performance. KEYWORDS Clinical competency, competency-based education, professional education, intensive care, emergency medicine, urgent care, continuing medical education, curriculum, medical residency, Cuba.

The Development of Accepted Performance Items to Demonstrate Braille Competence in the Nemeth Code for Mathematics and Science Notation

ERIC Educational Resources Information Center

Smith, Derrick; Rosenblum, L. Penny

2013-01-01

Introduction: The purpose of the study presented here was the initial validation of a comprehensive set of competencies focused solely on the Nemeth code. Methods: Using the Delphi method, 20 expert panelists were recruited to participate in the study on the basis of their past experience in teaching a university-level course in the Nemeth code.…

Curriculum development for a national cardiotocography education program: a Delphi survey to obtain consensus on learning objectives.

PubMed

Thellesen, Line; Hedegaard, Morten; Bergholt, Thomas; Colov, Nina P; Hoegh, Stinne; Sorensen, Jette L

2015-08-01

To define learning objectives for a national cardiotocography (CTG) education program based on expert consensus. A three-round Delphi survey. One midwife and one obstetrician from each maternity unit in Denmark were appointed based on CTG teaching experience and clinical obstetric experience. Following national and international guidelines, the research group determined six topics as important when using CTG: fetal physiology, equipment, indication, interpretation, clinical management, and communication/responsibility. In the first Delphi round, participants listed one to five learning objectives within the predefined topics. Responses were analyzed by a directed approach to content analysis. Phrasing was modified in accordance with Bloom's taxonomy. In the second and third Delphi rounds, participants rated each objective on a five-point relevance scale. Consensus was predefined as objectives with a mean rating value of ≥ 3. A prioritized list of CTG learning objectives. A total of 42 midwives and obstetricians from 21 maternity units were invited to participate, of whom 26 completed all three Delphi rounds, representing 18 maternity units. The final prioritized list included 40 objectives. The highest ranked objectives emphasized CTG interpretation and clinical management. The lowest ranked objectives emphasized fetal physiology. Mean ratings of relevance ranged from 3.15 to 5.00. National consensus on CTG learning objectives was achieved using the Delphi methodology. This was an initial step in developing a valid CTG education program. A prioritized list of objectives will clarify which topics to emphasize in a CTG education program. © 2015 Nordic Federation of Societies of Obstetrics and Gynecology.

Intimate Partner Violence Programs in a Children's Hospital: Comprehensive Assessment Utilizing a Delphi Instrument.

PubMed

Randell, Kimberly A; Evans, Sarah E; O'Malley, Donna; Dowd, M Denise

2015-03-01

The purpose of this study was to conduct a baseline assessment of intimate partner violence (IPV) practices in a pediatric hospital system. The Delphi Instrument for Hospital-based Domestic Violence Programs was used to assess the structure and components of the hospital system's IPV practices. Through key stakeholder interviews, we also assessed IPV practices in individual patient care areas. Qualitative analysis of interview data used a grounded theory approach. The hospital scored 17 of 100 points on the Delphi instrument assessment. Key areas of weakness identified by the Delphi instrument and interviews included lack of coordinated provider training and evaluation of IPV-related processes and no standards for IPV screening, safety assessment, and documentation. Most interviewees supported addressing IPV; all identified barriers to IPV screening at individual provider and institutional levels. Institutional barriers included lack of a standardized response to IPV disclosure, need for individualized screening protocols for different patient care settings, lack of standardized provider training, concerns about overextending social work resources, and lack of resources for hospital staff experiencing vicarious trauma. Individual barriers included concern that screening may harm physician-patient-family relationships and the perception that physicians are unwilling to address psychosocial issues. The Delphi Instrument for Hospital-based Domestic Violence Programs identified weaknesses and key areas for improvement in IPV practices. Deficiencies revealed by the Delphi instrument were affirmed by individual interview results. Institutional and individual provider level barriers must be addressed to optimize IPV practices in a pediatric hospital system. Copyright © 2015 by the American Academy of Pediatrics.

Management of intrathecal baclofen therapy for severe acquired brain injury: consensus and recommendations for good clinical practice.

PubMed

De Tanti, Antonio; Scarponi, Federico; Bertoni, Michele; Gasperini, Giulio; Lanzillo, Bernardo; Molteni, Franco; Posteraro, Federico; Vitale, Dino Francesco; Zanpolini, Mauro

2017-08-01

Although widespread in the treatment of generalised spasticity due to severe acquired brain injury, clinical use of intrathecal baclofen administered through an implanted catheter is not yet supported by full scientific evidence. The aim of the study is to provide recommendations for good clinical practice regarding intrathecal baclofen therapy. We used a modified RAND Delphi method to develop consensus-based medical guidelines, involving clinicians who use intrathecal baclofen therapy throughout Italy. The clinicians were asked 38 questions grouped in six areas (patient selection, contraindications for implant, tests prior to implant, method of implant and management of therapy, efficacy evaluation and goal setting, and management of complications). To establish consensus, 75% agreement was required in answers to every question. Consensus was reached on the second round of the Delphi process on 27/38 questions (71%), specifically those regarding identification of objectives, efficacy evaluation, and method of implant and management of therapy, whereas management of complications and contraindications for implant remained critical areas. Despite the limits of our method, a set of recommendations was drawn up for clinical practice in this sector. The study also revealed residual critical areas and indicated future lines of research necessary to reach evidence-based consensus.

A Quality Scorecard for the Administration of Online Education Programs: A Delphi Study

ERIC Educational Resources Information Center

Shelton, Kaye

2010-01-01

As the demands for public accountability increase for the higher education industry, institutions are seeking methods for continuous improvement in order to demonstrate quality within programs and processes, including those provided through online education. Because of the rapid growth of online education programs, institutions are further called…

Organizational Application of Social Networking Information Technologies

ERIC Educational Resources Information Center

Reppert, Jeffrey R.

2012-01-01

The focus of this qualitative research study using the Delphi method is to provide a framework for leaders to develop their own social networks. By exploring concerns in four areas, leaders may be able to better plan, implement, and manage social networking systems in organizations. The areas addressed are: (a) social networking using…

Developing and Validating a Competence Framework for Secondary Mathematics Student Teachers through a Delphi Method

ERIC Educational Resources Information Center

Muñiz-Rodríguez, Laura; Alonso, Pedro; Rodríguez-Muñiz, Luis J.; Valcke, Martin

2017-01-01

Initial teacher education programmes provide student teachers with the desired competences to develop themselves as teachers. Although a generic framework for teaching competences is available covering all school subjects in Spain, the initial teacher education programmes curriculum does not specify which competences secondary mathematics student…

Development of the Gross Motor Function Classification System (1997)

ERIC Educational Resources Information Center

Morris, Christopher

2008-01-01

To address the need for a standardized system to classify the gross motor function of children with cerebral palsy, the authors developed a five-level classification system analogous to the staging and grading systems used in medicine. Nominal group process and Delphi survey consensus methods were used to examine content validity and revise the…

Designing HRD Interventions for Employee-Robot Interaction

ERIC Educational Resources Information Center

Heo, Se Jin

2011-01-01

The purpose of this study was to identify critical causes of work stress and job satisfaction of nurses, which can contribute to find appropriate organizational supports to help nurses effectively work with a surgical robot. Delphi method was employed to identify the critical stressors and the key causes of job satisfaction of nurses working with…

Operating Hours Based Inventory Management.

DTIC Science & Technology

1986-12-01

forecasting can be based on the expert opinion. The Delphi technique is one such method of forecasting which uses a group of decision makers with a...errors occ.ur. If larce a’nounts of’ material are procured and warehoused, there could be a greater chance that the material will no longer be needed

Research on evaluation of third-party governance operation services for environmental pollution

NASA Astrophysics Data System (ADS)

Xu, Bingsheng; Ling, Lin; Jin, Huang

2017-11-01

This paper focuses on the evaluation of third-party governance operation services for environmental pollution, and determines the evaluation indicator system composed of 5 primary indicators as the basic competence of enterprise, operation of equipment, technique economics, environmental benefit and management level, and 26 secondary indicators via policies and regulations, standards, literature research and expert consultation in combination with the composition elements, service value judgment factors and full-life cycle of the work, providing theoretical support for the effect evaluation of third-governance over the environmental pollution in China. Then, the hierarchical analytic matrix is formed by analyzing the environmental pollution governance evaluation indicator system via analytic hierarchy process and scoring the importance of various indicators by experts by applying the Delphi method. The feature vector of the matrix is then calculated to obtain the weight of each indicator and verify the effectiveness of the Delphi method and obtain the comprehensive weight by judging the consistency of the matrix, so as to finally determine the overall ordering level of the importance of secondary indicators.

5. A PHOTO IMAGE FROM THE WEST SIDEWALK LOOKING EAST ...

Library of Congress Historic Buildings Survey, Historic Engineering Record, Historic Landscapes Survey

5. A PHOTO IMAGE FROM THE WEST SIDEWALK LOOKING EAST TOWARD THE ENTRY GATES AND PORTIONS OF RILEY PARK - Delphi Bridge on U.S. Route 421, Spanning Deer Creek at U.S. Route 421, Delphi, Carroll County, IN

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process.

PubMed

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-09-10

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention.

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process

PubMed Central

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-01-01

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention. PMID:26378557

Towards an international taxonomy of integrated primary care: a Delphi consensus approach.

PubMed

Valentijn, Pim P; Vrijhoef, Hubertus J M; Ruwaard, Dirk; Boesveld, Inge; Arends, Rosa Y; Bruijnzeels, Marc A

2015-05-22

Developing integrated service models in a primary care setting is considered an essential strategy for establishing a sustainable and affordable health care system. The Rainbow Model of Integrated Care (RMIC) describes the theoretical foundations of integrated primary care. The aim of this study is to refine the RMIC by developing a consensus-based taxonomy of key features. First, the appropriateness of previously identified key features was retested by conducting an international Delphi study that was built on the results of a previous national Delphi study. Second, categorisation of the features among the RMIC integrated care domains was assessed in a second international Delphi study. Finally, a taxonomy was constructed by the researchers based on the results of the three Delphi studies. The final taxonomy consists of 21 key features distributed over eight integration domains which are organised into three main categories: scope (person-focused vs. population-based), type (clinical, professional, organisational and system) and enablers (functional vs. normative) of an integrated primary care service model. The taxonomy provides a crucial differentiation that clarifies and supports implementation, policy formulation and research regarding the organisation of integrated primary care. Further research is needed to develop instruments based on the taxonomy that can reveal the realm of integrated primary care in practice.

Development of a clinical definition for acute respiratory distress syndrome using the Delphi technique.

PubMed

Ferguson, Niall D; Davis, Aileen M; Slutsky, Arthur S; Stewart, Thomas E

2005-06-01

The objective of this study is to describe the implementation of formal consensus techniques in the development of a clinical definition for acute respiratory distress syndrome. A Delphi consensus process was conducted using e-mail. Sixteen panelists who were both researchers and opinion leaders were systematically recruited. The Delphi technique was performed over 4 rounds on the background of an explicit definition framework. Item generation was performed in round 1, item reduction in rounds 2 and 3, and definition evaluation in round 4. Explicit consensus thresholds were used throughout. Of the 16 panelists, 11 actually participated in developing a definition that met a priori consensus rules on the third iteration. New incorporations in the Delphi definition include the use of a standardized oxygenation assessment and the documentation of either a predisposing factor or decreased thoracic compliance. The panelists rated the Delphi definition as acceptable to highly acceptable (median score, 6; range, 5-7 on a 7-point Likert scale). We conclude that it is feasible to consider using formal consensus in the development of future definitions of acute respiratory distress syndrome. Testing of sensibility, reliability, and validity are needed for this preliminary definition; these test results should be incorporated into future iterations of this definition.

An expert-based approach to forest road network planning by combining Delphi and spatial multi-criteria evaluation.

PubMed

Hayati, Elyas; Majnounian, Baris; Abdi, Ehsan; Sessions, John; Makhdoum, Majid

2013-02-01

Changes in forest landscapes resulting from road construction have increased remarkably in the last few years. On the other hand, the sustainable management of forest resources can only be achieved through a well-organized road network. In order to minimize the environmental impacts of forest roads, forest road managers must design the road network efficiently and environmentally as well. Efficient planning methodologies can assist forest road managers in considering the technical, economic, and environmental factors that affect forest road planning. This paper describes a three-stage methodology using the Delphi method for selecting the important criteria, the Analytic Hierarchy Process for obtaining the relative importance of the criteria, and finally, a spatial multi-criteria evaluation in a geographic information system (GIS) environment for identifying the lowest-impact road network alternative. Results of the Delphi method revealed that ground slope, lithology, distance from stream network, distance from faults, landslide susceptibility, erosion susceptibility, geology, and soil texture are the most important criteria for forest road planning in the study area. The suitability map for road planning was then obtained by combining the fuzzy map layers of these criteria with respect to their weights. Nine road network alternatives were designed using PEGGER, an ArcView GIS extension, and finally, their values were extracted from the suitability map. Results showed that the methodology was useful for identifying road that met environmental and cost considerations. Based on this work, we suggest future work in forest road planning using multi-criteria evaluation and decision making be considered in other regions and that the road planning criteria identified in this study may be useful.

Addressing the knowledge gap in clinical recommendations for management and complete excision of clinically atypical nevi/dysplastic nevi: Pigmented Lesion Subcommittee consensus statement.

PubMed

Kim, Caroline C; Swetter, Susan M; Curiel-Lewandrowski, Clara; Grichnik, James M; Grossman, Douglas; Halpern, Allan C; Kirkwood, John M; Leachman, Sancy A; Marghoob, Ashfaq A; Ming, Michael E; Nelson, Kelly C; Veledar, Emir; Venna, Suraj S; Chen, Suephy C

2015-02-01

The management of clinically atypical nevi/dysplastic nevi (CAN/DN) is controversial, with few data to guide the process. Management recommendations for DN with positive histologic margins were developed by the Delphi method to achieve consensus among members of the Pigmented Lesion Subcommittee (PLS) of the Melanoma Prevention Working Group (MPWG) after reviewing the current evidence. To outline key issues related to the management of CAN/DN: (1) biopsies of CAN and how positive margins arise, (2) whether incompletely excised DN evolve into melanoma, (3) current data on the outcomes of DN with positive histologic margins, (4) consensus recommendations, and (5) a proposal for future studies, including a large-scale study to help guide the management of DN with positive margins. The literature, including recent studies examining management and outcomes of DN with positive margins between 2009 to 2014, was reviewed. A consensus statement by the PLS of the MPWG following review of the literature, group discussions, and a structured Delphi method consensus. This consensus statement reviews the complexities of management of CAN/DN. A review of the literature and 2 rounds of a structured Delphi consensus resulted in the following recommendations: (1) mildly and moderately DN with clear margins do not need to be reexcised, (2) mildly DN biopsied with positive histologic margins without clinical residual pigmentation may be safely observed rather than reexcised, and (3) observation may be a reasonable option for management of moderately DN with positive histologic margins without clinically apparent residual pigmentation; however, more data are needed to make definitive recommendations in this clinical scenario.

Technical Feasibility Assessment of Lunar Base Mission Scenarios

NASA Astrophysics Data System (ADS)

Magelssen, Trygve ``Spike''; Sadeh, Eligar

2005-02-01

Investigation of the literature pertaining to lunar base (LB) missions and the technologies required for LB development has revealed an information gap that hinders technical feasibility assessment. This information gap is the absence of technical readiness levels (TRL) (Mankins, 1995) and information pertaining to the criticality of the critical enabling technologies (CETs) that enable mission success. TRL is a means of identifying technical readiness stages of a technology. Criticality is defined as the level of influence the CET has on the mission scenario. The hypothesis of this research study is that technical feasibility is a function of technical readiness and technical readiness is a function of criticality. A newly developed research analysis method is used to identify the technical feasibility of LB mission scenarios. A Delphi is used to ascertain technical readiness levels and CET criticality-to-mission. The research analysis method is applied to the Delphi results to determine the technical feasibility of the LB mission scenarios that include: observatory, science research, lunar settlement, space exploration gateway, space resource utilization, and space tourism. The CETs identified encompasses four major system level technologies of: transportation, life support, structures, and power systems. Results of the technical feasibility assessment show the observatory and science research LB mission scenarios to be more technical ready out of all the scenarios, but all mission scenarios are in very close proximity to each other in regard to criticality and TRL and no one mission scenario stands out as being absolutely more technically ready than any of the other scenarios. What is significant and of value are the Delphi results concerning CET criticality-to-mission and the TRL values evidenced in the Tables that can be used by anyone assessing the technical feasibility of LB missions.

Teacher Competencies in Health Education: Results of a Delphi Study

PubMed Central

Moynihan, Sharon; Paakkari, Leena; Välimaa, Raili; Jourdan, Didier; Mannix-McNamara, Patricia

2015-01-01

Objective The aim of this research study was to identify the core competencies for health education teachers in supporting the development of health literacy among their students. Method/Results A three round Delphi method was employed. Experts in health education were asked to identify core competencies for school health educators. Twenty six participants from the academic field were invited to participate in the study. Twenty participants completed the first round of the Delphi, while eighteen took part in round two and fifteen participated in the final round. Data were collected using an electronic questionnaire. The first round contained an open ended question in which participants were asked to name and define all the competencies they perceived were important. Thematic analysis was undertaken on these data. A list of 36 competencies was created from this round. This list was then returned to the same participants and they were asked to rate each competency on a 7 point semantic differential scale in terms of importance. The resulting data were then analysed. For the final round, participants were presented with a list of 33 competencies and were asked to rank them again, in order of importance. Conclusion Twelve core competencies emerged from the analysis and these competencies comprised of a mixture of knowledge, attitude and skills. The authors suggest that how these competencies are achieved and operationalised in the school context can be quite complex and multi-faceted. While the authors do not seek to generalise from the study they suggest that these competencies are an important input for all stakeholders, in order to question national and international teacher guidelines. In addition the competencies identified may provide a useful starting point for others to undertake deeper analysis of what it means to be an effective health educator in schools. PMID:26630180

Pharmacy executive leadership issues and associated skills, knowledge, and abilities.

PubMed

Meadows, Andrew B; Maine, Lucinda L; Keyes, Elizabeth K; Pearson, Kathy; Finstuen, Kenn

2005-01-01

To identify challenges that current and future pharmacy executives are facing or will face in the future and to define what skills, knowledge, and abilities (SKAs) are required to successfully negotiate these challenges. Delphi method for executive decision making. Civilian pharmacy profession. 110 pharmacists who graduated from the GlaxoSmithKline Executive Management Program for Pharmacy Leaders. Two iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants were asked to identify five major issues they believed to be of greatest importance to pharmacy leaders in the next 5-10 years and name specific SKAs that might be needed by future leaders to successfully deal with those issues. An expert panel reviewed the issues, classified issues into specific domains, and titled each domain. Round 2-participants rated the SKAs on a 7-point scale according to their individual assessment of importance in each domain. For Delphi rounds 1 and 2, response rates were 21.8% and 18.2%, respectively. More than 100 total issue statements were identified. The expert panel sorted the issues into five domains: management and development of the pharmacy workforce, pharmacy finance, total quality management of work-flow systems, influences on the practice of pharmacy, and professional pharmacy leadership. Five of the top 15 SKAs-and all four highest ranked items--came from the professional pharmacy leadership domain, including ability to see the big picture, ability to demonstrate the value of pharmacy services, ability to lead and manage in an ethical manner, and skills for influencing an organization's senior leadership. Through successful integration of communication skills, critical thinking, and problem solving techniques, future public-sector pharmacy executives will be better equipped to effectively position their organizations and the profession for the challenges that lie ahead.

Core Outcome Domains for early phase clinical trials of sound-, psychology-, and pharmacology-based interventions to manage chronic subjective tinnitus in adults: the COMIT'ID study protocol for using a Delphi process and face-to-face meetings to establish consensus.

PubMed

Fackrell, Kathryn; Smith, Harriet; Colley, Veronica; Thacker, Brian; Horobin, Adele; Haider, Haúla F; Londero, Alain; Mazurek, Birgit; Hall, Deborah A

2017-08-23

The reporting of outcomes in clinical trials of subjective tinnitus indicates that many different tinnitus-related complaints are of interest to investigators, from perceptual attributes of the sound (e.g. loudness) to psychosocial impacts (e.g. quality of life). Even when considering one type of intervention strategy for subjective tinnitus, there is no agreement about what is critically important for deciding whether a treatment is effective. The main purpose of this observational study is, therefore to, develop Core Outcome Domain Sets for the three different intervention strategies (sound, psychological, and pharmacological) for adults with chronic subjective tinnitus that should be measured and reported in every clinical trial of these interventions. Secondary objectives are to identify the strengths and limitations of our study design for recruiting and reducing attrition of participants, and to explore uptake of the core outcomes. The 'Core Outcome Measures in Tinnitus: International Delphi' (COMIT'ID) study will use a mixed-methods approach that incorporates input from health care users at the pre-Delphi stage, a modified three-round Delphi survey and final consensus meetings (one for each intervention). The meetings will generate recommendations by stakeholder representatives on agreed Core Outcome Domain Sets specific to each intervention. A subsequent step will establish a common cross-cutting Core Outcome Domain Set by identifying the common outcome domains included in all three intervention-specific Core Outcome Domain Sets. To address the secondary objectives, we will gather feedback from participants about their experience of taking part in the Delphi process. We aspire to conduct an observational cohort study to evaluate uptake of the core outcomes in published studies at 7 years following Core Outcome Set publication. The COMIT'ID study aims to develop a Core Outcome Domain Set that is agreed as critically important for deciding whether a treatment for subjective tinnitus is effective. Such a recommendation would help to standardise future clinical trials worldwide and so we will determine if participation increases use of the Core Outcome Set in the long term. This project has been registered (November 2014) in the database of the Core Outcome Measures in Effectiveness Trials (COMET) initiative.

Suicide first aid guidelines for Sri Lanka: a Delphi consensus study.

PubMed

De Silva, Saranga A; Colucci, Erminia; Mendis, Jayan; Kelly, Claire M; Jorm, Anthony F; Minas, Harry

2016-01-01

Sri Lanka has one of the highest suicide rates in the world. Gatekeeper programs aimed at specific target groups could be a promising suicide prevention strategy in the country. The aim of this study was to develop guidelines that help members of the public to provide first aid to persons in Sri Lanka who are at risk of suicide. The Delphi method was used to elicit consensus on potential helping statements to include in the guidelines. These statements describe information members of the public should have and actions they can take to help a person who is experiencing suicidal thoughts. An expert panel, comprised of mental health and suicide experts in Sri Lanka, rated each statement. The panellists were encouraged to suggest any additional action that was not included in the original questionnaire and, in particular, to include items that were culturally appropriate or gender specific. Responses to open-ended questions were used to generate new items. These items were included in the subsequent Delphi rounds. Three Delphi rounds were carried out. Statements were accepted for inclusion in the guidelines if they were endorsed (rated as essential or important) by at least 80 % of the panel. Statements endorsed by 70-79 % of the panel were re-rated in the following round. Statements with less than 70 % endorsement, or re-rated items that did not receive 80 % or higher endorsement were rejected. The output from the Delphi process was a set of endorsed statements. In the first round questionnaire 473 statements were presented to the panel and 58 new items were generated from responses to the open-ended questions. Of the total 531 statements presented, 304 were endorsed. These statements were used to develop the suicide first aid guidelines for Sri Lanka. By engaging Sri Lankans who are experts in the field of mental health or suicide this research developed culturally appropriate guidelines for providing mental health first aid to a person at risk of suicide in Sri Lanka. The guidelines may serve as a basis for developing training for members of the public to provide mental health first aid to persons at risk of suicide as part of Sri Lanka's suicide prevention strategy.

Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi consensus approach.

PubMed

Wakai, Abel; O'Sullivan, Ronan; Staunton, Paul; Walsh, Cathal; Hickey, Fergal; Plunkett, Patrick K

2013-04-01

The objective of this study was to develop a consensus among emergency medicine (EM) specialists working in Ireland for emergency department (ED) key performance indicators (KPIs). The method employed was a three-round electronic modified-Delphi process. An online questionnaire with 54 potential KPIs was set up for round 1 of the Delphi process. The Delphi panel consisted of all registered EM specialists in Ireland. Each indicator on the questionnaire was rated using a five-point Likert-type rating scale. Agreement was defined as at least 70% of the responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using standard descriptive statistics. Data were also analysed as the mean of the Likert rating with 95% confidence intervals (95% CIs). Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Statistical analyses were carried out using SPSS version 16.0. The response rates in rounds 1, 2 and 3 were 86, 88 and 88%, respectively. Ninety-seven potential indicators reached agreement after the three rounds. In the context of the Donabedian structure-process-outcome framework of performance indicators, 41 (42%) of the agreed indicators were structure indicators, 52 (54%) were process indicators and four (4%) were outcome indicators. Overall, the top-three highest rated indicators were: presence of a dedicated ED clinical information system (4.7; 95% CI 4.6-4.9), ED compliance with minimum design standards (4.7; 95% CI 4.5-4.8) and time from ED arrival to first ECG in suspected cardiac chest pain (4.7; 95% CI 4.5-4.9). The top-three highest rated indicators specific to clinical care of children in EDs were: time to administration of antibiotics in children with suspected bacterial meningitis (4.6; 95% CI 4.5-4.8), separate area available within EDs (seeing both adults and children) to assess children (4.4; 95% CI 4.2-4.6) and time to administration of analgesia in children with forearm fractures (4.4; 95% CI 4.2-4.7). Employing a Delphi consensus process, it was possible to reach a consensus among EM specialists in Ireland on a suite of 97 KPIs for EDs.

Derivation of a Performance Checklist for Ultrasound-Guided Arthrocentesis Using the Modified Delphi Method.

PubMed

Kunz, Derek; Pariyadath, Manoj; Wittler, Mary; Askew, Kim; Manthey, David; Hartman, Nicholas

2017-06-01

Arthrocentesis is an important skill for physicians in multiple specialties. Recent studies indicate a superior safety and performance profile for this procedure using ultrasound guidance for needle placement, and improving quality of care requires a valid measurement of competency using this modality. We endeavored to create a validated tool to assess the performance of this procedure using the modified Delphi technique and experts in multiple disciplines across the United States. We derived a 22-item checklist designed to assess competency for the completion of ultrasound-guided arthrocentesis, which demonstrated a Cronbach's alpha of 0.89, indicating an excellent degree of internal consistency. Although we were able to demonstrate content validity for this tool, further validity evidence should be acquired after the tool is used and studied in clinical and simulated contexts. © 2017 by the American Institute of Ultrasound in Medicine.

Determining and prioritizing competencies in the undergraduate internal medicine curriculum in Saudi Arabia.

PubMed

Almoallim, H

2011-08-01

To determine knowledge and skills competencies in internal medicine for the undergraduate curriculum in Saudi Arabia, competencies were identified based on group work utilizing common textbooks. The Delphi Technique was used as a consensus method to determine and prioritize competencies in internal medicine. A group of 20 clinicians rated the identified competencies from 0-3 (0: no need to know, 1: interesting to know, 2: should know and 3: must know). After formulating the results, a second Delphi round was conducted with 5 experts in internal medicine. A total of 1513 knowledge competencies and 189 skills competencies were determined and prioritized. The competencies corresponded to the 12 systems in internal medicine. All competencies rated 2.2-3.0 were produced separately and considered core competencies for the undergraduate internal medicine curriculum. Determining and prioritizing competencies should influence the curriculum reform process.

Identifying the critical financial ratios for stocks evaluation: A fuzzy delphi approach

NASA Astrophysics Data System (ADS)

Mokhtar, Mazura; Shuib, Adibah; Mohamad, Daud

2014-12-01

Stocks evaluation has always been an interesting and challenging problem for both researchers and practitioners. Generally, the evaluation can be made based on a set of financial ratios. Nevertheless, there are a variety of financial ratios that can be considered and if all ratios in the set are placed into the evaluation process, data collection would be more difficult and time consuming. Thus, the objective of this paper is to identify the most important financial ratios upon which to focus in order to evaluate the stock's performance. For this purpose, a survey was carried out using an approach which is based on an expert judgement, namely the Fuzzy Delphi Method (FDM). The results of this study indicated that return on equity, return on assets, net profit margin, operating profit margin, earnings per share and debt to equity are the most important ratios.

A core outcome set for evaluating self-management interventions in people with comorbid diabetes and severe mental illness: study protocol for a modified Delphi study and systematic review.

PubMed

Taylor, Johanna; Böhnke, Jan R; Wright, Judy; Kellar, Ian; Alderson, Sarah L; Hughes, Tom; Holt, Richard I G; Siddiqi, Najma

2017-02-14

People with diabetes and comorbid severe mental illness (SMI) form a growing population at risk of increased mortality and morbidity compared to those with diabetes or SMI alone. There is increasing interest in interventions that target diabetes in SMI in order to help to improve physical health and reduce the associated health inequalities. However, there is a lack of consensus about which outcomes are important for this comorbid population, with trials differing in their focus on physical and mental health. A core outcome set, which includes outcomes across both conditions that are relevant to patients and other key stakeholders, is needed. This study protocol describes methods to develop a core outcome set for use in effectiveness trials of self-management interventions for adults with comorbid type-2 diabetes and SMI. We will use a modified Delphi method to identify, rank, and agree core outcomes. This will comprise a two-round online survey and multistakeholder workshops involving patients and carers, health and social care professionals, health care commissioners, and other experts (e.g. academic researchers and third sector organisations). We will also select appropriate measurement tools for each outcome in the proposed core set and identify gaps in measures, where these exist. The proposed core outcome set will provide clear guidance about what outcomes should be measured, as a minimum, in trials of interventions for people with coexisting type-2 diabetes and SMI, and improve future synthesis of trial evidence in this area. We will also explore the challenges of using online Delphi methods for this hard-to-reach population, and examine differences in opinion about which outcomes matter to diverse stakeholder groups. COMET registration: http://www.comet-initiative.org/studies/details/911 . Registered on 1 July 2016.

Proposal of quality indicators for cardiac rehabilitation after acute coronary syndrome in Japan: a modified Delphi method and practice test.

PubMed

Ohtera, Shosuke; Kanazawa, Natsuko; Ozasa, Neiko; Ueshima, Kenji; Nakayama, Takeo

2017-01-27

Cardiac rehabilitation is underused and its quality in practice is unclear. A quality indicator is a measurable element of clinical practice performance. This study aimed to propose a set of quality indicators for cardiac rehabilitation following an acute coronary event in the Japanese population and conduct a small-size practice test to confirm feasibility and applicability of the indicators in real-world clinical practice. This study used a modified Delphi technique (the RAND/UCLA appropriateness method), a consensus method which involves an evidence review, a face-to-face multidisciplinary panel meeting and repeated anonymous rating. Evidence to be reviewed included clinical practice guidelines available in English or Japanese and existing quality indicators. Performance of each indicator was assessed retrospectively using medical records at a university hospital in Japan. 10 professionals in cardiac rehabilitation for the consensus panel. In the literature review, 23 clinical practice guidelines and 16 existing indicators were identified to generate potential indicators. Through the consensus-building process, a total of 30 indicators were assessed and finally 13 indicators were accepted. The practice test (n=39) revealed that 74% of patients underwent cardiac rehabilitation. Median performance of process measures was 93% (IQR 46-100%). 'Communication with the doctor who referred the patient to cardiac rehabilitation' and 'continuous participation in cardiac rehabilitation' had low performance (32% and 38%, respectively). A modified Delphi technique identified a comprehensive set of quality indicators for cardiac rehabilitation. The single-site, small-size practice test confirmed that most of the proposed indicators were measurable in real-world clinical practice. However, some clinical processes which are not covered by national health insurance in Japan had low performance. Further studies will be needed to clarify and improve the quality of care in cardiac rehabilitation. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Cardiovascular–renal axis disorders in the domestic dog and cat: a veterinary consensus statement

PubMed Central

Pouchelon, J L; Atkins, C E; Bussadori, C; Oyama, M A; Vaden, S L; Bonagura, J D; Chetboul, V; Cowgill, L D; Elliot, J; Francey, T; Grauer, G F; Luis Fuentes, V; Sydney Moise, N; Polzin, D J; Van Dongen, A M; Van Israël, N

2015-01-01

OBJECTIVES There is a growing understanding of the complexity of interplay between renal and cardiovascular systems in both health and disease. The medical profession has adopted the term “cardiorenal syndrome” (CRS) to describe the pathophysiological relationship between the kidney and heart in disease. CRS has yet to be formally defined and described by the veterinary profession and its existence and importance in dogs and cats warrant investigation. The CRS Consensus Group, comprising nine veterinary cardiologists and seven nephrologists from Europe and North America, sought to achieve consensus around the definition, pathophysiology, diagnosis and management of dogs and cats with “cardiovascular-renal disorders” (CvRD). To this end, the Delphi formal methodology for defining/building consensus and defining guidelines was utilised. METHODS Following a literature review, 13 candidate statements regarding CvRD in dogs and cats were tested for consensus, using a modified Delphi method. As a new area of interest, well-designed studies, specific to CRS/CvRD, are lacking, particularly in dogs and cats. Hence, while scientific justification of all the recommendations was sought and used when available, recommendations were largely reliant on theory, expert opinion, small clinical studies and extrapolation from data derived from other species. RESULTS Of the 13 statements, 11 achieved consensus and 2 did not. The modified Delphi approach worked well to achieve consensus in an objective manner and to develop initial guidelines for CvRD. DISCUSSION The resultant manuscript describes consensus statements for the definition, classification, diagnosis and management strategies for veterinary patients with CvRD, with an emphasis on the pathological interplay between the two organ systems. By formulating consensus statements regarding CvRD in veterinary medicine, the authors hope to stimulate interest in and advancement of the understanding and management of CvRD in dogs and cats. The use of a formalised method for consensus and guideline development should be considered for other topics in veterinary medicine. PMID:26331869

Modified Policy-Delphi study for exploring obesity prevention priorities

PubMed Central

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-01-01

Introduction Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of ‘intrusiveness’ has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. Methods and analysis The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethics and dissemination Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. PMID:27601495

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research.

PubMed

Staniszewska, S; Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. One hundred forty-three participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites.

Frontline over ivory tower: key competencies in community-based curricula.

PubMed

Millar, Adam; Malcolm, Janine; Cheng, Alice; Fine, Rebecca; Wong, Rene

2015-01-01

The Royal College of Physicians and Surgeons of Canada mandates that community experiences be incorporated into medicine-based specialties. Presently there is wide variability in community endocrine experiences across Canadian training programs. This is complicated by the paucity of literature providing guidance on what constitutes a 'community' rotation. A modified Delphi technique was used to determine the CanMEDS competencies best taught in a community endocrinology curriculum. The Delphi technique is a qualitative-research method that uses a series of questionnaires sent to a group of experts with controlled feedback provided by the researchers after each survey round. The experts in this study included endocrinology program directors, community endocrinologists, endocrinology residents and recent endocrinology graduates. Thirty four out of 44 competencies rated by the panel were deemed suitable for a community curriculum. The experts considered the "Manager" role best taught in the community, while they considered the community least suitable to learn the "Medical Expert" competency. To our knowledge, this is the first time the content of a community-based subspecialty curriculum was determined using the Delphi process in Canada. These findings suggest that community settings have potential to fill in gaps in residency training in regards to the CanMEDS Manager role. The results will aid program directors in designing competency-based community endocrinology rotations and competency-based community rotations in other medical subspecialty programs.

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study

PubMed Central

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-01-01

Objectives To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. Methods A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. Results In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Conclusions Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. PMID:24670554

A Comprehensive List of Items to be Included on a Pediatric Drug Monograph

PubMed Central

Ito, Shinya; Woods, David; Nunn, Anthony J.; Taketomo, Carol; de Hoog, Matthijs; Offringa, Martin

2017-01-01

OBJECTIVES Children require special considerations for drug prescribing. Drug information summarized in a formulary containing drug monographs is essential for safe and effective prescribing. Currently, little is known about the information needs of those who prescribe and administer medicines to children. Our primary objective was to identify a list of important and relevant items to be included in a pediatric drug monograph. METHODS Following the establishment of an expert steering committee and an environmental scan of adult and pediatric formulary monograph items, 46 participants from 25 countries were invited to complete a 2-round Delphi survey. Questions regarding source of prescribing information and importance of items were recorded. An international consensus meeting to vote on and finalize the items list with the steering committee followed. RESULTS Pediatric formularies are most commonly the first resource consulted for information on medication used in children by 31 Delphi participants. After the Delphi rounds, 116 items were identified to be included in a comprehensive pediatric drug monograph, including general information, adverse drug reactions, dosages, precautions, drug-drug interactions, formulation, and drug properties. CONCLUSIONS Health care providers identified 116 monograph items as important for prescribing medicines for children by an international consensus-based process. This information will assist in setting standards for the creation of new pediatric drug monographs for international application and for those involved in pediatric formulary development. PMID:28337081

[Episodic breathlessness: translation and consenting of the international definition using the Delphi method].

PubMed

Simon, S T; Weingärtner, V; Voltz, R; Bausewein, C

2014-10-01

Similar to pain, refractory breathlessness can occur episodically. Episodic Breathlessness is a distressing symptom in patients with advanced life-limiting disease. The lack of a universal definition impedes symptom understanding in clinical practice and effective management, respectively. The aim of the study was to formally consent a German translation of the English definition and terminology of episodic breathlessness. A web-based Delphi survey was conducted with German breathlessness experts (breathlessness working group of Germany's National Guideline (S3) for Palliative Care). Drafts of German-language definitions und terminology were assessed using structured questionnaires by binary rating or rankings, respectively. Optional comments were analysed by content analysis. Consensus was defined by ≥ 70% agreement among participants. In two resulting Delphi-rounds 8/16 (50%) und 11/16 (69%) experts, 30-59 years of age, 50%/55% female, participated. After the second round, consensus was reached for the symptom's description "Atemnotattacke" (73%) and a German-language definition (90%). The terms "vorhersehbar" vs. "unvorhersehbar" were directly consented for the categorization (88%). The formally consented German definition and terminology of episodic breathlessness enable clearer symptom understanding and provide a precise basis for education and research on the symptom and its management also in Germany. Effective management options are warranted to improve quality of life of suffering patients and their relatives. © Georg Thieme Verlag KG Stuttgart · New York.

An international delphi survey for the definition of the variables for the development of new classification criteria for periodic fever aphtous stomatitis pharingitis cervical adenitis (PFAPA).

PubMed

Vanoni, Federica; Federici, Silvia; Antón, Jordi; Barron, Karyl S; Brogan, Paul; De Benedetti, Fabrizio; Dedeoglu, Fatma; Demirkaya, Erkan; Hentgen, Veronique; Kallinich, Tilmann; Laxer, Ronald; Russo, Ricardo; Toplak, Natasa; Uziel, Yosef; Martini, Alberto; Ruperto, Nicolino; Gattorno, Marco; Hofer, Michael

2018-04-18

Diagnosis of Periodic fever, aphthous stomatitis, pharyngitis and cervical adenitis (PFAPA) is currently based on a set of criteria proposed in 1999 modified from Marshall's criteria. Nevertheless no validated evidence based set of classification criteria for PFAPA has been established so far. The aim of this study was to identify candidate classification criteria PFAPA syndrome using international consensus formation through a Delphi questionnaire survey. A first open-ended questionnaire was sent to adult and pediatric clinicians/researchers, asking to identify the variables thought most likely to be helpful and relevant for the diagnosis of PFAPA. In a second survey, respondents were asked to select, from the list of variables coming from the first survey, the 10 features that they felt were most important, and to rank them in descending order from most important to least important. The response rate to the first and second Delphi was respectively 109/124 (88%) and 141/162 (87%). The number of participants that completed the first and second Delphi was 69/124 (56%) and 110/162 (68%). From the first Delphi we obtained a list of 92 variables, of which 62 were selected in the second Delphi. Variables reaching the top five position of the rank were regular periodicity, aphthous stomatitis, response to corticosteroids, cervical adenitis, and well-being between flares. Our process led to identification of features that were felt to be the most important as candidate classification criteria for PFAPA by a large sample of international rheumatologists. The performance of these items will be tested further in the next phase of the study, through analysis of real patient data.

BCQ+: a body constitution questionnaire to assess Yang-Xu. Part I: establishment of a first final version through a Delphi process.

PubMed

Su, Yi-Chang; Chen, Li-Li; Lin, Jun-Dai; Lin, Jui-Shan; Huang, Yi-Chia; Lai, Jim-Shoung

2008-12-01

Assessing an individual's level of Yang deficiency (Yang-Xu) by its manifestations is a frequent issue in traditional Chinese medicine (TCM) clinical trials. To this end, an objective, reliable and rigorous diagnostic tool is required. This study aimed to develop a first final version of the Yang-Xu Constitution Questionnaire. We conducted 3 steps to develop such an objective measurement tool: 1) the research team was formed and a panel of 26 experts was selected for the Delphi process; 2) items for the questionnaire were generated by literature review and a Delphi process; items were reworded into colloquial questions; face and content validity of the items were evaluated through a Delphi process again; 3) the difficulty of the questionnaire was evaluated in a pilot study with 81 subjects aged 20-60 years. The literature review retrieved 35 relevant items which matched the definition of 'constitution' and 'Yang-Xu'. After a first Delphi process, 22 items were retained and translated into colloquial questions. According to the second part of the Delphi process, the content validity index of each of the 22 questions ranged between 0.85-1. These 22 questions were evaluated by 81 subjects, 2 questions that were hard to tell the difference were combined; 3 questions were modified after the research team had discussed the participants' feedback. Finally, the questionnaire was established with 21 questions. This first final version of a questionnaire to assess Yang-Xu constitution with considerable face and content validity may serve as a basis to develop an advanced Yang-Xu questionnaire. 2008 S. Karger AG, Basel.

Quality of care for cancer patients on home parenteral nutrition: development of key interventions and outcome indicators using a two-round Delphi approach.

PubMed

Dreesen, Mira; Foulon, Veerle; Hiele, Martin; Vanhaecht, Kris; De Pourcq, Lutgart; Pironi, Loris; Van Gossum, André; Arends, Jann; Cuerda, Cristina; Thul, Paul; Bozzetti, Frederico; Willems, Ludo

2013-05-01

Clear recommendations on how to guide patients with cancer on home parenteral nutrition (HPN) are lacking as the use of HPN in this population remains a controversial issue. Therefore, the aims of this study were to rank treatment recommendations and main outcome indicators to ensure high-quality care and to indicate differences in care concerning benign versus malignant patients. Treatment recommendations, identified from published guidelines, were used as a starting point for a two-round Delphi approach. Comments and additional interventions proposed in the first round were reevaluated in the second round. Ordinal logistic regression with SPSS 2.0 was used to identify differences in care concerning benign versus malignant patients. Twenty-seven experts from five European countries completed two Delphi rounds. After the second Delphi round, the top three most important outcome indicators were (1) quality of life (QoL), (2) incidence of hospital readmission and (3) incidence of catheter-related infections. Forty-two interventions were considered as important for quality of care (28/42 based on published guidelines; 14/42 newly suggested by Delphi panel). The topics 'Liver disease' and 'Metabolic bone disease' were considered less important for cancer patients, together with use of infusion pumps (p = 0.004) and monitoring of vitamins and trace elements (p = 0.000). Monitoring of QoL is considered more important for cancer patients (p = 0.03). Using a two-round Delphi approach, we developed a minimal set of 42 interventions that may be used to determine quality of care in HPN patients with malignancies. This set of interventions differs from a similar set developed for benign patients.

Development of the Korean framework for senior-friendly hospitals: a Delphi study.

PubMed

Kim, Yoon-Sook; Han, Seol-Heui; Hwang, Jeong-Hae; Park, Jae-Min; Lee, Jongmin; Choi, Jaekyung; Moon, Yeonsil; Kim, Hee Joung; Shin, Grace Jung Eun; Lee, Ji-Sun; Choi, Ye Ji; Uhm, Kyeong Eun; Kim, In Ae; Nam, Ji-Won

2017-08-04

Aging is an inevitable part of life. One can maintain well-being and wellness even after discharge and/or transition if his or her functional decline is minimized, sudden decline is prevented, and functioning is promoted during hospitalization. Caring appropriately for elderly patients requires the systematic application of Senior-Friendly Hospital principles to all operating systems, including medical centres' organization and environment, as well as patient treatment processes. The Senior-Friendly Hospital framework is valid and important for patient safety and quality improvement. This study aimed to make recommendations regarding the development of the Korean Framework for Senior-Friendly Hospitals for older patients' care management, patient safety interventions, and health promotion, via a Delphi survey. Two rounds of Delphi surveying were conducted with 15 participants who had at least 3 years' experience in accreditation surveying and medical accreditation standards, survey methods, and accreditation investigator education. In each round, we calculated statistics describing each standard's validity and feasibility. The Korean Framework for Senior-Friendly Hospitals included 4 Chapters, 11 categories, and 67 standards through consensus of the Senior-Friendly Hospitals task force and experts' peer review. After the two rounds of Delphi surveying, validity evaluation led to no changes in standards of the Senior-Friendly Hospitals; however, the number of standards showing adequate validity decreased from 67 to 58. Regarding feasibility, no changes were necessary in the standards; however, the number of categories showing adequate feasibility decreased from 11 to 8 and from 67 to 30, respectively. The excluded categories were 3.2, 4.2, and 4.3 (service, transportation, and signage and identification). The highest feasibility values were given to standards 2.1.1, 4.1.4, and 4.1.6. The highest feasibility score was given to standard 2.4.2. The Korean Framework for Senior-Friendly Hospitals needs to include 4 Chapters, 8 categories, and 30 standards. The Accreditation Program for Healthcare Organizations should include Senior-Friendly Hospitals -relevant standards considering Korea's medical environment.

Defining a set of standardised outcome measures for newly diagnosed patients with multiple myeloma using the Delphi consensus method: the IMPORTA project.

PubMed

Blade, Joan; Calleja, Miguel Ángel; Lahuerta, Juan José; Poveda, José Luis; de Paz, Héctor David; Lizán, Luis

2018-02-22

To define a standard set of outcomes and the most appropriate instruments to measure them for managing newly diagnosed patients with multiple myeloma (MM). A literature review and five discussion groups facilitated the design of two-round Delphi questionnaire. Delphi panellists (haematologists, hospital pharmacists and patients) were identified by the scientific committee, the Spanish Program of Haematology Treatments Foundation, the Spanish Society of Hospital Pharmacies and the Spanish Community of Patients with MM. Panellist's perception about outcomes' suitability and feasibility of use was assessed on a seven-point Likert scale. Consensus was reached when at least 75% of the respondents reached agreement or disagreement. A scientific committee led the project. Fifty-one and 45 panellists participated in the first and second Delphi rounds, respectively. Consensus was reached to use overall survival, progression-free survival, minimal residual disease and treatment response to assess survival and disease control. Panellists agreed to measure health-related quality of life, pain, performance status, fatigue, psychosocial status, symptoms, self-perception on body image, sexuality and preferences/satisfaction. However, panellist did not reach consensus about the feasibility of assessing in routine practice psychosocial status, symptoms, self-perception on body image and sexuality. Consensus was reached to collect patient-reported outcomes through the European Organisation for the Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire (QLQ) Core questionnaire 30 (C30), three items from EORTC-QLQ-Multiple Myeloma (MY20) and EORTC-QLQ-Breast Cancer (BR23), pain Visual Analogue Scale, Morisky-Green and ad hoc questions about patients' preferences/satisfaction. A consensual standard set of outcomes for managing newly diagnosed patients with MM has been defined. The feasibility of its implementation in routine practice will be assessed in a future pilot study. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Management of problematic behaviours among individuals on long-term opioid therapy: protocol for a Delphi study

PubMed Central

Merlin, Jessica S; Young, Sarah R; Azari, Soraya; Becker, William C; Liebschutz, Jane M; Pomeranz, Jamie; Roy, Payel; Saini, Shalini; Starrels, Joanna L; Edelman, E Jennifer

2016-01-01

Introduction Given the sharp rise in opioid prescribing and heightened recognition of opioid addiction and overdose, opioid safety has become a priority. Clinical guidelines on long-term opioid therapy (LTOT) for chronic pain consistently recommend routine monitoring and screening for problematic behaviours. Yet, there is no consensus definition regarding what constitutes a problematic behaviour, and recommendations for appropriate management to inform front-line providers, researchers and policymakers are lacking. This creates a barrier to effective guideline implementation. Thus, our objective is to present the protocol for a Delphi study designed to: (1) elicit expert opinion to identify the most important problematic behaviours seen in clinical practice and (2) develop consensus on how these behaviours should be managed in the context of routine clinical care. Methods/analysis We will include clinical experts, defined as individuals who provide direct patient care to adults with chronic pain who are on LTOT in an ambulatory setting, and for whom opioid prescribing for chronic non-malignant pain is an area of expertise. The Delphi study will be conducted online in 4 consecutive rounds. Participants will be asked to list problematic behaviours and identify which behaviours are most common and challenging. They will then describe how they would manage the most frequently occurring common and challenging behaviours, rating the importance of each management strategy. Qualitative analysis will be used to categorise behaviours and management strategies, and consensus will be based on a definition established a priori. Ethics/dissemination This study has been approved by the Institutional Review Board (IRB) of the University of Alabama at Birmingham (UAB). This study will generate Delphi-based expert consensus on the management of problematic behaviours that arise in individuals on LTOT, which we will publish and disseminate to appropriate professional societies. Ultimately, our findings will provide guidance to front-line providers, researchers and policymakers. PMID:27154486

PIM-Check: development of an international prescription-screening checklist designed by a Delphi method for internal medicine patients.

PubMed

Desnoyer, Aude; Blanc, Anne-Laure; Pourcher, Valérie; Besson, Marie; Fonzo-Christe, Caroline; Desmeules, Jules; Perrier, Arnaud; Bonnabry, Pascal; Samer, Caroline; Guignard, Bertrand

2017-07-31

Potentially inappropriate medication (PIM) occurs frequently and is a well-known risk factor for adverse drug events, but its incidence is underestimated in internal medicine. The objective of this study was to develop an electronic prescription-screening checklist to assist residents and young healthcare professionals in PIM detection. Five-step study involving selection of medical domains, literature review and 17 semistructured interviews, a two-round Delphi survey, a forward/back-translation process and an electronic tool development. 22 University and general hospitals from Canada, Belgium, France and Switzerland. 40 physicians and 25 clinical pharmacists were involved in the study.Agreement with the checklist statements and their usefulness for healthcare professional training were evaluated using two 6-point Likert scales (ranging from 0 to 5). Agreement and usefulness ratings were defined as: >65% of the experts giving the statement a rating of 4 or 5, during the first Delphi-round and >75% during the second. 166 statements were generated during the first two steps. Mean agreement and usefulness ratings were 4.32/5 (95% CI 4.28 to 4.36) and 4.11/5 (4.07 to 4.15), respectively, during the first Delphi-round and 4.53/5 (4.51 to 4.56) and 4.36/5 (4.33 to 4.39) during the second (p<0.001). The final checklist includes 160 statements in 17 medical domains and 56 pathologies. An algorithm of approximately 31 000 lines was developed including comorbidities and medications variables to create the electronic tool. PIM-Check is the first electronic prescription-screening checklist designed to detect PIM in internal medicine. It is intended to help young healthcare professionals in their clinical practice to detect PIM, to reduce medication errors and to improve patient safety. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

PIM-Check: development of an international prescription-screening checklist designed by a Delphi method for internal medicine patients

PubMed Central

Desnoyer, Aude; Blanc, Anne-Laure; Pourcher, Valérie; Besson, Marie; Fonzo-Christe, Caroline; Desmeules, Jules; Perrier, Arnaud; Bonnabry, Pascal; Samer, Caroline; Guignard, Bertrand

2017-01-01

Objectives Potentially inappropriate medication (PIM) occurs frequently and is a well-known risk factor for adverse drug events, but its incidence is underestimated in internal medicine. The objective of this study was to develop an electronic prescription-screening checklist to assist residents and young healthcare professionals in PIM detection. Design Five-step study involving selection of medical domains, literature review and 17 semistructured interviews, a two-round Delphi survey, a forward/back-translation process and an electronic tool development. Setting 22 University and general hospitals from Canada, Belgium, France and Switzerland. Participants 40 physicians and 25 clinical pharmacists were involved in the study. Agreement with the checklist statements and their usefulness for healthcare professional training were evaluated using two 6-point Likert scales (ranging from 0 to 5). Primary and secondary outcome measures Agreement and usefulness ratings were defined as: >65% of the experts giving the statement a rating of 4 or 5, during the first Delphi-round and >75% during the second. Results 166 statements were generated during the first two steps. Mean agreement and usefulness ratings were 4.32/5 (95% CI 4.28 to 4.36) and 4.11/5 (4.07 to 4.15), respectively, during the first Delphi-round and 4.53/5 (4.51 to 4.56) and 4.36/5 (4.33 to 4.39) during the second (p<0.001). The final checklist includes 160 statements in 17 medical domains and 56 pathologies. An algorithm of approximately 31 000 lines was developed including comorbidities and medications variables to create the electronic tool. Conclusion PIM-Check is the first electronic prescription-screening checklist designed to detect PIM in internal medicine. It is intended to help young healthcare professionals in their clinical practice to detect PIM, to reduce medication errors and to improve patient safety. PMID:28760793

International and Interdisciplinary Identification of Health Care Transition Outcomes.

PubMed

Fair, Cynthia; Cuttance, Jessica; Sharma, Niraj; Maslow, Gary; Wiener, Lori; Betz, Cecily; Porter, Jerlym; McLaughlin, Suzanne; Gilleland-Marchak, Jordan; Renwick, Amy; Naranjo, Diana; Jan, Sophia; Javalkar, Karina; Ferris, Maria

2016-03-01

There is a lack of agreement on what constitutes successful outcomes for the process of health care transition (HCT) among adolescent and young adults with special health care needs. To present HCT outcomes identified by a Delphi process with an interdisciplinary group of participants. A Delphi method involving 3 stages was deployed to refine a list of HCT outcomes. This 18-month study (from January 5, 2013, of stage 1 to July 3, 2014, of stage 3) included an initial literature search, expert interviews, and then 2 waves of a web-based survey. On this survey, 93 participants from outpatient, community-based, and primary care clinics rated the importance of the top HCT outcomes identified by the Delphi process. Analyses were performed from July 5, 2014, to December 5, 2014. Health care transition outcomes of adolescents and young adults with special health care needs. Importance ratings of identified HCT outcomes rated on a Likert scale from 1 (not important) to 9 (very important). The 2 waves of surveys included 117 and 93 participants as the list of outcomes was refined. Transition outcomes were refined by the 3 waves of the Delphi process, with quality of life being the highest-rated outcome with broad agreement. The 10 final outcomes identified included individual outcomes (quality of life, understanding the characteristics of conditions and complications, knowledge of medication, self-management, adherence to medication, and understanding health insurance), health services outcomes (attending medical appointments, having a medical home, and avoidance of unnecessary hospitalization), and a social outcome (having a social network). Participants indicated that different outcomes were likely needed for individuals with cognitive disabilities. Quality of life is an important construct relevant to HCT. Future research should identify valid measures associated with each outcome and further explore the role that quality of life plays in the HCT process. Achieving consensus is a critical step toward the development of reliable and objective comparisons of HCT outcomes across clinical conditions and care delivery locations.

A consensus-based framework for design, validation, and implementation of simulation-based training curricula in surgery.

PubMed

Zevin, Boris; Levy, Jeffrey S; Satava, Richard M; Grantcharov, Teodor P

2012-10-01

Simulation-based training can improve technical and nontechnical skills in surgery. To date, there is no consensus on the principles for design, validation, and implementation of a simulation-based surgical training curriculum. The aim of this study was to define such principles and formulate them into an interoperable framework using international expert consensus based on the Delphi method. Literature was reviewed, 4 international experts were queried, and consensus conference of national and international members of surgical societies was held to identify the items for the Delphi survey. Forty-five international experts in surgical education were invited to complete the online survey by ranking each item on a Likert scale from 1 to 5. Consensus was predefined as Cronbach's α ≥0.80. Items that 80% of experts ranked as ≥4 were included in the final framework. Twenty-four international experts with training in general surgery (n = 11), orthopaedic surgery (n = 2), obstetrics and gynecology (n = 3), urology (n = 1), plastic surgery (n = 1), pediatric surgery (n = 1), otolaryngology (n = 1), vascular surgery (n = 1), military (n = 1), and doctorate-level educators (n = 2) completed the iterative online Delphi survey. Consensus among participants was achieved after one round of the survey (Cronbach's α = 0.91). The final framework included predevelopment analysis; cognitive, psychomotor, and team-based training; curriculum validation evaluation and improvement; and maintenance of training. The Delphi methodology allowed for determination of international expert consensus on the principles for design, validation, and implementation of a simulation-based surgical training curriculum. These principles were formulated into a framework that can be used internationally across surgical specialties as a step-by-step guide for the development and validation of future simulation-based training curricula. Copyright © 2012 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas

PubMed Central

Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-01-01

Introduction The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. Methods and analysis We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. Ethics and dissemination We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. PMID:28780546

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol

PubMed Central

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-01-01

Introduction Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues—including conceptualisation, measurement and data analysis—that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. Methods and analysis This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. Ethics and dissemination An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. PMID:28188154

The main indicators for Iranian hospital ethical accreditation

PubMed Central

ENJOO, SEYED ALI; AMINI, MITRA; TABEI, SEYED ZIAADIN; MAHBUDI, ALI; KAVOSI, ZAHRA; SABER, MAHBOOBEH

2015-01-01

Introduction The application of organizational ethics in hospitals is one of the novel ways to improve medical ethics. Nowadays achieving efficient and sufficient ethical hospital indicators seems to be inevitable. In this connection, the present study aims to determine the best indicators in hospital accreditation. Methods 69 indicators in 11 fields to evaluate hospital ethics were achieved through a five-step qualitative and quantitative study including literature review, expert focus group, Likert scale survey, 3 rounded Delphi, and content validity measurement. Expert focus group meeting was conducted, employing Nominal Group Technique (NGT). After running NGT, a three rounded Delphi and parallel to Delphi and a Likert scale survey were performed to obtain objective indicators for each domain. The experts were all healthcare professionals who were also medical ethics researchers, teachers, or PhD students. Content validity measurements were computed, using the viewpoints of two different expert groups, some ethicists, and some health care professionals (n=46). Results After conducting NGT, Delphi, Likert survey, 11 main domains were listed including:  Informed consent, Medical confidentiality, Physician-patient economic relations, Ethics consultation policy in the hospital, Ethical charter of hospital, Breaking bad medical news protocol, Respect for the patients’ rights, Clinical ethics committee, Spiritual and palliative care unit programs in the hospitals, Healthcare professionals’ communication skills, and Equitable access to the healthcare. Also 71 objective indicators for these 11 domains were listed in 11 tables with 5 to 8 indicators per table. Content Validity Ratio (CVR) measurements were done and 69 indicators were highlighted. Conclusion The domains listed in this study seem to be the most important ones for evaluating hospital ethics programs and services. Healthcare organizations’ accreditation and ranking are crucial for the improvement of healthcare services. Ethics programs would also motivate hospitals to improve their services and move towards patients’ satisfaction. In this regard, more involvement of bioethicists can help healthcare organizations to develop ethics programs and ensure ethics-based practice in hospitals. PMID:26269789

A DELPHI STUDY OF RISK FACTORS FOR ACHILLES TENDINOPATHY- OPINIONS OF WORLD TENDON EXPERTS

PubMed Central

Watson, Paul J.; Barry, Simon

2016-01-01

Background and Purpose Achilles tendinopathy can be a debilitating chronic condition for both active and inactive individuals. The identification of risk facors is important both in preventing but also treating tendinopathy, many factors have been proposed but there is a lack of primary epidemiological data. The purpose of this study was to develop a statement of expert consensus on risk factors for Achilles tendinopathy in active and sedentary patient populations to inform a primary epidemiological study. Study design Delphi study Methods and Measures An online Delphi study was completed inviting participation from world tendon experts. The consensus was developed using three rounds of the Delphi technique. The first round developed a complete list of potential risk factors, the second round refined this list but also separated the factors into two population groups – active/athletic and inactive/sedentary. The third round ranked this list in order of perceived importance. Results Forty-four experts were invited to participate, 16 participated in the first round (response rate 40%) and two dropped out in the second round (resulting in a response rate of 35%). A total of 27 intrinsic and eight extrinsic risk factors were identified during round one. During round two only 12 intrinsic and five extrinsic risk factors were identified as important in active/athletic tendinopathy while 14 intrinsic and three extrinsic factors were identified as important for inactive/sedentary tendinopathy. Conclusions Risk factors for Achilles tendinopathy were identified based on expert consensus, and these factors provide a basis for primary epidemiological studies. Plantarflexor strength was identified as the primary modifiable factor in the active/athletic group while systemic factors were identified as important in the inactive/sedentary group, many of the potential factors suggested for either group were non-modifiable. Non-modifiable factors include: previous tendinopathy, previous injury, advancing age, sex, steroid exposure, and antibiotic treatment. Level of evidence Level V PMID:27757281

75 FR 41521 - Delphi Corporation, Automotive Holding Group, Instrument Cluster Plant, Currently Known as...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-16

..., Automotive Holding Group, Instrument Cluster Plant, Currently Known as General Motors Corporation, Including... Corporation, Automotive Holding Group, Instrument Cluster Plant, including on-site leased workers from... Material Management working on-site at Delphi Corporation, Automotive Holding Group, Instrument Cluster...

14 CFR Special Federal Aviation... - Rules for use of portable oxygen concentrator systems on board aircraft

Code of Federal Regulations, 2011 CFR

2011-01-01

... Concentrator: means the AirSep FreeStyle, AirSep LifeStyle, Delphi RS-00400, DeVilbiss Healthcare iGo, Inogen... LifeStyle, Delphi RS-00400, DeVilbiss Healthcare iGo, Inogen One, Inogen One G2, International...

14 CFR Special Federal Aviation... - Rules for use of portable oxygen concentrator systems on board aircraft

Code of Federal Regulations, 2012 CFR

2012-01-01

... Concentrator: means the AirSep FreeStyle, AirSep LifeStyle, Delphi RS-00400, DeVilbiss Healthcare iGo, Inogen... LifeStyle, Delphi RS-00400, DeVilbiss Healthcare iGo, Inogen One, Inogen One G2, International...

The impact of the internet on community pharmacy practice: a comparison of a Delphi panel's forecast with emerging trends.

PubMed

Holmes, Erin R; Tipton, David J; Desselle, Shane P

2002-01-01

The purpose of this study was to forecast the impact of Internet pharmacy commerce on various stakeholders. A panel of experts assembled from a list of academicians in the social and administrative pharmaceutical sciences participated in a three-iteration Delphi procedure. Feedback from the aggregate responses of the panel was used to construct questionnaires employed in subsequent iterations of the Delphi. The panel converged to form a consensus upon a variety of issues. They forecasted the attainment of a 10-15% share in the market of prescription and over-the-counter pharmaceuticals through on-line purchases, the formation of strategic alliances among stakeholders in the drug distribution process, a shift in marketing strategies by brick-and-mortar stores, an increase in the prevalence of niching among pharmacy service providers and a subsequent growth in the implementation of cognitive services throughout the industry. With few exceptions, the forecast produced by the Delphi panel appears to be coming to fruition.

Using Delphi technique in a consensual curriculum for periodontics.

PubMed

Fried, Hana; Leao, Anna Thereza

2007-11-01

Periodontics has experienced several important conceptual changes in the last few decades. As such, it is important to have a periodontics curriculum built upon the expertise of specialists in that discipline and reflecting those changes. The main goal of this study was to attain a consensus, through the use of the Delphi technique, on the topics that should be included in a periodontics curriculum for undergraduate dental students. A sample of periodontics lecturers from nine dental schools in two Brazilian cities was used, and a Delphi technique approach was followed to investigate sample member perceptions on the subject. Participants received four postal mail questionnaires asking them to rate and rerate eighty-nine topics for possible inclusion in the curriculum. A descriptive analysis was conducted, and topic frequencies were calculated. Topics rated as highly important for inclusion were the following: health, ailment, prevention, etiology, epidemiology, diagnosis, and treatment. The Delphi technique approach proved successful in involving periodontics lecturers in the design of a periodontics curriculum for undergraduate dental students.

Medication administration errors from a nursing viewpoint: a formal consensus of definition and scenarios using a Delphi technique.

PubMed

Shawahna, Ramzi; Masri, Dina; Al-Gharabeh, Rawan; Deek, Rawan; Al-Thayba, Lama; Halaweh, Masa

2016-02-01

To develop and achieve formal consensus on a definition of medication administration errors and scenarios that should or should not be considered as medication administration errors in hospitalised patient settings. Medication administration errors occur frequently in hospitalised patient settings. Currently, there is no formal consensus on a definition of medication administration errors or scenarios that should or should not be considered as medication administration errors. This was a descriptive study using Delphi technique. A panel of experts (n = 50) recruited from major hospitals, nursing schools and universities in Palestine took part in the study. Three Delphi rounds were followed to achieve consensus on a proposed definition of medication administration errors and a series of 61 scenarios representing potential medication administration error situations formulated into a questionnaire. In the first Delphi round, key contact nurses' views on medication administration errors were explored. In the second Delphi round, consensus was achieved to accept the proposed definition of medication administration errors and to include 36 (59%) scenarios and exclude 1 (1·6%) as medication administration errors. In the third Delphi round, consensus was achieved to consider further 14 (23%) and exclude 2 (3·3%) as medication administration errors while the remaining eight (13·1%) were considered equivocal. Of the 61 scenarios included in the Delphi process, experts decided to include 50 scenarios as medication administration errors, exclude three scenarios and include or exclude eight scenarios depending on the individual clinical situation. Consensus on a definition and scenarios representing medication administration errors can be achieved using formal consensus techniques. Researchers should be aware that using different definitions of medication administration errors, inclusion or exclusion of medication administration error situations could significantly affect the rate of medication administration errors reported in their studies. Consensual definitions and medication administration error situations can be used in future epidemiology studies investigating medication administration errors in hospitalised patient settings which may permit and promote direct comparisons of different studies. © 2015 John Wiley & Sons Ltd.

Development and pilot testing of an informed consent video for patients with limb trauma prior to debridement surgery using a modified Delphi technique.

PubMed

Lin, Yen-Ko; Chen, Chao-Wen; Lee, Wei-Che; Lin, Tsung-Ying; Kuo, Liang-Chi; Lin, Chia-Ju; Shi, Leiyu; Tien, Yin-Chun; Cheng, Yuan-Chia

2017-11-29

Ensuring adequate informed consent for surgery in a trauma setting is challenging. We developed and pilot tested an educational video containing information regarding the informed consent process for surgery in trauma patients and a knowledge measure instrument and evaluated whether the audiovisual presentation improved the patients' knowledge regarding their procedure and aftercare and their satisfaction with the informed consent process. A modified Delphi technique in which a panel of experts participated in successive rounds of shared scoring of items to forecast outcomes was applied to reach a consensus among the experts. The resulting consensus was used to develop the video content and questions for measuring the understanding of the informed consent for debridement surgery in limb trauma patients. The expert panel included experienced patients. The participants in this pilot study were enrolled as a convenience sample of adult trauma patients scheduled to receive surgery. The modified Delphi technique comprised three rounds over a 4-month period. The items given higher scores by the experts in several categories were chosen for the subsequent rounds until consensus was reached. The experts reached a consensus on each item after the three-round process. The final knowledge measure comprising 10 questions was developed and validated. Thirty eligible trauma patients presenting to the Emergency Department (ED) were approached and completed the questionnaires in this pilot study. The participants exhibited significantly higher mean knowledge and satisfaction scores after watching the educational video than before watching the video. Our process is promising for developing procedure-specific informed consent and audiovisual aids in medical and surgical specialties. The educational video was developed using a scientific method that integrated the opinions of different stakeholders, particularly patients. This video is a useful tool for improving the knowledge and satisfaction of trauma patients in the ED. The modified Delphi technique is an effective method for collecting experts' opinions and reaching a consensus on the content of educational materials for informed consent. Institutions should prioritize patient-centered health care and develop a structured informed consent process to improve the quality of care. The ClinicalTrials.gov Identifier is NCT01338480 . The date of registration was April 18, 2011 (retrospectively registered).

The Modified Delphi Method to Analyze the Application of Instructional Design Theory to Online Graduate Education

ERIC Educational Resources Information Center

Zeedick, Danielle Marie

2010-01-01

During the past several decades, the field of instructional design theory has experienced changes in what is mostly applied to traditional, on-ground education. While instructional design theory has been (and still is being) discussed, constructed, and deconstructed, there has been no agreement among prominent instructional design theory…

School Reform and the School Counselor: Restructuring for the 21st Century.

ERIC Educational Resources Information Center

Stickel, Sue A.

This study is designed to gauge the impact that school reform and restructuring is having on the functions of school counselors. It explores how school counselors will work as the new century begins, and projects how changes in roles and responsibilities may impact school counselor training programs. The Delphi research method was used to forecast…

Assessing College Student-Athletes' Life Stress: Initial Measurement Development and Validation

ERIC Educational Resources Information Center

Lu, Frank Jing-Horng; Hsu, Ya-Wen; Chan, Yuan-Shuo; Cheen, Jang-Rong; Kao, Kuei-Tsu

2012-01-01

College student-athletes have unique life stress that warrants close attention. The purpose of this study was to develop a reliable and valid measurement assessing college student-athletes' life stress. In Study 1, a focus group discussion and Delphi method produced a questionnaire draft, termed the College Student-Athletes' Life Stress Scale. In…

Services in the Community for Adults with Psychosis and Intellectual Disabilities: A Delphi Consultation of Professionals' Views

ERIC Educational Resources Information Center

Hemmings, C. P.; Underwood, L. A.; Bouras, N.

2009-01-01

Background: There remains a severe lack of evidence on the effectiveness of community services for adults with psychosis and intellectual disabilities (ID). There has been little consensus even of what services should provide for this service user group. Method: A consultation of multidisciplinary professionals was carried out by using a…

Forecasting Doctoral-Level Content in Agricultural Education: Viewpoints of Engaged Scholars in the United States

ERIC Educational Resources Information Center

Shinn, Glen C.; Briers, Gary; Baker, Matt

2008-01-01

In this study, the researchers used a classical Delphi method to re-examine the conceptual framework, definition, and knowledge base of the field. Seventeen engaged scholars, each representing the expert agricultural education community, reached consensus on defining the field of study, 10 knowledge domains, and 67 knowledge objects. The Delphi…

D-Move: A Mobile Communication Based Delphi for Digital Natives to Support Embedded Research

ERIC Educational Resources Information Center

Petrovic, Otto

2017-01-01

Digital Natives are raised with computers and the Internet, which are a familiar part of their daily life. To gain insights into their attitude and behavior, methods and media for empirical research face new challenges like gamification, context oriented embedded research, integration of multiple data sources, and the increased importance of…

Development of an Effective School-Based Financial Management Profile in Malaysia: The Delphi Method Application

ERIC Educational Resources Information Center

Radzi, Norfariza Mohd; Ghani, Muhammad Faizal A.; Siraj, Saedah

2015-01-01

The agenda for national development requires a persistent improvement in education as a tool for creating knowledgeable human capital, highly skilled labour, a high technology society and ultimately a highly civilized nation for the future challenging world. It requires considerable financial and technical investment as well as effective and…

Vital Business Educators' Perceptions about the Usefulness of Business Education Periodicals: Making the Relevant Literature More Accessible

ERIC Educational Resources Information Center

Scott, James Calvert; Blaszczynski, Carol; Green, Diana J.; Fagerheim, Britt Anna

2008-01-01

Problem: The business education literature isn't accessible. Research Questions: Which business education periodicals do vital business educators perceive to be more useful? In which databases and/or indices are they found? How much literature is fugitive? What strategies might increase literature accessibility? Research Method: Delphi technique.…

The Delphi Method: Gathering Expert Opinion in Religious Education

ERIC Educational Resources Information Center

Baumfield, Vivienne M.; Conroy, James C.; Davis, Robert A.; Lundie, David C.

2012-01-01

The "Does Religious Education work?" project is part of the Religion and Society programme funded by two major research councils in the UK. It sets out to track the trajectory of Religious Education (RE) in secondary schools in the UK from the aims and intentions represented in policy through its enactment in classroom practice to the…

Forecasting Educational Futures. Resolving Uncertainties and Disagreements through Compact Policy Assessment.

ERIC Educational Resources Information Center

Hudson, Barclay M.

Descriptions of models for policy analysis in future studies are presented. Separate sections of the paper focus on the need for appropriate technologies of social science in future studies, a description of "compact policy assessment" (CPA), and a comparison of two CPA methods, Compass and Delphi. Compact policy assessment refers to any low-cost,…

Characterizing the sustainable forestry issue network in thc United States

Treesearch

Steverson O. Moffat; Frederick W. Cubbage; Thomas P. Holmes; Elizabethann O' Sullivan

2001-01-01

Issue network analysis techniques were applied to the issue sustainable forestry in the United States to identify potential public and private outcomes for the issue. A quantitative approach based on work by Laumann and Knoke [(The Organizational State (1987)] was utilized in conjunction with the Delphi method. Results suggest that the parity in the distribution of...

Action Researchers' Perspectives about the Distinguishing Characteristics of Action Research: A Delphi and Learning Circles Mixed-Methods Study

ERIC Educational Resources Information Center

Rowell, Lonnie L.; Polush, Elena Yu; Riel, Margaret; Bruewer, Aaron

2015-01-01

The purpose of this study was to identify distinguishing characteristics of action research within the Action Research Special Interest Group of the American Educational Research Association. The authors sought to delineate the foundational framework endorsed by this community. The study was conducted during January-April 2012 and employed an…

Research Priorities for Mental Health Counseling with Youth: Implications for Counselor Preparation, Professional Development, and Research

ERIC Educational Resources Information Center

Mellin, Elizabeth A.; Pertuit, Terry L.

2009-01-01

Counselors encounter the needs of youth (3-17 years) in a variety of settings; however, outside of school counseling, the profession faces a lack of preparation, professional development, and research focused on mental health practice with youth. Using the Delphi method, 12 counselor educators and 15 practicing counselors were polled regarding…

The Delphi: Education and Assessment in Institutional Goal Setting.

ERIC Educational Resources Information Center

Fazio, Linda S.

1985-01-01

The use of delphi techniques in a school of osteopathic medicine is described to assess and change faculty perceptions of institutional goals and needs such as curriculum orientation, campus design and location, faculty personnel policy, teaching and instructional evaluation, student characteristics and admission policies, and administrative…

Identifying Critical Issues and Problems in Technology Education Using a Modified-Delphi Technique.

ERIC Educational Resources Information Center

Wicklein, Robert C.

1993-01-01

Critical issues for technology education (TE) identified by a 25-member Delphi panel were identification of the knowledge base, curriculum development approaches, interdisciplinary approaches, and teacher education reform. Problems identified included inadequate marketing/public relations, teacher shortage, lack of content consensus, and…

Health Professionals' Perceptions of Sexual Assault Management: A Delphi Study

ERIC Educational Resources Information Center

Jancey, Jonine; Meuleners, Lynn; Phillips, Maureen

2011-01-01

Objective: To explore health professionals' perceptions of sexual assault management practices and identify issues related to these practices across Western Australia (WA). Design: A two-round electronic Delphi study was undertaken with health professionals (medical doctors, registered nurses, social workers and managers). Setting: Healthcare…

Legislative priorities for transportation safety in Virginia : a pilot application of a modified delphi technique : final report.

DOT National Transportation Integrated Search

1985-01-01

Using a modified version of the Delphi technique, a panel of transportation safety experts developed the following list of legislative priorities for submission to the Department of Motor Vehicles (DMV) Legislative Package for the 1986 session of the...

Development Of A Solid Oxide Fuel Cell Stack By Delphi And Battelle

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mukerjee, Subhasish; Shaffer, Steven J.; Zizelman, James

2003-01-20

Delphi and Battelle are developing a Solid Oxide Fuel Cell (SOFC) stack for transportation and residential applications. This paper describes the status of development of the Generation 2 stack and key progress made in addressing some of the challenges in this technology.

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research

PubMed Central

Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

Background While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. Objective To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. Methods The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. Results 143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. Conclusions GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites. PMID:28768629

A comparison of three methods for estimating the requirements for medical specialists: the case of otolaryngologists.

PubMed Central

Anderson, G F; Han, K C; Miller, R H; Johns, M E

1997-01-01

OBJECTIVE: To compare three methods of computing the national requirements for otolaryngologists in 1994 and 2010. DATA SOURCES: Three large HMOs, a Delphi panel, the Bureau of Health Professions (BHPr), and published sources. STUDY DESIGN: Three established methods of computing requirements for otolaryngologists were compared: managed care, demand-utilization, and adjusted needs assessment. Under the managed care model, a published method based on reviewing staffing patterns in HMOs was modified to estimate the number of otolaryngologists. We obtained from BHPr estimates of work force projections from their demand model. To estimate the adjusted needs model, we convened a Delphi panel of otolaryngologists using the methodology developed by the Graduate Medical Education National Advisory Committee (GMENAC). DATA COLLECTION/EXTRACTION METHODS: Not applicable. PRINCIPAL FINDINGS: Wide variation in the estimated number of otolaryngologists required occurred across the three methods. Within each model it was possible to alter the requirements for otolaryngologists significantly by changing one or more of the key assumptions. The managed care model has a potential to obtain the most reliable estimates because it reflects actual staffing patterns in institutions that are attempting to use physicians efficiently. CONCLUSIONS: Estimates of work force requirements can vary considerably if one or more assumptions are changed. In order for the managed care approach to be useful for actual decision making concerning the appropriate number of otolaryngologists required, additional research on the methodology used to extrapolate the results to the general population is necessary. PMID:9180613

A delphi study on health in future India.

PubMed

Rohatgi, K; Rohatgi, P K

1980-07-01

A delphi study was conducted to identify or envision health scenarios in India by the year 2000. Questionnaires consisting of 48 questions on 5 areas (diagnosis and therapy; family planning; pharmaceuticals and drugs; biochemical and biomedical research; health services) were mailed to 250 experts in India. 36 responded. Results were compiled and mailed back to the respondents for changes and comments. 17 people responded. Results of the delphi study shows that policy decisions with respect to compulsory family planning as well as health education at secondary school level will precede further breakthroughs in birth control technology. Non operation reversible sterilization procedures, immunological birth control, Ayurvedic medicines for contraception and abortion, and selection of baby's sex are all possible by 2000 thereafter. Complete eradication of infectious diseases, malnutrition and associated diseases is considered unlikely before 2000, as are advances in biomedical research. Changes in health services (e.g., significant increases in hospital beds and doctors, cheap bulk drugs), particularly in rural areas, are imminent, leading to prolonging of life expectancy to 70 years. Genetic engineering may provide significant breakthroughs in the prevention of malignancies and cardiac disorders. The India delphi study is patterned after a similar delphi study conducted in the U.S. by Smith, Kline and French (SKF) Laboratories in 1968. The SKF study was able to predict some breakthroughs with basic research which have been realized.

[Delphi study to identify the management skills of nursing executives].

PubMed

Yañez, M R; Avila, J A; Bermudez, M I; De Miguel, I; Bellver, V; Guilabert, M; Mira, J J

2016-01-01

To determine and update the skills map for the position of Nurse Administrator in hospitals and Primary Care. An observational, descriptive, cross-sectional study based on a Delphi technique was conducted in hospital and Primary Care settings. Two nominal groups with 15 nurses each were used to define the contents of the questionnaire 0 in the Delphi technique. All nurses registered in the professional associations of Alicante, Castellón and Valencia were invited to participate. The results of the Delphi study was submitted to factor analysis to identify the set of skills and, subsequently, compare them with the offer of post-graduate course in colleges and universities during the 2014-15 academic year. Forty-five competences were extracted during the Nominal groups. In total, 705 nurses replied to the first wave in the Delphi Technique, and 394 in the second (response rate of 56%). Factorial analysis grouped the skills chosen into 10 factors: managing people, conflict management, independent learning, ethics, emotional balance, commitment, self-discipline, continuous improvement, critical-thinking, and innovation. Four skills groups identified in this study (emotional balancing, commitment, self-discipline and courage) were not usually included in the post-graduate courses The nurse administrator skills should be related to relational and ethical behaviour. The training offer of the post-graduate courses must be reoriented. Copyright © 2015 SECA. Published by Elsevier Espana. All rights reserved.

The transculturality of 'gut feelings'. Results from a French Delphi consensus survey.

PubMed

Le Reste, Jean-Yves; Coppens, Magali; Barais, Marie; Nabbe, Patrice; Le Floch, Bernard; Chiron, Benoît; Dinant, Geert Jan; Berkhout, Christophe; Stolper, Erik; Barraine, Pierre

2013-12-01

General Practitioners (GPs) sometimes base their clinical decisions on 'gut feelings.' Research into the significance of this phenomenon with focus groups and a Delphi consensus procedure in the Netherlands provided a concept of 'gut feelings:' a sense of alarm, a sense of reassurance and several determinants. The transculturality of 'gut feelings' has been examined briefly until now as the issue is complex. To determine whether a consensus on 'gut feelings' in general practice in France could be obtained. Using a similar Delphi consensus procedure and the same six initial statements as in the Netherlands, and compare the French results with the seven final Dutch consensual statements. Qualitative research, including a Delphi consensus procedure after a forward-backward translation (FBT) of the initial Dutch statements of 'gut feelings.' A heterogeneous sample of 34 French expert GPs participated. FBT of the final French statements was undertaken for a content comparison with the Dutch. After three Delphi rounds, French GPs reached agreement on nine statements. Many similarities have been found between the Dutch and the French defining statements, with reservations concerning the 'sense of reassurance,' which French GPs seemed to feel more cautious about. 'Gut feelings' are a well-defined concept in France too. The Dutch and the French consensual statements seem very close. The transculturality of the concept is confirmed, which is a new indicator that 'gut feelings' are a self-contained concept.

Defining the Medical Library Association research agenda: methodology and final results from a consensus process

PubMed Central

Eldredge, Jonathan D.; Harris, Martha R.; Ascher, Marie T.

2009-01-01

Objective: Using a group consensus methodology, the research sought to generate a list of the twelve to fifteen most important and answerable research questions in health sciences librarianship as part of a broader effort to implement the new Medical Library Association (MLA) research policy. Methods: The delphi method was used. The committee distributed a brief survey to all estimated 827 MLA leaders and 237 MLA Research Section members, requesting they submit what they considered to be the most important and answerable research questions facing the profession. The submitted questions were then subjected to 2 rounds of voting to produce a short list of top-ranked questions. Results: The survey produced 62 questions from 54 MLA leaders and MLA Research Section members, who responded from an estimated potential population of 1,064 targeted colleagues. These questions were considered by the process participants to be the most important and answerable research questions facing the profession. Through 2 rounds of voting, these 62 questions were reduced to the final 12 highest priority questions. Conclusion: The modified delphi method accomplished its desired survey and consensus goals. Future survey and consensus processes will be revised to generate more initial questions and to distill a larger number of ranked prioritized research questions. PMID:19626143

Electronic-Imen-Delphi (EID): An Online Conferencing Procedure.

ERIC Educational Resources Information Center

Passig, David; Sharbat, Aviva

2000-01-01

Examines the efficiency of the Imen-Delphi (ID) technique as an electronic procedure for conferencing that helps participants clarify their opinions and expectations regarding preferable and possible futures. Describes an electronic version of the original ID procedure and tested its efficiency among a group of experts on virtual reality and…

A Delphi Survey on Citizenship Education in Asean Countries: Findings for Brunei

ERIC Educational Resources Information Center

Salleh, Hajah Sallimah Haji Mohammed; Laxman, Kumar; Jawawi, Rosmawijah

2015-01-01

The aim of the Delphi Survey was to elucidate Bruneian Education experts' responses to five questions regarding their knowledge and understanding of the charateristics of citizenship education viz. Environment, Coexistence, Culture, Social Justice and Equity, Democracy, Sustainable Development, Interdependence, Foreign Language, Social Welfare,…

Delphi Research Methodology Applied to Place-Based Watershed Education

ERIC Educational Resources Information Center

Vallor, Rosanna R.; Yates, Kimberly A.; Brody, Michael

2016-01-01

This research focuses on the results of the Flathead Watershed Delphi survey, a consensus-building methodology used to establish foundational knowledge, skills and dispositions for the Flathead Watershed Educators Guide, a place-based watershed curriculum for middle school grades based on the Flathead Watershed Sourcebook. Survey participants (n =…

Factors Influencing Continuing Professional Development: A Delphi Study among Nursing Experts

ERIC Educational Resources Information Center

Brekelmans, Gerard; Poell, Rob F.; van Wijk, Kees

2013-01-01

Purpose: The aim of this paper is to present an inventory of expert opinions on the factors that influence the participation of registered nurses in continuing professional development (CPD) activities. Design/methodology/approach: A Delphi study was conducted among 38 Dutch experts (nursing employers, managers, education institutions, and…

Competencies for Leaders of Volunteers During the Next Decade: A National Delphi Study.

ERIC Educational Resources Information Center

Boyd, Barry L.

Using the Delphi technique, a nationwide panel of experts identified 33 competencies that volunteer administrators (VAs) will need during the next decade and categorized them into these five constructs: organizational leadership; systems leadership; organizational culture; personal skills; and management skills. Twelve barriers to acquiring the…

Updating the School Counseling Research Agenda: A Delphi Study

ERIC Educational Resources Information Center

Villares, Elizabeth; Dimmitt, Carey

2017-01-01

The authors updated an earlier Delphi study identifying the research priorities for school counseling (Dimmitt et al., 2005). A 29-member expert panel selected research questions from the prior study, generated new questions, and rank ordered the combined set. The results provide guidance for prioritizing dissertation topics, targeting future…

A Delphi Study of Agriculture Teacher Perceptions of Problems in Student Retention.

ERIC Educational Resources Information Center

Dyer, James E.; Breja, Lisa M.; Ball, Anna L.

2003-01-01

A four-round Delphi study of secondary agriculture teachers (17, 17, 22, and 21 responses) identified and rated student retention problems. Consensus was reached on these items: scheduling difficulties, lack of counselor support, image, increased graduation requirements, college entrance requirements, competition from other activities, block…

78 FR 48467 - Delphi Automotive Systems, LLC, Products and Service Solutions Division, Including On-Site Leased...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-08

... amending this certification to include all workers of Delphi Automotive Systems, LLC, Product and Service..., LLC, Products and Service Solutions Division, Including On-Site Leased Workers From Bartech Workforce Management, Kokomo, Indiana; Amended Certification Regarding Eligibility To Apply for Worker Adjustment...

Co-Creating Nano-Imaginaries: Report of a Delphi-Exercise

ERIC Educational Resources Information Center

Deblonde, Marian; Van Oudheusden, Michiel; Evers, Johan; Goorden, Lieve

2008-01-01

In the first phase of the research project Nanotechnologies for Tomorrow's Society (www.nanosoc.be), the research consortium explored a variety of futuristic visions or technoscientific imaginaries. This exploration took the form of a Policy Delphi, adapted to the particular objective of jointly constructing nano-imaginaries, taking participants'…

Cross platform development using Delphi and Kylix

DOE Office of Scientific and Technical Information (OSTI.GOV)

McDonald, J.L.; Nishimura, H.; Timossi, C.

2002-10-08

A cross platform component for EPICS Simple Channel Access (SCA) has been developed for the use with Delphi on Windows and Kylix on Linux. An EPICS controls GUI application developed on Windows runs on Linux by simply rebuilding it, and vice versa. This paper describes the technical details of the component.

Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel

PubMed Central

Boulkedid, Rym; Sibony, Olivier; Goffinet, François; Fauconnier, Arnaud; Branger, Bernard; Alberti, Corinne

2013-01-01

Objective Measuring the quality of inpatient obstetrical care using quality indicators is becoming increasingly important for both patients and healthcare providers. However, there is no consensus about which measures are optimal. We describe a modified Delphi method to identify a set of indicators for continuously monitoring the quality of maternity care by healthcare professionals. Methodology and Main Findings An international French-speaking multidisciplinary panel comprising 22 obstetricians-gynaecologists, 12 midwives, and 1 paediatrician assessed potential indicators extracted from a medical literature search, using a two-round Delphi procedure followed by a physical meeting. Each panellist rated each indicator based on validity and feasibility. In the first round, 35 panellists from 5 countries and 20 maternity units evaluated 26 indicators including 15 related to the management of the overall population of pregnant women, 3 to the management of women followed from the first trimester of pregnancy, 2 to the management of low-risk pregnant women, and 6 to the management of neonates. 25 quality indicators were kept for next step. In the second round, 27 (27/35: 77%) panellists selected 17 indicators; the remaining 8 indicators were discussed during a physical meeting. The final set comprised 18 indicators. Conclusion A multidisciplinary panel selected indicators that reflect the quality of obstetrical care. This set of indicators could be used to assess and monitor obstetrical care, with the goal of improving the quality of care in maternity units. PMID:23577143

Feasibility of depopulation of a large feedlot during a foot-and-mouth disease outbreak.

PubMed

McReynolds, Sara W; Sanderson, Michael W

2014-02-01

To examine the feasibility of depopulation of a large feedlot during a foot-and-mouth disease (FMD) outbreak in the United States. Delphi survey followed by facilitated discussion. 27 experts, including veterinary toxicologists and pharmacologists, animal welfare experts, feedlot managers, and consulting veterinarians. 4 veterinary pharmacologists, 5 veterinary toxicologists, 4 animal welfare experts, 26 consulting veterinarians, and 8 feedlot managers were invited to participate in a Delphi survey to identify methods for depopulation of a large feedlot during an FMD outbreak. A facilitated discussion that included 1 pharmacologist, 1 toxicologist, 1 animal welfare expert, 2 consulting veterinarians, and 2 feedlot managers was held to review the survey results. 27 of 47 invited experts participated in the Delphi survey. Survey consensus was that, although several toxic agents would effectively cause acute death in a large number of animals, all of them had substantial animal welfare concerns. Pentobarbital sodium administered IV was considered the most effective pharmacological agent for euthanasia, and xylazine was considered the most effective sedative. Animal welfare concerns following administration of a euthanasia solution IV or a penetrating captive bolt were minimal; however, both veterinarians and feedlot managers felt that use of a captive bolt would be inefficient for depopulation. Veterinarians were extremely concerned about public perception, human safety, and timely depopulation of a large feedlot during an FMD outbreak. Depopulation of a large feedlot during an FMD outbreak would be difficult to complete in a humane and timely fashion.

STEM integration in middle school career and technical education programs: A Delphi design study

NASA Astrophysics Data System (ADS)

Wu-Rorrer, Billy Ray

The purpose of this qualitative method study with a Delphi research design sought to determine how STEM programs can be effectively integrated into middle school career and technical education programs by local, state, and national educators, administrators, directors, specialists, and curriculum writers. The significance of the study is to provide leaders in CTE with a greater awareness, insight, and strategies about how CTE programs can more effectively integrate academics into career and technical education programs through STEM-related programming. The findings will increase the limited amount of available literature providing best practice strategies for the integration of STEM curriculum into middle school CTE programs. One basic question has guided this research: How can STEM programs be effectively integrated into middle school career and technical education programs? A total of twelve strategies were identified. The strategies of real-world applications and administrative buy-in were the two predominant strategies consistently addressed throughout the review of literature and all three sub-questions in the research study. The Delphi design study consisted of pilot round and three rounds of data collection on barriers, strategies, and professional development for STEM integration in middle school career and technical education programs. Four panelists participated in the pilot round, and 16 panel members not involved in the pilot round participated in the three rounds of questioning and consensus building. In the future, more comprehensive studies can build upon this foundational investigation of middle school CTE programs.

International, Expert-Based, Consensus Statement Regarding the Management of Acute Diverticulitis.

PubMed

O'Leary, D Peter; Lynch, Noel; Clancy, Cillian; Winter, Desmond C; Myers, Eddie

2015-09-01

This Delphi study provides consensus related to many aspects of acute diverticulitis and identifies other areas in need of research. To generate an international, expert-based, consensus statement to address controversies in the management of acute diverticulitis. This study was conducted using the Delphi technique from April 3 through October 21, 2014. A survey website was used and a panel of acute diverticulitis experts was formed via the snowball method. The top 5 acute diverticulitis experts in 5 international geographic regions were identified based on their number of publications related to acute diverticulitis. The Delphi study used 3 rounds of questions, after which the consensus statement was collated. A consensus statement related to the management of acute diverticulitis. Twenty items were selected for inclusion in the consensus statement following 3 rounds of questioning. A clear definition of uncomplicated and complicated diverticulitis is provided. In uncomplicated diverticulitis, consensus was reached regarding appropriate laboratory and radiological evaluation of patients as well as nonsurgical, surgical, and follow-up strategies. A number of important topics, including antibiotic treatment, failed to reach consensus. In addition, consensus was reached regarding many nonsurgical and surgical treatment strategies in complicated diverticulitis. Controversy continues internationally regarding the management of acute diverticulitis. This study demonstrates that there is more nonconsensus among experts than consensus regarding most issues, even in the same region. It also provides insight into the status quo regarding the treatment of acute diverticulitis and provides important direction for future research.

Constructing the Indicators of Assessing Human Vulnerability to Industrial Chemical Accidents: A Consensus-based Fuzzy Delphi and Fuzzy AHP Approach.

PubMed

Fatemi, Farin; Ardalan, Ali; Aguirre, Benigno; Mansouri, Nabiollah; Mohammadfam, Iraj

2017-04-10

Industrial chemical accidents have been increased in developing countries. Assessing the human vulnerability in the residents of industrial areas is necessary for reducing the injuries and causalities of chemical hazards. The aim of this study was to explore the key indicators for the assessment of human vulnerability in the residents living near chemical installations. The indicators were established in the present study based on the Fuzzy Delphi method (FDM) and Fuzzy Analytic Hierarchy Process (FAHP). The reliability of FDM and FAHP was calculated. The indicators of human vulnerability were explored in two sets of social and physical domains. Thirty-five relevant experts participated in this study during March-July 2015. According to experts, the top three indicators of human vulnerability according to the FDM and FAHP were vulnerable groups, population density, and awareness. Detailed sub-vulnerable groups and awareness were developed based on age, chronic or severe diseases, disability, first responders, and residents, respectively. Each indicator and sub-indicator was weighted and ranked and had an acceptable consistency ratio. The importance of social vulnerability indicators are about 7 times more than physical vulnerability indicators. Among the extracted indicators, vulnerable groups had the highest weight and the greatest impact on human vulnerability. however, further research is needed to investigate the applicability of established indicators and generalizability of the results to other studies. Fuzzy Delphi; Fuzzy AHP; Human vulnerability; Chemical hazards.

Strategies to promote better research on oral health in Africa: A Delphi consensus study

PubMed Central

Kanoute, Aïda; Faye, Daouda; Bourgeois, Denis

2014-01-01

Background: Research on oral health contributes to improved health outcomes; it is an indispensable tool in health policy. But how to fill the gaps in research oral health and to strengthen its capacity is the question. The main objective of the present study is to identify the current status of oral health research and potential strategies, thereby strengthening the research infrastructure and capacity. Delphi consultation, in the perspective of assisting decision-makers to identify strategies to promote better research on oral health in Africa, was initiated. Design and Methods: The panels of 30 experts were asked to complete the questionnaire with 42 items into four groups by web survey. Each indicator statement was considered to be in consensus if the expert's opinion rating was of “A or B” for more than 75% in a scale of seven categories. Quantitative analysis was made from the answers of Delphi round. Results: There was a strong consensus about three items concerning the role of oral health research, the development of research policy for oral health going through an effective governance of research institutes, migration of researchers and fund raising. Conclusion: This study shows strong many dispersal opinions by experts, but highlights the need for to improve the effectiveness of oral health research capacity strengthening activities. Africa's researchers, policy makers and partners will have to give special attention to ensuring that knowledge generated from oral health research is acted on to improve health for all. PMID:24808689

Using a Delphi Technique to Seek Consensus Regarding Definitions, Descriptions and Classification of Terms Related to Implicit and Explicit Forms of Motor Learning

PubMed Central

Kleynen, Melanie; Braun, Susy M.; Bleijlevens, Michel H.; Lexis, Monique A.; Rasquin, Sascha M.; Halfens, Jos; Wilson, Mark R.; Beurskens, Anna J.; Masters, Rich S. W.

2014-01-01

Background Motor learning is central to domains such as sports and rehabilitation; however, often terminologies are insufficiently uniform to allow effective sharing of experience or translation of knowledge. A study using a Delphi technique was conducted to ascertain level of agreement between experts from different motor learning domains (i.e., therapists, coaches, researchers) with respect to definitions and descriptions of a fundamental conceptual distinction within motor learning, namely implicit and explicit motor learning. Methods A Delphi technique was embedded in multiple rounds of a survey designed to collect and aggregate informed opinions of 49 international respondents with expertise related to motor learning. The survey was administered via an online survey program and accompanied by feedback after each round. Consensus was considered to be reached if ≥70% of the experts agreed on a topic. Results Consensus was reached with respect to definitions of implicit and explicit motor learning, and seven common primary intervention strategies were identified in the context of implicit and explicit motor learning. Consensus was not reached with respect to whether the strategies promote implicit or explicit forms of learning. Discussion The definitions and descriptions agreed upon may aid translation and transfer of knowledge between domains in the field of motor learning. Empirical and clinical research is required to confirm the accuracy of the definitions and to explore the feasibility of the strategies that were identified in research, everyday practice and education. PMID:24968228

Skyline Wide Educational Plan (SWEP) Product Evaluation Report: Educational Goals for the Future (1980's). SWEP Evaluation Report No. 2.

ERIC Educational Resources Information Center

Burns, Robert J.

The major purpose of this evaluation report is to scrutinize the Skyline Wide Educational Plan (SWEP) research methods and analytical schemes and to communicate the project's constituency priorities relative to the educational programs and processes of the future. A Delphi technique was used as the primary mechanism for gathering and scrutinizing…

Evaluation Criteria for Interactive E-Books for Open and Distance Learning

ERIC Educational Resources Information Center

Bozkurt, Aras; Bozkaya, Mujgan

2015-01-01

The aim of this mixed method study is to identify evaluation criteria for interactive e-books. To find answers for the research questions of the study, both quantitative and qualitative data were collected through a four-round Delphi study with a panel consisting of 30 experts. After that, a total of 20 interactive e-books were examined with…

Why Is It So Hard to Reach Agreement on Terminology? The Case of Developmental Language Disorder (DLD)

ERIC Educational Resources Information Center

Bishop, Dorothy V. M.

2017-01-01

A recent project entitled CATALISE used the Delphi method to reach a consensus on terminology for unexplained language problems in children. "Developmental language disorder" (DLD) was the term agreed by a panel of 57 experts. Here I reflect on points of difficulty that arose when attempting to reach a consensus, using qualitative…

Application of Fuzzy Delphi Method in Exploring Facebook as a Tool for Writing Therapy among Young Adults

ERIC Educational Resources Information Center

Tee, Ying Qin; Mohamed, Anizah; Alias, Norlidah

2014-01-01

Social media sites including Facebook are increasingly accessed and integrated in the counselling and psychotherapy profession. As there is a universal escalation of mental and emotional health needs in today's society especially among young adults, Facebook as a popular social networking site for Malaysian youths could be taken advantage as a…

Developing an ICT-Literacy Task-Based Assessment Instrument: The Findings on the Final Testing Phase

ERIC Educational Resources Information Center

Mat-jizat, Jessnor Elmy

2013-01-01

This paper reports the findings of a study which seeks to identify the information and communications technology (ICT) literacy levels of trainee teachers, by investigating their ICT proficiency using a task-bask assessment instrument. The Delphi technique was used as a primary validation method for the new assessment tool and the ICT literacy…

What Is Standard Care for People with Learning Disabilities and Behaviour That Challenges and What Does It Cost?

ERIC Educational Resources Information Center

Iemmi, Valentina; Knapp, Martin; Gore, Nick; Cooper, Vivien; Brown, Freddy Jackson; Reid, Caroline; Saville, Maria

2016-01-01

Background: We describe current care arrangements in England for children, young people and adults with learning disabilities and behaviour that challenges, and estimate their comparative costs. Materials and Methods: A two-round Delphi exercise was performed in March and April 2014, followed by a costing exercise. Results: The study finds a mixed…

A Change Management Approach to Enhance Facility Maintenance Programs

DTIC Science & Technology

2014-03-27

dependent on the particular research effort and the researcher’s experience. Large groups tend to increase the decision quality but can be difficult...consolidate SME opinions on facility maintenance criteria. The Delphi method utilizes numerous questionnaire rounds to capitalize on a group think...effort provides the discussion and conclusions, recommendations, and suggestions for follow on research . 9 II. Literature Review This

The Current State of Human Performance Technology: A Citation Network Analysis of "Performance Improvement Quarterly," 1988-2010

ERIC Educational Resources Information Center

Cho, Yonjoo; Jo, Sung Jun; Park, Sunyoung; Kang, Ingu; Chen, Zengguan

2011-01-01

This study conducted a citation network analysis (CNA) of human performance technology (HPT) to examine its current state of the field. Previous reviews of the field have used traditional research methods, such as content analysis, survey, Delphi, and citation analysis. The distinctive features of CNA come from using a social network analysis…

A management plan for hospitals and medical centers facing radiation incidents.

PubMed

Davari, Fereshteh; Zahed, Arash

2015-09-01

Nowadays, application of nuclear technology in different industries has largely expanded worldwide. Proportionately, the risk of nuclear incidents and the resulting injuries have, therefore, increased in recent years. Preparedness is an important part of the crisis management cycle; therefore efficient preplanning seems crucial to any crisis management plan. Equipped with facilities and experienced personnel, hospitals naturally engage with the response to disasters. The main purpose of our study was to present a practical management pattern for hospitals and medical centers in case they encounter a nuclear emergency. In this descriptive qualitative study, data were collected through experimental observations, sources like Safety manuals released by the International Atomic Energy Agency and interviews with experts to gather their ideas along with Delphi method for polling, and brainstorming. In addition, the 45 experts were interviewed on three targeted using brainstorming and Delphi method. We finally proposed a management plan along with a set of practicality standards for hospitals and medical centers to optimally respond to nuclear medical emergencies when a radiation incident happens nearby. With respect to the great importance of preparedness against nuclear incidents adoption and regular practice of nuclear crisis management codes for hospitals and medical centers seems quite necessary.

Grading of parameters for urban tree inventories by city officials, arborists, and academics using the delphi method.

PubMed

Östberg, Johan; Delshammar, Tim; Wiström, Björn; Nielsen, Anders Busse

2013-03-01

Tree inventories are expensive to conduct and update, so every inventory carried out must be maximized. However, increasing the number of constituent parameters increases the cost of performing and updating the inventory, illustrating the need for careful parameter selection. This article reports the results of a systematic expert rating of tree inventories aiming to quantify the relative importance of each parameter. Using the Delphi method, panels comprising city officials, arborists, and academics rated a total of 148 parameters. The total mean score, the top ranking parameters, which can serve as a guide for decision-making at practical level and for standardization of tree inventories, were: Scientific name of the tree species and genera, Vitality, Coordinates, Hazard class, and Identification number. The study also examined whether the different responsibilities and usage of urban tree databases among organizations and people engaged in urban tree inventories affected their prioritization. The results revealed noticeable dissimilarities in the ranking of parameters between the panels, underlining the need for collaboration between the research community and those commissioning, administrating, and conducting inventories. Only by applying such a transdisciplinary approach to parameter selection can urban tree inventories be strengthened and made more relevant.

Grading of Parameters for Urban Tree Inventories by City Officials, Arborists, and Academics Using the Delphi Method

NASA Astrophysics Data System (ADS)

Östberg, Johan; Delshammar, Tim; Wiström, Björn; Nielsen, Anders Busse

2013-03-01

Tree inventories are expensive to conduct and update, so every inventory carried out must be maximized. However, increasing the number of constituent parameters increases the cost of performing and updating the inventory, illustrating the need for careful parameter selection. This article reports the results of a systematic expert rating of tree inventories aiming to quantify the relative importance of each parameter. Using the Delphi method, panels comprising city officials, arborists, and academics rated a total of 148 parameters. The total mean score, the top ranking parameters, which can serve as a guide for decision-making at practical level and for standardization of tree inventories, were: Scientific name of the tree species and genera, Vitality, Coordinates, Hazard class, and Identification number. The study also examined whether the different responsibilities and usage of urban tree databases among organizations and people engaged in urban tree inventories affected their prioritization. The results revealed noticeable dissimilarities in the ranking of parameters between the panels, underlining the need for collaboration between the research community and those commissioning, administrating, and conducting inventories. Only by applying such a transdisciplinary approach to parameter selection can urban tree inventories be strengthened and made more relevant.

Unified treatment algorithm for the management of crotaline snakebite in the United States: results of an evidence-informed consensus workshop

PubMed Central

2011-01-01

Background Envenomation by crotaline snakes (rattlesnake, cottonmouth, copperhead) is a complex, potentially lethal condition affecting thousands of people in the United States each year. Treatment of crotaline envenomation is not standardized, and significant variation in practice exists. Methods A geographically diverse panel of experts was convened for the purpose of deriving an evidence-informed unified treatment algorithm. Research staff analyzed the extant medical literature and performed targeted analyses of existing databases to inform specific clinical decisions. A trained external facilitator used modified Delphi and structured consensus methodology to achieve consensus on the final treatment algorithm. Results A unified treatment algorithm was produced and endorsed by all nine expert panel members. This algorithm provides guidance about clinical and laboratory observations, indications for and dosing of antivenom, adjunctive therapies, post-stabilization care, and management of complications from envenomation and therapy. Conclusions Clinical manifestations and ideal treatment of crotaline snakebite differ greatly, and can result in severe complications. Using a modified Delphi method, we provide evidence-informed treatment guidelines in an attempt to reduce variation in care and possibly improve clinical outcomes. PMID:21291549

Evaluating Risk Perception based on Gender Differences for Mountaineering Activity

NASA Astrophysics Data System (ADS)

Susanto, Novie; Susatyo, Nugroho W. P.; Rizkiyah, Ega

2018-02-01

In average 26 death events in mountaineering per year for the time span from 2003 to 2012 is reported. The number of women dying during the mountaineering is significantly smaller than males (3.5 deaths male for one female death). This study aims to analyze the differences of risk perception based on gender and provide recommendations as education basic to prevent accidents in mountaineering. This study utilizes the Kruskal-Wallis test and the Delphi Method. A total of 200 mountaineer respondents (100 males and 100 females) participated in this study. The independent variable in this study was gender. The dependent variable was risk perception including perception toward the serious accident, perception toward the probability of accident event as well as anxiety level and perception of efficacy and self-efficacy. The study result showed that the risk perception of women is higher than men with significant difference (p-value = 0.019). The recommendations from Delphi method result are by developing a positive mental attitude, showing about the risks that exist in nature, implementing Cognitive Behaviour Therapy (CBT) to raise awareness of the safety of ownself, following the climbing or mountaineer school, and using instructors to give lessons about safety in outdoor activities.

Creating a Body of Knowledge for cartography

NASA Astrophysics Data System (ADS)

Fairbairn, David

2018-05-01

The nature of knowledge is considered, in particular its creation and formalisation, and some of the issues which re-late to disciplinary knowledge in particular. It is suggested that cartography has particular needs addressing its disciplinary boundaries, the role of uncertain and `troublesome' knowledge in its subject-matter, and the enhancement of its subject-specific knowledge, with more generic supporting material, including skills and attitudes. An overview of Bodies of Knowledge (BoK) in other disciplines has been undertaken, and models of BoK structure, content and usage have been assessed. BoKs in closely related subjects, including civil engineering, GIS and software engineering, give examples of good practice. The paper concentrates on the work done to date to create the cartography BoK, and the adoption of the `Delphi' method of consultation to develop it. The Delphi method is intended to yield consensus on the scope, content, context and use of the BoK. It is regarded as a rigorous process, iterative (and therefore time consuming), involving questionnaire survey, opinion gathering, discourse analysis, and feedback. The participants are expected to be experts, from a range of different sectors, but `volunteer amateurs' are also important consultants.

Current and Emerging Ethical Issues in Counseling: A Delphi Study of Expert Opinions

ERIC Educational Resources Information Center

Herlihy, Barbara; Dufrene, Roxane L.

2011-01-01

A Delphi study was conducted to ascertain the opinions of panel experts regarding the most important current and emerging ethical issues facing the counseling profession. Expert opinions on ethical issues in counselor preparation also were sought. Eighteen panelists responded to 3 rounds of data collection interspersed with feedback. Themes that…

Workplace Issues in Extension--A Delphi Study of Extension Educators

ERIC Educational Resources Information Center

Kroth, Michael; Peutz, Joey

2011-01-01

Using the Delphi technique, expert Extension educators identified and prioritized those workplace issues they believe will be the most important to attract, motivate, and retain Extension educators/agents over the next 5 to 7 years. Obtaining and then utilizing a talented, highly motivated workforce during a period when many will be retiring will…

Supervising Counsellors and Psychotherapists Who Work with Trauma: A Delphi Study

ERIC Educational Resources Information Center

West, Angela

2010-01-01

In this study the Delphi technique was used to identify the main supervision issues that require attention and consideration when supervising counsellors and psychotherapists working with trauma. A panel of supervisors, who were additionally experienced in working with trauma in adulthood, completed a series of three questionnaires comprising two…

Towards an Understanding of Instructional Design Heuristics: An Exploratory Delphi Study

ERIC Educational Resources Information Center

York, Cindy S.; Ertmer, Peggy A.

2011-01-01

Evidence suggests that experienced instructional designers often use heuristics and adapted models when engaged in the instructional design problem-solving process. This study used the Delphi technique to identify a core set of heuristics designers reported as being important to the success of the design process. The overarching purpose of the…

The Conduct of Socially Valid Investigation by Culturally Diverse Researchers: A Delphi Study

ERIC Educational Resources Information Center

Dutta, Alo; Kundu, Madan; Chan, Fong

2010-01-01

Minority researchers have traditionally exhibited a need for and interest in investigating non-mainstream issues involving diverse communities. Since faculty at colleges and universities within the United States are largely Caucasian, research on issues relevant to marginalized groups is lacking. This three-stage Delphi study was designed to…

Development of a School Nursing Research Agenda in Florida: A Delphi Study

ERIC Educational Resources Information Center

Gordon, Shirley C.; Barry, Charlotte D.

2006-01-01

Research is important to the image, visibility, and viability of school nursing. Each state school nursing association should evaluate member commitment to school nursing research based on their unique set of financial, educational, and organizational resources. A 3-round Delphi study was conducted in which Florida school nurses identified…

Identifying the Professional Development Needs of Adjunct Faculty Using an Online Delphi

ERIC Educational Resources Information Center

Cuddie, Stephani B.

2016-01-01

The purpose of this online Delphi was to explore the professional development needs and preferences of adjunct faculty, specifically those who teach online. The study involved adjunct faculty who were categorized by their self-selected type of adjunct faculty member: specialist, aspiring academic, professional/freelancer, and career-ender. Through…

Achieving Next Generation Science Standards through Agricultural Contexts: A Delphi Study of Outdoor Education Experts

ERIC Educational Resources Information Center

Meals, Anthony; Washburn, Shannon

2015-01-01

A Delphi survey was conducted with 30 outdoor education experts in Kansas. Participant responses helped frame a Kansas definition of outdoor education and identified essential educational goals and outcomes, critical components for effective outdoor education programming, and barriers facing outdoor education in Kansas. The study highlights…

Incorporating Nonparametric Statistics into Delphi Studies in Library and Information Science

ERIC Educational Resources Information Center

Ju, Boryung; Jin, Tao

2013-01-01

Introduction: The Delphi technique is widely used in library and information science research. However, many researchers in the field fail to employ standard statistical tests when using this technique. This makes the technique vulnerable to criticisms of its reliability and validity. The general goal of this article is to explore how…

Reinforcement of Science Learning through Local Culture: A Delphi Study

ERIC Educational Resources Information Center

Nuangchalerm, Prasart

2008-01-01

This study aims to explore the ways to reinforce science learning through local culture by using Delphi technique. Twenty four participants in various fields of study were selected. The result of study provides a framework for reinforcement of science learning through local culture on the theme life and environment. (Contains 1 table.)

The Delphi Process: Some Assumptions and Some Realities.

ERIC Educational Resources Information Center

Waldron, James S.

The effectiveness of the Delphi Technique is evaluated in terms of immediate and delayed controlled information feedback (feedback within 5 seconds as compared with a 24-hour delay); and the relationships that exist among measures of integrative complexity, estimations about the time of occurrence of future events, and time delay between task…

The Future of Information Literacy in Academic Libraries: A Delphi Study

ERIC Educational Resources Information Center

Saunders, Laura

2009-01-01

Information literacy is a central tenet of academic librarianship. However, technological advancements coupled with drastic changes in users' information needs and expectations are having a great impact on this service, leading practitioners to wonder how programs may evolve. Based on a Delphi study, this article surveyed 13 information literacy…

Qualitative Delphi Study of Factors Influencing Data Center Investment in Eco-Innovations

ERIC Educational Resources Information Center

Stewart, M. Bennett

2016-01-01

This qualitative investigation explored the diffusion of eco-innovations within the U.S. data center industry from 2007 to 2015 whose adoption was intended to decouple digital economy growth from environmental impact. Using diffusion of innovation theory to inform the study, and synthesizing subject matter expert input from a Delphi panel…

Quality Characteristics of a Graduate Teacher Education Program in Graphic Communications: Results from a Delphi Research Study.

ERIC Educational Resources Information Center

Clark, Aaron C.; Scales, Alice Y.

2000-01-01

Investigates characteristics of a quality program in graphic communications teacher education with involvement of professionals in the field. Uses the Delphi technique to achieve consensus on the characteristics that they felt compromised a good educational program for future graphics teachers. (Contains 27 references.) (Author/YDS)

A core outcome set for localised prostate cancer effectiveness trials: protocol for a systematic review of the literature and stakeholder involvement through interviews and a Delphi survey.

PubMed

MacLennan, Steven; Bekema, Hendrika J; Williamson, Paula R; Campbell, Marion K; Stewart, Fiona; MacLennan, Sara J; N'Dow, James M O; Lam, Thomas B L

2015-03-04

Prostate cancer is a growing health problem worldwide. The management of localised prostate cancer is controversial. It is unclear which of several surgical, radiotherapeutic, ablative, and surveillance treatments is the most effective. All have cost, process and recovery, and morbidity implications which add to treatment decision-making complexity for patients and healthcare professionals. Evidence from randomised controlled trials (RCTs) is not optimal because of uncertainty as to what constitutes important outcomes. Another issue hampering evidence synthesis is heterogeneity of outcome definition, measurement, and reporting. This project aims to determine which outcomes are the most important to patients and healthcare professionals, and use these findings to recommend a standardised core outcome set for comparative effectiveness trials of treatments for localised prostate cancer, to optimise decision-making. The range of potentially important outcomes and measures will be identified through systematic reviews of the literature and semi-structured interviews with patients. A consultation exercise involving representatives from two key stakeholder groups (patients and healthcare professionals) will ratify the list of outcomes to be entered into a three round Delphi study. The Delphi process will refine and prioritise the list of identified outcomes. A methodological substudy (nested RCT design) will also be undertaken. Participants will be randomised after round one of the Delphi study to one of three feedback groups, based on different feedback strategies, in order to explore the potential impact of feedback strategies on participant responses. This may assist the design of a future core outcome set and Delphi studies. Following the Delphi study, a final consensus meeting attended by representatives from both stakeholder groups will determine the final recommended core outcome set. This study will inform clinical practice and future trials of interventions of localised prostate cancer by standardising a core outcome set which should be considered in comparative effectiveness studies for localised prostate cancer.

Establishment of a dental license regulation authority is required in Korea: results of the Delphi technique.

PubMed

Choi, Jin-Woo; Kim, Kack-Kyun; Lee, Jihyun; Choi, Dong-Ju; Kim, Kyung-Nyun

2017-01-01

In addition to dental education, a system for the evaluation and management of dental licensing and certification is required to meet the growing societal demand for more competent dentists. In this study, the Delphi technique was used to gather opinions from a variety of professionals on the problems of and remedies for the dental license management system in Korea. Delphi surveys were conducted from April 2016 to October 2016 in South Korea. A variety of dental professionals were included and categorized into 3 groups according to their expertise as follows: the basic dentistry group, the clinical dentistry group, and the policy group. The Delphi technique was conducted in 3 rounds of e-mail surveys, each with different questions that probed with increasing depth on the dental license management system. In each successive round, the responses were categorized, scored on a Likert scale, and statistically analyzed. After categorizing the results of the first survey and ranking the results of the second survey using the Delphi technique, regulation by a licensing authority was found to be the most critical issue. This was followed by the license renewal system, continuing education, a tiered licensure system, improvement of foreign license approval, and utilization of retirees, in decreasing order of importance. The third Delphi survey showed a similar ranking, with regulation by a licensing authority being the major concern. Opinions regarding the dental license management system were provided as open-ended responses. The responses of the 3 groups showed statistically significant differences in the scores for the issue of regulation by a licensing authority. After re-grouping into the dentistry group and the policy group, the issue received a significantly higher score in the dentistry group. The quality of dental treatment should be managed to protect patients and dental professionals. For this purpose, the establishment of an independent license regulation authority along with legislative changes is required.

A Delphi-Based Framework for systems architecting of in-orbit exploration infrastructure for human exploration beyond Low Earth Orbit

NASA Astrophysics Data System (ADS)

Aliakbargolkar, Alessandro; Crawley, Edward F.

2014-01-01

The current debate in the U.S. Human Spaceflight Program focuses on the development of the next generation of man-rated heavy lift launch vehicles. While launch vehicle systems are of critical importance for future exploration, a comprehensive analysis of the entire exploration infrastructure is required to avoid costly pitfalls at early stages of the design process. This paper addresses this need by presenting a Delphi-Based Systems Architecting Framework for integrated architectural analysis of future in-orbit infrastructure for human space exploration beyond Low Earth Orbit. The paper is structured in two parts. The first part consists of an expert elicitation study to identify objectives for the in-space transportation infrastructure. The study was conducted between November 2011 and January 2012 with 15 senior experts involved in human spaceflight in the United States and Europe. The elicitation study included the formation of three expert panels representing exploration, science, and policy stakeholders engaged in a 3-round Delphi study. The rationale behind the Delphi approach, as imported from social science research, is discussed. Finally, a novel version of the Delphi method is presented and applied to technical decision-making and systems architecting in the context of human space exploration. The second part of the paper describes a tradespace exploration study of in-orbit infrastructure coupled with a requirements definition exercise informed by expert elicitation. The uncertainties associated with technical requirements and stakeholder goals are explicitly considered in the analysis. The outcome of the expert elicitation process portrays an integrated view of perceived stakeholder needs within the human spaceflight community. Needs are subsequently converted into requirements and coupled to the system architectures of interest to analyze the correlation between exploration, science, and policy goals. Pareto analysis is used to identify architectures of interest for further consideration by decision-makers. The paper closes with a summary of insights and develops a strategy for evolutionary development of the exploration infrastructure of the incoming decades. The most important result produced by this analysis is the identification of a critical irreducible ambiguity undermining value delivery for the in-space transportation infrastructure of the next three decades: destination choice. Consensus on destination is far from being reached by the community at large, with particular reference to exploration and policy stakeholders. The realization of this ambiguity is a call for NASA to promote an open forum on this topic, and to develop a strong case for policy makers to incentivize investments in the human spaceflight industry in the next decades.

Three nested randomized controlled trials of peer-only or multiple stakeholder group feedback within Delphi surveys during core outcome and information set development.

PubMed

Brookes, Sara T; Macefield, Rhiannon C; Williamson, Paula R; McNair, Angus G; Potter, Shelley; Blencowe, Natalie S; Strong, Sean; Blazeby, Jane M

2016-08-17

Methods for developing a core outcome or information set require involvement of key stakeholders to prioritise many items and achieve agreement as to the core set. The Delphi technique requires participants to rate the importance of items in sequential questionnaires (or rounds) with feedback provided in each subsequent round such that participants are able to consider the views of others. This study examines the impact of receiving feedback from different stakeholder groups, on the subsequent rating of items and the level of agreement between stakeholders. Randomized controlled trials were nested within the development of three core sets each including a Delphi process with two rounds of questionnaires, completed by patients and health professionals. Participants rated items from 1 (not essential) to 9 (absolutely essential). For round 2, participants were randomized to receive feedback from their peer stakeholder group only (peer) or both stakeholder groups separately (multiple). Decisions as to which items to retain following each round were determined by pre-specified criteria. Whilst type of feedback did not impact on the percentage of items for which a participant subsequently changed their rating, or the magnitude of change, it did impact on items retained at the end of round 2. Each core set contained discordant items retained by one feedback group but not the other (3-22 % discordant items). Consensus between patients and professionals in items to retain was greater amongst those receiving multiple group feedback in each core set (65-82 % agreement for peer-only feedback versus 74-94 % for multiple feedback). In addition, differences in round 2 scores were smaller between stakeholder groups receiving multiple feedback than between those receiving peer group feedback only. Variability in item scores across stakeholders was reduced following any feedback but this reduction was consistently greater amongst the multiple feedback group. In the development of a core outcome or information set, providing feedback within Delphi questionnaires from all stakeholder groups separately may influence the final core set and improve consensus between the groups. Further work is needed to better understand how participants rate and re-rate items within a Delphi process. The three randomized controlled trials reported here were each nested within the development of a core information or outcome set to investigate processes in core outcome and information set development. Outcomes were not health-related and therefore trial registration was not applicable.

Decision Analysis in the U.S. Army’s Capabilties Needs Analysis: Applications of Decision Analysis Methods to Capabilities Resource Allocation and Capabilities Development Decisions

DTIC Science & Technology

2015-10-01

capability to meet the task to the standard under the condition, nothing more or less, else the funding is wasted . Also, that funding for the...bin to segregate gaps qualitatively before the gap value model determined preference among gaps within the bins. Computation of a gap’s...for communication, interpretation, or processing by humans or by automatic means (as it pertains to modeling and simulation). Delphi Method -- a

Evidence-based algorithm for diagnosis and assessment in psoriatic arthritis: results by Italian DElphi in psoriatic Arthritis (IDEA).

PubMed

Lapadula, G; Marchesoni, A; Salaffi, F; Ramonda, R; Salvarani, C; Punzi, L; Costa, L; Caso, F; Simone, D; Baiocchi, G; Scioscia, C; Di Carlo, M; Scarpa, R; Ferraccioli, G

2016-12-16

Psoriatic arthritis (PsA) is a chronic inflammatory disease involving skin, peripheral joints, entheses, and axial skeleton. The disease is frequently associated with extrarticular manifestations (EAMs) and comorbidities. In order to create a protocol for PsA diagnosis and global assessment of patients with an algorithm based on anamnestic, clinical, laboratory and imaging procedures, we established a DElphi study on a national scale, named Italian DElphi in psoriatic Arthritis (IDEA). After a literature search, a Delphi poll, involving 52 rheumatologists, was performed. On the basis of the literature search, 202 potential items were identified. The steering committee planned at least two Delphi rounds. In the first Delphi round, the experts judged each of the 202 items using a score ranging from 1 to 9 based on its increasing clinical relevance. The questions posed to experts were How relevant is this procedure/observation/sign/symptom for assessment of a psoriatic arthritis patient? Proposals of additional items, not included in the questionnaire, were also encouraged. The results of the poll were discussed by the Steering Committee, which evaluated the necessity for removing selected procedures or adding additional ones, according to criteria of clinical appropriateness and sustainability. A total of 43 recommended diagnosis and assessment procedures, recognized as items, were derived by combination of the Delphi survey and two National Expert Meetings, and grouped in different areas. Favourable opinion was reached in 100% of cases for several aspects covering the following areas: medical (familial and personal) history, physical evaluation, imaging tool, second level laboratory tests, disease activity measurement and extrarticular manifestations. After performing PsA diagnosis, identification of specific disease activity scores and clinimetric approaches were suggested for assessing the different clinical subsets. Further, results showed the need for investigation on the presence of several EAMs and risk factors. In the context of any area, a rank was assigned for each item by Expert Committee members, in order to create the logical sequence of the algorithm. The final list of recommended diagnosis and assessment procedures, by the Delphi survey and the two National Expert Meetings, was also reported as an algorithm. This study shows results obtained by the combination of a DElphi survey of a group of Italian rheumatologists and two National Expert Meetings, created with the aim of establishing a clinical procedure and algorithm for the diagnosis and the assessment of PsA patients. In order to find accurate and practical diagnostic and assessment items in clinical practice, we have focused our attention on evaluating the different PsA domains. Hence, we conceived the IDEA algorithm in order to address PsA diagnosis and assessment in the context of daily clinical practice. The IDEA algorithm might eventually lead to a multidimensional approach and could represent a useful and practical tool for addressing diagnosis and for assessing the disease appropriately. However, the elaborated algorithm needs to be further investigated in daily practice, for evidencing and proving its eventual efficacy in detecting and staging PsA and its heterogeneous spectrum appropriately.

Building Responsive Health Systems to Help Communities Affected by Migration: An International Delphi Consensus

PubMed Central

Pottie, Kevin; Hui, Charles; Rahman, Prinon; Ingleby, David; Akl, Elie A.; Russell, Grant; Ling, Li; Wickramage, Kolitha; Mosca, Davide; Brindis, Claire D.

2017-01-01

Persons affected by migration require health systems that are responsive and adaptable to the needs of both disadvantaged migrants and non-migrant populations. The objective of this study is to support health systems for populations affected by migration. Materials and Methods: An international Delphi consensus process was used to identify policy approaches to improve health systems for populations affected by migration. Participants were leading migrant health experts from Americas, Europe, Middle East, Asia, and Australasia. We calculated average ranking scores and qualitatively analyzed open-ended questions. Results: Participants identified the following key areas as priorities for policy development: health inequities, system discrimination, migrant related health data, disadvantaged migrant sub-groups, and considerations for disadvantaged non-migrant populations. Highly ranked items to improve health systems were: Health Equity Impact Assessment, evidence based guidelines, and the International Organization for Migration annual reports. Discussion: Policy makers need tools, data and resources to address health systems challenges. Policies need to avoid preventable deaths of migrants and barriers to basic health services. PMID:28165380

Increasing Activeness and Learning Outcomes by Developing Borland Delphi 7.0 Application as Instructional Media

ERIC Educational Resources Information Center

Setyorini, Dyna; Churiyah, Madziatul

2016-01-01

This study aims to produce instructional media of petty cash fund with Borland Delphi 7.0 application in the Finance Administration subject, Managing Petty Cash Fund material in class XII APK in Vocational High School (SMK) Negeri 1 Pasuruan, East Java, Indonesia. This study used "Research and Development" (R&D) design procedures…

Identifying Areas of Tension in the Field of Technology-Enhanced Learning: Results of an International Delphi Study

ERIC Educational Resources Information Center

Plesch, Christine; Kaendler, Celia; Rummel, Nikol; Wiedmann, Michael; Spada, Hans

2013-01-01

Despite steady progress in research in technology-enhanced learning (TEL), the translation of research findings and technology into educational practices falls short of expectations. We present five Areas of Tension which were identified and evaluated in an international Delphi study on TEL. These tensions might impede a more comprehensive…

A Classical Delphi Study to Identify the Barriers of Pursuing Green Information and Communication Technologies

ERIC Educational Resources Information Center

Gotay, Jose Antonio

2013-01-01

This qualitative, classical Delphi study served to explore the apparent lack of corporate commitment to prioritized Green Information Communication Technologies (ICTs), which could delay the economic and social benefits for maximizing the use of natural energy resources in a weak economy. The purpose of this study was to examine the leadership…

Trails research: where do we go from here?

Treesearch

Michael A. Schuett; Patricia Seiser

2002-01-01

This paper describes a recent study focusing on trails research needs. This study was supported by American Trails. Using a Delphi technique, 86 trails experts representing a variety of federal, state and local agencies, nonprofits, and trail uses were queried by email on trails research needs. A Delphi technique is a prognostic tool for dealing with complex problems...

Knowledge as an Aspect of Scientific Competence for Citizenship: Results of a Delphi Study in Spain

ERIC Educational Resources Information Center

España-Ramos, Enrique; González-García, Francisco José; Blanco-López, Ángel; Franco-Mariscal, Antonio Joaquín

2016-01-01

This article focuses on scientific knowledge as one aspect of the scientific competencies that citizens should ideally possess. The analysis is based on a Delphi study we conducted with Spanish experts from different science-related fields. The results showed that although the experts proposed several examples of scientific knowledge, the degree…

African American Parental Beliefs about Resiliency: A Delphi Study

ERIC Educational Resources Information Center

Jones, Vita; Higgins, Kyle; Boone, Randall; Miller, Susan P.; Sileo, Nancy

2014-01-01

This study involved a Delphi inquiry concerning the characteristics of resiliency specific to African American children/youth. The study was conducted with a large group of African American parents who were considered experts in resiliency because they had graduated from high school and had at least one child who had graduated from high school.…

Critical Guidelines for U.S.-Based Counselor Educators When Working Transnationally: A Delphi Study

ERIC Educational Resources Information Center

Smith, Paul H.; Benshoff, James M.; Gonzalez, Laura M.

2018-01-01

U.S.-based counselor education faculty increasingly are participating in transnational experiences, such as global research and study abroad. The purpose of this study was to develop guidelines for U.S.-based counselor educators when working transnationally. Using Delphi methodology, 69 consensus guidelines were developed from an expert panel.…

A Delphi Study: The Characteristics of Democratic Schools

ERIC Educational Resources Information Center

Korkmaz, H. Eylem; Erden, Münire

2014-01-01

The authors aim to identify characteristics of democratic schools. The Delphi technique used in this study is based on attaining a consensus among a group of experts over 3 rounds with 22 experts from 9 countries participating in the first round. By the end of the third round, 339 items referring to democratic school characteristics were…

A Delphi Study to Understand Relational Bonds in Supervision and Their Effect on Rehabilitation Counselor Disclosure in the Public Rehabilitation Program

ERIC Educational Resources Information Center

Magnuson, Lori Anne

2012-01-01

The scholarly literature surrounding counselor supervision suggests that relational bonds built on liking, trusting, and caring between supervisors and counselors positively impact counselor willingness to disclose practice errors and ethical issues in supervision. This Delphi study explored the opinions of expert public rehabilitation supervisors…

Issues Facing Urban Agriscience Teachers: A Delphi Study

ERIC Educational Resources Information Center

Warner, Wendy J.; Washburn, Shannon G.

2009-01-01

This national study used the Delphi technique to identify the issues facing urban agriscience teachers. The first round of the study used a questionnaire with one open-ended question to generate responses from the expert panel. In the second round, respondents were asked to rate their level of agreement with 72 issues identified in round one using…

Exploring Research Themes in Public Engagement within a Natural History Museum: A Modified Delphi Approach

ERIC Educational Resources Information Center

Seakins, Amy; Dillon, Justin

2013-01-01

The primacy of the research question in designing studies affords an opportunity for enhancing collaborations between researchers and "practitioners". This paper describes the use of a modified Delphi technique to co-generate research questions for a collaborative research study co-funded by a university and a natural history museum.…

Identifying Core Mobile Learning Faculty Competencies Based Integrated Approach: A Delphi Study

ERIC Educational Resources Information Center

Elbarbary, Rafik Said

2015-01-01

This study is based on the integrated approach as a concept framework to identify, categorize, and rank a key component of mobile learning core competencies for Egyptian faculty members in higher education. The field investigation framework used four rounds Delphi technique to determine the importance rate of each component of core competencies…

Characteristics of Viable and Sustainable Workers for the Year 2015.

ERIC Educational Resources Information Center

Dean, Brenda Pennington; West, Russell

A two-round Delphi study was conducted to identify the characteristics of viable and sustainable employees in northeastern Tennessee in 2015. The Delphi panel selected for the study consisted of 25 experts who represented a cross-section of the businesses and communities in the 10-county area of northeastern Tennessee served by Walters State…

Intuitionistic fuzzy analytical hierarchical processes for selecting the paradigms of mangroves in municipal wastewater treatment.

PubMed

Ouyang, Xiaoguang; Guo, Fen

2018-04-01

Municipal wastewater discharge is widespread and one of the sources of coastal eutrophication, and is especially uncontrolled in developing and undeveloped coastal regions. Mangrove forests are natural filters of pollutants in wastewater. There are three paradigms of mangroves for municipal wastewater treatment and the selection of the optimal one is a multi-criteria decision-making problem. Combining intuitionistic fuzzy theory, the Fuzzy Delphi Method and the fuzzy analytical hierarchical process (AHP), this study develops an intuitionistic fuzzy AHP (IFAHP) method. For the Fuzzy Delphi Method, the judgments of experts and representatives on criterion weights are made by linguistic variables and quantified by intuitionistic fuzzy theory, which is also used to weight the importance of experts and representatives. This process generates the entropy weights of criteria, which are combined with indices values and weights to rank the alternatives by the fuzzy AHP method. The IFAHP method was used to select the optimal paradigm of mangroves for treating municipal wastewater. The entropy weights were entrained by the valid evaluation of 64 experts and representatives via online survey. Natural mangroves were found to be the optimal paradigm for municipal wastewater treatment. By assigning different weights to the criteria, sensitivity analysis shows that natural mangroves remain to be the optimal paradigm under most scenarios. This study stresses the importance of mangroves for wastewater treatment. Decision-makers need to contemplate mangrove reforestation projects, especially where mangroves are highly deforested but wastewater discharge is uncontrolled. The IFAHP method is expected to be applied in other multi-criteria decision-making cases. Copyright © 2017 Elsevier Ltd. All rights reserved.

Assessment of Group Preferences and Group Uncertainty for Decision Making

DTIC Science & Technology

1976-06-01

the individ- uals. decision making , group judgments should be preferred to individual judgments if obtaining group judgments costs more. -26- -YI IV... decision making group . IV. A. 3. Aggregation using conjugate distribution. Arvther procedure for combining indivi(jai probability judgments into a group...statisticized group group decision making group judgment subjective probability Delphi method expected utility nominal group 20. ABSTRACT (Continue on

Identification of Skills Standards for Entry Level Legal Office Support Staff in Urban Oklahoma: A Delphi Study

ERIC Educational Resources Information Center

Reese Ward, Tonya Maria

2010-01-01

Scope and Method of Study: The purpose of this study was to use industry experts to identify critical skills or competencies perceived by the legal profession to be required by competent team members in the legal office environment. Specifically, this study focused on fulfilling this purpose in the context of urban Oklahoma, where a large number…

Identifying Estonian Stakeholder Views as the Bases for Designing Science Teachers' In-Service Course Which Support Promotion of Competence Based Curriculum Goals

ERIC Educational Resources Information Center

Laius, A.; Post, A.; Rannikmäe, M.

2015-01-01

This study solicits views about the goals of science education from a range of stakeholders within the science education community and society. It also compares students' needs, expressed through stakeholder expectations, with the current learning situation of gymnasium graduates. The study uses a Delphi method to solicit views with 111…

Foreword: Proceedings From the First Annual Lumbar Total Disc Replacement Summit.

PubMed

Blumenthal, Scott; Buttermann, Glenn; Garcia, Rolando; Gornet, Matthew; Grunch, Betsy; Guyer, Richard; Janssen, Michael; Kimball, Brent; Lewis, Adam; Mesiwala, Ali; Miller, Lynn; Morreale, Joseph; Reed, William; Sandhu, Faheem; Shackleford, Ian; Yue, James; Zigler, Jack; OConnell, Brent; Ferko, Nicole; Hollmann, Sarah

2017-12-15

: This publication focuses on proceedings from the First Annual Lumbar Total Disc Replacement Summit, held October 25, 2016 in Boston, MA. The Summit brought together 17 thought leading surgeons who employed a modified-Delphi method to determine where consensus existed pertaining to the utilization of lumbar total disc replacement as a standard of care for a subpopulation of patients suffering from degenerative disc disease.

The Development and Validation of an End-User Satisfaction Measure in a Student Laptop Environment

ERIC Educational Resources Information Center

Kim, Sung; Meng, Juan; Kalinowski, Jon; Shin, Dooyoung

2014-01-01

The purpose of this paper is to present the development and validation of a measurement model for student user satisfaction in a laptop environment. Using a "quasi Delphi" method in addition to contributions from prior research we used EFA and CFA (LISREL) to identify a five factor (14 item) measurement model that best fit the data. The…

The Delphi Method and Its Applications: A Bibliography

DTIC Science & Technology

1976-06-01

Quality of Life ," The Quality of Life " Connept, chapter, 5p: Environmental Protection Agency4 Jantsch, Erich, Perspectives of’ PLanning, Paris...develop measures of effectiveness in evaluating new governmental organizations or reorganizations, with particular reference to the Army...Controlled Environment. Cambridge, Mass.: M.I.To Press, 1968. 340p. Ansolf, L.I. and Brandenburg, R.G., A Language for Organization Design. Perspectives

The ITINERIS Scale on the Rights of Persons with Intellectual Disabilities: Development, Pilot Studies and Application at a Country Level in South America

ERIC Educational Resources Information Center

Aznar, A. S.; Gonzalez Castanon, D.; Olate, G.

2012-01-01

Background: The "ITINERIS scale on the rights of persons with intellectual disabilities" (ISRPID) was developed to measure the extent to which people with intellectual disabilities (ID) exercise their rights. Method: The ISRPID was produced through a virtual Delphi group with 37 professionals and relatives of people with ID from four…

Development of an objective assessment tool for total laparoscopic hysterectomy: A Delphi method among experts and evaluation on a virtual reality simulator

PubMed Central

Knight, Sophie; Aggarwal, Rajesh; Agostini, Aubert; Loundou, Anderson; Berdah, Stéphane

2018-01-01

Introduction Total Laparoscopic hysterectomy (LH) requires an advanced level of operative skills and training. The aim of this study was to develop an objective scale specific for the assessment of technical skills for LH (H-OSATS) and to demonstrate feasibility of use and validity in a virtual reality setting. Material and methods The scale was developed using a hierarchical task analysis and a panel of international experts. A Delphi method obtained consensus among experts on relevant steps that should be included into the H-OSATS scale for assessment of operative performances. Feasibility of use and validity of the scale were evaluated by reviewing video recordings of LH performed on a virtual reality laparoscopic simulator. Three groups of operators of different levels of experience were assessed in a Marseille teaching hospital (10 novices, 8 intermediates and 8 experienced surgeons). Correlations with scores obtained using a recognised generic global rating tool (OSATS) were calculated. Results A total of 76 discrete steps were identified by the hierarchical task analysis. 14 experts completed the two rounds of the Delphi questionnaire. 64 steps reached consensus and were integrated in the scale. During the validation process, median time to rate each video recording was 25 minutes. There was a significant difference between the novice, intermediate and experienced group for total H-OSATS scores (133, 155.9 and 178.25 respectively; p = 0.002). H-OSATS scale demonstrated high inter-rater reliability (intraclass correlation coefficient [ICC] = 0.930; p<0.001) and test retest reliability (ICC = 0.877; p<0.001). High correlations were found between total H-OSATS scores and OSATS scores (rho = 0.928; p<0.001). Conclusion The H-OSATS scale displayed evidence of validity for assessment of technical performances for LH performed on a virtual reality simulator. The implementation of this scale is expected to facilitate deliberate practice. Next steps should focus on evaluating the validity of the scale in the operating room. PMID:29293635

Development of a clinical feeding assessment scale for very young infants in South Africa

PubMed Central

2016-01-01

Background There is a need for validated neonatal feeding assessment instruments in South Africa. A locally developed instrument may contribute to standardised evaluation procedures of high-risk neonates and address needs in resource constrained developing settings. Objective The aim of the study was to develop and validate the content of a clinical feeding assessment scale to diagnose oropharyngeal dysphagia (OPD) in neonates. Method The Neonatal Feeding Assessment Scale (NFAS) was developed using the Delphi method. Five international and South African speech-language therapists (SLTs) formed the expert panel, participating in two rounds of electronic questionnaires to develop and validate the content of the NFAS. Results All participants agreed on the need for the development of a valid clinical feeding assessment instrument to use with the neonatal population. The initial NFAS consisted of 240 items across 8 sections, and after the Delphi process was implemented, the final format was reduced to 211 items across 6 sections. The final format of the NFAS is scored using a binary scoring system guiding the clinician to diagnose the presence or absence of OPD. All members agreed on the format, the scoring system and the feeding constructs addressed in the revised final format of the NFAS. Conclusion The Delphi method and the diverse clinical and research experience of participants could be integrated to develop the NFAS which may be used in clinical practice in South Africa or similar developing contexts. Because of demographically different work settings marked by developed versus developing contexts, participants did not have the same expectations of a clinical dysphagia assessment. The international participants contributed to evidence-based content development. Local participants considered the contextual challenges of South African SLTs entering the field with basic competencies in neonatal dysphagia management, thereby justifying a comprehensive clinical instrument. The NFAS is aimed at clinicians working in Neonatal Intensive Care Units where they manage large caseloads of high-risk neonates. Further validation of the NFAS is recommended to determine its criterion validity in comparison with a widely accepted standard such as the modified barium swallow study. PMID:27796101

Academic Primer Series: Key Papers About Competency-Based Medical Education

PubMed Central

Cooney, Robert; Chan, Teresa M.; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-01-01

Introduction Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Methods Based on the online discussions of the 2016–2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Results Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. Conclusion We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs. PMID:28611893

Clinical stakeholders’ opinions on the use of selective decontamination of the digestive tract in critically ill patients in intensive care units: an international Delphi study

PubMed Central

2013-01-01

Introduction Selective decontamination of the digestive tract (SDD) is a prophylactic antibiotic regimen that is not widely used in practice. We aimed to describe the opinions of key ‘stakeholders’ about the validity of the existing evidence base, likely consequences of implementation, relative importance of their opinions in influencing overall practice, likely barriers to implementation and perceptions of the requirement for further research to inform the decision about whether to embark on a further large randomised controlled trial. Methods This was a Delphi study informed by comprehensive framework of possible determinants of health professionals’ behaviour to study Critical Care practice in four countries. There were four key stakeholder participant groups including ICU physicians, pharmacists, clinical leads, and clinical microbiologists/ infectious disease physicians. Round one comprised participant interviews and Rounds two and three were online questionnaires using Delphi method. Results In this study, 141 participants were recruited of whom 82% were retained. Participants rated themselves as knowledgeable about SDD. Antibiotic resistance was identified as the most important issue. SDD was seen as a low clinical priority but few participants reported strong opposition. There was moderate agreement that research to date has not adequately addressed concerns about antibiotic resistance and lacks generalizability. Participants indicated equipoise with regard to benefits and harms of SDD, and indicated strong support for a further randomised trial. Conclusions Clinicians have clinical equipoise about the effectiveness of SDD. Future research requires longer follow up to assess antibiotic resistance as well as greater validity/generalizability to provide definitive answers on the effectiveness of decontamination and effects on antibiotic resistance. SDD was regarded as not being a high clinical priority, which may limit future trial participation. These results have identified that further large randomised controlled trial of SDD in critical care is both warranted and appropriate. PMID:24207137

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study

PubMed Central

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-01-01

Background The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. Objective This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. Design A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Results Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. Discussion and conclusions This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. PMID:27540101

Optimizing the pre-referral workup for gastroenterology and hepatology specialty care: consensus using the Delphi method.

PubMed

Ho, Chanda K; Boscardin, Christy K; Gleason, Nathaniel; Collado, Don; Terdiman, Jonathan; Terrault, Norah A; Gonzales, Ralph

2016-02-01

Specialty care referrals have doubled in the last decade. Optimization of the pre-referral workup by a primary care doctor can lead to a more efficient first specialty visit with the patient. Guidance regarding pre-referral laboratory testing is a first step towards improving the specialty referral process. Our aim was to establish consensus regarding appropriate pre-referral workup for common gastrointestinal and liver conditions. The Delphi method was used to establish local consensus for recommending certain laboratory tests prior to specialty referral for 13 clinical conditions. Seven conditions from The University of Michigan outpatient referral guidelines were used as a baseline. An expert panel of three PCPs and nine gastroenterologists from three academic hospitals participated in three iterative rounds of electronic surveys. Each panellist ranked each test using a 5-point Likert scale (strongly disagree to strongly agree). Local panellists could recommend additional tests for the initial diagnoses, and also recommended additional diagnoses needing guidelines: iron deficiency anaemia, abdominal pain, irritable bowel syndrome, fatty liver disease, liver mass and cirrhosis. Consensus was defined as ≥70% of experts scoring ≥4 (agree or strongly agree). Applying Delphi methodology to extrapolate externally developed referral guidelines for local implementation resulted in considerable modifications. For some conditions, many tests from the external group were eliminated by the local group (abdominal bloating; iron deficiency anaemia; irritable bowel syndrome). In contrast, for chronic diarrhoea, abnormal liver enzymes and viral hepatitis, all/most original tests were retained with additional tests added. For liver mass, fatty liver disease and cirrhosis, there was high concordance among the panel with few tests added or eliminated. Consideration of externally developed referral guidelines using a consensus-building process leads to significant local tailoring and adaption. Our next steps include implementation and dissemination of these guidelines and evaluating their impact on care efficiency in clinical practice. © 2015 John Wiley & Sons, Ltd.

Development of an objective assessment tool for total laparoscopic hysterectomy: A Delphi method among experts and evaluation on a virtual reality simulator.

PubMed

Knight, Sophie; Aggarwal, Rajesh; Agostini, Aubert; Loundou, Anderson; Berdah, Stéphane; Crochet, Patrice

2018-01-01

Total Laparoscopic hysterectomy (LH) requires an advanced level of operative skills and training. The aim of this study was to develop an objective scale specific for the assessment of technical skills for LH (H-OSATS) and to demonstrate feasibility of use and validity in a virtual reality setting. The scale was developed using a hierarchical task analysis and a panel of international experts. A Delphi method obtained consensus among experts on relevant steps that should be included into the H-OSATS scale for assessment of operative performances. Feasibility of use and validity of the scale were evaluated by reviewing video recordings of LH performed on a virtual reality laparoscopic simulator. Three groups of operators of different levels of experience were assessed in a Marseille teaching hospital (10 novices, 8 intermediates and 8 experienced surgeons). Correlations with scores obtained using a recognised generic global rating tool (OSATS) were calculated. A total of 76 discrete steps were identified by the hierarchical task analysis. 14 experts completed the two rounds of the Delphi questionnaire. 64 steps reached consensus and were integrated in the scale. During the validation process, median time to rate each video recording was 25 minutes. There was a significant difference between the novice, intermediate and experienced group for total H-OSATS scores (133, 155.9 and 178.25 respectively; p = 0.002). H-OSATS scale demonstrated high inter-rater reliability (intraclass correlation coefficient [ICC] = 0.930; p<0.001) and test retest reliability (ICC = 0.877; p<0.001). High correlations were found between total H-OSATS scores and OSATS scores (rho = 0.928; p<0.001). The H-OSATS scale displayed evidence of validity for assessment of technical performances for LH performed on a virtual reality simulator. The implementation of this scale is expected to facilitate deliberate practice. Next steps should focus on evaluating the validity of the scale in the operating room.

Modified Policy-Delphi study for exploring obesity prevention priorities.

PubMed

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-09-06

Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of 'intrusiveness' has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Pharmacy executives: leadership issues and associated skills, knowledge, and abilities in the U.S. Department of Defense.

PubMed

Meadows, Andrew B; Finstuen, Kenn; Hudak, Ronald P

2003-01-01

To identify the issues or problems that current and aspiring U.S. Department of Defense (DoD) pharmacy executives will face in the future and to define the skills, knowledge, and abilities (SKAs) required to successfully address these issues. Delphi method for executive decision making. DoD. Ninety-three pharmacists serving in the military grades of lieutenant colonel/commander and colonel/captain, as well as pharmacists selected for promotion to those grades. iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants identified five major issues believed to be of greatest importance to pharmacy executives and reported specific SKAs that might be needed to successfully manage those issues. An expert panel sorted these issues into meaningful domains, then provided an appropriate title for each domain. Round 2--on a 7-point scale, respondents rated the SKA items according to their assessment of how much a future DoD pharmacy executive would need each SKA. Response rates were 44.1% and 46.2% for Delphi rounds 1 and 2, respectively. The first round generated 62 unique issues facing pharmacy executives. The expert panel reviewed and sorted the issues into eight domains and selected an appropriate title for each domain. The domains identified by the panel were human resources, pharmacy operations/business practices, information management and technology, financial resources, formulary management, drug therapy management, pharmacy benefit management, and leadership. During round 2, 73.3% of the top 15 rated SKAs came from the drug therapy management, leadership, and formulary management domains. The three highest-rated SKAs were "ability to see the big picture," "ability to build strong relations with medical staffs," and "skills in both writing and verbal communication." The issues facing future DoD pharmacy executives will require them to expand their clinical abilities as well as their ability to collaborate and communicate with other professionals.

Consensus-Based Attributes for Identifying Patients With Spasmodic Dysphonia and Other Voice Disorders.

PubMed

Ludlow, Christy L; Domangue, Rickie; Sharma, Dinesh; Jinnah, H A; Perlmutter, Joel S; Berke, Gerald; Sapienza, Christine; Smith, Marshall E; Blumin, Joel H; Kalata, Carrie E; Blindauer, Karen; Johns, Michael; Hapner, Edie; Harmon, Archie; Paniello, Randal; Adler, Charles H; Crujido, Lisa; Lott, David G; Bansberg, Stephen F; Barone, Nicholas; Drulia, Teresa; Stebbins, Glenn

2018-06-21

A roadblock for research on adductor spasmodic dysphonia (ADSD), abductor SD (ABSD), voice tremor (VT), and muscular tension dysphonia (MTD) is the lack of criteria for selecting patients with these disorders. To determine the agreement among experts not using standard guidelines to classify patients with ABSD, ADSD, VT, and MTD, and develop expert consensus attributes for classifying patients for research. From 2011 to 2016, a multicenter observational study examined agreement among blinded experts when classifying patients with ADSD, ABSD, VT or MTD (first study). Subsequently, a 4-stage Delphi method study used reiterative stages of review by an expert panel and 46 community experts to develop consensus on attributes to be used for classifying patients with the 4 disorders (second study). The study used a convenience sample of 178 patients clinically diagnosed with ADSD, ABSD, VT MTD, vocal fold paresis/paralysis, psychogenic voice disorders, or hypophonia secondary to Parkinson disease. Participants were aged 18 years or older, without laryngeal structural disease or surgery for ADSD and underwent speech and nasolaryngoscopy video recordings following a standard protocol. Speech and nasolaryngoscopy video recordings following a standard protocol. Specialists at 4 sites classified 178 patients into 11 categories. Four international experts independently classified 75 patients using the same categories without guidelines after viewing speech and nasolaryngoscopy video recordings. Each member from the 4 sites also classified 50 patients from other sites after viewing video clips of voice/laryngeal tasks. Interrater κ less than 0.40 indicated poor classification agreement among rater pairs and across recruiting sites. Consequently, a Delphi panel of 13 experts identified and ranked speech and laryngeal movement attributes for classifying ADSD, ABSD, VT, and MTD, which were reviewed by 46 community specialists. Based on the median attribute rankings, a final attribute list was created for each disorder. When classifying patients without guidelines, raters differed in their classification distributions (likelihood ratio, χ2 = 107.66), had poor interrater agreement, and poor agreement with site categories. For 11 categories, the highest agreement was 34%, with no κ values greater than 0.26. In external rater pairs, the highest κ was 0.23 and the highest agreement was 38.5%. Using 6 categories, the highest percent agreement was 73.3% and the highest κ was 0.40. The Delphi method yielded 18 attributes for classifying disorders from speech and nasolaryngoscopic examinations. Specialists without guidelines had poor agreement when classifying patients for research, leading to a Delphi-based development of the Spasmodic Dysphonia Attributes Inventory for classifying patients with ADSD, ABSD, VT, and MTD for research.

Development and validation of a professionalism assessment scale for medical students

PubMed Central

Klemenc-Ketis, Zalika; Vrecko, Helena

2014-01-01

Objectives To develop and validate a scale for the assess-ment of professionalism in medical students based on students' perceptions of and attitudes towards professional-ism in medicine. Methods This was a mixed methods study with under-graduate medical students. Two focus groups were carried out with 12 students, followed by a transcript analysis (grounded theory method with open coding). Then, a 3-round Delphi with 20 family medicine experts was carried out. A psychometric assessment of the scale was performed with a group of 449 students. The items of the Professional-ism Assessment Scale could be answered on a five-point Likert scale. Results After the focus groups, the first version of the PAS consisted of 56 items and after the Delphi study, 30 items remained. The final sample for quantitative study consisted of 122 students (27.2% response rate). There were 95 (77.9%) female students in the sample. The mean age of the sample was 22.1 ± 2.1 years. After the principal component analysis, we removed 8 items and produced the final version of the PAS (22 items). The Cronbach's alpha of the scale was 0.88. Factor analysis revealed three factors: empathy and humanism, professional relationships and development and responsibility. Conclusions The new Professionalism Assessment Scale proved to be valid and reliable. It can be used for the assessment of professionalism in undergraduate medical students. PMID:25382090

A decision-making framework for total ownership cost management of complex systems: A Delphi study

NASA Astrophysics Data System (ADS)

King, Russel J.

This qualitative study, using a modified Delphi method, was conducted to develop a decision-making framework for the total ownership cost management of complex systems in the aerospace industry. The primary focus of total ownership cost is to look beyond the purchase price when evaluating complex system life cycle alternatives. A thorough literature review and the opinions of a group of qualified experts resulted in a compilation of total ownership cost best practices, cost drivers, key performance factors, applicable assessment methods, practitioner credentials and potential barriers to effective implementation. The expert panel provided responses to the study questions using a 5-point Likert-type scale. Data were analyzed and provided to the panel members for review and discussion with the intent to achieve group consensus. As a result of the study, the experts agreed that a total ownership cost analysis should (a) be as simple as possible using historical data; (b) establish cost targets, metrics, and penalties early in the program; (c) monitor the targets throughout the product lifecycle and revise them as applicable historical data becomes available; and (d) directly link total ownership cost elements with other success factors during program development. The resultant study framework provides the business leader with incentives and methods to develop and implement strategies for controlling and reducing total ownership cost over the entire product life cycle when balancing cost, schedule, and performance decisions.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

[Construction of a psychological aging scale for healthy people].

PubMed

Lin, Fei; Long, Yao; Zeng, Ni; Wu, Lei; Huang, Helang

2017-04-28

To construct a psychological aging scale, and to provide a tool and indexes for scientific evaluation on aging.
 Methods: The age-related psychological items were collected through literature screening and expert interview. The importance, feasibilityand the degree of authority for the psychological index system were graded by two rounds of Delphi method. Using analytic hierarchy process, the weight of dimensions and items were determined. The analysis for internal consistency reliability, correlation and exploratory factor was performed to evaluate the reliability and validity of the scales.
 Results: By two rounds of Delphi method, 17 experts offered the results as follows: the coefficient of expert authorities was 0.88±0.06, the coordination coefficients for the importance and feasibility in second round were 0.456 (P<0.01) and 0.666 (P<0.01), respectively. The consistency was good. The psychological aging scale for healthy people included 4 dimensions as follows: cognitive function, emotion, personality and motivation. The weight coefficients for the 4 dimensions were 0.338, 0.250, 0.166 and 0.258, respectively. The Cronbach's α coefficient for the scale was 0.822, the reliability was 0.817, the content validity index (CVI) was 0.847, and the cumulative contribution rate for the 5 factors was51.42%.
 Conclusion: The psychological aging scale is satisfied, which can provide reference for the evaluation for aging. The indicators were representative and well-recognized.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study.

PubMed

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D

2017-01-01

As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Panelist's responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. Copyright® by the International Brazilian Journal of Urology.

Expanding Robust HCCI Operation with Advanced Valve and Fuel Control Technologies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Szybist, J. P.; Confer, K.

2012-09-11

Delphi Automotive Systems and ORNL established this CRADA to advance the commercialization potential of the homogeneous charge compression ignition (HCCI) advanced combustion strategy for gasoline engine platforms. HCCI combustion has been shown by others to produce high diesel-like efficiency on a gasoline engine platform while simultaneously producing low NOX and particulate matter emissions. However, the commercialization barriers that face HCCI combustion are significant, with requirements for a more active engine control system, likely with next-cycle closed-loop feedback control, and with advanced valve train technologies to enable negative valve overlap conditions. In the partnership between Delphi and ORNL, each organization broughtmore » a unique and complementary set of skills to the project. Delphi has made a number of breakthroughs with production-intent valve train technologies and controls in recent years to make a part time production-intent HCCI engine plausible. ORNL has extensive knowledge and expertise with HCCI combustion, and also has a versatile research engine with hydraulic valve actuation (HVA) that is useful for guiding production of a cam-based HCCI system. Partnering these knowledge bases and capabilities was essential towards making progress to better understand HCCI combustion and the commercialization barriers that it faces. ORNL and Delphi maintained strong collaboration throughout the project. Meetings were held regularly, with additional reports, presentations, and meetings as necessary to maintain progress. Delphi provided guidance to ORNL regarding operational strategies to investigate on their single-cylinder research engine with HVA and data from their experimental multi-cylinder engine for modeling. ORNL provided single-cylinder engine data and modeling results.« less

Weighting Criteria and Prioritizing of Heat stress indices in surface mining using a Delphi Technique and Fuzzy AHP-TOPSIS Method.

PubMed

Asghari, Mehdi; Nassiri, Parvin; Monazzam, Mohammad Reza; Golbabaei, Farideh; Arabalibeik, Hossein; Shamsipour, Aliakbar; Allahverdy, Armin

2017-01-01

Heat stress as a physical harmful agent can increase the risk of health and safety problems in different workplaces such as mining. Although there are different indices to assess the heat stress imposed on workers, choosing the best index for a specific workplace is so important. Since various criteria affect an index applicability, extracting the most effective ones and determining their weights help to prioritize the existing indices and select the optimal index. In order to achieve this aim, present study compared some heat stress indices using effective methods. The viewpoints of occupational health experts and the qualitative Delphi methods were used to extract the most important criteria. Then, the weights of 11 selected criteria were determined by Fuzzy Analytic Hierarchy Process. Finally, fuzzy TOPSIS technique was applied for choosing the most suitable heat stress index. According to result, simplicity, reliability, being low cost, and comprehensiveness were the most determinative criteria for a heat stress index. Based on these criteria and their weights, the existing indices were prioritized. Eventually, wet bulb glob temperature appropriated the first priority and it was proposed as an applicable index for evaluating the heat stress at outdoor hot environments such as surface mines. The use of these strong methods allows introducing the most simple, precise, and applicable tool for evaluation the heat stress in hot environments. It seems that WBGT acts as an appropriate index for assessing the heat stress in mining activities at outdoors.

A core outcome set for clinical trials on non-specific low back pain: study protocol for the development of a core domain set.

PubMed

Chiarotto, Alessandro; Terwee, Caroline B; Deyo, Richard A; Boers, Maarten; Lin, Chung-Wei Christine; Buchbinder, Rachelle; Corbin, Terry P; Costa, Leonardo O P; Foster, Nadine E; Grotle, Margreth; Koes, Bart W; Kovacs, Francisco M; Maher, Chris G; Pearson, Adam M; Peul, Wilco C; Schoene, Mark L; Turk, Dennis C; van Tulder, Maurits W; Ostelo, Raymond W

2014-12-26

Low back pain (LBP) is one of the most disabling and costly disorders affecting modern society, and approximately 90% of patients are labelled as having non-specific LBP (NSLBP). Several interventions for patients with NSLBP have been assessed in clinical trials, but heterogeneous reporting of outcomes in these trials has hindered comparison of results and performance of meta-analyses. Moreover, there is a risk of selective outcome reporting bias. To address these issues, the development of a core outcome set (COS) that should be measured in all clinical trials for a specific health condition has been recommended. A standardized set of outcomes for LBP was proposed in 1998, however, with evolution in COS development methodology, new instruments, interventions, and understanding of measurement properties, it is appropriate to update that proposal. This protocol describes the methods used in the initial step in developing a COS for NSLBP, namely, establishing a core domain set that should be measured in all clinical trials. An International Steering Committee including researchers, clinicians, and patient representatives from four continents was formed to guide the development of this COS. The approach of initiatives like Core Outcome Measures in Effectiveness Trials (COMET) and Outcome Measures in Rheumatology (OMERACT) was followed. Participants were invited to participate in a Delphi study aimed at generating a consensus-based core domain set for NSLBP. A list of potential core domains was drafted and presented to the Delphi participants who were asked to judge which domains were core. Participant suggestions about overlap, aggregation, or addition of potential core domains were addressed during the study. The patients' responses were isolated to assess whether there was substantial disagreement with the rest of the Delphi panel. A priori thresholds for consensus were established before each Delphi round. All participants' responses were analysed from a quantitative and qualitative perspective to ascertain that no substantial discrepancies between the two approaches emerged. We present the initial step in developing a COS for NSLBP. The next step will be to determine which measurement instruments adequately cover the domains.

Stakeholder involvement in establishing a milk quality sub-index in dairy cow breeding goals: a Delphi approach.

PubMed

Henchion, M; McCarthy, M; Resconi, V C; Berry, D P; McParland, S

2016-05-01

The relative weighting on traits within breeding goals are generally determined by bio-economic models or profit functions. While such methods have generally delivered profitability gains to producers, and are being expanded to consider non-market values, current approaches generally do not consider the numerous and diverse stakeholders that affect, or are affected, by such tools. Based on principles of respondent anonymity, iteration, controlled feedback and statistical aggregation of feedback, a Delphi study was undertaken to gauge stakeholder opinion of the importance of detailed milk quality traits within an overall dairy breeding goal for profit, with the aim of assessing its suitability as a complementary, participatory approach to defining breeding goals. The questionnaires used over two survey rounds asked stakeholders: (a) their opinion on incorporating an explicit sub-index for milk quality into a national breeding goal; (b) the importance they would assign to a pre-determined list of milk quality traits and (c) the (relative) weighting they would give such a milk quality sub-index. Results from the survey highlighted a good degree of consensus among stakeholders on the issues raised. Similarly, revelation of the underlying assumptions and knowledge used by stakeholders to make their judgements illustrated their ability to consider a range of perspectives when evaluating traits, and to reconsider their answers based on the responses and rationales given by others, which demonstrated social learning. Finally, while the relative importance assigned by stakeholders in the Delphi survey (4% to 10%) and the results of calculations based on selection index theory of the relative emphasis that should be placed on milk quality to halt any deterioration (16%) are broadly in line, the difference indicates the benefit of considering more than one approach to determining breeding goals. This study thus illustrates the role of the Delphi technique, as a complementary approach to traditional approaches, to defining breeding goals. This has implications for how breeding goals will be defined and in determining who should be involved in the decision-making process.

Establishing nursing-sensitive quality indicators for the operating room: A cross-sectional Delphi survey conducted in China.

PubMed

Wu, Qi; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-01-01

Nursing-sensitive quality indicators comprise principles, procedures, and assessments to quantify the level of nursing quality in hospital departments. Although studies have demonstrated that quality indicators are essential for monitoring nursing practice in the operating room (OR), nursing quality in China is highly subjective and localised OR nursing-sensitive quality indicators are lacking. This study aimed to establish scientific, objective and comprehensive nursing-sensitive quality indicators for the OR to evaluate and monitor OR nursing care quality in China. Literature search for relevant evidence-based studies was performed using Cochrane, Medline, PubMed, Embase, and other databases, followed by literature review and group discussion by the expert panel. Two successive rounds of Delphi surveys were conducted using questionnaires completed by the expert panel to reach consensus and define nursing-sensitive quality indicators for the OR. Two rounds of Delphi surveys each had 100% questionnaire retrieval rate, with Kendall W coordination coefficients ranging from 0.096 to 0.263 (P<0.001). In round 1 of expert evaluation of 26 indicators, Kendall's W was 0.263 for importance, 0.126 for rationality, and 0.125 for feasibility of data collection (all P<0.001). After round 2, 23 items were established as OR nursing-sensitive quality indicators, including rates of work time wastage, surgery start-time delay, OR turnover time between surgeries, same-day surgery cancellation, and number of monthly surgeries in each OR; checking surgical patients, surgery site marking, allergy history, and antibiotics use 60min before incision; and also assessing expected surgical time, sterilisation indicator results, availability of surgical instruments and materials, and instrument count. Scientific, practical, and reliable OR nursing-sensitive quality indicators can be established based on evidence-based studies and expert consensus using the Delphi method. The quality indicators developed in this study may provide an objective and quantitative reference for evaluating nursing quality in Chinese ORs. Copyright © 2016 Australian College of Critical Care Nurses Ltd. Published by Elsevier Ltd. All rights reserved.

Insufficiently studied factors related to burnout in nursing: Results from an e-Delphi study

PubMed Central

2017-01-01

Objective This study aimed to identify potentially important factors in explaining burnout in nursing that have been insufficiently studied or ignored. Methods A three-round Delphi study via e-mail correspondence was conducted, with a group of 40 European experts. The e-Delphi questionnaire consisted of 52 factors identified from a literature review. Experts rated and scored the importance of factors in the occurrence of burnout and the degree of attention given by researchers to each of the variables listed, on a six-point Likert scale. We used the agreement percentage (>80%) to measure the level of consensus between experts. Furthermore, to confirm the level of consensus, we also calculated mean scores and modes. Regardless of the degree of consensus reached by the experts, we have calculated the mean of the stability of the answers for each expert (individual's qualitative stability) and the mean of the stability percentages of the experts (qualitative group stability). Results The response rate in the three rounds was 93.02% (n = 40). Eight new factors were suggested in the first round. After modified, the e-Delphi questionnaire in the second and third rounds had 60 factors. All the factors reached the third round with a consensus level above 80% in terms of the attention that researchers gave them in their studies. Moreover, the data show a total mean qualitative group stability of 96.21%. In the third round 9 factors were classified by experts as ‘studied very little’, 17 as ‘studied little’ and 34 as 'well studied' Conclusion Findings show that not all the factors that may influence nursing burnout have received the same attention from researchers. The panel of experts has identified factors that, although important in explaining burnout, have been poorly studied or even forgotten. Our results suggest that further study into factors such as a lack of recognition of part of the tasks that nurses perform, feminine stereotype or excessive bureaucracy is needed for a better understanding of this syndrome and improve the quality of life in nurses. PMID:28388660

A Study to Identify the Training Needs of Life Insurance Sales Representatives in Taiwan Using the Delphi Approach

ERIC Educational Resources Information Center

Fan, Chiang Ku; Cheng, Chen-Liang

2006-01-01

This article reports a study conducted to identify the needs for continuing professional development for life insurance sales representatives and to examine the competencies needed by those sales representatives. A modified Delphi technique was used. Most life insurance companies in the USA implement an education and training plan advocated by the…

A Delphi-Based Approach for Detecting Key E-Learning Trends in Postgraduate Education: The Spanish Case

ERIC Educational Resources Information Center

Lopez-Catalan, Blanca; Bañuls, Victor A.

2017-01-01

Purpose: The purpose of this paper is to present the results of national level Delphi study carried out in Spain aimed at providing inputs for higher education administrators and decision makers about key e-learning trends for supporting postgraduate courses. Design/methodology/approach: The ranking of the e-learning trends is based on a…

An Analysis of Factors that Inhibit Business Use of User-Centered Design Principles: A Delphi Study

ERIC Educational Resources Information Center

Hilton, Tod M.

2010-01-01

The use of user-centered design (UCD) principles has a positive impact on the use of web-based interactive systems in customer-centric organizations. User-centered design methodologies are not widely adopted in organizations due to intraorganizational factors. A qualitative study using a modified Delphi technique was used to identify the factors…

75 FR 41523 - Delphi Corporation, a Subsidiary of Delphi Holdings, LLC, Including On-Site Leased Workers From...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-16

... workers are engaged in the production of fuel modules, instrument clusters, and air meters. The review... production of instrument clusters, separated from employment on or after March 30, 2006 through May 15, 2009... date established for TA-W-70,988 to read May 16, 2009 for workers producing instrument clusters and...