Achieving Consensus for the Design and Delivery of an Online Intervention to Support Midwives in Work-Related Psychological Distress: Results From a Delphi Study

PubMed Central

Clyne, Wendy

2016-01-01

Background Some midwives are known to experience both professional and organizational sources of psychological distress, which can manifest as a result of the emotionally demanding midwifery work, and the traumatic work environments they endure. An online intervention may be one option midwives may engage with in pursuit of effective support. However, the priorities for the development of an online intervention to effectively support midwives in work-related psychological distress have yet to be explored. Objective The aim of this study was to explore priorities in the development of an online intervention to support midwives in work-related psychological distress. Methods A two-round online Delphi study was conducted. This study invited both qualitative and quantitative data from experts recruited via a scoping literature search and social media channels. Results In total, 185 experts were invited to participate in this Delphi study. Of all participants invited to contribute, 35.7% (66/185) completed Round 1 and of those who participated in this first round, 67% (44/66) continued to complete Round 2. Out of 39 questions posed over two rounds, 18 statements (46%) achieved consensus, 21 (54%) did not. Participants were given the opportunity to write any additional comments as free text. In total, 1604 free text responses were collected and categorized into 2446 separate statements of opinion, creating a total of 442 themes. Overall, participants agreed that in order to effectively support midwives in work-related psychological distress, online interventions should make confidentiality and anonymity a high priority, along with 24-hour mobile access, effective moderation, an online discussion forum, and additional legal, educational, and therapeutic components. It was also agreed that midwives should be offered a simple user assessment to identify those people deemed to be at risk of either causing harm to others or experiencing harm themselves, and direct them to appropriate support. Conclusions This study has identified priorities for the development of online interventions to effectively support midwives in work-related psychological distress. The impact of any future intervention of this type will be optimized by utilizing these findings in the development process. PMID:27405386

The development of a consensus-based nutritional pathway for infants with CHD before surgery using a modified Delphi process.

PubMed

Marino, Luise V; Johnson, Mark J; Hall, Nigel J; Davies, Natalie J; Kidd, Catherine S; Daniels, M Lowri; Robinson, Julia E; Richens, Trevor; Bharucha, Tara; Darlington, Anne-Sophie E

2018-04-29

IntroductionDespite improvements in the medical and surgical management of infants with CHD, growth failure before surgery in many infants continues to be a significant concern. A nutritional pathway was developed, the aim of which was to provide a structured approach to nutritional care for infants with CHD awaiting surgery.Materials and methodsThe modified Delphi process was development of a nutritional pathway; initial stakeholder meeting to finalise draft guidelines and develop questions; round 1 anonymous online survey; round 2 online survey; regional cardiac conference and pathway revision; and final expert meeting and pathway finalisation. Paediatric Dietitians from all 11 of the paediatric cardiology surgical centres in the United Kingdom contributed to the guideline development. In all, 33% of participants had 9 or more years of experience working with infants with CHD. By the end of rounds 1 and 2, 76 and 96% of participants, respectively, were in agreement with the statements. Three statements where consensus was not achieved by the end of round 2 were discussed and agreed at the final expert group meeting. Nutrition guidelines were developed for infants with CHD awaiting surgery, using a modified Delphi process, incorporating the best available evidence and expert opinion with regard to nutritional support in this group.

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study.

PubMed

Blackwood, Bronagh; Ringrow, Suzanne; Clarke, Mike; Marshall, John; Rose, Louise; Williamson, Paula; McAuley, Danny

2015-08-20

Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children. We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes. The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

Electronic-Imen-Delphi (EID): An Online Conferencing Procedure.

ERIC Educational Resources Information Center

Passig, David; Sharbat, Aviva

2000-01-01

Examines the efficiency of the Imen-Delphi (ID) technique as an electronic procedure for conferencing that helps participants clarify their opinions and expectations regarding preferable and possible futures. Describes an electronic version of the original ID procedure and tested its efficiency among a group of experts on virtual reality and…

Best Practices Framework for Online Faculty Professional Development: A Delphi Study

ERIC Educational Resources Information Center

Mohr, Sandra Coswatte; Shelton, Kaye

2017-01-01

Online learning is now a common practice in higher education. Because of the continued online enrollment growth, higher educational institutions must prepare faculty throughout their teaching career for learning theory, technical expertise, and pedagogical shifts for teaching in the online environment. This study presents best practices for…

Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis Standard Reporting and Evaluation Guidelines: Results of a National Institutes of Health Working Group.

PubMed

Maverakis, Emanual; Wang, Elizabeth A; Shinkai, Kanade; Mahasirimongkol, Surakameth; Margolis, David J; Avigan, Mark; Chung, Wen-Hung; Goldman, Jennifer; La Grenade, Lois; Pirmohamed, Munir; Shear, Neil H; Tassaeeyakul, Wichittra; Hoetzenecker, Wolfram; Klaewsongkram, Jettanong; Rerkpattanapipat, Ticha; Manuyakorn, Wiparat; Yasuda, Sally Usdin; Sharon, Victoria R; Sukhov, Andrea; Micheletti, Robert; Struewing, Jeff; French, Lars E; Cheng, Michelle Y

2017-06-01

Toxic epidermal necrolysis (TEN) and Stevens-Johnson Syndrome (SJS) are rare, acute, life-threatening dermatologic disorders involving the skin and mucous membranes. Research into these conditions is hampered by a lack of standardization of case reporting and data collection. To establish a standardized case report form to facilitate comparisons and maintain data quality based on an international panel of SJS/TEN experts who performed a Delphi consensus-building exercise. The elements presented for committee scrutiny were adapted from previous case report forms and from PubMed literature searches of highly cited manuscripts pertaining to SJS/TEN. The expert opinions and experience of the members of the consensus group were included in the discussion. Overall, 21 out of 29 experts who were invited to participate in the online Delphi exercise agreed to participate. Surveys at each stage were administered via an online survery software tool. For the first 2 Delphi rounds, results were analyzed using the Interpercentile Range Adjusted for Symmetry method and statements that passed consensus formulated a new case report form. For the third Delphi round, the case report form was presented to the committee, who agreed that it was "appropriate and useful" for documenting cases of SJS/TEN, making it more reliable and valuable for future research endeavors. With the consensus of international experts, a case report form for SJS/TEN has been created to help standardize the collection of patient information in future studies and the documentation of individual cases.

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method.

PubMed

Yeh, James S; Van Hoof, Thomas J; Fischer, Michael A

2016-02-01

Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process.

The Modified Delphi Method to Analyze the Application of Instructional Design Theory to Online Graduate Education

ERIC Educational Resources Information Center

Zeedick, Danielle Marie

2010-01-01

During the past several decades, the field of instructional design theory has experienced changes in what is mostly applied to traditional, on-ground education. While instructional design theory has been (and still is being) discussed, constructed, and deconstructed, there has been no agreement among prominent instructional design theory…

DelPhi Web Server: A comprehensive online suite for electrostatic calculations of biological macromolecules and their complexes

PubMed Central

Sarkar, Subhra; Witham, Shawn; Zhang, Jie; Zhenirovskyy, Maxim; Rocchia, Walter; Alexov, Emil

2011-01-01

Here we report a web server, the DelPhi web server, which utilizes DelPhi program to calculate electrostatic energies and the corresponding electrostatic potential and ionic distributions, and dielectric map. The server provides extra services to fix structural defects, as missing atoms in the structural file and allows for generation of missing hydrogen atoms. The hydrogen placement and the corresponding DelPhi calculations can be done with user selected force field parameters being either Charmm22, Amber98 or OPLS. Upon completion of the calculations, the user is given option to download fixed and protonated structural file, together with the parameter and Delphi output files for further analysis. Utilizing Jmol viewer, the user can see the corresponding structural file, to manipulate it and to change the presentation. In addition, if the potential map is requested to be calculated, the potential can be mapped onto the molecule surface. The DelPhi web server is available from http://compbio.clemson.edu/delphi_webserver. PMID:24683424

Content Analysis of Major Textbooks and Online Resources Used in Responsible Conduct of Research Instruction

PubMed Central

Kon, Alexander A.; Schilling, Debie A.; Heitman, Elizabeth; Steneck, Nicholas H.; DuBois, James M.

2011-01-01

Instruction in the responsible conduct of research (RCR) is required for all trainees funded by the National Institues of Health (NIH) or National Science Foundation (NSF). A recent Delphi study identified 53 key topics in 7 core areas that RCR education experts felt should be included in this instruction, which is required of many trainees in clinical and translational research. We performed a content analysis of major textbooks and online resources used in RCR instruction to determine the extent to which the 53 key topics identified in the Delphi study are covered by these resources. Textbooks and online resources used in RCR education at Clinical and Translational Science Award institutions were identified via survey. These resources were subjected to a content analysis. The 53 key topics identified in the Delphi study formed the basis of these analyses. We identified 10 textbooks and 1 online resource currently in use. Of the 53 key topics, only 4 were included in all 11 resources, and another 12 were included in 10. Twenty-three topics were covered in fewer than 65% of the resources, and two topics were absent from nearly all. Educators in clinical and translational research should be aware of key topics that are not covered in the RCR textbooks and online resources they may use and should consider augmenting discussion of such topics with other materials. PMID:21766046

Inexpensive News Sources.

ERIC Educational Resources Information Center

Briscoe, Ellen D.; Wall, Catherine

1992-01-01

Describes consumer or business-oriented online services that provide access to current news information and offers a less expensive alternative to standard online databases. Online clipping services are discussed, their costs are examined, and profiles of five services are compared: CompuServe, CompuServe as a gateway to IQuest, DELPHI, DIALCOM,…

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study

PubMed Central

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-01-01

Objectives To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. Methods A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. Results In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Conclusions Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. PMID:24670554

Technical College Instructors' Perceptions of the Impact of Online Readiness and of Student Support Services on Student Success in Online Courses

ERIC Educational Resources Information Center

Dowd, Nathan

2012-01-01

The purpose of this study is to determine how Wisconsin Technical College (WTCS) administrators and online instructors perceive the impact of online learner readiness and student support services to be on student success in online courses. The study used a modified three-round Delphi technique to determine to collect data. The results indicated…

The development of ethical guidelines for nurses' collegiality using the Delphi method.

PubMed

Kangasniemi, Mari; Arala, Katariina; Becker, Eve; Suutarla, Anna; Haapa, Toni; Korhonen, Anne

2017-08-01

Nurses' collegiality is topical because patient care is complicated, requiring shared knowledge and working methods. Nurses' collaboration has been supported by a number of different working models, but there has been less focus on ethics. This study aimed to develop nurses' collegiality guidelines using the Delphi method. Two online panels of Finnish experts, with 35 and 40 members, used the four-step Delphi method in December 2013 and January 2014. They reformulated the items of nurses' collegiality identified by the literature and rated based on validity and importance. Content analysis and descriptive statistical methods were used to analyze the data, and the nurses' collegiality guidelines were formulated. Ethical considerations: Organizational approval was received, and an informed consent was obtained from all participants. Information about the voluntary nature of participation was provided. During the first Delphi panel round, a number of items were reformulated and added, resulting in 32 reformulated items. As a result of the second round, 8 of the 32 items scored an agreement rate of more than 75%, with the most rated item being collegiality means that professionals respect each other. The item with second highest rating was collegiality has a common objective: what is best for patients, followed by the third highest which was professional ethics is the basis of collegiality. Nurses' collegiality and its content are well recognized in clinical practice but seldom studied. Collegiality can be supported by guidelines, and nurses working in clinical practice, together with teachers and managers, have shared responsibilities to support and develop it. More research in different nursing environments is needed to improve understanding of the content and practice of nursing collegiality.

Creation and Delphi-method refinement of pediatric disaster triage simulations.

PubMed

Cicero, Mark X; Brown, Linda; Overly, Frank; Yarzebski, Jorge; Meckler, Garth; Fuchs, Susan; Tomassoni, Anthony; Aghababian, Richard; Chung, Sarita; Garrett, Andrew; Fagbuyi, Daniel; Adelgais, Kathleen; Goldman, Ran; Parker, James; Auerbach, Marc; Riera, Antonio; Cone, David; Baum, Carl R

2014-01-01

There is a need for rigorously designed pediatric disaster triage (PDT) training simulations for paramedics. First, we sought to design three multiple patient incidents for EMS provider training simulations. Our second objective was to determine the appropriate interventions and triage level for each victim in each of the simulations and develop evaluation instruments for each simulation. The final objective was to ensure that each simulation and evaluation tool was free of bias toward any specific PDT strategy. We created mixed-methods disaster simulation scenarios with pediatric victims: a school shooting, a school bus crash, and a multiple-victim house fire. Standardized patients, high-fidelity manikins, and low-fidelity manikins were used to portray the victims. Each simulation had similar acuity of injuries and 10 victims. Examples include children with special health-care needs, gunshot wounds, and smoke inhalation. Checklist-based evaluation tools and behaviorally anchored global assessments of function were created for each simulation. Eight physicians and paramedics from areas with differing PDT strategies were recruited as Subject Matter Experts (SMEs) for a modified Delphi iterative critique of the simulations and evaluation tools. The modified Delphi was managed with an online survey tool. The SMEs provided an expected triage category for each patient. The target for modified Delphi consensus was ≥85%. Using Likert scales and free text, the SMEs assessed the validity of the simulations, including instances of bias toward a specific PDT strategy, clarity of learning objectives, and the correlation of the evaluation tools to the learning objectives and scenarios. After two rounds of the modified Delphi, consensus for expected triage level was >85% for 28 of 30 victims, with the remaining two achieving >85% consensus after three Delphi iterations. To achieve consensus, we amended 11 instances of bias toward a specific PDT strategy and corrected 10 instances of noncorrelation between evaluations and simulation. The modified Delphi process, used to derive novel PDT simulation and evaluation tools, yielded a high degree of consensus among the SMEs, and eliminated biases toward specific PDT strategies in the evaluations. The simulations and evaluation tools may now be tested for reliability and validity as part of a prehospital PDT curriculum.

Best Practices of Online Undergraduate Spiritual Formation at Select Institutions of Christian Higher Education: A Delphi Study

ERIC Educational Resources Information Center

Ledbetter, Neal Brian

2017-01-01

The purpose of this research project was to establish consensus among experts regarding best practices of online undergraduate spiritual formation with a specific focus on the Council for Christian Colleges and Universities (CCCU). Prior to this project, there was no consensus regarding best practices of online spiritual formation at the…

Understanding and Supporting Online Communities of Practice: Lessons Learned from Wikipedia

ERIC Educational Resources Information Center

Zhao, Xiaoli; Bishop, M. J.

2011-01-01

In order to seek more effective ways to design and support online communities of practice, we examined how Wikipedia, a large-scale online community of practice, is developed and emerges over time. We conducted a Delphi study to explore the social, organizational, and technical factors that Wikipedia experts believe have supported the evolution of…

Development of the Austrian Nursing Minimum Data Set (NMDS-AT): the third Delphi Round, a quantitative online survey.

PubMed

Ranegger, Renate; Hackl, Werner O; Ammenwerth, Elske

2015-01-01

A Nursing Minimum Data Set (NMDS) aims at systematically describing nursing care in terms of patient problems, nursing activities, and patient outcomes. In an earlier Delphi study, 56 data elements were proposed to be included in an Austrian Nursing Minimum Data Set (NMDS-AT). To identify the most important data elements of this list, and to identify appropriate coding systems. Online Delphi-based survey with 88 experts. 43 data elements were rated as relevant for an NMDS-AT (strong agreement of more than half of the experts): nine data elements concerning the institution, patient demographics, and medical condition; 18 data elements concerning patient problems by using nursing diagnosis; seven data elements concerning nursing outcomes, and nine data elements concerning nursing interventions. As classification systems, national classification systems were proposed besides ICNP, NNN, and nursing-sensitive indicators. The resulting proposal for an NMDS-AT will now be tested with routine data.

Roles and Domains to Teach in Online Learning Environments: Educational ICT Competency Framework for University Teachers

NASA Astrophysics Data System (ADS)

Guasch, Teresa; Alvarez, Ibis; Espasa, Anna

This chapter is aimed at presenting an integrated framework of the educational information and communications technology (ICT) competencies that university teachers should have to teach in an online learning environment. Teaching through ICT in higher education involves performing three main roles - pedagogical, socialist, and design/planning - and also two cross-cutting domains that arise from the online environment: technological and managerial. This framework as well as the competencies for university teachers associated with it were validated at a European level by a dual process of net-based focus groups of teachers and teacher trainers in each of the participating countries in a European Project (Elene-TLC) and an online Delphi method involving 78 experts from 14 universities of ten European countries. The competency framework and the examples provided in the chapter are the basis for designing innovative professional development activities in online university environments.

A Delphi Study to Examine the Quality Measurement Standards by Online Instructors Using the Quality Matters™ Rubric as a Basis for Creating Instructional Materials

ERIC Educational Resources Information Center

Robinson, Daniel J.

2017-01-01

Quality measurement tools such as the Rubric for Online Instruction (ROI) and Quality Matters (QM) have developed guidelines by providing research based educational criteria for planning, creating, and implementing quality online education courses. This dissertation reviews QM program standards and identifies the primary characteristics of…

Best Practices for Designing Online Learning Environments for 3D Modeling Curricula: A Delphi Study

ERIC Educational Resources Information Center

Mapson, Kathleen Harrell

2011-01-01

The purpose of this study was to develop an inventory of best practices for designing online learning environments for 3D modeling curricula. Due to the instructional complexity of three-dimensional modeling, few have sought to develop this type of course for online teaching and learning. Considering this, the study aimed to collectively aggregate…

A core outcome set for evaluating self-management interventions in people with comorbid diabetes and severe mental illness: study protocol for a modified Delphi study and systematic review.

PubMed

Taylor, Johanna; Böhnke, Jan R; Wright, Judy; Kellar, Ian; Alderson, Sarah L; Hughes, Tom; Holt, Richard I G; Siddiqi, Najma

2017-02-14

People with diabetes and comorbid severe mental illness (SMI) form a growing population at risk of increased mortality and morbidity compared to those with diabetes or SMI alone. There is increasing interest in interventions that target diabetes in SMI in order to help to improve physical health and reduce the associated health inequalities. However, there is a lack of consensus about which outcomes are important for this comorbid population, with trials differing in their focus on physical and mental health. A core outcome set, which includes outcomes across both conditions that are relevant to patients and other key stakeholders, is needed. This study protocol describes methods to develop a core outcome set for use in effectiveness trials of self-management interventions for adults with comorbid type-2 diabetes and SMI. We will use a modified Delphi method to identify, rank, and agree core outcomes. This will comprise a two-round online survey and multistakeholder workshops involving patients and carers, health and social care professionals, health care commissioners, and other experts (e.g. academic researchers and third sector organisations). We will also select appropriate measurement tools for each outcome in the proposed core set and identify gaps in measures, where these exist. The proposed core outcome set will provide clear guidance about what outcomes should be measured, as a minimum, in trials of interventions for people with coexisting type-2 diabetes and SMI, and improve future synthesis of trial evidence in this area. We will also explore the challenges of using online Delphi methods for this hard-to-reach population, and examine differences in opinion about which outcomes matter to diverse stakeholder groups. COMET registration: http://www.comet-initiative.org/studies/details/911 . Registered on 1 July 2016.

Developing a Constructivist Learning Environment in Online Postsecondary Science Courses

ERIC Educational Resources Information Center

Hackworth, Sylvester N.

2010-01-01

This Delphi study addressed the concerns of postsecondary educators regarding the quality of education received by postsecondary science students who receive their instruction online. This study was framed with the constructivist learning theory and Piaget's and Dewey's cognitive development theories. The overarching question addressed a gap in…

A consensus-based framework for design, validation, and implementation of simulation-based training curricula in surgery.

PubMed

Zevin, Boris; Levy, Jeffrey S; Satava, Richard M; Grantcharov, Teodor P

2012-10-01

Simulation-based training can improve technical and nontechnical skills in surgery. To date, there is no consensus on the principles for design, validation, and implementation of a simulation-based surgical training curriculum. The aim of this study was to define such principles and formulate them into an interoperable framework using international expert consensus based on the Delphi method. Literature was reviewed, 4 international experts were queried, and consensus conference of national and international members of surgical societies was held to identify the items for the Delphi survey. Forty-five international experts in surgical education were invited to complete the online survey by ranking each item on a Likert scale from 1 to 5. Consensus was predefined as Cronbach's α ≥0.80. Items that 80% of experts ranked as ≥4 were included in the final framework. Twenty-four international experts with training in general surgery (n = 11), orthopaedic surgery (n = 2), obstetrics and gynecology (n = 3), urology (n = 1), plastic surgery (n = 1), pediatric surgery (n = 1), otolaryngology (n = 1), vascular surgery (n = 1), military (n = 1), and doctorate-level educators (n = 2) completed the iterative online Delphi survey. Consensus among participants was achieved after one round of the survey (Cronbach's α = 0.91). The final framework included predevelopment analysis; cognitive, psychomotor, and team-based training; curriculum validation evaluation and improvement; and maintenance of training. The Delphi methodology allowed for determination of international expert consensus on the principles for design, validation, and implementation of a simulation-based surgical training curriculum. These principles were formulated into a framework that can be used internationally across surgical specialties as a step-by-step guide for the development and validation of future simulation-based training curricula. Copyright © 2012 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Entry-to-practice public health nursing competencies: A Delphi method and knowledge translation strategy.

PubMed

Schofield, Ruth; Chircop, Andrea; Baker, Cynthia; Dietrich Leurer, Marie; Duncan, Susan; Wotton, Donalda

2018-06-01

Sustaining and strengthening nurses 'contributions to public and population health in the 21st century depends in part on nursing education. Clearly articulated entry-to-practice competencies will contribute to the capacity of undergraduate nursing education programs to prepare graduates to promote local, national and global population health. The Canadian Association of Schools of Nursing created the Public Health Task Force to develop consensus on core, national entry-to-practice competencies in public health nursing for undergraduate nursing students and to support these competencies with corresponding online teaching strategies. Delphi approach. Nurses with public health experience in education and practice, and representatives from other public health professional organizations across Canada. The three-phased competency development included: 1) an environmental scan; 2) an iterative process to draft competencies; and 3) a modified Delphi process to confirm the final competency framework using face to face consultations and a survey. The knowledge translation strategy involved soliciting submissions of teaching strategies for peer-review and subsequent inclusion in an interactive online resource. 242 public health educators and practitioners participated in the consensus consultation. The final document outlined five competency statements with 19 accompanying indicators. A total of 123 teaching strategies were submitted for the online resource, of which 50 were accepted as exemplary teaching strategies. This competency development process can provide guidance for the development of competencies in other countries, thus strengthening public health nursing education globally. The decision to intentionally level the competencies to entry-to-practice, as opposed to an advanced level, enhanced their application to undergraduate nursing education. The development of the additional inventory of teaching strategies created a sustainable innovative resource for public health nursing educators and practitioners world-wide to support the adoption of entry-to-practice public health nursing competencies. Crown Copyright © 2018. Published by Elsevier Ltd. All rights reserved.

[Application of Delphi method in traditional Chinese medicine clinical research].

PubMed

Bi, Ying-fei; Mao, Jing-yuan

2012-03-01

In recent years, Delphi method has been widely applied in traditional Chinese medicine (TCM) clinical research. This article analyzed the present application situation of Delphi method in TCM clinical research, and discussed some problems presented in the choice of evaluation method, classification of observation indexes and selection of survey items. On the basis of present application of Delphi method, the author analyzed the method on questionnaire making, selection of experts, evaluation of observation indexes and selection of survey items. Furthermore, the author summarized the steps of application of Delphi method in TCM clinical research.

Toward a Consensus in Ethics Education for the Doctor of Nursing Practice.

PubMed

Laabs, Carolyn A

2015-01-01

The purpose of this study was to begin to develop a consensus as to the essential content and methods of ethics education for advanced practice nurses. An online Delphi technique was used to survey ethics experts to determine whether items were essential, desirable, or unnecessary to ethics education for students in doctor of nursing practice programs. Only the American Nurses Association Code of Ethics and ethics terminology were deemed essential foundational knowledge.

Achieving Consensus for the Design and Delivery of an Online Intervention to Support Midwives in Work-Related Psychological Distress: Results From a Delphi Study.

PubMed

Pezaro, Sally; Clyne, Wendy

2016-07-12

Some midwives are known to experience both professional and organizational sources of psychological distress, which can manifest as a result of the emotionally demanding midwifery work, and the traumatic work environments they endure. An online intervention may be one option midwives may engage with in pursuit of effective support. However, the priorities for the development of an online intervention to effectively support midwives in work-related psychological distress have yet to be explored. The aim of this study was to explore priorities in the development of an online intervention to support midwives in work-related psychological distress. A two-round online Delphi study was conducted. This study invited both qualitative and quantitative data from experts recruited via a scoping literature search and social media channels. In total, 185 experts were invited to participate in this Delphi study. Of all participants invited to contribute, 35.7% (66/185) completed Round 1 and of those who participated in this first round, 67% (44/66) continued to complete Round 2. Out of 39 questions posed over two rounds, 18 statements (46%) achieved consensus, 21 (54%) did not. Participants were given the opportunity to write any additional comments as free text. In total, 1604 free text responses were collected and categorized into 2446 separate statements of opinion, creating a total of 442 themes. Overall, participants agreed that in order to effectively support midwives in work-related psychological distress, online interventions should make confidentiality and anonymity a high priority, along with 24-hour mobile access, effective moderation, an online discussion forum, and additional legal, educational, and therapeutic components. It was also agreed that midwives should be offered a simple user assessment to identify those people deemed to be at risk of either causing harm to others or experiencing harm themselves, and direct them to appropriate support. This study has identified priorities for the development of online interventions to effectively support midwives in work-related psychological distress. The impact of any future intervention of this type will be optimized by utilizing these findings in the development process.

Web-based dynamic Delphi: a new survey instrument

NASA Astrophysics Data System (ADS)

Yao, JingTao; Liu, Wei-Ning

2006-04-01

We present a mathematical model for a dynamic Delphi survey method which takes advantages of Web technology. A comparative study on the performance of the conventional Delphi method and the dynamic Delphi instrument is conducted. It is suggested that a dynamic Delphi survey may form a consensus quickly. However, the result may not be robust due to the judgement leaking issues.

A Delphi survey on diagnosis and management of stress velopharyngeal insufficiency in wind musicians.

PubMed

Evans, Alison; Driscoll, Tim; Ackermann, Bronwen

2014-10-01

The aim of this study was to identify current trends in clinical assessment and management of stress velopharyngeal insufficiency (VPI) in wind musicians. This was an online two-round Delphi survey of health practitioners familiar with assessing and treating musicians with stress VPI. Fourteen specialists (seven otolaryngologists and seven speech-language pathologists) from four countries participated in the Delphi survey. From the first round questionnaire, 32 items were identified as being causes, assessment tools, diagnostic indicators, and treatment methods for stress VPI. The second round questionnaire revealed that prolonged exposure to high intra-oral pressures was important in determining the cause of stress VPI. The most important assessment tools for stress VPI were case history and nasendoscopy. The most important indicator for stress VPI was self-reported symptoms. There was no clear agreement identified on the management methods for stress VPI for musicians. However, the trend followed by most of the survey participants was a combination of conservative management approaches (including rest or watch and wait, speech-language pathology intervention, velopharyngeal muscle training, and changes to the instrument or reed), and then, if symptoms persist, to use injection pharyngoplasty or pharyngeal flap. This survey demonstrates that no standard management protocol currently exists for musicians diagnosed with stress VPI, but provides current trends in the assessment and management which can be used in future guidelines for health professionals who treat wind musicians.

Using Continuous Quality Improvement (CQI) to Sustain Success in Faculty Development for Online Teaching

ERIC Educational Resources Information Center

Kerrick, Sharon A.; Miller, Karen Hughes; Ziegler, Craig

2015-01-01

This article shares the curriculum and evaluation findings over four years for a faculty development program aimed at increasing skills in designing and teaching online courses. The University of Louisville's "Delphi U" is a four-day retreat style program covering 17 modules, each of which includes an exercise or activity. Over the four…

Identifying Online Graduate Learners' Perceived Barriers to Their Academic Success Utilizing a Delphi Study

ERIC Educational Resources Information Center

Banks, Karen Lee

2017-01-01

Nontraditional online adult graduate students ages 25 and older have unique challenges toward achieving their academic goals as compared to younger learners. These older graduate students usually already have families, careers, and other demands on their time. Deciding to pursue their advanced degrees is typically related to gaining a competitive…

Cross-cultural adaptation of the delphi definitions of low back pain prevalence (German DOLBaPP).

PubMed

Leonhardt, Marja; Liebers, Falk; Dionne, Clermont E; Latza, Ute

2014-11-25

Assessed dimensions of low back pain (LBP) vary in prevalence studies. This may explain the heterogeneity in frequency estimates. To standardize definitions of LBP, an English consensus with 28 experts from 12 countries developed the "Delphi Definitions of Low Back Pain Prevalence" (DOLBaPP). The optimal definition and the shorter minimal definition with the related questionnaires for online, paper, and face-to-face use and telephone surveys are suitable for population-based studies. The definitions have to be adapted to different languages and cultures to provide comparable frequency estimates. The objective was to culturally adapt and pre-test the English definitions and corresponding Delphi DOLBaPP questionnaire forms into German. The German DOLBaPP adaptation was conducted using the systematic approach suggested by Beaton et al. A pre-test of the Delphi DOLBaPP optimal paper questionnaire including an additional evaluation form was conducted in a sample of 121 employees (mainly office workers). In order to evaluate the comprehensibility, usability, applicability, and completeness of the adapted questionnaire, response to the questionnaire and 6 closed evaluation questions were analyzed descriptively. Qualitative methods were used for the 3 open questions of the evaluation form. The cultural adaptation of the DOLBaPP for a German-speaking audience required little linguistic adaptation. Conceptual equivalence was difficult for the expression "low back pain". The expert committee considered the face validity of the pre-final version of the related Delphi DOLBaPP questionnaires as good. In the pre-test, most participants (95%) needed less than 5 minutes to fill in the optimal Delphi DOLBaPP questionnaire. They were generally positive regarding length, wording, diagram, and composition. All subjects with LBP (n=61 out of 121 - 50.4%) answered the questions on functional limitation, sciatic pain, frequency and duration of symptoms as well as pain severity. The results indicate that the cross-cultural German adaptation of the DOLBaPP Definitions and the corresponding questionnaires was successful. The definitions can be used in epidemiological studies to measure the prevalence of LBP. Some critical issues were raised regarding the general features of the Delphi DOLBaPP questionnaires. Future research is needed to evaluate these instruments.

Physical Restraints: Consensus of a Research Definition Using a Modified Delphi Technique.

PubMed

Bleijlevens, Michel H C; Wagner, Laura M; Capezuti, Elizabeth; Hamers, Jan P H

2016-11-01

To develop an internationally accepted research definition of physical restraint. Comprehensive literature search followed by a web-based, three-round, modified Delphi technique comprising reviews and feedback. Clinical care settings. An international group of 48 experts consisting of researchers and clinicians from 14 countries who have made sustained contribution to research and clinical application in the field of physical restraint in clinical care. Data were collected using an online survey program and one in-person meeting. Results of the online survey and the in-person meeting were used for distribution in subsequent rounds until consensus on a definition was reached. Consensus was defined as 90% of the participating experts agreeing with the proposed definition of physical restraint. Thirty-four different definitions were identified during the literature search and served as a starting point for the modified Delphi technique. After three rounds, 45 (95.7%) of 47 remaining experts agreed with the newly proposed definition: "Physical restraint is defined as any action or procedure that prevents a person's free body movement to a position of choice and/or normal access to his/her body by the use of any method, attached or adjacent to a person's body that he/she cannot control or remove easily." A multidisciplinary, internationally representative panel of experts reached consensus on a research definition for physical restraints in older persons. This is a necessary step toward improved comparisons of the prevalence of physical restraint use across studies and countries. This definition can further guide research interventions aimed at reducing use of physical restraints. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Blending online therapy into regular face-to-face therapy for depression: content, ratio and preconditions according to patients and therapists using a Delphi study.

PubMed

van der Vaart, Rosalie; Witting, Marjon; Riper, Heleen; Kooistra, Lisa; Bohlmeijer, Ernst T; van Gemert-Pijnen, Lisette J E W C

2014-12-14

Blending online modules into face-to-face therapy offers perspectives to enhance patient self-management and to increase the (cost-)effectiveness of therapy, while still providing the support patients need. The aim of this study was to outline optimal usage of blended care for depression, according to patients and therapists. A Delphi method was used to find consensus on suitable blended protocols (content, sequence and ratio). Phase 1 was an explorative phase, conducted in two rounds of online questionnaires, in which patients' and therapists' preferences and opinions about online psychotherapy were surveyed. In phase 2, data from phase 1 was used in face-to-face interviews with therapists to investigate how blended therapy protocols could be set up and what essential preconditions would be. Twelve therapists and nine patients completed the surveys. Blended therapy was positively perceived among all respondents, especially to enhance the self-management of patients. According to most respondents, practical therapy components (assignments, diaries and psycho-education) may be provided via online modules, while process-related components (introduction, evaluation and discussing thoughts and feelings), should be supported face-to-face. The preferred blend of online and face-to-face sessions differs between therapists and patients; most therapists prefer 75% face-to-face sessions, most patients 50 to 60%. The interviews showed that tailoring treatment to individual patients is essential in secondary mental health care, due to the complexity of their problems. The amount and ratio of online modules needs to be adjusted according to the patient's problems, skills and characteristics. Therapists themselves should also develop skills to integrate online and face-to-face sessions. Blending online and face-to-face sessions in an integrated depression therapy is viewed as a positive innovation by patients and therapists. Following a standard blended protocol, however, would be difficult in secondary mental health care. A database of online modules could provide flexibility to tailor treatment to individual patients, which asks motivation and skills of both patients and therapists. Further research is necessary to determine the (cost-)effectiveness of blended care, but this study provides starting points and preconditions to blend online and face-to-face sessions and create a treatment combining the best of both worlds.

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

Survey indicated that core outcome set development is increasingly including patients, being conducted internationally and using Delphi surveys.

PubMed

Biggane, Alice M; Brading, Lucy; Ravaud, Philippe; Young, Bridget; Williamson, Paula R

2018-02-17

There are numerous challenges in including patients in a core outcome set (COS) study, these can vary depending on the patient group. This study describes current efforts to include patients in the development of COS, with the aim of identifying areas for further improvement and study. Using the COMET database, corresponding authors of COS projects registered or published from 1 January 2013 to 2 February 2017 were invited via a personalised email to participate in a short online survey. The survey and emails were constructed to maximise the response rate by following the academic literature on enhancing survey responses. Personalised reminder emails were sent to non-responders. This survey explored the frequency of patient input in COS studies, who was involved, what methods were used and whether or not the COS development was international. One hundred and ninety-two COS developers were sent the survey. Responses were collected from 21 February 2017 until 7 May 2017. One hundred and forty-six unique developers responded, yielding a 76% response rate and data in relation to 195 unique COSs (as some developers had worked on multiple COSs). Of focus here are their responses regarding 162 COSs at the published, completed or ongoing stages of development. Inclusion of patient participants was indicated in 87% (141/162) of COSs in the published completed or ongoing stages and over 94% (65/69) of ongoing COS projects. Nearly half (65/135) of COSs included patient participants from two or more countries and 22% (30/135) included patient participants from five or more countries. The Delphi survey was reported as being used singularly or in combination with other methods in 85% (119/140) of projects. Almost a quarter (16/65) of ongoing studies reported using a combination of qualitative interviews, Delphi survey and consensus meeting. These findings indicated that the Delphi survey is the most popular method of facilitating patient participation, while the combination of qualitative interviews, Delphi survey and consensus meetings is the most popular combination of methods. The increased inclusion of patient participants in the development of COSs is encouraging, as is the international approach to COS development that some developers are adopting.

The impact of the internet on community pharmacy practice: a comparison of a Delphi panel's forecast with emerging trends.

PubMed

Holmes, Erin R; Tipton, David J; Desselle, Shane P

2002-01-01

The purpose of this study was to forecast the impact of Internet pharmacy commerce on various stakeholders. A panel of experts assembled from a list of academicians in the social and administrative pharmaceutical sciences participated in a three-iteration Delphi procedure. Feedback from the aggregate responses of the panel was used to construct questionnaires employed in subsequent iterations of the Delphi. The panel converged to form a consensus upon a variety of issues. They forecasted the attainment of a 10-15% share in the market of prescription and over-the-counter pharmaceuticals through on-line purchases, the formation of strategic alliances among stakeholders in the drug distribution process, a shift in marketing strategies by brick-and-mortar stores, an increase in the prevalence of niching among pharmacy service providers and a subsequent growth in the implementation of cognitive services throughout the industry. With few exceptions, the forecast produced by the Delphi panel appears to be coming to fruition.

Defining a Bobath clinical framework - A modified e-Delphi study.

PubMed

Vaughan-Graham, Julie; Cott, Cheryl

2016-11-01

To gain consensus within the expert International Bobath Instructors Training Association (IBITA) on a Bobath clinical framework on which future efficacy studies can be based. A three-round modified e-Delphi approach was used with 204 full members of the IBITA. Twenty-one initial statements were generated from the literature. Consensus was defined a priori as at least 80% of the respondents with a level of agreement on a Likert scale of 4 or 5. The Delphi questionnaire for each round was available online for two weeks. Summary reports and subsequent questionnaires were posted within four weeks. Ninety-four IBITA members responded, forming the Delphi panel, of which 68 and 66 responded to Rounds Two and Three, respectively. The 21 initial statements were revised to 17 statements and five new statements in Round Two in which eight statements were accepted and two statements were eliminated. Round Three presented 12 revised statements, all reaching consensus. The Delphi was successful in gaining consensus on a Bobath clinical framework in a geographically diverse expert association, identifying the unique components of Bobath clinical practice. Discussion throughout all three Rounds revolved primarily around the terminology of atypical and compensatory motor behavior and balance.

A practical guideline for examining a uterine niche using ultrasonography in non-pregnant women: a modified Delphi method amongst European experts.

PubMed

Jordans, I P M; de Leeuw, R; Stegwee, S I; Amso, N N; Barri-Soldevila, P N; van den Bosch, T; Bourne, T; Brolmann, H A M; Donnez, O; Dueholm, M; Hehenkamp, W J K; Jastrow, N; Jurkovic, D; Mashiach, R; Naji, O; Streuli, I; Timmerman, D; Vd Voet, L F; Huirne, J A F

2018-03-14

To generate a uniform, internationally recognized guideline for detailed uterine niche evaluation by ultrasonography in non-pregnant women using a modified Delphi method amongst international experts. Fifteen international gynecological experts were recruited by their membership of the European niche taskforce group. All experts were physicians with extensive experience in niche evaluation in clinical practice and/or authors of niche studies. Relevant items for niche measurement were determined based on the results of a literature search and recommendations of a focus group. Two online questionnaires were sent to the expert panel and one group meeting was organized. Consensus was predefined as a consensus rate of at least 70%. In total 15 experts participated in this study. Consensus was reached for a total of 42 items on niche evaluation, including definitions, relevance, method of measurement and tips for visualization of the niche. All experts agreed on the proposed guideline for niche evaluation in non-pregnant women as presented in this paper. Consensus between niche experts was achieved on all items regarding ultrasonographic niche measurement. This article is protected by copyright. All rights reserved.

Expert surgical consensus for prenatal counseling using the Delphi method.

PubMed

Berman, Loren; Jackson, Jordan; Miller, Kristen; Kowalski, Rebecca; Kolm, Paul; Luks, Francois I

2017-11-28

Pediatric surgeons frequently offer prenatal consultation for congenital pulmonary airway malformation (CPAM) and congenital diaphragmatic hernia (CDH); however, there is no evidence-based consensus to guide prenatal decision making and counseling for these conditions. Eliciting feedback from experts is integral to defining best practice regarding prenatal counseling and intervention. A Delphi consensus process was undertaken using a panel of pediatric surgeons identified as experts in fetal therapy to address current limitations. Areas of discrepancy in the literature on CPAM and CDH were identified and used to generate a list of content and intervention questions. Experts were invited to participate in an online Delphi survey. Items that did not reach first-round consensus were broken down into additional questions, and consensus was achieved in the second round. Fifty-four surgeons (69%) responded to at least one of the two survey rounds. During round one, consensus was reached on 54 of 89 survey questions (61%), and 45 new questions were developed. During round two, consensus was reached on 53 of 60 survey questions (88%). We determined expert consensus to establish guidelines regarding perinatal management of CPAM and CDH. Our results can help educate pediatric surgeons participating in perinatal care of these patients. V. Copyright © 2017 Elsevier Inc. All rights reserved.

The Delphi Method for Graduate Research

ERIC Educational Resources Information Center

Skulmoski, Gregory J.; Hartman, Francis T.; Krahn, Jennifer

2007-01-01

The Delphi method is an attractive method for graduate students completing masters and PhD level research. It is a flexible research technique that has been successfully used in our program at the University of Calgary to explore new concepts within and outside of the information systems body of knowledge. The Delphi method is an iterative process…

Developing clinical practice guidelines for Chinese herbal treatment of polycystic ovary syndrome: A mixed-methods modified Delphi study.

PubMed

Lai, Lily; Flower, Andrew; Moore, Michael; Lewith, George

2015-06-01

Preliminary evidence suggests Chinese herbal medicine (CHM) could be a viable treatment option for polycystic ovary syndrome (PCOS). Prior to conducting a clinical trial it is important to consider the characteristics of good clinical practice. This study aims to use professional consensus to establish good clinical practice guidelines for the CHM treatment of PCOS. CHM practitioners participated in a mixed-methods modified Delphi study involving three rounds of structured group communication. Round 1 involved qualitative interviews with practitioners to generate statements regarding good clinical practice. In round 2, these statements were distributed online to the same practitioners to rate their agreement using a 7-point Likert scale, where group consensus was defined as a median rating of ≥5. Statements reaching consensus were accepted for consideration onto the guideline whilst those not reaching consensus were re-distributed for consideration in round 3. Statements presented in the guidelines were graded from A (strong consensus) to D (no consensus) determined by median score and interquartile range. 11 CHM practitioners in the UK were recruited. After three Delphi rounds, 91 statement items in total had been considered, of which 89 (97.8%) reached consensus and 2 (2.2%) did not. The concluding set of guidelines consists of 85 items representing key features of CHM prescribing for PCOS. These guidelines can be viewed as an initial framework that captures fundamental principles of good clinical practice for CHM. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Delphi study to determine the European core curriculum for Master programmes in genetic counselling.

PubMed

Skirton, Heather; Barnoy, Sivia; Ingvoldstad, Charlotta; van Kessel, Ingrid; Patch, Christine; O'Connor, Anita; Serra-Juhe, Clara; Stayner, Barbara; Voelckel, Marie-Antoinette

2013-10-01

Genetic counsellors have been working in some European countries for at least 30 years. Although there are great disparities between the numbers, education, practice and acceptance of these professionals across Europe, it is evident that genetic counsellors and genetic nurses in Europe are working autonomously within teams to deliver patient care. The aim of this study was to use the Delphi research method to develop a core curriculum to guide the educational preparation of these professionals in Europe. The Delphi method enables the researcher to utilise the views and opinions of a group of recognised experts in the field of study; this study consisted of four phases. Phases 1 and 4 consisted of expert workshops, whereas data were collected in phases 2 and 3 (n=35) via online surveys. All participants in the study were considered experts in the field of genetic counselling. The topics considered essential for genetic counsellor training have been organised under the following headings: (1) counselling; (2) psychological issues; (3) medical genetics; (4) human genetics; (5) ethics, law and sociology; (6) professional practice; and (7) education and research. Each topic includes the knowledge, skills and attitudes required to enable genetic counsellors to develop competence. In addition, it was considered by the experts that clinical practice should comprise 50% of the educational programme. The core Master programme curriculum will enable current courses to be assessed and inform the design of future educational programmes for European genetic counsellors.

Using the Delphi expert consensus method in mental health research.

PubMed

Jorm, Anthony F

2015-10-01

The article gives an introductory overview of the use of the Delphi expert consensus method in mental health research. It explains the rationale for using the method, examines the range of uses to which it has been put in mental health research, and describes the stages of carrying out a Delphi study using examples from the literature. To ascertain the range of uses, a systematic search was carried out in PubMed. The article also examines the implications of 'wisdom of crowds' research for how to conduct Delphi studies. The Delphi method is a systematic way of determining expert consensus that is useful for answering questions that are not amenable to experimental and epidemiological methods. The validity of the approach is supported by 'wisdom of crowds' research showing that groups can make good judgements under certain conditions. In mental health research, the Delphi method has been used for making estimations where there is incomplete evidence (e.g. What is the global prevalence of dementia?), making predictions (e.g. What types of interactions with a person who is suicidal will reduce their chance of suicide?), determining collective values (e.g. What areas of research should be given greatest priority?) and defining foundational concepts (e.g. How should we define 'relapse'?). A range of experts have been used in Delphi research, including clinicians, researchers, consumers and caregivers. The Delphi method has a wide range of potential uses in mental health research. © The Royal Australian and New Zealand College of Psychiatrists 2015.

Expert agreed standards for the selection and development of cancer support group leaders: an online reactive Delphi study.

PubMed

Pomery, Amanda; Schofield, Penelope; Xhilaga, Miranda; Gough, Karla

2018-01-01

The aim of this study was to develop pragmatic, consensus-based minimum standards for the role of a cancer support group leader. Secondly, to produce a structured interview designed to assess the knowledge, skills and attributes of the individuals who seek to undertake the role. An expert panel of 73 academics, health professionals, cancer agency workers and cancer support group leaders were invited to participate in a reactive online Delphi study involving three online questionnaire rounds. Participants determined and ranked requisite knowledge, skills and attributes (KSA) for cancer support group leaders, differentiated ideal from required KSA to establish minimum standards, and agreed on a method of rating KSA to determine suitability and readiness. Forty-five experts (62%) participated in round 1, 36 (49%) in round 2 and 23 (31%) in round 3. In round 1, experts confirmed 59 KSA identified via a systemic review and identified a further 55 KSA. In round 2, using agreement ≥75%, 52 KSA emerged as minimum standards for support group leaders. In round 3, consensus was reached on almost every aspect of the content and structure of a structured interview. Panel member comments guided refinement of wording, re-ordering of questions and improvement of probing questions. Alongside a novel structured interview, the first consensus-based minimum standards have been developed for cancer support group leaders, incorporating expert consensus and pragmatic considerations. Pilot and field testing will be used to appraise aspects of clinical utility and establish a rational scoring model for the structured interview.

Core neurological examination items for neurology clerks: A modified Delphi study with a grass-roots approach

PubMed Central

Liu, Chi-Hung; Hsu, Li-Ling; Hsiao, Cheng-Ting; Hsieh, Suh-Ing; Chang, Chun-Wei; Huang, Elaine Shinwei; Chang, Yeu-Jhy

2018-01-01

Background With the evolution of treatments for neurological diseases, the contents of core neurological examinations (NEs) for medical students may need to be modified. We aimed to establish a consensus on the core NE items for neurology clerks and compare viewpoints between different groups of panelists. Methods First, a pilot group proposed the core contents of NEs for neurology clerks. The proposed core NE items were then subject to a modified web-based Delphi process using the online software “SurveyMonkey”. A total of 30 panelists from different backgrounds (tutors or learners, neurologists or non-neurologists, community hospitals or medical centers, and different academic positions) participated in the modified Delphi process. Each panelist was asked to agree or disagree on the inclusion of each item using a 9-point Likert scale and was encouraged to provide feedback. We also compared viewpoints between different groups of panelists using the Mann-Whitney U test. Results Eighty-three items were used for the first round of the Delphi process. Of them, 18 without consensus of being a core NE item for the neurology clerks in the first round and another 14 items suggested by the panelists were further discussed in the second round. Finally, 75 items with different grades were included in the recommended NE items for neurology clerks. Conclusions Our findings provide a reference regarding the core NE items for milestone development for neurology clerkships. We hope that prioritizing the NE items in this order can help medical students to learn NE more efficiently. PMID:29771997

Phase 2 of CATALISE: a multinational and multidisciplinary Delphi consensus study of problems with language development: Terminology.

PubMed

Bishop, Dorothy V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2017-10-01

Lack of agreement about criteria and terminology for children's language problems affects access to services as well as hindering research and practice. We report the second phase of a study using an online Delphi method to address these issues. In the first phase, we focused on criteria for language disorder. Here we consider terminology. The Delphi method is an iterative process in which an initial set of statements is rated by a panel of experts, who then have the opportunity to view anonymised ratings from other panel members. On this basis they can either revise their views or make a case for their position. The statements are then revised based on panel feedback, and again rated by and commented on by the panel. In this study, feedback from a second round was used to prepare a final set of statements in narrative form. The panel included 57 individuals representing a range of professions and nationalities. We achieved at least 78% agreement for 19 of 21 statements within two rounds of ratings. These were collapsed into 12 statements for the final consensus reported here. The term 'Language Disorder' is recommended to refer to a profile of difficulties that causes functional impairment in everyday life and is associated with poor prognosis. The term, 'Developmental Language Disorder' (DLD) was endorsed for use when the language disorder was not associated with a known biomedical aetiology. It was also agreed that (a) presence of risk factors (neurobiological or environmental) does not preclude a diagnosis of DLD, (b) DLD can co-occur with other neurodevelopmental disorders (e.g. ADHD) and (c) DLD does not require a mismatch between verbal and nonverbal ability. This Delphi exercise highlights reasons for disagreements about terminology for language disorders and proposes standard definitions and nomenclature. © 2017 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

Experiences and wisdom behind the numbers: qualitative analysis of the National Action Alliance for Suicide Prevention's Research Prioritization Task Force stakeholder survey.

PubMed

Booth, Chelsea L

2014-09-01

The Research Prioritization Task Force of the National Action Alliance for Suicide Prevention conducted a stakeholder survey including 716 respondents from 49 U.S. states and 18 foreign countries. To conduct a qualitative analysis on responses from individuals representing four main stakeholder groups: attempt and loss survivors, researchers, providers, and policy/administrators. This article focuses on a qualitative analysis of the early-round, open-ended responses collected in a modified online Delphi process, and, as an illustration of the research method, focuses on analysis of respondents' views of the role of life and emotional skills in suicide prevention. Content analysis was performed using both inductive and deductive code and category development and systematic qualitative methods. After the inductive coding was completed, the same data set was re-coded using the 12 Aspirational Goals (AGs) identified by the Delphi process. Codes and thematic categories produced from the inductive coding process were, in some cases, very similar or identical to the 12 AGs (i.e., those dealing with risk and protective factors, provider training, preventing reattempts, and stigma). Other codes highlighted areas that were not identified as important in the Delphi process (e.g., cultural/social factors of suicide, substance use). Qualitative and mixed-methods research are essential to the future of suicide prevention work. By design, qualitative research is explorative and appropriate for complex, culturally embedded social issues such as suicide. Such research can be used to generate hypotheses for testing and, as in this analysis, illuminate areas that would be missed in an approach that imposed predetermined categories on data. Published by Elsevier Inc.

Delphi: An Overview, An Application, Some Lessons.

ERIC Educational Resources Information Center

Moore, Carl M.; Coke, James G.

This paper discusses Delphi-a method of utilizing individuals' knowledge, judgment, and opinions to address complex questions and applies the method to a community planning project in Stow, Ohio. There are four phases of any Delphi: (1) exploring the subject under discussion, with each individual contributing pertinent information, (2) reaching an…

[A model for shared decision-making with frail older patients: consensus reached using Delphi technique].

PubMed

van de Pol, M H J; Fluit, C R M G; Lagro, J; Lagro-Janssen, A L M; Olde Rikkert, M G M

2017-01-01

To develop a model for shared decision-making with frail older patients. Online Delphi forum. We used a three-round Delphi technique to reach consensus on the structure of a model for shared decision-making with older patients. The expert panel consisted of 16 patients (round 1), and 59 professionals (rounds 1-3). In round 1, the panel of experts was asked about important steps in the process of shared decision-making and the draft model was introduced. Rounds 2 and 3 were used to adapt the model and test it for 'importance' and 'feasibility'. Consensus for the dynamic shared decision-making model as a whole was achieved for both importance (91% panel agreement) and feasibility (76% panel agreement). Shared decision-making with older patients is a dynamic process. It requires a continuous supportive dialogue between health care professional and patient.

Using a web-based survey tool to undertake a Delphi study: application for nurse education research.

PubMed

Gill, Fenella J; Leslie, Gavin D; Grech, Carol; Latour, Jos M

2013-11-01

The Internet is increasingly being used as a data collection medium to access research participants. This paper reports on the experience and value of using web-survey software to conduct an eDelphi study to develop Australian critical care course graduate practice standards. The eDelphi technique used involved the iterative process of administering three rounds of surveys to a national expert panel. The survey was developed online using SurveyMonkey. Panel members responded to statements using one rating scale for round one and two scales for rounds two and three. Text boxes for panel comments were provided. For each round, the SurveyMonkey's email tool was used to distribute an individualized email invitation containing the survey web link. The distribution of panel responses, individual responses and a summary of comments were emailed to panel members. Stacked bar charts representing the distribution of responses were generated using the SurveyMonkey software. Panel response rates remained greater than 85% over all rounds. An online survey provided numerous advantages over traditional survey approaches including high quality data collection, ease and speed of survey administration, direct communication with the panel and rapid collation of feedback allowing data collection to be undertaken in 12 weeks. Only minor challenges were experienced using the technology. Ethical issues, specific to using the Internet to conduct research and external hosting of web-based software, lacked formal guidance. High response rates and an increased level of data quality were achieved in this study using web-survey software and the process was efficient and user-friendly. However, when considering online survey software, it is important to match the research design with the computer capabilities of participants and recognize that ethical review guidelines and processes have not yet kept pace with online research practices. Copyright © 2013 Elsevier Ltd. All rights reserved.

Building Adaptive Capacity with the Delphi Method and Mediated Modeling for Water Quality and Climate Change Adaptation in Lake Champlain Basin

NASA Astrophysics Data System (ADS)

Coleman, S.; Hurley, S.; Koliba, C.; Zia, A.; Exler, S.

2014-12-01

Eutrophication and nutrient pollution of surface waters occur within complex governance, social, hydrologic and biophysical basin contexts. The pervasive and perennial nutrient pollution in Lake Champlain Basin, despite decades of efforts, exemplifies problems found across the world's surface waters. Stakeholders with diverse values, interests, and forms of explicit and tacit knowledge determine water quality impacts through land use, agricultural and water resource decisions. Uncertainty, ambiguity and dynamic feedback further complicate the ability to promote the continual provision of water quality and ecosystem services. Adaptive management of water resources and land use requires mechanisms to allow for learning and integration of new information over time. The transdisciplinary Research on Adaptation to Climate Change (RACC) team is working to build regional adaptive capacity in Lake Champlain Basin while studying and integrating governance, land use, hydrological, and biophysical systems to evaluate implications for adaptive management. The RACC team has engaged stakeholders through mediated modeling workshops, online forums, surveys, focus groups and interviews. In March 2014, CSS2CC.org, an interactive online forum to source and identify adaptive interventions from a group of stakeholders across sectors was launched. The forum, based on the Delphi Method, brings forward the collective wisdom of stakeholders and experts to identify potential interventions and governance designs in response to scientific uncertainty and ambiguity surrounding the effectiveness of any strategy, climate change impacts, and the social and natural systems governing water quality and eutrophication. A Mediated Modeling Workshop followed the forum in May 2014, where participants refined and identified plausible interventions under different governance, policy and resource scenarios. Results from the online forum and workshop can identify emerging consensus across scales and sectors and be simulated in adaptation scenarios within integrated models. Comparing interventions and scenarios to existing and planned policy and governance systems in Lake Champlain Basin allows for new feedback to build adaptive capacity to identify key leverage points in the coupled natural and human system.

Exploration to Identify Professional Dispositions of School Librarians: A Delphi Study

ERIC Educational Resources Information Center

Bush, Gail; Jones, Jami L.

2010-01-01

This article reports the findings of an exploratory study to identify professional dispositions of school librarians. The authors employed the Delphi method, a qualitative research method that emphasizes expert knowledge and consensus within a particular field. The Delphi panel consisted of members of the editorial boards of nationally recognized…

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.

PubMed

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

77 FR 74859 - Proposed Flood Hazard Determinations

Federal Register 2010, 2011, 2012, 2013, 2014

2012-12-18

... resolution process. SRPs are independent panels of experts in hydrology, hydraulics, and other pertinent...://www.in.gov/dnr/water/6401.htm City of Delphi Carroll County Area Plan Commission, Carroll County... Inspection Online at: http://www.in.gov/dnr/water/7339.htm Town of Cumberland Municipal Building, 11501 East...

Determinants of adolescents' ineffective and improved coping with cyberbullying: a Delphi study.

PubMed

Jacobs, Niels C L; Dehue, Francine; Völlink, Trijntje; Lechner, Lilian

2014-06-01

The study's aim was to obtain an overview of all relevant variables involved in ineffective coping behavior and improvement in coping behavior as it pertains to cyberbullying among adolescents, in order to systematically develop a theory- and evidence-based intervention. This was done by means of a three round online Delphi study. First, 20 key experts listed possible relevant determinants. Next, 70 experts scored these determinants on their relevance and finally, experts rerated relevance of each determinant based on group median scores. The experts agreed that 115 items are relevant for ineffective (62) or improvement in (53) coping behavior. New found determinants were the extent to which one can adjust behavior upon feedback, impulsivity, self-confidence, communication style, personality, decision-making skills, conflict resolution skills, previous participation in personal resilience training, social relationships, rumors and self-disclosure. We conclude that the Delphi technique is useful in discovering new and relevant determinants of behavior. Copyright © 2014 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Using a Delphi Technique to Seek Consensus Regarding Definitions, Descriptions and Classification of Terms Related to Implicit and Explicit Forms of Motor Learning

PubMed Central

Kleynen, Melanie; Braun, Susy M.; Bleijlevens, Michel H.; Lexis, Monique A.; Rasquin, Sascha M.; Halfens, Jos; Wilson, Mark R.; Beurskens, Anna J.; Masters, Rich S. W.

2014-01-01

Background Motor learning is central to domains such as sports and rehabilitation; however, often terminologies are insufficiently uniform to allow effective sharing of experience or translation of knowledge. A study using a Delphi technique was conducted to ascertain level of agreement between experts from different motor learning domains (i.e., therapists, coaches, researchers) with respect to definitions and descriptions of a fundamental conceptual distinction within motor learning, namely implicit and explicit motor learning. Methods A Delphi technique was embedded in multiple rounds of a survey designed to collect and aggregate informed opinions of 49 international respondents with expertise related to motor learning. The survey was administered via an online survey program and accompanied by feedback after each round. Consensus was considered to be reached if ≥70% of the experts agreed on a topic. Results Consensus was reached with respect to definitions of implicit and explicit motor learning, and seven common primary intervention strategies were identified in the context of implicit and explicit motor learning. Consensus was not reached with respect to whether the strategies promote implicit or explicit forms of learning. Discussion The definitions and descriptions agreed upon may aid translation and transfer of knowledge between domains in the field of motor learning. Empirical and clinical research is required to confirm the accuracy of the definitions and to explore the feasibility of the strategies that were identified in research, everyday practice and education. PMID:24968228

Development of an antibiotic spectrum score based on veterans affairs culture and susceptibility data for the purpose of measuring antibiotic de-escalation: a modified Delphi approach.

PubMed

Madaras-Kelly, Karl; Jones, Makoto; Remington, Richard; Hill, Nicole; Huttner, Benedikt; Samore, Matthew

2014-09-01

Development of a numerical score to measure the microbial spectrum of antibiotic regimens (spectrum score) and method to identify antibiotic de-escalation events based on application of the score. Web-based modified Delphi method. Physician and pharmacist antimicrobial stewards practicing in the United States recruited through infectious diseases-focused listservs. Three Delphi rounds investigated: organisms and antibiotics to include in the spectrum score, operationalization of rules for the score, and de-escalation measurement. A 4-point ordinal scale was used to score antibiotic susceptibility for organism-antibiotic domain pairs. Antibiotic regimen scores, which represented combined activity of antibiotics in a regimen across all organism domains, were used to compare antibiotic spectrum administered early (day 2) and later (day 4) in therapy. Changes in spectrum score were calculated and compared with Delphi participants' judgments on de-escalation with 20 antibiotic regimen vignettes and with non-Delphi steward judgments on de-escalation of 300 pneumonia regimen vignettes. Method sensitivity and specificity to predict expert de-escalation status were calculated. Twenty-four participants completed all Delphi rounds. Expert support for concepts utilized in metric development was identified. For vignettes presented in the Delphi, the sign of change in score correctly classified de-escalation in all vignettes except those involving substitution of oral antibiotics. The sensitivity and specificity of the method to identify de-escalation events as judged by non-Delphi stewards were 86.3% and 96.0%, respectively. Identification of de-escalation events based on an algorithm that measures microbial spectrum of antibiotic regimens generally agreed with steward judgments of de-escalation status.

Curricular priorities for business ethics in medical practice and research: recommendations from Delphi consensus panels.

PubMed

DuBois, James M; Kraus, Elena M; Gursahani, Kamal; Mikulec, Anthony; Bakanas, Erin

2014-11-15

No published curricula in the area of medical business ethics exist. This is surprising given that physicians wrestle daily with business decisions and that professional associations, the Institute of Medicine, Health and Human Services, Congress, and industry have issued related guidelines over the past 5 years. To fill this gap, the authors aimed (1) to identify the full range of medical business ethics topics that experts consider important to teach, and (2) to establish curricular priorities through expert consensus. In spring 2012, the authors conducted an online Delphi survey with two heterogeneous panels of experts recruited in the United States. One panel focused on business ethics in medical practice (n = 14), and 1 focused on business ethics in medical research (n = 12). Panel 1 generated an initial list of 14 major topics related to business ethics in medical practice, and subsequently rated 6 topics as very important or essential to teach. Panel 2 generated an initial list of 10 major topics related to business ethics in medical research, and subsequently rated 5 as very important or essential. In both domains, the panel strongly recommended addressing problems that conflicts of interest can cause, legal guidelines, and the goals or ideals of the profession. The Bander Center for Medical Business Ethics at Saint Louis University will use the results of the Delphi panel to develop online curricular resources for each of the highest rated topics.

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study.

PubMed

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-09-01

To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Lifelong learning in nursing: a Delphi study.

PubMed

Davis, Lisa; Taylor, Heidi; Reyes, Helen

2014-03-01

In order to foster a culture of lifelong learning in nursing, it is important to identify what the concept means in the nursing profession as well as the characteristics of a lifelong learner. The purpose of this Delphi study was to conceptualize lifelong learning from the perspective of nursing, and to identify characteristics and essential elements of lifelong learning. A Delphi Study technique in three phases was completed using an online survey tool. Data were analyzed for conceptual description, ratings of characteristics and attributes, and expert consensus in these three phases. An online survey tool was used in this study. Recognized experts in nursing education, administration and public policy participated in this study. Lifelong learning in nursing is defined as a dynamic process, which encompasses both personal and professional life. This learning process is also both formal and informal. Lifelong learning involves seeking and appreciating new worlds or ideas in order to gain a new perspective as well as questioning one's environment, knowledge, skills and interactions. The most essential characteristics of a lifelong learner are reflection, questioning, enjoying learning, understanding the dynamic nature of knowledge, and engaging in learning by actively seeking learning opportunities. Keeping the mind active is essential to both lifelong learning and being able to translate knowledge into the capacity to deliver high quality nursing care. It is hoped that a clearer understanding of lifelong learning in nursing will foster more discussion and research about intentional, active inclusion of lifelong learning behaviors in nursing curricula. Copyright © 2013 Elsevier Ltd. All rights reserved.

Development of the Canadian Physiotherapy Assessment of Clinical Performance: A New Tool to Assess Physiotherapy Students' Performance in Clinical Education.

PubMed

Mori, Brenda; Brooks, Dina; Norman, Kathleen E; Herold, Jodi; Beaton, Dorcas E

2015-08-01

To develop the first draft of a Canadian tool to assess physiotherapy (PT) students' performance in clinical education (CE). Phase 1: to gain consensus on the items within the new tool, the number and placement of the comment boxes, and the rating scale; Phase 2: to explore the face and content validity of the draft tool. Phase 1 used the Delphi method; Phase 2 used cognitive interviewing methods with recent graduates and clinical instructors (CIs) and detailed interviews with clinical education and measurement experts. Consensus was reached on the first draft of the new tool by round 3 of the Delphi process, which was completed by 21 participants. Interviews were completed with 13 CIs, 6 recent graduates, and 7 experts. Recent graduates and CIs were able to interpret the tool accurately, felt they could apply it to a recent CE experience, and provided suggestions to improve the draft. Experts provided salient advice. The first draft of a new tool to assess PT students in CE, the Canadian Physiotherapy Assessment of Clinical Performance (ACP), was developed and will undergo further development and testing, including national consultation with stakeholders. Data from Phase 2 will contribute to developing an online education module for CIs and students.

Experience of Delphi technique in the process of establishing consensus on core competencies.

PubMed

Raghav, Pankaja Ravi; Kumar, Dewesh; Bhardwaj, Pankaj

2016-01-01

The Department of Community Medicine and Family Medicine (CMFM) has been started as a new model for imparting the components of family medicine and delivering health-care services at primary and secondary levels in all six newly established All India Institute of Medical Sciences (AIIMS), but there is no competency-based curriculum for it. The paper aims to share the experience of Delphi method in the process of developing consensus on core competencies of the new model of CMFM in AIIMS for undergraduate medical students in India. The study adopted different approaches and methods, but Delphi was the most critical method used in this research. In Delphi, the experts were contacted by e-mail and their feedback on the same was analyzed. Two rounds of Delphi were conducted in which 150 participants were contacted in Delphi-I but only 46 responded. In Delphi-II, 26 participants responded whose responses were finally considered for analysis. Three of the core competencies namely clinician, primary-care physician, and professionalism were agreed by all the participants, and the least agreement was observed in the competencies of epidemiologist and medical teacher. The experts having more experience were less consistent as responses were changed from agree to disagree in more than 15% of participants and 6% changed from disagree to agree. Within the given constraints, the final list of competencies and skills for the discipline of CMFM compiled after the Delphi process will provide a useful insight into the development of competency-based curriculum of the subject.

Consensus development of core competencies in intensive and critical care medicine training in China.

PubMed

Hu, Xiaoyun; Xi, Xiuming; Ma, Penglin; Qiu, Haibo; Yu, Kaijiang; Tang, Yaoqing; Qian, Chuanyun; Fang, Qiang; Wang, Yushan; Yu, Xiangyou; Xu, Yuan; Du, Bin

2016-10-16

The aim of this study is to develop consensus on core competencies required for postgraduate training in intensive care medicine. We used a combination of a modified Delphi method and a nominal group technique to create and modify the list of core competencies to ensure maximum consensus. Ideas were generated modified from Competency Based Training in Intensive Care Medicine in Europe collaboration (CoBaTrICE) core competencies. An online survey invited healthcare professionals, educators, and trainees to rate and comment on these competencies. The output from the online survey was edited and then reviewed by a nominal group of 13 intensive care professionals to identify each competence for importance. The resulting list was then recirculated in the nominal group for iterative rating. The online survey yielded a list of 199 competencies for nominal group reviewing. After five rounds of rating, 129 competencies entered the final set defined as core competencies. We have generated a set of core competencies using a consensus technique which can serve as an indicator for training program development.

Integrating UDL Principles and Practices into the Online Course Development Process: A Delphi Study

ERIC Educational Resources Information Center

Singleton, Korey J.

2017-01-01

The literature shows that both faculty and students hold favorable opinions about UDL principles and practices and students' benefit from such practices when implemented in the higher education classroom. Despite this, faculty members remain resistant to implementing UDL principles and practices. Few studies have examined the barriers impacting…

Modified Policy-Delphi study for exploring obesity prevention priorities

PubMed Central

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-01-01

Introduction Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of ‘intrusiveness’ has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. Methods and analysis The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethics and dissemination Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. PMID:27601495

Three decision-making aids: brainstorming, nominal group, and Delphi technique.

PubMed

McMurray, A R

1994-01-01

The methods of brainstorming, Nominal Group Technique, and the Delphi technique can be important resources for nursing staff development educators who wish to expand their decision-making skills. Staff development educators may find opportunities to use these methods for such tasks as developing courses, setting departmental goals, and forecasting trends for planning purposes. Brainstorming, Nominal Group Technique, and the Delphi technique provide a structured format that helps increase the quantity and quality of participant responses.

Development of a nationwide consensus syllabus of palliative medicine for undergraduate medical education in Japan: a modified Delphi method.

PubMed

Kizawa, Yoshiyuki; Tsuneto, Satoru; Tamba, Kaichiro; Takamiya, Yusuke; Morita, Tatsuya; Bito, Seiji; Otaki, Junji

2012-07-01

There is currently no consensus syllabus of palliative medicine for undergraduate medical education in Japan, although the Cancer Control Act proposed in 2007 covers the dissemination of palliative care. To develop a nationwide consensus syllabus of palliative medicine for undergraduate medical education in Japan using a modified Delphi method. We adopted the following three-step method: (1) a workshop to produce the draft syllabus; (2) a survey-based provisional syllabus; (3) Delphi rounds and a panel meeting (modified Delphi method) to produce the working syllabus. Educators in charge of palliative medicine from 63% of the medical schools in Japan collaborated to develop a survey-based provisional syllabus before the Delphi rounds. A panel of 32 people was then formed for the modified Delphi rounds comprising 28 educators and experts in palliative medicine, one cancer survivor, one bereaved family member, and two medical students. The final consensus syllabus consists of 115 learning objectives across seven sections as follows: basic principles; disease process and comprehensive assessment; symptom management; psychosocial care; cultural, religious, and spiritual issues; ethical issues; and legal frameworks. Learning objectives were categorized as essential or desirable (essential: 66; desirable: 49). A consensus syllabus of palliative medicine for undergraduate medical education was developed using a clear and innovative methodology. The final consensus syllabus will be made available for further dissemination of palliative care education throughout the country.

How to use the nominal group and Delphi techniques.

PubMed

McMillan, Sara S; King, Michelle; Tully, Mary P

2016-06-01

Introduction The Nominal Group Technique (NGT) and Delphi Technique are consensus methods used in research that is directed at problem-solving, idea-generation, or determining priorities. While consensus methods are commonly used in health services literature, few studies in pharmacy practice use these methods. This paper provides an overview of the NGT and Delphi technique, including the steps involved and the types of research questions best suited to each method, with examples from the pharmacy literature. Methodology The NGT entails face-to-face discussion in small groups, and provides a prompt result for researchers. The classic NGT involves four key stages: silent generation, round robin, clarification and voting (ranking). Variations have occurred in relation to generating ideas, and how 'consensus' is obtained from participants. The Delphi technique uses a multistage self-completed questionnaire with individual feedback, to determine consensus from a larger group of 'experts.' Questionnaires have been mailed, or more recently, e-mailed to participants. When to use The NGT has been used to explore consumer and stakeholder views, while the Delphi technique is commonly used to develop guidelines with health professionals. Method choice is influenced by various factors, including the research question, the perception of consensus required, and associated practicalities such as time and geography. Limitations The NGT requires participants to personally attend a meeting. This may prove difficult to organise and geography may limit attendance. The Delphi technique can take weeks or months to conclude, especially if multiple rounds are required, and may be complex for lay people to complete.

Intuitionistic fuzzy analytical hierarchical processes for selecting the paradigms of mangroves in municipal wastewater treatment.

PubMed

Ouyang, Xiaoguang; Guo, Fen

2018-04-01

Municipal wastewater discharge is widespread and one of the sources of coastal eutrophication, and is especially uncontrolled in developing and undeveloped coastal regions. Mangrove forests are natural filters of pollutants in wastewater. There are three paradigms of mangroves for municipal wastewater treatment and the selection of the optimal one is a multi-criteria decision-making problem. Combining intuitionistic fuzzy theory, the Fuzzy Delphi Method and the fuzzy analytical hierarchical process (AHP), this study develops an intuitionistic fuzzy AHP (IFAHP) method. For the Fuzzy Delphi Method, the judgments of experts and representatives on criterion weights are made by linguistic variables and quantified by intuitionistic fuzzy theory, which is also used to weight the importance of experts and representatives. This process generates the entropy weights of criteria, which are combined with indices values and weights to rank the alternatives by the fuzzy AHP method. The IFAHP method was used to select the optimal paradigm of mangroves for treating municipal wastewater. The entropy weights were entrained by the valid evaluation of 64 experts and representatives via online survey. Natural mangroves were found to be the optimal paradigm for municipal wastewater treatment. By assigning different weights to the criteria, sensitivity analysis shows that natural mangroves remain to be the optimal paradigm under most scenarios. This study stresses the importance of mangroves for wastewater treatment. Decision-makers need to contemplate mangrove reforestation projects, especially where mangroves are highly deforested but wastewater discharge is uncontrolled. The IFAHP method is expected to be applied in other multi-criteria decision-making cases. Copyright © 2017 Elsevier Ltd. All rights reserved.

Management of problematic behaviours among individuals on long-term opioid therapy: protocol for a Delphi study

PubMed Central

Merlin, Jessica S; Young, Sarah R; Azari, Soraya; Becker, William C; Liebschutz, Jane M; Pomeranz, Jamie; Roy, Payel; Saini, Shalini; Starrels, Joanna L; Edelman, E Jennifer

2016-01-01

Introduction Given the sharp rise in opioid prescribing and heightened recognition of opioid addiction and overdose, opioid safety has become a priority. Clinical guidelines on long-term opioid therapy (LTOT) for chronic pain consistently recommend routine monitoring and screening for problematic behaviours. Yet, there is no consensus definition regarding what constitutes a problematic behaviour, and recommendations for appropriate management to inform front-line providers, researchers and policymakers are lacking. This creates a barrier to effective guideline implementation. Thus, our objective is to present the protocol for a Delphi study designed to: (1) elicit expert opinion to identify the most important problematic behaviours seen in clinical practice and (2) develop consensus on how these behaviours should be managed in the context of routine clinical care. Methods/analysis We will include clinical experts, defined as individuals who provide direct patient care to adults with chronic pain who are on LTOT in an ambulatory setting, and for whom opioid prescribing for chronic non-malignant pain is an area of expertise. The Delphi study will be conducted online in 4 consecutive rounds. Participants will be asked to list problematic behaviours and identify which behaviours are most common and challenging. They will then describe how they would manage the most frequently occurring common and challenging behaviours, rating the importance of each management strategy. Qualitative analysis will be used to categorise behaviours and management strategies, and consensus will be based on a definition established a priori. Ethics/dissemination This study has been approved by the Institutional Review Board (IRB) of the University of Alabama at Birmingham (UAB). This study will generate Delphi-based expert consensus on the management of problematic behaviours that arise in individuals on LTOT, which we will publish and disseminate to appropriate professional societies. Ultimately, our findings will provide guidance to front-line providers, researchers and policymakers. PMID:27154486

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol

PubMed Central

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-01-01

Introduction Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues—including conceptualisation, measurement and data analysis—that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. Methods and analysis This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. Ethics and dissemination An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. PMID:28188154

A DELPHI STUDY OF RISK FACTORS FOR ACHILLES TENDINOPATHY- OPINIONS OF WORLD TENDON EXPERTS

PubMed Central

Watson, Paul J.; Barry, Simon

2016-01-01

Background and Purpose Achilles tendinopathy can be a debilitating chronic condition for both active and inactive individuals. The identification of risk facors is important both in preventing but also treating tendinopathy, many factors have been proposed but there is a lack of primary epidemiological data. The purpose of this study was to develop a statement of expert consensus on risk factors for Achilles tendinopathy in active and sedentary patient populations to inform a primary epidemiological study. Study design Delphi study Methods and Measures An online Delphi study was completed inviting participation from world tendon experts. The consensus was developed using three rounds of the Delphi technique. The first round developed a complete list of potential risk factors, the second round refined this list but also separated the factors into two population groups – active/athletic and inactive/sedentary. The third round ranked this list in order of perceived importance. Results Forty-four experts were invited to participate, 16 participated in the first round (response rate 40%) and two dropped out in the second round (resulting in a response rate of 35%). A total of 27 intrinsic and eight extrinsic risk factors were identified during round one. During round two only 12 intrinsic and five extrinsic risk factors were identified as important in active/athletic tendinopathy while 14 intrinsic and three extrinsic factors were identified as important for inactive/sedentary tendinopathy. Conclusions Risk factors for Achilles tendinopathy were identified based on expert consensus, and these factors provide a basis for primary epidemiological studies. Plantarflexor strength was identified as the primary modifiable factor in the active/athletic group while systemic factors were identified as important in the inactive/sedentary group, many of the potential factors suggested for either group were non-modifiable. Non-modifiable factors include: previous tendinopathy, previous injury, advancing age, sex, steroid exposure, and antibiotic treatment. Level of evidence Level V PMID:27757281

Setting Priorities for Gerontological Social Work Research: A National Delphi Study

ERIC Educational Resources Information Center

Burnette, Denise; Morrow-Howell, Nancy; Chen, Li-Mei

2003-01-01

Purpose: An increasingly important task for all disciplines involved in aging research is to identify and prioritize areas for investigation. This article reports the results of a national Delphi study on setting research priorities for gerontological social work. Design and Methods: Delphi methodology, a structured process for eliciting and…

Terminating Sequential Delphi Survey Data Collection

ERIC Educational Resources Information Center

Kalaian, Sema A.; Kasim, Rafa M.

2012-01-01

The Delphi survey technique is an iterative mail or electronic (e-mail or web-based) survey method used to obtain agreement or consensus among a group of experts in a specific field on a particular issue through a well-designed and systematic multiple sequential rounds of survey administrations. Each of the multiple rounds of the Delphi survey…

Towards global consensus on core outcomes for hidradenitis suppurativa research: an update from the HISTORIC consensus meetings I and II*

PubMed Central

Thorlacius, L.; Garg, A.; Ingram, J.R.; Villumsen, B.; Riis, P. Theut; Gottlieb, A.B.; Merola, J.F.; Dellavalle, R.; Ardon, C.; Baba, R.; Bechara, F.G.; Cohen, A.D.; Daham, N.; Davis, M.; Emtestam, L.; Fernández-Peñas, P.; Filippelli, M.; Gibbons, A.; Grant, T.; Guilbault, S.; Gulliver, S.; Harris, C; Harvent, C.; Houston, K.; Kirby, J.S.; Matusiak, L.; Mehdizadeh, A.; Mojica, T.; Okun, M.; Orgill, D.; Pallack, L.; Parks-Miller, A.; Prens, E.P.; Randell, S.; Rogers, C.; Rosen, C.F.; Choon, S.E.; van der Zee, H.H.; Christensen, R.; Jemec, G.B.E.

2018-01-01

Summary Background A core outcomes set (COS) is an agreed minimum set of outcomes that should be measured and reported in all clinical trials for a specific condition. Hidradenitis suppurativa (HS) has no agreed-upon COS. A central aspect in the COS development process is to identify a set of candidate outcome domains from a long list of items. Our long list had been developed from patient interviews, a systematic review of the literature and a healthcare professional survey, and initial votes had been cast in two e-Delphi surveys. In this manuscript, we describe two in-person consensus meetings of Delphi participants designed to ensure an inclusive approach to generation of domains from related items. Objectives To consider which items from a long list of candidate items to exclude and which to cluster into outcome domains. Methods The study used an international and multistakeholder approach, involving patients, dermatologists, surgeons, the pharmaceutical industry and medical regulators. The study format was a combination of formal presentations, small group work based on nominal group theory and a subsequent online confirmation survey. Results Forty-one individuals from 13 countries and four continents participated. Nine items were excluded and there was consensus to propose seven domains: disease course, physical signs, HS-specific quality of life, satisfaction, symptoms, pain and global assessments. Conclusions The HISTORIC consensus meetings I and II will be followed by further e-Delphi rounds to finalize the core domain set, building on the work of the in-person consensus meetings. PMID:29080368

Quality pharmacy services and key performance indicators in Polish NICUs: a Delphi approach.

PubMed

Krzyżaniak, Natalia; Pawłowska, Iga; Bajorek, Beata

2018-03-31

Background Currently, there is no literature describing what a quality level of practice entails in Polish neonatal intensive care units (NICUs), nor are there any means of currently measuring the quality of pharmaceutical care provided to NICU patients. Objective To identify a set of essential pharmacist roles and pharmacy-relevant key performance indicators (KPI's) suitable for Polish neonatal intensive units (NICUs). Setting Polish hospital pharmacies and NICUs. Method Using a modified Delphi technique, potential KPI's structured along Donabedian's domains as well as pharmacy services were presented to an expert panel of stakeholders. Two online, consecutive Delphi rounds, were completed by panellists between August and September 2017. Main outcome measure To identify the minimum level of pharmacy services that should be consistently provided to NICU patients. Results A total of 16 panellists contributed to the expert panel. Overall, consensus of 75% was reached for 23 indicators and for 28 roles. When considering pharmacy services for the NICU, the experts were found to highly value traditional pharmacy roles, such as dispensing and extemporaneous compounding, however, they were still eager for roles in the other domains, such as educational and clinical services, to be listed as essential for NICU practice. Panellists were found to positively value the list of indicators presented, and excluded only 9 out of the total list. Conclusion There is a need for future research to establish a minimum standard of practice for Polish pharmacists to encourage the progression and standardisation of hospital pharmacy services to meet the level of practice seen in NICUs worldwide.

Reference Materials in LIS Instruction: A Delphi Study

ERIC Educational Resources Information Center

Rabina, Debbie

2013-01-01

This paper presents the results of a Delphi study conducted over a two-month period in 2011. The purpose of the study was to identify reference sources that should be covered in basic reference courses taught in LIS programs in the United States. The Delphi method was selected for its appropriateness in soliciting expert opinions and assessing the…

A Delphi Study: Exploring Faculty Perceptions of the Best Practices Influencing Student Persistence in Blended Courses

ERIC Educational Resources Information Center

Manning, Kim Elise

2010-01-01

This Delphi study explored the instructional practices of community college faculty who were teaching blended or Web-assisted courses and how these practices influenced student persistence. The Delphi method provided qualitative data in the form of expert advice through consensus building on the instructional practices most likely to influence…

Career and Technical Education at a Crossroads: A Delphi Study

ERIC Educational Resources Information Center

Cutright, Michael W.

2011-01-01

Career and technical education in the United States has reached a critical juncture. A three round Delphi method was used to determine a consensus on the future events of career and technical education to better inform educational decision makers. Forty-one individual experts in the field were invited to serve as panelists for the Delphi study and…

A Delphi Study on Staff Bereavement Training in the Intellectual and Developmental Disabilities Field

ERIC Educational Resources Information Center

Gray, Jennifer A.; Truesdale, Jesslyn

2015-01-01

The Delphi technique was used to obtain expert panel consensus to prioritize content areas and delivery methods for developing staff grief and bereavement curriculum training in the intellectual and developmental disabilities (IDD) field. The Delphi technique was conducted with a panel of 18 experts from formal and informal disability caregiving,…

Engaging Patients and Caregivers Managing Rare Diseases to Improve the Methods of Clinical Guideline Development: A Research Protocol

PubMed Central

Kinnett, Kathi; Grant, Sean; Lucas, Ann; Martin, Ann; Denger, Brian; Peay, Holly; Coulter, Ian; Fink, Arlene

2017-01-01

Background Clinical guidelines provide systematically developed recommendations for deciding on appropriate health care options for specific conditions and clinical circumstances. Up until recently, patients and caregivers have rarely been included in the process of developing care guidelines. Objective This project will develop and test a new online method for including patients and their caregivers in this process using Duchenne muscular dystrophy (DMD) care guidelines as an example. The new method will mirror and complement the RAND/UCLA Appropriateness Method (RAM)—the gold standard approach for conducting clinical expert panels that uses a modified Delphi format. RAM is often used in clinical guideline development to determine care appropriateness and necessity in situations where existing clinical evidence is uncertain, weak, or unavailable. Methods To develop the new method for engaging patients and their caregivers in guideline development, we will first conduct interviews with experts on RAM, guideline development, patient engagement, and patient-centeredness and engage with Duchenne patients and caregivers to identify how RAM should be modified for the purposes of patient engagement and what rating criteria should patients and caregivers use to provide their input during the process of guideline development. Once the new method is piloted, we will test it by conducting two concurrently run patient/caregiver panels that will rate patient-centeredness of a subset of DMD care management recommendations already deemed clinically appropriate and necessary. The ExpertLens™ system—a previously evaluated online modified Delphi system that combines two rounds of rating with a round of feedback and moderated online discussions—will be used to conduct these panels. In addition to developing and testing the new engagement method, we will work with the members of our project’s Advisory Board to generate a list of best practices for enhancing the level of patient and caregiver involvement in the guideline development process. We will solicit input on these best practice from Duchenne patients, caregivers, and clinicians by conducting a series of round-table discussions and making a presentation at an annual conference on Duchenne. Results The study protocol was reviewed by RAND’s Human Subjects Protection Committee, which determined it to be exempt from review. Interviews with RAM experts have been completed. The projected study completion date is May 2020. Conclusions We expect that the new method will make it easier to engage large numbers of patients and caregivers in the process of guideline development in a rigorous and culturally appropriate manner that is consistent with the way clinicians participate in guideline development. Moreover, this project will develop best practices that could help involve patients and caregivers in the clinical guideline development process in other clinical areas, thereby facilitating the work of guideline developers. PMID:28455279

Expert Consensus on Characteristics of Wisdom: A Delphi Method Study

ERIC Educational Resources Information Center

Jeste, Dilip V.; Ardelt, Monika; Blazer, Dan; Kraemer, Helena C.; Vaillant, George; Meeks, Thomas W.

2010-01-01

Purpose: Wisdom has received increasing attention in empirical research in recent years, especially in gerontology and psychology, but consistent definitions of wisdom remain elusive. We sought to better characterize this concept via an expert consensus panel using a 2-phase Delphi method. Design and Methods: A survey questionnaire comprised 53…

Application of the Delphi technique in healthcare maintenance.

PubMed

Njuangang, Stanley; Liyanage, Champika; Akintoye, Akintola

2017-10-09

Purpose The purpose of this paper is to examine the research design, issues and considerations in the application of the Delphi technique to identify, refine and rate the critical success factors and performance measures in maintenance-associated infections. Design/methodology/approach In-depth literature review through the application of open and axial coding were applied to formulate the interview and research questions. These were used to conduct an exploratory case study of two healthcare maintenance managers, randomly selected from two National Health Service Foundation Trusts in England. The results of exploratory case study provided the rationale for the application of the Delphi technique in this research. The different processes in the application of the Delphi technique in healthcare research are examined thoroughly. Findings This research demonstrates the need to apply and integrate different research methods to enhance the validity of the Delphi technique. The rationale for the application of the Delphi technique in this research is because some healthcare maintenance managers lack knowledge about basic infection control (IC) principles to make hospitals safe for patient care. The result of first round of the Delphi exercise is a useful contribution in its own rights. It identified a number of salient issues and differences in the opinions of the Delphi participants, noticeably between healthcare maintenance managers and members of the infection control team. It also resulted in useful suggestions and comments to improve the quality and presentation of the second- and third-round Delphi instruments. Practical implications This research provides a research methodology that can be adopted by researchers investigating new and emerging issues in the healthcare sector. As this research demonstrates, the Delphi technique is relevant in soliciting expert knowledge and opinion to identify performance measures to control maintenance-associated infections in hospitals. The methodology provided here could be applied by other researchers elsewhere to probe, investigate and generate rich information about new and emerging healthcare research topics. Originality/value The authors demonstrate how different research methods can be integrated to enhance the validity of the Delphi technique. For example, the results of an exploratory case study provided the rationale for the application of the Delphi technique investigating the key performance measures in maintenance-associated infections. The different processes involved in the application of the Delphi technique are also carefully explored and discussed in depth.

Highly efficient and exact method for parallelization of grid-based algorithms and its implementation in DelPhi

PubMed Central

Li, Chuan; Li, Lin; Zhang, Jie; Alexov, Emil

2012-01-01

The Gauss-Seidel method is a standard iterative numerical method widely used to solve a system of equations and, in general, is more efficient comparing to other iterative methods, such as the Jacobi method. However, standard implementation of the Gauss-Seidel method restricts its utilization in parallel computing due to its requirement of using updated neighboring values (i.e., in current iteration) as soon as they are available. Here we report an efficient and exact (not requiring assumptions) method to parallelize iterations and to reduce the computational time as a linear/nearly linear function of the number of CPUs. In contrast to other existing solutions, our method does not require any assumptions and is equally applicable for solving linear and nonlinear equations. This approach is implemented in the DelPhi program, which is a finite difference Poisson-Boltzmann equation solver to model electrostatics in molecular biology. This development makes the iterative procedure on obtaining the electrostatic potential distribution in the parallelized DelPhi several folds faster than that in the serial code. Further we demonstrate the advantages of the new parallelized DelPhi by computing the electrostatic potential and the corresponding energies of large supramolecular structures. PMID:22674480

Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi consensus approach.

PubMed

Wakai, Abel; O'Sullivan, Ronan; Staunton, Paul; Walsh, Cathal; Hickey, Fergal; Plunkett, Patrick K

2013-04-01

The objective of this study was to develop a consensus among emergency medicine (EM) specialists working in Ireland for emergency department (ED) key performance indicators (KPIs). The method employed was a three-round electronic modified-Delphi process. An online questionnaire with 54 potential KPIs was set up for round 1 of the Delphi process. The Delphi panel consisted of all registered EM specialists in Ireland. Each indicator on the questionnaire was rated using a five-point Likert-type rating scale. Agreement was defined as at least 70% of the responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using standard descriptive statistics. Data were also analysed as the mean of the Likert rating with 95% confidence intervals (95% CIs). Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Statistical analyses were carried out using SPSS version 16.0. The response rates in rounds 1, 2 and 3 were 86, 88 and 88%, respectively. Ninety-seven potential indicators reached agreement after the three rounds. In the context of the Donabedian structure-process-outcome framework of performance indicators, 41 (42%) of the agreed indicators were structure indicators, 52 (54%) were process indicators and four (4%) were outcome indicators. Overall, the top-three highest rated indicators were: presence of a dedicated ED clinical information system (4.7; 95% CI 4.6-4.9), ED compliance with minimum design standards (4.7; 95% CI 4.5-4.8) and time from ED arrival to first ECG in suspected cardiac chest pain (4.7; 95% CI 4.5-4.9). The top-three highest rated indicators specific to clinical care of children in EDs were: time to administration of antibiotics in children with suspected bacterial meningitis (4.6; 95% CI 4.5-4.8), separate area available within EDs (seeing both adults and children) to assess children (4.4; 95% CI 4.2-4.6) and time to administration of analgesia in children with forearm fractures (4.4; 95% CI 4.2-4.7). Employing a Delphi consensus process, it was possible to reach a consensus among EM specialists in Ireland on a suite of 97 KPIs for EDs.

Internet Basics: Your Online Access to the Global Electronic Superhighway.

ERIC Educational Resources Information Center

Lambert, Steve; Howe, Walt

This clear and simple handbook is a guide to use of the Internet. For readers without free Internet access through work or school, the book includes membership and 5 hours of time on Delphi Internet Services Corporation, a widely used commercial access to the Internet. Chapters review the following: (1) an introduction to the Internet; (2) ways to…

[Modified Delphi method in the constitution of school sanitation standard].

PubMed

Yin, Xunqiang; Liang, Ying; Tan, Hongzhuan; Gong, Wenjie; Deng, Jing; Luo, Jiayou; Di, Xiaokang; Wu, Yue

2012-11-01

To constitute school sanitation standard using modified Delphi method, and to explore the feasibility and the predominance of Delphi method in the constitution of school sanitation standard. Two rounds of expert consultations were adopted in this study. The data were analyzed with SPSS15.0 to screen indices of school sanitation standard. Thirty-two experts accomplished the 2 rounds of consultations. The average length of expert service was (24.69 ±8.53) years. The authority coefficient was 0.729 ±0.172. The expert positive coefficient was 94.12% (32/34) in the first round and 100% (32/32) in the second round. The harmonious coefficients of importance, feasibility and rationality in the second round were 0.493 (P<0.05), 0.527 (P<0.01), and 0.535 (P<0.01), respectively, suggesting unanimous expert opinions. According to the second round of consultation, 38 indices were included in the framework. Theoretical analysis, literature review, investigation and so on are generally used in health standard constitution currently. Delphi method is a rapid, effective and feasible method in this field.

The Delphi Method in Rehabilitation Counseling Research

ERIC Educational Resources Information Center

Vazquez-Ramos, Robinson; Leahy, Michael; Estrada Hernandez, Noel

2007-01-01

Rehabilitation researchers have found in the application of the Delphi method a more sophisticated way of obtaining consensus from experts in the field on certain matters. The application of this research methodology has affected and certainly advanced the body of knowledge of the rehabilitation counseling practice. However, the rehabilitation…

Application of Delphi-AHP methods to select the priorities of WEEE for recycling in a waste management decision-making tool.

PubMed

Kim, Mincheol; Jang, Yong-Chul; Lee, Seunguk

2013-10-15

The management of waste electrical and electronic equipment (WEEE) or electronic waste (e-waste) has become a major issue of concern for solid waste communities due to the large volumes of waste being generated from the consumption of modern electrical and electronic products. In 2003, Korea introduced the extended producer responsibility (EPR) system to reduce the amount of electronic products to be disposed and to promote resource recovery from WEEE. The EPR currently regulates a total of 10 electrical and electronic products. This paper presents the results of the application of the Delphi method and analytical hierarchy process (AHP) modeling to the WEEE management tool in the policy-making process. Specifically, this paper focuses on the application of the Delphi-AHP technique to determine the WEEE priority to be included in the EPR system. Appropriate evaluation criteria were derived using the Delphi method to assess the potential selection and priority among electrical and electronic products that will be regulated by the EPR system. Quantitative weightings from the AHP model were calculated to identify the priorities of electrical and electronic products to be potentially regulated. After applying all the criteria using the AHP model, the results indicate that the top 10 target recycling products for the expansion of the WEEE list were found to be vacuum cleaners, electric fans, rice cookers, large freezers, microwave ovens, water purifiers, air purifiers, humidifiers, dryers, and telephones in order from the first to last. The proposed Delphi-AHP method can offer a more efficient means of selecting WEEE than subjective assessment methods that are often based on professional judgment or limited available data. By providing WEEE items to be regulated, the proposed Delphi-AHP method can eliminate uncertainty and subjective assessment and enable WEEE management policy-makers to identify the priority of potential WEEE. More generally, the work performed in this study is an example of how Delphi-AHP modeling can be used as a decision-making process tool in WEEE management. Crown Copyright © 2013. Published by Elsevier Ltd. All rights reserved.

Academic Primer Series: Key Papers About Competency-Based Medical Education

PubMed Central

Cooney, Robert; Chan, Teresa M.; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-01-01

Introduction Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Methods Based on the online discussions of the 2016–2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Results Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. Conclusion We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs. PMID:28611893

Clinical stakeholders’ opinions on the use of selective decontamination of the digestive tract in critically ill patients in intensive care units: an international Delphi study

PubMed Central

2013-01-01

Introduction Selective decontamination of the digestive tract (SDD) is a prophylactic antibiotic regimen that is not widely used in practice. We aimed to describe the opinions of key ‘stakeholders’ about the validity of the existing evidence base, likely consequences of implementation, relative importance of their opinions in influencing overall practice, likely barriers to implementation and perceptions of the requirement for further research to inform the decision about whether to embark on a further large randomised controlled trial. Methods This was a Delphi study informed by comprehensive framework of possible determinants of health professionals’ behaviour to study Critical Care practice in four countries. There were four key stakeholder participant groups including ICU physicians, pharmacists, clinical leads, and clinical microbiologists/ infectious disease physicians. Round one comprised participant interviews and Rounds two and three were online questionnaires using Delphi method. Results In this study, 141 participants were recruited of whom 82% were retained. Participants rated themselves as knowledgeable about SDD. Antibiotic resistance was identified as the most important issue. SDD was seen as a low clinical priority but few participants reported strong opposition. There was moderate agreement that research to date has not adequately addressed concerns about antibiotic resistance and lacks generalizability. Participants indicated equipoise with regard to benefits and harms of SDD, and indicated strong support for a further randomised trial. Conclusions Clinicians have clinical equipoise about the effectiveness of SDD. Future research requires longer follow up to assess antibiotic resistance as well as greater validity/generalizability to provide definitive answers on the effectiveness of decontamination and effects on antibiotic resistance. SDD was regarded as not being a high clinical priority, which may limit future trial participation. These results have identified that further large randomised controlled trial of SDD in critical care is both warranted and appropriate. PMID:24207137

Modified Policy-Delphi study for exploring obesity prevention priorities.

PubMed

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-09-06

Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of 'intrusiveness' has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Research priorities of the Canadian chiropractic profession: a consensus study using a modified Delphi technique.

PubMed

French, Simon D; Beliveau, Peter J H; Bruno, Paul; Passmore, Steven R; Hayden, Jill A; Srbely, John; Kawchuk, Greg N

2017-01-01

Research funds are limited and a healthcare profession that supports research activity should establish research priority areas. The study objective was to identify research priority areas for the Canadian chiropractic profession, and for stakeholders in the chiropractic profession to rank these in order of importance. We conducted a modified Delphi consensus study between August 2015 and May 2017 to determine the views of Canadian chiropractic organisations (e.g. Canadian Chiropractic Association; provincial associations) and stakeholder groups (e.g. chiropractic educational institutions; researchers). Participants completed three online Delphi survey rounds. In Round 1, participants suggested research areas within four broad research themes: 1) Basic science; 2) Clinical; 3) Health services; and 4) Population health. In Round 2, researchers created sub-themes by categorising the areas suggested in Round 1, and participants judged the importance of the research sub-themes. We defined consensus as at least 70% of participants agreeing that a research area was "essential" or "very important". In Round 3, results from Round 2 were presented to the participants to re-evaluate the importance of sub-themes. Finally, participants completed an online pairwise ranking activity to determine the rank order of the list of important research sub-themes. Fifty-seven participants, of 85 people invited, completed Round 1 (response rate 67%). Fifty-six participants completed Round 2, 55 completed Round 3, and 53 completed the ranking activity. After three Delphi rounds and the pairwise ranking activity was completed, the ranked list of research sub-themes considered important were: 1) Integration of chiropractic care into multidisciplinary settings; 2) Costs and cost-effectiveness of chiropractic care; 3) Effect of chiropractic care on reducing medical services; 4) Effects of chiropractic care; 5) Safety/side effects of chiropractic care; 6) Chiropractic care for older adults; 7) Neurophysiological mechanisms and effects of spinal manipulative therapy; 8) General mechanisms and effects of spinal manipulative therapy. This project identified research priority areas for the Canadian chiropractic profession. The top three priority areas were all in the area of health services research: 1) Integration of chiropractic care into multidisciplinary settings; 2) Costs and cost-effectiveness of chiropractic care; 3) Effect of chiropractic care on reducing medical services.

Elder-friendly emergency services in Brazil: necessary conditions for care.

PubMed

Santos, Mariana Timmers Dos; Lima, Maria Alice Dias da Silva; Zucatti, Paula Buchs

2016-01-01

To identify and analyze the aspects necessary to provide an elder-friendly emergency service (ES) from the perspective of nurses. This is a descriptive, quantitative study using the Delphi technique in three rounds. Nurses with professional experience in the ES and/or researchers with publications and/or conducting research in the study area were selected. The first round of the Delphi panel had 72 participants, the second 49, and the third 44. An online questionnaire was used based on a review of the scientific literature with questions organized into the central dimensions of elder-friendly hospitals. A five-point Likert scale was used for each question and a 70% consensus level was established. There were 38 aspects identified as necessary for elderly care that were organized into central dimensions. The study's results are consistent with the findings in scientific literature and suggest indicators for quality of care and training for an elder-friendly ES. Identificar e analisar aspectos necessários para um atendimento amigo do idoso nos serviços de emergência (SE), na perspectiva de enfermeiros. Estudo descritivo, quantitativo, com utilização da Técnica Delphi, em três rodadas. Foram selecionados enfermeiros com experiência profissional em SE e/ou pesquisadores com publicações e/ou desenvolvendo pesquisas na área de estudo. A primeira rodada do painel Delphi contou com 72 participantes, a segunda com 49 e a terceira com 44. Foi utilizado questionário on-line, baseado na revisão da literatura científica, com questões organizadas em dimensões centrais de hospitais amigos do idoso. Foi utilizada uma escala de Likert de 5 pontos para cada questão e estabelecido nível de consenso de 70%. Foram identificados 38 aspectos necessários para o atendimento ao idoso, organizados em dimensões centrais. Os resultados do estudo são consistentes com os achados na literatura científica e sugerem indicadores para qualidade do cuidado e para formação de SE amigos do idoso.

Measuring organisational readiness for patient engagement (MORE): an international online Delphi consensus study.

PubMed

Oostendorp, Linda J M; Durand, Marie-Anne; Lloyd, Amy; Elwyn, Glyn

2015-02-14

Widespread implementation of patient engagement by organisations and clinical teams is not a reality yet. The aim of this study is to develop a measure of organisational readiness for patient engagement designed to monitor and facilitate a healthcare organisation's willingness and ability to effectively implement patient engagement in healthcare. The development of the MORE (Measuring Organisational Readiness for patient Engagement) scale was guided by Weiner's theory of organisational readiness for change. Weiner postulates that an organisation's readiness is determined by both the willingness and ability to implement the change (i.e. in this context: patient engagement). A first version of the scale was developed based on a literature search and evaluation of pre-existing tools. We invited multi-disciplinary stakeholders to participate in a two-round online Delphi survey. Respondents were asked to rate the importance of each proposed item, and to comment on the proposed domains and items. Second round participants received feedback from the first round and were asked to re-rate the importance of the revised, new and unchanged items, and to provide comments. The first version of the scale contained 51 items divided into three domains: (1) Respondents' characteristics; (2) the organisation's willingness to implement patient engagement; and (3) the organisation's ability to implement patient engagement. 131 respondents from 16 countries (health care managers, policy makers, clinicians, patients and patient representatives, researchers, and other stakeholders) completed the first survey, and 72 of them also completed the second survey. During the Delphi process, 34 items were reworded, 8 new items were added, 5 items were removed, and 18 were combined. The scale's instructions were revised. The final version of MORE totalled 38 items; 5 on stakeholders, 13 on an organisation's willingness to implement, and 20 on an organisation's ability to implement patient engagement in healthcare. The Delphi technique was successfully used to refine the scale's instructions, domains and items, using input from a broad range of international stakeholders, hoping that MORE can be applied in a variety of healthcare contexts worldwide. Further assessment is needed to determine the psychometric properties of the scale.

The CompHP core competencies framework for health promotion in Europe.

PubMed

Barry, Margaret M; Battel-Kirk, Barbara; Dempsey, Colette

2012-12-01

The CompHP Project on Developing Competencies and Professional Standards for Health Promotion in Europe was developed in response to the need for new and changing health promotion competencies to address health challenges. This article presents the process of developing the CompHP Core Competencies Framework for Health Promotion across the European Union Member States and Candidate Countries. A phased, multiple-method approach was employed to facilitate a consensus-building process on the development of the core competencies. Key stakeholders in European health promotion were engaged in a layered consultation process using the Delphi technique, online consultations, workshops, and focus groups. Based on an extensive literature review, a mapping process was used to identify the core domains, which informed the first draft of the Framework. A consultation process involving two rounds of a Delphi survey with national experts in health promotion from 30 countries was carried out. In addition, feedback was received from 25 health promotion leaders who participated in two focus groups at a pan-European level and 116 health promotion practitioners who engaged in four country-specific consultations. A further 54 respondents replied to online consultations, and there were a number of followers on various social media platforms. Based on four rounds of redrafting, the final Framework document was produced, consisting of 11 core domains and 68 core competency statements. The CompHP Core Competencies Framework for Health Promotion provides a resource for workforce development in Europe, by articulating the necessary knowledge, skills, and abilities that are required for effective practice. The core domains are based on the multidisciplinary concepts, theories, and research that make health promotion distinctive. It is the combined application of all the domains, the knowledge base, and the ethical values that constitute the CompHP Core Competencies Framework for Health Promotion.

The Use of the Delphi and Other Consensus Group Methods in Medical Education Research: A Review.

PubMed

Humphrey-Murto, Susan; Varpio, Lara; Wood, Timothy J; Gonsalves, Carol; Ufholz, Lee-Anne; Mascioli, Kelly; Wang, Carol; Foth, Thomas

2017-10-01

Consensus group methods, such as the Delphi method and nominal group technique (NGT), are used to synthesize expert opinions when evidence is lacking. Despite their extensive use, these methods are inconsistently applied. Their use in medical education research has not been well studied. The authors set out to describe the use of consensus methods in medical education research and to assess the reporting quality of these methods and results. Using scoping review methods, the authors searched the Medline, Embase, PsycInfo, PubMed, Scopus, and ERIC databases for 2009-2016. Full-text articles that focused on medical education and the keywords Delphi, RAND, NGT, or other consensus group methods were included. A standardized extraction form was used to collect article demographic data and features reflecting methodological rigor. Of the articles reviewed, 257 met the inclusion criteria. The Modified Delphi (105/257; 40.8%), Delphi (91/257; 35.4%), and NGT (23/257; 8.9%) methods were most often used. The most common study purpose was curriculum development or reform (68/257; 26.5%), assessment tool development (55/257; 21.4%), and defining competencies (43/257; 16.7%). The reporting quality varied, with 70.0% (180/257) of articles reporting a literature review, 27.2% (70/257) reporting what background information was provided to participants, 66.1% (170/257) describing the number of participants, 40.1% (103/257) reporting if private decisions were collected, 37.7% (97/257) reporting if formal feedback of group ratings was shared, and 43.2% (111/257) defining consensus a priori. Consensus methods are poorly standardized and inconsistently used in medical education research. Improved criteria for reporting are needed.

Using the Delphi Method for Selecting Effective Rehabilitation Practices for Case Study Research: Methods, Challenges, and Solutions and Implications for Future Research

ERIC Educational Resources Information Center

Fleming, Allison R.; Boeltzig-Brown, Heike; Foley, Susan M.

2015-01-01

Purpose: We describe a modified Delphi method used to select effective state vocational rehabilitation agency practices to prioritize rehabilitation services for individuals with most significant disabilities within the context of Order of Selection, an area where there is little known and published. Specifically, we describe how we applied the…

A Research Study Using the Delphi Method to Define Essential Competencies for a High School Game Art and Design Course Framework at the National Level

ERIC Educational Resources Information Center

Mack, Nayo Corenus-Geneva

2011-01-01

This research study reports the findings of a Delphi study conducted to determine the essential competencies and objectives for a high school Game Art and Design course framework at the national level. The Delphi panel consisted of gaming, industry and educational experts from all over the world who were members of the International Game…

Development of an English-language version of a Japanese iPad application to facilitate collaborative goal setting in rehabilitation: a Delphi study and field test

PubMed Central

Tomori, Kounosuke; Takahashi, Kayoko; Sherrington, Aidan J

2018-01-01

Objective This study aimed to investigate the content of an English-language version of a Japanese iPad application designed to facilitate shared decision-making around goal setting in rehabilitation: Aid for Decision-making in Occupational Choice—English (ADOC-E). Design Phase 1: Delphi methods to reach consensus with an international group of expert occupational therapists on the text and images in ADOC-E. Phase 2: Testing correct recognition (unprompted and prompted) of images in ADOC-E by health service users in inpatient rehabilitation and residential care. Setting Phase 1: International, online. Phase 2: Three healthcare services in New Zealand—(1) a residential rehabilitation service for traumatic brain injury, (2) a nursing home for frail older adults and (3) an inpatient rehabilitation ward in a public hospital. Participants Phase 1: Fourteen experienced occupational therapists from New Zealand (4), Australia (4), UK (2) and USA (4). Phase 2: Twenty-four rehabilitation and residential care service users (10 men, 14 women; 20–95 years; Mini-Mental State Exam scores 13–30). Results Four Delphi rounds were required to reach consensus with the experienced occupational therapists on the content of ADOC-E, ending with 100 items covering daily activities that people do and social roles they participate in. Ninety-five per cent (95/100) of ADOC-E items could each be correctly identified by over 80% of service user participants with either unprompted or prompted recognition. Conclusion While a few of the more abstract concepts in ADOC-E (related to complex social roles) were less likely to be correctly recognised by all participants, the text and images ADOC-E were deemed to be fit for purpose overall and ready for future clinical testing. PMID:29500204

Academic Primer Series: Key Papers About Competency-Based Medical Education.

PubMed

Cooney, Robert; Chan, Teresa M; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-06-01

Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Based on the online discussions of the 2016-2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs.

What should dental services for people with disabilities be like? Results of an Irish Delphi panel survey.

PubMed

Mac Giolla Phadraig, Caoimhin; Nunn, June; Dougall, Alison; O'Neill, Eunan; McLoughlin, Jacinta; Guerin, Suzanne

2014-01-01

This study aimed to generate prioritised goals for oral health services for people with disabilities as a first step in meeting the need for evidence based oral health services for people with disabilities in Ireland. The study used a three round modified e-Delphi method, involving dental service professionals and people with disabilities or their representatives, in Ireland. Three rounds were completed online using SurveyMonkey. Round 1 asked: "List what you think dental services for people with disabilities in Ireland should be like." Items for subsequent rounds were generated from responses to Round 1. Round 2 and Round 3 used 5 point Likert scales to rank these items by priority: from No Priority (1) to Top Priority (5). Consensus was achieved on each item where at least 80% of respondents considered an item either High or Top Priority. A consensus meeting concluded the process. Sixty-one panelists started and 48 completed the survey. The Delphi panel agreed on level of priority for 69 items and generated 16 consensus statements. These statements covered a range of topics such as access to care, availability of information and training, quality of care, dental treatment and cost. A recurrent theme relating to the appropriateness of care to individual need arose across topics suggesting a need to match service delivery according to the individual's needs, wants and expectations rather than the disability type/diagnosis based service which predominates today. This process produced a list of prioritised goals for dental services for people with disabilities. This creates a foundation for building evidence-based service models for people with disabilities in Ireland.

POPI (Pediatrics: Omission of Prescriptions and Inappropriate Prescriptions): Development of a Tool to Identify Inappropriate Prescribing

PubMed Central

Prot-Labarthe, Sonia; Weil, Thomas; Angoulvant, François; Boulkedid, Rym; Alberti, Corinne; Bourdon, Olivier

2014-01-01

Introduction Rational prescribing for children is an issue for all countries and has been inadequately studied. Inappropriate prescriptions, including drug omissions, are one of the main causes of medication errors in this population. Our aim is to develop a screening tool to identify omissions and inappropriate prescriptions in pediatrics based on French and international guidelines. Methods A selection of diseases was included in the tool using data from social security and hospital statistics. A literature review was done to obtain criteria which could be included in the tool called POPI. A 2-round-Delphi consensus technique was used to establish the content validity of POPI; panelists were asked to rate their level of agreement with each proposition on a 9-point Likert scale and add suggestions if necessary. Results 108 explicit criteria (80 inappropriate prescriptions and 28 omissions) were obtained and submitted to a 16-member expert panel (8 pharmacists, 8 pediatricians hospital-based −50%- or working in community −50%-). Criteria were categorized according to the main physiological systems (gastroenterology, respiratory infections, pain, neurology, dermatology and miscellaneous). Each criterion was accompanied by a concise explanation as to why the practice is potentially inappropriate in pediatrics (including references). Two round of Delphi process were completed via an online questionnaire. 104 out of the 108 criteria submitted to experts were selected after 2 Delphi rounds (79 inappropriate prescriptions and 25 omissions). Discussion Conclusion POPI is the first screening-tool develop to detect inappropriate prescriptions and omissions in pediatrics based on explicit criteria. Inter-user reliability study is necessary before using the tool, and prospective study to assess the effectiveness of POPI is also necessary. PMID:24978045

Determining e-Portfolio Elements in Learning Process Using Fuzzy Delphi Analysis

ERIC Educational Resources Information Center

Mohamad, Syamsul Nor Azlan; Embi, Mohamad Amin; Nordin, Norazah

2015-01-01

The present article introduces the Fuzzy Delphi method results obtained in the study on determining e-Portfolio elements in learning process for art and design context. This method bases on qualified experts that assure the validity of the collected information. In particular, the confirmation of elements is based on experts' opinion and…

Revised Conceptual Framework of Parent-to-Parent Support for Parents of Children Who Are Deaf or Hard of Hearing: A Modified Delphi Study.

PubMed

Henderson, Rebecca J; Johnson, Andrew M; Moodie, Sheila T

2016-06-01

A scoping review of the literature was conducted, resulting in the development of a conceptual framework of parent-to-parent support for parents with children who are Deaf or hard of hearing. This is the 2nd stage of a dual-stage scoping review. This study sought stakeholder opinion and feedback with an aim to achieve consensus on the constructs, components, and design of the initial conceptual framework. A modified electronic Delphi study was completed with 21 handpicked experts from 7 countries who have experience in provision, research, or experience in the area of parent-to-parent support. Participants completed an online questionnaire using an 11-point Likert scale (strongly disagree to strongly agree) and open-ended questions to answer various questions related to the descriptor terms, definitions, constructs, components, and overall design of the framework. Participant responses led to the revision of the original conceptual framework. The findings from this dual-stage scoping review and electronic Delphi study provide a conceptual framework that defines the vital contribution of parents in Early Hearing Detection and Intervention programs that will be a useful addition to these programs.

Developing a Consensus-Driven, Core Competency Model to Shape Future Audio Engineering Technology Curriculum: A Web-Based Modified Delphi Study

ERIC Educational Resources Information Center

Tough, David T.

2009-01-01

The purpose of this online study was to create a ranking of essential core competencies and technologies required by AET (audio engineering technology) programs 10 years in the future. The study was designed to facilitate curriculum development and improvement in the rapidly expanding number of small to medium sized audio engineering technology…

Design of a Bahasa Melayu Grammar Online Learning Portal for Form Two Students Using Delphi Technique

ERIC Educational Resources Information Center

Leng, Chin Hai; Siraj, Saedah; Asmawi, Adelina; Dewitt, Dorothy; Ranee, Alina

2013-01-01

This study was aimed at developing a Bahasa Melayu grammar learning portal for Form Two students (BMGLP). A developmental approach was used in this study. Needs analysis was carried out on the Bahasa Melayu teachers and Form Two students. The results of needs analysis on Form Two students showed that they preferred topics such as question…

Engaging stakeholders and target groups in prioritising a public health intervention: the Creating Active School Environments (CASE) online Delphi study.

PubMed

Morton, Katie L; Atkin, Andrew J; Corder, Kirsten; Suhrcke, Marc; Turner, David; van Sluijs, Esther M F

2017-01-13

Stakeholder engagement and public involvement are considered as integral to developing effective public health interventions and is encouraged across all phases of the research cycle. However, limited guidelines and appropriate tools exist to facilitate stakeholder engagement-especially during the intervention prioritisation phase. We present the findings of an online 'Delphi' study that engaged stakeholders (including young people) in the process of prioritising secondary school environment-focused interventions that aim to increase physical activity. Web-based data collection using an online Delphi tool enabling participation of geographically diverse stakeholders. 37 stakeholders participated, including young people (age 13-16 years), parents, teachers, public health practitioners, academics and commissioners; 33 participants completed both rounds. Participants were asked to prioritise a (short-listed) selection of school environment-focused interventions (eg, standing desks, outdoor design changes) based on the criteria of 'reach', 'equality', 'acceptability', 'feasibility', 'effectiveness' and 'cost'. Participants were also asked to rank the criteria and the effectiveness outcomes (eg, physical activity, academic achievement, school enjoyment) from most to least important. Following feedback along with any new information provided, participants completed round 2 4 weeks later. The intervention prioritisation process was feasible to conduct and comments from participants indicated satisfaction with the process. Consensus regarding intervention strategies was achieved among the varied groups of stakeholders, with 'active lessons' being the favoured approach. Participants ranked 'mental health and well-being' as the most important outcome followed by 'enjoyment of school'. The most important criteria was 'effectiveness', followed by 'feasibility'. This novel approach to engaging a wide variety of stakeholders in the research process was feasible to conduct and acceptable to participants. It also provided insightful information relating to how stakeholders prioritise interventions. The approach could be extended beyond the specific project to be a useful tool for researchers and practitioners. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

A Quality, Benefit, Cost, and Financial Framework for Health Information Technology, E-Prescribing: A Delphi Study.

PubMed

DeMuro, Paul R; Ash, Joan; Middleton, Blackford; Fletcher, Justin; Madison, Cecelia J

2017-01-01

Little research has been conducted about the quality, benefits, costs, and financial considerations associated with health information technology (HIT), particularly informatics technologies, such as e-prescribing, from the perspective of all its stakeholders. This research effort sought to identify the stakeholders involved in e-prescribing and to identify and rank-order the positives and the negatives from the perspective of the stakeholders to create a framework to assist in the development of incentives and payment mechanisms which result in better managed care. The Delphi method was employed by enlisting a panel of experts. They were presented with the results of initial research in an online survey of questions which sought to prioritize the quality, benefit, cost, and financial effects of e-prescribing from the perspective of each stakeholder. From the results of this study, a framework was presented to framework experts. The experts added stakeholders and positives and negatives to the initial lists and rank-ordered the positives and negatives of e-prescribing from the perspective of each stakeholder. The aggregate results were summarized by category of stakeholder. The framework experts evaluated the framework. Positives and negatives can be rank-ordered from the perspective of each stakeholder. A useful framework was created.

Comparing Management Models of Secondary Schools in Tamaulipas, Mexico: An Exploration with a Delphi Method

ERIC Educational Resources Information Center

Navarro-Leal, Marco Aurelio; Garcia, Concepcion Nino; Saldivar, Luisa Caballero

2012-01-01

For a preliminary exploration of management models between two secondary schools, a Delphi method was used in order to identify and focus relevant topics for a larger research. A first approximation with this method proved to be a heuristic tool to focus and define some categories and guidelines of enquiry. It was found that in both of the schools…

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

Maastricht Delphi Consensus on Event Definitions for Classification of Recurrence in Breast Cancer Research

PubMed Central

van Roozendaal, Lori M.; Strobbe, Luc J. A.; Aebi, Stefan; Cameron, David A.; Dixon, J. Michael; Giuliano, Armando E.; Haffty, Bruce G.; Hickey, Brigid E.; Hudis, Clifford A.; Klimberg, V. Suzanne; Koczwara, Bogda; Kühn, Thorsten; Lippman, Marc E.; Lucci, Anthony; Piccart, Martine; Smith, Benjamin D.; Tjan-Heijnen, Vivianne C. G.; van de Velde, Cornelis J. H.; Van Zee, Kimberly J.; Vermorken, Jan B.; Viale, Giuseppe; Voogd, Adri C.; Wapnir, Irene L.; White, Julia R.; Smidt, Marjolein L.

2014-01-01

Background In breast cancer studies, many different endpoints are used. Definitions are often not provided or vary between studies. For instance, “local recurrence” may include different components in similar studies. This limits transparency and comparability of results. This project aimed to reach consensus on the definitions of local event, second primary breast cancer, regional and distant event for breast cancer studies. Methods The RAND-UCLA Appropriateness method (modified Delphi method) was used. A Consensus Group of international breast cancer experts was formed, including representatives of all involved clinical disciplines. Consensus was reached in two rounds of online questionnaires and one meeting. Results Twenty-four international breast cancer experts participated. Consensus was reached on 134 items in four categories. Local event is defined as any epithelial breast cancer or ductal carcinoma in situ (DCIS) in the ipsilateral breast, or skin and subcutaneous tissue on the ipsilateral thoracic wall. Second primary breast cancer is defined as epithelial breast cancer in the contralateral breast. Regional events are breast cancer in ipsilateral lymph nodes. A distant event is breast cancer in any other location. Therefore, this includes metastasis in contralateral lymph nodes and breast cancer involving the sternal bone. If feasible, tissue sampling of a first, solitary, lesion suspected for metastasis is highly recommended. Conclusion This project resulted in consensus-based event definitions for classification of recurrence in breast cancer research. Future breast cancer research projects should adopt these definitions to increase transparency. This should facilitate comparison of results and conducting reviews as well as meta-analysis. PMID:25381395

A Delphi Investigation into the Research Needs in Swedish Librarianship

ERIC Educational Resources Information Center

Maceviciute, Elena; Wilson, T. D.

2009-01-01

Introduction: Reports the conduct of a national survey in Sweden to establish the desired research priorities for libraries. The research sought to establish what evidence-base is needed for evidence-based practice. Method: The Delphi method was employed to solicit opinions on the kinds of research needed by libraries of all kinds in Sweden.…

An Empirical Investigation of Entrepreneurship Intensity in Iranian State Universities

ERIC Educational Resources Information Center

Mazdeh, Mohammad Mahdavi; Razavi, Seyed-Mostafa; Hesamamiri, Roozbeh; Zahedi, Mohammad-Reza; Elahi, Behin

2013-01-01

The purpose of this study is to propose a framework to evaluate the entrepreneurship intensity (EI) of Iranian state universities. In order to determine EI, a hybrid multi-method framework consisting of Delphi, Analytic Network Process (ANP), and VIKOR is proposed. The Delphi method is used to localize and reduce the number of criteria extracted…

Idea Generation and Exploration: Benefits and Limitations of the Policy Delphi Research Method

ERIC Educational Resources Information Center

Franklin, Kathy K.; Hart, Jan K.

2007-01-01

Researchers use the policy Delphi method to explore a complex topic with little historical context that requires expert opinion to fully understand underlying issues. The benefit of this research technique is the use of experts who have more timely information than can be gleamed from extant literature. Additionally, those experts place…

Cost estimation: An expert-opinion approach. [cost analysis of research projects using the Delphi method (forecasting)

NASA Technical Reports Server (NTRS)

Buffalano, C.; Fogleman, S.; Gielecki, M.

1976-01-01

A methodology is outlined which can be used to estimate the costs of research and development projects. The approach uses the Delphi technique a method developed by the Rand Corporation for systematically eliciting and evaluating group judgments in an objective manner. The use of the Delphi allows for the integration of expert opinion into the cost-estimating process in a consistent and rigorous fashion. This approach can also signal potential cost-problem areas. This result can be a useful tool in planning additional cost analysis or in estimating contingency funds. A Monte Carlo approach is also examined.

Environmental and occupational health research and training needs in Colombia: A Delphi study

PubMed Central

Rodríguez-Villamizar, Laura A.; González, Beatriz Elena; Vera, Lina María; Patz, Jonathan; Bautista, Leonelo E.

2015-01-01

Introduction Environmental factors contribute with 16% of the burden of disease in Colombia. A main obstacle in implementing national and regional environmental and occupational health policies is the limited knowledge on the local ability to study and control the impact of harmful exposures on health. Objective To identify needs for research and training in environmental and occupational health in Colombia. Materials and methods We conducted a three-round hybrid Delphi study. A group of environmental and occupational health Colombian experts (n=16) from government agencies, universities, and research centers was recruited to participate in the study. Expert’s opinions on research and training needs were gathered through online questionnaires, followed by an in-person meeting. The percentage of agreement and the coefficient of variation were used to measure consensus. Results Air pollution and chemical products were considered the most important environmental and occupational exposures, due to their significant impact on chronic non-communicable diseases, such as respiratory diseases, cardiovascular diseases, and cancer. Research on the effects of outdoor air pollution on cardiovascular and respiratory diseases was considered of the greatest importance. Priority training areas included environmental and occupational health risk assessment, exposure modeling, advanced statistical methods, urban planning, occupational safety and hygiene, and epidemiology and toxicology. Conclusions These findings provide a valuable input for the definition and implementation of national environmental and occupational health policies and for the development of a regional hub aimed at strengthening the capacity for research and training in Colombia. PMID:26535742

RAMESES publication standards: meta-narrative reviews

PubMed Central

2013-01-01

Background Meta-narrative review is one of an emerging menu of new approaches to qualitative and mixed-method systematic review. A meta-narrative review seeks to illuminate a heterogeneous topic area by highlighting the contrasting and complementary ways in which researchers have studied the same or a similar topic. No previous publication standards exist for the reporting of meta-narrative reviews. This publication standard was developed as part of the RAMESES (Realist And MEta-narrative Evidence Syntheses: Evolving Standards) project. The project's aim is to produce preliminary publication standards for meta-narrative reviews. Methods We (a) collated and summarized existing literature on the principles of good practice in meta-narrative reviews; (b) considered the extent to which these principles had been followed by published reviews, thereby identifying how rigor may be lost and how existing methods could be improved; (c) used a three-round online Delphi method with an interdisciplinary panel of national and international experts in evidence synthesis, meta-narrative reviews, policy and/or publishing to produce and iteratively refine a draft set of methodological steps and publication standards; (d) provided real-time support to ongoing meta-narrative reviews and the open-access RAMESES online discussion list so as to capture problems and questions as they arose; and (e) synthesized expert input, evidence review and real-time problem analysis into a definitive set of standards. Results We identified nine published meta-narrative reviews, provided real-time support to four ongoing reviews and captured questions raised in the RAMESES discussion list. Through analysis and discussion within the project team, we summarized the published literature, and common questions and challenges into briefing materials for the Delphi panel, comprising 33 members. Within three rounds this panel had reached consensus on 20 key publication standards, with an overall response rate of 90%. Conclusion This project used multiple sources to draw together evidence and expertise in meta-narrative reviews. For each item we have included an explanation for why it is important and guidance on how it might be reported. Meta-narrative review is a relatively new method for evidence synthesis and as experience and methodological developments occur, we anticipate that these standards will evolve to reflect further theoretical and methodological developments. We hope that these standards will act as a resource that will contribute to improving the reporting of meta-narrative reviews. To encourage dissemination of the RAMESES publication standards, this article is co-published in the Journal of Advanced Nursing and is freely accessible on Wiley Online Library (http://www.wileyonlinelibrary.com/journal/jan). Please see related articles http://www.biomedcentral.com/1741-7015/11/21 and http://www.biomedcentral.com/1741-7015/11/22 PMID:23360661

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique.

PubMed

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method.

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique

PubMed Central

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method. PMID:25948132

Consulting the oracle: ten lessons from using the Delphi technique in nursing research.

PubMed

Keeney, Sinead; Hasson, Felicity; McKenna, Hugh

2006-01-01

The aim of this paper was to provide insight into the Delphi technique by outlining our personal experiences during its use over a 10-year period in a variety of applications. As a means of achieving consensus on an issue, the Delphi research method has become widely used in healthcare research generally and nursing research in particular. The literature on this technique is expanding, mainly addressing what it is and how it should be used. However, there is still much confusion and uncertainty surrounding it, particularly about issues such as modifications, consensus, anonymity, definition of experts, how 'experts' are selected and how non-respondents are pursued. This issues that arise when planning and carrying out a Delphi study include the definition of consensus; the issue of anonymity vs. quasi-anonymity for participants; how to estimate the time needed to collect the data, analyse each 'round', feed back results to participants, and gain their responses to this feedback; how to define and select the 'experts' who will be asked to participate; how to enhance response rates; and how many 'rounds' to conduct. Many challenges and questions are raised when using the Delphi technique, but there is no doubt that it is an important method for achieving consensus on issues where none previously existed. Researchers need to adapt the method to suit their particular study.

DelPhiForce web server: electrostatic forces and energy calculations and visualization.

PubMed

Li, Lin; Jia, Zhe; Peng, Yunhui; Chakravorty, Arghya; Sun, Lexuan; Alexov, Emil

2017-11-15

Electrostatic force is an essential component of the total force acting between atoms and macromolecules. Therefore, accurate calculations of electrostatic forces are crucial for revealing the mechanisms of many biological processes. We developed a DelPhiForce web server to calculate and visualize the electrostatic forces at molecular level. DelPhiForce web server enables modeling of electrostatic forces on individual atoms, residues, domains and molecules, and generates an output that can be visualized by VMD software. Here we demonstrate the usage of the server for various biological problems including protein-cofactor, domain-domain, protein-protein, protein-DNA and protein-RNA interactions. The DelPhiForce web server is available at: http://compbio.clemson.edu/delphi-force. delphi@clemson.edu. Supplementary data are available at Bioinformatics online. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com

Successful and Unsuccessful Multicultural Supervisory Behaviors: A Delphi Poll

ERIC Educational Resources Information Center

Dressel, Jeana L.; Consoli, Andres J.; Kim, Bryan S.K.; Atkinson, Donald R.

2007-01-01

Using the Delphi method, university counseling center supervisors with significant experience in multicultural supervision generated and ranked elements of successful and unsuccessful multicultural supervision. Twenty-seven of 35 successful elements and 24 of 33 unsuccessful elements involved cultural considerations. Multicultural supervision was…

What works for wellbeing in culture and sport? Report of a DELPHI process to support coproduction and establish principles and parameters of an evidence review

PubMed Central

Daykin, Norma; Mansfield, Louise; Payne, Annette; Kay, Tess; Meads, Catherine; D’Innocenzo, Giorgia; Burnett, Adele; Dolan, Paul; Julier, Guy; Longworth, Louise; Tomlinson, Alan; Testoni, Stefano; Victor, Christina

2016-01-01

Aims: There is a growing recognition of the ways in which culture and sport can contribute to wellbeing. A strong evidence base is needed to support innovative service development and a 3-year research programme is being undertaken to capture best evidence of wellbeing impacts and outcomes of cultural and sporting activities in order to inform UK policy and practice. This article provides an overview of methods and findings from an initial coproduction process with key stakeholders that sought to explore and agree principles and parameters of the evidence review for culture, sport and wellbeing (CSW). Methods: A two-stage DELPHI process was conducted with a purposeful sample of 57 stakeholders between August and December 2015. Participants were drawn from a range of culture and sport organisations and included commissioners and managers, policy makers, representatives of service delivery organisations (SDOs) and scholars. The DELPHI 1 questionnaire was developed from extensive consultation in July and August 2015. It explored definitions of wellbeing, the role of evidence, quality assessment, and the culture and sport populations, settings and interventions that are most likely to deliver wellbeing outcomes. Following further consultation, the results, presented as a series of ranked statements, were sent back to participants (DELPHI 2), which allowed them to reflect on and, if they wished, express agreement or disagreement with the emerging consensus. Results: A total of 40 stakeholders (70.02%) responded to the DELPHI questionnaires. DELPHI 1 mapped areas of agreement and disagreement, confirmed in DELPHI 2. The exercise drew together the key priorities for the CSW evidence review. Conclusion: The DELPHI process, in combination with face-to-face deliberation, enabled stakeholders to engage in complex discussion and express nuanced priorities while also allowing the group to come to an overall consensus and agree outcomes. The results will inform the CSW evidence review programme until its completion in March 2018. PMID:27789779

Domains of quality of life: results of a three-stage Delphi consensus procedure among patients, family of patients, clinicians, scientists and the general public.

PubMed

Pietersma, Suzanne; de Vries, Marieke; van den Akker-van Marle, M Elske

2014-06-01

Our key objective is to identify the core domains of health-related quality of life (QoL). Health-related QoL utility scales are commonly used in economic evaluations to assess the effectiveness of health-care interventions. However, health-care interventions are likely to affect QoL in a broader sense than is quantifiable with traditional scales. Therefore, measures need to go beyond these scales. Unfortunately, there is no consensus in the scientific literature on the essential domains of QoL. We conducted a three-stage online Delphi consensus procedure to identify the key domains of health-related QoL. Five stakeholder groups (i.e., patients, family of patients, clinicians, scientists and general public) were asked, on three consecutive occasions, what they perceive as the most important domains of health-related QoL. An analysis of existing (health-related) QoL and well-being measurements formed the basis of the Delphi-procedure. In total, 42 domains of QoL were judged, covering physical, mental and social aspects. All participants rated 'self-acceptance', 'self-esteem' and 'good social contacts' as essential. Strikingly, mental and social domains are perceived as more essential than physical domains across stakeholders groups. In traditionally used health-related QoL utility measures, physical domains like 'mobility' are prominently present. The Delphi-procedure shows that health-related QoL (utility) scales need to put sufficient emphasis on mental and social domains to capture aspects of QoL that are essential to people.

Subjective and clinical assessment criteria suggestive for five clinical patterns discernible in nonspecific neck pain patients. A Delphi-survey of clinical experts.

PubMed

Dewitte, Vincent; Peersman, Wim; Danneels, Lieven; Bouche, Katie; Roets, Arne; Cagnie, Barbara

2016-12-01

Nonspecific neck pain patients form a heterogeneous group with different musculoskeletal impairments. Classifying nonspecific neck pain patients into subgroups based on clinical characteristics might lead to more comprehensive diagnoses and can guide effective management. To establish consensus among a group of experts regarding the clinical criteria suggestive of a clinical dominance of 'articular', 'myofascial', 'neural', 'central' and 'sensorimotor control' dysfunction patterns distinguishable in patients with nonspecific neck pain. Delphi study. A focus group with 10 academic experts was organized to elaborate on the different dysfunction patterns discernible in neck pain patients. Consecutively, a 3-round online Delphi-survey was designed to obtain consensual symptoms and physical examination findings for the 5 distinct dysfunction patterns resulting from the focus group. A total of 21 musculoskeletal physical therapists from Belgium and the Netherlands experienced in assessing and treating neck pain patients completed the 3-round Delphi-survey. Respectively, 33 (response rate, 100.0%), 27 (81.8%) and 21 (63.6%) respondents replied to rounds 1, 2 and 3. Eighteen 'articular', 16 'myofascial', 20 'neural', 18 'central' and 10 'sensorimotor control' clinical indicators reached a predefined ≥80% consensus level. These indicators suggestive of a clinical dominance of 'articular', 'myofascial', 'neural', 'central', and 'sensorimotor control' dysfunction patterns may help clinicians to assess and diagnose patients with nonspecific neck pain. Future validity testing is needed to determine how these criteria may help to improve the outcome of physical therapy interventions in nonspecific neck pain patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies.

PubMed

Diamond, Ivan R; Grant, Robert C; Feldman, Brian M; Pencharz, Paul B; Ling, Simon C; Moore, Aideen M; Wales, Paul W

2014-04-01

To investigate how consensus is operationalized in Delphi studies and to explore the role of consensus in determining the results of these studies. Systematic review of a random sample of 100 English language Delphi studies, from two large multidisciplinary databases [ISI Web of Science (Thompson Reuters, New York, NY) and Scopus (Elsevier, Amsterdam, NL)], published between 2000 and 2009. About 98 of the Delphi studies purported to assess consensus, although a definition for consensus was only provided in 72 of the studies (64 a priori). The most common definition for consensus was percent agreement (25 studies), with 75% being the median threshold to define consensus. Although the authors concluded in 86 of the studies that consensus was achieved, consensus was only specified a priori (with a threshold value) in 42 of these studies. Achievement of consensus was related to the decision to stop the Delphi study in only 23 studies, with 70 studies terminating after a specified number of rounds. Although consensus generally is felt to be of primary importance to the Delphi process, definitions of consensus vary widely and are poorly reported. Improved criteria for reporting of methods of Delphi studies are required. Copyright © 2014 Elsevier Inc. All rights reserved.

Competencies Needed by Korean HRD Master's Graduates: A Comparison between the ASTD WLP Competency Model and the Korean Study

ERIC Educational Resources Information Center

Lee, Yonghak

2009-01-01

The primary purpose of this study was to identify competencies needed by current human resource development (HRD) master's degree graduate students in Korea. The study used a quantitative method, the Delphi technique, in combination with a qualitative method consisting of a series of in-depth interviews. The Delphi technique was conducted using a…

African American Faculty Expressing Concerns: Breaking the Silence at Predominantly White Research Oriented Universities

ERIC Educational Resources Information Center

Ross, Henry H.; Edwards, Willie J.

2016-01-01

A Delphi method was used with a panel of 24 African American faculty employed at 43 predominantly white doctoral extensive universities to arrive at a group consensus on a list of concerns that African American faculty in general experienced or held. Using the Delphi method a panel of African American faculty initially worked from a list of eight…

The use of qualitative methods to inform Delphi surveys in core outcome set development.

PubMed

Keeley, T; Williamson, P; Callery, P; Jones, L L; Mathers, J; Jones, J; Young, B; Calvert, M

2016-05-04

Core outcome sets (COS) help to minimise bias in trials and facilitate evidence synthesis. Delphi surveys are increasingly being used as part of a wider process to reach consensus about what outcomes should be included in a COS. Qualitative research can be used to inform the development of Delphi surveys. This is an advance in the field of COS development and one which is potentially valuable; however, little guidance exists for COS developers on how best to use qualitative methods and what the challenges are. This paper aims to provide early guidance on the potential role and contribution of qualitative research in this area. We hope the ideas we present will be challenged, critiqued and built upon by others exploring the role of qualitative research in COS development. This paper draws upon the experiences of using qualitative methods in the pre-Delphi stage of the development of three different COS. Using these studies as examples, we identify some of the ways that qualitative research might contribute to COS development, the challenges in using such methods and areas where future research is required. Qualitative research can help to identify what outcomes are important to stakeholders; facilitate understanding of why some outcomes may be more important than others, determine the scope of outcomes; identify appropriate language for use in the Delphi survey and inform comparisons between stakeholder data and other sources, such as systematic reviews. Developers need to consider a number of methodological points when using qualitative research: specifically, which stakeholders to involve, how to sample participants, which data collection methods are most appropriate, how to consider outcomes with stakeholders and how to analyse these data. A number of areas for future research are identified. Qualitative research has the potential to increase the research community's confidence in COS, although this will be dependent upon using rigorous and appropriate methodology. We have begun to identify some issues for COS developers to consider in using qualitative methods to inform the development of Delphi surveys in this article.

[Study on commercial specification of atractylodes based on Delphi method].

PubMed

Wang, Hao; Chen, Li-Xiao; Huang, Lu-Qi; Zhang, Tian-Tian; Li, Ying; Zheng, Yu-Guang

2016-03-01

This research adopts "Delphi method" to evaluate atractylodes traditional traits and rank correlation. By using methods of mathematical statistics the relationship of the traditional identification indicators and atractylodes goods rank correlation was analyzed, It is found that the main characteristics affectingatractylodes commodity specifications and grades of main characters wereoil points of transaction,color of transaction,color of surface,grain of transaction,texture of transaction andspoilage. The study points out that the original "seventy-six kinds of medicinal materials commodity specification standards of atractylodes differentiate commodity specification" is not in conformity with the actual market situation, we need to formulate corresponding atractylodes medicinal products specifications and grades.This study combined with experimental results "Delphi method" and the market actual situation, proposed the new draft atractylodes commodity specifications and grades, as the new atractylodes commodity specifications and grades standards. It provides a reference and theoretical basis. Copyright© by the Chinese Pharmaceutical Association.

Self-Organized Terrorist-Counterterrorist Adaptive Coevolutions, Part 1: A Conceptual Design

DTIC Science & Technology

2005-02-01

nodes. Imple- mented in Delphi, it runs in the Windows environment and is being developed by Vladimir Batagelj and Andrej Mrvar . Pajek supports all...Post, January 13, 2002. [22] J. M. Epstein and Robert L. Axtell, Growing Artificial Societies: Social Science from the Bottom Up, MIT Press, 1996 . [23...Mathematical Background and Technical Sourcebook, Center for Naval Analyses Information Manual CIM-461, Unclassified, 1996 . Available on-line, in Adobe’s

A Delphi-matrix approach to SEA and its application within the tourism sector in Taiwan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kuo, N.-W.; Hsiao, T.-Y.; Yu, Y.-H.

Strategic Environmental Assessment (SEA) is a procedural tool and within the framework of SEA, several different types of analytical methods can be used in the assessment. However, the impact matrix used currently in Taiwan has some disadvantages. Hence, a Delphi-matrix approach to SEA is proposed here to improve the performance of Taiwan's SEA. This new approach is based on the impact matrix combination with indicators of sustainability, and then the Delphi method is employed to collect experts' opinions. In addition, the assessment of National Floriculture Park Plan and Taiwan Flora 2008 Program is taken as an example to examine thismore » new method. Although international exhibition is one of the important tourism (economic) activities, SEA is seldom about tourism sector. Finally, the Delphi-matrix approach to SEA for tourism development plan is established containing eight assessment topics and 26 corresponding categories. In summary, three major types of impacts: resources' usages, pollution emissions, and local cultures change are found. Resources' usages, such as water, electricity, and natural gas demand, are calculated on a per capita basis. Various forms of pollution resulting from this plan, such as air, water, soil, waste, and noise, are also identified.« less

Computer Technology and Education: A Policy Delphi.

ERIC Educational Resources Information Center

Steier, Lloyd P.

Realizing the educational potential of computer technology largely depends on developing appropriate policies related to the technology. A Policy Delphi method was used to identify changes in education that are both probable and possible on account of the introduction of computers, and to explore potential patterns for arriving at a desired…

Identifying Dispositions That Matter: Reaching for Consensus Using a Delphi Study

ERIC Educational Resources Information Center

Bair, Mary Antony

2017-01-01

This article describes how one institution used the Delphi technique to identify and operationalize key professional dispositions to be addressed in its teacher education program. Participants included teacher educators, methods course instructors, and school administrators. Data collection occurred in three phases, with the results of each phase…

Using Delphi Methodology to Design Assessments of Teachers' Pedagogical Content Knowledge

ERIC Educational Resources Information Center

Manizade, Agida Gabil; Mason, Marguerite M.

2011-01-01

Descriptions of methodologies that can be used to create items for assessing teachers' "professionally situated" knowledge are lacking in mathematics education research literature. In this study, researchers described and used the Delphi method to design an instrument to measure teachers' pedagogical content knowledge. The instrument focused on a…

Assessment Leaders' Perspectives of Institutional Cultures of Assessment: A Delphi Study

ERIC Educational Resources Information Center

Fuller, Matthew; Henderson, Susan; Bustamante, Rebecca

2015-01-01

Institutional cultures of assessment are praised as beneficial to student learning. Yet, extant studies have not explored the theoretical foundations and pragmatic approaches to shaping cultures of assessment. The researchers used the Delphi method to explore 10 higher education assessment leaders' attitudes and theoretical perspectives regarding…

Single-Parent Nontraditional Students: Faculty Support within the Classroom Environment

ERIC Educational Resources Information Center

Allen-Drewry, Lisa M.

2017-01-01

Purpose: The purpose of this Delphi study was to explore single-parent nontraditional student experiences within nontraditional university classroom environments and to determine methods for providing better support within the classroom setting. Methodology: The Delphi technique was conducted through 3 survey rounds to explore ways professors and…

Identifying Competencies for Volunteer Administrators for the Coming Decade: A National Delphi Study.

ERIC Educational Resources Information Center

Boyd, Barry L.

2003-01-01

A Delphi panel of 13 experts categorized 33 competencies for volunteer administration into 5 constructs: organizational leadership, systems leadership, organizational culture, personal skills, and management skills. Twelve barriers to acquiring competencies and 21 methods to address them were identified. (Contains 24 references.) (SK)

Use of the Delphi method for determining community growth goals inventory: the Nashville experience

Treesearch

Vishwa K. Varma

1977-01-01

The author discusses the growth-inducing pressures on Nashville, Tennessee, describes the application of the Delphi technique to develop an inventory of the community's growth goals, and suggests that the development of a list of community goals is a necessary first step toward growth management.

A Delphi Study and Initial Validation of Counselor Supervision Competencies

ERIC Educational Resources Information Center

Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

2016-01-01

The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

Development of an active behavioural physiotherapy intervention (ABPI) for acute whiplash-associated disorder (WAD) II management: a modified Delphi study.

PubMed

Wiangkham, Taweewat; Duda, Joan; Haque, M Sayeed; Rushton, Alison

2016-09-14

To develop an active behavioural physiotherapy intervention (ABPI) for managing acute whiplash-associated disorder (WAD) II using a modified Delphi method to develop consensus for the basic features of the ABPI. Modified Delphi study. Our systematic review and meta-analysis evaluating conservative management for acute WADII found that a combined ABPI may be a useful intervention to prevent patients progressing to chronicity. No previous research has considered a combined behavioural approach and active physiotherapy in the management of acute WADII patients. The ABPI was therefore developed using a rigorous consensus method using international research and local clinical whiplash experts. Descriptive statistics were used to assess consensus in each round. Online international survey. A purposive sample of 97 potential participants (aiming to recruit n=30) consisting of international research whiplash experts, UK private physiotherapists and UK postgraduate musculoskeletal physiotherapy students were invited to participate via electronic mail with an attached participant information sheet and consent form. 36 individuals signed and returned the consent form. In round 1, 32/36 participants (response rate=89%, mean age±SD=36.03±13.22 years) across 8 countries (Australia, Finland, Greece, India, Netherlands, Norway, Sweden and UK) contributed to round 1 questionnaire. Response rates were 78% and 75% for rounds 2 and 3, respectively. Following round 3, 12 underlying principles (eg, return to normal function as soon as possible, pain management, encouragement of self-management, reduce fear avoidance and anxiety) achieved consensus. The treatment components reaching consensus included behavioural (eg, education, reassurance, self-management) and physiotherapy components (eg, exercises for stability and mobility). No passive intervention achieved consensus. Experts suggested and agreed the underlying principles and treatment components of the ABPI for the management of acute WADII. The ABPI was underpinned by social cognitive theory focusing on self-efficacy enhancement prior to conducting a phase II trial. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Identification of preliminary core outcome domains for communication about childhood vaccination: An online Delphi survey.

PubMed

Kaufman, Jessica; Ryan, Rebecca; Lewin, Simon; Bosch-Capblanch, Xavier; Glenton, Claire; Cliff, Julie; Oyo-Ita, Angela; Muloliwa, Artur Manuel; Oku, Afiong; Ames, Heather; Rada, Gabriel; Cartier, Yuri; Hill, Sophie

2017-08-20

Communication interventions for childhood vaccination are promising strategies to address vaccine hesitancy, but current research is limited by the outcomes measured. Most studies measure only vaccination-related outcomes, with minimal consideration of vaccine hesitancy-relevant intermediate outcomes. This impedes understanding of which interventions or elements are effective. It is also unknown which outcomes are important to the range of stakeholders affected by vaccine hesitancy. Outcome selection shapes the evidence base, informing future interventions and trials, and should reflect stakeholder priorities. Therefore, our aim was to identify which outcome domains (i.e. broad outcome categories) are most important to different stakeholders, identifying preliminary core outcome domains to inform evaluation of three common vaccination communication types: (i) communication to inform or educate, (ii) remind or recall, and (iii) enhance community ownership. We conducted a two-stage online Delphi survey, involving four stakeholder groups: parents or community members, healthcare providers, researchers, and government or non-governmental organisation representatives. Participants rated the importance of eight outcome domains for each of the three communication types. They also rated specific outcomes within one domain ("attitudes or beliefs") and provided feedback about the survey. Collectively, stakeholder groups prioritised outcome domains differently when considering the effects of different communication types. For communication that aims to (i) inform or educate, the most important outcome domain is "knowledge or understanding"; for (ii) reminder communication, "vaccination status and behaviours"; and for (iii) community engagement communication, "community participation". All stakeholder groups rated most outcome domains as very important or critical. The highest rated specific outcome within the "attitudes or beliefs" domain was "trust". This Delphi survey expands the field of core outcomes research and identifies preliminary core outcome domains for measuring the effects of communication about childhood vaccination. The findings support the argument that vaccination communication is not a single homogenous intervention - it has a range of purposes, and vaccination communication evaluators should select outcomes accordingly. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

The trials methodological research agenda: results from a priority setting exercise

PubMed Central

2014-01-01

Background Research into the methods used in the design, conduct, analysis, and reporting of clinical trials is essential to ensure that effective methods are available and that clinical decisions made using results from trials are based on the best available evidence, which is reliable and robust. Methods An on-line Delphi survey of 48 UK Clinical Research Collaboration registered Clinical Trials Units (CTUs) was undertaken. During round one, CTU Directors were asked to identify important topics that require methodological research. During round two, their opinion about the level of importance of each topic was recorded, and during round three, they were asked to review the group’s average opinion and revise their previous opinion if appropriate. Direct reminders were sent to maximise the number of responses at each round. Results are summarised using descriptive methods. Results Forty one (85%) CTU Directors responded to at least one round of the Delphi process: 25 (52%) responded in round one, 32 (67%) responded in round two, 24 (50%) responded in round three. There were only 12 (25%) who responded to all three rounds and 18 (38%) who responded to both rounds two and three. Consensus was achieved amongst CTU Directors that the top three priorities for trials methodological research were ‘Research into methods to boost recruitment in trials’ (considered the highest priority), ‘Methods to minimise attrition’ and ‘Choosing appropriate outcomes to measure’. Fifty other topics were included in the list of priorities and consensus was reached that two topics, ‘Radiotherapy study designs’ and ‘Low carbon trials’, were not priorities. Conclusions This priority setting exercise has identified the research topics felt to be most important to the key stakeholder group of Directors of UKCRC registered CTUs. The use of robust methodology to identify these priorities will help ensure that this work informs the trials methodological research agenda, with a focus on topics that will have most impact and relevance. PMID:24456928

Medicine authentication technology as a counterfeit medicine-detection tool: a Delphi method study to establish expert opinion on manual medicine authentication technology in secondary care

PubMed Central

Naughton, Bernard; Roberts, Lindsey; Dopson, Sue; Brindley, David; Chapman, Stephen

2017-01-01

Objectives This study aims to establish expert opinion and potential improvements for the Falsified Medicines Directive mandated medicines authentication technology. Design and intervention A two-round Delphi method study using an online questionnaire. Setting Large National Health Service (NHS) foundation trust teaching hospital. Participants Secondary care pharmacists and accredited checking technicians. Primary outcome measures Seven-point rating scale answers which reached a consensus of 70–80% with a standard deviation (SD) of <1.0. Likert scale questions which reached a consensus of 70–80%, a SD of <1.0 and classified as important according to study criteria. Results Consensus expert opinion has described database cross-checking technology as quick and user friendly and suggested the inclusion of an audio signal to further support the detection of counterfeit medicines in secondary care (70% consensus, 0.9 SD); other important consensus with a SD of <1.0 included reviewing the colour and information in warning pop up screens to ensure they were not mistaken for the ‘already dispensed here’ pop up, encouraging the dispenser/checker to act on the warnings and making it mandatory to complete an ‘action taken’ documentation process to improve the quarantine of potentially counterfeit, expired or recalled medicines. Conclusions This paper informs key opinion leaders and decision makers as to the positives and negatives of medicines authentication technology from an operator's perspective and suggests the adjustments which may be required to improve operator compliance and the detection of counterfeit medicines in the secondary care sector. PMID:28478398

Priorities for research in child maltreatment, intimate partner violence and resilience to violence exposures: results of an international Delphi consensus development process

PubMed Central

2012-01-01

Background Intimate partner violence (IPV) and child maltreatment (CM) are major global public health problems. The Preventing Violence Across the Lifespan (PreVAiL) Research Network, an international group of over 60 researchers and national and international knowledge-user partners in CM and IPV, sought to identify evidence-based research priorities in IPV and CM, with a focus on resilience, using a modified Delphi consensus development process. Methods Review of existing empirical evidence, PreVAiL documents and team discussion identified a starting list of 20 priorities in the following categories: resilience to violence exposure (RES), CM, and IPV, as well as priorities that cross-cut the content areas (CC), and others specific to research methodologies (RM) in violence research. PreVAiL members (N = 47) completed two online survey rounds, and one round of discussions via three teleconference calls to rate, rank and refine research priorities. Results Research priorities were: to examine key elements of promising or successful programmes in RES/CM/IPV to build intervention pilot work; CC: to integrate violence questions into national and international surveys, and RM: to investigate methods for collecting and collating datasets to link data and to conduct pooled, meta and sub-group analyses to identify promising interventions for particular groups. Conclusions These evidence-based research priorities, developed by an international team of violence, gender and mental health researchers and knowledge-user partners, are of relevance for prevention and resilience-oriented research in the areas of IPV and CM. PMID:22908894

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Military Medical Leadership in Uniformed Medical Students: Creating a New Assessment Instrument Using the Delphi Method

DTIC Science & Technology

2015-12-17

healthcare management and have not focused on assessing leadership among student physicians. A systematic review of 80 Delphi method studies by...medical students ( Research Question 1), to create a leadership assessment instrument based on those important components ( Research Question 2), and... research question 2 (RQ2) saw the creation of a three page assessment instrument to assess medical leadership in student physicians. Based on critical

TREatment of ATopic eczema (TREAT) Registry Taskforce: protocol for an international Delphi exercise to identify a core set of domains and domain items for national atopic eczema registries.

PubMed

Gerbens, Louise A A; Boyce, Aaron E; Wall, Dmitri; Barbarot, Sebastien; de Booij, Richard J; Deleuran, Mette; Middelkamp-Hup, Maritza A; Roberts, Amanda; Vestergaard, Christian; Weidinger, Stephan; Apfelbacher, Christian J; Irvine, Alan D; Schmitt, Jochen; Williamson, Paula R; Spuls, Phyllis I; Flohr, Carsten

2017-02-27

Patients with moderate-to-severe atopic eczema (AE) often require photo- or systemic immunomodulatory therapies to induce disease remission and maintain long-term control. The current evidence to guide clinical management is small, despite the frequent and often off-label use of these treatments. Registries of patients on photo- and systemic immunomodulatory therapies could fill this gap, and the collection of a core set concerning these therapies in AE will allow direct comparisons across registries as well as data sharing and pooling. Using an eDelphi approach, the international TREatment of ATopic eczema (TREAT) Registry Taskforce aims to seek consensus between key stakeholders internationally on a core set of domains and domain items for AE patient registries with a research focus that collect data of children and adults on photo- and systemic immunomodulatory therapies. Participants from six stakeholder groups will be invited: doctors, nurses, non-clinical researchers, patients, as well as industry and regulatory body representatives. The eDelphi will comprise three sequential online rounds, requesting participants to rate the importance of each proposed domain and domain items. Participants will be able to add domains and domain items to the proposed list in round 1. A final consensus meeting will be held with representatives of each stakeholder group. Identifying a uniform core set of domains and domain items to be captured by AE patient registries will increase the utility of individual registries, and provide greater insight into the effectiveness, safety and cost-effectiveness of photo- and systemic immunomodulatory therapies to guide clinical management across dermatology centres and country borders. Not applicable. This eDelphi study was registered in the Core Outcome Measures for Effectiveness Trials (COMET) database.

Future Directions for Business Education: A Delphi Study

ERIC Educational Resources Information Center

Kesten, Cyril A.; Lambrecht, Judith J.

2010-01-01

Purpose: The purpose of this study was to synthesize perceptions from the field about current issues and to propose future directions for the field of business education. Method: A modified three-stage Delphi study was carried out with business educators who attended national conferences and/or belonged to national professional organizations.…

Helping Competencies of Student Affairs Professionals: A Delphi Study

ERIC Educational Resources Information Center

Reynolds, Amy L.

2011-01-01

The purpose of this study was to gather student affairs professionals' perceptions of the knowledge and skills needed to effectively help students. Using the Delphi method, 159 entry-level and mid-level student affairs administrators from institutions across the United States were surveyed regarding their perceptions of the helping skills they use…

The Policy Delphi: A Method for Identifying Intended and Unintended Consequences of Educational Policy

ERIC Educational Resources Information Center

Manley, R. Adam

2013-01-01

This article highlights a rarely utilized but effective technique for identifying intended and unintended consequences of past or current policy or policy change. The author guides the reader through the process of identifying potential participants, contacting participants, developing the policy Delphi instrument, and analyzing the findings by…

Rehabilitation Counselor Competencies When Working With Hispanic/Latino Immigrant Injured Workers: A Delphi Study

ERIC Educational Resources Information Center

Santos Román, Leslie M.; Estrada-Hernández, Noel

2017-01-01

Purpose: To explore and identify attitudes, knowledge, and skills rehabilitation practitioners in the private sector need when working with Hispanic/Latino immigrant injured workers. Methods: This study employed a 3-round Delphi study to obtain a consensus of 8 rehabilitation practitioners who had experience and expertise working with…

The Stammering Information Programme: A Delphi Study

ERIC Educational Resources Information Center

Berquez, Ali E.; Cook, Frances M.; Millard, Sharon K.; Jarvis, Effie

2011-01-01

Purpose: To find out what information children, parents and education staff feel would be important to know to support a child who stutters in the educational environment, in order to develop appropriate resources. Method: A Delphi study was carried out to seek the opinions of experts about the information to include. A structured six stage…

Assessing risk factors for early hip osteoarthritis in activity-related hip pain: a Delphi study

PubMed Central

Jackson, K A; Glyn-Jones, S; Batt, M E; Arden, N K; Newton, J L

2015-01-01

Objective Hip pain and injury as a result of activity can lead to the development of early hip osteoarthritis (OA) in susceptible individuals. Our understanding of the factors that increase susceptibility continues to evolve. The ability to clearly identify individuals (and cohorts) with activity-related hip pain who are at risk of early hip OA is currently lacking. The purpose of this study was to gain expert consensus on which key clinical measures might help predict the risk of early hip OA in individuals presenting with activity-related hip pain. The agreed measures would constitute a standardised approach to initial clinical assessment to help identify these individuals. Methods This Dephi study used online surveys to gain concordance of expert opinion in a structured process of ‘rounds’. In this study, we asked ‘What outcome measures are useful in predicting hip OA in activity-related hip pain?’ The Delphi panel consisted of experts from sport and exercise medicine, orthopaedics, rheumatology, physiotherapy and OA research. Results The study identified key clinical measures in the history, examination and investigations (plain anteroposterior radiograph and femoroacetabular impingement views) that the panel agreed would be useful in predicting future risk of hip OA when assessing activity-related hip pain. The panel also agreed that certain investigations and tests (eg, MR angiography) did not currently have a role in routine assessment. There was a lack of consensus regarding the role of MRI, patient-reported outcome measures (PROMs) and certain biomechanical and functional assessments. Conclusions We provide a standardised approach to the clinical assessment of patients with activity-related hip pain. Assessment measures rejected by the Delphi panel were newer, more expensive investigations that currently lack evidence. Assessment measures that did not reach consensus include MRI and PROMs. Their role remains ambiguous and would benefit from further research. PMID:26419679

Characteristics of student preparedness for clinical learning: clinical educator perspectives using the Delphi approach

PubMed Central

2012-01-01

Background During clinical placements, clinical educators facilitate student learning. Previous research has defined the skills, attitudes and practices that pertain to an ideal clinical educator. However, less attention has been paid to the role of student readiness in terms of foundational knowledge and attitudes at the commencement of practice education. Therefore, the aim of this study was to ascertain clinical educators’ views on the characteristics that they perceive demonstrate that a student is well prepared for clinical learning. Methods A two round on-line Delphi study was conducted. The first questionnaire was emailed to a total of 636 expert clinical educators from the disciplines of occupational therapy, physiotherapy and speech pathology. Expert clinical educators were asked to describe the key characteristics that indicate a student is prepared for a clinical placement and ready to learn. Open-ended responses received from the first round were subject to a thematic analysis and resulted in six themes with 62 characteristics. In the second round, participants were asked to rate each characteristic on a 7 point Likert Scale. Results A total of 258 (40.56%) responded to the first round of the Delphi survey while 161 clinical educators completed the second (62.40% retention rate). Consensus was reached on 57 characteristics (six themes) using a cut off of greater than 70% positive respondents and an interquartile deviation IQD of equal or less than 1. Conclusions This study identified 57 characteristics (six themes) perceived by clinical educators as indicators of a student who is prepared and ready for clinical learning. A list of characteristics relating to behaviours has been compiled and could be provided to students to aid their preparation for clinical learning and to universities to incorporate within curricula. In addition, the list provides a platform for discussions by professional bodies about the role of placement education. PMID:23145840

Protocol—the RAMESES II study: developing guidance and reporting standards for realist evaluation

PubMed Central

Greenhalgh, Trisha; Wong, Geoff; Jagosh, Justin; Greenhalgh, Joanne; Manzano, Ana; Westhorp, Gill; Pawson, Ray

2015-01-01

Introduction Realist evaluation is an increasingly popular methodology in health services research. For realist evaluations (RE) this project aims to: develop quality and reporting standards and training materials; build capacity for undertaking and critically evaluating them; produce resources and training materials for lay participants, and those seeking to involve them. Methods To achieve our aims, we will: (1) Establish management and governance infrastructure; (2) Recruit an interdisciplinary Delphi panel of 35 participants with diverse relevant experience of RE; (3) Summarise current literature and expert opinion on best practice in RE; (4) Run an online Delphi panel to generate and refine items for quality and reporting standards; (5) Capture ‘real world’ experiences and challenges of RE—for example, by providing ongoing support to realist evaluations, hosting the RAMESES JISCmail list on realist research, and feeding problems and insights from these into the deliberations of the Delphi panel; (6) Produce quality and reporting standards; (7) Collate examples of the learning and training needs of researchers, students, reviewers and lay members in relation to RE; (8) Develop, deliver and evaluate training materials for RE and deliver training workshops; and (9) Develop and evaluate information and resources for patients and other lay participants in RE (eg, draft template information sheets and model consent forms) and; (10) Disseminate training materials and other resources. Planned outputs: (1) Quality and reporting standards and training materials for RE. (2) Methodological support for RE. (3) Increase in capacity to support and evaluate RE. (4) Accessible, plain-English resources for patients and the public participating in RE. Discussion The realist evaluation is a relatively new approach to evaluation and its overall place in the is not yet fully established. As with all primary research approaches, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency. PMID:26238395

Multidisciplinary Delphi Development of a Scale to Evaluate Team Function in Obstetric Emergencies: The PETRA Scale.

PubMed

Balki, Mrinalini; Hoppe, David; Monks, David; Cooke, Mary Ellen; Sharples, Lynn; Windrim, Rory

2017-06-01

The objective of this study was to develop a new interdisciplinary teamwork scale, the Perinatal Emergency: Team Response Assessment (PETRA), for the management of obstetric crises, through consensus agreement of obstetric caregivers. This prospective study was performed using expert consensus, based on a Delphi method. The study investigators developed a new PETRA tool, specifically related to obstetric crisis management, based on the existing literature and discussions among themselves. The scale was distributed to a selected panel of experts in the field for the Delphi process. After each round of Delphi, every component of the scale was analyzed quantitatively by the percentage of agreement ratings and each comment reviewed by the blinded investigators. The assessment scale was then modified, with components of less than 80% agreement removed from the scale. The process was repeated on three occasions to reach a consensus and final PETRA scale. Fourteen of 24 invited experts participated in the Delphi process. The original PETRA scale included six categories and 48 items, one global scale item, and a 3-point rubric for rating. The overall percentage agreement by experts in the first, second, and third rounds was 95.0%, 93.2%, and 98.5%, respectively. The final scale after the third round of Delphi consisted of the following seven categories: shared mental model, communication, situational awareness, leadership, followership, workload management, and positive/effective behaviours and attitudes. There were 34 individual items within these categories, each with a 5-point rating rubric (1 = unacceptable to 5 = perfect). Using a structured Delphi method, we established the face and content validity of this assessment scale that focuses on important aspects of interdisciplinary teamwork in the management of obstetric crises. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

PubMed

Turner, S; Ollerhead, E; Cook, A

2017-10-09

In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and logistically challenging. Identifying such research priorities can be particularly challenging for complex public health problems as there is a need to consult a number of experts across disciplines and with a range of expertise. This study investigated the use of Delphi-like survey methods in identifying important research priorities relating to health inequalities and framing tractable research questions for topic areas identified. The study was conducted in two phases, both using Delphi-like survey methods. Firstly, public health professionals with an interest in health inequalities were asked to identify research priorities. Secondly academic researchers were asked to frame tractable research questions relating to the priorities identified. These research priorities identified using Delphi-like survey methods were subsequently compared to those identified using different methods. A total of 52 public health professionals and 21 academics across the United Kingdom agreed to take part. The response rates were high, from public health professionals across three survey rounds (69%, 50% and 40%) and from academics across one round (52%), indicating that participants were receptive to the method and motivated to respond. The themes identified as encompassing the most important research priorities were mental health, healthy environment and health behaviours. Within these themes, the topic areas that emerged most strongly included community interventions for prevention of mental health problems and the food and alcohol environment. Some responses received from academic researchers were (as requested) in the form of tractable research questions, whereas others contributed further potential topic areas instead. Delphi-like survey methods are practical and productive as a means of obtaining opinions from a wide number of relevant experts identifying potential priority topic areas for research; however, this method is less appropriate for framing tractable research questions.

The trials methodological research agenda: results from a priority setting exercise.

PubMed

Tudur Smith, Catrin; Hickey, Helen; Clarke, Mike; Blazeby, Jane; Williamson, Paula

2014-01-23

Research into the methods used in the design, conduct, analysis, and reporting of clinical trials is essential to ensure that effective methods are available and that clinical decisions made using results from trials are based on the best available evidence, which is reliable and robust. An on-line Delphi survey of 48 UK Clinical Research Collaboration registered Clinical Trials Units (CTUs) was undertaken. During round one, CTU Directors were asked to identify important topics that require methodological research. During round two, their opinion about the level of importance of each topic was recorded, and during round three, they were asked to review the group's average opinion and revise their previous opinion if appropriate. Direct reminders were sent to maximise the number of responses at each round. Results are summarised using descriptive methods. Forty one (85%) CTU Directors responded to at least one round of the Delphi process: 25 (52%) responded in round one, 32 (67%) responded in round two, 24 (50%) responded in round three. There were only 12 (25%) who responded to all three rounds and 18 (38%) who responded to both rounds two and three. Consensus was achieved amongst CTU Directors that the top three priorities for trials methodological research were 'Research into methods to boost recruitment in trials' (considered the highest priority), 'Methods to minimise attrition' and 'Choosing appropriate outcomes to measure'. Fifty other topics were included in the list of priorities and consensus was reached that two topics, 'Radiotherapy study designs' and 'Low carbon trials', were not priorities. This priority setting exercise has identified the research topics felt to be most important to the key stakeholder group of Directors of UKCRC registered CTUs. The use of robust methodology to identify these priorities will help ensure that this work informs the trials methodological research agenda, with a focus on topics that will have most impact and relevance.

Effective self-management strategies for bipolar disorder: A community-engaged Delphi Consensus Consultation study.

PubMed

Michalak, Erin E; Suto, Melinda J; Barnes, Steven J; Hou, Sharon; Lapsley, Sara; Scott, Mike W; Murray, Greg; Austin, Jehannine; Elliott, Nusha Balram; Berk, Lesley; Crest Bd

2016-12-01

Self-management represents an important complement to psychosocial treatments for bipolar disorder (BD), but research is limited. Specifically, little is known about self-management approaches for elevated mood states; this study investigated self-management strategies for: (1) maintaining balance in mood, and (2) stopping progression into hypomania/mania. To identify the common components of BD self-management, Delphi Consensus Consultation methods were combined with a Community-Based Participatory Research (CBPR) approach across five study phases: (1) Qualitative dataset content analysis; (2) Academic/grey literature reviews; (3) Content analysis; (4) Two Delphi rounds (rating strategies on a 5-point Likert scale, Very Unhelpful-Very Helpful), and; (5) Quantitative analysis and interpretation. Participants were people with BD and healthcare providers. Phases 1 and 2 identified 262 and 3940 candidate strategies, respectively; 3709 were discarded as duplicates/unintelligible. The remaining 493 were assessed via Delphi methods in Phase 4: 101 people with BD and 52 healthcare providers participated in Round 1; 83 of the BD panel (82%) and 43 of the healthcare provider panel (83%) participated in Round 2-exploratory factor analysis (EFA) was conducted on Round 2 results. EFA was underpowered and sample was not ethnically diverse, limiting generalizability. High concordance was observed in ratings of strategy effectiveness between the two panels. Future research could usefully investigate the provisional discovery here of underlying factors which link individual strategies. For example, 'maintaining hope' underpinned strategies for maintaining balance, and 'decreasing use of stimulants' underpinned strategies to interrupt hypo/manic ascent. There is merit in combining CBPR and Delphi methods. Copyright © 2016 Elsevier B.V. All rights reserved.

Development of the Assessment Items of Debris Flow Using the Delphi Method

NASA Astrophysics Data System (ADS)

Byun, Yosep; Seong, Joohyun; Kim, Mingi; Park, Kyunghan; Yoon, Hyungkoo

2016-04-01

In recent years in Korea, Typhoon and the localized extreme rainfall caused by the abnormal climate has increased. Accordingly, debris flow is becoming one of the most dangerous natural disaster. This study aimed to develop the assessment items which can be used for conducting damage investigation of debris flow. Delphi method was applied to classify the realms of assessment items. As a result, 29 assessment items which can be classified into 6 groups were determined.

A Delphi forecast of technology in education

NASA Technical Reports Server (NTRS)

Robinson, B. E.

1973-01-01

The results are reported of a Delphi forecast of the utilization and social impacts of large-scale educational telecommunications technology. The focus is on both forecasting methodology and educational technology. The various methods of forecasting used by futurists are analyzed from the perspective of the most appropriate method for a prognosticator of educational technology, and review and critical analysis are presented of previous forecasts and studies. Graphic responses, summarized comments, and a scenario of education in 1990 are presented.

Using a Delphi process to establish consensus on emergency medicine clerkship competencies.

PubMed

Penciner, Rick; Langhan, Trevor; Lee, Richard; McEwen, Jill; Woods, Robert A; Bandiera, Glen

2011-01-01

Currently, there is no consensus on the core competencies required for emergency medicine (EM) clerkships in Canada. Existing EM curricula have been developed through informal consensus or local efforts. The Delphi process has been used extensively as a means for establishing consensus. The purpose of this project was to define core competencies for EM clerkships in Canada, to validate a Delphi process in the context of national curriculum development, and to demonstrate the adoption of the CanMEDS physician competency paradigm in the undergraduate medical education realm. Using a modified Delphi process, we developed a consensus amongst a panel of expert emergency physicians from across Canada utilizing the CanMEDS 2005 Physician Competency Framework. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). This study demonstrated that a modified Delphi process can result in a strong consensus around a realistic number of core competencies for EM clerkships. We propose that such a method could be used by other medical specialties and health professions to develop rotation-specific core competencies.

Application of Delphi expert panel in joint venture projects

NASA Astrophysics Data System (ADS)

Adnan, H.; Rosman, M. R.; Rashid, Z. Z. Ahmad; Mohamad Yusuwan, N.; Bakhary, N. A.

2018-02-01

This study was conducted with the aim to identify the application of the Delphi Technique in validating findings obtained from questionnaire surveys and interviews done in- depth on the subject of joint venture projects in Malaysia. The Delphi technique aims to achieve a consensus of opinion amongst expert panellist that were selected on the primary factors in JV projects. To achieve research objectives, a progressive series of questions was designed where a selected panel of expert to confirm and validate the final findings. The rationale, benefits, limitations and recommendations for the use of Delphi were given in this study. From the literature review done, twenty-one factors were identified as critical factors to the making any joint venture project successful. Detail information from contractors were obtained by using the questionnaire survey method and forty-three in-depth interviews were carried out. Trust between partners, mutual understanding, partner selection criteria, agreement of contract, objective compatibility, conflict, and commitment were confirmed by the Delphi panel to be the critical success factors besides another fourteen factors which were found to be the Failure Reduction Criteria. Delphi techniques has proven to successfully assist in recognising the main factors and would be beneficial in supplementing the success of joint venture arrangements application for construction projects in Malaysia.

Developing a constructivist learning environment in online postsecondary science courses

NASA Astrophysics Data System (ADS)

Hackworth, Sylvester N.

This Delphi study addressed the concerns of postsecondary educators regarding the quality of education received by postsecondary science students who receive their instruction online. This study was framed with the constructivist learning theory and Piaget's and Dewey's cognitive development theories. The overarching question addressed a gap in research literature surrounding the pedagogical practices that could be successfully applied to future postsecondary online science education. The panel consisted of 30 experts in the area of online postsecondary education. Qualitative data from the initial seed questions were used to create a Likert-type survey to seek consensus of the themes derived from participant responses. Participants reached agreement on six items: apply constructivism to science curricula, identify strengths and challenges of online collegiate students, explicate students' consequences due to lack of participation in discussion forums, ensure that online course content is relevant to students' lives, reinforce academic integrity, and identify qualities face-to-face collegiate science instructors need when transitioning to online science instructors. The majority of participants agreed that gender is not an important factor in determining the success of an online collegiate science student. There was no consensus on the efficacy of virtual labs in an online science classroom. This study contributes to positive social change by providing information to new and struggling postsecondary science teachers to help them successfully align their instruction with students' needs and, as a result, increase students' success.

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists

PubMed Central

2017-01-01

Purpose This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. Methods A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects’ responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Results Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Conclusion Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience. PMID:28900069

A Delphi Investigation into Future Trends in E-Learning in Israel

ERIC Educational Resources Information Center

Aharony, Noa; Bronstein, Jenny

2014-01-01

The purpose of this study is to investigate the views and opinions of e-learning experts regarding future trends in the e-learning arena. The Delphi technique was chosen as a method of study. This technique is an efficient and effective group communication process designed to systematically elicit judgments from experts in their selected area of…

Views and Dreams: A Delphi Investigation into Library 2.0 Applications

ERIC Educational Resources Information Center

Bronstein, Jenny; Aharony, Noa

2009-01-01

The study's purpose was to investigate the views and opinions of librarians about the implementation of Web 2.0 technologies into library operations and services. The Delphi technique was chosen as the method of inquiry in this study, in which a group of panelists graded the desirability and probability of a list of statements. Thirty-nine…

Designing Graduate-Level Plant Breeding Curriculum: A Delphi Study of Private Sector Stakeholder Opinions

ERIC Educational Resources Information Center

Miller, Jane K.; Repinski, Shelby L.; Hayes, Kathryn N.; Bliss, Frederick A.; Trexler, Cary J.

2011-01-01

A broad-based survey using the Delphi method was conducted to garner current information from private sector stakeholders and build consensus opinions supporting key ideas for enhancing plant breeder education and training. This study asked respondents to suggest and rate topics and content they deemed most important to plant breeding graduate…

Identification of Core Competencies for an Undergraduate Food Safety Curriculum Using a Modified Delphi Approach

ERIC Educational Resources Information Center

Johnston, Lynette M.; Wiedmann, Martin; Orta-Ramirez, Alicia; Oliver, Haley F.; Nightingale, Kendra K.; Moore, Christina M.; Stevenson, Clinton D.; Jaykus, Lee-Ann

2014-01-01

Identification of core competencies for undergraduates in food safety is critical to assure courses and curricula are appropriate in maintaining a well-qualified food safety workforce. The purpose of this study was to identify and refine core competencies relevant to postsecondary food safety education using a modified Delphi method. Twenty-nine…

The Underutilization of Information and Communication Technology-Assisted Collaborative Project-Based Learning among International Educators: A Delphi Study

ERIC Educational Resources Information Center

Kramer, Barry S.; Walker, Andrew E.; Brill, Jennifer M.

2007-01-01

This study explores the barriers associated with teachers implementing information and communication technology-assisted collaborative project-based learning (ICTCPrjBL) as a classroom teaching methodology with students. We used a Web-based Delphi method to engage experienced educators in anonymous consensus building consisting of three rounds of…

Greenhouse Facility Management Experts Identification of Competencies and Teaching Methods to Support Secondary Agricultural Education Instructors: A Modified Delphi Study

ERIC Educational Resources Information Center

Franklin, Edward A.

2011-01-01

In this study the Delphi technique has been used to develop a list of educational competencies for preparing secondary agricultural education instructors to effectively manage their school greenhouse facilities. The use of specialized facilities in agricultural education requires appropriate preparation of agricultural education teachers. The…

77 FR 2773 - Proposed Information Collection Request; Notice of New Requirements and Procedures for Grant...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-01-19

... the Office of Management and Budget (OMB). You may submit comments by the following methods: Email... required to have electronic Internet access to register in the Delphi eInvoicing system. Grantees will be.... The identities of system users must be verified prior to receiving access to the Delphi eInvoicing...

Identifying Threshold Concepts for Information Literacy: A Delphi Study

ERIC Educational Resources Information Center

Townsend, Lori; Hofer, Amy R.; Hanick, Silvia Lin; Brunetti, Korey

2016-01-01

This study used the Delphi method to engage expert practitioners on the topic of threshold concepts--core ideas and processes in a discipline that students need to grasp in order to progress in their learning, but that are often unspoken or unrecognized by expert practitioners--for information literacy. A panel of experts considered two questions:…

Emerging Issues in the Utilization of Weblogs in Higher Education Classrooms

ERIC Educational Resources Information Center

Ayao-ao, Shirley

2014-01-01

This paper examines the emerging issues in the utilization of weblogs in Philippine higher education and how these issues affect the performance of students. This study used a modified Delphi method. The Delphi panel consisted of 12 experts in the integration of technology, particularly blogs, in their teaching. The study yielded the following…

Trends that FCS Education Should Address: A Delphi Study Reveals Top 16

ERIC Educational Resources Information Center

Alexander, Karen L.; Davis, Kimberlee

2011-01-01

This study used the Delphi method to identify trends of importance to family and consumer sciences (FCS) education. A panel of 21 FCS education experts identified 16 trends and evaluated them by importance, desirability, feasibility, and confidence in validity of the trend. Nutrition appeared as a top priority, followed by consumer economics. The…

Delphi in Criminal Justice Policy: A Case Study on Judgmental Forecasting

ERIC Educational Resources Information Center

Loyens, Kim; Maesschalck, Jeroen; Bouckaert, Geert

2011-01-01

This article provides an in-depth case study analysis of a pilot project organized by the section "Strategic Analysis" of the Belgian Federal Police. Using the Delphi method, which is a judgmental forecasting technique, a panel of experts was questioned about future developments of crime, based on their expertise in criminal or social…

The Essential Components of Coach Training for Mental Health Professionals: A Delphi Study

ERIC Educational Resources Information Center

Moriarity, Marlene Therese

2010-01-01

Purpose. The purpose of this study was to discover how coach training experts define coaching and what they would identify to be the essential components of a coach training program for mental health professionals. Methods. A panel of nine experts, through an iterative Delphi process of responding to three rounds of questionnaires, provided…

Financial Leadership Competencies for Public College and University Presidential Leaders in Georgia: A Delphi Study

ERIC Educational Resources Information Center

Jones, Susan M.

2011-01-01

The purpose of the mixed-method Delphi study is to identify the financial leadership competencies considered most important in operating public higher education institutions. The current study also determined whether differences existed in the perceptions of participants' age, level of education, years of service as a president, the number of…

The Semiconductor Industry and Emerging Technologies: A Study Using a Modified Delphi Method

ERIC Educational Resources Information Center

Jordan, Edgar A.

2010-01-01

The purpose of this qualitative descriptive study was to determine what leaders in the semiconductor industry thought the future of computing would look like and what emerging materials showed the most promise to overcome the current theoretical limit of 10 nanometers for silicon dioxide. The researcher used a modified Delphi technique in two…

Safe surgery: validation of pre and postoperative checklists 1

PubMed Central

Alpendre, Francine Taporosky; Cruz, Elaine Drehmer de Almeida; Dyniewicz, Ana Maria; Mantovani, Maria de Fátima; Silva, Ana Elisa Bauer de Camargo e; dos Santos, Gabriela de Souza

2017-01-01

ABSTRACT Objective: to develop, evaluate and validate a surgical safety checklist for patients in the pre and postoperative periods in surgical hospitalization units. Method: methodological research carried out in a large public teaching hospital in the South of Brazil, with application of the principles of the Safe Surgery Saves Lives Programme of the World Health Organization. The checklist was applied to 16 nurses of 8 surgical units and submitted for validation by a group of eight experts using the Delphi method online. Results: the instrument was validated and it was achieved a mean score ≥1, level of agreement ≥75% and Cronbach’s alpha >0.90. The final version included 97 safety indicators organized into six categories: identification, preoperative, immediate postoperative, immediate postoperative, other surgical complications, and hospital discharge. Conclusion: the Surgical Safety Checklist in the Pre and Postoperative periods is another strategy to promote patient safety, as it allows the monitoring of predictive signs and symptoms of surgical complications and the early detection of adverse events. PMID:28699994

[Evaluation of the first training on clinical research methodology in Chile].

PubMed

Espinoza, Manuel; Cabieses, Báltica; Pedreros, César; Zitko, Pedro

2011-03-01

This paper describes the evaluation of the first training on clinical research methodology in Chile (EMIC-Chile) 12 months after its completion. An online survey was conducted for students and the Delphi method was used for the teaching team. Among the students, the majority reported that the program had contributed to their professional development and that they had shared some of the knowledge acquired with colleagues in their workplace. Forty-one percent submitted a project to obtain research funding through a competitive grants process once they had completed the course. Among the teachers, the areas of greatest interest were the communication strategy, teaching methods, the characteristics of the teaching team, and potential strategies for making the EMIC-Chile permanent in the future. This experience could contribute to future research training initiatives for health professionals. Recognized challenges are the involvement of nonmedical professions in clinical research, the complexities associated with the distance learning methodology, and the continued presence of initiatives of this importance at the national and regional level.

[Assessment method for mobile health applications in Spanish: The iSYScore index].

PubMed

Grau, I; Kostov, B; Gallego, J A; Grajales Iii, F; Fernández-Luque, L; Sisó-Almirall, A

The widespread of mobile smartphones among the population has resulted in a growing range of mobile applications in health using iOS and Android devices. The level of confidence that such applications deserve and the health information available online to the general population is a widely debated issue. The main objective of this work was to develop a tool -a scale-, for evaluating the reliability of health apps. The scale was developed using a systematic evidence-based approach, and with an expert consensus, built with a Delphi process. This was followed by a health app catalogue, which was used to test and validate our method that helps to recommend the best apps for non-medical experts across 3 different user interest axes: 1) popularity and interest; 2) trust and quality; and 3) usefulness. Copyright © 2015 Sociedad Española de Médicos de Atención Primaria (SEMERGEN). Publicado por Elsevier España, S.L.U. All rights reserved.

Verification of a Quality Management Theory: Using a Delphi Study

PubMed Central

Mosadeghrad, Ali Mohammad

2013-01-01

Background: A model of quality management called Strategic Collaborative Quality Management (SCQM) model was developed based on the quality management literature review, the findings of a survey on quality management assessment in healthcare organisations, semi-structured interviews with healthcare stakeholders, and a Delphi study on healthcare quality management experts. The purpose of this study was to verify the SCQM model. Methods: The proposed model was further developed using feedback from thirty quality management experts using a Delphi method. Further, a guidebook for its implementation was prepared including a road map and performance measurement. Results: The research led to the development of a context-specific model of quality management for healthcare organisations and a series of guidelines for its implementation. Conclusion: A proper model of quality management should be developed and implemented properly in healthcare organisations to achieve business excellence. PMID:24596883

Assessment of critical thinking: a Delphi study.

PubMed

Paul, Sheila A

2014-11-01

Nurse educators are responsible for preparing nurses who critically analyze patient information and provide meaningful interventions in today's complex health care system. By using the Delphi research method, this study, utilized the specialized and experiential knowledge of Certified Nurse Educators. This original Delphi research study asked Certified Nurse Educators how to assess the critical-thinking ability of nursing students in the clinical setting. The results showed that nurse educators need time, during the clinical experience, to accurately assess each individual nursing student. This study demonstrated the need for extended student clinical time, and a variety of clinical learning assessment tools. Copyright © 2014 Elsevier Ltd. All rights reserved.

Using the Delphi method to develop nursing-sensitive quality indicators for the NICU.

PubMed

Chen, Lin; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-02-01

To develop nursing-sensitive quality indicators consistent with current medical practices in Chinese neonatal intensive care units. The development of nursing-sensitive quality indicators has become a top priority in nursing management. To the best of our knowledge, there has been no objective, scientific and sensitive evaluation of the quality of neonatal intensive care unit nursing in China. A modified Delphi technique was used to seek opinions from experts about what should be used and prioritised as indicators of quality care in neonatal intensive care unit nursing. Based on a literature review, we identified 21 indicators of nursing-sensitive quality in the neonatal intensive care unit. Our group of 11 consultants chose 13 indicators to be discussed using the Delphi method. In October and November 2014, 39 neonatal intensive care unit experts in 18 tertiary hospitals spread across six provinces participated in two rounds of Delphi panels. Of the 13 indicators discussed, 11 were identified as indicators of nursing-sensitive quality in the neonatal intensive care unit: rate of nosocomial infections, rate of accidental endotracheal extubation, rate of errors in medication administration, rate of treatment for pain, rate of peripheral venous extravasation, rate of compliance with handwashing techniques, incidence of pressure ulcers, incidence of noise, the bed-to-care ratio, the proportion of nurses with greater than five years neonatal intensive care unit experience and incidence of retinopathy. The 11 neonatal intensive care unit nursing-sensitive indicators identified by the Delphi method integrated with basic Chinese practices provide a basis for nursing management and the monitoring of nursing quality. This study identified nursing-sensitive quality indicators for neonatal intensive care unit care that are suitable for current clinical practice in China. © 2016 John Wiley & Sons Ltd.

Evaluating the construct of triage acuity against a set of reference vignettes developed via modified Delphi method.

PubMed

Twomey, Michèle; Wallis, Lee A; Myers, Jonathan E

2014-07-01

To evaluate the construct of triage acuity as measured by the South African Triage Scale (SATS) against a set of reference vignettes. A modified Delphi method was used to develop a set of reference vignettes. Delphi participants completed a 2-round consensus-building process, and independently assigned triage acuity ratings to 100 written vignettes unaware of the ratings given by others. Triage acuity ratings were summarised for all vignettes, and only those that reached 80% consensus during round 2 were included in the reference set. Triage ratings for the reference vignettes given by two independent experts using the SATS were compared with the ratings given by the international Delphi panel. Measures of sensitivity, specificity, associated percentages for over-triage/under-triage were used to evaluate the construct of triage acuity (as measured by the SATS) by examining the association between the ratings by the two experts and the international panel. On completion of the Delphi process, 42 of the 100 vignettes reached 80% consensus on their acuity rating and made up the reference set. On average, over all acuity levels, sensitivity was 74% (CI 64% to 82%), specificity 92% (CI 87% to 94%), under-triage occurred 14% (CI 8% to 23%) and over-triage 12% (CI 8% to 23%) of the time. The results of this study provide an alternative to evaluating triage scales against the construct of acuity as measured with the SATS. This method of using 80% consensus vignettes may, however, systematically bias the validity estimate towards better performance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Teacher Leadership: A Delphi Study of Factors in Building Teacher Leadership Capacity in Elementary Educational Organizations

ERIC Educational Resources Information Center

Castilleja Gray, Beatrice

2016-01-01

Purpose: The purpose of this qualitative study was to identify and describe the most important factors that motivate or deter teachers in deciding to take on the informal or formal role of teacher-leader in Riverside County elementary school districts. Methodology: Endemic of a Delphi method, the instruments used within this study collected data…

Development of an Adolescent Alcohol Misuse Intervention Based on the Prototype Willingness Model: A Delphi Study

ERIC Educational Resources Information Center

Davies, Emma; Martin, Jilly; Foxcroft, David

2016-01-01

Purpose: The purpose of this paper is to report on the use of the Delphi method to gain expert feedback on the identification of behaviour change techniques (BCTs) and development of a novel intervention to reduce adolescent alcohol misuse, based on the Prototype Willingness Model (PWM) of health risk behaviour. Design/methodology/approach: Four…

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

[Construction of a physiological aging scale for healthy people based on a modified Delphi method].

PubMed

Long, Yao; Zhou, Xuan; Deng, Pengfei; Liao, Xiong; Wu, Lei; Zhou, Jianming; Huang, Helang

2016-04-01

To build a physiological aging scale for healthy people.
 We collected age-related physiologic items through literature screening and expert interview. Two rounds of Delphi were implemented. The importance, feasibility and the degree of authority for the physiological index system were graded. Using analytic hierarchy process, we determined the weight of dimensions and items.
 Using Delphy mothod, 17 physiological and other professional experts offered the results as follow: coefficient of expert authorities Cr was 0.86±0.03, coordination coefficients for the first and second round were 0.264(χ2=229.691, P<0.001) and 0.293(χ2=228.474，P<0.001), respectively. The consistency was good. The aging scale for healthy people included 3 dimensions, namely physical form, feeling movement and functional status. Each dimension had 8 items. The weight coefficients for the 3 dimensions were 0.54, 0.16, and 0.30, respectively. The Cronbach's α coefficient of the scale was 0.893, the reliability was 0.796, and the variance of the common factor was 58.17%.
 The improved Delphi method or physiological aging scale is satisfied, which can provide reference for the evaluation of aging.

Anatomical Society core regional anatomy syllabus for undergraduate medicine: the Delphi process.

PubMed

Smith, C F; Finn, G M; Stewart, J; McHanwell, S

2016-01-01

A modified Delphi method was employed to seek consensus when revising the UK and Ireland's core syllabus for regional anatomy in undergraduate medicine. A Delphi panel was constructed involving 'expert' (individuals with at least 5 years' experience in teaching medical students anatomy at the level required for graduation). The panel (n = 39) was selected and nominated by members of Council and/or the Education Committee of the Anatomical Society and included a range of specialists including surgeons, radiologists and anatomists. The experts were asked in two stages to 'accept', 'reject' or 'modify' (first stage only) each learning outcome. A third stage, which was not part of the Delphi method, then allowed the original authors of the syllabus to make changes either to correct any anatomical errors or to make minor syntax changes. From the original syllabus of 182 learning outcomes, removing the neuroanatomy component (163), 23 learning outcomes (15%) remained unchanged, seven learning outcomes were removed and two new learning outcomes added. The remaining 133 learning outcomes were modified. All learning outcomes on the new core syllabus achieved over 90% acceptance by the panel. © 2015 Anatomical Society.

A modified Delphi method toward multidisciplinary consensus on functional convalescence recommendations after abdominal surgery.

PubMed

van Vliet, Daphne C R; van der Meij, Eva; Bouwsma, Esther V A; Vonk Noordegraaf, Antonie; van den Heuvel, Baukje; Meijerink, Wilhelmus J H J; van Baal, W Marchien; Huirne, Judith A F; Anema, Johannes R

2016-12-01

Evidence-based information on the resumption of daily activities following uncomplicated abdominal surgery is scarce and not yet standardized in medical guidelines. As a consequence, convalescence recommendations are generally not provided after surgery, leading to patients' insecurity, needlessly delayed recovery and prolonged sick leave. The aim of this study was to generate consensus-based multidisciplinary convalescence recommendations, including advice on return to work, applicable for both patients and physicians. Using a modified Delphi method among a multidisciplinary panel of 13 experts consisting of surgeons, occupational physicians and general practitioners, detailed recommendations were developed for graded resumption of 34 activities after uncomplicated laparoscopic cholecystectomy, laparoscopic and open appendectomy, laparoscopic and open colectomy and laparoscopic and open inguinal hernia repair. A sample of occupational physicians, general practitioners and surgeons assessed the recommendations on feasibility in daily practice. The response of this group of care providers was discussed with the experts in the final Delphi questionnaire round. Out of initially 56 activities, the expert panel selected 34 relevant activities for which convalescence recommendations were developed. After four Delphi rounds, consensus was reached for all of the 34 activities for all the surgical procedures. A sample of occupational physicians, general practitioners and surgeons regarded the recommendations as feasible in daily practice. Multidisciplinary convalescence recommendations regarding uncomplicated laparoscopic cholecystectomy, appendectomy (laparoscopic, open), colectomy (laparoscopic, open) and inguinal hernia repair (laparoscopic, open) were developed by a modified Delphi procedure. Further research is required to evaluate whether these recommendations are realistic and effective in daily practice.

Standardizing hysteroscopy teaching: development of a curriculum using the Delphi method.

PubMed

Neveu, Marie-Emmanuelle; Debras, Elodie; Niro, Julien; Fernandez, Hervé; Panel, Pierre

2017-12-01

Hysteroscopy is performed often and in many indications but is challenging to learn. Hands-on training in live patients faces ethical, legal, and economic obstacles. Virtual reality simulation may hold promise as a hysteroscopy training tool. No validated curriculum specific in hysteroscopy exists. The aim of this study was to develop a hysteroscopy curriculum, using the Delphi method to identify skill requirements. Based on a literature review using the key words "curriculum," "simulation," and "hysteroscopy," we identified five technical and non-technical areas in which skills were required. Twenty hysteroscopy experts from different French hospital departments participated in Delphi rounds to select items in these five areas. The rounds were to be continued until 80-100% agreement was obtained for at least 60% of items. A curriculum was built based on the selected items and was evaluated in residents. From November 2014 to April 2015, 18 of 20 invited experts participated in three Delphi rounds. Of the 51 items selected during the first round, only 25 (49%) had 80-100% agreement during the second round, and a third round was therefore conducted. During this last round, 80-100% agreement was achieved for 31 (61%) items, which were used to create the curriculum. All 14 residents tested felt that a simulator training session was acceptable and helped them to improve their skills. We describe a simulation-based hysteroscopy curriculum focusing on skill requirements identified by a Delphi procedure. Its development allows standardization of training programs offered to residents.

EURECCA colorectal: multidisciplinary management: European consensus conference colon & rectum.

PubMed

van de Velde, Cornelis J H; Boelens, Petra G; Borras, Josep M; Coebergh, Jan-Willem; Cervantes, Andres; Blomqvist, Lennart; Beets-Tan, Regina G H; van den Broek, Colette B M; Brown, Gina; Van Cutsem, Eric; Espin, Eloy; Haustermans, Karin; Glimelius, Bengt; Iversen, Lene H; van Krieken, J Han; Marijnen, Corrie A M; Henning, Geoffrey; Gore-Booth, Jola; Meldolesi, Elisa; Mroczkowski, Pawel; Nagtegaal, Iris; Naredi, Peter; Ortiz, Hector; Påhlman, Lars; Quirke, Philip; Rödel, Claus; Roth, Arnaud; Rutten, Harm; Schmoll, Hans J; Smith, Jason J; Tanis, Pieter J; Taylor, Claire; Wibe, Arne; Wiggers, Theo; Gambacorta, Maria A; Aristei, Cynthia; Valentini, Vincenzo

2014-01-01

Care for patients with colon and rectal cancer has improved in the last 20years; however considerable variation still exists in cancer management and outcome between European countries. Large variation is also apparent between national guidelines and patterns of cancer care in Europe. Therefore, EURECCA, which is the acronym of European Registration of Cancer Care, is aiming at defining core treatment strategies and developing a European audit structure in order to improve the quality of care for all patients with colon and rectal cancer. In December 2012, the first multidisciplinary consensus conference about cancer of the colon and rectum was held. The expert panel consisted of representatives of European scientific organisations involved in cancer care of patients with colon and rectal cancer and representatives of national colorectal registries. The expert panel had delegates of the European Society of Surgical Oncology (ESSO), European Society for Radiotherapy & Oncology (ESTRO), European Society of Pathology (ESP), European Society for Medical Oncology (ESMO), European Society of Radiology (ESR), European Society of Coloproctology (ESCP), European CanCer Organisation (ECCO), European Oncology Nursing Society (EONS) and the European Colorectal Cancer Patient Organisation (EuropaColon), as well as delegates from national registries or audits. Consensus was achieved using the Delphi method. For the Delphi process, multidisciplinary experts were invited to comment and vote three web-based online voting rounds and to lecture on the subjects during the meeting (13th-15th December 2012). The sentences in the consensus document were available during the meeting and a televoting round during the conference by all participants was performed. This manuscript covers all sentences of the consensus document with the result of the voting. The consensus document represents sections on diagnostics, pathology, surgery, medical oncology, radiotherapy, and follow-up where applicable for treatment of colon cancer, rectal cancer and metastatic colorectal disease separately. Moreover, evidence based algorithms for diagnostics and treatment were composed which were also submitted to the Delphi process. The total number of the voted sentences was 465. All chapters were voted on by at least 75% of the experts. Of the 465 sentences, 84% achieved large consensus, 6% achieved moderate consensus, and 7% resulted in minimum consensus. Only 3% was disagreed by more than 50% of the members. Multidisciplinary consensus on key diagnostic and treatment issues for colon and rectal cancer management using the Delphi method was successful. This consensus document embodies the expertise of professionals from all disciplines involved in the care for patients with colon and rectal cancer. Diagnostic and treatment algorithms were developed to implement the current evidence and to define core treatment guidance for multidisciplinary team management of colon and rectal cancer throughout Europe. Copyright © 2013 Elsevier Ltd. All rights reserved.

Development of Cardiovascular Quality Indicators for Rheumatoid Arthritis: Results from an International Expert Panel Using a Novel Online Process

PubMed Central

Barber, Claire E. H.; Marshall, Deborah A; Alvarez, Nanette; John Mancini, G. B.; Lacaille, Diane; Keeling, Stephanie; Aviña-Zubieta, J. Antonio; Khodyakov, Dmitry; Barnabe, Cheryl; Faris, Peter; Smith, Alexa; Noormohamed, Raheem; Hazlewood, Glen; Martin, Liam O.; Esdaile, John M.

2016-01-01

Objective Patients with rheumatoid arthritis (RA) have a high risk of premature cardiovascular disease (CVD). We developed CVD quality indicators (QIs) for screening and use in Rheumatology clinics. Methods A systematic review of the literature on CVD risk reduction in RA and the general population was conducted. Based on the best practices identified from this review, a draft set of 12 candidate QIs were presented to a Canadian panel of rheumatologists and cardiologists (n=6) from three academic centers to achieve consensus on the QI specifications. The resulting 11 QIs were then evaluated by an online modified-Delphi panel of multidisciplinary health professionals and patients (n = 43) to determine their relevance, validity and feasibility in three rounds of online voting and threaded discussion using a modified RAND/UCLA Appropriateness Methodology. Results Response rates for the online panel were 86%. All 11 QIs were rated as highly relevant, valid and feasible (median rating ≥7 on a 1–9 scale) with no significant disagreement. The final QI set addresses the following themes: communication to primary care about increased CV risk in RA, CV risk assessment, defining smoking status and providing cessation counseling, screening and addressing hypertension, dyslipidemia and diabetes, exercise recommendations, body mass index screening and lifestyle counseling, minimizing corticosteroid use and communicating to patients at high risk of CVD about the risks/benefits of non-steroidal anti-inflammatory drugs. Conclusion Eleven QIs for CVD care in RA patients have been developed and are rated as highly relevant, valid and feasible by an international multidisciplinary panel. PMID:26178275

Guiding Principles for Student Leadership Development in the Doctor of Pharmacy Program to Assist Administrators and Faculty Members in Implementing or Refining Curricula

PubMed Central

Boyle, Cynthia J.; Janke, Kristin K.

2013-01-01

Objective. To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Results. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Conclusions. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought. PMID:24371345

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology.

PubMed

King, Andrew; Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-10-25

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development.

Environmental and occupational health research and training needs in Colombia: A Delphi study.

PubMed

Rodríguez-Villamizar, Laura A; González, Beatriz Elena; Vera, Lina María; Patz, Jonathan; Bautista, Leonelo E

2015-08-01

Environmental factors contribute with 16% of the burden of disease in Colombia. A main obstacle in implementing national and regional environmental and occupational health policies is the limited knowledge on the local ability to study and control the impact of harmful exposures on health. To identify needs for research and training in environmental and occupational health in Colombia. We conducted a three-round hybrid Delphi study. A group of environmental and occupational health Colombian experts (n=16) from government agencies, universities, and research centers was recruited to participate in the study. Expert´s opinions on research and training needs were gathered through online questionnaires, followed by an in-person meeting. The percentage of agreement and the coefficient of variation were used to measure consensus. Air pollution and chemical products were considered the most important environmental and occupational exposures, due to their significant impact on chronic non-communicable diseases, such as respiratory diseases, cardiovascular diseases, and cancer. Research on the effects of outdoor air pollution on cardiovascular and respiratory diseases was considered of the greatest importance. Priority training areas included environmental and occupational health risk assessment, exposure modeling, advanced statistical methods, urban planning, occupational safety and hygiene, and epidemiology and toxicology. These findings provide a valuable input for the definition and implementation of national environmental and occupational health policies and for the development of a regional hub aimed at strengthening the capacity for research and training in Colombia.

Medicine authentication technology as a counterfeit medicine-detection tool: a Delphi method study to establish expert opinion on manual medicine authentication technology in secondary care.

PubMed

Naughton, Bernard; Roberts, Lindsey; Dopson, Sue; Brindley, David; Chapman, Stephen

2017-05-06

This study aims to establish expert opinion and potential improvements for the Falsified Medicines Directive mandated medicines authentication technology. A two-round Delphi method study using an online questionnaire. Large National Health Service (NHS) foundation trust teaching hospital. Secondary care pharmacists and accredited checking technicians. Seven-point rating scale answers which reached a consensus of 70-80% with a standard deviation (SD) of <1.0. Likert scale questions which reached a consensus of 70-80%, a SD of <1.0 and classified as important according to study criteria. Consensus expert opinion has described database cross-checking technology as quick and user friendly and suggested the inclusion of an audio signal to further support the detection of counterfeit medicines in secondary care (70% consensus, 0.9 SD); other important consensus with a SD of <1.0 included reviewing the colour and information in warning pop up screens to ensure they were not mistaken for the 'already dispensed here' pop up, encouraging the dispenser/checker to act on the warnings and making it mandatory to complete an 'action taken' documentation process to improve the quarantine of potentially counterfeit, expired or recalled medicines. This paper informs key opinion leaders and decision makers as to the positives and negatives of medicines authentication technology from an operator's perspective and suggests the adjustments which may be required to improve operator compliance and the detection of counterfeit medicines in the secondary care sector. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Procedural key steps in laparoscopic colorectal surgery, consensus through Delphi methodology.

PubMed

Dijkstra, Frederieke A; Bosker, Robbert J I; Veeger, Nicolaas J G M; van Det, Marc J; Pierie, Jean Pierre E N

2015-09-01

While several procedural training curricula in laparoscopic colorectal surgery have been validated and published, none have focused on dividing surgical procedures into well-identified segments, which can be trained and assessed separately. This enables the surgeon and resident to focus on a specific segment, or combination of segments, of a procedure. Furthermore, it will provide a consistent and uniform method of training for residents rotating through different teaching hospitals. The goal of this study was to determine consensus on the key steps of laparoscopic right hemicolectomy and laparoscopic sigmoid colectomy among experts in our University Medical Center and affiliated hospitals. This will form the basis for the INVEST video-assisted side-by-side training curriculum. The Delphi method was used for determining consensus on key steps of both procedures. A list of 31 steps for laparoscopic right hemicolectomy and 37 steps for laparoscopic sigmoid colectomy was compiled from textbooks and national and international guidelines. In an online questionnaire, 22 experts in 12 hospitals within our teaching region were invited to rate all steps on a Likert scale on importance for the procedure. Consensus was reached in two rounds. Sixteen experts agreed to participate. Of these 16 experts, 14 (88%) completed the questionnaire for both procedures. Of the 14 who completed the first round, 13 (93%) completed the second round. Cronbach's alpha was 0.79 for the right hemicolectomy and 0.91 for the sigmoid colectomy, showing high internal consistency between the experts. For the right hemicolectomy, 25 key steps were established; for the sigmoid colectomy, 24 key steps were established. Expert consensus on the key steps for laparoscopic right hemicolectomy and laparoscopic sigmoid colectomy was reached. These key steps will form the basis for a video-assisted teaching curriculum.

Management of chronic spontaneous urticaria in routine clinical practice: A Delphi-method questionnaire among specialists to test agreement with current European guidelines statements.

PubMed

Giménez-Arnau, A; Ferrer, M; Bartra, J; Jáuregui, I; Labrador-Horrillo, M; Frutos, J Ortiz de; Silvestre, J F; Sastre, J; Velasco, M; Valero, A

Chronic spontaneous urticaria (CSU) is a frequent clinical entity that often presents a diagnostic and therapeutic challenge. To explore the degree of agreement that exists among the experts caring for patients with CSU diagnosis, evaluation, and management. An online survey was conducted to explore the opinions of experts in CSU, address controversial issues, and provide recommendations regarding its definition, natural history, diagnosis, and treatment. A modified Delphi method was used for the consensus. The questionnaire was answered by 68 experts (dermatologists, allergologists, and primary care physicians). A consensus was reached on 54 of the 65 items posed (96.4%). The experts concluded that CSU is a difficult-to-control disease of unpredictable evolution. Diagnostic tests should be limited and based on clinical history and should not be indiscriminate. Autoinflammatory syndromes and urticarial vasculitis must be ruled out in the differential diagnosis. A cutaneous biopsy is only recommended when wheals last more than 24h, to rule out urticarial vasculitis. The use of specific scales to assess the severity of the disease and the quality of life is recommended. In patients with severe and resistant CSU, second-generation H1-antihistamines could be used at doses up to four times the standard dose before giving second-line treatments. Omalizumab is a safe and effective treatment for CSU that is refractory to H1-antihistamines treatment. In general, diagnosis and treatment recommendations given for adults could be extrapolated to children. This work offers consensus recommendations that may be useful in the management of CSU. Copyright © 2016 SEICAP. Published by Elsevier España, S.L.U. All rights reserved.

Standards for UNiversal reporting of patient Decision Aid Evaluation studies: the development of SUNDAE Checklist.

PubMed

Sepucha, Karen R; Abhyankar, Purva; Hoffman, Aubri S; Bekker, Hilary L; LeBlanc, Annie; Levin, Carrie A; Ropka, Mary; Shaffer, Victoria A; Sheridan, Stacey L; Stacey, Dawn; Stalmeier, Peep; Vo, Ha; Wills, Celia E; Thomson, Richard

2018-05-01

Patient decision aids (PDAs) are evidence-based tools designed to help patients make specific and deliberated choices among healthcare options. The International Patient Decision Aid Standards (IPDAS) Collaboration review papers and Cochrane systematic review of PDAs have found significant gaps in the reporting of evaluations of PDAs, including poor or limited reporting of PDA content, development methods and delivery. This study sought to develop and reach consensus on reporting guidelines to improve the quality of publications evaluating PDAs. An international workgroup, consisting of members from IPDAS Collaboration, followed established methods to develop reporting guidelines for PDA evaluation studies. This paper describes the results from three completed phases: (1) planning, (2) drafting and (3) consensus, which included a modified, two-stage, online international Delphi process. The work was conducted over 2 years with bimonthly conference calls and three in-person meetings. The workgroup used input from these phases to produce a final set of recommended items in the form of a checklist. The SUNDAE Checklist (Standards for UNiversal reporting of patient Decision Aid Evaluations) includes 26 items recommended for studies reporting evaluations of PDAs. In the two-stage Delphi process, 117/143 (82%) experts from 14 countries completed round 1 and 96/117 (82%) completed round 2. Respondents reached a high level of consensus on the importance of the items and indicated strong willingness to use the items when reporting PDA studies. The SUNDAE Checklist will help ensure that reports of PDA evaluation studies are understandable, transparent and of high quality. A separate Explanation and Elaboration publication provides additional details to support use of the checklist. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Designing a Standardized Laparoscopy Curriculum for Gynecology Residents: A Delphi Approach

PubMed Central

Shore, Eliane M.; Lefebvre, Guylaine G.; Husslein, Heinrich; Bjerrum, Flemming; Sorensen, Jette Led; Grantcharov, Teodor P.

2015-01-01

Background Evidence suggests that simulation leads to improved operative skill, shorter operating room time, and better patient outcomes. Currently, no standardized laparoscopy curriculum exists for gynecology residents. Objective To design a structured laparoscopy curriculum for gynecology residents using Delphi consensus methodology. Methods This study began with Delphi methodology to determine expert consensus on the components of a gynecology laparoscopic skills curriculum. We generated a list of cognitive content, technical skills, and nontechnical skills for training in laparoscopic surgery, and asked 39 experts in gynecologic education to rate the items on a Likert scale (1–5) for inclusion in the curriculum. Consensus was predefined as Cronbach α of ≥ 0.80. We then conducted another Delphi survey with 9 experienced users of laparoscopic virtual reality simulators to delineate relevant curricular tasks. Finally, a cross-sectional design defined benchmark scores for all identified tasks, with 10 experienced gynecologic surgeons performing the identified tasks at basic, intermediate, and advanced levels. Results Consensus (Cronbach α = 0.85) was achieved in the first round of the curriculum Delphi, and after 2 rounds (Cronbach α = 0.80) in the virtual reality curriculum Delphi. Consensus was reached for cognitive, technical, and nontechnical skills as well as for 6 virtual reality tasks. Median time and economy of movement scores defined benchmarks for all tasks. Conclusions This study used Delphi consensus to develop a comprehensive curriculum for teaching gynecologic laparoscopy. The curriculum conforms to current educational standards of proficiency-based training, and is suggested as a standard in residency programs. PMID:26221434

[Identification of the scope of practice for dental nurses with Delphi method].

PubMed

Li, Yu-Hong; Lu, Yue-Cen; Huang, Yao; Ruan, Hong; Wu, Zheng-Yi

2016-10-01

To identify the practice scope of dental nurses under the new situations. The draft of scope of practice for dental nurses was based on theoretical analysis, literature review and consultation of advisory panel, and the final scope of practice for dental nurses was established by using the Delphi method. Statistical analysis was implemented using coefficient of variation, Kendall W with SPSS 17.0 software package. Thirty experts were consulted twice by using the Delphi method. The effective rates of two rounds of questionnaire were 100% and 73.3%, respectively. The authority coefficient was 0.837, and the P value of expert coordination coefficients W was less than 0.05. There were totally 116 suggestions from the experts, and 96 were accepted. The scope of practice for dental nurses was finally established, including 4 primary indexes and 25 secondary indexes. The scope of practice for dental nurses under the new situations is established in China through scientific methods. It is favorable for position management of dental nurses and may promote the development of nurse specialists in dental clinic.

Academic Primer Series: Key Papers About Teaching with Technology

PubMed Central

Boysen-Osborn, Megan; Cooney, Robert; Gottlieb, Michael; Chan, Teresa M.; Brown, Aaron; King, Andrew; Tobias, Adam; Thoma, Brent

2017-01-01

Introduction Modern learners have immediate, unlimited access to a wide variety of online resources. To appeal to this current generation of learners, educators must embrace the use of technology. However, educators must balance newer, novel technologies with traditional methods to achieve the best learning outcomes. Therefore, we aimed to review several papers useful for faculty members wishing to incorporate technology into instructional design. Methods We identified a broad list of papers relevant to teaching and learning with technology within the online discussions of the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented with suggestions by a guest expert (BT) and an open call on Twitter (tagged with the #meded and #FOAMed hashtags) yielding 24 papers. We then conducted a modified three-round Delphi process within the authorship group, including junior and senior faculty members, to identify the most impactful papers. Results We pared the list of 24 papers to five that were most highly rated. Two were research papers and three were commentaries or editorials. The authorship group reviewed and summarized these papers with specific consideration to their value to junior educators and faculty developers. Conclusion This is a key reading list for junior faculty members and faculty developers interested in teaching with technology. The commentary contextualizes the importance of these papers for medical educators, to optimize use of technology in their teaching or incorporate into faculty development. PMID:28611895

Comparative analysis of stakeholder experiences with an online approach to prioritizing patient-centered research topics.

PubMed

Khodyakov, Dmitry; Grant, Sean; Meeker, Daniella; Booth, Marika; Pacheco-Santivanez, Nathaly; Kim, Katherine K

2017-05-01

Little evidence exists about effective and scalable methods for meaningful stakeholder engagement in research. We explored patient/caregiver experiences with a high-tech online engagement approach for patient-centered research prioritization, compared their experiences with those of professional stakeholders, and identified factors associated with favorable participant experiences. We conducted 8 online modified-Delphi (OMD) panels. Panelists participated in 2 rating rounds with a statistical feedback/online discussion round in between. Panels focused on weight management/obesity, heart failure, and Kawasaki disease. We recruited a convenience sample of adults with any of the 3 conditions (or parents/guardians of Kawasaki disease patients), clinicians, and researchers. Measures included self-reported willingness to use OMD again, the panelists' study participation and online discussion experiences, the system's perceived ease of use, and active engagement metrics. Out of 349 panelists, 292 (84%) completed the study. Of those, 46% were patients, 36% were clinicians, and 19% were researchers. In multivariate models, patients were not significantly more actively engaged (Odds ratio (OR) = 1.69, 95% confidence interval (CI), 0.94-3.05) but had more favorable study participation (β = 0.49; P  ≤ .05) and online discussion (β = 0.18; P  ≤ .05) experiences and were more willing to use OMD again (β = 0.36; P  ≤ .05), compared to professional stakeholders. Positive perceptions of the OMD system's ease of use (β = 0.16; P  ≤ .05) and favorable study participation (β = 0.26; P  ≤ .05) and online discussion (β = 0.57; P  ≤ .05) experiences were also associated with increased willingness to use OMD in the future. Active engagement was not associated with online experience indices or willingness to use OMD again. Online approaches to engaging large numbers of stakeholders are a promising and efficient adjunct to in-person meetings. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Use of the Delphi method in resolving complex water resources issues

USGS Publications Warehouse

Taylor, J.G.; Ryder, S.D.

2003-01-01

The tri-state river basins, shared by Georgia, Alabama, and Florida, are being modeled by the U.S. Fish and Wildlife Service and the U.S. Army Corps of Engineers to help facilitate agreement in an acrimonious water dispute among these different state governments. Modeling of such basin reservoir operations requires parallel understanding of several river system components: hydropower production, flood control, municipal and industrial water use, navigation, and reservoir fisheries requirements. The Delphi method, using repetitive surveying of experts, was applied to determine fisheries' water and lake-level requirements on 25 reservoirs in these interstate basins. The Delphi technique allowed the needs and requirements of fish populations to be brought into the modeling effort on equal footing with other water supply and demand components. When the subject matter is concisely defined and limited, this technique can rapidly assess expert opinion on any natural resource issue, and even move expert opinion toward greater agreement.

[Medical expert consensus in AH on the clinical use of triple fixed-dose antihypertensive therapy in Spain].

PubMed

Mazón, P; Galve, E; Gómez, J; Gorostidi, M; Górriz, J L; Mediavilla, J D

The opinion of experts (different specialties) on the triple fixed-dose antihypertensive therapy in clinical practice may differ. Online questionnaire with controversial aspects of the triple therapy answered by panel of experts in hypertension (HT) using two-round modified Delphi method. The questionnaire was completed by 158 experts: Internal Medicine (49), Nephrology (26), Cardiology (83). Consensus was reached (agreement) on 27/45 items (60%); 7 items showed differences statistically significant. Consensus was reached regarding: Predictive factors in the need for combination therapy and its efficacy vs. increasing the dose of a pretreatment, and advantage of triple therapy (prescription/adherence/cost/pressure control) vs. free combination. This consensus provides an overview of the clinical use of triple therapy in moderate-severe and resistant/difficult to control HT. Copyright © 2016 SEH-LELHA. Publicado por Elsevier España, S.L.U. All rights reserved.

75 FR 16513 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-01

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8th, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture... location of Delphi Packard Electrical/Electronic Architecture, a subsidiary of Delphi Corporation. The...

Reflections of Tomorrow: Lifelong Learning and the Public Library (A Delphi Study). Excerpts.

ERIC Educational Resources Information Center

Weingand, Darlene E.

This study focuses on the question of whether the public library can or will be one of the non-formal providers of lifelong learning in Minnesota, and uses the Delphi method to discover in what way the public library as it is perceived by various publics could become an active participant in this dimension of the educational process. Five groups…

A Modified Delphi to Identify the Significant Works Pertaining to the Understanding of Reading Comprehension and Content Analysis of the Identified Works

ERIC Educational Resources Information Center

Zunker, Norma D.; Pearce, Daniel L.

2012-01-01

The first part of this study explored the significant works pertaining to the understanding of reading comprehension using a Modified Delphi Method. A panel of reading comprehension experts identified 19 works they considered to be significant to the understanding of reading comprehension. The panel of experts identified the reasons they…

What works for wellbeing in culture and sport? Report of a DELPHI process to support coproduction and establish principles and parameters of an evidence review.

PubMed

Daykin, Norma; Mansfield, Louise; Payne, Annette; Kay, Tess; Meads, Catherine; D'Innocenzo, Giorgia; Burnett, Adele; Dolan, Paul; Julier, Guy; Longworth, Louise; Tomlinson, Alan; Testoni, Stefano; Victor, Christina

2017-09-01

There is a growing recognition of the ways in which culture and sport can contribute to wellbeing. A strong evidence base is needed to support innovative service development and a 3-year research programme is being undertaken to capture best evidence of wellbeing impacts and outcomes of cultural and sporting activities in order to inform UK policy and practice. This article provides an overview of methods and findings from an initial coproduction process with key stakeholders that sought to explore and agree principles and parameters of the evidence review for culture, sport and wellbeing (CSW). A two-stage DELPHI process was conducted with a purposeful sample of 57 stakeholders between August and December 2015. Participants were drawn from a range of culture and sport organisations and included commissioners and managers, policy makers, representatives of service delivery organisations (SDOs) and scholars. The DELPHI 1 questionnaire was developed from extensive consultation in July and August 2015. It explored definitions of wellbeing, the role of evidence, quality assessment, and the culture and sport populations, settings and interventions that are most likely to deliver wellbeing outcomes. Following further consultation, the results, presented as a series of ranked statements, were sent back to participants (DELPHI 2), which allowed them to reflect on and, if they wished, express agreement or disagreement with the emerging consensus. A total of 40 stakeholders (70.02%) responded to the DELPHI questionnaires. DELPHI 1 mapped areas of agreement and disagreement, confirmed in DELPHI 2. The exercise drew together the key priorities for the CSW evidence review. The DELPHI process, in combination with face-to-face deliberation, enabled stakeholders to engage in complex discussion and express nuanced priorities while also allowing the group to come to an overall consensus and agree outcomes. The results will inform the CSW evidence review programme until its completion in March 2018.

Approaches, tools and methods used for setting priorities in health research in the 21st century

PubMed Central

Yoshida, Sachiyo

2016-01-01

Background Health research is difficult to prioritize, because the number of possible competing ideas for research is large, the outcome of research is inherently uncertain, and the impact of research is difficult to predict and measure. A systematic and transparent process to assist policy makers and research funding agencies in making investment decisions is a permanent need. Methods To obtain a better understanding of the landscape of approaches, tools and methods used to prioritize health research, I conducted a methodical review using the PubMed database for the period 2001–2014. Results A total of 165 relevant studies were identified, in which health research prioritization was conducted. They most frequently used the CHNRI method (26%), followed by the Delphi method (24%), James Lind Alliance method (8%), the Combined Approach Matrix (CAM) method (2%) and the Essential National Health Research method (<1%). About 3% of studies reported no clear process and provided very little information on how priorities were set. A further 19% used a combination of expert panel interview and focus group discussion (“consultation process”) but provided few details, while a further 2% used approaches that were clearly described, but not established as a replicable method. Online surveys that were not accompanied by face–to–face meetings were used in 8% of studies, while 9% used a combination of literature review and questionnaire to scrutinise the research options for prioritization among the participating experts. Conclusion The number of priority setting exercises in health research published in PubMed–indexed journals is increasing, especially since 2010. These exercises are being conducted at a variety of levels, ranging from the global level to the level of an individual hospital. With the development of new tools and methods which have a well–defined structure – such as the CHNRI method, James Lind Alliance Method and Combined Approach Matrix – it is likely that the Delphi method and non–replicable consultation processes will gradually be replaced by these emerging tools, which offer more transparency and replicability. It is too early to say whether any single method can address the needs of most exercises conducted at different levels, or if better results may perhaps be achieved through combination of components of several methods. PMID:26401271

Approaches, tools and methods used for setting priorities in health research in the 21(st) century.

PubMed

Yoshida, Sachiyo

2016-06-01

Health research is difficult to prioritize, because the number of possible competing ideas for research is large, the outcome of research is inherently uncertain, and the impact of research is difficult to predict and measure. A systematic and transparent process to assist policy makers and research funding agencies in making investment decisions is a permanent need. To obtain a better understanding of the landscape of approaches, tools and methods used to prioritize health research, I conducted a methodical review using the PubMed database for the period 2001-2014. A total of 165 relevant studies were identified, in which health research prioritization was conducted. They most frequently used the CHNRI method (26%), followed by the Delphi method (24%), James Lind Alliance method (8%), the Combined Approach Matrix (CAM) method (2%) and the Essential National Health Research method (<1%). About 3% of studies reported no clear process and provided very little information on how priorities were set. A further 19% used a combination of expert panel interview and focus group discussion ("consultation process") but provided few details, while a further 2% used approaches that were clearly described, but not established as a replicable method. Online surveys that were not accompanied by face-to-face meetings were used in 8% of studies, while 9% used a combination of literature review and questionnaire to scrutinise the research options for prioritization among the participating experts. The number of priority setting exercises in health research published in PubMed-indexed journals is increasing, especially since 2010. These exercises are being conducted at a variety of levels, ranging from the global level to the level of an individual hospital. With the development of new tools and methods which have a well-defined structure - such as the CHNRI method, James Lind Alliance Method and Combined Approach Matrix - it is likely that the Delphi method and non-replicable consultation processes will gradually be replaced by these emerging tools, which offer more transparency and replicability. It is too early to say whether any single method can address the needs of most exercises conducted at different levels, or if better results may perhaps be achieved through combination of components of several methods.

Preliminary identification of key clinical domains for outcome evaluation in fibromyalgia using the Delphi method: the Italian experience.

PubMed

Salaffi, F; Ciapetti, A; Sarzi Puttini, P; Atzeni, F; Iannuccelli, C; Di Franco, M; Cazzola, M; Bazzichi, L

2012-03-19

Fibromyalgia (FM) is a complex syndrome that, in Italy, affects at least 2% of the adult population. It is characterized by chronic widespread musculoskeletal pain often accompanied by multiple other symptoms. The aim of this study was to identify a set of clinical domains for FM considered relevant by both clinicians and patients using a consensus process. Consensus was achieved using the Delphi method based on questionnaires and systematic, controlled opinion feedback. The Delphi exercise involved a panel of 252 rheumatologists and 86 patients with FM as defined by the American College of Rheumatology criteria. All of the patients and clinicians were asked to rank the relative different domains of FM in order of priority. The content validity index (CVI) was used to establish the percentage agreement. The importance of each item was ranked on a 0-3 Likert scale. The frequency, mean relevance scores, and frequency importance product were also calculated. The Delphi exercise showed that the domains ranked highest by patients were similar to those of the clinicians, with the exception of tender point intensity (considered relevant by the clinicians but not by the patients) and environmental sensitivity (considered important by the patients but not by the clinicians). A final 8-item model was developed which was considered to demonstrate adequate validity. The Delphi exercises identified and ranked relevant key clinical domains that need to be assessed in FM research. On the basis of these results, a new patient-reported composite outcome index can be developed and used in clinical trials.

Distributed usability evaluation of the Pennsylvania Cancer Atlas

PubMed Central

Bhowmick, Tanuka; Robinson, Anthony C; Gruver, Adrienne; MacEachren, Alan M; Lengerich, Eugene J

2008-01-01

Background The Pennsylvania Cancer Atlas (PA-CA) is an interactive online atlas to help policy-makers, program managers, and epidemiologists with tasks related to cancer prevention and control. The PA-CA includes maps, graphs, tables, that are dynamically linked to support data exploration and decision-making with spatio-temporal cancer data. Our Atlas development process follows a user-centered design approach. To assess the usability of the initial versions of the PA-CA, we developed and applied a novel strategy for soliciting user feedback through multiple distributed focus groups and surveys. Our process of acquiring user feedback leverages an online web application (e-Delphi). In this paper we describe the PA-CA, detail how we have adapted e-Delphi web application to support usability and utility evaluation of the PA-CA, and present the results of our evaluation. Results We report results from four sets of users. Each group provided structured individual and group assessments of the PA-CA as well as input on the kinds of users and applications for which it is best suited. Overall reactions to the PA-CA are quite positive. Participants did, however, provide a range of useful suggestions. Key suggestions focused on improving interaction functions, enhancing methods of temporal analysis, addressing data issues, and providing additional data displays and help functions. These suggestions were incorporated in each design and implementation iteration for the PA-CA and used to inform a set of web-atlas design principles. Conclusion For the Atlas, we find that a design that utilizes linked map, graph, and table views is understandable to and perceived to be useful by the target audience of cancer prevention and control professionals. However, it is clear that considerable variation in experience using maps and graphics exists and for those with less experience, integrated tutorials and help features are needed. In relation to our usability assessment strategy, we find that our distributed, web-based method for soliciting user input is generally effective. Advantages include the ability to gather information from users distributed in time and space and the relative anonymity of the participants while disadvantages include less control over when and how often participants provide input and challenges for obtaining rich input. PMID:18620565

ISSLS Prize Winner: Consensus on the Clinical Diagnosis of Lumbar Spinal Stenosis: Results of an International Delphi Study.

PubMed

Tomkins-Lane, Christy; Melloh, Markus; Lurie, Jon; Smuck, Matt; Battié, Michele C; Freeman, Brian; Samartzis, Dino; Hu, Richard; Barz, Thomas; Stuber, Kent; Schneider, Michael; Haig, Andrew; Schizas, Constantin; Cheung, Jason Pui Yin; Mannion, Anne F; Staub, Lukas; Comer, Christine; Macedo, Luciana; Ahn, Sang-Ho; Takahashi, Kazuhisa; Sandella, Danielle

2016-08-01

Delphi. The aim of this study was to obtain an expert consensus on which history factors are most important in the clinical diagnosis of lumbar spinal stenosis (LSS). LSS is a poorly defined clinical syndrome. Criteria for defining LSS are needed and should be informed by the experience of expert clinicians. Phase 1 (Delphi Items): 20 members of the International Taskforce on the Diagnosis and Management of LSS confirmed a list of 14 history items. An online survey was developed that permits specialists to express the logical order in which they consider the items, and the level of certainty ascertained from the questions. Phase 2 (Delphi Study) Round 1: Survey distributed to members of the International Society for the Study of the Lumbar Spine. Round 2: Meeting of 9 members of Taskforce where consensus was reached on a final list of 10 items. Round 3: Final survey was distributed internationally. Phase 3: Final Taskforce consensus meeting. A total of 279 clinicians from 29 different countries, with a mean of 19 (±SD: 12) years in practice participated. The six top items were "leg or buttock pain while walking," "flex forward to relieve symptoms," "feel relief when using a shopping cart or bicycle," "motor or sensory disturbance while walking," "normal and symmetric foot pulses," "lower extremity weakness," and "low back pain." Significant change in certainty ceased after six questions at 80% (P < .05). This is the first study to reach an international consensus on the clinical diagnosis of LSS, and suggests that within six questions clinicians are 80% certain of diagnosis. We propose a consensus-based set of "seven history items" that can act as a pragmatic criterion for defining LSS in both clinical and research settings, which in the long term may lead to more cost-effective treatment, improved health care utilization, and enhanced patient outcomes. 2.

Expert validation of a teamwork assessment rubric: A modified Delphi study.

PubMed

Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

2016-01-01

Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with confidence in the university setting. Copyright © 2015 Elsevier Ltd. All rights reserved.

TREatment of ATopic eczema (TREAT) Registry Taskforce: An international Delphi exercise to identify a core set of domains and domain items for national atopic eczema photo- and systemic therapy registries.

PubMed

Gerbens, L A A; Apfelbacher, C J; Irvine, A D; Barbarot, S; de Booij, R J; Boyce, A E; Deleuran, M; Eichenfield, L F; Hof, M H; Middelkamp-Hup, M A; Roberts, A; Schmitt, J; Vestergaard, C; Wall, D; Weidinger, S; Williamson, P R; Flohr, C; Spuls, P I

2018-05-15

Evidence of immunomodulatory therapies to guide clinical management for atopic eczema (AE) is scarce, despite frequent and often off-label use. Patient registries provide valuable evidence for the effects of treatments under real world conditions which can inform treatment guidelines, give the opportunity for health economic evaluation and the evaluation of quality of care, as well as pharmacogenetic and -dynamic research which cannot be adequately addressed in clinical trials. The TREatment of ATopic eczema (TREAT) Registry Taskforce aims to seek international consensus on a core set of domains and items ('what to measure') for AE research registries, using a Delphi approach. Participants from six stakeholder groups were included: doctors, nurses, non-clinical researchers, patients, industry and regulatory body representatives. The eDelphi comprised 3 sequential online rounds, requesting participants to rate the importance of each proposed domain item. Participants could add domain items to the proposed list in round 1. A final consensus meeting was held to ratify the core set. 479 participants from 36 countries accessed the eDelphi platform, of whom 86%, 79% and 74% completed rounds 1, 2, and 3 respectively. At the face-to-face consensus meeting attended by 42 participants the final core set was established containing 19 domains with 69 domain items (49 baseline and 20 follow-up items). This core set of domains and items to be captured by national AE systemic therapy registries will standardise data collection and thereby allow direct comparability across registries and facilitate data pooling between countries. Ultimately, it will provide greater insight into the effectiveness, safety and cost-effectiveness of photo- and systemic immunomodulatory therapies. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Delphi Rating on the Internet

PubMed Central

Deshpande, Aniruddha M.; Shiffman, Richard N.

2003-01-01

We designed an application to allow respondents to rate components of clinical guidelines on the Internet. Twenty-three invited experts completed the rating followed by a satisfaction survey using a 5-level Likert scale. The experts felt that Web data entry was convenient, acceptable and easily accessible. We conclude that Web-based Delphi rating for consensus development is a convenient and acceptable alternative to the traditional paper-based method. PMID:14728333

Summary of Research 1997, Department of Mechanical Engineering.

DTIC Science & Technology

1999-01-01

Maintenance for Diesel Engines 49 Control Architectures and Non-Linear Controllers for Unmanned Underwater Vehicles 38 Creep of Fiber Reinforced Metal...Technology Demonstration (ATD) 50 Development of Delphi Visual Performance Model 25 Diffraction Methods for the Accurate Measurement of Structure Factors...literature. If this could be done, a U.S. version of ORACLE (to be called DELPHI ) could be developed and used. The result has been the development of a

Metadata-driven Delphi rating on the Internet.

PubMed

Deshpande, Aniruddha M; Shiffman, Richard N; Nadkarni, Prakash M

2005-01-01

Paper-based data collection and analysis for consensus development is inefficient and error-prone. Computerized techniques that could improve efficiency, however, have been criticized as costly, inconvenient and difficult to use. We designed and implemented a metadata-driven Web-based Delphi rating and analysis tool, employing the flexible entity-attribute-value schema to create generic, reusable software. The software can be applied to various domains by altering the metadata; the programming code remains intact. This approach greatly reduces the marginal cost of re-using the software. We implemented our software to prepare for the Conference on Guidelines Standardization. Twenty-three invited experts completed the first round of the Delphi rating on the Web. For each participant, the software generated individualized reports that described the median rating and the disagreement index (calculated from the Interpercentile Range Adjusted for Symmetry) as defined by the RAND/UCLA Appropriateness Method. We evaluated the software with a satisfaction survey using a five-level Likert scale. The panelists felt that Web data entry was convenient (median 4, interquartile range [IQR] 4.0-5.0), acceptable (median 4.5, IQR 4.0-5.0) and easily accessible (median 5, IQR 4.0-5.0). We conclude that Web-based Delphi rating for consensus development is a convenient and acceptable alternative to the traditional paper-based method.

Application of Fuzzy Delphi in the Selection of COPD Risk Factors among Steel Industry Workers

PubMed Central

Ismail, Halim; Ismail, Rosnah; Ismail, Noor Hassim

2017-01-01

Background: The Delphi method has been widely applied in many study areas to systematically gather experts’ input on particular topic. Recently, it has become increasingly well known in health related research. This paper applied the Fuzzy Delphi method to enhance the validation of a questionnaire pertaining chronic obstructive pulmonary disease (COPD) risk factors among metal industry workers. Materials and Methods: A detailed, predefined list of possible risk factors for COPD among metal industry workers was created through a comprehensive and exhaustive review of literature from 1995 to 2015. The COPD questionnaire were distributed among people identified as occupational, environmental, and hygiene experts. Linguistic variable using Likert scale was used by the expert to indicate their expert judgment of each item. Subsequently, the linguistic variable was converted into a triangular fuzzy number. The average score of the fuzzy number will be used to determine whether the item will be removed or retained. Results: Ten experts were involved in evaluating 26 items. The experts were in agreement with most of the items, with an average fuzzy number range between 0.429 and 0.800. Two items were removed and three items were added, leaving a total 26 items selected for the COPD risk factors questionnaire. The experts were in disagreement with each other for items F10 and F11 where most of the experts claimed that the question is too subjective and based on self-perception only. Conclusion: The fuzzy Delphi method enhanced the accuracy of the questionnaire pertaining to COPD risk factors, and decreased the length of the established tools. PMID:28638424

Designing Excellence and Quality Model for Training Centers of Primary Health Care: A Delphi Method Study.

PubMed

Tabrizi, Jafar-Sadegh; Farahbakhsh, Mostafa; Shahgoli, Javad; Rahbar, Mohammad Reza; Naghavi-Behzad, Mohammad; Ahadi, Hamid-Reza; Azami-Aghdash, Saber

2015-10-01

Excellence and quality models are comprehensive methods for improving the quality of healthcare. The aim of this study was to design excellence and quality model for training centers of primary health care using Delphi method. In this study, Delphi method was used. First, comprehensive information were collected using literature review. In extracted references, 39 models were identified from 34 countries and related sub-criteria and standards were extracted from 34 models (from primary 39 models). Then primary pattern including 8 criteria, 55 sub-criteria, and 236 standards was developed as a Delphi questionnaire and evaluated in four stages by 9 specialists of health care system in Tabriz and 50 specialists from all around the country. Designed primary model (8 criteria, 55 sub-criteria, and 236 standards) were concluded with 8 criteria, 45 sub-criteria, and 192 standards after 4 stages of evaluations by specialists. Major criteria of the model are leadership, strategic and operational planning, resource management, information analysis, human resources management, process management, costumer results, and functional results, where the top score was assigned as 1000 by specialists. Functional results had the maximum score of 195 whereas planning had the minimum score of 60. Furthermore the most and the least sub-criteria was for leadership with 10 sub-criteria and strategic planning with 3 sub-criteria, respectively. The model that introduced in this research has been designed following 34 reference models of the world. This model could provide a proper frame for managers of health system in improving quality.

Pathological diagnostic criterion of blood and lymphatic vessel invasion in colorectal cancer: a framework for developing an objective pathological diagnostic system using the Delphi method, from the Pathology Working Group of the Japanese Society for Cancer of the Colon and Rectum

PubMed Central

Kojima, Motohiro; Shimazaki, Hideyuki; Iwaya, Keiichi; Kage, Masayoshi; Akiba, Jun; Ohkura, Yasuo; Horiguchi, Shinichiro; Shomori, Kohei; Kushima, Ryoji; Ajioka, Yoichi; Nomura, Shogo; Ochiai, Atsushi

2013-01-01

Aims The goal of this study is to create an objective pathological diagnostic system for blood and lymphatic vessel invasion (BLI). Methods 1450 surgically resected colorectal cancer specimens from eight hospitals were reviewed. Our first step was to compare the current practice of pathology assessment among eight hospitals. Then, H&E stained slides with or without histochemical/immunohistochemical staining were assessed by eight pathologists and concordance of BLI diagnosis was checked. In addition, histological findings associated with BLI having good concordance were reviewed. Based on these results, framework for developing diagnostic criterion was developed, using the Delphi method. The new criterion was evaluated using 40 colorectal cancer specimens. Results Frequency of BLI diagnoses, number of blocks obtained and stained for assessment of BLI varied among eight hospitals. Concordance was low for BLI diagnosis and was not any better when histochemical/immunohistochemical staining was provided. All histological findings associated with BLI from H&E staining were poor in agreement. However, observation of elastica-stained internal elastic membrane covering more than half of the circumference surrounding the tumour cluster as well as the presence of D2-40-stained endothelial cells covering more than half of the circumference surrounding the tumour cluster showed high concordance. Based on this observation, we developed a framework for pathological diagnostic criterion, using the Delphi method. This criterion was found to be useful in improving concordance of BLI diagnosis. Conclusions A framework for pathological diagnostic criterion was developed by reviewing concordance and using the Delphi method. The criterion developed may serve as the basis for creating a standardised procedure for pathological diagnosis. PMID:23592799

Vitamin D Prescribing Practices in Primary Care Pediatrics: Underpinnings From the Health Belief Model and Use of Web-Based Delphi Technique for Instrument Validity.

PubMed

DelGiudice, Nancy J; Street, Nancy; Torchia, Ronald J; Sawyer, Susan S; Bernard, Sylvia Allison; Holick, Michael F

2018-05-24

Vitamin D deficiency and insufficiency is a pandemic problem in children and adolescents in the United States. The problem may be aggravated by the inconsistent implementation of current clinical practice guidelines for vitamin D management by pediatric primary care providers. This study examines the relationship between primary care providers' prescribing vitamin D to children ages 1 through 18 years and their practice actions and knowledge. A descriptive correlation design was used. Participants were recruited from a purposive sample of pediatricians and pediatric nurse practitioners through an online invitation to participate in a survey. Reliability and validity was established for the survey developed by the principal investigator using a web-based Delphi technique. Results from this study indicate that although most providers are aware that vitamin D insufficiency and deficiency are problems, fewer than half currently recommend 600- to 1,000-IU supplementation to their patients ages 1 through 18 years. Copyright © 2018 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Development of a quality instrument for assessing the spontaneous reports of ADR/ADE using Delphi method in China.

PubMed

Chen, Lixun; Jiang, Ling; Shen, Aizong; Wei, Wei

2016-09-01

The frequently low quality of submitted spontaneous reports is of an increasing concern; to our knowledge, no validated instrument exists for assessing case reports' quality comprehensively enough. This work was conducted to develop such a quality instrument for assessing the spontaneous reports of adverse drug reaction (ADR)/adverse drug event (ADE) in China. Initial evaluation indicators were generated using systematic and literature data analysis. Final indicators and their weights were identified using Delphi method. The final quality instrument was developed by adopting the synthetic scoring method. A consensus was reached after four rounds of Delphi survey. The developed quality instrument consisted of 6 first-rank indicators, 18 second-rank indicators, and 115 third-rank indicators, and each rank indicator has been weighted. It evaluates the quality of spontaneous reports of ADR/ADE comprehensively and quantitatively on six parameters: authenticity, duplication, regulatory, completeness, vigilance level, and reporting time frame. The developed instrument was tested with good reliability and validity, which can be used to comprehensively and quantitatively assess the submitted spontaneous reports of ADR/ADE in China.

Study of Methods for Assessing Research Topic Elicitation and pRioritization (SMARTER): Study Protocol to Compare Qualitative Research Methods and Advance Patient Engagement in Research

PubMed Central

Comstock, Bryan

2017-01-01

Background Involving patients as partners in research is a defining characteristic of patient-centered outcomes research (PCOR). While patients’ experiential knowledge of a health condition or treatment may yield research priorities not reflected by researchers and policy makers, the methods for identifying and effectively collaborating with patients are still evolving. Patient registries and crowdsourcing may offer ease of access and convenience to both researchers and patients. Surveys and focus groups, including online modalities, have been described for prioritizing research topics. However, little is known about how these different methods compare in producing consistent priorities and similar perceptions of engagement quality among participants. Objective The aims of this study are (1) to compare how different engagement methods used to elicit patient priorities for research perform as measured by rankings for priorities generated and participant satisfaction; and (2) to determine characteristics of individuals choosing to participate in research prioritization activities. Methods Participants in the Back pain Outcomes using Longitudinal Data (BOLD) patient registry, established to evaluate the natural history of back pain among individuals 65 years and older, and participants on the Amazon Mechanical Turk (MTurk) crowdsourcing platform, to provide input on priorities for research via a questionnaire, are invited. For BOLD participants, we subsequently randomize interested respondents to 1 of 3 interactive prioritization activities to further develop priorities: a Delphi panel, an online crowd voting activity, or an in-person facilitated prioritization activity using nominal group technique (NGT). Participants involved in each activity complete a survey to evaluate the quality of the experience and a subset of these participants discuss their experience further in an interview. Descriptive statistics are used to characterize the rankings produced by each method and compare the top 5 rated topics resulting from each prioritization activity. We use rank-ordered logistic regression models to identify associations of the ranked priority topics with baseline patient characteristics. We analyze responses to the evaluation using a mixed-methods approach wherein we tabulate responses to Likert-scale questions and use content analysis to enumerate themes emerging from interviews for the 3 activities. Results In Phase I, we invite approximately 3000 BOLD participants and 500 Amazon MTurk workers to complete a research topic prioritization survey. Based on these results, we include additional topics into a subsequent prioritization survey. In Phase II, we invite BOLD participants to join 1 of 3 activities: 90 participants for Delphi panel, 100 participants for crowd voting, and 60 participants for focus groups. Of the Phase II participants, 30 will be interviewed to evaluate the activities. Conclusions This study informs decisions about how to conduct outreach to patient registry participants for providing input on research priorities, how individuals 65 years and older wish to participate in engagement activities, and how different research prioritization methods compare in terms of rankings generated and participant satisfaction. PMID:28882810

[The application of Delphi method in improving the score table for the hygienic quantifying and classification of hotels].

PubMed

Wang, Zi-yun; Liu, Yong-quan; Wang, Hong-bo; Zheng, Yang; Wu, Qi; Yang, Xia; Wu, Yong-wei; Zhao, Yi-ming

2009-04-01

By means of Delphi method and expert panel consultations, to choose suitable indicators and improve the score table for classifying the hygienic condition of hotels so that it can be widely used at nationwide. A two-round Delphi consultation was held to choose suitable indicators among 78 experts from 18 provinces, municipalities and autonomous regions. The suitable indicators were selected according to the importance recognized by experts. The average length of service in public health of the experts was (21.08 +/- 5.78) years and the average coefficient of experts' authorities C(r) was 0.89 +/- 0.07. The response rates of the two-round consultation were 98.72% (77/78) and 100.00% (77/77). The average feedback time were (8.49 +/- 4.48) d, (5.86 +/- 2.28) d, and the difference between two rounds was statistically significant (t = 4.60, P < 0.01). Kendall's coefficient were 0.26 (chi(2) = 723.63, P < 0.01), 0.32 (chi(2) = 635.65, P < 0.01) and opinions among experts became consistent. The score table for the hygienic quantifying and classification of hotels was composed of three first-class indicators (hygienic management, hygienic facilities and hygienic practices) and 36 second-class indicators. The weight coefficients of the three first-class indicators were 0.35, 0.34, 0.31. Delphi method might be used in a large-scale consultation among experts and be propitious to improve the score table for the hygienic quantifying and classification.

Habitat suitability index curves for paddlefish, developed by the delphi technique

USGS Publications Warehouse

Crance, John H.

1987-01-01

A Delphi exercise conducted with a panel of 11 experts on paddlefish (Polyodon spathula) and an evaluator resulted in 14 riverine habitat suitability index curves associating various life stages or activities of paddlefish with four variables: velocity, depth, substrate type, and temperature. The panel reached a consensus on six of the curves and eight to 10 panelists agreed on the others. Several panelists reported that they found the Delphi exercise to be a good learning experience, and they believed the technique is an appropriate interim method for developing suitability index curves when available data are inadequate for more conventional statistical analyses. Documentation of good paddlefish spawning habitat was the data need most commonly identified by the panelists.

Engaging stakeholders and target groups in prioritising a public health intervention: the Creating Active School Environments (CASE) online Delphi study

PubMed Central

Morton, Katie L; Atkin, Andrew J; Corder, Kirsten; Suhrcke, Marc; Turner, David; van Sluijs, Esther M F

2017-01-01

Objectives Stakeholder engagement and public involvement are considered as integral to developing effective public health interventions and is encouraged across all phases of the research cycle. However, limited guidelines and appropriate tools exist to facilitate stakeholder engagement—especially during the intervention prioritisation phase. We present the findings of an online ‘Delphi’ study that engaged stakeholders (including young people) in the process of prioritising secondary school environment-focused interventions that aim to increase physical activity. Setting Web-based data collection using an online Delphi tool enabling participation of geographically diverse stakeholders. Participants 37 stakeholders participated, including young people (age 13–16 years), parents, teachers, public health practitioners, academics and commissioners; 33 participants completed both rounds. Primary and secondary outcome measures Participants were asked to prioritise a (short-listed) selection of school environment-focused interventions (eg, standing desks, outdoor design changes) based on the criteria of ‘reach’, ‘equality’, ‘acceptability’, ‘feasibility’, ‘effectiveness’ and ‘cost’. Participants were also asked to rank the criteria and the effectiveness outcomes (eg, physical activity, academic achievement, school enjoyment) from most to least important. Following feedback along with any new information provided, participants completed round 2 4 weeks later. Results The intervention prioritisation process was feasible to conduct and comments from participants indicated satisfaction with the process. Consensus regarding intervention strategies was achieved among the varied groups of stakeholders, with ‘active lessons’ being the favoured approach. Participants ranked ‘mental health and well-being’ as the most important outcome followed by ‘enjoyment of school’. The most important criteria was ‘effectiveness’, followed by ‘feasibility’. Conclusions This novel approach to engaging a wide variety of stakeholders in the research process was feasible to conduct and acceptable to participants. It also provided insightful information relating to how stakeholders prioritise interventions. The approach could be extended beyond the specific project to be a useful tool for researchers and practitioners. PMID:28087549

DIET@NET: Best Practice Guidelines for dietary assessment in health research.

PubMed

Cade, Janet E; Warthon-Medina, Marisol; Albar, Salwa; Alwan, Nisreen A; Ness, Andrew; Roe, Mark; Wark, Petra A; Greathead, Katharine; Burley, Victoria J; Finglas, Paul; Johnson, Laura; Page, Polly; Roberts, Katharine; Steer, Toni; Hooson, Jozef; Greenwood, Darren C; Robinson, Sian

2017-11-15

Dietary assessment is complex, and strategies to select the most appropriate dietary assessment tool (DAT) in epidemiological research are needed. The DIETary Assessment Tool NETwork (DIET@NET) aimed to establish expert consensus on Best Practice Guidelines (BPGs) for dietary assessment using self-report. The BPGs were developed using the Delphi technique. Two Delphi rounds were conducted. A total of 131 experts were invited, and of these 65 accepted, with 48 completing Delphi round I and 51 completing Delphi round II. In all, a total of 57 experts from North America, Europe, Asia and Australia commented on the 47 suggested guidelines. Forty-three guidelines were generated, grouped into the following four stages: Stage I. Define what is to be measured in terms of dietary intake (what? who? and when?); Stage II. Investigate different types of DATs; Stage III. Evaluate existing tools to select the most appropriate DAT by evaluating published validation studies; Stage IV. Think through the implementation of the chosen DAT and consider sources of potential biases. The Delphi technique consolidated expert views on best practice in assessing dietary intake. The BPGs provide a valuable guide for health researchers to choose the most appropriate dietary assessment method for their studies. These guidelines will be accessible through the Nutritools website, www.nutritools.org .

Improving the care of older persons in Australian prisons using the Policy Delphi method.

PubMed

Patterson, Karen; Newman, Claire; Doona, Katherine

2016-09-01

There are currently no internationally recognised and approved processes relating to the care of older persons with dementia in prison. This research aimed to develop tools and procedures related to managing the care of, including the identification and assessment of, older persons with dementia who are imprisoned in New South Wales, Australia. A modified approach to the Policy Delphi method, using both surveys and facilitated discussion groups, enabled experts to come together to discuss improving the quality of care provision for older persons with dementia in prison and achieve research aims. © The Author(s) 2014.

NETS1HD: study protocol for development of a core outcome set for use in determining the overall success of Hirschsprung's disease treatment.

PubMed

Allin, Benjamin; Bradnock, Timothy; Kenny, Simon; Walker, Gregor; Knight, Marian

2016-12-07

Use of core outcome sets in research has been proposed as a method for countering the problems caused by heterogeneity of outcome measure reporting. Heterogeneity of outcome measure reporting occurs in Hirschsprung's disease (HD) research and is limiting the development of a robust evidence base to support clinical practice. Candidate outcome measures have been identified through a systematic review. These outcome measures will form the starting point for a three-phase online Delphi process to be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel; panel 2 is a non-neonatal panel; and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1 to 9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's HD. In round 2, experts will be presented with the same list of outcome measures and graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure, taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels, which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. Results of the Delphi process will be discussed, and outcomes will be re-scored. Outcome measures where >70% of participants at the meeting scored it 7-9 and <15% scored it 1-3 will form the core outcome set. Development of a core outcome set will help to reduce heterogeneity of outcome measure reporting in HD. This will increase the quality of research taking place and ultimately improve care provided to infants with HD.

Development of a core outcome set for effectiveness trials aimed at optimising prescribing in older adults in care homes.

PubMed

Millar, Anna N; Daffu-O'Reilly, Amrit; Hughes, Carmel M; Alldred, David P; Barton, Garry; Bond, Christine M; Desborough, James A; Myint, Phyo K; Holland, Richard; Poland, Fiona M; Wright, David

2017-04-12

Prescribing medicines for older adults in care homes is known to be sub-optimal. Whilst trials testing interventions to optimise prescribing in this setting have been published, heterogeneity in outcome reporting has hindered comparison of interventions, thus limiting evidence synthesis. The aim of this study was to develop a core outcome set (COS), a list of outcomes which should be measured and reported, as a minimum, for all effectiveness trials involving optimising prescribing in care homes. The COS was developed as part of the Care Homes Independent Pharmacist Prescribing Study (CHIPPS). A long-list of outcomes was identified through a review of published literature and stakeholder input. Outcomes were reviewed and refined prior to entering a two-round online Delphi exercise and then distributed via a web link to the CHIPPS Management Team, a multidisciplinary team including pharmacists, doctors and Patient Public Involvement representatives (amongst others), who comprised the Delphi panel. The Delphi panellists (n = 19) rated the importance of outcomes on a 9-point Likert scale from 1 (not important) to 9 (critically important). Consensus for an outcome being included in the COS was defined as ≥70% participants scoring 7-9 and <15% scoring 1-3. Exclusion was defined as ≥70% scoring 1-3 and <15% 7-9. Individual and group scores were fed back to participants alongside the second questionnaire round, which included outcomes for which no consensus had been achieved. A long-list of 63 potential outcomes was identified. Refinement of this long-list of outcomes resulted in 29 outcomes, which were included in the Delphi questionnaire (round 1). Following both rounds of the Delphi exercise, 13 outcomes (organised into seven overarching domains: medication appropriateness, adverse drug events, prescribing errors, falls, quality of life, all-cause mortality and admissions to hospital (and associated costs)) met the criteria for inclusion in the final COS. We have developed a COS for effectiveness trials aimed at optimising prescribing in older adults in care homes using robust methodology. Widespread adoption of this COS will facilitate evidence synthesis between trials. Future work should focus on evaluating appropriate tools for these key outcomes to further reduce heterogeneity in outcome measurement in this context.

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

75 FR 28655 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-21

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture, a.../Electronic Architecture, a subsidiary of Delphi Corporation, including on-site leased [[Page 28656

International consensus statement regarding the use of animal models for research on anastomoses in the lower gastrointestinal tract.

PubMed

Bosmans, Joanna W A M; Moossdorff, Martine; Al-Taher, Mahdi; van Beek, Lotte; Derikx, Joep P M; Bouvy, Nicole D

2016-05-01

This project aimed to reach consensus on the most appropriate animal models and outcome measures in research on anastomoses in the lower gastrointestinal tract (GIT). The physiology of anastomotic healing remains an important research topic in gastrointestinal surgery. Recent results from experimental studies are limited with regard to comparability and clinical translation. PubMed and EMBASE were searched for experimental studies investigating anastomotic healing in the lower GIT published between January 1, 2000 and December 31, 2014 to assess currently used models. All corresponding authors were invited for a Delphi-based analysis that consisted of two online survey rounds followed by a final online recommendation survey to reach consensus on the discussed topics. Two hundred seventy-seven original articles were retrieved and 167 articles were included in the systematic review. Mice, rats, rabbits, pigs, and dogs are currently being used as animal models, with a large variety in surgical techniques and outcome measures. Forty-four corresponding authors participated in the Delphi analysis. In the first two rounds, 39/44 and 35/39 participants completed the survey. In the final meeting, 35 experts reached consensus on 76/122 items in six categories. Mouse, rat, and pig are considered appropriate animal models; rabbit and dog should be abandoned in research regarding bowel anastomoses. ARRIVE guidelines should be followed more strictly. Consensus was reached on several recommendations for the use of animal models and outcome measurements in research on anastomoses of the lower GIT. Future research should take these suggestions into account to facilitate comparison and clinical translation of results.

Standardization of definitions in focal therapy of prostate cancer: report from a Delphi consensus project.

PubMed

Postema, A W; De Reijke, T M; Ukimura, O; Van den Bos, W; Azzouzi, A R; Barret, E; Baumunk, D; Blana, A; Bossi, A; Brausi, M; Coleman, J A; Crouzet, S; Dominguez-Escrig, J; Eggener, S; Ganzer, R; Ghai, S; Gill, I S; Gupta, R T; Henkel, T O; Hohenfellner, M; Jones, J S; Kahmann, F; Kastner, C; Köhrmann, K U; Kovacs, G; Miano, R; van Moorselaar, R J; Mottet, N; Osorio, L; Pieters, B R; Polascik, T J; Rastinehad, A R; Salomon, G; Sanchez-Salas, R; Schostak, M; Sentker, L; Tay, K J; Varkarakis, I M; Villers, A; Walz, J; De la Rosette, J J

2016-10-01

To reach standardized terminology in focal therapy (FT) for prostate cancer (PCa). A four-stage modified Delphi consensus project was undertaken among a panel of international experts in the field of FT for PCa. Data on terminology in FT was collected from the panel by three rounds of online questionnaires. During a face-to-face meeting on June 21, 2015, attended by 38 experts, all data from the online rounds were reviewed and recommendations for definitions were formulated. Consensus was attained on 23 of 27 topics; Targeted FT was defined as a lesion-based treatment strategy, treating all identified significant cancer foci; FT was generically defined as an anatomy-based (zonal) treatment strategy. Treatment failure due to the ablative energy inadequately destroying treated tissue is defined as ablation failure. In targeting failure the energy is not adequately applied to the tumor spatially and selection failure occurs when a patient was wrongfully selected for FT. No definition of biochemical recurrence can be recommended based on the current data. Important definitions for outcome measures are potency (minimum IIEF-5 score of 21), incontinence (new need for pads or leakage) and deterioration in urinary function (increase in IPSS >5 points). No agreement on the best quality of life tool was established, but UCLA-EPIC and EORTC-QLQ-30 were most commonly supported by the experts. A complete overview of statements is presented in the text. Focal therapy is an emerging field of PCa therapeutics. Standardization of definitions helps to create comparable research results and facilitate clear communication in clinical practice.

Priorities for research in child maltreatment, intimate partner violence and resilience to violence exposures: results of an international Delphi consensus development process.

PubMed

Wathen, C Nadine; MacGregor, Jennifer C D; Hammerton, Joanne; Coben, Jeffrey H; Herrman, Helen; Stewart, Donna E; MacMillan, Harriet L

2012-08-21

Intimate partner violence (IPV) and child maltreatment (CM) are major global public health problems. The Preventing Violence Across the Lifespan (PreVAiL) Research Network, an international group of over 60 researchers and national and international knowledge-user partners in CM and IPV, sought to identify evidence-based research priorities in IPV and CM, with a focus on resilience, using a modified Delphi consensus development process. Review of existing empirical evidence, PreVAiL documents and team discussion identified a starting list of 20 priorities in the following categories: resilience to violence exposure (RES), CM, and IPV, as well as priorities that cross-cut the content areas (CC), and others specific to research methodologies (RM) in violence research. PreVAiL members (N = 47) completed two online survey rounds, and one round of discussions via three teleconference calls to rate, rank and refine research priorities. Research priorities were: to examine key elements of promising or successful programmes in RES/CM/IPV to build intervention pilot work; CC: to integrate violence questions into national and international surveys, and RM: to investigate methods for collecting and collating datasets to link data and to conduct pooled, meta and sub-group analyses to identify promising interventions for particular groups. These evidence-based research priorities, developed by an international team of violence, gender and mental health researchers and knowledge-user partners, are of relevance for prevention and resilience-oriented research in the areas of IPV and CM.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology

PubMed Central

Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-01-01

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development. PMID:29282445

Youth injury prevention in Canada: use of the Delphi method to develop recommendations.

PubMed

Pike, Ian; Piedt, Shannon; Davison, Colleen M; Russell, Kelly; Macpherson, Alison K; Pickett, William

2015-12-22

The Health Behaviour in School-aged Children Survey is one of very few cross-national health surveys that includes information on injury occurrence and prevention within adolescent populations. A collaboration to develop a Canadian youth injury report using these data resulted in, Injury among Young Canadians: A national study of contextual determinants. The objective of this study was to develop specific evidence-based, policy-oriented recommendations arising from the national report, using a modified-Delphi process with a panel of expert stakeholders. Eight injury prevention experts and a 3-person youth advisory team associated with a Canadian injury prevention organization (Parachute Canada) reviewed, edited and commented on report recommendations through a three-stage iterative modified-Delphi process. From an initial list of 27 draft recommendations, the modified-Delphi process resulted in a final list of 19 specific recommendations, worded to resonate with the group(s) responsible to lead or take the recommended action. Two recommendations were rated as "extremely important" or "very important" by 100 % of the expert panel, two were deleted, a further two recommendations were deleted but the content included as text in the report, and four were merged with other existing recommendations. The modified-Delphi process was an appropriate method to achieve agreement on 19 specific evidence-based, policy-oriented recommendations to complement the national youth injury report. In providing their input, it is noted that the injury stakeholders each acted as individual experts, unattached to any organizational position or policy. These recommendations will require multidisciplinary collaborations in order to support the proposed policy development, additional research, programming and clear decision-making for youth injury prevention.

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

PubMed

Bank, Ilana; Cheng, Adam; McLeod, Peter; Bhanji, Farhan

2015-11-01

By the end of residency training, pediatric emergency medicine (PEM) residents are expected to have developed the confidence and abilities required to manage acutely ill children. Acquisition of competence requires exposure and/or supplemental formal education for critical and noncritical medical clinical presentations. Simulation can provide experiential learning and can improve trainees' knowledge, skills, and attitudes. The primary objective of this project was to identify the content for a simulation-based national curriculum for PEM training. We recruited participants for the Delphi study by contacting current PEM program directors and immediate past program directors as well as simulation experts at all of the Canadian PEM fellowship sites. We determined the appropriate core content for the Delphi study by combining the PEM core content requirements of the Royal College of Physicians and Surgeons of Canada (RCPSC) and the American Board of Pediatrics (ABP). Using the Delphi method, we achieved consensus amongst the national group of PEM and simulation experts. The participants completed a three-round Delphi (using a four-point Likert scale). Response rates for the Delphi were 85% for the first round and 77% for second and third rounds. From the initial 224 topics, 53 were eliminated (scored <2). Eighty-five topics scored between 2 and 3, and 87 scored between 3 and 4. The 48 topics, which were scored between 3.5 and 4.0, were labeled as "key curriculum topics." We have iteratively identified a consensus for the content of a national simulation-based curriculum.

Practical Considerations for Conducting Delphi Studies: The Oracle Enters a New Age.

ERIC Educational Resources Information Center

Eggers, Renee M.; Jones, Charles M.

1998-01-01

In addition to giving an overview of Delphi methodology and describing the methodology used by the researchers in two Delphi studies, the authors provide information about electronic communication in Delphi studies. Also provided are suggestions that can be used in a Delphi study involving any form of communication. (SLD)

Competency model for dentists in China: Results of a Delphi study

PubMed Central

Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

Objective With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Methods Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Results Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. Conclusion In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China. PMID:29566048

Pathological diagnostic criterion of blood and lymphatic vessel invasion in colorectal cancer: a framework for developing an objective pathological diagnostic system using the Delphi method, from the Pathology Working Group of the Japanese Society for Cancer of the Colon and Rectum.

PubMed

Kojima, Motohiro; Shimazaki, Hideyuki; Iwaya, Keiichi; Kage, Masayoshi; Akiba, Jun; Ohkura, Yasuo; Horiguchi, Shinichiro; Shomori, Kohei; Kushima, Ryoji; Ajioka, Yoichi; Nomura, Shogo; Ochiai, Atsushi

2013-07-01

The goal of this study is to create an objective pathological diagnostic system for blood and lymphatic vessel invasion (BLI). 1450 surgically resected colorectal cancer specimens from eight hospitals were reviewed. Our first step was to compare the current practice of pathology assessment among eight hospitals. Then, H&E stained slides with or without histochemical/immunohistochemical staining were assessed by eight pathologists and concordance of BLI diagnosis was checked. In addition, histological findings associated with BLI having good concordance were reviewed. Based on these results, framework for developing diagnostic criterion was developed, using the Delphi method. The new criterion was evaluated using 40 colorectal cancer specimens. Frequency of BLI diagnoses, number of blocks obtained and stained for assessment of BLI varied among eight hospitals. Concordance was low for BLI diagnosis and was not any better when histochemical/immunohistochemical staining was provided. All histological findings associated with BLI from H&E staining were poor in agreement. However, observation of elastica-stained internal elastic membrane covering more than half of the circumference surrounding the tumour cluster as well as the presence of D2-40-stained endothelial cells covering more than half of the circumference surrounding the tumour cluster showed high concordance. Based on this observation, we developed a framework for pathological diagnostic criterion, using the Delphi method. This criterion was found to be useful in improving concordance of BLI diagnosis. A framework for pathological diagnostic criterion was developed by reviewing concordance and using the Delphi method. The criterion developed may serve as the basis for creating a standardised procedure for pathological diagnosis.

Evaluating methods to establish habitat suitability criteria: A case study in the upper Delaware River Basin, USA

USGS Publications Warehouse

Galbraith, Heather S.; Blakeslee, Carrie J.; Cole, Jeffrey C.; Talbert, Colin; Maloney, Kelly O.

2016-01-01

Defining habitat suitability criteria (HSC) of aquatic biota can be a key component to environmental flow science. HSC can be developed through numerous methods; however, few studies have evaluated the consistency of HSC developed by different methodologies. We directly compared HSC for depth and velocity developed by the Delphi method (expert opinion) and by two primary literature meta-analyses (literature-derived range and interquartile range) to assess whether these independent methods produce analogous criteria for multiple species (rainbow trout, brown trout, American shad, and shallow fast guild) and life stages. We further evaluated how these two independently developed HSC affect calculations of habitat availability under three alternative reservoir management scenarios in the upper Delaware River at a mesohabitat (main channel, stream margins, and flood plain), reach, and basin scale. In general, literature-derived HSC fell within the range of the Delphi HSC, with highest congruence for velocity habitat. Habitat area predicted using the Delphi HSC fell between the habitat area predicted using two literature-derived HSC, both at the basin and the site scale. Predicted habitat increased in shallow regions (stream margins and flood plain) using literature-derived HSC while Delphi-derived HSC predicted increased channel habitat. HSC generally favoured the same reservoir management scenario; however, no favoured reservoir management scenario was the most common outcome when applying the literature range HSC. The differences found in this study lend insight into how different methodologies can shape HSC and their consequences for predicted habitat and water management decisions. Published 2016. This article is a U.S. Government work and is in the public domain in the USA.

A consensus definition of running-related injury in recreational runners: a modified Delphi approach.

PubMed

Yamato, Tiê Parma; Saragiotto, Bruno Tirotti; Lopes, Alexandre Dias

2015-05-01

Delphi study. To reach a consensus definition of running-related injury in recreational runners through a modified Delphi approach. Many studies have suggested the need for a standardized definition of running-related injury to provide uniformity to injury surveillance in running. We invited 112 researchers from running-related injury studies identified in a previous systematic review to classify words and terms frequently used in definitions of running-related injury in an online form during 3 rounds of study. In the last round, participants were asked to approve or disapprove the consensus definition. We considered an agreement level of at least 75% to be a consensus. Thirty-eight participants agreed to participate in the study. The response rates were 94.7% (n = 36) for the first round, 83.3% (n = 30) for the second round, and 86.7% (n = 26) for the third round. A consensus definition of running-related injury was reached, with 80% of participants approving the following: "Running-related (training or competition) musculoskeletal pain in the lower limbs that causes a restriction on or stoppage of running (distance, speed, duration, or training) for at least 7 days or 3 consecutive scheduled training sessions, or that requires the runner to consult a physician or other health professional." The proposed standardized definition of running-related injury could assist in standardizing the definitions used in sport science research and facilitate between-study comparisons. Future studies testing the validity of the proposed consensus definition, as well as its accurate translation to other languages, are also needed.

Clinical practice guidelines for the surgical management of colon cancer: a consensus statement of the Hellenic and Cypriot Colorectal Cancer Study Group by the HeSMO*

PubMed Central

Xynos, Evaghelos; Gouvas, Nikolaos; Triantopoulou, Charina; Tekkis, Paris; Vini, Louiza; Tzardi, Maria; Boukovinas, Ioannis; Androulakis, Nikolaos; Athanasiadis, Athanasios; Christodoulou, Christos; Chrysou, Evangelia; Dervenis, Christos; Emmanouilidis, Christos; Georgiou, Panagiotis; Katopodi, Ourania; Kountourakis, Panteleimon; Makatsoris, Thomas; Papakostas, Pavlos; Papamichael, Demetris; Pentheroudakis, Georgios; Pilpilidis, Ioannis; Sgouros, Joseph; Vassiliou, Vassilios; Xynogalos, Spyridon; Ziras, Nikolaos; Karachaliou, Niki; Zoras, Odysseas; Agalianos, Christos; Souglakos, John

2016-01-01

Despite considerable improvement in the management of colon cancer, there is a great deal of variation in the outcomes among European countries, and in particular among different hospital centers in Greece and Cyprus. Discrepancy in the approach strategies and lack of adherence to guidelines for the management of colon cancer may explain the situation. The aim was to elaborate a consensus on the multidisciplinary management of colon cancer, based on European guidelines (ESMO and EURECCA), and also taking into account local special characteristics of our healthcare system. Following discussion and online communication among members of an executive team, a consensus was developed. Statements entered the Delphi voting system on two rounds to achieve consensus by multidisciplinary international experts. Statements with an agreement rate of ≥80% achieved a large consensus, while those with an agreement rate of 60-80% a moderate consensus. Statements achieving an agreement of <60% after both rounds were rejected and not presented. Sixty statements on the management of colon cancer were subjected to the Delphi methodology. Voting experts were 109. The median rate of abstain per statement was 10% (range: 0-41%). In the end of the voting process, all statements achieved a consensus by more than 80% of the experts. A consensus on the management of colon cancer was developed by applying the Delphi methodology. Guidelines are proposed along with algorithms of diagnosis and treatment. The importance of centralization, care by a multidisciplinary team, and adherence to guidelines is emphasized. PMID:26752945

Delphi Survey of Clinical Nursing and Midwifery Research Priorities in the Eastern Mediterranean Region.

PubMed

Sun, Carolyn; Dohrn, Jennifer; Oweis, Arwa; Huijer, Huda Abu-Saad; Abu-Moghli, Fathieh; Dawani, Hania; Ghazi, Cheherezade; Larson, Elaine

2017-03-01

As the shortage of nurses and midwives is expected to worsen in the Eastern Mediterranean region concomitantly with a growing focus on achievement of universal health coverage, nurses and midwives are expected to fill major gaps in health care. Hence, the need for a solid evidence base for nursing practice and a clear direction for clinical nursing research are paramount. Therefore, a Delphi survey was conducted to determine clinical (research focused on patient outcomes) nursing and midwifery priorities for research within this region. A Delphi survey, using iterative rounds of an online survey of regional clinical nursing and midwifery research experts, was conducted between January and April 2016. Consensus was determined by percentage agreement on level of priority for topics as determined by participants. Additionally, results were compared between countries within the region by income and mortality levels using Kendall's tau. Critical research topics were focused on public/community/primary care as well as emergency preparedness for disasters, and these priorities are well aligned with gaps in the literature for this region. There were statistically significant differences between priority level and country mortality group for geriatrics, self-management of disease, and sexually transmitted infections. Critical research priorities should focus on population-based health topics. Between-country differences should be analyzed further. A clinical research database for the region may help improve research access for nurses and midwives. Practicing nurses and midwives lack extensive evidence (including culturally relevant evidence) on which to practice. Increasing research in areas identified in this survey may improve patient outcomes and quality of care regionally. © 2017 Sigma Theta Tau International.

Developing a clinical pathway for the identification and management of anxiety and depression in adult cancer patients: an online Delphi consensus process.

PubMed

Shaw, Joanne M; Price, Melanie A; Clayton, Josephine M; Grimison, Peter; Shaw, Tim; Rankin, Nicole; Butow, Phyllis N

2016-01-01

People with cancer and their families experience high levels of psychological morbidity. However, many cancer services do not routinely screen patients for anxiety and depression, and there are no standardized clinical referral pathways. This study aimed to establish consensus on elements of a draft clinical pathway tailored to the Australian context. A two-round Delphi study was conducted to gain consensus among Australian oncology and psycho-oncology clinicians about the validity of 39 items that form the basis of a clinical pathway that includes screening, assessment, referral and stepped care management of anxiety and depression in the context of cancer. The expert panel comprised 87 multidisciplinary clinician members of the Australian Psycho-oncology Co-operative Research Group (PoCoG). Respondents rated their level of agreement with each statement on a 5-point Likert scale. Consensus was defined as >80% of respondents scoring within 2 points on the Likert scale. Consensus was reached for 21 of 39 items, and a further 15 items approached consensus except for specific contextual factors, after two Delphi rounds. Formal screening for anxiety and depression, a stepped care model of management and recommendations for inclusion of length of treatment and time to review were endorsed. Consensus was not reached on items related to roles and responsibilities, particularly those not applicable across cancer settings. This study identified a core set of evidence- and consensus-based principles considered essential to a stepped care model of care incorporating identification, referral and management of anxiety and depression in adult cancer patients.

Using the modified Delphi method to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy.

PubMed

Zang, Lei; Fan, Ning; Hai, Yong; Lu, S B; Su, Q J; Yang, J C; Du, Peng; Gao, Y J

2015-06-01

Although cervical radiculopathy is very common, there is no standard treatment for this condition, with little high-level evidence available to guide the treatment choice. Thus, this study aimed to review the current data on the management of cervical radiculopathy; and, further, to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy using the Delphi method. First, a systematic review of the previously established treatment guidelines and of articles related to cervical radiculopathy was conducted to establish a protocol for the clinical consensus of the treatment for cervical radiculopathy. Second, from February 2012 to June 2014, we performed a modified Delphi survey in which the current professional opinions from 30 experienced experts, representing almost all of the Chinese provinces, were gathered. Three rounds were performed, and consensus was defined as ≥70% agreement. Consensus of the treatments for cervical radiculopathy was reached on seven aspects, including the proportion of patients requiring only non-surgical therapies; the effectiveness of neck immobilization, physiotherapy, pharmacologic treatment; surgical indications; contraindications; surgery. The modified Delphi study conducted herein reached a consensus concerning several treatment issues for cervical radiculopathy. In the absence of high-level evidence, at present, these expert opinion findings will help guide health care providers to define the appropriate treatment in their regions. Items with no consensus provide excellent areas for future research.

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study

PubMed Central

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-01

Objectives To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Setting Hospitals and community health centres in Taiwan. Method A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. Participants 15 Chinese healthcare practitioners with more than 6 months’ experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Results Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. Conclusions The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. PMID:28093428

Application of Fuzzy Delphi in the Selection of COPD Risk Factors among Steel Industry Workers.

PubMed

Dapari, Rahmat; Ismail, Halim; Ismail, Rosnah; Ismail, Noor Hassim

2017-01-01

The Delphi method has been widely applied in many study areas to systematically gather experts' input on particular topic. Recently, it has become increasingly well known in health related research. This paper applied the Fuzzy Delphi method to enhance the validation of a questionnaire pertaining chronic obstructive pulmonary disease (COPD) risk factors among metal industry workers. A detailed, predefined list of possible risk factors for COPD among metal industry workers was created through a comprehensive and exhaustive review of literature from 1995 to 2015. The COPD questionnaire were distributed among people identified as occupational, environmental, and hygiene experts. Linguistic variable using Likert scale was used by the expert to indicate their expert judgment of each item. Subsequently, the linguistic variable was converted into a triangular fuzzy number. The average score of the fuzzy number will be used to determine whether the item will be removed or retained. Ten experts were involved in evaluating 26 items. The experts were in agreement with most of the items, with an average fuzzy number range between 0.429 and 0.800. Two items were removed and three items were added, leaving a total 26 items selected for the COPD risk factors questionnaire. The experts were in disagreement with each other for items F10 and F11 where most of the experts claimed that the question is too subjective and based on self-perception only. The fuzzy Delphi method enhanced the accuracy of the questionnaire pertaining to COPD risk factors, and decreased the length of the established tools.

A checklist to assess the quality of reports on spa therapy and balneotherapy trials was developed using the Delphi consensus method: the SPAC checklist.

PubMed

Kamioka, Hiroharu; Kawamura, Yoichi; Tsutani, Kiichiro; Maeda, Masaharu; Hayasaka, Shinya; Okuizum, Hiroyasu; Okada, Shinpei; Honda, Takuya; Iijima, Yuichi

2013-08-01

The purpose of this study was to develop a checklist of items that describes and measures the quality of reports of interventional trials assessing spa therapy. The Delphi consensus method was used to select the number of items in the checklist. A total of eight individuals participated, including an epidemiologist, a clinical research methodologist, clinical researchers, a medical journalist, and a health fitness programmer. Participants ranked on a 9-point Likert scale whether an item should be included in the checklist. Three rounds of the Delphi method were conducted to achieve consensus. The final checklist contained 19 items, with items related to title, place of implementation (specificity of spa), care provider influence, and additional measures to minimize the potential bias from withdrawals, loss to follow-up, and low treatment adherence. This checklist is simple and quick to complete, and should help clinicians and researchers critically appraise the medical and healthcare literature, reviewers assess the quality of reports included in systematic reviews, and researchers plan interventional trials of spa therapy. Copyright © 2013 Elsevier Ltd. All rights reserved.

Ontology Development for Patient Education Documents Using a Professional- and Patient-Oriented Delphi Method.

PubMed

Heimonen, Juho; Danielsson-Ojala, Riitta; Salakoski, Tapio; Lundgrén-Laine, Heljä; Salanterä, Sanna

2018-04-12

Written patient education materials are essential to motivate and help patients to participate in their own care, but the production and management of a large collection of high-quality and easily accessible patient education documents can be challenging. Ontologies can aid in these tasks, but the existing resources are not directly applicable to patient education. An ontology that models patient education documents and their readers was constructed. The Delphi method was used to identify a compact but sufficient set of entities with which the topics of documents may be described. The preferred terms of the entities were also considered to ensure their understandability. In the ontology, readers may be characterized by gender, age group, language, and role (patient or professional), whereas documents may be characterized by audience, topic(s), and content, as well as the time and place of use. The Delphi method yielded 265 unique document topics that are organized into seven hierarchies. Advantages and disadvantages of the ontology design, as well as possibilities for improvements, were identified. The patient education material ontology can enhance many applications, but further development is needed to reach its full potential.

Malaria chemoprophylaxis recommendations for immigrants to Europe, visiting relatives and friends - a Delphi method study

PubMed Central

2011-01-01

Background Numbers of travellers visiting friends and relatives (VFRs) from Europe to malaria endemic countries are increasing and include long-term and second generation immigrants, who represent the major burden of malaria cases imported back into Europe. Most recommendations for malaria chemoprophylaxis lack a solid evidence base, and often fail to address the cultural, social and economic needs of VFRs. Methods European travel medicine experts, who are members of TropNetEurop, completed a sequential series of questionnaires according to the Delphi method. This technique aims at evaluating and developing a consensus through repeated iterations of questionnaires. The questionnaires in this study included questions about professional experience with VFRs, controversial issues in malaria prophylaxis, and 16 scenarios exploring indications for prescribing and choice of chemoprophylaxis. Results The experience of participants was rather diverse as was their selection of chemoprophylaxis regimen. A significant consensus was observed in only seven of 16 scenarios. The analysis revealed a wide variation in prescribing choices with preferences grouped by region of practice and increased prescribing seen in Northern Europe compared to Central Europe. Conclusions Improving the evidence base on efficacy, adherence to chemoprophylaxis and risk of malaria and encouraging discussion among experts, using techniques such as the Delphi method, may reduce the variability in prescription in European travel clinics. PMID:21599909

Gaining consensus on family carer needs when caring for someone dying at home to develop the Carers' Alert Thermometer (CAT): a modified Delphi study.

PubMed

Knighting, Katherine; O'Brien, Mary R; Roe, Brenda; Gandy, Rob; Lloyd-Williams, Mari; Nolan, Mike; Jack, Barbara A

2016-01-01

To report a multi-phase modified Delphi study conducted with carers and professionals to identify the priority areas for inclusion in an alert screening tool for carers providing support to someone dying at home. Internationally, there is a growing emphasis on increasing choice for patients who wish to die at home which relies heavily on care provided by the unpaid family carers. Family carers can have high levels of unmet needs comprising their psychological and physical health and their ability to provide effective care and support. Development of an alert tool to identify carers' needs in everyday practice required identification and consensus of the priority areas of need for inclusion. Multi-phase modified Delphi study and instrument development. Qualitative and quantitative data collection took place between 2011-2013 with 111 carers and 93 professionals to identify carers' needs and gain consensus on the priority areas for inclusion in the alert tool. An expert panel stage and final evidence review post-Delphi were used. The Delphi panels had high levels of agreement and consensus. Ten areas of carer need across two themes of 'the current caring situation' and 'the carer's own health and well-being' were prioritized for inclusion in the alert tool. An optional end-of-life planning question was included following the final stages. The results provide evidence of carers' needs to be assessed, areas for consideration in the education of those who support carers and someone dying at home and targeting of services, while demonstrating the usefulness and adaptability of the Delphi method. © 2015 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Verification of a quality management theory: using a delphi study.

PubMed

Mosadeghrad, Ali Mohammad

2013-11-01

A model of quality management called Strategic Collaborative Quality Management (SCQM) model was developed based on the quality management literature review, the findings of a survey on quality management assessment in healthcare organisations, semi-structured interviews with healthcare stakeholders, and a Delphi study on healthcare quality management experts. The purpose of this study was to verify the SCQM model. The proposed model was further developed using feedback from thirty quality management experts using a Delphi method. Further, a guidebook for its implementation was prepared including a road map and performance measurement. The research led to the development of a context-specific model of quality management for healthcare organisations and a series of guidelines for its implementation. A proper model of quality management should be developed and implemented properly in healthcare organisations to achieve business excellence.

A cross-validation Delphi method approach to the diagnosis and treatment of personality disorders in older adults.

PubMed

Rosowsky, Erlene; Young, Alexander S; Malloy, Mary C; van Alphen, S P J; Ellison, James M

2018-03-01

The Delphi method is a consensus-building technique using expert opinion to formulate a shared framework for understanding a topic with limited empirical support. This cross-validation study replicates one completed in the Netherlands and Belgium, and explores US experts' views on the diagnosis and treatment of older adults with personality disorders (PD). Twenty-one geriatric PD experts participated in a Delphi survey addressing diagnosis and treatment of older adults with PD. The European survey was translated and administered electronically. First-round consensus was reached for 16 out of 18 items relevant to diagnosis and specific mental health programs for personality disorders in older adults. Experts agreed on the usefulness of establishing criteria for specific types of treatments. The majority of psychologists did not initially agree on the usefulness of pharmacotherapy. Expert consensus was reached following two subsequent rounds after clarification addressing medication use. Study results suggest consensus among regarding psychosocial treatments. Limited acceptance amongst US psychologists about the suitability of pharmacotherapy for late-life PDs contrasted with the views expressed by experts surveyed in Netherlands and Belgium studies.

Nursing Information Systems Requirements: A Milestone for Patient Outcome and Patient Safety Improvement.

PubMed

Farzandipour, Mehrdad; Meidani, Zahra; Riazi, Hossein; Sadeqi Jabali, Monireh

2016-12-01

Considering the integral role of understanding users' requirements in information system success, this research aimed to determine functional requirements of nursing information systems through a national survey. Delphi technique method was applied to conduct this study through three phases: focus group method modified Delphi technique and classic Delphi technique. A cross-sectional study was conducted to evaluate the proposed requirements within 15 general hospitals in Iran. Forty-three of 76 approved requirements were clinical, and 33 were administrative ones. Nurses' mean agreements for clinical requirements were higher than those of administrative requirements; minimum and maximum means of clinical requirements were 3.3 and 3.88, respectively. Minimum and maximum means of administrative requirements were 3.1 and 3.47, respectively. Research findings indicated that those information system requirements that support nurses in doing tasks including direct care, medicine prescription, patient treatment management, and patient safety have been the target of special attention. As nurses' requirements deal directly with patient outcome and patient safety, nursing information systems requirements should not only address automation but also nurses' tasks and work processes based on work analysis.

Internet-Based Delphi Research: Case Based Discussion

PubMed Central

Donohoe, Holly M.; Stellefson, Michael L.

2013-01-01

The interactive capacity of the Internet offers benefits that are intimately linked with contemporary research innovation in the natural resource and environmental studies domains. However, e-research methodologies, such as the e-Delphi technique, have yet to undergo critical review. This study advances methodological discourse on the e-Delphi technique by critically assessing an e-Delphi case study. The analysis suggests that the benefits of using e-Delphi are noteworthy but the authors acknowledge that researchers are likely to face challenges that could potentially compromise research validity and reliability. To ensure that these issues are sufficiently considered when planning and designing an e-Delphi, important facets of the technique are discussed and recommendations are offered to help the environmental researcher avoid potential pitfalls associated with coordinating e-Delphi research. PMID:23288149

Promising behavior change techniques in a multicomponent intervention to reduce concerns about falls in old age: a Delphi study.

PubMed

Vestjens, Lotte; Kempen, Gertrudis I J M; Crutzen, Rik; Kok, Gerjo; Zijlstra, G A Rixt

2015-04-01

Complex behavior change interventions need evidence regarding the effectiveness of individual components to understand how these interventions work. The objective of this study was to identify the least and most promising behavior change techniques (BCTs) within the Dutch intervention 'A Matter of Balance' (AMB-NL) aimed at concerns about falls in old age as an example. After the identification of 27 BCTs within AMB-NL, an online two-round Delphi survey among 16 international experts was conducted to reach consensus on the least and most promising BCTs. The level of consensus and the level of importance of BCTs were determined. In total, 23 of the 27 (>85%) BCTs identified reached consensus. Most promising BCTs were goal setting (behavior), graded tasks and behavioral practice/rehearsal. Information about health consequences, salience of consequences and information about emotional consequences were considered least promising. These outcomes provide a first but important step in the evidence building process regarding the effectiveness of BCTs in a complex intervention. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.

The Importance of Integration of Stakeholder Views in Core Outcome Set Development: Otitis Media with Effusion in Children with Cleft Palate

PubMed Central

Harman, Nicola L.; Bruce, Iain A.; Kirkham, Jamie J.; Tierney, Stephanie; Callery, Peter; O'Brien, Kevin; Williamson, Paula R.

2015-01-01

Background Approximately 75% of children with cleft palate (CP) have Otitis Media with Effusion (OME) histories. Evidence for the effective management of OME in these children is lacking. The inconsistency in outcome measurement in previous studies has led to a call for the development of a Core Outcome Set (COS). Despite the increase in the number of published COS, involvement of patients in the COS development process, and methods to integrate the views of patients and health professionals, to date have been limited. Methods and Findings A list of outcomes measured in previous research was identified through reviewing the literature. Opinion on the importance of each of these outcomes was then sought from key stakeholders: Ear, Nose and Throat (ENT) surgeons, audiologists, cleft surgeons, speech and language therapists, specialist cleft nurses, psychologists, parents and children. The opinion of health professionals was sought in a three round Delphi survey where participants were asked to score each outcome using a bespoke online system. Parents and children were also asked to score outcomes in a survey and provided an in-depth insight into having OME through semi-structured interviews. The results of the Delphi survey, interviews and parent/patient survey were brought together in a final consensus meeting with representation from all stakeholders. A final set of eleven outcomes reached the definition of “consensus in” to form the recommended COS: hearing; chronic otitis media (COM); OME; receptive language skills; speech development; psycho social development; acute otitis media (AOM); cholesteatoma; side effects of treatment; listening skills; otalgia. Conclusions We have produced a recommendation about the outcomes that should be measured, as a minimum, in studies of the management of OME in children with CP. The development process included input from key stakeholders and used novel methodology to integrate the opinion of healthcare professionals, parents and children. PMID:26115172

Consensus on Exercise Reporting Template (CERT): Explanation and Elaboration Statement.

PubMed

Slade, Susan C; Dionne, Clermont E; Underwood, Martin; Buchbinder, Rachelle

2016-10-05

Exercise is effective for prevention and management of acute and chronic health conditions. However, trial descriptions of exercise interventions are often suboptimal, leaving readers unclear about the content of effective programmes. To address this, the 16-item internationally endorsed Consensus on Exercise Reporting Template (CERT) was developed. The aim is to present the final template and provide an Explanation and Elaboration Statement to operationalise the CERT. Development of the CERT was based on the EQUATOR Network methodological framework for developing reporting guidelines. We used a modified Delphi technique to gain consensus of international exercise experts and conducted 3 sequential rounds of anonymous online questionnaires and a Delphi workshop. The 16-item CERT is the minimum data set considered necessary to report exercise interventions. The contents may be included in online supplementary material, published as a protocol or located on websites and other electronic repositories. The Explanation and Elaboration Statement is intended to enhance the use, understanding and dissemination of the CERT and presents the meaning and rationale for each item, together with examples of good reporting. The CERT is designed specifically for the reporting of exercise programmes across all evaluative study designs for exercise research. The CERT can be used by authors to structure intervention reports, by reviewers and editors to assess completeness of exercise descriptions and by readers to facilitate the use of the published information. The CERT has the potential to increase clinical uptake of effective exercise programmes, enable research replication, reduce research waste and improve patient outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Acne severity grading: determining essential clinical components and features using a Delphi consensus.

PubMed

Tan, Jerry; Wolfe, Barat; Weiss, Jonathan; Stein-Gold, Linda; Bikowski, Joseph; Del Rosso, James; Webster, Guy F; Lucky, Anne; Thiboutot, Diane; Wilkin, Jonathan; Leyden, James; Chren, Mary-Margaret

2012-08-01

There are multiple global scales for acne severity grading but no singular standard. Our objective was to determine the essential clinical components (content items) and features (property-related items) for an acne global grading scale for use in research and clinical practice using an iterative method, the Delphi process. Ten acne experts were invited to participate in a Web-based Delphi survey comprising 3 iterative rounds of questions. In round 1, the experts identified the following clinical components (primary acne lesions, number of lesions, extent, regional involvement, secondary lesions, and patient experiences) and features (clinimetric properties, ease of use, categorization of severity based on photographs or text, and acceptance by all stakeholders). In round 2, consensus for inclusion in the scale was established for primary lesions, number, sites, and extent; as well as clinimetric properties and ease of use. In round 3, consensus for inclusion was further established for categorization and acceptance. Patient experiences were excluded and no consensus was achieved for secondary lesions. The Delphi panel consisted solely of the United States (U.S.)-based acne experts. Using an established method for achieving consensus, experts in acne vulgaris concluded that an ideal acne global grading scale would comprise the essential clinical components of primary acne lesions, their quantity, extent, and facial and extrafacial sites of involvement; with features of clinimetric properties, categorization, efficiency, and acceptance. Copyright © 2011 American Academy of Dermatology, Inc. Published by Mosby, Inc. All rights reserved.

Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

PubMed

Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

2014-06-25

The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our study. Based upon this consultation process, a guideline will be developed on instrument selection for outcomes to be included in a COS.

Nature-based care opportunities and barriers in oncology contexts: a modified international e-Delphi survey.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-10-16

To develop recommendations regarding opportunities and barriers for nature-based care in oncology contexts using a structured knowledge generation process involving relevant healthcare and design experts. Four-round modified electronic Delphi study. Oncology patients' nature-based recommendations, uncovered in preceding qualitative investigation, were included in the first round for the expert participants' consideration. Key items (opportunities and barriers) were developed using data aggregation and synthesis, followed by item prioritisation and 10-point Likert scale ranking (1=not important, 10=very important). Descriptive statistics were calculated to assess items of highest importance representing expert recommendations. Online Delphi process constituting an electronic international survey. A purposive sample of 200 potential panellists (recruitment target n=40) comprising healthcare practitioners, managers, designers, architects and researchers were invited to participate; experts were identified via research networks, snowballing and systematic literature review. 38 experts across seven countries (Australia, USA, UK, New Zealand, Canada, Denmark and Sweden) returned questionnaire 1, which determined consent and acceptance for participation. Initial response rate was 19%, and subsequent response rates were 84%, 82% and 84% for rounds 2, 3 and 4, respectively. The Delphi panel developed recommendations consisting of 10 opportunities and 10 barriers. The following opportunities were rated to be of highest importance: window views from clinical areas onto nature; outdoor settings, gardens and courtyards with easy and effortless access; and nature-based physical exercise adapted to patient requirements. Highest-rated barriers for nature-based oncology care included lack of knowledge and awareness about benefits of nature engagement and inaccessibility, not considering access requirements for the very sick and frail. Experts suggested and agreed on a set of recommendations, which represent critical considerations for the safe adoption of nature-based oncology opportunities. These findings fill a gap in understanding about helpful nature-based oncology care and may translate into oncology design and innovation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Linking NHS data for pediatric pharmacovigilance: Results of a Delphi survey.

PubMed

Hopf, Y M; Francis, J; Helms, P J; Haughney, J; Bond, C

2016-01-01

Adverse drug events are a major cause of patient safety incidents. Current systems of pharmacovigilance under-report adverse drug reactions (ADRs), especially in children, leading to delays in their identification. This is of particular concern, as children especially have an increased vulnerability to ADRs. The objective was to seek consensus among healthcare professionals (HCPs) about barriers and facilitators to the linkage of routinely collected health data for pediatric pharmacovigilance in Scotland. A Delphi survey was conducted with a random sample of HCPs including nurses, pharmacists and doctors, working in primary or secondary care, in Scotland. Participants were identified from sampling frames of the target professionals such as an NHS workforce list for general practitioners and recruited by postal invitation. A total of 819 HCPs were invited to take part. Those agreeing to participate were given the option of completing the questionnaires online or as hard copy. Reminders were sent twice at a fortnightly interval. Questions content included description of professional role as well as testing for the willingness to support the proposed project and was informed by the Theoretical Domains Framework of Behavior Change (TDF) and earlier qualitative work. Three Delphi rounds were administered, including a first round for item generation. 121 of those invited agreed to take part (15%). The first round of the Delphi study included 21 open questions and generated over a 1000 individual statements from 61 participants that returned the questionnaires (50.4%). These were rationalized to 149 items for the second round in which participants rated their views on the importance (or not) of each item on a 9-point Likert scale (strongly disagree - strongly agree). After the third round, there was consensus on items that focused on professional standards, and practical requirements, overall there was support for data linkage and a multi-professional approach. It would be acceptable to stakeholders to introduce a data linkage system for pharmacovigilance as long as identified concerns are addressed. Concerns included adherence to current professional, legal and ethical standards, as well resolving practical issues. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol.

PubMed

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-02-10

Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues-including conceptualisation, measurement and data analysis-that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Competency model for dentists in China: Results of a Delphi study.

PubMed

Geng, Yunxia; Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China.

[Evaluation of the standard application of Delphi in the diagnosis of chronic obstructive pulmonary disease caused by occupational irritant chemicals].

PubMed

Zhao, L; Yan, Y J

2017-11-20

Objective: To investigate the problems encountered in the application of the standard (hereinafter referred to as standard) for the diagnosis of chronic obstructive pulmonary disease caused by occu-pational irritant chemicals, to provide reference for the revision of the new standard, to reduce the number of missed patients in occupational COPD, and to get rid of the working environment of those who suffer from chronic respiratory diseases due to long-term exposure to poisons., slowing the progression of the disease. Methods: Using Delphi (Delphi) Expert research method, after the senior experts to demonstrate, to under-stand the GBZ 237-2011 "occupational irritant chemicals to the diagnosis of chronic obstructive pulmonary dis-ease" standard evaluation of the system encountered problems, to seek expert advice, The problems encoun-tered during the clinical implementation of the standards promulgated in 2011 are presented. Results: Through the Delphi Expert investigation method, it is found that experts agree on the content evaluation and implemen-tation evaluation in the standard, but the operational evaluation of the standard is disputed. According to the clinical experience, the experts believe that the range of occupational irritant gases should be expanded, and the operation of the problem of smoking, seniority determination and occupational contact history should be challenged during the diagnosis. Conclusions: Since the promulgation in 2011 of the criteria for the diagnosis of chronic obstructive pulmonary disease caused by occupational stimulant chemicals, there have been some problems in the implementation process, which have caused many occupationally exposed to irritating gases to suffer from "occupational chronic respiratory Diseases" without a definitive diagnosis.

Research priorities in medical education at Shiraz University of Medical Sciences:categories and subcategories in the Iranian context

PubMed Central

NABEIEI, PARISA; AMINI, MITRA; GHANAVATI, SHIRIN; MARHAMATI, SAADAT

2016-01-01

Introduction Research in education is a globally significant issue without a long history. Due to the importance of the issue in Health System Development programs, this study intended to determine research priorities in medical education, considering their details and functions. By determining barriers existing in research in education progress, it is tried to make research priorities more functional by recommending acceptable strategies. Methods This is a qualitative-descriptive study in two descriptive phases. The goal of these phases was to determine research priorities subcategories in medical education by Nominal Group Technique (NGT) and two rounds of Delphi method. Through the first phase, subcategories of research priorities were determined, using Nominal Group Technique under medical education experts’ supervision. Through two rounds of Delphi, a questionnaire was constructed based on the subcategories. Eventually, research priorities were determined based on their highest score (scores more than 7 out of 10). Results In the first phase (NGT), 35 priorities in 5 major fields of medical education were presented. In the second phase, priorities were scored, using Delphi method. Medical Ethics and professionalism gained the highest scores (7.63±1.26) and educational evaluation the lowest (7.28±1.52). In this stage, 7 items were omitted but 2 of them were added again after experts’ revision in the third round of Delphi. Conclusion According to the results of the present study and based on previous studies, it really seems that the fields of “Learning and Teaching Approaches” and “Medical Ethics and Professionalism” were more important. Because of financial and resource limitations in our country and the importance of research priorities, it is recommended to frequently study “research priorities determination program” at universities. PMID:26793723

Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature.

PubMed

Moreira, Danilo Gomes; Costello, Joseph T; Brito, Ciro J; Adamczyk, Jakub G; Ammer, Kurt; Bach, Aaron J E; Costa, Carlos M A; Eglin, Clare; Fernandes, Alex A; Fernández-Cuevas, Ismael; Ferreira, José J A; Formenti, Damiano; Fournet, Damien; Havenith, George; Howell, Kevin; Jung, Anna; Kenny, Glen P; Kolosovas-Machuca, Eleazar S; Maley, Matthew J; Merla, Arcangelo; Pascoe, David D; Priego Quesada, Jose I; Schwartz, Robert G; Seixas, Adérito R D; Selfe, James; Vainer, Boris G; Sillero-Quintana, Manuel

2017-10-01

The importance of using infrared thermography (IRT) to assess skin temperature (t sk ) is increasing in clinical settings. Recently, its use has been increasing in sports and exercise medicine; however, no consensus guideline exists to address the methods for collecting data in such situations. The aim of this study was to develop a checklist for the collection of t sk using IRT in sports and exercise medicine. We carried out a Delphi study to set a checklist based on consensus agreement from leading experts in the field. Panelists (n = 24) representing the areas of sport science (n = 8; 33%), physiology (n = 7; 29%), physiotherapy (n = 3; 13%) and medicine (n = 6; 25%), from 13 different countries completed the Delphi process. An initial list of 16 points was proposed which was rated and commented on by panelists in three rounds of anonymous surveys following a standard Delphi procedure. The panel reached consensus on 15 items which encompassed the participants' demographic information, camera/room or environment setup and recording/analysis of t sk using IRT. The results of the Delphi produced the checklist entitled "Thermographic Imaging in Sports and Exercise Medicine (TISEM)" which is a proposal to standardize the collection and analysis of t sk data using IRT. It is intended that the TISEM can also be applied to evaluate bias in thermographic studies and to guide practitioners in the use of this technique. Copyright © 2017 Elsevier Ltd. All rights reserved.

BOB CAT: A Large-Scale Review and Delphi Consensus for Management of Barrett’s Esophagus With No Dysplasia, Indefinite for, or Low-Grade Dysplasia

PubMed Central

Bennett, Cathy; Moayyedi, Paul; Corley, Douglas A.; DeCaestecker, John; Falck-Ytter, Yngve; Falk, Gary; Vakil, Nimish; Sanders, Scott; Vieth, Michael; Inadomi, John; Aldulaimi, David; Ho, Khek-Yu; Odze, Robert; Meltzer, Stephen J.; Quigley, Eamonn; Gittens, Stuart; Watson, Peter; Zaninotto, Giovanni; Iyer, Prasad G.; Alexandre, Leo; Ang, Yeng; Callaghan, James; Harrison, Rebecca; Singh, Rajvinder; Bhandari, Pradeep; Bisschops, Raf; Geramizadeh, Bita; Kaye, Philip; Krishnadath, Sheila; Fennerty, M. Brian; Manner, Hendrik; Nason, Katie S.; Pech, Oliver; Konda, Vani; Ragunath, Krish; Rahman, Imdadur; Romero, Yvonne; Sampliner, Richard; Siersema, Peter D.; Tack, Jan; Tham, Tony C.K.; Trudgill, Nigel; Weinberg, David S.; Wang, Jean; Wang, Kenneth; Wong, Jennie Y.Y.; Attwood, Stephen; Malfertheiner, Peter; MacDonald, David; Barr, Hugh; Ferguson, Mark K.; Jankowski, Janusz

2015-01-01

OBJECTIVES Barrett’s esophagus (BE) is a common premalignant lesion for which surveillance is recommended. This strategy is limited by considerable variations in clinical practice. We conducted an international, multidisciplinary, systematic search and evidence-based review of BE and provided consensus recommendations for clinical use in patients with nondysplastic, indefinite, and low-grade dysplasia (LGD). METHODS We defined the scope, proposed statements, and searched electronic databases, yielding 20,558 publications that were screened, selected online, and formed the evidence base. We used a Delphi consensus process, with an 80% agreement threshold, using GRADE (Grading of Recommendations Assessment, Development and Evaluation) to categorize the quality of evidence and strength of recommendations. RESULTS In total, 80% of respondents agreed with 55 of 127 statements in the final voting rounds. Population endoscopic screening is not recommended and screening should target only very high-risk cases of males aged over 60 years with chronic uncontrolled reflux. A new international definition of BE was agreed upon. For any degree of dysplasia, at least two specialist gastrointestinal (GI) pathologists are required. Risk factors for cancer include male gender, length of BE, and central obesity. Endoscopic resection should be used for visible, nodular areas. Surveillance is not recommended for <5 years of life expectancy. Management strategies for indefinite dysplasia (IND) and LGD were identified, including a de-escalation strategy for lower-risk patients and escalation to intervention with follow-up for higher-risk patients. CONCLUSIONS In this uniquely large consensus process in gastroenterology, we made key clinical recommendations for the escalation/de-escalation of BE in clinical practice. We made strong recommendations for the prioritization of future research. PMID:25869390

A multi-disciplinary consensus statement concerning surgical approaches to low-grade, high-grade astrocytomas and diffuse intrinsic pontine gliomas in childhood (CPN Paris 2011) using the Delphi method.

PubMed

Walker, David A; Liu, JoFen; Kieran, Mark; Jabado, Nada; Picton, Susan; Packer, Roger; St Rose, Christian

2013-04-01

Astrocytic tumors account for 42% of childhood brain tumors, arising in all anatomical regions and associated with neurofibromatosis type 1 (NF1) in 15%. Anatomical site determines the degree and risk of resectability; the more complete resection, the better the survival rates. New biological markers and modern radiotherapy techniques are altering the risk assessments of clinical decisions for tumor resection and biopsy. The increasingly distinct pediatric neuro-oncology multidisciplinary team (PNMDT) is developing a distinct evidence base. A multidisciplinary consensus conference on pediatric neurosurgery was held in February 2011, where 92 invited participants reviewed evidence for clinical management of hypothalamic chiasmatic glioma (HCLGG), diffuse intrinsic pontine glioma (DIPG), and high-grade glioma (HGG). Twenty-seven statements were drafted and subjected to online Delphi consensus voting by participants, seeking >70% agreement from >60% of respondents; where <70% consensus occurred, the statement was modified and resubmitted for voting. Twenty-seven statements meeting consensus criteria are reported. For HCLGG, statements describing overall therapeutic purpose and indications for biopsy, observation, or treatment aimed at limiting the risk of visual damage and the need for on-going clinical trials were made. Primary surgical resection was not recommended. For DIPG, biopsy was recommended to ascertain biological characteristics to enhance understanding and targeting of treatments, especially in clinical trials. For HGG, biopsy is essential, the World Health Organization classification was recommended; selection of surgical strategy to achieve gross total resection in a single or multistep process should be discussed with the PNMDT and integrated with trials based drug strategies for adjuvant therapies.

Defining consensus norms for palliative care of people with intellectual disabilities in Europe, using Delphi methods: A White Paper from the European Association of Palliative Care

PubMed Central

Tuffrey-Wijne, Irene; McLaughlin, Dorry; Curfs, Leopold; Dusart, Anne; Hoenger, Catherine; McEnhill, Linda; Read, Sue; Ryan, Karen; Satgé, Daniel; Straßer, Benjamin; Westergård, Britt-Evy; Oliver, David

2015-01-01

Background: People with intellectual disabilities often present with unique challenges that make it more difficult to meet their palliative care needs. Aim: To define consensus norms for palliative care of people with intellectual disabilities in Europe. Design: Delphi study in four rounds: (1) a taskforce of 12 experts from seven European countries drafted the norms, based on available empirical knowledge and regional/national guidelines; (2) using an online survey, 34 experts from 18 European countries evaluated the draft norms, provided feedback and distributed the survey within their professional networks. Criteria for consensus were clearly defined; (3) modifications and recommendations were made by the taskforce; and (4) the European Association for Palliative Care reviewed and approved the final version. Setting and participants: Taskforce members: identified through international networking strategies. Expert panel: a purposive sample identified through taskforce members’ networks. Results: A total of 80 experts from 15 European countries evaluated 52 items within the following 13 norms: equity of access, communication, recognising the need for palliative care, assessment of total needs, symptom management, end-of-life decision making, involving those who matter, collaboration, support for family/carers, preparing for death, bereavement support, education/training and developing/managing services. None of the items scored less than 86% agreement, making a further round unnecessary. In light of respondents’ comments, several items were modified and one item was deleted. Conclusion: This White Paper presents the first guidance for clinical practice, policy and research related to palliative care for people with intellectual disabilities based on evidence and European consensus, setting a benchmark for changes in policy and practice. PMID:26346181

Developing the E-Delphi System: A Web-Based Forecasting Tool for Educational Research.

ERIC Educational Resources Information Center

Chou, Chien

2002-01-01

Discusses use of the Delphi technique and describes the development of an electronic version, called e-Delphi, in which questionnaire construction and communication with panel members was accomplished using the Web. Explains system function and interface and discusses evaluation of the e-Delphi system. (Author/LRW)

Identifying research priorities for patient safety in mental health: an international expert Delphi study

PubMed Central

Murray, Kevin; Thibaut, Bethan; Ramtale, Sonny Christian; Adam, Sheila; Darzi, Ara; Archer, Stephanie

2018-01-01

Objective Physical healthcare has dominated the patient safety field; research in mental healthcare is not as extensive but findings from physical healthcare cannot be applied to mental healthcare because it delivers specialised care that faces unique challenges. Therefore, a clearer focus and recognition of patient safety in mental health as a distinct research area is still needed. The study aim is to identify future research priorities in the field of patient safety in mental health. Design Semistructured interviews were conducted with the experts to ascertain their views on research priorities in patient safety in mental health. A three-round online Delphi study was used to ascertain consensus on 117 research priority statements. Setting and participants Academic and service user experts from the USA, UK, Switzerland, Netherlands, Ireland, Denmark, Finland, Germany, Sweden, Australia, New Zealand and Singapore were included. Main outcome measures Agreement in research priorities on a five-point scale. Results Seventy-nine statements achieved consensus (>70%). Three out of the top six research priorities were patient driven; experts agreed that understanding the patient perspective on safety planning, on self-harm and on medication was important. Conclusions This is the first international Delphi study to identify research priorities in safety in the mental field as determined by expert academic and service user perspectives. A reasonable consensus was obtained from international perspectives on future research priorities in patient safety in mental health; however, the patient perspective on their mental healthcare is a priority. The research agenda for patient safety in mental health identified here should be informed by patient safety science more broadly and used to further establish this area as a priority in its own right. The safety of mental health patients must have parity with that of physical health patients to achieve this. PMID:29502096

STOPP/START Medication Criteria Modified for US Nursing Home Setting

PubMed Central

Khodyakov, Dmitry; Ochoa, Aileen; Olivieri-Mui, Brianne L.; Bouwmeester, Carla; Zarowitz, Barbara J.; Patel, Meenakshi; Ching, Diana; Briesacher, Becky

2016-01-01

STRUCTURED ABSTRACT BACKGROUND/OBJECTIVES A barrier to assessing the quality of prescribing in nursing homes (NH) is the lack of explicit criteria for this setting. Our objective was to develop a set of prescribing indicators measurable with available data from electronic nursing home databases by adapting the European-based 2014 STOPP/START criteria of potentially inappropriate and underused medications for the US setting. DESIGN A two-stage expert panel process. In first stage, investigator team reviewed 114 criteria for compatibility and measurability. In second stage, we convened an online modified e-Delphi (OMD) panel to rate the validity of criteria and two webinars to identify criteria with highest relevance to US NHs. PARTICIPANTS Seventeen experts with recognized reputations in NH care participated in the e-Delphi panel and 12 in the webinar. MEASUREMENTS Compatibility and measurability were assessed by comparing criteria to US terminology/setting standards and data elements in NH databases. Validity was rated with a 9-point Likert-type scale (1=not valid at all, 9=highly valid). Mean, median, interpercentile ranges, and agreement were determined for each criterion score. Relevance was determined by ranking the mean panel ratings on criteria that reached agreement; half of the criteria with the highest mean values were reviewed and approved by the webinar participants. RESULTS Fifty-three STOPP/START criteria were deemed as compatible with US setting and measurable using data from electronic NH databases. E-Delphi panelists rated 48 criteria as valid for US NHs. Twenty-four criteria were deemed as most relevant, consisting of 22 measures of potentially inappropriate medications and 2 measures of underused medications. CONCLUSION This study created the first explicit criteria for assessing the quality of prescribing in US NHs. PMID:28008599

Using a Delphi process to define priorities for prison health research in Canada

PubMed Central

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-01

Objectives A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. Setting We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. Participants We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators’ professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Primary and secondary outcome measures Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. Results In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Conclusions Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. PMID:26769790

Improving University Ranking to Achieve University Competitiveness by Management Information System

NASA Astrophysics Data System (ADS)

Dachyar, M.; Dewi, F.

2015-05-01

One way to increase university competitiveness is through information system management. A literature review was done to find information system factors that affect university performance in Quacquarelli Symonds (QS) University Ranking: Asia evaluation. Information system factors were then eliminated using Delphi method through consensus of 7 experts. Result from Delphi method was used as measured variables in PLS-SEM. Estimation with PLS-SEM method through 72 respondents shows that the latent variable academic reputation and citation per paper have significant correlation to university competitiveness. In University of Indonesia (UI) the priority to increase university competitiveness as follow: (i) network building in international conference, (ii) availability of research data to public, (iii) international conference information, (iv) information on achievements and accreditations of each major, (v) ease of employment for alumni.

Identifying Psychological Contract Breaches to Guide Improvements in Faculty Recruitment, Retention, and Development

PubMed Central

Desselle, Shane P.; Draugalis, JoLaine R.; Spies, Alan R.; Davis, Tamra S.; Bolino, Mark

2012-01-01

Objective. To identify pharmacy faculty members’ perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. Methods. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Results. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. Conclusion. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development. PMID:22919084

Academic Primer Series: Key Papers About Teaching with Technology.

PubMed

Boysen-Osborn, Megan; Cooney, Robert; Gottlieb, Michael; Chan, Teresa M; Brown, Aaron; King, Andrew; Tobias, Adam; Thoma, Brent

2017-06-01

Modern learners have immediate, unlimited access to a wide variety of online resources . To appeal to this current generation of learners, educators must embrace the use of technology. However, educators must balance newer, novel technologies with traditional methods to achieve the best learning outcomes. Therefore, we aimed to review several papers useful for faculty members wishing to incorporate technology into instructional design. We identified a broad list of papers relevant to teaching and learning with technology within the online discussions of the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented with suggestions by a guest expert (BT) and an open call on Twitter (tagged with the #meded and #FOAMed hashtags) yielding 24 papers. We then conducted a modified three-round Delphi process within the authorship group, including junior and senior faculty members, to identify the most impactful papers. We pared the list of 24 papers to five that were most highly rated. Two were research papers and three were commentaries or editorials. The authorship group reviewed and summarized these papers with specific consideration to their value to junior educators and faculty developers. This is a key reading list for junior faculty members and faculty developers interested in teaching with technology. The commentary contextualizes the importance of these papers for medical educators, to optimize use of technology in their teaching or incorporate into faculty development.

Study of Methods for Assessing Research Topic Elicitation and pRioritization (SMARTER): Study Protocol to Compare Qualitative Research Methods and Advance Patient Engagement in Research.

PubMed

Lavallee, Danielle C; Comstock, Bryan; Scott, Mary R; Avins, Andrew L; Nerenz, David R; Edwards, Todd C; Patrick, Donald L; Lawrence, Sarah O; Bauer, Zoya; Truitt, Anjali R; Jarvik, Jeffrey G

2017-09-07

Involving patients as partners in research is a defining characteristic of patient-centered outcomes research (PCOR). While patients' experiential knowledge of a health condition or treatment may yield research priorities not reflected by researchers and policy makers, the methods for identifying and effectively collaborating with patients are still evolving. Patient registries and crowdsourcing may offer ease of access and convenience to both researchers and patients. Surveys and focus groups, including online modalities, have been described for prioritizing research topics. However, little is known about how these different methods compare in producing consistent priorities and similar perceptions of engagement quality among participants. The aims of this study are (1) to compare how different engagement methods used to elicit patient priorities for research perform as measured by rankings for priorities generated and participant satisfaction; and (2) to determine characteristics of individuals choosing to participate in research prioritization activities. Participants in the Back pain Outcomes using Longitudinal Data (BOLD) patient registry, established to evaluate the natural history of back pain among individuals 65 years and older, and participants on the Amazon Mechanical Turk (MTurk) crowdsourcing platform, to provide input on priorities for research via a questionnaire, are invited. For BOLD participants, we subsequently randomize interested respondents to 1 of 3 interactive prioritization activities to further develop priorities: a Delphi panel, an online crowd voting activity, or an in-person facilitated prioritization activity using nominal group technique (NGT). Participants involved in each activity complete a survey to evaluate the quality of the experience and a subset of these participants discuss their experience further in an interview. Descriptive statistics are used to characterize the rankings produced by each method and compare the top 5 rated topics resulting from each prioritization activity. We use rank-ordered logistic regression models to identify associations of the ranked priority topics with baseline patient characteristics. We analyze responses to the evaluation using a mixed-methods approach wherein we tabulate responses to Likert-scale questions and use content analysis to enumerate themes emerging from interviews for the 3 activities. In Phase I, we invite approximately 3000 BOLD participants and 500 Amazon MTurk workers to complete a research topic prioritization survey. Based on these results, we include additional topics into a subsequent prioritization survey. In Phase II, we invite BOLD participants to join 1 of 3 activities: 90 participants for Delphi panel, 100 participants for crowd voting, and 60 participants for focus groups. Of the Phase II participants, 30 will be interviewed to evaluate the activities. This study informs decisions about how to conduct outreach to patient registry participants for providing input on research priorities, how individuals 65 years and older wish to participate in engagement activities, and how different research prioritization methods compare in terms of rankings generated and participant satisfaction. ©Danielle C Lavallee, Bryan Comstock, Mary R Scott, Andrew L Avins, David R Nerenz, Todd C Edwards, Donald L Patrick, Sarah O Lawrence, Zoya Bauer, Anjali R Truitt, Jeffrey G Jarvik. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 07.09.2017.

Algorithms for monitoring warfarin use: Results from Delphi Method.

PubMed

Kano, Eunice Kazue; Borges, Jessica Bassani; Scomparini, Erika Burim; Curi, Ana Paula; Ribeiro, Eliane

2017-10-01

Warfarin stands as the most prescribed oral anticoagulant. New oral anticoagulants have been approved recently; however, their use is limited and the reversibility techniques of the anticoagulation effect are little known. Thus, our study's purpose was to develop algorithms for therapeutic monitoring of patients taking warfarin based on the opinion of physicians who prescribe this medicine in their clinical practice. The development of the algorithm was performed in two stages, namely: (i) literature review and (ii) algorithm evaluation by physicians using a Delphi Method. Based on the articles analyzed, two algorithms were developed: "Recommendations for the use of warfarin in anticoagulation therapy" and "Recommendations for the use of warfarin in anticoagulation therapy: dose adjustment and bleeding control." Later, these algorithms were analyzed by 19 medical doctors that responded to the invitation and agreed to participate in the study. Of these, 16 responded to the first round, 11 to the second and eight to the third round. A 70% consensus or higher was reached for most issues and at least 50% for six questions. We were able to develop algorithms to monitor the use of warfarin by physicians using a Delphi Method. The proposed method is inexpensive and involves the participation of specialists, and it has proved adequate for the intended purpose. Further studies are needed to validate these algorithms, enabling them to be used in clinical practice.

Practical state of health estimation of power batteries based on Delphi method and grey relational grade analysis

NASA Astrophysics Data System (ADS)

Sun, Bingxiang; Jiang, Jiuchun; Zheng, Fangdan; Zhao, Wei; Liaw, Bor Yann; Ruan, Haijun; Han, Zhiqiang; Zhang, Weige

2015-05-01

The state of health (SOH) estimation is very critical to battery management system to ensure the safety and reliability of EV battery operation. Here, we used a unique hybrid approach to enable complex SOH estimations. The approach hybridizes the Delphi method known for its simplicity and effectiveness in applying weighting factors for complicated decision-making and the grey relational grade analysis (GRGA) for multi-factor optimization. Six critical factors were used in the consideration for SOH estimation: peak power at 30% state-of-charge (SOC), capacity, the voltage drop at 30% SOC with a C/3 pulse, the temperature rises at the end of discharge and charge at 1C; respectively, and the open circuit voltage at the end of charge after 1-h rest. The weighting of these factors for SOH estimation was scored by the 'experts' in the Delphi method, indicating the influencing power of each factor on SOH. The parameters for these factors expressing the battery state variations are optimized by GRGA. Eight battery cells were used to illustrate the principle and methodology to estimate the SOH by this hybrid approach, and the results were compared with those based on capacity and power capability. The contrast among different SOH estimations is discussed.

How to Choose? Using the Delphi Method to Develop Consensus Triggers and Indicators for Disaster Response.

PubMed

Lis, Rebecca; Sakata, Vicki; Lien, Onora

2017-08-01

To identify key decisions along the continuum of care (conventional, contingency, and crisis) and the critical triggers and data elements used to inform those decisions concerning public health and health care response during an emergency. A classic Delphi method, a consensus-building survey technique, was used with clinicians around Washington State to identify regional triggers and indicators. Additionally, using a modified Delphi method, we combined a workshop and single-round survey with panelists from public health (state and local) and health care coalitions to identify consensus state-level triggers and indicators. In the clinical survey, 122 of 223 proposed triggers or indicators (43.7%) reached consensus and were deemed important in regional decision-making during a disaster. In the state-level survey, 110 of 140 proposed triggers or indicators (78.6%) reached consensus and were deemed important in state-level decision-making during a disaster. The identification of consensus triggers and indicators for health care emergency response is crucial in supporting a comprehensive health care situational awareness process. This can inform the creation of standardized questions to ask health care, public health, and other partners to support decision-making during a response. (Disaster Med Public Health Preparedness. 2017;11:467-472).

Current opinion and consensus statement regarding the diagnosis, prognosis, and treatment of patients with essential thrombocythemia: a survey of the Spanish Group of Ph-negative Myeloproliferative Neoplasms (GEMFIN) using the Delphi method.

PubMed

Besses, C; Hernández-Boluda, J C; Pérez Encinas, M; Raya, J M; Hernández-Rivas, J M; Jiménez Velasco, A; Martínez Lopez, J; Vicente, V; Burgaleta, C

2016-04-01

The current consensus on the diagnosis, prognosis, and treatment of essential thrombocythemia (ET) is based on experts' recommendations. However, several aspects of the diagnosis of, prognosis of, and therapy for ET are still controversial. The Delphi method was employed with an expert panel of members of the Spanish Group of Ph-negative Myeloproliferative Neoplasms in order to identify the degree of agreement on the diagnosis, prognosis, and treatment of ET. Nine leading experts selected a total of 41 clinical hematologists with well-known expertise in ET. An electronic questionnaire was used to collect the questions rated in a four-step scale. The questions were grouped into four blocks: diagnosis, risk stratification, goals of therapy, and treatment strategy. After the first round consisting of 80 questions, a second round including 14 additional questions focused on the recommendations advocated by experts of the European LeukemiaNet in 2011 was analyzed. The median and mean values for the first and second rounds were calculated. A summary of the conclusions considered as the most representative of each block of questions is presented. The Delphi method is a powerful instrument to address the current approaches and controversies surrounding ET.

Development of criteria for evaluating clinical response in thyroid eye disease using a modified Delphi technique.

PubMed

Douglas, Raymond S; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A; Cahill, Kenneth; Dolman, Peter J; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J; Khanna, Dinesh

2009-09-01

To identify components of a provisional clinical response index for thyroid eye disease using a modified Delphi technique. The International Thyroid Eye Disease Society conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in thyroid eye disease. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty-four respondents participated in the Delphi 1 survey, providing 220 unique items. Ninety-two members (100% of the respondents from Delphi 1 plus 8 new participants) responded in Delphi 2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi 3 (67 criteria were excluded because of redundancy). Criteria with a mean greater than 6 (1 = least appropriate to 9 = most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for thyroid eye disease. These measures will be iteratively refined for use in multicenter clinical trials.

Development of criteria for evaluating clinical response in thyroid eye disease (CRI-TED) using a modified Delphi technique

PubMed Central

Douglas, Raymond S.; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A.; Cahill, Kenneth; Dolman, Peter J.; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J.; Khanna, Dinesh

2014-01-01

To identify components of a provisional clinical response index for thyroid eye disease (CRI-TED) using a modified Delphi technique. The International Thyroid Eye Disease Society (ITEDS) conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in TED. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty four respondents participated in the Delphi-1 survey, providing 220 unique items. Ninety- two members (100% of the respondents from Delphi 1 plus eight new participants) responded in Delphi-2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi-3 (67 criteria were excluded due to redundancy). Criteria with a mean greater than 6 (1 least appropriate to 9 most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for TED. These measures will be iteratively refined for use in multicenter clinical trials. PMID:19752424

Development of a core outcome set for use in determining the overall success of gastroschisis treatment.

PubMed

Allin, Benjamin; Ross, Andrew; Marven, Sean; J Hall, Nigel; Knight, Marian

2016-07-27

Gastroschisis research is limited in quality by the presence of significant heterogeneity in outcome measure reporting (PloS One 10(1):e0116908, 2015). Using core outcome sets in research is one proposed method for addressing this problem (Trials 13:103, 2012; Clin Rheumatol 33(9):1313-1322, 2014; Health Serv Res Policy 17(1):1-2, 2012). Ultimately, standardising outcome measure reporting will improve research quality and translate into improvements in patient care. Candidate outcome measures have been identified through systematic reviews. These outcome measures will form the starting point for an online, three-phase Delphi process that will be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel, panel 2 is a non-neonatal panel and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1-9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's gastroschisis treatment. In round 2, experts will be presented with the same list of outcome measures and with graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. The results of the Delphi process will be discussed, and outcomes re-scored. Outcome measures where > 70 % of the participants at the meeting scored them as 7-9 and < 15 % scored them as 1-3 will form the core outcome set. Development of a core outcome set will help to reduce the heterogeneity of the outcome measure reporting in gastroschisis. This will increase the quality of research taking place and ultimately improve care provided to infants with gastroschisis.

From control to causation: Validating a 'complex systems model' of running-related injury development and prevention.

PubMed

Hulme, A; Salmon, P M; Nielsen, R O; Read, G J M; Finch, C F

2017-11-01

There is a need for an ecological and complex systems approach for better understanding the development and prevention of running-related injury (RRI). In a previous article, we proposed a prototype model of the Australian recreational distance running system which was based on the Systems Theoretic Accident Mapping and Processes (STAMP) method. That model included the influence of political, organisational, managerial, and sociocultural determinants alongside individual-level factors in relation to RRI development. The purpose of this study was to validate that prototype model by drawing on the expertise of both systems thinking and distance running experts. This study used a modified Delphi technique involving a series of online surveys (December 2016- March 2017). The initial survey was divided into four sections containing a total of seven questions pertaining to different features associated with the prototype model. Consensus in opinion about the validity of the prototype model was reached when the number of experts who agreed or disagreed with survey statement was ≥75% of the total number of respondents. A total of two Delphi rounds was needed to validate the prototype model. Out of a total of 51 experts who were initially contacted, 50.9% (n = 26) completed the first round of the Delphi, and 92.3% (n = 24) of those in the first round participated in the second. Most of the 24 full participants considered themselves to be a running expert (66.7%), and approximately a third indicated their expertise as a systems thinker (33.3%). After the second round, 91.7% of the experts agreed that the prototype model was a valid description of the Australian distance running system. This is the first study to formally examine the development and prevention of RRI from an ecological and complex systems perspective. The validated model of the Australian distance running system facilitates theoretical advancement in terms of identifying practical system-wide opportunities for the implementation of sustainable RRI prevention interventions. This 'big picture' perspective represents the first step required when thinking about the range of contributory causal factors that affect other system elements, as well as runners' behaviours in relation to RRI risk. Copyright © 2017 Elsevier Ltd. All rights reserved.

Defining the activities of publicness for Korea's public community hospitals using the Delphi method.

PubMed

Lee, Kunsei; Kim, Hyun Joo; You, Myoungsoon; Lee, Jin-Seok; Eun, Sang Jun; Jeong, Hyoseon; Ahn, Hye Mi; Lee, Jin Yong

2017-03-01

This study aims to identify which activities of a public community hospital (PHC) should be included in their definition of publicness and tries to achieve a consensus among experts using the Delphi method. We conduct 2 rounds of the Delphi process with 17 panel members using a developed draft of tentative activities for publicness including 5 main categories covering 27 items. The questions remain the same in both rounds and the applicability of each of the 27 items to publicness is measured on a 9-point scale. If the participants believe government funding is needed, we ask how much they think the government should support each item on a 0% to 100% scale. After conducting 2 rounds of the Delphi process, 22 out of the 27 items reached a consensus as activities defining the publicness of the PHCs. Among the 5 major categories, in category C, activities preventing market failure, all 10 items were considered activities of publicness. Nine of these were evaluated as items that should be compensated at 100% of total financial loss by the Korean government. Throughout results, we were able to define the activities of the PCH that encompassed its publicness and confirm that there are "good deficits" in the context of the PCHs. Thus, some PCH deficits are unavoidable and not wasted as these monies support a necessary role and function in providing public health. The Korean government should therefore consider taking actions such as exempting such "good deficits" or providing additional financial aid to reimburse the PHCs for "good deficits."

Emerging Technologies Program Integration Report. Volume 2. Background, Delphi and Workshop Data. Appendices

DTIC Science & Technology

1987-05-04

FTIILE COP’ AD-A196 840 EMERGING TECHNOLOGIES PROGRAM INTEGRATION REPORT VOLUME II BACKGROUND, DELPHI AND WORKSHOP DATA, APPENDICES . -- PREPARED...Security Classification) Emerging Technologies Program Integration Report Volume II: Background, Delphi and Workshop Data; Appendices (U) 12 PERSONAL...volumes of this integration report assess and synthesize information gathered through a Delphi survey, defense needs prioritization workshops, and

Using the Delphi technique in economic evaluation: time to revisit the oracle?

PubMed

Simoens, S

2006-12-01

Although the Delphi technique has been commonly used as a data source in medical and health services research, its application in economic evaluation of medicines has been more limited. The aim of this study was to describe the methodology of the Delphi technique, to present a case for using the technique in economic evaluation, and to provide recommendations to improve such use. The literature was accessed through MEDLINE focusing on studies discussing the methodology of the Delphi technique and economic evaluations of medicines using the Delphi technique. The Delphi technique can be used to provide estimates of health care resources required and to modify such estimates when making inter-country comparisons. The Delphi technique can also contribute to mapping the treatment process under investigation, to identifying the appropriate comparator to be used, and to ensuring that the economic evaluation estimates cost-effectiveness rather than cost-efficacy. Ideally, economic evaluations of medicines should be based on real-patient data. In the absence of such data, evaluations need to incorporate the best evidence available by employing approaches such as the Delphi technique. Evaluations based on this approach should state the limitations, and explore the impact of the associated uncertainty in the results.

Incorporating Information Value into Navy Tactical Data System: System Configuration Management Through the Delphi Method

DTIC Science & Technology

1989-03-01

e"-s tcc,: -e .- r reverse of necessary an., ice-tfy by bi.-:’ ru-’ce," 5uz"ou configuration management. Delphi method. Command and Control 19 Ac-s:’a...Aos!,ac: 21 Aostraczt Security Classitcator : R uncassf~’! i~e sa-e as renc- E 0orC users Unclassified 22a Na-e of Respon’s :e iro, v c a 22o Te’eo’one...i!r’ciule A’ea coce’ 22: C’" ce . Thomnas 1’. Mitchell (4081 646-2620 155k.11i DD FORI, 1473.6.: VAR 63 A-- R e-.!c- rnay be usec~ unti exhausted se

Community Engagement in the CTSA Program: Stakeholder Responses from a National Delphi Process

PubMed Central

Seifer, Sarena D.; Stupak, Matthew; Martinez, Linda Sprague

2014-01-01

Abstract In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community‐Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. PMID:24841362

Community engagement in the CTSA program: stakeholder responses from a national Delphi process.

PubMed

Freeman, Elmer; Seifer, Sarena D; Stupak, Matthew; Martinez, Linda Sprague

2014-06-01

In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community-Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. © 2014 Wiley Periodicals, Inc.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study

PubMed Central

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D.

2017-01-01

ABSTRACT Introduction As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. Materials and methods We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Results Panelist’s responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Conclusions Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. PMID:28379668

Identifying the features of an exercise addiction: A Delphi study

PubMed Central

Macfarlane, Lucy; Owens, Glynn; Cruz, Borja del Pozo

2016-01-01

Objectives There remains limited consensus regarding the definition and conceptual basis of exercise addiction. An understanding of the factors motivating maintenance of addictive exercise behavior is important for appropriately targeting intervention. The aims of this study were twofold: first, to establish consensus on features of an exercise addiction using Delphi methodology and second, to identify whether these features are congruous with a conceptual model of exercise addiction adapted from the Work Craving Model. Methods A three-round Delphi process explored the views of participants regarding the features of an exercise addiction. The participants were selected from sport and exercise relevant domains, including physicians, physiotherapists, coaches, trainers, and athletes. Suggestions meeting consensus were considered with regard to the proposed conceptual model. Results and discussion Sixty-three items reached consensus. There was concordance of opinion that exercising excessively is an addiction, and therefore it was appropriate to consider the suggestions in light of the addiction-based conceptual model. Statements reaching consensus were consistent with all three components of the model: learned (negative perfectionism), behavioral (obsessive–compulsive drive), and hedonic (self-worth compensation and reduction of negative affect and withdrawal). Conclusions Delphi methodology allowed consensus to be reached regarding the features of an exercise addiction, and these features were consistent with our hypothesized conceptual model of exercise addiction. This study is the first to have applied Delphi methodology to the exercise addiction field, and therefore introduces a novel approach to exercise addiction research that can be used as a template to stimulate future examination using this technique. PMID:27554504

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique

PubMed Central

Barry, Emma; O'Brien, Kirsty; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-01-01

Objective There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Design Two-round modified Delphi consensus method. Setting Irish and UK general practice. Participants A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. Results 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). Conclusions The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. PMID:27601499

Medication dispensing errors in Palestinian community pharmacy practice: a formal consensus using the Delphi technique.

PubMed

Shawahna, Ramzi; Haddad, Aseel; Khawaja, Baraa; Raie, Rand; Zaneen, Sireen; Edais, Tasneem

2016-10-01

Background Medication dispensing errors (MDEs) are frequent in community pharmacy practice. A definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice were not previously approached using formal consensus techniques. Objective This study was conducted to achieve consensus on a definition of MDEs and a wide range of scenarios that should or should not be considered as MDEs in Palestinian community pharmacy practice by a panel of community pharmacists. Setting Community pharmacy practice in Palestine. Method This was a descriptive study using the Delphi technique. A panel of fifty community pharmacists was recruited from different geographical locations of the West Bank of Palestine. A three round Delphi technique was followed to achieve consensus on a proposed definition of MDEs and 83 different scenarios representing potential MDEs using a nine-point scale. Main outcome measure Agreement or disagreement of a panel of community pharmacists on a proposed definition of MDEs and a series of scenarios representing potential MDEs. Results In the first Delphi round, views of key contact community pharmacists on MDEs were explored and situations representing potential MDEs were collected. In the second Delphi round, consensus was achieved to accept the proposed definition and to include 49 (59 %) of the 83 proposed scenarios as MDEs. In the third Delphi round, consensus was achieved to include further 13 (15.7 %) scenarios as MDEs, exclude 9 (10.8 %) scenarios and the rest of 12 (14.5 %) scenarios were considered equivocal based on the opinions of the panelists. Conclusion Consensus on a definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice was achieved using a formal consensus technique. The use of consensual definitions and scenarios representing MDE situations in community pharmacy practice might minimize methodological variations and their significant effects on the number and rate of MDEs reported in different studies.

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique.

PubMed

Barry, Emma; O'Brien, Kirsty; Moriarty, Frank; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-09-06

There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Two-round modified Delphi consensus method. Irish and UK general practice. A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Constructing post-surgical discharge instructions through a Delphi consensus methodology.

PubMed

Scott, Aaron R; Sanderson, Cody J; Rush, Augustus J; Alore, Elizabeth A; Naik, Aanand D; Berger, David H; Suliburk, James W

2018-05-01

Patient education materials are a crucial part of physician-patient communication. We hypothesize that available discharge instructions are difficult to read and fail to address necessary topics. Our objective is to evaluate readability and content of surgical discharge instructions using thyroidectomy to develop standardized discharge materials. Thyroidectomy discharge materials were analyzed for readability and assessed for content. Fifteen endocrine surgeons participated in a modified Delphi consensus panel to select necessary topics. Using readability best practices, we created standardized discharge instructions which included all selected topics. The panel evaluated 40 topics, selected 23, deemed 4 inappropriate, consolidated 5, and did not reach consensus on 8 topics after 4 rounds. The evaluated instructions' reading levels ranged from grade 6.5 to 13.2; none contained all consensus topics. Current post surgical thyroidectomy discharge instructions are more difficult to read than recommended by literacy standards and omit consensus warning signs of major complications. Our easy-to-read discharge instructions cover pertinent topics and may enhance patient education. Delphi methodology is useful for developing post-surgical instructions. Patient education materials need appropriate readability levels and content. We recommend the Delphi method to select content using consensus expert opinion whenever higher level data is lacking. Copyright © 2017 Elsevier B.V. All rights reserved.

Development of post-disaster psychosocial evaluation and intervention for children: Results of a South Korean delphi panel survey

PubMed Central

Lee, Mi-Sun; Hwang, Jun-Won; Lee, Cheol-Soon; Kim, Ji-Youn; Lee, Ju-Hyun; Kim, Eunji; Chang, Hyoung Yoon; Bae, SeungMin; Park, Jang-Ho

2018-01-01

Objective This study aimed to administer a Delphi panel survey and provide evidence for the development of a psychological intervention protocol for use after disasters in South Korea. Method A three-round Delphi survey was conducted. In all rounds, respondents answered open- or closed-ended questions regarding their views on i) the concept of disaster, ii) evaluation, iii) intervention, and iv) considerations in a disaster. Data from Round 1 were subjected to content analysis. In Round 2, items with content validity ratios (CVRs) greater than 0.49 were included, and in Round 3, items with a CVR≥0.38 were accepted. Results The response rates for the Delphi survey were high: 83% (n = 15, Round 1), 80% (n = 16, Round 2), and 86% (n = 24, Round 3). The data collected during this survey showed a need for a support system for children; for preventive strategies, including disaster readiness plans; for the protection of children's safety; and for the development of post-disaster psychosocial care. Conclusions The panel experts reached a consensus regarding the steps they considered critical in post-disaster evaluation and intervention. The findings suggest a unified model for advancing the development of the Korean version of an intervention protocol for children and adolescents exposed to traumatic events. PMID:29596483

Initiation of biological agents in patients with ankylosing spondylitis: results of a Delphi study by the ASAS Group

PubMed Central

Pham, T; van der Heijde, D; Calin, A; Khan, M; van der Linden, S.; Bellamy, N; Dougados, M

2003-01-01

Background: There is ample evidence of important symptomatic efficacy of tumour necrosis factor α (TNFα) inhibition in ankylosing spondylitis (AS). Moreover, studies suggest that anti-TNF could be considered as the first disease controlling antirheumatic treatment (DC-ART) for AS. Objective: To determine precisely which patients with AS are most likely to benefit from anti-TNFα treatment because of the cost and possible long term side effects of such treatment. Methods: Assessment in Ankylosing Spondylitis (ASAS) members were asked to use a Delphi technique to name the characteristics of patients with AS for whom they would start DC-ART, in three different clinical presentations (isolated axial involvement, peripheral arthritis, enthesitis). Results: Among the 62 invited ASAS members, more than 50% actively participated in the four phases of definition according to the Delphi technique. For each of the three clinical presentations, a combination of five to six domains was proposed, with an evaluation instrument and a cut off point defining a minimum level of activity for each domain. Conclusion: This study provides a profile for a patient with AS for considering initiation of biological agents that reflects the opinion of the ASAS members, using a Delphi exercise. Further studies are required to assess their relevance and their consistency with clinical practice. PMID:12922951

A proposed minimum data set for international primary care optometry: a modified Delphi study.

PubMed

Davey, Christopher J; Slade, Sarah V; Shickle, Darren

2017-07-01

To identify a minimum list of metrics of international relevance to public health, research and service development which can be extracted from practice management systems and electronic patient records in primary optometric practice. A two stage modified Delphi technique was used. Stage 1 categorised metrics that may be recorded as being part of a primary eye examination by their importance to research using the results from a previous survey of 40 vision science and public health academics. Delphi stage 2 then gauged the opinion of a panel of seven vision science academics and achieved consensus on contentious metrics and methods of grading/classification. A consensus regarding inclusion and response categories was achieved for nearly all metrics. A recommendation was made of 53 metrics which would be appropriate in a minimum data set. This minimum data set should be easily integrated into clinical practice yet allow vital data to be collected internationally from primary care optometry. It should not be mistaken for a clinical guideline and should not add workload to the optometrist. A pilot study incorporating an additional Delphi stage prior to implementation is advisable to refine some response categories. © 2017 The Authors. Ophthalmic and Physiological Optics published by John Wiley & Sons Ltd on behalf of College of Optometrists.

Protocol for the development of a Core Outcome Set (COS) for hemorrhoidal disease: an international Delphi study.

PubMed

van Tol, R R; Melenhorst, J; Dirksen, C D; Stassen, L P S; Breukink, S O

2017-07-01

Over the last decade, many studies were performed regarding treatment options for hemorrhoidal disease. Randomised controlled trials (RCTs) should have well-defined primary and secondary outcomes. However, the reported outcome measures are numerous and diverse. The heterogeneity of outcome definition in clinical trials limits transparency and paves the way for bias. The development of a core outcome set (COS) helps minimizing this problem. A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease. The aim of this project is to generate a COS regarding the outcome of treatment after hemorrhoidal disease. A Delphi study will be performed by an international steering group healthcare professionals and patients with the intention to create a standard outcome set for future clinical trials for the treatment of hemorrhoidal disease. First, a literature review will be conducted to establish which outcomes are used in clinical trials for hemorrhoidal disease. Secondly, both healthcare professionals and patients will participate in several consecutive rounds of online questionnaires and a face-to-face meeting to refine the content of the COS. Development of a COS for hemorrhoidal disease defines a minimum outcome-reporting standard and will improve the quality of research in the future.

Competencies of specialised wound care nurses: a European Delphi study.

PubMed

Eskes, Anne M; Maaskant, Jolanda M; Holloway, Samantha; van Dijk, Nynke; Alves, Paulo; Legemate, Dink A; Ubbink, Dirk T; Vermeulen, Hester

2014-12-01

Health care professionals responsible for patients with complex wounds need a particular level of expertise and education to ensure optimum wound care. However, uniform education for those working as wound care nurses is lacking. We aimed to reach consensus among experts from six European countries as to the competencies for specialised wound care nurses that meet international professional expectations and educational systems. Wound care experts including doctors, wound care nurses, lecturers, managers and head nurses were invited to contribute to an e-Delphi study. They completed online questionnaires based on the Canadian Medical Education Directives for Specialists framework. Suggested competencies were rated on a 9-point Likert scale. Consensus was defined as an agreement of at least 75% for each competence. Response rates ranged from 62% (round 1) to 86% (rounds 2 and 3). The experts reached consensus on 77 (80%) competences. Most competencies chosen belonged to the domain 'scholar' (n = 19), whereas few addressed those associated with being a 'health advocate' (n = 7). Competencies related to professional knowledge and expertise, ethical integrity and patient commitment were considered most important. This consensus on core competencies for specialised wound care nurses may help achieve a more uniform definition and education for specialised wound care nurses. © 2013 The Authors. International Wound Journal © 2013 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

Patient Involvement as Experts in the Development and Assessment of a Smartphone App as a Patient Education Tool for the Management of Thalassemia and Iron Overload Syndromes.

PubMed

Ward, Richard; Taha, Karim M

2016-09-01

Our aim was to develop and assess the feasibility of an education tool to improve health outcomes of patients with thalassemia. Thirty-five patients attending a Canadian thalassemia clinic were enrolled. Acting in an expert role, they participated in a Delphi method to reach consensus as to what tools and information should be incorporated in the development of a self management Smartphone app. One- and 6-month usability and health impact feedback surveys were built-in. Sixty percent of responders were 18-34 years old, over 50.0% had a college degree. The Delphi method successfully generated a comprehensive list of features important to patients. The app has been downloaded 147 times globally. Between March 2015 and January 2016, 19 responses for the 1-month survey were collected and the trends described. Responders reported improved medication adherence. The personal adherence pledge feature supports gamification of health apps to individualize goals of therapy. The impact of tracking iron levels was highly favorable. The Delphi method was an effective way to introduce a patient education and empowerment tool to the thalassemia population. The long-term impact requires data maturation. Use of validated methodology is essential to ensure ehealth interventions are positively contributing to patient education and disease outcomes.

[Competency requirements for executives in healthcare and social services organizations: Results of a Delphi study].

PubMed

Pielach, Martin; Schubert, Hans-Joachim

2018-02-07

Leadership in social services and healthcare organizations is marked by high levels of complexity and contradiction, which cannot be fully explained by politically, economically, and socially induced changes. Rather, it is the particularities of service provision in healthcare and social services that confront executives with specific demands. This study aimed to capture and prioritize required leadership competencies in healthcare and social services organizations. A three-step Delphi study was conducted with executives and managerial staff, who are job holders and thus experts on their occupation. For the first step, an explorative qualitative approach was chosen to record general opinion without prior assumptions. The following two steps weighted and selected the competency requirements in step one using rating- and ranking procedures. Results of the Delphi inquiry imply high relevance of social and personal competencies. Approximately 66 % of the competencies assessed in round three were social and personal competencies. 12 out of the 15 highest rated competencies in Delphi step three can be assigned to these two competency categories. In contrast, the importance of professional as well as methodical competencies was rated as less important. Only two methodical competencies and one professional competency were rated as very important by the panel. Nevertheless, the importance of executive professional and methodical competencies in healthcare and social services organizations is emphasized by high ratings of the competencies "Sector-specific expertise" and "Analytical skills". The methodical competency "Analytical skills" was identified by the Delphi respondents as the most important competency requirement. Social and personal requirements are of primary importance for leadership in healthcare and social services organizations. These results mostly correspond to leadership requirements posited in the literature on leadership skills. Emphasis should be on the specific relevance of professionalism, which can be traced back to the high proportion of professional activities in everyday working practices, the self-conception of executive staff based on professional qualifications and profession as well as the organizational form as expert organization. Healthcare and social services organizations are expert organizations with a strong emphasis on professional expertise. Professional knowledge is the most important means of production of expert organizations and imperative to leadership in healthcare and social services organization, given the high integration of executives into the professional system. Despite the dominance of social and personal competency requirements, the most important competency requirement is "Analytical skills", which can be described as the basis of every action. Copyright © 2018. Published by Elsevier GmbH.

Evaluation Criteria for Nursing Student Application of Evidence-Based Practice: A Delphi Study.

PubMed

Bostwick, Lina; Linden, Lois

2016-06-01

Core clinical evaluation criteria do not exist for measuring prelicensure baccalaureate nursing students' application of evidence-based practice (EBP) during direct care assignments. The study objective was to achieve consensus among EBP nursing experts to create clinical criteria for faculty to use in evaluating students' application of EBP principles. A three-round Delphi method was used. Experts were invited to participate in Web-based surveys. Data were analyzed using qualitative coding and categorizing. Quantitative analyses were descriptive calculations for rating and ranking. Expert consensus occurred in the Delphi rounds. The study provides a set of 10 core clinical evaluation criteria for faculty evaluating students' progression toward competency in their application of EBP. A baccalaureate program curriculum requiring the use of Bostwick's EBP Core Clinical Evaluation Criteria will provide a clear definition for understanding basic core EBP competence as expected for the assessment of student learning. [J Nurs Educ. 2016;55(5):336-341.]. Copyright 2016, SLACK Incorporated.

DelPhi web server v2: incorporating atomic-style geometrical figures into the computational protocol.

PubMed

Smith, Nicholas; Witham, Shawn; Sarkar, Subhra; Zhang, Jie; Li, Lin; Li, Chuan; Alexov, Emil

2012-06-15

A new edition of the DelPhi web server, DelPhi web server v2, is released to include atomic presentation of geometrical figures. These geometrical objects can be used to model nano-size objects together with real biological macromolecules. The position and size of the object can be manipulated by the user in real time until desired results are achieved. The server fixes structural defects, adds hydrogen atoms and calculates electrostatic energies and the corresponding electrostatic potential and ionic distributions. The web server follows a client-server architecture built on PHP and HTML and utilizes DelPhi software. The computation is carried out on supercomputer cluster and results are given back to the user via http protocol, including the ability to visualize the structure and corresponding electrostatic potential via Jmol implementation. The DelPhi web server is available from http://compbio.clemson.edu/delphi_webserver.

Reaching consensus on reporting patient and public involvement (PPI) in research: methods and lessons learned from the development of reporting guidelines

PubMed Central

Brett, Jo; Staniszewska, Sophie; Simera, Iveta; Seers, Kate; Mockford, Carole; Goodlad, Susan; Altman, Doug; Moher, David; Barber, Rosemary; Denegri, Simon; Entwistle, Andrew Robert; Littlejohns, Peter; Suleman, Rashida; Thomas, Victoria; Tysall, Colin

2017-01-01

Introduction Patient and public involvement (PPI) is inconsistently reported in health and social care research. Improving the quality of how PPI is reported is critical in developing a higher quality evidence base to gain a better insight into the methods and impact of PPI. This paper describes the methods used to develop and gain consensus on guidelines for reporting PPI in research studies (updated version of the Guidance for Reporting Patient and Public Involvement (GRIPP2)). Methods There were three key stages in the development of GRIPP2: identification of key items for the guideline from systematic review evidence of the impact of PPI on health research and health services, a three-phase online Delphi survey with a diverse sample of experts in PPI to gain consensus on included items and a face-to-face consensus meeting to finalise and reach definitive agreement on GRIPP2. Challenges and lessons learnt during the development of the reporting guidelines are reported. Discussion The process of reaching consensus is vital within the development of guidelines and policy directions, although debate around how best to reach consensus is still needed. This paper discusses the critical stages of consensus development as applied to the development of consensus for GRIPP2 and discusses the benefits and challenges of consensus development. PMID:29061613

Operationalising elaboration theory for simulation instruction design: a Delphi study.

PubMed

Haji, Faizal A; Khan, Rabia; Regehr, Glenn; Ng, Gary; de Ribaupierre, Sandrine; Dubrowski, Adam

2015-06-01

The aim of this study was to assess the feasibility of incorporating the Delphi process within the simplifying conditions method (SCM) described in elaboration theory (ET) to identify conditions impacting the complexity of procedural skills for novice learners. We generated an initial list of conditions impacting the complexity of lumbar puncture (LP) from key informant interviews (n = 5) and a literature review. Eighteen clinician-educators from six different medical specialties were subsequently recruited as expert panellists. Over three Delphi rounds, these panellists rated: (i) their agreement with the inclusion of the simple version of the conditions in a representative ('epitome') training scenario, and (ii) how much the inverse (complex) version increases LP complexity for a novice. Cronbach's α-values were used to assess inter-rater agreement. All panellists completed Rounds 1 and 2 of the survey and 17 completed Round 3. In Round 1, Cronbach's α-values were 0.89 and 0.94 for conditions that simplify and increase LP complexity, respectively; both values increased to 0.98 in Rounds 2 and 3. With the exception of 'high CSF (cerebral spinal fluid) pressure', panellists agreed with the inclusion of all conditions in the simplest (epitome) training scenario. Panellists rated patient movement, spinal anatomy, patient cooperativeness, body habitus, and the presence or absence of an experienced assistant as having the greatest impact on the complexity of LP. This study demonstrated the feasibility of using expert consensus to establish conditions impacting the complexity of procedural skills, and the benefits of incorporating the Delphi method into the SCM. These data can be used to develop and sequence simulation scenarios in a progressively challenging manner. If the theorised learning gains associated with ET are realised, the methods described in this study may be applied to the design of simulation training for other procedural and non-procedural skills, thereby advancing the agenda of theoretically based instruction design in health care simulation. © 2015 John Wiley & Sons Ltd.

Rating scale for the assessment of competence in ultrasound-guided peripheral vascular access - a Delphi Consensus Study.

PubMed

Primdahl, Stine C; Todsen, Tobias; Clemmesen, Louise; Knudsen, Lars; Weile, Jesper

2016-09-21

Peripheral vascular access is vital for treatment and diagnostics of hospitalized patients. Ultrasound-guided vascular access (UGVA) is superior to the landmark technique. To ensure competence-based education, an assessment tool of UGVA competence is needed. We aimed to develop a global rating scale (RS) for assessment of UGVA competence based on opinions on the content from ultrasound experts in a modified Delphi consensus study. We included experts from anesthesiology, emergency medicine and radiology across university hospitals in Denmark. Nine elements were drafted based on existing literature and recommendations from international societies. In a multi-round survey, the experts rated the elements on a five-point Likert scale according to importance, and suggested missing elements. The final Delphi round occurred when >80% of the experts rated all elements ≥4 on the Likert scale. Sixteen experts consented to participate in the study, one withdrew consent prior to the first Delphi round, and 14 completed all three Delphi rounds. In the first Delphi round the experts excluded one element from the scale and changed the content of two elements. In the second Delphi round, the experts excluded one element from the scale. In the third Delphi round, consensus was obtained on the eight elements: preparation of utensils, ergonomics, preparation of the ultrasound device, identification of blood vessels, anatomy, hygiene, coordination of the needle, and completion of the procedure. We developed an RS for assessment of UGVA competence based on opinions of ultrasound experts through a modified Delphi consensus study.

An international survey and modified Delphi process revealed editors’ perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals

PubMed Central

Galipeau, James; Cobey, Kelly D.; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants’ list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 “highly rated” competency-related statements and another 86 “included” items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future. PMID:28979768

An international survey and modified Delphi process revealed editors' perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals.

PubMed

Galipeau, James; Cobey, Kelly D; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants' list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 "highly rated" competency-related statements and another 86 "included" items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future.

Use of cultural consensus analysis to evaluate expert feedback of median safety.

PubMed

Kim, Tae-Gyu; Donnell, Eric T; Lee, Dongmin

2008-07-01

Cultural consensus analysis is a statistical method that can be used to assess participant responses to survey questions. The technique concurrently estimates the knowledge of each survey participant and estimates the culturally correct answer to each question asked, based on the existence of consensus among survey participants. The main objectives of this paper are to present the cultural consensus methodology and apply it to a set of median design and safety survey data that were collected using the Delphi method. A total of 21 Delphi survey participants were asked to answer research questions related to cross-median crashes. It was found that the Delphi panel had agreeable opinions with respect to the association of average daily traffic (ADT) and heavy vehicle percentage combination on the risk of cross-median crashes; relative importance of additional factors, other than ADT, median width, and crash history that may contribute to cross-median crashes; and, the relative importance of geometric factors that may be associated with the likelihood of cross-median crashes. Therefore, the findings from the cultural consensus analysis indicate that the expert panel selected to participate in the Delphi survey shared a common knowledge pool relative to the association between median design and safety. There were, however, diverse opinions regarding median barrier type and its preferred placement location. The panel showed a higher level of knowledge on the relative importance regarding the association of geometric factors on cross-median crashes likelihood than on other issues considered. The results of the cultural consensus analysis of the present median design and safety survey data could be used to design a focused field study of median safety.

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study.

PubMed

Mascherek, Anna C; Schwappach, David L B

2016-08-05

Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Developing consensus-based policy solutions for medicines adherence for Europe: a delphi study

PubMed Central

2012-01-01

Background Non-adherence to prescribed medication is a pervasive problem that can incur serious effects on patients’ health outcomes and well-being, and the availability of resources in healthcare systems. This study aimed to develop practical consensus-based policy solutions to address medicines non-adherence for Europe. Methods A four-round Delphi study was conducted. The Delphi Expert Panel comprised 50 participants from 14 countries and was representative of: patient/carers organisations; healthcare providers and professionals; commissioners and policy makers; academics; and industry representatives. Participants engaged in the study remotely, anonymously and electronically. Participants were invited to respond to open questions about the causes, consequences and solutions to medicines non-adherence. Subsequent rounds refined responses, and sought ratings of the relative importance, and operational and political feasibility of each potential solution to medicines non-adherence. Feedback of individual and group responses was provided to participants after each round. Members of the Delphi Expert Panel and members of the research group participated in a consensus meeting upon completion of the Delphi study to discuss and further refine the proposed policy solutions. Results 43 separate policy solutions to medication non-adherence were agreed by the Panel. 25 policy solutions were prioritised based on composite scores for importance, and operational and political feasibility. Prioritised policy solutions focused on interventions for patients, training for healthcare professionals, and actions to support partnership between patients and healthcare professionals. Few solutions concerned actions by governments, healthcare commissioners, or interventions at the system level. Conclusions Consensus about practical actions necessary to address non-adherence to medicines has been developed for Europe. These actions are also applicable to other regions. Prioritised policy solutions for medicines non-adherence offer a benefit to policymakers and healthcare providers seeking to address this multifaceted, complex problem. PMID:23176439

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study

PubMed Central

Mascherek, Anna C

2016-01-01

Objective Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. Design As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Results Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Conclusions Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. PMID:27496233

Remediation System Evaluation, Delphi Corporation Site in Vandalia, Ohio

EPA Pesticide Factsheets

This RSE pertains to aspects of the corrective action underway at two neighboring plants, the Delphi Energy and Chassis Systems Plant and Delphi Safety and Interior Systems Plant, collectively referred to as the “facility” in this report.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.

PubMed

Birko, Stanislav; Dove, Edward S; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts' variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions. PMID:26270647

Competencies for Student Leadership Development in Doctor of Pharmacy Curricula to Assist Curriculum Committees and Leadership Instructors

PubMed Central

Traynor, Andrew P.; Boyle, Cynthia J.

2013-01-01

Objective. To assist curriculum committees and leadership instructors by gathering expert opinion to define student leadership development competencies for pharmacy curricula. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define competencies for student leadership development in pharmacy curricula. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes. Round 2 grouped responses for agreement rating and comment. Round 3 allowed rating and comment on competencies not yet meeting consensus, which was prospectively set at 80%. Results. Eleven competencies attained 80% consensus or higher and were grouped into 3 areas: leadership knowledge, personal leadership commitment, and leadership skill development. Connections to contemporary leadership development literature were outlined for each competency as a means of verifying the panel’s work. Conclusions. The leadership competencies will aid students in addressing: What is leadership? Who am I as a leader? What skills and abilities do I need to be effective? The competencies will help curriculum committees and leadership instructors to focus leadership development opportunities, identify learning assessments, and define program evaluation. PMID:24371346

Validation of the instrument of health literacy competencies for Chinese-speaking health professionals.

PubMed

Chang, Li-Chun; Chen, Yu-Chi; Liao, Li-Ling; Wu, Fei Ling; Hsieh, Pei-Lin; Chen, Hsiao-Jung

2017-01-01

The study aimed to illustrate the constructs and test the psychometric properties of an instrument of health literacy competencies (IOHLC) for health professionals. A multi-phase questionnaire development method was used to develop the scale. The categorization of the knowledge and practice domains achieved consensus through a modified Delphi process. To reduce the number of items, the 92-item IOHLC was psychometrically evaluated through internal consistency, Rasch modeling, and two-stage factor analysis. In total, 736 practitioners, including nurses, nurse practitioners, health educators, case managers, and dieticians completed the 92-item IOHLC online from May 2012 to January 2013. The final version of the IOHLC covered 9 knowledge items and 40 skill items containing 9 dimensions, with good model fit, and explaining 72% of total variance. All domains had acceptable internal consistency and discriminant validity. The tool in this study is the first to verify health literacy competencies rigorously. Moreover, through psychometric testing, the 49-item IOHLC demonstrates adequate reliability and validity. The IOHLC may serve as a reference for the theoretical and in-service training of Chinese-speaking individuals' health literacy competencies.

An international survey and modified Delphi approach revealed numerous rapid review methods.

PubMed

Tricco, Andrea C; Zarin, Wasifa; Antony, Jesmin; Hutton, Brian; Moher, David; Sherifali, Diana; Straus, Sharon E

2016-02-01

To solicit experiences with and perceptions of rapid reviews from stakeholders, including researchers, policy makers, industry, journal editors, and health care providers. An international survey of rapid review producers and modified Delphi. Forty rapid review producers responded on our survey (63% response rate). Eighty-eight rapid reviews with 31 different names were reported. Rapid review commissioning organizations were predominantly government (78%) and health care (58%) organizations. Several rapid review approaches were identified, including updating the literature search of previous reviews (92%); limiting the search strategy by date of publication (88%); and having only one reviewer screen (85%), abstract data (84%), and assess the quality of studies (86%). The modified Delphi included input from 113 stakeholders on the rapid review approaches from the survey. Approach 1 (search limited by date and language; study selection by one reviewer only, and data abstraction and quality appraisal conducted by one reviewer and one verifier) was ranked the most feasible (72%, 81/113 responses), with the lowest perceived risk of bias (12%, 12/103); it also ranked second in timeliness (37%, 38/102) and fifth in comprehensiveness (5%, 5/100). Rapid reviews have many names and approaches, and some methods might be more desirable than others. Copyright © 2016 Elsevier Inc. All rights reserved.

What makes a competent clinical teacher?

PubMed Central

Wealthall, Stephen; Henning, Marcus

2012-01-01

Background Clinical teaching competency is a professional necessity ensuring that clinicians’ knowledge, skills and attitudes are effectively transmitted from experts to novices. The aim of this paper is to consider how clinical skills are transmitted from a historical and reflective perspective and to link these ideas with student and teacher perceptions of competence in clinical teaching. Methods The reflections are informed by a Delphi process and professional development survey designed to capture students’ and clinicians’ ideas about the attributes of a competent clinical teacher. In addition, the survey process obtained information on the importance and ‘teachability’ of these characteristics. Results Four key characteristics of the competent teacher emerged from the Delphi process: clinically competent, efficient organizer, group communicator and person–centred. In a subsequent survey, students were found to be more optimistic about the ‘teachability’ of these characteristics than clinicians and scored the attribute of person-centredness higher than clinicians. Clinicians, on the other hand, ascribed higher levels of importance to clinical competency, efficient organization and group communication than students. Conclusions The Delphi process created a non-threatening system for gathering student and clinician expectations of teachers and created a foundation for developing methods for evaluating clinical competency. This provided insights into differences between teachers’ and students’ expectations, their importance, and professional development. PMID:26451184

Guidelines for using the Delphi Technique to develop habitat suitability index curves

USGS Publications Warehouse

Crance, Johnie H.

1987-01-01

Habitat Suitability Index (SI) curves are one method of presenting species habitat suitability criteria. The curves are often used with the Habitat Evaluation Procedures (HEP) and are necessary components of the Instream Flow Incremental Methodology (IFIM) (Armour et al. 1984). Bovee (1986) described three categories of SI curves or habitat suitability criteria based on the procedures and data used to develop the criteria. Category I curves are based on professional judgment, with 1ittle or no empirical data. Both Category II (utilization criteria) and Category III (preference criteria) curves have as their source data collected at locations where target species are observed or collected. Having Category II and Category III curves for all species of concern would be ideal. In reality, no SI curves are available for many species, and SI curves that require intensive field sampling often cannot be developed under prevailing constraints on time and costs. One alternative under these circumstances is the development and interim use of SI curves based on expert opinion. The Delphi technique (Pill 1971; Delbecq et al. 1975; Linstone and Turoff 1975) is one method used for combining the knowledge and opinions of a group of experts. The purpose of this report is to describe how the Delphi technique may be used to develop expert-opinion-based SI curves.

Scientific framework for research on disaster and mass casualty incident in Korea: building consensus using Delphi method.

PubMed

Kim, Chu Hyun; Park, Ju Ok; Park, Chang Bae; Kim, Seong Chun; Kim, Soo Jin; Hong, Ki Jeong

2014-01-01

We aimed to determine the scientific framework for research on disaster and mass casualty incident (MCI) in Korea, especially Korean terminology, feasible definition, and epidemiologic indices. The two staged policy Delphi method was performed by instructors of National Disaster Life Support (NDLS®) with the constructed questionnaire containing items based on the literature review. The first-stage survey was conducted by 11 experts through two rounds of survey for making issue and option. The second-stage survey was conducted by 35 experts for making a generalized group based consensus. Experts were selected among instructors of National Disaster Life Support Course. Through two staged Delphi survey experts made consensus: 1) the Korean terminology "jaenan" with "disaster" and "dajung-sonsang-sago" with "MCI"; 2) the feasible definition of "disaster" as the events that have an effect on one or more municipal local government area (city-county-district) or results in ≥ 10 of death or ≥ 50 injured victims; 3) the feasible definition of MCI as the events that result in ≥ 6 casualties including death; 4) essential 31 epidemiologic indices. Experts could determine the scientific framework in Korea for research on disaster medicine, considering the distinct characteristics of Korea and current research trends.

Developing a Canadian Curriculum for Simulation-Based Education in Obstetrics and Gynaecology: A Delphi Study.

PubMed

Craig, Catherine; Posner, Glenn D

2017-09-01

As obstetrics and gynaecology (Ob/Gyn) residency training programs move towards a competence-based approach to training and assessment, the development of a national standardized simulation curriculum is essential. The primary goal of this study was to define the fundamental content for the Canadian Obstetrics and Gynecology Simulation curriculum. A modified Delphi technique was used to achieve consensus in three rounds by surveying residency program directors or their local simulation educator delegates in 16 accredited Canadian Ob/Gyn residency programs. A consensus rate of 80% was agreed upon. Survey results were collected over 11 months in 2016. Response rates for the Delphi were 50% for the first round, 81% for the second round, and 94% for the third round. The first survey resulted in 84 suggested topics. These were organized into four categories: obstetrics high acuity low frequency events, obstetrics common events, gynaecology high acuity low frequency events, and gynaecology common events. Using the modified Delphi method, consensus was reached on 6 scenarios. This study identified the content for a national simulation-based curriculum for Ob/Gyn residency training programs and is the first step in the development of this curriculum. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

European undergraduate curriculum in geriatric medicine developed using an international modified Delphi technique

PubMed Central

Masud, Tahir; Blundell, Adrian; Gordon, Adam Lee; Mulpeter, Ken; Roller, Regina; Singler, Katrin; Goeldlin, Adrian; Stuck, Andreas

2014-01-01

Introduction: the rise in the number of older, frail adults necessitates that future doctors are adequately trained in the skills of geriatric medicine. Few countries have dedicated curricula in geriatric medicine at the undergraduate level. The aim of this project was to develop a consensus among geriatricians on a curriculum with the minimal requirements that a medical student should achieve by the end of medical school. Methods: a modified Delphi process was used. First, educational experts and geriatricians proposed a set of learning objectives based on a literature review. Second, three Delphi rounds involving a panel with 49 experts representing 29 countries affiliated to the European Union of Medical Specialists (UEMS) was used to gain consensus for a final curriculum. Results: the number of disagreements following Delphi Rounds 1 and 2 were 81 and 53, respectively. Complete agreement was reached following the third round. The final curriculum consisted of detailed objectives grouped under 10 overarching learning outcomes. Discussion: a consensus on the minimum requirements of geriatric learning objectives for medical students has been agreed by European geriatricians. Major efforts will be needed to implement these requirements, given the large variation in the quality of geriatric teaching in medical schools. This curriculum is a first step to help improve teaching of geriatrics in medical schools, and will also serve as a basis for advancing postgraduate training in geriatrics across Europe. PMID:24603283

Determination of Problematic ICD-9-CM Subcategories for Further Study of Coding Performance: Delphi Method

PubMed Central

Zeng, Xiaoming; Bell, Paul D

2011-01-01

In this study, we report on a qualitative method known as the Delphi method, used in the first part of a research study for improving the accuracy and reliability of ICD-9-CM coding. A panel of independent coding experts interacted methodically to determine that the three criteria to identify a problematic ICD-9-CM subcategory for further study were cost, volume, and level of coding confusion caused. The Medicare Provider Analysis and Review (MEDPAR) 2007 fiscal year data set as well as suggestions from the experts were used to identify coding subcategories based on cost and volume data. Next, the panelists performed two rounds of independent ranking before identifying Excisional Debridement as the subcategory that causes the most confusion among coders. As a result, they recommended it for further study aimed at improving coding accuracy and variation. This framework can be adopted at different levels for similar studies in need of a schema for determining problematic subcategories of code sets. PMID:21796264

Pathways to Lean Software Development: An Analysis of Effective Methods of Change

ERIC Educational Resources Information Center

Hanson, Richard D.

2014-01-01

This qualitative Delphi study explored the challenges that exist in delivering software on time, within budget, and with the original scope identified. The literature review identified many attempts over the past several decades to reform the methods used to develop software. These attempts found that the classical waterfall method, which is…

Global priorities for research and the relative importance of different research outcomes: an international Delphi survey of malaria research experts.

PubMed

Mulligan, Jo-Ann; Conteh, Lesong

2016-12-06

As global research investment increases, attention inevitably turns to assessing and measuring the outcomes and impact from research programmes. Research can have many different outcomes such as producing advances in scientific knowledge, building research capacity and, ultimately, health and broader societal benefits. The aim of this study was to test the use of a Delphi methodology as a way of gathering views from malaria research experts on research priorities and eliciting relative valuations of the different types of health research impact. An international Delphi survey of 60 malaria research experts was used to understand views on research outcomes and priorities within malaria and across global health more widely. The study demonstrated the application of the Delphi technique to eliciting views on malaria specific research priorities, wider global health research priorities and the values assigned to different types of research impact. In terms of the most important past research successes, the development of new anti-malarial drugs and insecticide-treated bed nets were rated as the most important. When asked about research priorities for future funding, respondents ranked tackling emerging drug and insecticide resistance the highest. With respect to research impact, the panel valued research that focuses on health and health sector benefits and informing policy and product development. Contributions to scientific knowledge, although highly valued, came lower down the ranking, suggesting that efforts to move research discoveries to health products and services are valued more highly than pure advances in scientific knowledge. Although the Delphi technique has been used to elicit views on research questions in global health this was the first time it has been used to assess how a group of research experts value or rank different types of research impact. The results suggest it is feasible to inject the views of a key stakeholder group into the research prioritization process and the Delphi approach is a useful tool for eliciting views on the value or importance of research impact. Future work will explore other methods for assessing and valuing research impact and test the feasibility of developing a composite tool for measuring research outcomes weighted by the values of different stakeholders.

Establishing key components of yoga interventions for musculoskeletal conditions: a Delphi survey

PubMed Central

2014-01-01

Background Evidence suggests yoga is a safe and effective intervention for the management of physical and psychosocial symptoms associated with musculoskeletal conditions. However, heterogeneity in the components and reporting of clinical yoga trials impedes both the generalization of study results and the replication of study protocols. The aim of this Delphi survey was to address these issues of heterogeneity, by developing a list of recommendations of key components for the design and reporting of yoga interventions for musculoskeletal conditions. Methods Recognised experts involved in the design, conduct, and teaching of yoga for musculoskeletal conditions were identified from a systematic review, and invited to contribute to the Delphi survey. Forty-one of the 58 experts contacted, representing six countries, agreed to participate. A three-round Delphi was conducted via electronic surveys. Round 1 presented an open-ended question, allowing panellists to individually identify components they considered key to the design and reporting of yoga interventions for musculoskeletal conditions. Thematic analysis of Round 1 identified items for quantitative rating in Round 2; items not reaching consensus were forwarded to Round 3 for re-rating. Results Thirty-six panellists (36/41; 88%) completed the three rounds of the Delphi survey. Panellists provided 348 comments to the Round 1 question. These comments were reduced to 49 items, grouped under five themes, for rating in subsequent rounds. A priori group consensus of ≥80% was reached on 28 items related to five themes concerning defining the yoga intervention, types of yoga practices to include in an intervention, delivery of the yoga protocol, domains of outcome measures, and reporting of yoga interventions for musculoskeletal conditions. Additionally, a priori consensus of ≥50% was reached on five items relating to minimum values for intervention parameters. Conclusions Expert consensus has provided a non-prescriptive reference list for the design and reporting of yoga interventions for musculoskeletal conditions. It is anticipated future research incorporating the Delphi guidelines will facilitate high quality international research in this field, increase homogeneity of intervention components and parameters, and enhance the comparison and reproducibility of research into the use of yoga for the management of musculoskeletal conditions. PMID:24942270

EURECCA colorectal: multidisciplinary mission statement on better care for patients with colon and rectal cancer in Europe.

PubMed

van de Velde, Cornelis J H; Aristei, Cynthia; Boelens, Petra G; Beets-Tan, Regina G H; Blomqvist, Lennart; Borras, Josep M; van den Broek, Colette B M; Brown, Gina; Coebergh, Jan-Willem; Cutsem, Eric Van; Espin, Eloy; Gore-Booth, Jola; Glimelius, Bengt; Haustermans, Karin; Henning, Geoffrey; Iversen, Lene H; Han van Krieken, J; Marijnen, Corrie A M; Mroczkowski, Pawel; Nagtegaal, Iris; Naredi, Peter; Ortiz, Hector; Påhlman, Lars; Quirke, Philip; Rödel, Claus; Roth, Arnaud; Rutten, Harm J T; Schmoll, Hans J; Smith, Jason; Tanis, Pieter J; Taylor, Claire; Wibe, Arne; Gambacorta, Maria Antonietta; Meldolesi, Elisa; Wiggers, Theo; Cervantes, Andres; Valentini, Vincenzo

2013-09-01

Care for patients with colon and rectal cancer has improved in the last twenty years however still considerable variation exists in cancer management and outcome between European countries. Therefore, EURECCA, which is the acronym of European Registration of cancer care, is aiming at defining core treatment strategies and developing a European audit structure in order to improve the quality of care for all patients with colon and rectal cancer. In December 2012 the first multidisciplinary consensus conference about colon and rectum was held looking for multidisciplinary consensus. The expert panel consisted of representatives of European scientific organisations involved in cancer care of patients with colon and rectal cancer and representatives of national colorectal registries. The expert panel had delegates of the European Society of Surgical Oncology (ESSO), European Society for Radiotherapy & Oncology (ESTRO), European Society of Pathology (ESP), European Society for Medical Oncology (ESMO), European Society of Radiology (ESR), European Society of Coloproctology (ESCP), European CanCer Organisation (ECCO), European Oncology Nursing Society (EONS) and the European Colorectal Cancer Patient Organisation (EuropaColon), as well as delegates from national registries or audits. Experts commented and voted on the two web-based online voting rounds before the meeting (between 4th and 25th October and between the 20th November and 3rd December 2012) as well as one online round after the meeting (4th-20th March 2013) and were invited to lecture on the subjects during the meeting (13th-15th December 2012). The sentences in the consensus document were available during the meeting and a televoting round during the conference by all participants was performed. All sentences that were voted on are available on the EURECCA website www.canceraudit.eu. The consensus document was divided in sections describing evidence based algorithms of diagnostics, pathology, surgery, medical oncology, radiotherapy, and follow-up where applicable for treatment of colon cancer, rectal cancer and stage IV separately. Consensus was achieved using the Delphi method. The total number of the voted sentences was 465. All chapters were voted on by at least 75% of the experts. Of the 465 sentences, 84% achieved large consensus, 6% achieved moderate consensus, and 7% resulted in minimum consensus. Only 3% was disagreed by more than 50% of the members. It is feasible to achieve European Consensus on key diagnostic and treatment issues using the Delphi method. This consensus embodies the expertise of professionals from all disciplines involved in the care for patients with colon and rectal cancer. Diagnostic and treatment algorithms were developed to implement the current evidence and to define core treatment guidance for multidisciplinary team management of colon and rectal cancer throughout Europe. Copyright © 2013 Elsevier Ltd. All rights reserved.

Standardised method for reporting exercise programmes: protocol for a modified Delphi study.

PubMed

Slade, Susan C; Dionne, Clermont E; Underwood, Martin; Buchbinder, Rachelle

2014-12-30

Exercise is integral to health across the lifespan and important for people with chronic health conditions. A systematic review of exercise trials for chronic conditions reported suboptimal descriptions of the evaluated interventions and concluded that this hinders interpretation and replication. The aim of this project is to develop a standardised method for reporting essential exercise programme details being evaluated in clinical trials. A modified Delphi technique will be used to gain consensus among international exercise experts. We will use three sequential rounds of anonymous online questionnaires to refine a standardised checklist. A draft checklist of potentially relevant items was developed based on the results of a systematic review of exercise systematic reviews. An international panel of experts was identified by exercise systematic review authorship, established international profile in exercise research and practice and by peer referral. In round 1, the international panel of experts will be asked to rate the importance of each draft item and provide additional suggestions for revisions or new items. Consensus will be considered reached if at least 70% of the panel strongly agree/disagree that an item should be included or excluded. Where agreement is not reached or there are suggestions for altered or new items, these will be taken to round 2 together with an aggregated summary of round 1 responses. Following the second round, a ranking of item importance will be made to rationalise the number of items. The final template will be distributed to panel members for approval. Ethics approval was received from The Cabrini Institute Ethics Committee, Melbourne, Australia (HREC 02-07-04-14). We plan to use a stepwise process to develop and refine a standardised and internationally agreed template for explicit reporting of exercise programmes. The template will be generalisable across all types of exercise interventions. The findings will be disseminated through peer-reviewed publications and conference presentations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Determining Possible Professionals and Respective Roles and Responsibilities for a Model Comprehensive Elder Abuse Intervention: A Delphi Consensus Survey

PubMed Central

Du Mont, Janice; Kosa, Daisy; Macdonald, Sheila; Elliot, Shannon; Yaffe, Mark

2015-01-01

Objective We have undertaken a multi-phase, multi-method program of research to develop, implement, and evaluate a comprehensive hospital-based nurse examiner elder abuse intervention that addresses the complex functional, social, forensic, and medical needs of older women and men. In this study, we determined the importance of possible participating professionals and respective roles and responsibilities within the intervention. Methods Using a modified Delphi methodology, recommended professionals and their associated roles and responsibilities were generated from a systematic scoping review of relevant scholarly and grey literatures. These items were reviewed, new items added for review, and rated/re-rated for their importance to the intervention on a 5-point Likert scale by an expert panel during a one day in-person meeting. Items that did not achieve consensus were subsequently re-rated in an online survey. Analysis Those items that achieved a mean Likert rating of 4+ (rated important to very important), and an interquartile range<1 in the first or second round, and/or for which 80% of ratings were 4+ in the second round were retained for the model elder abuse intervention. Results Twenty-two of 31 recommended professionals and 192 of 229 recommended roles and responsibilities rated were retained for our model elder abuse intervention. Retained professionals were: public guardian and trustee (mean rating = 4.88), geriatrician (4.87), police officer (4.87), GEM (geriatric emergency management) nurse (4.80), GEM social worker (4.78), community health worker (4.76), social worker/counsellor (4.74), family physician in community (4.71), paramedic (4.65), financial worker (4.59), lawyer (4.59), pharmacist (4.59), emergency physician (4.57), geriatric psychiatrist (4.33), occupational therapist (4.29), family physician in hospital (4.28), Crown prosecutor (4.24), neuropsychologist (4.24), bioethicist (4.18), caregiver advocate (4.18), victim support worker (4.18), and respite care worker (4.12). Conclusion A large and diverse group of multidisciplinary, intersectoral collaborators was deemed necessary to address the complex needs of abused older adults, each having important roles and responsibilities to fulfill within a model comprehensive elder abuse intervention. PMID:26630030

Project evaluation and selection using fuzzy Delphi method and zero - one goal programming

NASA Astrophysics Data System (ADS)

Alias, Suriana; Adna, Nofarziah; Arsad, Roslah; Soid, Siti Khuzaimah; Ali, Zaileha Md

2014-12-01

Project evaluation and selection is a factor affecting the impotence of board director in which is trying to maximize all the possible goals. Assessment of the problem occurred in organization plan is the first phase for decision making process. The company needs a group of expert to evaluate the problems. The Fuzzy Delphi Method (FDM) is a systematic procedure to evoke the group's opinion in order to get the best result to evaluate the project performance. This paper proposes an evaluation and selection of the best alternative project based on combination of FDM and Zero - One Goal Programming (ZOGP) formulation. ZOGP is used to solve the multi-criteria decision making for final decision part by using optimization software LINDO 6.1. An empirical example on an ongoing decision making project in Johor, Malaysia is implemented for case study.

Core competency model for the family planning public health nurse.

PubMed

Hewitt, Caroline M; Roye, Carol; Gebbie, Kristine M

2014-01-01

A core competency model for family planning public health nurses has been developed, using a three stage Delphi Method with an expert panel of 40 family planning senior administrators, community/public health nursing faculty and seasoned family planning public health nurses. The initial survey was developed from the 2011 Title X Family Planning program priorities. The 32-item survey was distributed electronically via SurveyMonkey(®). Panelist attrition was low, and participation robust resulting in the final 28-item model, suggesting that the Delphi Method was a successful technique through which to achieve consensus. Competencies with at least 75% consensus were included in the model and those competencies were primarily related to education/counseling and administration of medications and contraceptives. The competencies identified have implications for education/training, certification and workplace performance. © 2014 Wiley Periodicals, Inc.

Using a Delphi process to define priorities for prison health research in Canada.

PubMed

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-14

A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators' professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

The U. S. transportation sector in the year 2030: results of a two-part Delphi survey.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Morrison, G.; Stephens, T.S.; Univ. of California at Davis)

2011-10-11

A two-part Delphi Survey was given to transportation experts attending the Asilomar Conference on Transportation and Energy in August, 2011. The survey asked respondents about trends in the US transportation sector in 2030. Topics included: alternative vehicles, high speed rail construction, rail freight transportation, average vehicle miles traveled, truck versus passenger car shares, vehicle fuel economy, and biofuels in different modes. The survey consisted of two rounds -- both asked the same set of seven questions. In the first round, respondents were given a short introductory paragraph about the topic and asked to use their own judgment in their responses.more » In the second round, the respondents were asked the same questions, but were also given results from the first round as guidance. The survey was sponsored by Argonne National Lab (ANL), the National Renewable Energy Lab (NREL), and implemented by University of California at Davis, Institute of Transportation Studies. The survey was part of the larger Transportation Energy Futures (TEF) project run by the Department of Energy, Office of Energy Efficiency and Renewable Energy. Of the 206 invitation letters sent, 94 answered all questions in the first round (105 answered at least one question), and 23 of those answered all questions in the second round. 10 of the 23 second round responses were at a discussion section at Asilomar, while the remaining were online. Means and standard deviations of responses from Round One and Two are given in Table 1 below. One main purpose of Delphi surveys is to reduce the variance in opinions through successive rounds of questioning. As shown in Table 1, the standard deviations of 25 of the 30 individual sub-questions decreased between Round One and Round Two, but the decrease was slight in most cases.« less

Identifying research priorities for patient safety in mental health: an international expert Delphi study.

PubMed

Dewa, Lindsay H; Murray, Kevin; Thibaut, Bethan; Ramtale, Sonny Christian; Adam, Sheila; Darzi, Ara; Archer, Stephanie

2018-03-03

Physical healthcare has dominated the patient safety field; research in mental healthcare is not as extensive but findings from physical healthcare cannot be applied to mental healthcare because it delivers specialised care that faces unique challenges. Therefore, a clearer focus and recognition of patient safety in mental health as a distinct research area is still needed. The study aim is to identify future research priorities in the field of patient safety in mental health. Semistructured interviews were conducted with the experts to ascertain their views on research priorities in patient safety in mental health. A three-round online Delphi study was used to ascertain consensus on 117 research priority statements. Academic and service user experts from the USA, UK, Switzerland, Netherlands, Ireland, Denmark, Finland, Germany, Sweden, Australia, New Zealand and Singapore were included. Agreement in research priorities on a five-point scale. Seventy-nine statements achieved consensus (>70%). Three out of the top six research priorities were patient driven; experts agreed that understanding the patient perspective on safety planning, on self-harm and on medication was important. This is the first international Delphi study to identify research priorities in safety in the mental field as determined by expert academic and service user perspectives. A reasonable consensus was obtained from international perspectives on future research priorities in patient safety in mental health; however, the patient perspective on their mental healthcare is a priority. The research agenda for patient safety in mental health identified here should be informed by patient safety science more broadly and used to further establish this area as a priority in its own right. The safety of mental health patients must have parity with that of physical health patients to achieve this. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

78 FR 48468 - Delphi Corporation, Electronics and Safety Division, Including On-Site Leased Workers From...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-08

..., Electronics and Safety Division, Including On-Site Leased Workers From Securitas, Bartech, Flint Janitorial... Adjustment Assistance on May 20, 2013, applicable to workers of Delphi Corporation, Electronics and Safety... on- site at the Flint, Michigan location of Delphi Corporation, Electronics and Safety Division. The...

75 FR 20383 - Delphi Thermal Systems Currently Known as General Motors Components Holdings LLC, Lockport...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-19

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-63,818] Delphi Thermal Systems... 25, 2008, applicable to workers of Delphi Thermal Systems, Lockport Operations, Lockport, New York... workers are engaged in activities related to the production of automotive heat exchanger products and HVAC...

Climate Change Impacts and Vulnerability Assessment in Industrial Complexes

NASA Astrophysics Data System (ADS)

Lee, H. J.; Lee, D. K.

2016-12-01

Climate change has recently caused frequent natural disasters, such as floods, droughts, and heat waves. Such disasters have also increased industrial damages. We must establish climate change adaptation policies to reduce the industrial damages. It is important to make accurate vulnerability assessment to establish climate change adaptation policies. Thus, this study aims at establishing a new index to assess vulnerability level in industrial complexes. Most vulnerability indices have been developed with subjective approaches, such as the Delphi survey and the Analytic Hierarchy Process(AHP). The subjective approaches rely on the knowledge of a few experts, which provokes the lack of the reliability of the indices. To alleviate the problem, we have designed a vulnerability index incorporating objective approaches. We have investigated 42 industrial complex sites in Republic of Korea (ROK). To calculate weights of variables, we used entropy method as an objective method integrating the Delphi survey as a subjective method. Finally, we found our method integrating both subjective method and objective method could generate result. The integration of the entropy method enables us to assess the vulnerability objectively. Our method will be useful to establish climate change adaptation policies by reducing the uncertainties of the methods based on the subjective approaches.

DELPHI: An introduction to output layout and data content

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, C.F.

1994-08-16

DELPHI was the data summary and interpretation code used by gas diagnostics personnel during the period from 1968 through 1986. It was written by Floyd Momyer, and went through several revisions during its period of use. Described here is the final version, which provided the most extensive set of summary tables. Earlier versions of the code lacked some of the capabilities of the final version, but what they did include was of substantially the same format. DELPHI was run against most available input decks in the mid 1980s. Microfiche and hardcopy output were generated. Both now reside in our archives.more » These reruns used modified input decks, which may not have had the proper {open_quotes}trigger{close_quotes} to instruct DELPHI to output some tables. These tables could, therefore be missing from a printout even though the necessary data was present. Also, modifications to DELPHI did, in some instances, eliminate DELPHIs` capability to correctly output some of the earlier optional tables. This monologue is intended to compliment the archived printout, and to provide enough insight so that someone unfamiliar with the techniques of Gas Diagnostics can retrieve the results at some future date. DELPHI last ran on the CDC-7600 machines, and was not converted to run on the Crays when the CDC-7600`s were decommissioned. DELPHI accepted data from various analytical systems, set up data summary tables, and combined preshot tracer and detector data with these results to calculate the total production of measured species and the indicated fission yields and detector conversions.« less

Environmental initiative prioritization with a Delphi approach: a case study.

PubMed

Gokhale, A A

2001-08-01

India is fast finding its place in the industrialized world and that is beginning to raise its environmental consciousness. The Delphi technique was used to prioritize specific needs and articulate a sustainable urban improvement strategy for the city of Mumbai (formerly Bombay). The Delphi technique is a means of achieving consensual validity among raters by providing them feedback regarding other raters' responses. Mumbai has several indigenous environmental groups that were tapped for activists and leaders; the study was conducted using ten environmentalists. In the initial phases the responses resulted in a range of possible program alternatives. The last two stages helped to seek out information that generated a consensus on the part of the respondent group. Statistical analysis methods included a hierarchical cluster analysis, mean, median, mode, and percent of agreement calculations using SPSS software. The face-to-face discussion in phase 4 clarified some issues and helped the group as a whole to outline the strategy for putting in place the essential elements of a framework to improve the quality of life in an urban environment.

Communication and social competencies in medical education in German-speaking countries: the Basel consensus statement. Results of a Delphi survey.

PubMed

Kiessling, Claudia; Dieterich, Anja; Fabry, Götz; Hölzer, Henrike; Langewitz, Wolf; Mühlinghaus, Isabel; Pruskil, Susanne; Scheffer, Simone; Schubert, Sebastian

2010-11-01

To propose a comprehensive set of competencies and educational objectives for communication and social competencies in undergraduate medical education and to support the nationwide implementation of these issues in all medical schools. Thirty experts from different medical and psychosocial disciplines participated in a 2-day workshop using the Nominal Group Technique (NGT) to develop an initial set of educational objectives. These were refined, structured, and rated according to their importance by means of a two-step Delphi Survey involving additional experts in medical education. The initial workshop resulted in 188 educational objectives assigned to 26 different topics. After the Delphi Survey, 131 objectives remained, assigned to 19 different topics. Some objectives that could be assigned to more than one topic were subsumed under a new more general category. The described consensus process proved successful as one method to develop a set of educational objectives. The Basel consensus statement can be used to orientate curriculum reform and development in medical education. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Japanese Clinical Guidelines for Endoscopic Treatment of Pancreatolithiasis.

PubMed

Inui, Kazuo; Igarashi, Yoshinori; Irisawa, Atsushi; Ohara, Hirotaka; Tazuma, Susumu; Hirooka, Yoshiki; Fujita, Naotaka; Miyakawa, Hiroyuki; Sata, Naohiro; Shimosegawa, Tooru; Tanaka, Masao; Shiratori, Keiko; Sugiyama, Masanori; Takeyama, Yoshifumi

2015-10-01

In addition to surgery, procedures for patients with pancreatolithiasis are developing; therefore, establishing practical guidelines for the management of pancreatolithiasis is required. Three committees (the professional committee for asking clinical questions (CQs) and statements by Japanese endoscopists, the expert panel committee for rating statements by the modified Delphi method, and the evaluating committee by moderators) were organized. Eight endoscopists and a surgeon for pancreatolithiasis made the CQs and statements from a total of 694 reports of published literature by PubMed search (from 1983 to 2012). The expert panelists individually rated these clinical statements using a modified Delphi approach, in which a clinical statement receiving a median score greater than 7 on a 9-point scale from the panel was regarded as valid. The professional committee made 3, 7, and 10 CQs and statements for the concept and pathogenesis, diagnosis, and treatment, respectively. The expert panelists regarded them as valid after a 2-round modified Delphi approach. After evaluation by the moderators, the Japanese clinical guidelines for pancreatolithiasis were established. Further discussions and studies for international guidelines are needed.

Using the Delphi Technique to Support Curriculum Development

ERIC Educational Resources Information Center

Sitlington, Helen Barbara; Coetzer, Alan John

2015-01-01

Purpose: The purpose of this paper is to present an analysis of the use of the Delphi technique to support curriculum development with a view to enhancing existing literature on use of the technique for renewal of business course curricula. Design/methodology/approach: The authors outline the Delphi process for obtaining consensus amongst a…

The Delphi Predictions of Pathology Chairmen: A Six-Year Retrospective View.

ERIC Educational Resources Information Center

Hill, Rolla B.; Goodale, Fairfield

1981-01-01

A retrospective review is reported of progress in academic pathology since 1974, when the Association of Pathology Chairmen undertook a Delphi study of pathology chairmen's expectations and desires for the future. The Delphi study was useful in alerting academic pathologists to opportunities and in coalescing activities toward achievement of…

Identifying Core Concepts of Cybersecurity: Results of Two Delphi Processes

ERIC Educational Resources Information Center

Parekh, Geet; DeLatte, David; Herman, Geoffrey L.; Oliva, Linda; Phatak, Dhananjay; Scheponik, Travis; Sherman, Alan T.

2018-01-01

This paper presents and analyzes results of two Delphi processes that polled cybersecurity experts to rate cybersecurity topics based on importance, difficulty, and timelessness. These ratings can be used to identify core concepts--cross-cutting ideas that connect knowledge in the discipline. The first Delphi process identified core concepts that…

Characteristics of a global classification system for perinatal deaths: a Delphi consensus study.

PubMed

Wojcieszek, Aleena M; Reinebrant, Hanna E; Leisher, Susannah Hopkins; Allanson, Emma; Coory, Michael; Erwich, Jan Jaap; Frøen, J Frederik; Gardosi, Jason; Gordijn, Sanne; Gulmezoglu, Metin; Heazell, Alexander E P; Korteweg, Fleurisca J; McClure, Elizabeth; Pattinson, Robert; Silver, Robert M; Smith, Gordon; Teoh, Zheyi; Tunçalp, Özge; Flenady, Vicki

2016-08-15

Despite the global burden of perinatal deaths, there is currently no single, globally-acceptable classification system for perinatal deaths. Instead, multiple, disparate systems are in use world-wide. This inconsistency hinders accurate estimates of causes of death and impedes effective prevention strategies. The World Health Organisation (WHO) is developing a globally-acceptable classification approach for perinatal deaths. To inform this work, we sought to establish a consensus on the important characteristics of such a system. A group of international experts in the classification of perinatal deaths were identified and invited to join an expert panel to develop a list of important characteristics of a quality global classification system for perinatal death. A Delphi consensus methodology was used to reach agreement. Three rounds of consultation were undertaken using a purpose built on-line survey. Round one sought suggested characteristics for subsequent scoring and selection in rounds two and three. The panel of experts agreed on a total of 17 important characteristics for a globally-acceptable perinatal death classification system. Of these, 10 relate to the structural design of the system and 7 relate to the functional aspects and use of the system. This study serves as formative work towards the development of a globally-acceptable approach for the classification of the causes of perinatal deaths. The list of functional and structural characteristics identified should be taken into consideration when designing and developing such a system.

Defining a Leader Role curriculum for radiation oncology: A global Delphi consensus study.

PubMed

Turner, Sandra; Seel, Matthew; Trotter, Theresa; Giuliani, Meredith; Benstead, Kim; Eriksen, Jesper G; Poortmans, Philip; Verfaillie, Christine; Westerveld, Henrike; Cross, Shamira; Chan, Ming-Ka; Shaw, Timothy

2017-05-01

The need for radiation oncologists and other radiation oncology (RO) professionals to lead quality improvement activities and contribute to shaping the future of our specialty is self-evident. Leadership knowledge, skills and behaviours, like other competencies, can be learned (Blumenthal et al., 2012). The objective of this study was to define a globally applicable competency set specific to radiation oncology for the CanMEDS Leader Role (Frank et al., 2015). A modified Delphi consensus process delivering two rounds of on-line surveys was used. Participants included trainees, radiation/clinical oncologists and other RO team members (radiation therapists, physicists, and nurses), professional educators and patients. 72 of 95 (76%) invitees from nine countries completed the Round 1 (R1) survey. Of the 72 respondents to RI, 70 completed Round 2 (R2) (97%). In R1, 35 items were deemed for 'inclusion' and 21 for 'exclusion', leaving 41 'undetermined'. After review of items, informed by participant comments, 14 competencies from the 'inclusion' group went into the final curriculum; 12 from the 'undetermined' group went to R2. In R2, 6 items reached consensus for inclusion. This process resulted in 20 RO Leader Role competencies with apparent global applicability. This is the first step towards developing learning, teaching and assessment tools for this important area of training. Copyright © 2017 Elsevier B.V. All rights reserved.

Priorities for the professional development of registered nurses in nursing homes: a Delphi study.

PubMed

Cooper, Emily; Spilsbury, Karen; McCaughan, Dorothy; Thompson, Carl; Butterworth, Tony; Hanratty, Barbara

2017-01-08

To establish a consensus on the care and professional development needs of registered nurses (RNs) employed by UK care homes. Two-stage, online modified Delphi study. A panel (n = 352) of individuals with experience, expertise or interest in care home nursing: (i) care home nurses and managers; (ii) community healthcare professionals (including general practitioners, geriatricians, specialist and district nurses); and (iii) nurse educators in higher education. RNs employed by nursing homes require particular skills, knowledge, competence and experience to provide high-quality care for older residents. The most important responsibilities for the nursing home nurse were: promoting dignity, personhood and wellbeing, ensuring resident safety and enhancing quality of life. Continuing professional development priorities included personal care, dementia care and managing long-term conditions. The main barrier to professional development was staff shortages. Nursing degree programmes were perceived as inadequately preparing nurses for a nursing home role. Nursing homes could improve by providing supportive learning opportunities for students and fostering challenging and rewarding careers for newly RNs. If nurses employed by nursing homes are not fit for purpose, the consequences for the wider health and social-care system are significant. Nursing homes, the NHS, educational and local authorities need to work together to provide challenging and rewarding career paths for RNs and evaluate them. Without well-trained, motivated staff, a high-quality care sector will remain merely an aspiration.

International consensus criteria for the diagnosis of Raynaud's phenomenon.

PubMed

Maverakis, Emanual; Patel, Forum; Kronenberg, Daniel G; Chung, Lorinda; Fiorentino, David; Allanore, Yannick; Guiducci, Serena; Hesselstrand, Roger; Hummers, Laura K; Duong, Chris; Kahaleh, Bashar; Macgregor, Alexander; Matucci-Cerinic, Marco; Wollheim, Frank A; Mayes, Maureen D; Gershwin, M Eric

2014-01-01

Vasoconstriction accompanied by changes in skin color is a normal physiologic response to cold. The distinction between this normal physiology and Raynaud's phenomenon (RP) has yet to be well characterized. In anticipation of the 9th International Congress on Autoimmunity, a panel of 12 RP experts from 9 different institutes and four different countries were assembled for a Delphi exercise to establish new diagnostic criteria for RP. Relevant investigators with highly cited manuscripts in Raynaud's-related research were identified using the Web of Science and invited to participate. Surveys at each stage were administered to participants via the on-line SurveyMonkey software tool. The participants evaluated the level of appropriateness of statements using a scale of 1 (extremely inappropriate) through 9 (extremely appropriate). In the second stage, panel participants were asked to rank rewritten items from the first round that were scored as "uncertain" for the diagnosis of RP, items with significant disagreement (Disagreement Index > 1), and new items suggested by the panel. Results were analyzed using the Interpercentile Range Adjusted for Symmetry (IPRAS) method. A 3-Step Approach to diagnose RP was then developed using items the panelists "agreed" were "appropriate" diagnostic criteria. In the final stage, the panel was presented with the newly developed diagnostic criteria and asked to rate them against previous models. Following the first two iterations of the Delphi exercise, the panel of 12 experts agreed that 36 of the items were "appropriate", 12 items had "uncertain" appropriateness, and 13 items were "inappropriate" to use in the diagnostic criteria of RP. Using an expert committee, we developed a 3-Step Approach for the diagnosis of RP and 5 additional criteria for the diagnosis of primary RP. The committee came to an agreement that the proposed criteria were "appropriate and accurate" for use by physicians to diagnose patients with RP. Published by Elsevier Ltd.

International Consensus Criteria for the Diagnosis of Raynaud’s Phenomenon

PubMed Central

Maverakis, Emanual; Patel, Forum; Kronenberg, Daniel; Chung, Lori; Fiorentino, David; Allanore, Yannick; Guiducci, Serena; Hesselstrand, Roger; Hummers, Laura; Duong, Chris; Kahaleh, Bashar; Macgregor, Alexander; Matucci-Cerinic, Marco; Wollheim, Frank; Mayes, Maureen; Gershwin, M. Eric

2014-01-01

Vasoconstriction accompanied by changes in skin color is a normal physiologic response to cold. The distinction between this normal physiology and Raynaud’s phenomenon (RP) has yet to be well characterized. In anticipation of the 9th International Congress on Autoimmunity, a panel of 12 RP experts from 9 different institutes and four different countries were assembled for a Delphi exercise to establish new diagnostic criteria for RP. Relevant investigators with highly cited manuscripts in Raynaud’s-related research were identified using the Web of Science and invited to participate. Surveys at each stage were administered to participants via the on-line SurveyMonkey software tool. The participants evaluated the level of appropriateness of statements using a scale of 1 (extremely inappropriate) through 9 (extremely appropriate). In the second stage, panel participants were asked to rank rewritten items from the first round that were scored as “uncertain” for the diagnosis of RP, items with significant disagreement (Disagreement Index > 1), and new items suggested by the panel. Results were analyzed using the Interpercentile Range Adjusted for Symmetry (IPRAS) method. A 3-Step Approach to diagnose RP was then developed using items the panelists “agreed” were “appropriate” diagnostic criteria. In the final stage, the panel was presented with the newly developed diagnostic criteria and asked to rate them against previous models. Following the first two iterations of the Delphi exercise, the panel of 12 experts agreed that 36 of the items were “appropriate,” 12 items had “uncertain” appropriateness, and 13 items were “inappropriate” to use in the diagnostic criteria of RP. Using an expert committee, we developed a 3-Step Approach for the diagnosis of RP and 5 additional criteria for the diagnosis of primary RP. The committee came to an agreement that the proposed criteria were “appropriate and accurate” for use by physicians to diagnose patients with RP. PMID:24491823

Exploring areas of consensus and conflict around values underpinning public involvement in health and social care research: a modified Delphi study

PubMed Central

Snape, D; Kirkham, J; Preston, J; Popay, J; Britten, N; Collins, M; Froggatt, K; Gibson, A; Lobban, F; Wyatt, K; Jacoby, A

2014-01-01

Objective There is growing interest in the potential benefits of public involvement (PI) in health and social care research. However, there has been little examination of values underpinning PI or how these values might differ for different groups with an interest in PI in the research process. We aimed to explore areas of consensus and conflict around normative, substantive and process-related values underpinning PI. Design Mixed method, three-phase, modified Delphi study, conducted as part of a larger multiphase project. Setting The UK health and social care research community. Participants Stakeholders in PI in research, defined as: clinical and non-clinical academics, members of the public, research managers, commissioners and funders; identified via research networks, online searches and a literature review. Results We identified high levels of consensus for many normative, substantive and process-related issues. However, there were also areas of conflict in relation to issues of bias and representativeness, and around whether the purpose of PI in health and social care research is to bring about service change or generate new knowledge. There were large differences by group in the percentages endorsing the ethical justification for PI and the argument that PI equalises power imbalances. With regard to practical implementation of PI, research support infrastructures were reported as lacking. Participants reported shortcomings in the uptake and practice of PI. Embedding PI practice and evaluation in research study designs was seen as fundamental to strengthening the evidence base. Conclusions Our findings highlight the extent to which PI is already embedded in research. However, they also highlight a need for ‘best practice’ standards to assist research teams to understand, implement and evaluate PI. These findings have been used in developing a Public Involvement Impact Assessment Framework (PiiAF), which offers guidance to researchers and members of the public involved in the PI process. PMID:24413356

Development and Validation of the Bicultural Youth Acculturation Questionnaire

PubMed Central

Kukaswadia, Atif; Janssen, Ian; Pickett, William; Bajwa, Jasmine; Georgiades, Katholiki; Lalonde, Richard N.; Quon, Elizabeth C.; Safdar, Saba; Pike, Ian

2016-01-01

Objectives Acculturation is a multidimensional process involving changes in behaviour and beliefs. Questionnaires developed to measure acculturation are typically designed for specific ethnic populations and adult experiences. This study developed a questionnaire that measures acculturation among ethnically diverse populations of youth that can be included as a module in population surveys. Methods Questionnaires measuring acculturation in youth were identified in the literature. The importance of items from the existing questionnaires was determined using a Delphi process and this informed the development of our questionnaire. The questionnaire was then pilot tested using a sample of 248 Canadians aged 18–25 via an online system. Participants identified as East and South East Asian (27.8%), South Asian (17.7%) and Black (13.7%). The majority were 1st (33.5%) or 2nd generation immigrants (52.0%). After redundant items were eliminated, exploratory factor analysis grouped items into domains, and, for each domain, internal consistency, and convergent validity with immigrant generation then age at immigration estimated. A subset of participants re-completed the questionnaire for reliability estimation. Results The literature review yielded 117 articles that used 13 questionnaires with a total of 440 questions. The Delphi process reduced these to 32 questions. Pilot testing occurred in 248 Canadians aged 18–25. Following item reduction, 16 questions in three domains remained: dominant culture, heritage language, and heritage culture. All had good internal consistency (Cronbach’s alphas > .75). The mean dominant domain score increased with immigrant generation (1st generation: 3.69 (95% CI: 3.49–3.89), 2nd: 4.13 (4.00–4.26), 3rd: 4.40 (4.19–4.61)), and mean heritage language score was higher among those who immigrated after age 12 than before (p = .0001), indicative of convergent validity. Conclusions This Bicultural Youth Acculturation Questionnaire has demonstrated validity. It can be incorporated into population health surveys to elucidate the impact of acculturation on health outcomes among bicultural youth. PMID:27557080

The Importance of Integration of Stakeholder Views in Core Outcome Set Development: Otitis Media with Effusion in Children with Cleft Palate.

PubMed

Harman, Nicola L; Bruce, Iain A; Kirkham, Jamie J; Tierney, Stephanie; Callery, Peter; O'Brien, Kevin; Bennett, Alex M D; Chorbachi, Raouf; Hall, Per N; Harding-Bell, Anne; Parfect, Victoria H; Rumsey, Nichola; Sell, Debbie; Sharma, Ravi; Williamson, Paula R

2015-01-01

Approximately 75% of children with cleft palate (CP) have Otitis Media with Effusion (OME) histories. Evidence for the effective management of OME in these children is lacking. The inconsistency in outcome measurement in previous studies has led to a call for the development of a Core Outcome Set (COS). Despite the increase in the number of published COS, involvement of patients in the COS development process, and methods to integrate the views of patients and health professionals, to date have been limited. A list of outcomes measured in previous research was identified through reviewing the literature. Opinion on the importance of each of these outcomes was then sought from key stakeholders: Ear, Nose and Throat (ENT) surgeons, audiologists, cleft surgeons, speech and language therapists, specialist cleft nurses, psychologists, parents and children. The opinion of health professionals was sought in a three round Delphi survey where participants were asked to score each outcome using a bespoke online system. Parents and children were also asked to score outcomes in a survey and provided an in-depth insight into having OME through semi-structured interviews. The results of the Delphi survey, interviews and parent/patient survey were brought together in a final consensus meeting with representation from all stakeholders. A final set of eleven outcomes reached the definition of "consensus in" to form the recommended COS: hearing; chronic otitis media (COM); OME; receptive language skills; speech development; psycho social development; acute otitis media (AOM); cholesteatoma; side effects of treatment; listening skills; otalgia. We have produced a recommendation about the outcomes that should be measured, as a minimum, in studies of the management of OME in children with CP. The development process included input from key stakeholders and used novel methodology to integrate the opinion of healthcare professionals, parents and children.

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors

PubMed Central

Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

Background The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Methods Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. Findings All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. Conclusions This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention. PMID:26726801

From the Medical Board of the National Psoriasis Foundation: Treatment targets for plaque psoriasis.

PubMed

Armstrong, April W; Siegel, Michael P; Bagel, Jerry; Boh, Erin E; Buell, Megan; Cooper, Kevin D; Callis Duffin, Kristina; Eichenfield, Lawrence F; Garg, Amit; Gelfand, Joel M; Gottlieb, Alice B; Koo, John Y M; Korman, Neil J; Krueger, Gerald G; Lebwohl, Mark G; Leonardi, Craig L; Mandelin, Arthur M; Menter, M Alan; Merola, Joseph F; Pariser, David M; Prussick, Ronald B; Ryan, Caitriona; Shah, Kara N; Weinberg, Jeffrey M; Williams, MaryJane O U; Wu, Jashin J; Yamauchi, Paul S; Van Voorhees, Abby S

2017-02-01

An urgent need exists in the United States to establish treatment goals in psoriasis. We aim to establish defined treatment targets toward which clinicians and patients with psoriasis can strive to inform treatment decisions, reduce disease burden, and improve outcomes in practice. The National Psoriasis Foundation conducted a consensus-building study among psoriasis experts using the Delphi method. The process consisted of: (1) literature review, (2) pre-Delphi question selection and input from general dermatologists and patients, and (3) 4 Delphi rounds. A total of 25 psoriasis experts participated in the Delphi process. The most preferred instrument was body surface area (BSA). The most preferred time for evaluating patient response after starting new therapies was at 3 months. The acceptable response at 3 months postinitiation was either BSA 3% or less or BSA improvement 75% or more from baseline. The target response at 3 months postinitiation was BSA 1% or less. During the maintenance period, evaluation every 6 months was most preferred. The target response at every 6 months maintenance evaluation is BSA 1% or less. Although BSA is feasible in practice, it does not encompass health-related quality of life, costs, and risks of side effects. With defined treatment targets, clinicians and patients can regularly evaluate treatment responses and perform benefit-risk assessments of therapeutic options individualized to the patient. Copyright © 2016 American Academy of Dermatology, Inc. Published by Elsevier Inc. All rights reserved.

Delphi Method Validation of a Procedural Performance Checklist for Insertion of an Ultrasound-Guided Internal Jugular Central Line.

PubMed

Hartman, Nicholas; Wittler, Mary; Askew, Kim; Manthey, David

2016-01-01

Placement of ultrasound-guided central lines is a critical skill for physicians in several specialties. Improving the quality of care delivered surrounding this procedure demands rigorous measurement of competency, and validated tools to assess performance are essential. Using the iterative, modified Delphi technique and experts in multiple disciplines across the United States, the study team created a 30-item checklist designed to assess competency in the placement of ultrasound-guided internal jugular central lines. Cronbach α was .94, indicating an excellent degree of internal consistency. Further validation of this checklist will require its implementation in simulated and clinical environments. © The Author(s) 2014.

Expert Opinion Is Necessary: Delphi Panel Methodology Facilitates a Scientific Approach to Consensus.

PubMed

Hohmann, Erik; Brand, Jefferson C; Rossi, Michael J; Lubowitz, James H

2018-02-01

Our current trend and focus on evidence-based medicine is biased in favor of randomized controlled trials, which are ranked highest in the hierarchy of evidence while devaluing expert opinion, which is ranked lowest in the hierarchy. However, randomized controlled trials have weaknesses as well as strengths, and no research method is flawless. Moreover, stringent application of scientific research techniques, such as the Delphi Panel methodology, allows survey of experts in a high quality and scientific manner. Level V evidence (expert opinion) remains a necessary component in the armamentarium used to determine the answer to a clinical question. Copyright © 2017 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Study plan to identify long term national telecommunications need and priorities applying Delphi techniques (handbook). [technological forecasting - United States of America

NASA Technical Reports Server (NTRS)

1974-01-01

A handbook that explains the basic Delphi methodology and discusses modified Delphi techniques is presented. The selection of communications experts to participate in a study, the construction of questionnaires on potential communications developments, and requisite technology is treated. No two modified Delphi studies were the same, which reflects the flexibility and adaptability of the technique. Each study must be specifically tailored to a particular case, and consists of seeking a consensus of opinion among experts about a particular subject and attendant conditions that may prevail in the future.

Alternative method of highway traffic safety analysis for developing countries using delphi technique and Bayesian network.

PubMed

Mbakwe, Anthony C; Saka, Anthony A; Choi, Keechoo; Lee, Young-Jae

2016-08-01

Highway traffic accidents all over the world result in more than 1.3 million fatalities annually. An alarming number of these fatalities occurs in developing countries. There are many risk factors that are associated with frequent accidents, heavy loss of lives, and property damage in developing countries. Unfortunately, poor record keeping practices are very difficult obstacle to overcome in striving to obtain a near accurate casualty and safety data. In light of the fact that there are numerous accident causes, any attempts to curb the escalating death and injury rates in developing countries must include the identification of the primary accident causes. This paper, therefore, seeks to show that the Delphi Technique is a suitable alternative method that can be exploited in generating highway traffic accident data through which the major accident causes can be identified. In order to authenticate the technique used, Korea, a country that underwent similar problems when it was in its early stages of development in addition to the availability of excellent highway safety records in its database, is chosen and utilized for this purpose. Validation of the methodology confirms the technique is suitable for application in developing countries. Furthermore, the Delphi Technique, in combination with the Bayesian Network Model, is utilized in modeling highway traffic accidents and forecasting accident rates in the countries of research. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development of quality indicators to evaluate antibiotic treatment of patients with community-acquired pneumonia in Indonesia.

PubMed

Farida, Helmia; Rondags, Angelique; Gasem, M Hussein; Leong, Katharina; Adityana, A; van den Broek, Peterhans J; Keuter, Monique; Natsch, Stephanie

2015-04-01

To develop an instrument for evaluating the quality of antibiotic management of patients with community-acquired pneumonia (CAP) applicable in a middle-income developing country. A previous study and Indonesian guidelines were reviewed to derive potential quality of care indicators (QIs). An expert panel performed a two-round Delphi consensus procedure on the QI's relevance to patient recovery, reduction of antimicrobial resistance and cost containment. Applicability in practice, including reliability, feasibility and opportunity for improvement, was determined in a data set of 128 patients hospitalised with CAP in Semarang, Indonesia. Fifteen QIs were selected by the consensus procedure. Five QIs did not pass feasibility criteria, because of inappropriate documentation, inefficient laboratory services or patient factors. Three QIs provided minor opportunity for improvement. Two QIs contradicted each other; one of these was considered not valid and excluded. A final set of six QIs was defined for use in the Indonesian setting. Using the Delphi method, we defined a list of QIs for assessing the quality of care, in particular antibiotic treatment, for CAP in Indonesia. For further improvement, a modified Delphi method that includes discussion, a sound medical documentation system, improvement of microbiology laboratory services, and multi-center applicability tests are needed to develop a valid and applicable QI list for the Indonesian setting. © 2014 John Wiley & Sons Ltd.

76 FR 46852 - Workers From Kelly Services, Working On-Site at Delphi Automotive Systems, LLC, Powertrain...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-03

... Services, Working On-Site at Delphi Automotive Systems, LLC, Powertrain Division, El Paso, TX; Amended..., 2011, applicable to leased workers from Kelly Services working on-site at Delphi Automotive Systems... automotive components. The notice will be published soon in the Federal Register. At the request of the State...

Lessons Learned from Teaching Scratch as an Introduction to Object-Oriented Programming in Delphi

ERIC Educational Resources Information Center

van Zyl, Sukie; Mentz, Elsa; Havenga, Marietjie

2016-01-01

As part of curriculum changes in South Africa, an introductory programming language, Scratch, must first be taught before switching to the well-established teaching of Delphi. The nature of programming in Scratch is considerably different from that in Delphi. It was assumed that the teaching of Scratch as introductory programming language could…

What Is Next for Functional Requirements for Bibliographic Records? A Delphi Study

ERIC Educational Resources Information Center

Zhang, Yin; Salaba, Athena

2009-01-01

This article reports on a Delphi study conducted to determine key issues and challenges facing Functional Requirements for Bibliographic Records (FRBR) research and practice. The Delphi panel consisted of thirty-three experts in the field who participated in a three-round issue-raising and consensus-building process via a Web-based survey…

Advantages and Limitations of the e-Delphi Technique: Implications for Health Education Researchers

ERIC Educational Resources Information Center

Donohoe, Holly; Stellefson, Michael; Tennant, Bethany

2012-01-01

In the last 30 years, the application of the Delphi technique has been increasing. With the recent availability and established popularity of Internet-based research tools, the Internet has been identified as a means for mitigating Delphi limitations, maximizing its advantages, and expanding the breadth of its application. The discourse on the…

75 FR 41521 - Delphi Corporation, Automotive Holding Group, Plant 6, Currently Known as General Motors...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-16

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-62,069; TA-W-62,069A] Delphi Corporation, Automotive Holding Group, Plant 6, Currently Known as General Motors Corporation Including On-Site Leased Workers From Securitas, EDS, Bartech, Mays Chemicals, Interim Physicians, LLC and HSS Material Management, Flint, MI; Delphi...

Working towards consensus on methods used to elicit participant-reported safety data in uncomplicated malaria clinical drug studies: a Delphi technique study.

PubMed

Mandimika, Nyaradzo; Barnes, Karen I; Chandler, Clare I R; Pace, Cheryl; Allen, Elizabeth N

2017-01-28

Eliciting adverse event (AE) and non-study medication data reports from clinical research participants is integral to evaluating drug safety. However, using different methods to question participants yields inconsistent results, compromising the interpretation, comparison and pooling of data across studies. This is particularly important given the widespread use of anti-malarials in vulnerable populations, and their increasing use in healthy, but at-risk individuals, as preventive treatment or to reduce malaria transmission. Experienced and knowledgeable anti-malarial drug clinical researchers were invited to participate in a Delphi technique study, to facilitate consensus on what are considered optimal (relevant, important and feasible) methods, tools, and approaches for detecting participant-reported AE and non-study medication data in uncomplicated malaria treatment studies. Of 72 invited, 25, 16 and 10 panellists responded to the first, second and third rounds of the Delphi, respectively. Overall, 68% (68/100) of all questioning items presented for rating achieved consensus. When asking general questions about health, panellists agreed on the utility of a question/concept about any change in health, taking care to ensure that such questions/concepts do not imply causality. Eighty-nine percent (39/44) of specific signs and symptoms questions were rated as optimal. For non-study medications, a general question and most structured questioning items were considered an optimal approach. The use of mobile phones, patient diaries, rating scales as well as openly engaging with participants to discuss concerns were also considered optimal complementary data-elicitation tools. This study succeeded in reaching consensus within a section of the anti-malarial drug clinical research community about using a general question concept, and structured questions for eliciting data about AEs and non-study medication reports. The concepts and items considered in this Delphi to be relevant, important and feasible should be further investigated for potential inclusion in a harmonized approach to collect participant-elicited anti-malarial drug safety data. This, in turn, should improve understanding of anti-malarial drug safety.

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists.

PubMed

Hwang, Yoon-Sook; Kang, Hyun-Sook; Kim, Soo-Hwa; Moon, Hee-Jung; Lee, Sun-Mi; Jung, Jae-Yeon; Hwang, Su-Jeong; Ha, Jung-Eun

2017-01-01

This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects' responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience.

Nursing process decision support system for urology ward.

PubMed

Hao, Angelica Te-Hui; Wu, Lee-Pin; Kumar, Ajit; Jian, Wen-Shan; Huang, Li-Fang; Kao, Ching-Chiu; Hsu, Chien-Yeh

2013-07-01

We developed a nursing process decision support system (NPDSS) based on three clinical pathways, including benign prostatic hypertrophy, inguinal hernia, and urinary tract stone. NPDSS included six major nursing diagnoses - acute pain, impaired urinary elimination, impaired skin integrity, anxiety, infection risk, and risk of falling. This paper aims to describe the design, development and validation process of the NPDSS. We deployed the Delphi method to reach consensus for decision support rules of NPDSS. A team of nine-member expert nurses from a medical center in Taiwan was involved in Delphi method. The Cronbach's α method was used for examining the reliability of the questionnaire used in the Delphi method. The Visual Basic 6.0 as front-end and Microsoft Access 2003 as back-end was used to develop the system. A team of six nursing experts was asked to evaluate the usability of the developed systems. A 5-point Likert scale questionnaire was used for the evaluation. The sensitivity and specificity of NPDSS were validated using 150 nursing chart. The study showed a consistency between the diagnoses of the developed system (NPDSS) and the nursing charts. The sensitivities of the nursing diagnoses including acute pain, impaired urinary elimination, risk of infection, and risk of falling were 96.9%, 98.1%, 94.9%, and 89.9% respectively; and the specificities were 88%, 49.5%, 62%, and 88% respectively. We did not calculate the sensitivity and specificity of impaired skin integrity and anxiety due to non-availability of enough sample size. NPDSS can help nurses in decision making of nursing diagnoses. Besides, it can help them to generate nursing diagnoses based on patient-specific data, individualized care plans, and implementation within their usual nursing workflow. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration

PubMed Central

Chan, David; Lawrence, Ben; Pavlakis, Nick; Kennecke, Hagen F.; Jackson, Christopher; Law, Calvin; Singh, Simron

2017-01-01

Purpose Neuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan. Methods A three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan. Results The Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established. Conclusion This modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field. PMID:28831446

Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment.

PubMed

Hepworth, Lauren R; Rowe, Fiona J

2018-02-01

The aim of this study was to ascertain what items stroke survivors and stroke care professionals think are important when assessing quality of life for stroke survivors with visual impairment for inclusion in the new patient-reported outcome measure. A reactive Delphi process was used in a three-round electronic-based survey. The items presented consisted of 62 items originally sourced from a systematic review of existing vision-related quality of life instruments and stroke survivor interviews, reduced and refined following a ranking exercise and pilot with stroke survivors with visual impairment. Stakeholders (stroke survivors/clinicians) were invited to take part in the process. A consensus definition of ≥70% was decided a priori. Participants were asked to rank importance on a 9-point scale and categorize the items by relevance to types of visual impairment following stroke or not relevant. Analysis of consensus, stability, and agreement was conducted. In total, 113 participants registered for the Delphi survey of which 47 (41.6%) completed all three rounds. Response rates to the three rounds were 78/113 (69.0%), 61/76 (81.3%), and 49/64 (76.6%), respectively. The participants included orthoptists (45.4%), occupational therapists (44.3%), and stroke survivors (10.3%). Consensus was reached on 56.5% of items in the three-round process, all for inclusion. A consensus was reached for 83.8% in the categorization of items. The majority (82.6%) of consensus were for relevant to 'all visual impairment following stroke'; two items were deemed 'not relevant'. The lack of item reduction achieved by this Delphi process highlights the need for additional methods of item reduction in the development of a new PROM for visual impairment following stroke. These results will be considered alongside Rasch analysis to achieve further item reduction. However, the Delphi survey remains important as it provides clinical and patient insight into each item rather than purely relying on the psychometric data.

Defining and identifying concepts of medication literacy: An international perspective.

PubMed

Pouliot, Annie; Vaillancourt, Régis; Stacey, Danielle; Suter, Philippe

2017-11-08

Multiple concepts to define health literacy in the context of medication use exist, such as medication literacy, pharmacotherapy literacy, pharmacy health literacy; however, no studies have looked at consensus among experts internationally. A Delphi process was used to achieve consensus on the statements about medication literacy. Experts for the Delphi were selected from a review of the literature and suggestions from an international survey conducted with members of the International Pharmaceutical Federation on medication literacy. The preliminary Delphi questionnaire was built using the statements about medication literacy found in the scientific literature. Responses and comments were analyzed using a pre-established method and communicated to the experts after each round of Delphi. Statements with an agreement of at least 80% were accepted and used to develop a definition of medication literacy. The Delphi process started with 21 experts and included 4 rounds. Overall, 30 statements regarding medication literacy were accepted and divided into 4 clusters representing: (1) type of information necessary for optimal and safe use of medication, (2) skills and abilities, (3) format of information, and (4) outcomes. These statements were used to propose 2 different definitions of medication literacy. One of the definitions was preferred by 75% of the expert panel, which provided further comments for improvements. Of the 11 experts who answered the final questionnaire, nine strongly agreed with the refined definition. Medication literacy is the degree to which individuals can obtain, comprehend, communicate, calculate and process patient-specific information about their medications to make informed medication and health decisions in order to safely and effectively use their medications, regardless of the mode by which the content is delivered (e.g. written, oral and visual). Future studies should focus on how this definition can be operationalized to support the role that pharmacists and other healthcare providers. Copyright © 2017 Elsevier Inc. All rights reserved.

Towards an operational definition of pharmacy clinical competency

NASA Astrophysics Data System (ADS)

Douglas, Charles Allen

The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

The STAR Data Reporting Guidelines for Clinical High Altitude Research.

PubMed

Brodmann Maeder, Monika; Brugger, Hermann; Pun, Matiram; Strapazzon, Giacomo; Dal Cappello, Tomas; Maggiorini, Marco; Hackett, Peter; Bärtsch, Peter; Swenson, Erik R; Zafren, Ken

2018-03-01

Brodmann Maeder, Monika, Hermann Brugger, Matiram Pun, Giacomo Strapazzon, Tomas Dal Cappello, Marco Maggiorini, Peter Hackett, Peter Baärtsch, Erik R. Swenson, Ken Zafren (STAR Core Group), and the STAR Delphi Expert Group. The STARdata reporting guidelines for clinical high altitude research. High AltMedBiol. 19:7-14, 2018. The goal of the STAR (STrengthening Altitude Research) initiative was to produce a uniform set of key elements for research and reporting in clinical high-altitude (HA) medicine. The STAR initiative was inspired by research on treatment of cardiac arrest, in which the establishment of the Utstein Style, a uniform data reporting protocol, substantially contributed to improving data reporting and subsequently the quality of scientific evidence. The STAR core group used the Delphi method, in which a group of experts reaches a consensus over multiple rounds using a formal method. We selected experts in the field of clinical HA medicine based on their scientific credentials and identified an initial set of parameters for evaluation by the experts. Of 51 experts in HA research who were identified initially, 21 experts completed both rounds. The experts identified 42 key parameters in 5 categories (setting, individual factors, acute mountain sickness and HA cerebral edema, HA pulmonary edema, and treatment) that were considered essential for research and reporting in clinical HA research. An additional 47 supplemental parameters were identified that should be reported depending on the nature of the research. The STAR initiative, using the Delphi method, identified a set of key parameters essential for research and reporting in clinical HA medicine.

Achieving 90% Adoption of Clinical Practice Guidelines Using the Delphi Consensus Method in a Large Orthopedic Group.

PubMed

Bini, Stefano A; Mahajan, John

2016-11-01

Little is known about the implementation rate of clinical practice guidelines (CPGs). Our purpose was to report on the adoption rate of CPGs created and implemented by a large orthopedic group using the Delphi consensus method. The draft CPGs were created before the group's annual meeting by 5 teams each assigned a subset of topics. The draft guidelines included a statement and a summary of the available evidence. Each guideline was debated in both small-group and plenary sessions. Voting was anonymous and a 75% supermajority was required for passage. A Likert scale was used to survey the patient's experience with the process at 1 week, and the Kirkpatrick evaluation model was used to gauge the efficacy of the process over a 6-month time frame. Eighty-five orthopedic surgeons attended the meeting. Fifteen guidelines grouped into 5 topics were created. All passed. Eighty-six percent of attendees found the process effective and 84% felt that participating in the process made it more likely that they would adopt the guidelines. At 1 week, an average of 62% of attendees stated they were practicing the guideline as written (range: 35%-72%), and at 6 months, 96% stated they were practicing them (range: 82%-100%). We have demonstrated that a modified Delphi method for reaching consensus can be very effective in both creating CPGs and leading to their adoption. Further we have shown that the process is well received by participants and that an inclusionary approach can be highly successful. Copyright © 2016 Elsevier Inc. All rights reserved.

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach

PubMed Central

Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-01-01

Abstract Introduction There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and ‘change making’ should become an intrinsic part of everyone’s job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. Methods This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. Results A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: ‘Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.’ Conclusions The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science. PMID:28289467

Development of an Electronic Pediatric All-Cause Harm Measurement Tool Using a Modified Delphi Method.

PubMed

Stockwell, David Christopher; Bisarya, Hema; Classen, David C; Kirkendall, Eric S; Lachman, Peter I; Matlow, Anne G; Tham, Eric; Hyman, Dan; Lehman, Samuel M; Searles, Elizabeth; Muething, Stephen E; Sharek, Paul J

2016-12-01

To have impact on reducing harm in pediatric inpatients, an efficient and reliable process for harm detection is needed. This work describes the first step toward the development of a pediatric all-cause harm measurement tool by recognized experts in the field. An international group of leaders in pediatric patient safety and informatics were charged with developing a comprehensive pediatric inpatient all-cause harm measurement tool using a modified Delphi technique. The process was conducted in 5 distinct steps: (1) literature review of triggers (elements from a medical record that assist in identifying patient harm) for inclusion; (2) translation of triggers to likely associated harm, improving the ability for expert prioritization; (3) 2 applications of a modified Delphi selection approach with consensus criteria using severity and frequency of harm as well as detectability of the associated trigger as criteria to rate each trigger and associated harm; (4) developing specific trigger logic and relevant values when applicable; and (5) final vetting of the entire trigger list for pilot testing. Literature and expert panel review identified 108 triggers and associated harms suitable for consideration (steps 1 and 2). This list was pared to 64 triggers and their associated harms after the first of the 2 independent expert reviews. The second independent expert review led to further refinement of the trigger package, resulting in 46 items for inclusion (step 3). Adding in specific trigger logic expanded the list. Final review and voting resulted in a list of 51 triggers (steps 4 and 5). Application of a modified Delphi method on an expert-constructed list of 108 triggers, focusing on severity and frequency of harms as well as detectability of triggers in an electronic medical record, resulted in a final list of 51 pediatric triggers. Pilot testing this list of pediatric triggers to identify all-cause harm for pediatric inpatients is the next step to establish the appropriateness of each trigger for inclusion in a global pediatric safety measurement tool.

Reducing Energy Cost and Greenhouse Gas Emission in the Corporate Sector, a Delphi Study

ERIC Educational Resources Information Center

Kramer, Maxim L.

2013-01-01

The study is titled "Reducing energy cost and GreenHouse Gas emission in the corporate sector, A Delphi Study". The study applied the Delphi methodology and focused on the Green IT solutions that can help the modern corporate organizations with less than 1000 employees to decrease their energy costs and GHG emissions. The study presents…

Projecting Agricultural Education Programs for the 21st Century Using a Modified Delphi Technique.

ERIC Educational Resources Information Center

Iverson, Maynard J.

A modified three-step Delphi procedure was used to conduct a series of national studies of futurists regarded by their peers as top experts in agricultural education. The primary objective was to project enrollments in agricultural education programs for the 21st century. Other study objectives were to ascertain whether the Delphi technique could…

Online Pestkoppenstoppen: systematic and theory-based development of a web-based tailored intervention for adolescent cyberbully victims to combat and prevent cyberbullying

PubMed Central

2014-01-01

Background The purpose of this article is to give an integrative insight into the theoretical and empirical-based development of the Online Pestkoppenstoppen (Stop Bullies Online/Stop Online Bullies). This intervention aims to reduce the number of cyberbully victims and their symptoms of depression and anxiety (program goal), by teaching cyberbully victims how to cope in an adequate and effective manner with cyberbully incidents (program’s outcomes). Method/Design In developing the program the different steps of the Intervention Mapping protocol are systematically used. In this article we describe each step of Intervention Mapping. Sources used for the development were a literature review, a Delphi study among experts, focus group interviews with the target group, and elements from a proven effective anti-bullying program. The result is a fully automated web-based tailored intervention for cyberbully victims (12-15 years) consisting of three web-based advice sessions delivered over three months. The first advice aims to teach participants how behavior is influenced by the thoughts they have, how to recognize and dispute irrational thoughts and how to form rational thoughts. In the second advice, participants will learn about the way bullying emerges, how their behavior influences bullying and how they can use effective coping strategies in order to stop (online) bullying. In the third advice, participants receive feedback and will learn how to use the Internet and mobile phones in a safe manner. Each advice is tailored to the participant’s personal characteristics (e.g., personality, self-efficacy, coping strategies used and (ir)rational thoughts). To ensure implementation of the program after testing it for effectiveness, the intervention was pretested in the target-population and an implementation plan was designed. Finally, we will elaborate on the planned randomized controlled trial in which the intervention will be compared to a general information group and waiting list control group. This evaluation will provide insight into the intervention’s efficacy to reduce cyberbullying and its negative effects. Discussion Intervention Mapping is a time consuming but profound way to ensure that each step of developing an intervention is taken, and resulted in three web-based tailored pieces of advices that teach adolescents how to cope more effectively with cyberbullying experiences. Trial registration NTR3613, 14-09-2012 PMID:24758264

Concepts and Contexts in Engineering and Technology Education: An International and Interdisciplinary Delphi Study

ERIC Educational Resources Information Center

Rossouw, Ammeret; Hacker, Michael; de Vries, Marc J.

2011-01-01

Inspired by a similar study by Osborne et al. we have conducted a Delphi study among experts to identify key concepts to be taught in engineering and technology education and relevant and meaningful contexts through which these concepts can be taught and learnt. By submitting the outcomes of the Delphi study to a panel of experts in a two-day…

Defining Advance Care Planning for Adults: A Consensus Definition from a Multidisciplinary Delphi Panel

PubMed Central

Sudore, Rebecca L.; Lum, Hillary D.; You, John J.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Matlock, Daniel D.; Rietjens, Judith A. C.; Korfage, Ida J.; Ritchie, Christine S.; Kutner, Jean S.; Teno, Joan M.; Thomas, Judy; McMahan, Ryan D.; Heyland, Daren K.

2017-01-01

Background Despite increasing interest in advance care planning (ACP) and prior ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. Objective To develop a consensus definition of ACP for adults. Design Delphi Panel Setting/Participants Participants included a multidisciplinary panel of international ACP experts consisting of 52 clinicians, researchers, and policy leaders from 4 countries, and a patient/surrogate advisory committee. Measurements We conducted 10 rounds of a modified Delphi method and qualitatively analyzed panelists’ input. Panelists identified several themes lacking consensus, and iteratively discussed and developed a final consensus definition. Results Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients’ values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: “Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness.” The panel also described strategies to best support adults in ACP. Conclusions A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. PMID:28062339

Developing standards for the development of glaucoma virtual clinics using a modified Delphi approach.

PubMed

Kotecha, Aachal; Longstaff, Simon; Azuara-Blanco, Augusto; Kirwan, James F; Morgan, James Edwards; Spencer, Anne Fiona; Foster, Paul J

2018-04-01

To obtain consensus opinion for the development of a standards framework for the development and implementation of virtual clinics for glaucoma monitoring in the UK using a modified Delphi methodology. A modified Delphi technique was used that involved sampling members of the UK Glaucoma and Eire Society (UKEGS). The first round scored the strength of agreement to a series of standards statements using a 9-point Likert scale. The revised standards were subjected to a second round of scoring and free-text comment. The final standards were discussed and agreed by an expert panel consisting of seven glaucoma subspecialists from across the UK. A version of the standards was submitted to external stakeholders for a 3-month consultation. There was a 44% response rate of UKEGS members to rounds 1 and 2, consisting largely of consultant ophthalmologists with a specialist interest in glaucoma. The final version of the standards document was validated by stakeholder consultation and contains four sections pertaining to the patient groups, testing methods, staffing requirements and governance structure of NHS secondary care glaucoma virtual clinic models. Use of a modified Delphi approach has provided consensus agreement for the standards required for the development of virtual clinics to monitor glaucoma in the UK. It is anticipated that this document will be useful as a guide for those implementing this model of service delivery. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Defining Advance Care Planning for Adults: A Consensus Definition From a Multidisciplinary Delphi Panel.

PubMed

Sudore, Rebecca L; Lum, Hillary D; You, John J; Hanson, Laura C; Meier, Diane E; Pantilat, Steven Z; Matlock, Daniel D; Rietjens, Judith A C; Korfage, Ida J; Ritchie, Christine S; Kutner, Jean S; Teno, Joan M; Thomas, Judy; McMahan, Ryan D; Heyland, Daren K

2017-05-01

Despite increasing interest in advance care planning (ACP) and previous ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. The aim of this study was to develop a consensus definition of ACP for adults. We convened a Delphi panel of multidisciplinary, international ACP experts consisting of 52 clinicians, researchers, and policy leaders from four countries and a patient/surrogate advisory committee. We conducted 10 rounds using a modified Delphi method and qualitatively analyzed panelists' input. Panelists identified several themes lacking consensus and iteratively discussed and developed a final consensus definition. Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients' values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: "Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness." The panel also described strategies to best support adults in ACP. A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. Published by Elsevier Inc.

[Prioritization and Consentation of Criteria for the Appraisal, Funding and Evaluation of Projects from the German Innovationsfonds: A multi-perspective Delphi study].

PubMed

Schmitt, J; Petzold, T; Nellessen-Martens, G; Pfaff, H

2015-09-01

The German Innovationsfonds provides the chance for evidence-based developments of the German healthcare system. Prioritization of recommendations for an effective, efficient, fair, transparent, and sustainable granting of funds through a transparent, evidence-driven consensus-process involving all relevant stakeholder groups. Representatives from health and research policy, payers, patient representatives, healthcare providers, and scientists were invited to nominate participants for an electronic 3 round iterative Delphi-study to prioritize the thematic focus, requirements concerning study methods, the team of applicants, evaluation, utilization of study results, and for the selection of reviewers. Criteria considered as relevant by at least 60% of the panel (consensus definition) in the first 2 Delphi rounds were rated as facultative, preferable, or obligatory criteria for project funding. Data were analyzed descriptively. ( Datenbank Versorgungsforschung Deutschland VfD_15_003561). All invited stakeholder groups except payers participated. 34 (85%) of 40 nominated representatives participated in the Delphi-study. A total of 64 criteria were consented as relevant for project review and funding concerning the thematic focus (n=28), methodological requirements (n=13), requirements for applicants (n=4), for the evaluation (n=4), utilization (n=6), and selection of peer reviewers (n=9). It is the collective responsibility of all stakeholders to spend the designated funds as efficient and sustainable as possible. The consented recommendations shall serve decision makers as a resource for the granting of funds and the evaluation of the Innovationsfonds. © Georg Thieme Verlag KG Stuttgart · New York.

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Using a Delphi Method to Identify Human Factors Contributing to Nursing Errors.

PubMed

Roth, Cheryl; Brewer, Melanie; Wieck, K Lynn

2017-07-01

The purpose of this study was to identify human factors associated with nursing errors. Using a Delphi technique, this study used feedback from a panel of nurse experts (n = 25) on an initial qualitative survey questionnaire followed by summarizing the results with feedback and confirmation. Synthesized factors regarding causes of errors were incorporated into a quantitative Likert-type scale, and the original expert panel participants were queried a second time to validate responses. The list identified 24 items as most common causes of nursing errors, including swamping and errors made by others that nurses are expected to recognize and fix. The responses provided a consensus top 10 errors list based on means with heavy workload and fatigue at the top of the list. The use of the Delphi survey established consensus and developed a platform upon which future study of nursing errors can evolve as a link to future solutions. This list of human factors in nursing errors should serve to stimulate dialogue among nurses about how to prevent errors and improve outcomes. Human and system failures have been the subject of an abundance of research, yet nursing errors continue to occur. © 2016 Wiley Periodicals, Inc.

A True Delphi Approach: Developing a Tailored Curriculum in Response to Local Agriscience Need

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rubenstein, Eric; Thoron, Andrew; Burleson, Sarah

2012-02-07

The Delphi approach is a structured communication technique, developed as a systematic, interactive forecasting method which relies on a panel of experts. In this specific case experts from Industry, Education and Extension fields addressed needs for educational programs in a traditional agriculturally-based community, environmentally conscious practices in order to restore environmental integrity and multi-disciplinary approach to solve sustainability problems facing the agricultural industry. The experts were divided into two main groups, (A) Secondary and (B) Post-secondary, and answered questionnaires in three rounds: • 1st Round – Participants generated a list of knowledge, skills, and competencies followed • 2nd Round –more » Panelists rated each item • 3rd Round – Panelists were given the opportunity to combine and add additional items As a result, top six items from both groups were not found similar, secondary panelists centralized around employment skills and post-secondary panelists focused on content areas. Implications include a need for content-based curriculum for post-secondary graduates, utilization of true-Delphi technique for future curriculum development research and further examination of students that complete secondary and post-secondary programs in biofuels/sustainable agriculture.« less

Neutron noise measurements at the Delphi subcritical assembly

DOE Office of Scientific and Technical Information (OSTI.GOV)

Szieberth, M.; Klujber, G.; Kloosterman, J. L.

2012-07-01

The paper presents the results and evaluations of a comprehensive set of neutron noise measurements on the Delphi subcritical assembly of the Delft Univ. of Technology. The measurements investigated the effect of different source distributions (inherent spontaneous fission and {sup 252}Cf) and the position of the detectors applied (both radially and vertically). The evaluation of the measured data has been performed by the variance-to-mean ratio (VTMR, Feynman-{alpha}), the autocorrelation (ACF, Rossi-{alpha}) and the cross-correlation (CCF) methods. The values obtained for the prompt decay constant show a strong bias, which depends both on the detector position and on the source distribution.more » This is due to the presence of higher modes in the system. It has been observed that the {alpha} value fitted is higher when the detector is close to the boundary of the core or to the {sup 252}Cf point-source. The higher alpha-modes have also been observed by fitting functions describing two alpha-modes. The successful set of measurement also provides a good basis for further theoretical investigations including the Monte Carlo simulation of the noise measurements and the calculation of the alpha-modes in the Delphi subcritical assembly. (authors)« less

Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure

PubMed Central

2013-01-01

Background The quantity and quality of studies in child and adolescent physical activity and sedentary behaviour have rapidly increased, but research directions are often pursued in a reactive and uncoordinated manner. Aim To arrive at an international consensus on research priorities in the area of child and adolescent physical activity and sedentary behaviour. Methods Two independent panels, each consisting of 12 experts, undertook three rounds of a Delphi methodology. The Delphi methodology required experts to anonymously answer questions put forward by the researchers with feedback provided between each round. Results The primary outcome of the study was a ranked set of 29 research priorities that aimed to be applicable for the next 10 years. The top three ranked priorities were: developing effective and sustainable interventions to increase children’s physical activity long-term; policy and/or environmental change and their influence on children’s physical activity and sedentary behaviour; and prospective, longitudinal studies of the independent effects of physical activity and sedentary behaviour on health. Conclusions These research priorities can help to guide decisions on future research directions. PMID:24228891

The Delphi Method: An Approach for Facilitating Evidence Based Practice in Athletic Training

ERIC Educational Resources Information Center

Sandrey, Michelle A.; Bulger, Sean M.

2008-01-01

Objective: The growing importance of evidence based practice in athletic training is necessitating academics and clinicians to be able to make judgments about the quality or lack of the body of research evidence and peer-reviewed standards pertaining to clinical questions. To assist in the judgment process, consensus methods, namely brainstorming,…

Professional Task-Based Curriculum Development for Distance Education Practitioners at Master's Level: A Design-Based Research

ERIC Educational Resources Information Center

Feng, Xiaoying; Lu, Guangxin; Yao, Zhihong

2015-01-01

Curriculum development for distance education (DE) practitioners is more and more focusing on practical requirements and competence development. Delphi and DACUM methods have been used at some universities. However, in the competency-based development area, these methods have been taken over by professional-task-based development in the last…

Report of Activities and Accomplishments: March 1, 1968 to February 28, 1969. Final Report.

ERIC Educational Resources Information Center

Green, Thomas F.; And Others

From 1968 to 1969 the EPRC focused on: staff development, definition of a specific research program, and development of methods to deal with educational policy issues in the context of longrange futures. The research program of the center is organized around educational futures and policy planning. Specific methods include Delphi techniques, goal…

Delphi`s DETOXSM process: Preparing to treat high organic content hazardous and mixed wastes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robertson, D.T.; Rogers, T.W.; Goldblatt, S.D.

1998-12-31

The US Department of Energy (DOE) Federal Energy Technology Center is sponsoring a full-scale technology demonstration of Delphi Research, Inc.`s patented DETOX{sup SM} catalytic wet chemical oxidation waste treatment process at the Savannah River Site (SRS) in South Carolina. The process is being developed primarily to treat hazardous and mixed wastes within the DOE complex as an alternative to incineration, but it has significant potential to treat wastes in the commercial sector. The results of the demonstration will be intensively studied and used to validate the technology. A critical objective in preparing for the demonstration was the successful completion ofmore » a programmatic Operational Readiness Review. Readiness Reviews are required by DOE for all new process startups. The Readiness Review provided the vehicle to ensure that Delphi was ready to start up and operate the DETOX{sup SM} process in the safest manner possible by implementing industry accepted management practices for safe operation. This paper provides an overview of the DETOX{sup SM} demonstration at SRS, and describes the crucial areas of the Readiness Review that marked the first steps in Delphi`s transition from a technology developer to an operating waste treatment services provider.« less

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach.

PubMed

Skela-Savič, Brigita; Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-06-01

There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and 'change making' should become an intrinsic part of everyone's job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: 'Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.' The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science.

Constructing the Indicators of Assessing Human Vulnerability to Industrial Chemical Accidents: A Consensus-based Fuzzy Delphi and Fuzzy AHP Approach

PubMed Central

Fatemi, Farin; Ardalan, Ali; Aguirre, Benigno; Mansouri, Nabiollah; Mohammadfam, Iraj

2017-01-01

Introduction: Industrial chemical accidents have been increased in developing countries. Assessing the human vulnerability in the residents of industrial areas is necessary for reducing the injuries and causalities of chemical hazards. The aim of this study was to explore the key indicators for the assessment of human vulnerability in the residents living near chemical installations. Methods: The indicators were established in the present study based on the Fuzzy Delphi method (FDM) and Fuzzy Analytic Hierarchy Process (FAHP). The reliability of FDM and FAHP was calculated. The indicators of human vulnerability were explored in two sets of social and physical domains. Thirty-five relevant experts participated in this study during March-July 2015. Results: According to experts, the top three indicators of human vulnerability according to the FDM and FAHP were vulnerable groups, population density, and awareness. Detailed sub-vulnerable groups and awareness were developed based on age, chronic or severe diseases, disability, first responders, and residents, respectively. Each indicator and sub-indicator was weighted and ranked and had an acceptable consistency ratio. Conclusions: The importance of social vulnerability indicators are about 7 times more than physical vulnerability indicators. Among the extracted indicators, vulnerable groups had the highest weight and the greatest impact on human vulnerability. however, further research is needed to investigate the applicability of established indicators and generalizability of the results to other studies. Key words: Fuzzy Delphi; Fuzzy AHP; Human vulnerability; Chemical hazards PMID:28480124

Seeking an oracle: using the Delphi process to develop practice guidelines for the treatment of endometriosis with Chinese herbal medicine.

PubMed

Flower, Andrew; Lewith, George T; Little, Paul

2007-11-01

For most complementary and alternative medicine interventions, the absence of a high-quality evidence base to define good practice presents a serious problem for clinicians, educators, and researchers. The Delphi process may offer a pragmatic way to establish good practice guidelines until more rigorous forms of assessment can be undertaken. To use a modified Delphi to develop good practice guidelines for a feasibility study exploring the role of Chinese herbal medicine (CHM) in the treatment of endometriosis. To compare the outcomes from Delphi with data derived from a systematic review of the Chinese language database. An expert group was convened for a three-round Delphi that initially produced key statements relating to the CHM diagnosis and treatment of endometriosis (round 1) and then anonymously rated these on a 1-7 Likert scale (rounds 2 and 3). Statements with a median score of 5 and above were regarded as demonstrating positive group consensus. The differential diagnoses within Chinese Medicine and rating of the clinical value of individual herbs were then contrasted with comparable data from a review of Chinese language reports in the Chinese Biomedical Retrieval System (1978-2002), and China Academy of Traditional Chinese Medicine (1985-2002) databases and the Chinese TCM and magazine literature (1984-2004) databases. Consensus (good practice) guidelines for the CHM treatment of endometriosis relating to common diagnostic patterns, herb selection, dosage, and patient management were produced. The Delphi guidelines demonstrated a high degree of congruence with the information from the Chinese language databases. In the absence of rigorous evidence, Delphi offers a way to synthesize expert knowledge relating to diagnosis, patient management, and herbal selection in the treatment of endometriosis. The limitations of the expert group and the inability of Delphi to capture the subtle nuances of individualized clinical decision-making limit the usefulness of this approach.

Curated Collections for Educators: Five Key Papers about Residents as Teachers Curriculum Development.

PubMed

Krzyzaniak, Sara M; Cherney, Alan; Messman, Anne; Natesan, Sreeja; Overbeck, Michael; Schnapp, Benjamin; Boysen-Osborn, Megan

2018-02-04

The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to prepare residents to teach and assess medical students and other learners. In order to achieve this, many programs develop formal residents as teachers (RAT) curricula. Medical educators may seek the guidance of previously published literature during the development of RAT programs at their institutions. The authors sought to identify key articles published on the subject of RAT programs over the last 10 years. The authors utilized a formal literature search with the help of a medical librarian and identified additional articles from virtual discussions among the author group and an open call for articles on Twitter using the hashtag #MedEd. Virtual discussions occurred within an online community of practice, the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. The lead author conducted a four-round modified Delphi process among the author group in order to narrow the broad article list to five key articles on RAT programs. The authors summarize each article and provide considerations for junior faculty as well as faculty developers. Curriculum development and program evaluation should utilize established frameworks and evidence-based approaches. The papers identified by this Delphi process will help faculty use best practices when creating or revising new RAT curriculum. In addition, faculty tasked with guiding junior faculty in this process or creating faculty development programs around curriculum development will find these articles to be a great resource for building content.

Guiding principles for student leadership development in the doctor of pharmacy program to assist administrators and faculty members in implementing or refining curricula.

PubMed

Traynor, Andrew P; Boyle, Cynthia J; Janke, Kristin K

2013-12-16

To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought.

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

Curated Collections for Educators: Five Key Papers about Residents as Teachers Curriculum Development

PubMed Central

Cherney, Alan; Messman, Anne; Natesan, Sreeja; Overbeck, Michael; Schnapp, Benjamin; Boysen-Osborn, Megan

2018-01-01

The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to prepare residents to teach and assess medical students and other learners. In order to achieve this, many programs develop formal residents as teachers (RAT) curricula. Medical educators may seek the guidance of previously published literature during the development of RAT programs at their institutions. The authors sought to identify key articles published on the subject of RAT programs over the last 10 years. The authors utilized a formal literature search with the help of a medical librarian and identified additional articles from virtual discussions among the author group and an open call for articles on Twitter using the hashtag #MedEd. Virtual discussions occurred within an online community of practice, the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. The lead author conducted a four-round modified Delphi process among the author group in order to narrow the broad article list to five key articles on RAT programs. The authors summarize each article and provide considerations for junior faculty as well as faculty developers. Curriculum development and program evaluation should utilize established frameworks and evidence-based approaches. The papers identified by this Delphi process will help faculty use best practices when creating or revising new RAT curriculum. In addition, faculty tasked with guiding junior faculty in this process or creating faculty development programs around curriculum development will find these articles to be a great resource for building content. PMID:29637035

Applying Quality Function Deployment Model in Burn Unit Service Improvement.

PubMed

Keshtkaran, Ali; Hashemi, Neda; Kharazmi, Erfan; Abbasi, Mehdi

2016-01-01

Quality function deployment (QFD) is one of the most effective quality design tools. This study applies QFD technique to improve the quality of the burn unit services in Ghotbedin Hospital in Shiraz, Iran. First, the patients' expectations of burn unit services and their priorities were determined through Delphi method. Thereafter, burn unit service specifications were determined through Delphi method. Further, the relationships between the patients' expectations and service specifications and also the relationships between service specifications were determined through an expert group's opinion. Last, the final importance scores of service specifications were calculated through simple additive weighting method. The findings show that burn unit patients have 40 expectations in six different areas. These expectations are in 16 priority levels. Burn units also have 45 service specifications in six different areas. There are four-level relationships between the patients' expectations and service specifications and four-level relationships between service specifications. The most important burn unit service specifications have been identified in this study. The QFD model developed in the study can be a general guideline for QFD planners and executives.

Benefit-risk of Patients' Online Access to their Medical Records: Consensus Exercise of an International Expert Group.

PubMed

Liyanage, Harshana; Liaw, Siaw-Teng; Konstantara, Emmanouela; Mold, Freda; Schreiber, Richard; Kuziemsky, Craig; Terry, Amanda L; de Lusignan, Simon

2018-04-22

 Patients' access to their computerised medical records (CMRs) is a legal right in many countries. However, little is reported about the benefit-risk associated with patients' online access to their CMRs.  To conduct a consensus exercise to assess the impact of patients' online access to their CMRs on the quality of care as defined in six domains by the Institute of Medicine (IoM), now the National Academy of Medicine (NAM).  A five-round Delphi study was conducted. Round One explored experts' (n = 37) viewpoints on providing patients with access to their CMRs. Round Two rated the appropriateness of statements arising from Round One (n = 16). The third round was an online panel discussion of findings (n = 13) with the members of both the International Medical Informatics Association and the European Federation of Medical Informatics Primary Health Care Informatics Working Groups. Two additional rounds, a survey of the revised consensus statements and an online workshop, were carried out to further refine consensus statements.  Thirty-seven responses from Round One were used as a basis to initially develop 15 statements which were categorised using IoM's domains of care quality. The experts agreed that providing patients online access to their CMRs for bookings, results, and prescriptions increased efficiency and improved the quality of medical records. Experts also anticipated that patients would proactively use their online access to share data with different health care providers, including emergencies. However, experts differed on whether access to limited or summary data was more useful to patients than accessing their complete records. They thought online access would change recording practice, but they were unclear about the benefit-risk of high and onerous levels of security. The 5-round process, finally, produced 16 consensus statements.  Patients' online access to their CMRs should be part of all CMR systems. It improves the process of health care, but further evidence is required about outcomes. Online access improves efficiency of bookings and other services. However, there is scope to improve many of the processes of care it purports to support, particularly the provision of a more effective interface and the protection of the vulnerable. Georg Thieme Verlag KG Stuttgart.

A Time-Out Checklist for Pediatric Regional Anesthetics

NASA Technical Reports Server (NTRS)

Clebone, Anna; Burian, Barbara K.; Polaner, David M.

2017-01-01

Although pediatric regional anesthesia has a demonstrated record of safety, adverse events, especially those related to block performance issues, still may occur. To reduce the frequency of those events, we developed a Regional Anesthesia Time-Out Checklist using expert opinion and the Delphi method.

Testing an Adapted Modified Delphi Method: Synthesizing Multiple Stakeholder Ratings of Health Care Service Effectiveness.

PubMed

Escaron, Anne L; Chang Weir, Rosy; Stanton, Petra; Vangala, Sitaram; Grogan, Tristan R; Clarke, Robin M

2016-03-01

The Affordable Care Act incentivizes health systems for better meeting patient needs, but often guidance about patient preferences for particular health services is limited. All too often vulnerable patient populations are excluded from these decision-making settings. A community-based participatory approach harnesses the in-depth knowledge of those experiencing barriers to health care. We made three modifications to the RAND-UCLA appropriateness method, a modified Delphi approach, involving patients, adding an advisory council group to characterize existing knowledge in this little studied area, and using effectiveness rather than "appropriateness" as the basis for rating. As a proof of concept, we tested this method by examining the broadly delivered but understudied nonmedical services that community health centers provide. This method created discrete, new knowledge about these services by defining 6 categories and 112 unique services and by prioritizing among these services based on effectiveness using a 9-point scale. Consistent with the appropriateness method, we found statistical convergence of ratings among the panelists. Challenges include time commitment and adherence to a clear definition of effectiveness of services. This diverse stakeholder engagement method efficiently addresses gaps in knowledge about the effectiveness of health care services to inform population health management. © 2015 Society for Public Health Education.

What do adolescents and young adults want from cancer resources? Insights from a Delphi panel of AYA patients.

PubMed

Cheung, Christabel K; Zebrack, Brad

2017-01-01

Cancer treatment programs and community-based support organizations are increasingly producing information and support resources geared to adolescent and young adult patients (AYAs); however, systematically-derived knowledge about user preferences for these resources is lacking. The primary purpose of this study was to generate findings from informed AYA cancer patients that resource developers can use to create products consistent with AYAs' expressed preferences for information and support. Utilizing a modified Delphi technique, AYA cancer patients identified barriers to optimal AYA cancer care, cancer resources that address their needs, and specific characteristics of cancer resources they find helpful. The Delphi panel consisted of a convenience sample of 21 patients aged 18-39 years, who were diagnosed with cancer between ages 15-39 and were no more than 8 years out from cancer treatment at the time of the study. Survey data were collected in three consecutive and iterative rounds over the course of 6 months in 2015. Findings indicated that AYA patients prefer resources that reduce feelings of loneliness, create a sense of community or belonging, and provide opportunities to meet other AYA patients. Among the top barriers to optimal cancer care, AYAs identified a lack of cancer care providers specializing in AYA care, a lack of connection to an AYA patient community, and their own lack of ability to navigate the health system. Participants also described aspects of cancer information and supportive care resources that they believe address AYAs' concerns. Information derived from this study will help developers of cancer information and support resources to better reach their intended audience. From the point of view of AYA cancer patients, optimal cancer care and utilization of information and support resources requires that cancer support programs foster meaningful connections among AYA patients. Results also suggest that patient resources should equip AYAs with practical knowledge and skills necessary to navigate the health system and advocate for themselves. Given patient interest in social media, future research should further investigate optimizing online resources to serve the AYA cancer population.

A Delphi Method Study on Triggering Transactional Distance to Improve Students' Learning: The Instructor's Rubric

ERIC Educational Resources Information Center

Maston, Heidi L.

2011-01-01

The 21st century ushered in change with the increased use of technology in educational delivery methods and opened doors for a new generation of students. While the debate over pedagogy, content design and overall effectiveness of this delivery format continues, scholars have not attended to the lessons of earlier theorists. This study examined a…

ICT and the future of health care: aspects of health promotion.

PubMed

Haluza, Daniela; Jungwirth, David

2015-01-01

Increasingly, Information and Communication Technology (ICT) applications enter the daily lives of consumers. Availability of various multimedia interfaces offers the opportunity to develop and adjust ICT solutions to all aspects of society including health care. To address the challenges of the ongoing adaptive progress of ICT, decision makers profit from estimates of expectable merits and risks of future technological developments. The aim of the present study was to assess the prevailing opinions and expectations among Austrian stakeholders regarding ICT-assisted health promotion. In total, 73 experts (74% males) engaged in the Austrian health care sector participated in a biphasic online Delphi survey. Panellists were assigned to three groups representing medical professionals, patient advocates, and administrative personnel. In a scenario-based questionnaire, experts evaluated potential advantages and barriers as well as degree of innovation, desirability, and estimated date of implementation of six future ICT scenarios. Scenario-specific and consolidated overall opinions were ranked. Inter-group differences were assessed using ANOVA. Panellists expected the future ICT-supported health promotion strategies to especially improve the factors living standard (56%), quality of health care (53%), and patient's knowledge (44%). Nevertheless, monetary aspects (57%), acceptance by patient advocates (45%), and data security and privacy (27%) were considered as the three most substantial hampering factors for ICT applications. Although overall mean desirability of the scenarios was quite high (80%) amongst panellists, it was considerably lower in medical professionals compared to patient advocates and administrative personnel (p=0.006). This observation suggests a more precautious attitude of this specific interest group regarding technological innovations. The present Delphi survey identified issues relevant for successful implementation of ICT-based health care solutions, providing a compilation of several areas that might require further research. In the light of ageing societies facing the perceived threat of permanent online surveillance, different requirements and expectations of end users should be accounted for by various stakeholders. Thus, close collaboration could facilitate the harmonization process on hot health topics among interest groups. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations.

PubMed

Timmings, Caitlyn; Khan, Sobia; Moore, Julia E; Marquez, Christine; Pyka, Kasha; Straus, Sharon E

2016-02-24

To address challenges related to selecting a valid, reliable, and appropriate readiness assessment measure in practice, we developed an online decision support tool to aid frontline implementers in healthcare settings in this process. The focus of this paper is to describe a multi-step, end-user driven approach to developing this tool for use during the planning stages of implementation. A multi-phase, end-user driven approach was used to develop and test the usability of a readiness decision support tool. First, readiness assessment measures that are valid, reliable, and appropriate for healthcare settings were identified from a systematic review. Second, a mapping exercise was performed to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a modified Delphi process was used to collect stakeholder ratings of the included measures on domains of feasibility, relevance, and likelihood to recommend. Fourth, two versions of a decision support tool prototype were developed and evaluated for usability. Nine valid and reliable readiness assessment measures were included in the decision support tool. The mapping exercise revealed that of the nine measures, most measures (78 %) focused on assessing readiness for change at the organizational versus the individual level, and that four measures (44 %) represented all constructs of organizational readiness. During the modified Delphi process, stakeholders rated most measures as feasible and relevant for use in practice, and reported that they would be likely to recommend use of most measures. Using data from the mapping exercise and stakeholder panel, an algorithm was developed to link users to a measure based on characteristics of their organizational setting and their readiness for change assessment priorities. Usability testing yielded recommendations that were used to refine the Ready, Set, Change! decision support tool . Ready, Set, Change! decision support tool is an implementation support that is designed to facilitate the routine incorporation of a readiness assessment as an early step in implementation. Use of this tool in practice may offer time and resource-saving implications for implementation.

Determining the Essential Components of State and Institution Dual Credit Program Policy in New Mexico: A Delphi Study with High School and College Experts

ERIC Educational Resources Information Center

Carlson, Gregory Dean

2013-01-01

The purpose of this Delphi study was to determine the essential components of dual credit in New Mexico. Dual credit experts from colleges and high schools in New Mexico were asked to participate in a three-round Delphi study to determine what the future policy of dual credit should be, and why it should be that way. Definitions of dual credit may…

Final Report of the AMC Committee-Armament. Armament Development Center Concept Plan. Volume 2

DTIC Science & Technology

1974-12-01

Considerations 111-22 Section C Operational Considerations 111-26 Section D Community Economic Impact 111-35 Statements Section E Delphi Benefit Analysis 111-37...Cost Analysis 111-3 B Personnel Considerations III-22 C Operational Considerations 111-26 D Community Economic Impact Statements 111-35 E Delphi ...sidered to be minimal. 111-36 S SECTION E. Delphi Benefit Analysis 1. Introduction. The assessment and comparison of the relative benefits of the various

Delphi based consensus study into planning for chemical incidents.

PubMed

Crawford, I W F; Mackway-Jones, K; Russell, D R; Carley, S D

2004-01-01

To achieve consensus in all phases of chemical incident planning and response. A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required.

Taxonomy of the common dolphins of the Eastern Pacific Ocean

USGS Publications Warehouse

Banks, R.C.; Brownell, R.

1969-01-01

Delphinus bairdii Dall is a species of dolphin distinct from D. delphis Linnaeus, with which it has usually been synonymized. D. bairdii has a longer rostrum relative to the zygomatic width of the skull; the ratio of these measurements falls at 1.55 or above for bairdii and 1.53 and below for delphis. In the eastern Pacific Ocean, D. bairdii is found in the Gulf of California and along the west coast of Baja California, Mexico; D. delphis is presently found in the waters off California. Until approximately the beginning of the present century, bairdii occurred farther north in the eastern Pacific Ocean, at least to the Monterey Bay area of California. Restriction of bairdii to more southerly waters, probably as an indirect result of a change in water temperature, may have permitted delphis to move into inshore Californian waters. The Pacific population of D. delphis has a somewhat shorter rostrum than the Atlantic population, and is perhaps subspecifically different. A thorough analysis of the entire genus Delphinus is needed before the relationship of all the populations can be understood and names properly applied.

Delphi based consensus study into planning for chemical incidents

PubMed Central

Crawford, I; Mackway-Jones, K; Russell, D; Carley, S

2004-01-01

Objective: To achieve consensus in all phases of chemical incident planning and response. Design: A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. Results: A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. Conclusions: The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required. PMID:14734369

Developing a guideline for clinical trial protocol content: Delphi consensus survey

PubMed Central

2012-01-01

Background Recent evidence has highlighted deficiencies in clinical trial protocols, having implications for many groups. Existing guidelines for randomized clinical trial (RCT) protocol content vary substantially and most do not describe systematic methodology for their development. As one of three prespecified steps for the systematic development of a guideline for trial protocol content, the objective of this study was to conduct a three-round Delphi consensus survey to develop and refine minimum content for RCT protocols. Methods Panellists were identified using a multistep iterative approach, met prespecified minimum criteria and represented key stakeholders who develop or use clinical trial protocols. They were asked to rate concepts for importance in a minimum set of items for RCT protocols. The main outcome measures were degree of importance (scale of 1 to 10; higher scores indicating higher importance) and level of consensus for items. Results were presented as medians, interquartile ranges, counts and percentages. Results Ninety-six expert panellists participated in the Delphi consensus survey including trial investigators, methodologists, research ethics board members, funders, industry, regulators and journal editors. Response rates were between 88 and 93% per round. Overall, panellists rated 63 of 88 concepts of high importance (of which 50 had a 25th percentile rating of 8 or greater), 13 of moderate importance (median 6 or 7) and 12 of low importance (median less than or equal to 5) for minimum trial protocol content. General and item-specific comments and subgroup results provided valuable insight for further discussions. Conclusions This Delphi process achieved consensus from a large panel of experts from diverse stakeholder groups on essential content for RCT protocols. It also highlights areas of divergence. These results, complemented by other empirical research and consensus meetings, are helping guide the development of a guideline for protocol content. PMID:23006145

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study

PubMed Central

2017-01-01

Background Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. Objective The aim of this study was to develop and prioritize measures of digital patient engagement based on patients’ use of the US Department of Veterans Affairs (VA)’s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. Methods We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. Results All 12 experts completed the study’s three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian’s three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). Conclusions This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients’ use of VA’s My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. PMID:28550008

Expert consensus for performing right heart catheterisation for suspected pulmonary arterial hypertension in systemic sclerosis: a Delphi consensus study with cluster analysis.

PubMed

Avouac, Jérôme; Huscher, Dörte; Furst, Daniel E; Opitz, Christian F; Distler, Oliver; Allanore, Yannick

2014-01-01

To establish an expert consensus on which criteria are the most appropriate in clinical practice to refer patients with systemic sclerosis (SSc) for right heart catheterisation (RHC) when pulmonary hypertension (PH) is suspected. A three stage internet based Delphi consensus exercise involving worldwide PH experts was designed. In the first stage, a comprehensive list of domains and items combining evidence based indications and expert opinions were obtained. In the second and third stages, experts were asked to rate each item selected in the list. After each of stages 2 and 3, the number of items and criteria were reduced according to a cluster analysis. A literature search and the opinions of 47 experts participating in Delphi stage 1 provided a list of seven domains containing 142 criteria. After stages 2 and 3, these domains and tools were reduced to three domains containing eight tools: clinical (progressive dyspnoea over the past 3 months, unexplained dyspnoea, worsening of WHO dyspnoea functional class, any finding on physical examination suggestive of elevated right heart pressures and any sign of right heart failure), echocardiography (systolic pulmonary artery pressure >45 mm Hg and right ventricle dilation) and pulmonary function tests (diffusion lung capacity for carbon monoxide <50% without pulmonary fibrosis). Among experts in pulmonary arterial hypertension-SSc, a core set of criteria for clinical practice to refer SSc patients for RHC has been defined by Delphi consensus methods. Although these indications are recommended by this expert group to be used as an interim tool, it will be necessary to formally validate the present tools in further studies.

Terminology and definitions on groin pain in athletes: building agreement using a short Delphi method.

PubMed

Weir, Adam; Hölmich, Per; Schache, Anthony G; Delahunt, Eamonn; de Vos, Robert-Jan

2015-06-01

Groin pain in athletes occurs frequently and can be difficult to treat, which may partly be due to the lack of agreement on diagnostic terminology. To perform a short Delphi survey on terminology agreement for groin pain in athletes by a group of experts. A selected number of experts were invited to participate in a Delphi questionnaire. The study coordinator sent a questionnaire, which consisted of demographic questions and two 'real-life' case reports of athletes with groin pain. The experts were asked to complete the questionnaire and to provide the most likely diagnosis for each case. Questionnaire responses were analysed by an independent researcher. The Cohen's κ statistic was used to evaluate the level of agreement between the diagnostic terms provided by the experts. Twenty-three experts participated (96% of those invited). For case 1, experts provided 9 different terms to describe the most likely diagnosis; for case 2, 11 different terms were provided to describe the most likely diagnosis. With respect to the terms provided for the most likely diagnosis, the Cohen's κ was 0.06 and 0.002 for case 1 and 2, respectively. This heterogeneous taxonomy reflects only a slight agreement between the various diagnostic terms provided by the selected experts. This short Delphi survey of two 'typical, straightforward' cases demonstrated major inconsistencies in the diagnostic terminology used by experts for groin pain in athletes. These results underscore the need for consensus on definitions and terminology on groin pain in athletes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Outcomes that Define Successful Advance Care Planning: A Delphi Panel Consensus

PubMed Central

Sudore, Rebecca L.; Heyland, Daren K.; Lum, Hillary D.; Rietjens, Judith A.C.; Korfage, Ida J.; Ritchie, Christine S.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Lorenz, Karl; Howard, Michelle; Green, Michael J.; Simon, Jessica E.; Feuz, Mariko A.; You, John J.

2017-01-01

Context Standardized outcomes that define successful advance care planning (ACP) are lacking. Objective To create an Organizing Framework of ACP outcome constructs and rate the importance of these outcomes. Methods This study convened a Delphi panel consisting of 52 multidisciplinary, international ACP experts including clinicians, researchers, and policy leaders from four countries. We conducted literature reviews and solicited attendee input from 5 international ACP conferences to identify initial ACP outcome constructs. In 5 Delphi rounds, we asked panelists to rate patient-centered outcomes on a 7-point “not-at-all” to “extremely important” scale. We calculated means and analyzed panelists’ input to finalize an Organizing Framework and outcome rankings. Results Organizing Framework outcome domains included process (e.g., attitudes), actions (e.g., discussions), quality of care (e.g., satisfaction), and healthcare (e.g., utilization). The top 5 outcomes included (1) care consistent with goals, mean 6.71 (±SD 0.04); (2) surrogate designation, 6.55 (0.45); (3) surrogate documentation, 6.50 (0.11); (4) discussions with surrogates, 6.40 (0.19); and (5) documents and recorded wishes are accessible when needed 6.27 (0.11). Advance directive documentation was ranked 10th, 6.01 (0.21). Panelists raised caution about whether “care consistent with goals” 6.01 (0.21). Panelists raised can be reliably measured. Conclusion A large, multidisciplinary Delphi panel developed an Organizing Framework and rated the importance of ACP outcome constructs. Top rated outcomes should be used to evaluate the success of ACP initiatives. More research is needed to create reliable and valid measurement tools for the highest rated outcomes, particularly “care consistent with goals.” PMID:28865870

The Simulation of Vibrations of Railway Beam Bridges in the Object-oriented Environment Delphi

NASA Astrophysics Data System (ADS)

Raspopov, Alexander; Artyomov, Vitaly; Rusu, Sergey

2010-01-01

The peculiarities of combination of finite-element method and equations of solid dynamics, the basic stages of development of the program complex Belinda for calculation of statics and dynamics of the rods constructions as applied to railway bridges are described.

Kentucky Workforce Pathways Development

ERIC Educational Resources Information Center

Coburn, Karen L.

2017-01-01

The purpose of the study was to determine whether the advent of healthcare information technology was a viable career pathway for the people of northeastern Kentucky. The qualitative study used the Delphi Method to conduct and examine interviews with nine experts in Kentucky's workforce development, economic development, education, and healthcare…

Alchemy of the Oracle: The Delphi Technique.

ERIC Educational Resources Information Center

Wilhelm, William J.

2001-01-01

Discusses the origins and foundations of the Delphi technique. Outlines procedures for using it in research to obtain the insights of experts. Addresses limitations of the technique. (Contains 44 references.) (SK)

A Delphi study and ranking exercise to support commissioning services: future delivery of Thrombectomy services in England.

PubMed

Halvorsrud, Kristoffer; Flynn, Darren; Ford, Gary A; McMeekin, Peter; Bhalla, Ajay; Balami, Joyce; Craig, Dawn; White, Phil

2018-02-22

Intra-arterial thrombectomy is the gold standard treatment for large artery occlusive stroke. However, the evidence of its benefits is almost entirely based on trials delivered by experienced neurointerventionists working in established teams in neuroscience centres. Those responsible for the design and prospective reconfiguration of services need access to a comprehensive and complementary array of information on which to base their decisions. This will help to ensure the demonstrated effects from trials may be realised in practice and account for regional/local variations in resources and skill-sets. One approach to elucidate the implementation preferences and considerations of key experts is a Delphi survey. In order to support commissioning decisions, we aimed using an electronic Delphi survey to establish consensus on the options for future organisation of thrombectomy services among physicians with clinical experience in managing large artery occlusive stroke. A Delphi survey was developed with 12 options for future organisation of thrombectomy services in England. A purposive sampling strategy established an expert panel of stroke physicians from the British Association of Stroke Physicians (BASP) Clinical Standards and/or Executive Membership that deliver 24/7 intravenous thrombolysis. Options with aggregate scores falling within the lowest quartile were removed from the subsequent Delphi round. Options reaching consensus following the two Delphi rounds were then ranked in a final exercise by both the wider BASP membership and the British Society of Neuroradiologists (BSNR). Eleven stroke physicians from BASP completed the initial two Delphi rounds. Three options achieved consensus, with subsequently wider BASP (97%, n = 43) and BSNR members (86%, n = 21) assigning the highest approval rankings in the final exercise for transferring large artery occlusive stroke patients to nearest neuroscience centre for thrombectomy based on local CT/CT Angiography. The initial Delphi rounds ensured optimal reduction of options by an expert panel of stroke physicians, while subsequent ranking exercises allowed remaining options to be ranked by a wider group of experts within stroke to reach consensus. The preferred implementation option for thrombectomy is investigating suspected acute stroke patients by CT/CT Angiography and secondary transfer of large artery occlusive stroke patients to the nearest neuroscience (thrombectomy) centre.

Patient engagement in the process of planning and designing outpatient care improvements at the Veterans Administration Health-care System: findings from an online expert panel.

PubMed

Khodyakov, Dmitry; Stockdale, Susan E; Smith, Nina; Booth, Marika; Altman, Lisa; Rubenstein, Lisa V

2017-02-01

There is a strong interest in the Veterans Administration (VA) Health-care System in promoting patient engagement to improve patient care. We solicited expert opinion using an online expert panel system with a modified Delphi structure called ExpertLens ™ . Experts reviewed, rated and discussed eight scenarios, representing four patient engagement roles in designing and improving VA outpatient care (consultant, implementation advisor, equal stakeholder and lead stakeholder) and two VA levels (local and regional). Rating criteria included desirability, feasibility, patient ability, physician/staff acceptance and impact on patient-centredness and care quality. Data were analysed using the RAND/UCLA Appropriateness Method for determining consensus. Experts rated consulting with patients at the local level as the most desirable and feasible patient engagement approach. Engagement at the local level was considered more desirable than engagement at the regional level. Being an equal stakeholder at the local level received the highest ratings on the patient-centredness and health-care quality criteria. Our findings illustrate expert opinion about different approaches to patient engagement and highlight the benefits and challenges posed by each. Although experts rated local consultations with patients on an as-needed basis as most desirable and feasible, they rated being an equal stakeholder at the local level as having the highest potential impact on patient-centredness and care quality. This result highlights a perceived discrepancy between what is most desirable and what is potentially most effective, but suggests that routine local engagement of patients as equal stakeholders may be a desirable first step for promoting high-quality, patient-centred care. © 2016 The Authors. Health Expectations Published by John Wiley & Sons Ltd.

Do we know what foundation year doctors think about patient safety incident reporting? Development of a Web based tool to assess attitude and knowledge.

PubMed

Robson, Jean; de Wet, Carl; McKay, John; Bowie, Paul

2011-11-01

Making healthcare safer is an international priority. Patient safety modules are now taught in medical schools, and methods to assess related student knowledge and attitudes have been developed. However, little is known about the attitudes and knowledge which foundation doctors are developing to patient safety and incident reporting in the healthcare workplace, since a specific assessment tool appears to be lacking. To develop, content validate and pilot test an online questionnaire survey to elicit foundation doctors' knowledge and experience of patient safety and incident reporting, and assess related attitudes and behaviours. Questionnaire content validity was facilitated through: a steering group; literature review; feedback from foundation year doctors and consultant staff; a modified Delphi group; and completion of a content validity index by experts. In 2010 a cross-sectional online survey of 110 foundation year 1 and 2 doctors was then undertaken in three Scottish NHS board areas, utilising the developed 25 item questionnaire. The questionnaire was validated, and piloted among 69 foundation year doctors who responded to the questionnaire. The pilot has provided valuable insights into trainee attitudes and experience. For example, 32 (48%) believed that most safety incidents were due to things that they could not do anything about; and 31 (43%) admitted to being involved in medication errors which were not formally reported. The pilot study was successful in taking the first steps to developing a validated survey questionnaire for a key staff group, foundation year doctors, in a priority area. However, the findings raise concerns about trainee experience of and attitudes to reporting, and the frequency with which incidents go unreported.

Worldwide Survey of the "Assessing Pain, Both Spontaneous Awakening and Breathing Trials, Choice of Drugs, Delirium Monitoring/Management, Early Exercise/Mobility, and Family Empowerment" (ABCDEF) Bundle.

PubMed

Morandi, Alessandro; Piva, Simone; Ely, E Wesley; Myatra, Sheila Nainan; Salluh, Jorge I F; Amare, Dawit; Azoulay, Elie; Bellelli, Giuseppe; Csomos, Akos; Fan, Eddy; Fagoni, Nazzareno; Girard, Timothy D; Heras La Calle, Gabriel; Inoue, Shigeaki; Lim, Chae-Man; Kaps, Rafael; Kotfis, Katarzyna; Koh, Younsuck; Misango, David; Pandharipande, Pratik P; Permpikul, Chairat; Cheng Tan, Cheng; Wang, Dong-Xin; Sharshar, Tarek; Shehabi, Yahya; Skrobik, Yoanna; Singh, Jeffrey M; Slooter, Arjen; Smith, Martin; Tsuruta, Ryosuke; Latronico, Nicola

2017-11-01

To assess the knowledge and use of the Assessment, prevention, and management of pain; spontaneous awakening and breathing trials; Choice of analgesia and sedation; Delirium assessment; Early mobility and exercise; and Family engagement and empowerment (ABCDEF) bundle to implement the Pain, Agitation, Delirium guidelines. Worldwide online survey. Intensive care. A cross-sectional online survey using the Delphi method was administered to intensivists worldwide, to assess the knowledge and use of all aspects of the ABCDEF bundle. There were 1,521 respondents from 47 countries, 57% had implemented the ABCDEF bundle, with varying degrees of compliance across continents. Most of the respondents (83%) used a scale to evaluate pain. Spontaneous awakening trials and spontaneous breathing trials are performed in 66% and 67% of the responder ICUs, respectively. Sedation scale was used in 89% of ICUs. Delirium monitoring was implemented in 70% of ICUs, but only 42% used a validated delirium tool. Likewise, early mobilization was "prescribed" by most, but 69% had no mobility team and 79% used no formal mobility scale. Only 36% of the respondents assessed ICU-acquired weakness. Family members were actively involved in 67% of ICUs; however, only 33% used dedicated staff to support families and only 35% reported that their unit was open 24 hr/d for family visits. The current implementation of the ABCDEF bundle varies across individual components and regions. We identified specific targets for quality improvement and adoption of the ABCDEF bundle. Our data reflect a significant but incomplete shift toward patient- and family-centered ICU care in accordance with the Pain, Agitation, Delirium guidelines.

Use of a Web-based Delphi for identifying critical components of a professional science master's program in biotechnology

NASA Astrophysics Data System (ADS)

Kantz, Jeannine Wells

The primary purpose of this research was to develop a model for a professional science master's program combining biotechnology and business. The objectives were to identify stakeholder preferences for various dimensions of a professional science master's program combining biotechnology and business and to identify differences in priorities between subgroups. A secondary purpose was to examine user preferences between Web-based and traditional methods of conducting a Delphi study and the panelist's impressions of its usefulness for program development. Prior to the first round, demographic data were collected on panelists regarding their gender, age, years experience in their current field, position title and education levels. Round 1 started with eight open-ended questions designed to investigate (a) learning objectives, (b) internships, (c) thesis vs. non-thesis degrees, (d) program focus (e) possible entry level positions, (f) roles for the industry advisory board, (g) recommended hours of hands-on experience and (h) other issues of importance. The final round ended with three questions to assess the panelists' perception of the usefulness of the Delphi for program development in higher education. Twenty-four panelists started Round 1 and participation in subsequent rounds varied from 17 in Round 2 to 11 in Round 4. Education level varied and included all levels of education in science and business. Issues emerged early in the study regarding development of different program tracks and the program goals, which were clarified in subsequent rounds. Significant differences occurred between industry and academic subgroups for two tracks, six skills designated for tracks, method of evaluating the internship, and entry-level positions appropriate for new graduates. When analyzed by level of confidence (high confidence vs. low confidence), significant differences occurred for (a) the number of semesters of hands-on experience students should have upon graduation, (b) skills recommended for core curriculum, (c) skills recommended for tracks, (d) compensation level and (e) entry level positions for new graduates. Perceived usefulness of the Delphi for program development was varied with only 10 panelists responding---five in favor, three undecided, and two against.

Framework of behavioral indicators evaluating TB health promotion outcomes: a modified Delphi study of TB policymakers and health workers.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Oren, Eyal; Cao, Jia

2015-12-15

Although TB health promotion directed at policy makers and healthcare workers (HCWs) is considered important to tuberculosis (TB) control, no indicators currently assess the impact of such promotional activities. This article is the second in a series of papers that seek to establish a framework of behavioral indicators for outcome evaluation of TB health promotion, using the Delphi method. In the first article, we sought to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. The objective of this second article is to present an indicator framework that can be used to assess behavioral outcomes of TB health promotion directed at policy makers and HCWs. A two-round, modified Delphi method was used to establish the indicators. Sixteen experts who were knowledgeable and experienced in the field of TB control were consulted in Delphi surveys. A questionnaire was developed following 4 steps, and involved ranking indicators on a five-point Likert scale. The consensus level was 70 %. Median, mode, and Coefficient of variation (CV) were used to describe expert responses. An authority coefficient (Cr) was used to assess the degree of each expert's authority. Consensus was achieved following the two survey rounds and several iterations among the experts. For TB health-promotion activities directed at policymakers, the experts reached consensus on 2 domains ("Resource inputs" and "Policymaking and monitoring behaviors"), 4 subdomains ("Human resources" among others), and 13 indicators ("Human resources per 100,000 person" among others). For TB health-promotion activities directed at HCWs, the experts reached consensus on 5 domains ("Self-protective behaviors" among others), 6 sub-domains ("Preventing infection" among others), and 15 indicators ("Average hours of daily workplace disinfection by ultraviolet radiation" among others). This study identified a conceptual framework of core behavioral indicators to evaluate TB health-promotion activities directed at policymakers and HCWs involved in TB control. Validation in other parts of the world could lead to global consensus on behavioral indicators to evaluate TB health promotion targeted at policymakers and HCWs.

Use of the Delphi process in paediatric cataract management.

PubMed

Serafino, Massimiliano; Trivedi, Rupal H; Levin, Alex V; Wilson, M Edward; Nucci, Paolo; Lambert, Scott R; Nischal, Ken K; Plager, David A; Bremond-Gignac, Dominique; Kekunnaya, Ramesh; Nishina, Sachiko; Tehrani, Nasrin N; Ventura, Marcelo C

2016-05-01

To identify areas of consensus and disagreement in the management of paediatric cataract using a modified Delphi approach among individuals recognised for publishing in this field. A modified Delphi method. International paediatric cataract experts with a publishing record in paediatric cataract management. The process consisted of three rounds of anonymous electronic questionnaires followed by a face-to-face meeting, followed by a fourth anonymous electronic questionnaire. The executive committee created questions to be used for the electronic questionnaires. Questions were designed to have unit-based, multiple choice or true-false answers. The questionnaire included issues related to the preoperative, intraoperative and postoperative management of paediatric cataract. Consensus based on 85% of panellists being in agreement for electronic questionnaires or 80% for the face-to-face meeting, and near consensus based on 70%. Sixteen of 22 invited paediatric cataract surgeons agreed to participate. We arrived at consensus or near consensus for 85/108 (78.7%) questions and non-consensus for the remaining 23 (21.3%) questions. Those questions where consensus was not reached highlight areas of either poor evidence or contradicting evidence, and may help investigators identify possible research questions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

A consensus exercise identifying priorities for research into clinical effectiveness among children's orthopaedic surgeons in the United Kingdom.

PubMed

Perry, D C; Wright, J G; Cooke, S; Roposch, A; Gaston, M S; Nicolaou, N; Theologis, T

2018-05-01

Aims High-quality clinical research in children's orthopaedic surgery has lagged behind other surgical subspecialties. This study used a consensus-based approach to identify research priorities for clinical trials in children's orthopaedics. Methods A modified Delphi technique was used, which involved an initial scoping survey, a two-round Delphi process and an expert panel formed of members of the British Society of Children's Orthopaedic Surgery. The survey was conducted amongst orthopaedic surgeons treating children in the United Kingdom and Ireland. Results A total of 86 clinicians contributed to both rounds of the Delphi process, scoring priorities from one (low priority) to five (high priority). Elective topics were ranked higher than those relating to trauma, with the top ten elective research questions scoring higher than the top question for trauma. Ten elective, and five trauma research priorities were identified, with the three highest ranked questions relating to the treatment of slipped capital femoral epiphysis (mean score 4.6/ 5), Perthes' disease (4.5) and bone infection (4.5). Conclusion This consensus-based research agenda will guide surgeons, academics and funders to improve the evidence in children's orthopaedic surgery and encourage the development of multicentre clinical trials. Cite this article: Bone Joint J 2018;100-B:680-4.

Improving Patient Safety in Public Hospitals: Developing Standard Measures to Track Medical Errors and Process Breakdowns.

PubMed

Ackerman, Sara L; Gourley, Gato; Le, Gem; Williams, Pamela; Yazdany, Jinoos; Sarkar, Urmimala

2018-03-14

The aim of the study was to develop standards for tracking patient safety gaps in ambulatory care in safety net health systems. Leaders from five California safety net health systems were invited to participate in a modified Delphi process sponsored by the Safety Promotion Action Research and Knowledge Network (SPARKNet) and the California Safety Net Institute in 2016. During each of the three Delphi rounds, the feasibility and validity of 13 proposed patient safety measures were discussed and prioritized. Surveys and transcripts from the meetings were analyzed to understand the decision-making process. The Delphi process included eight panelists. Consensus was reached to adopt 9 of 13 proposed measures. All 9 measures were unanimously considered valid, but concern was expressed about the feasibility of implementing several of the measures. Although safety net health systems face high barriers to standardized measurement, our study demonstrates that consensus can be reached on acceptable and feasible methods for tracking patient safety gaps in safety net health systems. If accompanied by the active participation key stakeholder groups, including patients, clinicians, staff, data system professionals, and health system leaders, the consensus measures reported here represent one step toward improving ambulatory patient safety in safety net health systems.

Development of a decision aid for the treatment of benign prostatic hyperplasia: A four stage method using a Delphi consensus study.

PubMed

Lamers, Romy E D; Cuypers, Maarten; Garvelink, Mirjam M; de Vries, Marieke; Bosch, J L H Ruud; Kil, Paul J M

2016-07-01

To develop a web-based decision aid (DA) for the treatment of lower urinary tract symptoms due to benign prostatic hyperplasia (LUTS/BPH). From February-September 2014 we performed a four-stage development method: 1: Two-round Delphi consensus method among urologists, 2: Identifying patients' needs and expectations, 3: Development of DA content and structure, 4: Usability testing with LUTS/BPH patients. 1 (N=15): Dutch urologists reached consensus on 61% of the statements concerning users' criteria, decision options, structure, and medical content. 2 (N=24): Consensus was reached in 69% on statements concerning the need for improvement of information provision, the need for DA development and that the DA should clarify patients' preferences. 3: DA development based on results from stage 1 and stage 2. 4 (N=10): Pros of the DA were clear information provision, systematic design and easy to read and re-read. A LUTS/BPH DA containing VCEs(**) was developed in cooperation with urologists and patients following a structured 4 stage method and was stated to be well accepted. This method can be adopted for the development of DAs to support other medical decision issues. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Consensus definitions of 14 severe acute toxic effects for childhood lymphoblastic leukaemia treatment: a Delphi consensus.

PubMed

Schmiegelow, Kjeld; Attarbaschi, Andishe; Barzilai, Shlomit; Escherich, Gabriele; Frandsen, Thomas Leth; Halsey, Christina; Hough, Rachael; Jeha, Sima; Kato, Motohiro; Liang, Der-Cherng; Mikkelsen, Torben Stamm; Möricke, Anja; Niinimäki, Riitta; Piette, Caroline; Putti, Maria Caterina; Raetz, Elizabeth; Silverman, Lewis B; Skinner, Roderick; Tuckuviene, Ruta; van der Sluis, Inge; Zapotocka, Ester

2016-06-01

Although there are high survival rates for children with acute lymphoblastic leukaemia, their outcome is often counterbalanced by the burden of toxic effects. This is because reported frequencies vary widely across studies, partly because of diverse definitions of toxic effects. Using the Delphi method, 15 international childhood acute lymphoblastic leukaemia study groups assessed acute lymphoblastic leukaemia protocols to address toxic effects that were to be considered by the Ponte di Legno working group. 14 acute toxic effects (hypersensitivity to asparaginase, hyperlipidaemia, osteonecrosis, asparaginase-associated pancreatitis, arterial hypertension, posterior reversible encephalopathy syndrome, seizures, depressed level of consciousness, methotrexate-related stroke-like syndrome, peripheral neuropathy, high-dose methotrexate-related nephrotoxicity, sinusoidal obstructive syndrome, thromboembolism, and Pneumocystis jirovecii pneumonia) that are serious but too rare to be addressed comprehensively within any single group, or are deemed to need consensus definitions for reliable incidence comparisons, were selected for assessment. Our results showed that none of the protocols addressed all 14 toxic effects, that no two protocols shared identical definitions of all toxic effects, and that no toxic effect definition was shared by all protocols. Using the Delphi method over three face-to-face plenary meetings, consensus definitions were obtained for all 14 toxic effects. In the overall assessment of outcome of acute lymphoblastic leukaemia treatment, these expert opinion-based definitions will allow reliable comparisons of frequencies and severities of acute toxic effects across treatment protocols, and facilitate international research on cause, guidelines for treatment adaptation, preventive strategies, and development of consensus algorithms for reporting on acute lymphoblastic leukaemia treatment. Copyright © 2016 Elsevier Ltd. All rights reserved.

Consensus in controversy: The modified Delphi method applied to Gynecologic Oncology practice.

PubMed

Cohn, David E; Havrilesky, Laura J; Osann, Kathryn; Lipscomb, Joseph; Hsieh, Susie; Walker, Joan L; Wright, Alexi A; Alvarez, Ronald D; Karlan, Beth Y; Bristow, Robert E; DiSilvestro, Paul A; Wakabayashi, Mark T; Morgan, Robert; Mukamel, Dana B; Wenzel, Lari

2015-09-01

To determine the degree of consensus regarding the probabilities of outcomes associated with IP/IV and IV chemotherapy. A survey was administered to an expert panel using the Delphi method. Ten ovarian cancer experts were asked to estimate outcomes for patients receiving IP/IV or IV chemotherapy. The clinical estimates were: 1) probability of completing six cycles of chemotherapy, 2) probability of surviving five years, 3) median survival, and 4) probability of ER/hospital visits during treatment. Estimates for two patients, one with a low comorbidity index (patient 1) and the other with a moderate index (patient 2), were included. The survey was administered in three rounds, and panelists could revise their subsequent responses based on review of the anonymous opinions of their peers. The ranges were smaller for IV compared with IP/IV therapy. Ranges decreased with each round. Consensus converged around outcomes related to IP/IV chemotherapy for: 1) completion of 6 cycles of therapy (type 1 patient, 62%, type 2 patient, 43%); 2) percentage of patients surviving 5 years (type 1 patient, 66%, type 2 patient, 47%); and 3) median survival (type 1 patient, 83 months, type 2 patient, 58 months). The group required three rounds to achieve consensus on the probabilities of ER/hospital visits (type 1 patient, 24%, type 2 patient, 35%). Initial estimates of survival and adverse events associated with IP/IV chemotherapy differ among experts. The Delphi process works to build consensus and may be a pragmatic tool to inform patients of their expected outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

Unsolicited E-mails to Forensic Psychiatrists.

PubMed

Friedman, Susan Hatters; Appel, Jacob M; Ash, Peter; Frierson, Richard L; Giorgi-Guarnieri, Deborah; Martinez, Richard; Newman, Alan W; Pinals, Debra A; Resnick, Phillip J; Simpson, Alexander I F

2016-12-01

E-mail communication is pervasive. Since many forensic psychiatrists have their e-mail addresses available online (either on personal websites, university websites, or articles they have authored), they are likely to receive unsolicited e-mails. Although there is an emerging body of literature about exchanging e-mail with patients, there is little guidance about how to respond to e-mails from nonpatients. Therefore, we used a Delphi technique to develop a consensus about salient points for the forensic psychiatrist to consider regarding responding to e-mails from nonpatients and the risks entailed. Four scenarios are described, including e-mails from nonpatients and unknown others requesting advice or help. The potential ethics-related, legal, moral, and practical concerns for forensic psychiatrists are discussed. Finally, potential pitfalls for forensic psychiatrists are described. © 2016 American Academy of Psychiatry and the Law.

ICT and the future of healthcare: Aspects of pervasive health monitoring.

PubMed

Haluza, Daniela; Jungwirth, David

2018-01-01

Along with the digital revolution, information and communication technology applications are currently transforming the delivery of health and social care services. This paper investigates prevailing opinions toward future technology-based healthcare solutions among Austrian healthcare professionals. During a biphasic online Delphi survey, panelists rated expected outcomes of two future scenarios describing pervasive health monitoring applications. Experts perceived that the scenarios were highly innovative, but only moderately desirable, and that their implementation could especially improve patients' knowledge, quality of healthcare, and living standard. Contrarily, monetary aspects, technical prerequisites, and data security were identified as key obstacles. We further compared the impact of professional affiliation. Clearly, opinions toward pervasive healthcare differed between the interest groups, medical professionals, patient advocates, and administrative personnel. These data suggest closer collaborations between stakeholder groups to harmonize differences in expectations regarding pervasive health monitoring.

Early Field Experience in Career and Technical Education

ERIC Educational Resources Information Center

Smalley, Scott Walter

2011-01-01

The purpose of the three studies in this dissertation was to enhance career and technical education in the area of agriculture, business, and family and consumer sciences. This dissertation contains three papers: (1) a Delphi study identifying the purpose, expected outcomes, and methods of documenting preservice teacher early field experience…

College Student Concerns: Perceptions of Student Affairs Practitioners

ERIC Educational Resources Information Center

Reynolds, Amy L.

2013-01-01

The purpose of this study was to increase awareness of the perceptions of student affairs professionals regarding the most frequent and challenging concerns facing college students today. Using the Delphi method, 159 entry-level and mid-level student affairs administrators from institutions across the country were surveyed about their perceptions…

Construct Validation of Content Standards for Teaching

ERIC Educational Resources Information Center

van der Schaaf, Marieke F.; Stokking, Karel M.

2011-01-01

Current international demands to strengthen the teaching profession have led to an increased development and use of professional content standards. The study aims to provide insight in the construct validity of content standards by researching experts' underlying assumptions and preferences when participating in a delphi method. In three rounds 21…

Colliding Scopes: Seeing Academic Library Leadership through a Lens of Complexity

ERIC Educational Resources Information Center

Baird, Lynn N.

2010-01-01

Academic libraries routinely negotiate layers of change as embedded organizations in higher education institutions. Facing competing demands with limited resources gave rise to the question: how do academic library deans effectively lead their organizations in times of change? A Delphi Method study was conducted to identify successful leadership…

Measuring and Assessing Technical Training Performance in the Army’s Schools and Units: A Survey of Current Methods

DTIC Science & Technology

1988-10-01

Madey and Stenner , 1981) and the Delphi Technique (Dalkey, 1969). These techniques are used by management analysts, industrial-organizational...Personnel Research Laboratory, Aerospace Medical Division, Lackland AFB, TX, May 1963. Madey, D, & Stenner , J. (1980). Policy implications analysis: A

Expert Perspectives on the Future of Physical Education in Higher Education

ERIC Educational Resources Information Center

Lorusso, Jenna R.; Richards, K. Andrew R.

2018-01-01

Despite physical education teacher education/physical education sport pedagogy's (PETE/PESP's) significant strides in the past century, there are concerns about its future. Grounded in participatory research, and through an interview-Delphi method, this study purposefully sampled five male PETE/PESP scholars' expert critiques of current threats,…

The National Health Educator Job Analysis 2010: Process and Outcomes

ERIC Educational Resources Information Center

Doyle, Eva I.; Caro, Carla M.; Lysoby, Linda; Auld, M. Elaine; Smith, Becky J.; Muenzen, Patricia M.

2012-01-01

The National Health Educator Job Analysis 2010 was conducted to update the competencies model for entry- and advanced-level health educators. Qualitative and quantitative methods were used. Structured interviews, focus groups, and a modified Delphi technique were implemented to engage 59 health educators from diverse work settings and experience…

Use of expert judgment elicitation to estimate seismic vulnerability of selected building types

USGS Publications Warehouse

Jaiswal, K.S.; Aspinall, W.; Perkins, D.; Wald, D.; Porter, K.A.

2012-01-01

Pooling engineering input on earthquake building vulnerability through an expert judgment elicitation process requires careful deliberation. This article provides an overview of expert judgment procedures including the Delphi approach and the Cooke performance-based method to estimate the seismic vulnerability of a building category.

The Relative Noncognitive Traits of Sonographers: A Delphi Study

ERIC Educational Resources Information Center

Hagerty, Christina A.

2012-01-01

As the entrance to sonography programs continues to be competitive, community colleges are seeking methods to select students who will complete the program successfully and practice the standards of the profession. Although researchers have investigated the use of cognitive admission criteria in the selection of sonography candidates, more studies…

Modified Delphi Investigation of Lesson Planning Concepts for Physical Education Teacher Education

ERIC Educational Resources Information Center

Sager, Jack W.

2012-01-01

Improving the methods of instructing future educators, through program evaluation and improvement, should be a goal of all teacher education programs. In physical education, the National Association for Sport & Physical Education created standards for initial preparation of physical education teachers. The six standards for preparation include…

Threshold Concepts in Entrepreneurship--The Entrepreneurs' Perspective

ERIC Educational Resources Information Center

Hatt, Lucy

2018-01-01

Purpose: The purpose of this paper is to present research into the entrepreneurs' perspective of concepts critical to thinking as an entrepreneur, in order to inform enterprise and entrepreneurship course design in higher education. Design/methodology/approach: Taking a social constructivist approach, using a Delphi-style method, semi-structured…

Exploring perceived barriers, drivers, impacts and the need for evaluation of public involvement in health and social care research: a modified Delphi study

PubMed Central

Snape, D; Kirkham, J; Britten, N; Froggatt, K; Gradinger, F; Lobban, F; Popay, Jennie; Wyatt, K; Jacoby, Ann

2014-01-01

Objective To explore areas of consensus and conflict in relation to perceived public involvement (PI) barriers and drivers, perceived impacts of PI and ways of evaluating PI approaches in health and social care research. Background Internationally and within the UK the recognition of potential benefits of PI in health and social care research is gathering momentum and PI is increasingly identified by organisations as a prerequisite for funding. However, there is relatively little examination of the impacts of PI and how those impacts might be measured. Design Mixed method, three-phase, modified Delphi technique, conducted as part of a larger MRC multiphase project. Sample Clinical and non-clinical academics, members of the public, research managers, commissioners and funders. Findings This study found high levels of consensus about the most important barriers and drivers to PI. There was acknowledgement that tokenism was common in relation to PI; and strong support for the view that demonstrating the impacts and value of PI was made more difficult by tokenistic practice. PI was seen as having intrinsic value; nonetheless, there was clear support for the importance of evaluating its impact. Research team cohesion and appropriate resources were considered essential to effective PI implementation. Panellists agreed that PI can be challenging, but can be facilitated by clear guidance, together with models of good practice and measurable standards. Conclusions This study is the first to present empirical evidence of the opinions voiced by key stakeholders on areas of consensus and conflict in relation to perceived PI barriers and drivers, perceived impacts of PI and the need to evaluate PI. As such it further contributes to debate around best practice in PI, the potential for tokenism and how best to evaluate the impacts of PI. These findings have been used in the development of the Public Involvement Impact Assessment Framework (PiiAF), an online resource which offers guidance to researchers and members of the public involved in the PI process. PMID:24939808

Programme Reporting Standards (PRS) for improving the reporting of sexual, reproductive, maternal, newborn, child and adolescent health programmes.

PubMed

Kågesten, Anna E; Tunçalp, Özge; Portela, Anayda; Ali, Moazzam; Tran, Nhan; Gülmezoglu, A Metin

2017-08-03

Information about design, implementation, monitoring and evaluation is central to understand the impact of programmes within the field of sexual, reproductive, maternal, newborn, child and adolescent health (SRMNCAH). Existing reporting guidelines do not orient on reporting of contextual and implementation issues in sufficient detail. We therefore developed Programme Reporting Standards (PRS) to be used by SRMNCAH programme implementers and researchers. Building on the first step of the PRS development (a systematic review to identify reporting items), we conducted a three-round online Delphi consensus survey with experts. Consensus was defined a-priori as 80% agreement of items as essential. This was followed by a technical consultation with a group of experts to refine the items, definitions and their structuring. The revised PRS was piloted to assess its relevance to current SRMNCAH programme reports and identify key issues regarding the use of the PRS. Of the 81 participants invited to the Delphi survey, 20 responded to all three rounds. In the final round, 27 items received consensus as essential; three items were ranked as "borderline" essential; 20 items as supplementary. The items were subsequently revised, followed by a technical consultation with 29 experts to further review and refine the PRS. The feedback resulted in substantial changes to the structure and content of the PRS into 24 items across five domains: Programme overview; Programme components and implementation; Monitoring of Implementation; Evaluation and Results; and Synthesis. This version was used in a piloting exercise, where questions regarding how much information to report and how to comment on the quality of the information reported were addressed. All items were kept in the PRS following the pilot although minor changes were made to the flow and description of items. The PRS 1.0 is the result of a structured, collaborative process, including methods to incorporate input from SRMNCAH stakeholders. The World Health Organization will develop a document that explains the items in greater detail, and will also apply the PRS to on-going initiatives. We welcome continuous input from the field, while it is being used, to improve its relevance and usefulness.

A protocol for developing, disseminating, and implementing a core outcome set for pre-eclampsia.

PubMed

Duffy, James M N; van 't Hooft, Janneke; Gale, Chris; Brown, Mark; Grobman, William; Fitzpatrick, Ray; Karumanchi, S Ananth; Lucas, Nuala; Magee, Laura; Mol, Ben; Stark, Michael; Thangaratinam, Shakila; Wilson, Mathew; von Dadelszen, Peter; Williamson, Paula; Khan, Khalid S; Ziebland, Sue; McManus, Richard J

2016-10-01

Pre-eclampsia is a serious complication of pregnancy and contributes to maternal and offspring mortality and morbidity. Randomised controlled trials evaluating therapeutic interventions for pre-eclampsia have reported many different outcomes and outcome measures. Such variation contributes to an inability to compare, contrast, and combine individual studies, limiting the usefulness of research to inform clinical practice. The development and use of a core outcome set would help to address these issues ensuring outcomes important to all stakeholders, including patients, will be collected and reported in a standardised fashion. An international steering group including healthcare professionals, researchers, and patients, has been formed to guide the development of this core outcome set. Potential outcomes will be identified through a comprehensive literature review and semi-structured interviews with patients. Potential core outcomes will be entered into an international, multi-perspective online Delphi survey. All key stakeholders, including healthcare professionals, researchers, and patients will be invited to participate. The modified Delphi method encourages whole and stakeholder group convergence towards consensus 'core' outcomes. Once core outcomes have been agreed upon it is important to determine how they should be measured. The truth, discrimination, and feasibility assessment framework will assess the quality of potential outcome measures. High quality outcome measures will be associated with core outcomes. Mechanisms exist to disseminate and implement the resulting core outcome set within an international context. Embedding the core outcome set within future clinical trials, systematic reviews, and clinical practice guidelines could make a profound contribution to advancing the usefulness of research to inform clinical practice, enhance patient care, and improve maternal and offspring outcomes. The infrastructure created by developing a core outcome set for pre-eclampsia could be leveraged in other settings, for example selecting research priorities and clinical practice guideline development. PROSPECTIVE REGISTRATION: [1] Core Outcome Measures in Effectiveness Trials (COMET) registration number: 588. [2] International Prospective Register of Systematic Reviews (PROSPERO) registration number: CRD42015015529. Copyright © 2016 International Society for the Study of Hypertension in Pregnancy. Published by Elsevier B.V. All rights reserved.

Measuring organizational readiness for knowledge translation in chronic care

PubMed Central

2011-01-01

Background Knowledge translation (KT) is an imperative in order to implement research-based and contextualized practices that can answer the numerous challenges of complex health problems. The Chronic Care Model (CCM) provides a conceptual framework to guide the implementation process in chronic care. Yet, organizations aiming to improve chronic care require an adequate level of organizational readiness (OR) for KT. Available instruments on organizational readiness for change (ORC) have shown limited validity, and are not tailored or adapted to specific phases of the knowledge-to-action (KTA) process. We aim to develop an evidence-based, comprehensive, and valid instrument to measure OR for KT in healthcare. The OR for KT instrument will be based on core concepts retrieved from existing literature and validated by a Delphi study. We will specifically test the instrument in chronic care that is of an increasing importance for the health system. Methods Phase one: We will conduct a systematic review of the theories and instruments assessing ORC in healthcare. The retained theoretical information will be synthesized in a conceptual map. A bibliography and database of ORC instruments will be prepared after appraisal of their psychometric properties according to the standards for educational and psychological testing. An online Delphi study will be carried out among decision makers and knowledge users across Canada to assess the importance of these concepts and measures at different steps in the KTA process in chronic care. Phase two: A final OR for KT instrument will be developed and validated both in French and in English and tested in chronic disease management to measure OR for KT regarding the adoption of comprehensive, patient-centered, and system-based CCMs. Discussion This study provides a comprehensive synthesis of current knowledge on explanatory models and instruments assessing OR for KT. Moreover, this project aims to create more consensus on the theoretical underpinnings and the instrumentation of OR for KT in chronic care. The final product--a comprehensive and valid OR for KT instrument--will provide the chronic care settings with an instrument to assess their readiness to implement evidence-based chronic care. PMID:21752264

Too Fit To Fracture: outcomes of a Delphi consensus process on physical activity and exercise recommendations for adults with osteoporosis with or without vertebral fractures

PubMed Central

McGill, S.; Wark, J. D.; Laprade, J.; Heinonen, A.; Ashe, M. C.; MacIntyre, N. J.; Cheung, A. M.; Shipp, K.; Keller, H.; Jain, R.; Papaioannou, A.

2016-01-01

Summary An international consensus process resulted in exercise and physical activity recommendations for individuals with osteoporosis. Emphasis was placed on strength, balance, and postural alignment. Rather than providing generic restrictions, activity should be encouraged while considering impairments, fracture risk, activity history, and preference, and guidance on spine sparing techniques should be provided. Introduction The objectives of this study were to establish expert consensus on key questions posed by patients or health care providers regarding recommended assessment domains to inform exercise prescription, therapeutic goals of exercise, and physical activity and exercise recommendations for individuals with osteoporosis or osteoporotic vertebral fracture. Methods The Too Fit To Fracture expert panel identified researchers and clinicians with expertise in exercise and osteoporosis and stakeholder groups. We delivered a modified online Delphi survey (two rounds) to establish consensus on assessment, exercise, and physical activities for three cases with varying risk (osteoporosis based on bone mineral density; 1 spine fracture and osteoporosis; multiple spine fractures, osteoporosis, hyperkyphosis, and pain). Duplicate content analyses of free text responses were performed. Results Response rates were 52 % (39/75) and 69 % (48/70) for each round. Key consensus points are the following: (a) Current physical activity guidelines are appropriate for individuals with osteoporosis without spine fracture, but not for those with spine fracture; (b) after spine fracture, physical activity of moderate intensity is preferred to vigorous; (c) daily balance training and endurance training for spinal extensor muscles are recommended for all; (d) providing guidance on spine-sparing techniques (e.g., hip hinge) during activities of daily living or leisure, considering impairments, fracture risk, activity history, and preference, is recommended rather than providing generic restrictions (e.g., lifting <10 lbs, no twisting), but for those with vertebral fracture, especially in the presence of pain, multiple fractures, or hyperkyphosis, the risks of many activities may outweigh the benefits—physical therapist consultation is recommended. Examples of spine-sparing techniques and exercise prescription elements are provided. Conclusions Our recommendations guide health care providers on assessment, exercise prescription, and safe movement for individuals with osteoporosis. PMID:25510579

A European Research Agenda for Somatic Symptom Disorders, Bodily Distress Disorders, and Functional Disorders: Results of an Estimate-Talk-Estimate Delphi Expert Study.

PubMed

van der Feltz-Cornelis, Christina M; Elfeddali, Iman; Werneke, Ursula; Malt, Ulrik F; Van den Bergh, Omer; Schaefert, Rainer; Kop, Willem J; Lobo, Antonio; Sharpe, Michael; Söllner, Wolfgang; Löwe, Bernd

2018-01-01

Background: Somatic Symptom Disorders (SSD), Bodily Distress Disorders (BDD) and functional disorders (FD) are associated with high medical and societal costs and pose a substantial challenge to the population and health policy of Europe. To meet this challenge, a specific research agenda is needed as one of the cornerstones of sustainable mental health research and health policy for SSD, BDD, and FD in Europe. Aim: To identify the main challenges and research priorities concerning SSD, BDD, and FD from a European perspective. Methods: Delphi study conducted from July 2016 until October 2017 in 3 rounds with 3 workshop meetings and 3 online surveys, involving 75 experts and 21 European countries. EURONET-SOMA and the European Association of Psychosomatic Medicine (EAPM) hosted the meetings. Results: Eight research priorities were identified: (1) Assessment of diagnostic profiles relevant to course and treatment outcome. (2) Development and evaluation of new, effective interventions. (3) Validation studies on questionnaires or semi-structured interviews that assess chronic medical conditions in this context. (4) Research into patients preferences for diagnosis and treatment. (5) Development of new methodologic designs to identify and explore mediators and moderators of clinical course and treatment outcomes (6). Translational research exploring how psychological and somatic symptoms develop from somatic conditions and biological and behavioral pathogenic factors. (7) Development of new, effective interventions to personalize treatment. (8) Implementation studies of treatment interventions in different settings, such as primary care, occupational care, general hospital and specialty mental health settings. The general public and policymakers will benefit from the development of new, effective, personalized interventions for SSD, BDD, and FD, that will be enhanced by translational research, as well as from the outcomes of research into patient involvement, GP-patient communication, consultation-liaison models and implementation. Conclusion: Funding for this research agenda, targeting these challenges in coordinated research networks such as EURONET-SOMA and EAPM, and systematically allocating resources by policymakers to this critical area in mental and physical well-being is urgently needed to improve efficacy and impact for diagnosis and treatment of SSD, BDD, and FD across Europe.

Determining Possible Professionals and Respective Roles and Responsibilities for a Model Comprehensive Elder Abuse Intervention: A Delphi Consensus Survey.

PubMed

Du Mont, Janice; Kosa, Daisy; Macdonald, Sheila; Elliot, Shannon; Yaffe, Mark

2015-01-01

We have undertaken a multi-phase, multi-method program of research to develop, implement, and evaluate a comprehensive hospital-based nurse examiner elder abuse intervention that addresses the complex functional, social, forensic, and medical needs of older women and men. In this study, we determined the importance of possible participating professionals and respective roles and responsibilities within the intervention. Using a modified Delphi methodology, recommended professionals and their associated roles and responsibilities were generated from a systematic scoping review of relevant scholarly and grey literatures. These items were reviewed, new items added for review, and rated/re-rated for their importance to the intervention on a 5-point Likert scale by an expert panel during a one day in-person meeting. Items that did not achieve consensus were subsequently re-rated in an online survey. Those items that achieved a mean Likert rating of 4+ (rated important to very important), and an interquartile range<1 in the first or second round, and/or for which 80% of ratings were 4+ in the second round were retained for the model elder abuse intervention. Twenty-two of 31 recommended professionals and 192 of 229 recommended roles and responsibilities rated were retained for our model elder abuse intervention. Retained professionals were: public guardian and trustee (mean rating = 4.88), geriatrician (4.87), police officer (4.87), GEM (geriatric emergency management) nurse (4.80), GEM social worker (4.78), community health worker (4.76), social worker/counsellor (4.74), family physician in community (4.71), paramedic (4.65), financial worker (4.59), lawyer (4.59), pharmacist (4.59), emergency physician (4.57), geriatric psychiatrist (4.33), occupational therapist (4.29), family physician in hospital (4.28), Crown prosecutor (4.24), neuropsychologist (4.24), bioethicist (4.18), caregiver advocate (4.18), victim support worker (4.18), and respite care worker (4.12). A large and diverse group of multidisciplinary, intersectoral collaborators was deemed necessary to address the complex needs of abused older adults, each having important roles and responsibilities to fulfill within a model comprehensive elder abuse intervention.

Feasibility of multi-sector policy measures that create activity-friendly environments for children: results of a Delphi study.

PubMed

Aarts, Marie-Jeanne; Schuit, Albertine J; van de Goor, Ien Am; van Oers, Hans Am

2011-12-15

Although multi-sector policy is a promising strategy to create environments that stimulate physical activity among children, little is known about the feasibility of such a multi-sector policy approach. The aims of this study were: to identify a set of tangible (multi-sector) policy measures at the local level that address environmental characteristics related to physical activity among children; and to assess the feasibility of these measures, as perceived by local policy makers. In four Dutch municipalities, a Delphi study was conducted among local policy makers of different policy sectors (public health, sports, youth and education, spatial planning/public space, traffic and transportation, and safety). In the first Delphi round, respondents generated a list of possible policy measures addressing three environmental correlates of physical activity among children (social cohesion, accessibility of facilities, and traffic safety). In the second Delphi round, policy makers weighted different feasibility aspects (political feasibility, cultural/community acceptability, technical feasibility, cost feasibility, and legal feasibility) and assessed the feasibility of the policy measures derived from the first round. The third Delphi round was aimed at reaching consensus by feedback of group results. Finally, one overall feasibility score was calculated for each policy measure. Cultural/community acceptability, political feasibility, and cost feasibility were considered most important feasibility aspects. The Delphi studies yielded 16 feasible policy measures aimed at physical and social environmental correlates of physical activity among children. Less drastic policy measures were considered more feasible, whereas environmental policy measures were considered less feasible. This study showed that the Delphi technique can be a useful tool in reaching consensus about feasible multi-sector policy measures. The study yielded several feasible policy measures aimed at physical and social environmental correlates of physical activity among children and can assist local policy makers in designing multi-sector policies aimed at an activity-friendly environment for children.

Development of the Learning Health System Researcher Core Competencies.

PubMed

Forrest, Christopher B; Chesley, Francis D; Tregear, Michelle L; Mistry, Kamila B

2017-08-04

To develop core competencies for learning health system (LHS) researchers to guide the development of training programs. Data were obtained from literature review, expert interviews, a modified Delphi process, and consensus development meetings. The competencies were developed from August to December 2016 using qualitative methods. The literature review formed the basis for the initial draft of a competency domain framework. Key informant semi-structured interviews, a modified Delphi survey, and three expert panel (n = 19 members) consensus development meetings produced the final set of competencies. The iterative development process yielded seven competency domains: (1) systems science; (2) research questions and standards of scientific evidence; (3) research methods; (4) informatics; (5) ethics of research and implementation in health systems; (6) improvement and implementation science; and (7) engagement, leadership, and research management. A total of 33 core competencies were prioritized across these seven domains. The real-world milieu of LHS research, the embeddedness of the researcher within the health system, and engagement of stakeholders are distinguishing characteristics of this emerging field. The LHS researcher core competencies can be used to guide the development of learning objectives, evaluation methods, and curricula for training programs. © Health Research and Educational Trust.

Guidelines for the development of social marketing programmes for sun protection among adolescents and young adults.

PubMed

Johnson, K M; Jones, S C; Iverson, D

2009-09-01

To formulate 'best practice' guidelines for social marketing programmes for adolescents' and young adults' sun protection. A Delphi consensus process. Eleven experts in sun protection and social marketing participated in a Delphi consensus process, where they were asked to provide up to 10 key points, based on their knowledge and practical experience, which they felt were most important in developing social marketing interventions for the primary prevention of skin cancer among adolescents and young adults. After reaching consensus, the evidence base for each guideline was determined and graded via the Scottish Intercollegiate Guideline Network grading system. Participants were then asked to indicate how strongly they rated the finalized 15 recommendations based on all aspects relating to their knowledge and practical opinion, as well as the research evidence, on a visual analogue scale. The resultant 15 guidelines offer general principles for sun protection interventions utilizing a social marketing approach. This method of guideline development brought the expertise of practitioners to the forefront of guideline development, whilst still utilizing established methods of evidence confirmation. It thus offers a useful method for guideline development in a public health context.

Optimising a curriculum for clinical haematology and biochemistry in sports medicine: a Delphi approach

PubMed Central

Fallon, K E; Trevitt, A C

2006-01-01

Objectives To investigate issues of curriculum in the context of a postgraduate sports medicine training programme, specifically in the field of clinical biochemistry and haematology. Methods Following the Delphi methodology, a series of sequential questionnaires was administered to curriculum developers, clinical teachers, examiners, and registrars. Results Agreement on a core syllabus for this subject with an indication of the core aims and objectives of teaching and learning in this field and the associated required skills and competencies. An indication of current and ideal teaching and learning methods and reasons for these preferences. A consensus of key features of a teaching module for this field and of appropriate methods of examination. Conclusions The data derived from this study, as well as the experience of engaging in it, will better inform curriculum developers, teachers, and students of one another's perceptions as to what is important in and appropriate to teaching and learning in this field of sports medicine. Engagement in the exercise and broader consideration of the outcomes by those who develop the curriculum, teach, and formulate the examination process will facilitate attainment of the ideal of well aligned teaching, learning, and examination in this specific field. PMID:16432001

Development and pilot test of a process to identify research needs from a systematic review.

PubMed

Saldanha, Ian J; Wilson, Lisa M; Bennett, Wendy L; Nicholson, Wanda K; Robinson, Karen A

2013-05-01

To ensure appropriate allocation of research funds, we need methods for identifying high-priority research needs. We developed and pilot tested a process to identify needs for primary clinical research using a systematic review in gestational diabetes mellitus. We conducted eight steps: abstract research gaps from a systematic review using the Population, Intervention, Comparison, Outcomes, and Settings (PICOS) framework; solicit feedback from the review authors; translate gaps into researchable questions using the PICOS framework; solicit feedback from multidisciplinary stakeholders at our institution; establish consensus among multidisciplinary external stakeholders on the importance of the research questions using the Delphi method; prioritize outcomes; develop conceptual models to highlight research needs; and evaluate the process. We identified 19 research questions. During the Delphi method, external stakeholders established consensus for 16 of these 19 questions (15 with "high" and 1 with "medium" clinical benefit/importance). We pilot tested an eight-step process to identify clinically important research needs. Before wider application of this process, it should be tested using systematic reviews of other diseases. Further evaluation should include assessment of the usefulness of the research needs generated using this process for primary researchers and funders. Copyright © 2013 Elsevier Inc. All rights reserved.

Professional Competencies of Cuban Specialists in Intensive Care and Emergency Medicine.

PubMed

Véliz-Martínez, Pedro L; Jorna-Calixto, Ana R; Oramas-González, René

2016-10-01

INTRODUCTION The quality of medical training and practice reflects the competency level of the professionals involved. The intensive care and emergency medicine specialty in Cuba has not defined its competencies. OBJECTIVE Identify the competencies required for specialty practice in intensive care and emergency medicine. METHODS The study was conducted from January 2014 to December 2015, using qualitative techniques; 48 professionals participated. We undertook functional occupational analysis, based on functions defined in a previous study. Three expert groups were utilized: the first used various group techniques; the second, the Delphi method; and the third, the Delphi method and a Likert questionnaire. RESULTS A total of 73 specific competencies were defined, grouped in 11 units: 44 in the patient care function, 16 in management, 7 in teaching and 6 in research. A competency map is provided. CONCLUSIONS The intensive care and emergency medicine specialty competencies identified will help improve professional standards, ensure health workforce quality, improve patient care and academic performance, and enable objective evaluation of specialists' competence and performance. KEYWORDS Clinical competency, competency-based education, professional education, intensive care, emergency medicine, urgent care, continuing medical education, curriculum, medical residency, Cuba.

Building the field of population health intervention research: The development and use of an initial set of competencies.

PubMed

Riley, Barbara; Harvey, Jean; Di Ruggiero, Erica; Potvin, Louise

2015-01-01

Population health intervention research (PHIR) is a relatively new research field that studies interventions that can improve health and health equity at a population level. Competencies are one way to give legitimacy and definition to a field. An initial set of PHIR competencies was developed with leadership from a multi-sector group in Canada. This paper describes the development process for these competencies and their possible uses. Methods to develop the competencies included key informant interviews; a targeted review of scientific and gray literature; a 2-round, online adapted Delphi study with a 24-member panel; and a focus group with 9 international PHIR experts. The resulting competencies consist of 25 items grouped into 6 categories. They include principles of good science applicable though not exclusive to PHIR, and more suitable for PHIR teams rather than individuals. This initial set of competencies, released in 2013, may be used to develop graduate student curriculum, recruit trainees and faculty to academic institutions, plan non-degree professional development, and develop job descriptions for PHIR-related research and professional positions. The competencies provide some initial guideposts for the field and will need to be adapted as the PHIR field matures and to meet unique needs of different jurisdictions.

Building the field of population health intervention research: The development and use of an initial set of competencies

PubMed Central

Riley, Barbara; Harvey, Jean; Di Ruggiero, Erica; Potvin, Louise

2015-01-01

Population health intervention research (PHIR) is a relatively new research field that studies interventions that can improve health and health equity at a population level. Competencies are one way to give legitimacy and definition to a field. An initial set of PHIR competencies was developed with leadership from a multi-sector group in Canada. This paper describes the development process for these competencies and their possible uses. Methods to develop the competencies included key informant interviews; a targeted review of scientific and gray literature; a 2-round, online adapted Delphi study with a 24-member panel; and a focus group with 9 international PHIR experts. The resulting competencies consist of 25 items grouped into 6 categories. They include principles of good science applicable though not exclusive to PHIR, and more suitable for PHIR teams rather than individuals. This initial set of competencies, released in 2013, may be used to develop graduate student curriculum, recruit trainees and faculty to academic institutions, plan non-degree professional development, and develop job descriptions for PHIR-related research and professional positions. The competencies provide some initial guideposts for the field and will need to be adapted as the PHIR field matures and to meet unique needs of different jurisdictions. PMID:26844160

Identifying the Priority Topics for the Assessment of Competence in Care of the Elderly

PubMed Central

Frank, Chris C.; Allen, Tim; Lozanovska, Tatjana; Arcand, Marcel; Feldman, Sidney; Lam, Robert E.; Mehta, Pravinsagar G.; Mangal, Nadia Y.

2018-01-01

Background With Canada’s senior population increasing, there is greater demand for family physicians with enhanced skills in Care of the Elderly (COE). The College of Family Physicians Canada (CFPC) has introduced Certificates of Added Competence (CACs), one being in COE. Our objective is to summarize the process used to determine the Priority Topics for the assessment of competence in COE. Methods A modified Delphi technique was used, with online surveys and face-to-face meetings. The Working Group (WG) of six physicians acted as the nominal group, and a larger group of randomly selected practitioners from across Canada acted as the Validation Group (VG). The WG, and then the VG, completed electronic write-in surveys that asked them to identify the Priority Topics. Responses were compiled, coded, and tabulated to identify the topics and to calculate the frequencies of their selection. The WG used face-to-face meetings and iterative discussion to decide on the final topic names. Results The correlation between the initial Priority Topic list identified by the VG and that identified by the WG is 0.6793. The final list has 18 Priority Topics. Conclusion Defining the required competencies is a first step to establishing national standards in COE. PMID:29581816

Assessment and management of nutrition and growth in Rett syndrome

PubMed Central

Leonard, Helen; Ravikumara, Madhur; Baikie, Gordon; Naseem, Nusrat; Ellaway, Carolyn; Percy, Alan; Abraham, Suzanne; Geerts, Suzanne; Lane, Jane; Jones, Mary; Bathgate, Katherine; Downs, Jenny

2014-01-01

Objectives We developed recommendations for the clinical management of poor growth and weight gain in Rett syndrome through evidence review and the consensus of an expert panel of clinicians. Methods Initial draft recommendations were created based upon literature review and 34 open-ended questions where the literature was lacking. Statements and questions were made available to an international, multi-disciplinary panel of clinicians in an online format and a Microsoft Word formatted version of the draft via email. Input was sought using a 2-stage modified Delphi process to reach consensus agreement. Items included clinical assessment of growth, anthropometry, feeding difficulties and management to increase caloric intake, decrease feeding difficulties and consideration of gastrostomy. Results Agreement was achieved on 101/112 statements. A comprehensive approach to the management of poor growth in Rett syndrome is recommended that takes into account factors such as feeding difficulties and nutritional needs. A BMI of approximately the 25th centile can be considered as a reasonable target in clinical practice. Gastrostomy is indicated for very poor growth, if there is risk of aspiration and if feeding times are prolonged. Conclusions These evidence- and consensus-based recommendations have the potential to improve care of nutrition and growth in a rare condition and stimulate research to improve the current limited evidence base. PMID:24084372

Time to go global: a consultation on global health competencies for postgraduate doctors

PubMed Central

Walpole, Sarah C.; Shortall, Clare; van Schalkwyk, May CI; Merriel, Abi; Ellis, Jayne; Obolensky, Lucy; Casanova Dias, Marisa; Watson, Jessica; Brown, Colin S.; Hall, Jennifer; Pettigrew, Luisa M.; Allen, Steve

2016-01-01

Background Globalisation is having profound impacts on health and healthcare. We solicited the views of a wide range of stakeholders in order to develop core global health competencies for postgraduate doctors. Methods Published literature and existing curricula informed writing of seven global health competencies for consultation. A modified policy Delphi involved an online survey and face-to-face and telephone interviews over three rounds. Results Over 250 stakeholders participated, including doctors, other health professionals, policymakers and members of the public from all continents of the world. Participants indicated that global health competence is essential for postgraduate doctors and other health professionals. Concerns were expressed about overburdening curricula and identifying what is ‘essential’ for whom. Conflicting perspectives emerged about the importance and relevance of different global health topics. Five core competencies were developed: (1) diversity, human rights and ethics; (2) environmental, social and economic determinants of health; (3) global epidemiology; (4) global health governance; and (5) health systems and health professionals. Conclusions Global health can bring important perspectives to postgraduate curricula, enhancing the ability of doctors to provide quality care. These global health competencies require tailoring to meet different trainees' needs and facilitate their incorporation into curricula. Healthcare and global health are ever-changing; therefore, the competencies will need to be regularly reviewed and updated. PMID:27241136