Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study

PubMed Central

2017-01-01

Background Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. Objective The aim of this study was to develop and prioritize measures of digital patient engagement based on patients’ use of the US Department of Veterans Affairs (VA)’s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. Methods We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. Results All 12 experts completed the study’s three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian’s three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). Conclusions This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients’ use of VA’s My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. PMID:28550008

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study.

PubMed

Garvin, Lynn A; Simon, Steven R

2017-05-26

Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. The aim of this study was to develop and prioritize measures of digital patient engagement based on patients' use of the US Department of Veterans Affairs (VA)'s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. All 12 experts completed the study's three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian's three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients' use of VA's My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. ©Lynn A Garvin, Steven R Simon. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.05.2017.

Development of clinical pharmacy key performance indicators for hospital pharmacists using a modified Delphi approach.

PubMed

Fernandes, Olavo; Gorman, Sean K; Slavik, Richard S; Semchuk, William M; Shalansky, Steve; Bussières, Jean-François; Doucette, Douglas; Bannerman, Heather; Lo, Jennifer; Shukla, Simone; Chan, Winnie W Y; Benninger, Natalie; MacKinnon, Neil J; Bell, Chaim M; Slobodan, Jeremy; Lyder, Catherine; Zed, Peter J; Toombs, Kent

2015-06-01

Key performance indicators (KPIs) are quantifiable measures of quality. There are no published, systematically derived clinical pharmacy KPIs (cpKPIs). A group of hospital pharmacists aimed to develop national cpKPIs to advance clinical pharmacy practice and improve patient care. A cpKPI working group established a cpKPI definition, 8 evidence-derived cpKPI critical activity areas, 26 candidate cpKPIs, and 11 cpKPI ideal attributes in addition to 1 overall consensus criterion. Twenty-six clinical pharmacists and hospital pharmacy leaders participated in an internet-based 3-round modified Delphi survey. Panelists rated 26 candidate cpKPIs using 11 cpKPI ideal attributes and 1 overall consensus criterion on a 9-point Likert scale. A meeting was facilitated between rounds 2 and 3 to debate the merits and wording of candidate cpKPIs. Consensus was reached if 75% or more of panelists assigned a score of 7 to 9 on the consensus criterion during the third Delphi round. All panelists completed the 3 Delphi rounds, and 25/26 (96%) attended the meeting. Eight candidate cpKPIs met the consensus definition: (1) performing admission medication reconciliation (including best-possible medication history), (2) participating in interprofessional patient care rounds, (3) completing pharmaceutical care plans, (4) resolving drug therapy problems, (5) providing in-person disease and medication education to patients, (6) providing discharge patient medication education, (7) performing discharge medication reconciliation, and (8) providing bundled, proactive direct patient care activities. A Delphi panel of hospital pharmacists was successful in determining 8 consensus cpKPIs. Measurement and assessment of these cpKPIs will serve to advance clinical pharmacy practice and improve patient care. © The Author(s) 2015.

Development of criteria for evaluating clinical response in thyroid eye disease using a modified Delphi technique.

PubMed

Douglas, Raymond S; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A; Cahill, Kenneth; Dolman, Peter J; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J; Khanna, Dinesh

2009-09-01

To identify components of a provisional clinical response index for thyroid eye disease using a modified Delphi technique. The International Thyroid Eye Disease Society conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in thyroid eye disease. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty-four respondents participated in the Delphi 1 survey, providing 220 unique items. Ninety-two members (100% of the respondents from Delphi 1 plus 8 new participants) responded in Delphi 2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi 3 (67 criteria were excluded because of redundancy). Criteria with a mean greater than 6 (1 = least appropriate to 9 = most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for thyroid eye disease. These measures will be iteratively refined for use in multicenter clinical trials.

Development of criteria for evaluating clinical response in thyroid eye disease (CRI-TED) using a modified Delphi technique

PubMed Central

Douglas, Raymond S.; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A.; Cahill, Kenneth; Dolman, Peter J.; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J.; Khanna, Dinesh

2014-01-01

To identify components of a provisional clinical response index for thyroid eye disease (CRI-TED) using a modified Delphi technique. The International Thyroid Eye Disease Society (ITEDS) conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in TED. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty four respondents participated in the Delphi-1 survey, providing 220 unique items. Ninety- two members (100% of the respondents from Delphi 1 plus eight new participants) responded in Delphi-2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi-3 (67 criteria were excluded due to redundancy). Criteria with a mean greater than 6 (1 least appropriate to 9 most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for TED. These measures will be iteratively refined for use in multicenter clinical trials. PMID:19752424

Developing a Canadian Curriculum for Simulation-Based Education in Obstetrics and Gynaecology: A Delphi Study.

PubMed

Craig, Catherine; Posner, Glenn D

2017-09-01

As obstetrics and gynaecology (Ob/Gyn) residency training programs move towards a competence-based approach to training and assessment, the development of a national standardized simulation curriculum is essential. The primary goal of this study was to define the fundamental content for the Canadian Obstetrics and Gynecology Simulation curriculum. A modified Delphi technique was used to achieve consensus in three rounds by surveying residency program directors or their local simulation educator delegates in 16 accredited Canadian Ob/Gyn residency programs. A consensus rate of 80% was agreed upon. Survey results were collected over 11 months in 2016. Response rates for the Delphi were 50% for the first round, 81% for the second round, and 94% for the third round. The first survey resulted in 84 suggested topics. These were organized into four categories: obstetrics high acuity low frequency events, obstetrics common events, gynaecology high acuity low frequency events, and gynaecology common events. Using the modified Delphi method, consensus was reached on 6 scenarios. This study identified the content for a national simulation-based curriculum for Ob/Gyn residency training programs and is the first step in the development of this curriculum. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Quality of care for cancer patients on home parenteral nutrition: development of key interventions and outcome indicators using a two-round Delphi approach.

PubMed

Dreesen, Mira; Foulon, Veerle; Hiele, Martin; Vanhaecht, Kris; De Pourcq, Lutgart; Pironi, Loris; Van Gossum, André; Arends, Jann; Cuerda, Cristina; Thul, Paul; Bozzetti, Frederico; Willems, Ludo

2013-05-01

Clear recommendations on how to guide patients with cancer on home parenteral nutrition (HPN) are lacking as the use of HPN in this population remains a controversial issue. Therefore, the aims of this study were to rank treatment recommendations and main outcome indicators to ensure high-quality care and to indicate differences in care concerning benign versus malignant patients. Treatment recommendations, identified from published guidelines, were used as a starting point for a two-round Delphi approach. Comments and additional interventions proposed in the first round were reevaluated in the second round. Ordinal logistic regression with SPSS 2.0 was used to identify differences in care concerning benign versus malignant patients. Twenty-seven experts from five European countries completed two Delphi rounds. After the second Delphi round, the top three most important outcome indicators were (1) quality of life (QoL), (2) incidence of hospital readmission and (3) incidence of catheter-related infections. Forty-two interventions were considered as important for quality of care (28/42 based on published guidelines; 14/42 newly suggested by Delphi panel). The topics 'Liver disease' and 'Metabolic bone disease' were considered less important for cancer patients, together with use of infusion pumps (p = 0.004) and monitoring of vitamins and trace elements (p = 0.000). Monitoring of QoL is considered more important for cancer patients (p = 0.03). Using a two-round Delphi approach, we developed a minimal set of 42 interventions that may be used to determine quality of care in HPN patients with malignancies. This set of interventions differs from a similar set developed for benign patients.

Developing standards for the development of glaucoma virtual clinics using a modified Delphi approach.

PubMed

Kotecha, Aachal; Longstaff, Simon; Azuara-Blanco, Augusto; Kirwan, James F; Morgan, James Edwards; Spencer, Anne Fiona; Foster, Paul J

2018-04-01

To obtain consensus opinion for the development of a standards framework for the development and implementation of virtual clinics for glaucoma monitoring in the UK using a modified Delphi methodology. A modified Delphi technique was used that involved sampling members of the UK Glaucoma and Eire Society (UKEGS). The first round scored the strength of agreement to a series of standards statements using a 9-point Likert scale. The revised standards were subjected to a second round of scoring and free-text comment. The final standards were discussed and agreed by an expert panel consisting of seven glaucoma subspecialists from across the UK. A version of the standards was submitted to external stakeholders for a 3-month consultation. There was a 44% response rate of UKEGS members to rounds 1 and 2, consisting largely of consultant ophthalmologists with a specialist interest in glaucoma. The final version of the standards document was validated by stakeholder consultation and contains four sections pertaining to the patient groups, testing methods, staffing requirements and governance structure of NHS secondary care glaucoma virtual clinic models. Use of a modified Delphi approach has provided consensus agreement for the standards required for the development of virtual clinics to monitor glaucoma in the UK. It is anticipated that this document will be useful as a guide for those implementing this model of service delivery. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Core neurological examination items for neurology clerks: A modified Delphi study with a grass-roots approach

PubMed Central

Liu, Chi-Hung; Hsu, Li-Ling; Hsiao, Cheng-Ting; Hsieh, Suh-Ing; Chang, Chun-Wei; Huang, Elaine Shinwei; Chang, Yeu-Jhy

2018-01-01

Background With the evolution of treatments for neurological diseases, the contents of core neurological examinations (NEs) for medical students may need to be modified. We aimed to establish a consensus on the core NE items for neurology clerks and compare viewpoints between different groups of panelists. Methods First, a pilot group proposed the core contents of NEs for neurology clerks. The proposed core NE items were then subject to a modified web-based Delphi process using the online software “SurveyMonkey”. A total of 30 panelists from different backgrounds (tutors or learners, neurologists or non-neurologists, community hospitals or medical centers, and different academic positions) participated in the modified Delphi process. Each panelist was asked to agree or disagree on the inclusion of each item using a 9-point Likert scale and was encouraged to provide feedback. We also compared viewpoints between different groups of panelists using the Mann-Whitney U test. Results Eighty-three items were used for the first round of the Delphi process. Of them, 18 without consensus of being a core NE item for the neurology clerks in the first round and another 14 items suggested by the panelists were further discussed in the second round. Finally, 75 items with different grades were included in the recommended NE items for neurology clerks. Conclusions Our findings provide a reference regarding the core NE items for milestone development for neurology clerkships. We hope that prioritizing the NE items in this order can help medical students to learn NE more efficiently. PMID:29771997

Evaluating the construct of triage acuity against a set of reference vignettes developed via modified Delphi method.

PubMed

Twomey, Michèle; Wallis, Lee A; Myers, Jonathan E

2014-07-01

To evaluate the construct of triage acuity as measured by the South African Triage Scale (SATS) against a set of reference vignettes. A modified Delphi method was used to develop a set of reference vignettes. Delphi participants completed a 2-round consensus-building process, and independently assigned triage acuity ratings to 100 written vignettes unaware of the ratings given by others. Triage acuity ratings were summarised for all vignettes, and only those that reached 80% consensus during round 2 were included in the reference set. Triage ratings for the reference vignettes given by two independent experts using the SATS were compared with the ratings given by the international Delphi panel. Measures of sensitivity, specificity, associated percentages for over-triage/under-triage were used to evaluate the construct of triage acuity (as measured by the SATS) by examining the association between the ratings by the two experts and the international panel. On completion of the Delphi process, 42 of the 100 vignettes reached 80% consensus on their acuity rating and made up the reference set. On average, over all acuity levels, sensitivity was 74% (CI 64% to 82%), specificity 92% (CI 87% to 94%), under-triage occurred 14% (CI 8% to 23%) and over-triage 12% (CI 8% to 23%) of the time. The results of this study provide an alternative to evaluating triage scales against the construct of acuity as measured with the SATS. This method of using 80% consensus vignettes may, however, systematically bias the validity estimate towards better performance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Research priorities for respiratory nursing: a UK-wide Delphi study.

PubMed

Kelly, Carol Ann; Kirkcaldy, Andrew J; Pilkington, Melissa; Hodson, Matthew; Welch, Lindsay; Yorke, Janelle; Knighting, Katherine

2018-04-01

Respiratory nurses make a significant contribution to the delivery of respiratory healthcare, but there is a dearth of nurse-led, practice-focused, published research. Using a modified three-round Delphi, this study sought to identify research priorities for respiratory nursing to inform a national research strategy. Study information and the survey link were sent electronically to members of UK professional respiratory organisations. Round 1 had 78 items across 16 topics, informed by a systematic literature review. Respondents suggested additional items which were content analysed to inform Round 2. Respondents rated all items and ranked the topics in all rounds. To ensure rigour, rounds had an explicit focus with pre-determined criteria for consensus (70%). In total, 363 responses were received across Rounds 1, 2 and 3 (n=183, 95 and 85, respectively). The top five research priorities were: 1) "Patient understanding of asthma control"; 2) "The clinical and cost-effectiveness of respiratory nurse interventions"; 3) "The impact of nurse-led clinics on patient care"; 4) "Inhaler technique"; and 5) two topics jointly scored: "Prevention of exacerbations" and "Symptom management". With potential international significance, this is the first UK study to identify research priorities for respiratory nursing, providing direction for those planning or undertaking research.

Administration and leadership competencies: establishment of a national consensus for emergency medicine.

PubMed

Thoma, Brent; Poitras, Julien; Penciner, Rick; Sherbino, Jonathan; Holroyd, Brian R; Woods, Robert A

2015-03-01

The Royal College of Physicians and Surgeons of Canada requires emergency medicine (EM) residency programs to meet training objectives relating to administration and leadership. The purpose of this study was to establish a national consensus on the competencies for inclusion in an EM administration and leadership curriculum. A modified Delphi process involving two iterative rounds of an electronic survey was used to achieve consensus on competencies for inclusion in an EM administration and leadership curriculum. An initial list of competencies was compiled using peer-reviewed and grey literature. The participants included 14 EM residency program directors and 43 leadership and administration experts from across Canada who were recruited using a snowball technique. The proposed competencies were organized using the CanMEDS Physician Competency Framework and presented in English or French. Consensus was defined a priori as >70% agreement. Nearly all (13 of 14) of the institutions with an FRCPC EM program had at least one participant complete both surveys. Thirty-five of 57 (61%) participants completed round 1, and 30 (53%) participants completed both rounds. Participants suggested an additional 16 competencies in round 1. The results of round 1 informed the decisions in round 2. Fifty-nine of 109 (54.1%) competencies achieved consensus for inclusion. Based on a national modified Delphi process, we describe 59 competencies for inclusion in an EM administration and leadership curriculum that was arranged by CanMEDS Role. EM educators may consider these competencies when designing local curricula.

Use of a Computer-Mediated Delphi Process to Validate a Mass Casualty Conceptual Model

PubMed Central

CULLEY, JOAN M.

2012-01-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters. PMID:21076283

Use of a computer-mediated Delphi process to validate a mass casualty conceptual model.

PubMed

Culley, Joan M

2011-05-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas

PubMed Central

Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-01-01

Introduction The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. Methods and analysis We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. Ethics and dissemination We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. PMID:28780546

Research priorities of the Canadian chiropractic profession: a consensus study using a modified Delphi technique.

PubMed

French, Simon D; Beliveau, Peter J H; Bruno, Paul; Passmore, Steven R; Hayden, Jill A; Srbely, John; Kawchuk, Greg N

2017-01-01

Research funds are limited and a healthcare profession that supports research activity should establish research priority areas. The study objective was to identify research priority areas for the Canadian chiropractic profession, and for stakeholders in the chiropractic profession to rank these in order of importance. We conducted a modified Delphi consensus study between August 2015 and May 2017 to determine the views of Canadian chiropractic organisations (e.g. Canadian Chiropractic Association; provincial associations) and stakeholder groups (e.g. chiropractic educational institutions; researchers). Participants completed three online Delphi survey rounds. In Round 1, participants suggested research areas within four broad research themes: 1) Basic science; 2) Clinical; 3) Health services; and 4) Population health. In Round 2, researchers created sub-themes by categorising the areas suggested in Round 1, and participants judged the importance of the research sub-themes. We defined consensus as at least 70% of participants agreeing that a research area was "essential" or "very important". In Round 3, results from Round 2 were presented to the participants to re-evaluate the importance of sub-themes. Finally, participants completed an online pairwise ranking activity to determine the rank order of the list of important research sub-themes. Fifty-seven participants, of 85 people invited, completed Round 1 (response rate 67%). Fifty-six participants completed Round 2, 55 completed Round 3, and 53 completed the ranking activity. After three Delphi rounds and the pairwise ranking activity was completed, the ranked list of research sub-themes considered important were: 1) Integration of chiropractic care into multidisciplinary settings; 2) Costs and cost-effectiveness of chiropractic care; 3) Effect of chiropractic care on reducing medical services; 4) Effects of chiropractic care; 5) Safety/side effects of chiropractic care; 6) Chiropractic care for older adults; 7) Neurophysiological mechanisms and effects of spinal manipulative therapy; 8) General mechanisms and effects of spinal manipulative therapy. This project identified research priority areas for the Canadian chiropractic profession. The top three priority areas were all in the area of health services research: 1) Integration of chiropractic care into multidisciplinary settings; 2) Costs and cost-effectiveness of chiropractic care; 3) Effect of chiropractic care on reducing medical services.

Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel

PubMed Central

Boulkedid, Rym; Sibony, Olivier; Goffinet, François; Fauconnier, Arnaud; Branger, Bernard; Alberti, Corinne

2013-01-01

Objective Measuring the quality of inpatient obstetrical care using quality indicators is becoming increasingly important for both patients and healthcare providers. However, there is no consensus about which measures are optimal. We describe a modified Delphi method to identify a set of indicators for continuously monitoring the quality of maternity care by healthcare professionals. Methodology and Main Findings An international French-speaking multidisciplinary panel comprising 22 obstetricians-gynaecologists, 12 midwives, and 1 paediatrician assessed potential indicators extracted from a medical literature search, using a two-round Delphi procedure followed by a physical meeting. Each panellist rated each indicator based on validity and feasibility. In the first round, 35 panellists from 5 countries and 20 maternity units evaluated 26 indicators including 15 related to the management of the overall population of pregnant women, 3 to the management of women followed from the first trimester of pregnancy, 2 to the management of low-risk pregnant women, and 6 to the management of neonates. 25 quality indicators were kept for next step. In the second round, 27 (27/35: 77%) panellists selected 17 indicators; the remaining 8 indicators were discussed during a physical meeting. The final set comprised 18 indicators. Conclusion A multidisciplinary panel selected indicators that reflect the quality of obstetrical care. This set of indicators could be used to assess and monitor obstetrical care, with the goal of improving the quality of care in maternity units. PMID:23577143

[Construction of a physiological aging scale for healthy people based on a modified Delphi method].

PubMed

Long, Yao; Zhou, Xuan; Deng, Pengfei; Liao, Xiong; Wu, Lei; Zhou, Jianming; Huang, Helang

2016-04-01

To build a physiological aging scale for healthy people.
 We collected age-related physiologic items through literature screening and expert interview. Two rounds of Delphi were implemented. The importance, feasibility and the degree of authority for the physiological index system were graded. Using analytic hierarchy process, we determined the weight of dimensions and items.
 Using Delphy mothod, 17 physiological and other professional experts offered the results as follow: coefficient of expert authorities Cr was 0.86±0.03, coordination coefficients for the first and second round were 0.264(χ2=229.691, P<0.001) and 0.293(χ2=228.474，P<0.001), respectively. The consistency was good. The aging scale for healthy people included 3 dimensions, namely physical form, feeling movement and functional status. Each dimension had 8 items. The weight coefficients for the 3 dimensions were 0.54, 0.16, and 0.30, respectively. The Cronbach's α coefficient of the scale was 0.893, the reliability was 0.796, and the variance of the common factor was 58.17%.
 The improved Delphi method or physiological aging scale is satisfied, which can provide reference for the evaluation of aging.

European undergraduate curriculum in geriatric medicine developed using an international modified Delphi technique

PubMed Central

Masud, Tahir; Blundell, Adrian; Gordon, Adam Lee; Mulpeter, Ken; Roller, Regina; Singler, Katrin; Goeldlin, Adrian; Stuck, Andreas

2014-01-01

Introduction: the rise in the number of older, frail adults necessitates that future doctors are adequately trained in the skills of geriatric medicine. Few countries have dedicated curricula in geriatric medicine at the undergraduate level. The aim of this project was to develop a consensus among geriatricians on a curriculum with the minimal requirements that a medical student should achieve by the end of medical school. Methods: a modified Delphi process was used. First, educational experts and geriatricians proposed a set of learning objectives based on a literature review. Second, three Delphi rounds involving a panel with 49 experts representing 29 countries affiliated to the European Union of Medical Specialists (UEMS) was used to gain consensus for a final curriculum. Results: the number of disagreements following Delphi Rounds 1 and 2 were 81 and 53, respectively. Complete agreement was reached following the third round. The final curriculum consisted of detailed objectives grouped under 10 overarching learning outcomes. Discussion: a consensus on the minimum requirements of geriatric learning objectives for medical students has been agreed by European geriatricians. Major efforts will be needed to implement these requirements, given the large variation in the quality of geriatric teaching in medical schools. This curriculum is a first step to help improve teaching of geriatrics in medical schools, and will also serve as a basis for advancing postgraduate training in geriatrics across Europe. PMID:24603283

Development of quality indicators for physiotherapy for patients with PAOD in the Netherlands: a Delphi study.

PubMed

Gijsbers, H J H; Lauret, G J; van Hofwegen, A; van Dockum, T A; Teijink, J A W; Hendriks, H J M

2016-06-01

The aim of the study was to develop quality indicators (QIs) for physiotherapy management of patients with intermittent claudication (IC) in the Netherlands. As part of an international six-step method to develop QIs, an online survey Delphi-procedure was completed. After two Delphi-rounds a validation round was performed. Twenty-six experts were recruited to participate in this study. Twenty-four experts completed two Delphi-rounds. A third round was conducted inviting 1200 qualified and registered physiotherapists of the Dutch integrated care network 'Claudicationet' to validate a draft set of quality indicators. Out of 83 potential QIs in the Dutch physiotherapy guideline on 'Intermittent claudication', consensus among the experts selected nine indicators. All nine quality indicators were validated by 300 physiotherapists. A final set of nine indicators was derived from (1) a Dutch evidence-based physiotherapy guideline, (2) an expert Delphi procedure and (3) a validation by 300 physiotherapists. This set of indicators should be validated in clinical practice. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Developing clinical practice guidelines for Chinese herbal treatment of polycystic ovary syndrome: A mixed-methods modified Delphi study.

PubMed

Lai, Lily; Flower, Andrew; Moore, Michael; Lewith, George

2015-06-01

Preliminary evidence suggests Chinese herbal medicine (CHM) could be a viable treatment option for polycystic ovary syndrome (PCOS). Prior to conducting a clinical trial it is important to consider the characteristics of good clinical practice. This study aims to use professional consensus to establish good clinical practice guidelines for the CHM treatment of PCOS. CHM practitioners participated in a mixed-methods modified Delphi study involving three rounds of structured group communication. Round 1 involved qualitative interviews with practitioners to generate statements regarding good clinical practice. In round 2, these statements were distributed online to the same practitioners to rate their agreement using a 7-point Likert scale, where group consensus was defined as a median rating of ≥5. Statements reaching consensus were accepted for consideration onto the guideline whilst those not reaching consensus were re-distributed for consideration in round 3. Statements presented in the guidelines were graded from A (strong consensus) to D (no consensus) determined by median score and interquartile range. 11 CHM practitioners in the UK were recruited. After three Delphi rounds, 91 statement items in total had been considered, of which 89 (97.8%) reached consensus and 2 (2.2%) did not. The concluding set of guidelines consists of 85 items representing key features of CHM prescribing for PCOS. These guidelines can be viewed as an initial framework that captures fundamental principles of good clinical practice for CHM. Copyright © 2015 Elsevier Ltd. All rights reserved.

A modified Delphi method toward multidisciplinary consensus on functional convalescence recommendations after abdominal surgery.

PubMed

van Vliet, Daphne C R; van der Meij, Eva; Bouwsma, Esther V A; Vonk Noordegraaf, Antonie; van den Heuvel, Baukje; Meijerink, Wilhelmus J H J; van Baal, W Marchien; Huirne, Judith A F; Anema, Johannes R

2016-12-01

Evidence-based information on the resumption of daily activities following uncomplicated abdominal surgery is scarce and not yet standardized in medical guidelines. As a consequence, convalescence recommendations are generally not provided after surgery, leading to patients' insecurity, needlessly delayed recovery and prolonged sick leave. The aim of this study was to generate consensus-based multidisciplinary convalescence recommendations, including advice on return to work, applicable for both patients and physicians. Using a modified Delphi method among a multidisciplinary panel of 13 experts consisting of surgeons, occupational physicians and general practitioners, detailed recommendations were developed for graded resumption of 34 activities after uncomplicated laparoscopic cholecystectomy, laparoscopic and open appendectomy, laparoscopic and open colectomy and laparoscopic and open inguinal hernia repair. A sample of occupational physicians, general practitioners and surgeons assessed the recommendations on feasibility in daily practice. The response of this group of care providers was discussed with the experts in the final Delphi questionnaire round. Out of initially 56 activities, the expert panel selected 34 relevant activities for which convalescence recommendations were developed. After four Delphi rounds, consensus was reached for all of the 34 activities for all the surgical procedures. A sample of occupational physicians, general practitioners and surgeons regarded the recommendations as feasible in daily practice. Multidisciplinary convalescence recommendations regarding uncomplicated laparoscopic cholecystectomy, appendectomy (laparoscopic, open), colectomy (laparoscopic, open) and inguinal hernia repair (laparoscopic, open) were developed by a modified Delphi procedure. Further research is required to evaluate whether these recommendations are realistic and effective in daily practice.

Research priorities for respiratory nursing: a UK-wide Delphi study

PubMed Central

Pilkington, Melissa; Hodson, Matthew; Welch, Lindsay; Yorke, Janelle

2018-01-01

Respiratory nurses make a significant contribution to the delivery of respiratory healthcare, but there is a dearth of nurse-led, practice-focused, published research. Using a modified three-round Delphi, this study sought to identify research priorities for respiratory nursing to inform a national research strategy. Study information and the survey link were sent electronically to members of UK professional respiratory organisations. Round 1 had 78 items across 16 topics, informed by a systematic literature review. Respondents suggested additional items which were content analysed to inform Round 2. Respondents rated all items and ranked the topics in all rounds. To ensure rigour, rounds had an explicit focus with pre-determined criteria for consensus (70%). In total, 363 responses were received across Rounds 1, 2 and 3 (n=183, 95 and 85, respectively). The top five research priorities were: 1) “Patient understanding of asthma control”; 2) “The clinical and cost-effectiveness of respiratory nurse interventions”; 3) “The impact of nurse-led clinics on patient care”; 4) “Inhaler technique”; and 5) two topics jointly scored: “Prevention of exacerbations” and “Symptom management”. With potential international significance, this is the first UK study to identify research priorities for respiratory nursing, providing direction for those planning or undertaking research. PMID:29692999

Curriculum development for a national cardiotocography education program: a Delphi survey to obtain consensus on learning objectives.

PubMed

Thellesen, Line; Hedegaard, Morten; Bergholt, Thomas; Colov, Nina P; Hoegh, Stinne; Sorensen, Jette L

2015-08-01

To define learning objectives for a national cardiotocography (CTG) education program based on expert consensus. A three-round Delphi survey. One midwife and one obstetrician from each maternity unit in Denmark were appointed based on CTG teaching experience and clinical obstetric experience. Following national and international guidelines, the research group determined six topics as important when using CTG: fetal physiology, equipment, indication, interpretation, clinical management, and communication/responsibility. In the first Delphi round, participants listed one to five learning objectives within the predefined topics. Responses were analyzed by a directed approach to content analysis. Phrasing was modified in accordance with Bloom's taxonomy. In the second and third Delphi rounds, participants rated each objective on a five-point relevance scale. Consensus was predefined as objectives with a mean rating value of ≥ 3. A prioritized list of CTG learning objectives. A total of 42 midwives and obstetricians from 21 maternity units were invited to participate, of whom 26 completed all three Delphi rounds, representing 18 maternity units. The final prioritized list included 40 objectives. The highest ranked objectives emphasized CTG interpretation and clinical management. The lowest ranked objectives emphasized fetal physiology. Mean ratings of relevance ranged from 3.15 to 5.00. National consensus on CTG learning objectives was achieved using the Delphi methodology. This was an initial step in developing a valid CTG education program. A prioritized list of objectives will clarify which topics to emphasize in a CTG education program. © 2015 Nordic Federation of Societies of Obstetrics and Gynecology.

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

Development of an antibiotic spectrum score based on veterans affairs culture and susceptibility data for the purpose of measuring antibiotic de-escalation: a modified Delphi approach.

PubMed

Madaras-Kelly, Karl; Jones, Makoto; Remington, Richard; Hill, Nicole; Huttner, Benedikt; Samore, Matthew

2014-09-01

Development of a numerical score to measure the microbial spectrum of antibiotic regimens (spectrum score) and method to identify antibiotic de-escalation events based on application of the score. Web-based modified Delphi method. Physician and pharmacist antimicrobial stewards practicing in the United States recruited through infectious diseases-focused listservs. Three Delphi rounds investigated: organisms and antibiotics to include in the spectrum score, operationalization of rules for the score, and de-escalation measurement. A 4-point ordinal scale was used to score antibiotic susceptibility for organism-antibiotic domain pairs. Antibiotic regimen scores, which represented combined activity of antibiotics in a regimen across all organism domains, were used to compare antibiotic spectrum administered early (day 2) and later (day 4) in therapy. Changes in spectrum score were calculated and compared with Delphi participants' judgments on de-escalation with 20 antibiotic regimen vignettes and with non-Delphi steward judgments on de-escalation of 300 pneumonia regimen vignettes. Method sensitivity and specificity to predict expert de-escalation status were calculated. Twenty-four participants completed all Delphi rounds. Expert support for concepts utilized in metric development was identified. For vignettes presented in the Delphi, the sign of change in score correctly classified de-escalation in all vignettes except those involving substitution of oral antibiotics. The sensitivity and specificity of the method to identify de-escalation events as judged by non-Delphi stewards were 86.3% and 96.0%, respectively. Identification of de-escalation events based on an algorithm that measures microbial spectrum of antibiotic regimens generally agreed with steward judgments of de-escalation status.

Creation and Delphi-method refinement of pediatric disaster triage simulations.

PubMed

Cicero, Mark X; Brown, Linda; Overly, Frank; Yarzebski, Jorge; Meckler, Garth; Fuchs, Susan; Tomassoni, Anthony; Aghababian, Richard; Chung, Sarita; Garrett, Andrew; Fagbuyi, Daniel; Adelgais, Kathleen; Goldman, Ran; Parker, James; Auerbach, Marc; Riera, Antonio; Cone, David; Baum, Carl R

2014-01-01

There is a need for rigorously designed pediatric disaster triage (PDT) training simulations for paramedics. First, we sought to design three multiple patient incidents for EMS provider training simulations. Our second objective was to determine the appropriate interventions and triage level for each victim in each of the simulations and develop evaluation instruments for each simulation. The final objective was to ensure that each simulation and evaluation tool was free of bias toward any specific PDT strategy. We created mixed-methods disaster simulation scenarios with pediatric victims: a school shooting, a school bus crash, and a multiple-victim house fire. Standardized patients, high-fidelity manikins, and low-fidelity manikins were used to portray the victims. Each simulation had similar acuity of injuries and 10 victims. Examples include children with special health-care needs, gunshot wounds, and smoke inhalation. Checklist-based evaluation tools and behaviorally anchored global assessments of function were created for each simulation. Eight physicians and paramedics from areas with differing PDT strategies were recruited as Subject Matter Experts (SMEs) for a modified Delphi iterative critique of the simulations and evaluation tools. The modified Delphi was managed with an online survey tool. The SMEs provided an expected triage category for each patient. The target for modified Delphi consensus was ≥85%. Using Likert scales and free text, the SMEs assessed the validity of the simulations, including instances of bias toward a specific PDT strategy, clarity of learning objectives, and the correlation of the evaluation tools to the learning objectives and scenarios. After two rounds of the modified Delphi, consensus for expected triage level was >85% for 28 of 30 victims, with the remaining two achieving >85% consensus after three Delphi iterations. To achieve consensus, we amended 11 instances of bias toward a specific PDT strategy and corrected 10 instances of noncorrelation between evaluations and simulation. The modified Delphi process, used to derive novel PDT simulation and evaluation tools, yielded a high degree of consensus among the SMEs, and eliminated biases toward specific PDT strategies in the evaluations. The simulations and evaluation tools may now be tested for reliability and validity as part of a prehospital PDT curriculum.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas.

PubMed

Hoekstra, Dyon; Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-08-04

The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A consensus definition of running-related injury in recreational runners: a modified Delphi approach.

PubMed

Yamato, Tiê Parma; Saragiotto, Bruno Tirotti; Lopes, Alexandre Dias

2015-05-01

Delphi study. To reach a consensus definition of running-related injury in recreational runners through a modified Delphi approach. Many studies have suggested the need for a standardized definition of running-related injury to provide uniformity to injury surveillance in running. We invited 112 researchers from running-related injury studies identified in a previous systematic review to classify words and terms frequently used in definitions of running-related injury in an online form during 3 rounds of study. In the last round, participants were asked to approve or disapprove the consensus definition. We considered an agreement level of at least 75% to be a consensus. Thirty-eight participants agreed to participate in the study. The response rates were 94.7% (n = 36) for the first round, 83.3% (n = 30) for the second round, and 86.7% (n = 26) for the third round. A consensus definition of running-related injury was reached, with 80% of participants approving the following: "Running-related (training or competition) musculoskeletal pain in the lower limbs that causes a restriction on or stoppage of running (distance, speed, duration, or training) for at least 7 days or 3 consecutive scheduled training sessions, or that requires the runner to consult a physician or other health professional." The proposed standardized definition of running-related injury could assist in standardizing the definitions used in sport science research and facilitate between-study comparisons. Future studies testing the validity of the proposed consensus definition, as well as its accurate translation to other languages, are also needed.

Core Domains for Clinical Research in Acute Respiratory Failure Survivors: An International Modified Delphi Consensus Study.

PubMed

Turnbull, Alison E; Sepulveda, Kristin A; Dinglas, Victor D; Chessare, Caroline M; Bingham, Clifton O; Needham, Dale M

2017-06-01

To identify the "core domains" (i.e., patient outcomes, health-related conditions, or aspects of health) that relevant stakeholders agree are essential to assess in all clinical research studies evaluating the outcomes of acute respiratory failure survivors after hospital discharge. A two-round consensus process, using a modified Delphi methodology, with participants from 16 countries, including patient and caregiver representatives. Prior to voting, participants were asked to review 1) results from surveys of clinical researchers, acute respiratory failure survivors, and caregivers that rated the importance of 19 preliminary outcome domains and 2) results from a qualitative study of acute respiratory failure survivors' outcomes after hospital discharge, as related to the 19 preliminary outcome domains. Participants also were asked to suggest any additional potential domains for evaluation in the first Delphi survey. Web-based surveys of participants representing four stakeholder groups relevant to clinical research evaluating postdischarge outcomes of acute respiratory failure survivors: clinical researchers, clinicians, patients and caregivers, and U.S. federal research funding organizations. None. None. Survey response rates were 97% and 99% in round 1 and round 2, respectively. There were seven domains that met the a priori consensus criteria to be designated as core domains: physical function, cognition, mental health, survival, pulmonary function, pain, and muscle and/or nerve function. This study generated a consensus-based list of core domains that should be assessed in all clinical research studies evaluating acute respiratory failure survivors after hospital discharge. Identifying appropriate measurement instruments to assess these core domains is an important next step toward developing a set of core outcome measures for this field of research.

Planning the content of a brief educational course in maxillofacial emergencies for staff in accident and emergency departments: a modified Delphi study.

PubMed

Elledge, Ross O C; McAleer, Sean

2015-02-01

It is well known that staff in accident and emergency (A&E) departments lack the knowledge and confidence needed to deal with maxillofacial emergencies, and that it is related to limited education at undergraduate and postgraduate levels. We therefore aimed to design a syllabus for a short course to educate staff about the most common emergencies. To find out which learning outcomes should be included and to reach a consensus, we did a 3-stage modified Delphi study of the opinions of members of the British Association of Oral and Maxillofacial Surgeons (BAOMS). Of a possible 890 members, 188 responded (21%) in the second round and 105 in the third (12%). Eighteen (37%) of the 49 proposed learning outcomes were rated very important and all of them were retained in the syllabus after the third round. Thirty (61%) items were retained with a consensus of 51% or above in the final round. The Delphi technique is a useful addition to the armamentarium of those involved in education, and has been used effectively in syllabus design. We achieved good consensus on the items to be included and the syllabus will be piloted locally. Copyright © 2014 The British Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.

PubMed

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

Development of quality indicators for transition from pediatric to adult care in sickle cell disease: A modified Delphi survey of adult providers.

PubMed

Sobota, Amy E; Shah, Nishita; Mack, Jennifer W

2017-06-01

Transition from pediatric to adult care is a vulnerable time for young adults with sickle cell disease (SCD); however, improvements in transition are limited by a lack of quality indicators. The purpose of this study was to establish quality indicators for transition in SCD and to determine the optimal timing between the final pediatric visit and the first adult provider visit. We conducted a modified Delphi survey to reach a consensus on which quality indicators are most important for a successful transition. Our expert panel consisted of members of the Sickle Cell Adult Provider Network. In the first round, the participants ranked a list of quality indicators by importance. In the second round, the participants chose their "top 5" quality indicators in terms of importance and also ranked them on feasibility. The response rates for the two rounds were 68 and 96%, respectively. Nine quality indicators were chosen as "top 5" by a majority of respondents, including communication between pediatric and adult providers, timing of first adult visit, patient self-efficacy, quality of life, and trust with their adult provider. Based on the comments from round 1, respondents were also asked for the optimal timing between leaving pediatric care and entering adult care. Most recommended a first adult visit within 2 months of the final pediatric visit. By using these quality indicators chosen by the majority of respondents, we can better develop and evaluate transition programs for young adults with SCD and improve health outcomes for these vulnerable patients. © 2016 Wiley Periodicals, Inc.

Developing a tool for nurses to assess risk of infection in pediatric oncology patients in China: a modified Delphi study.

PubMed

Zhou, Yufeng; Cui, Yan; Wang, Hong; Wang, Fang; Lu, Chao; Shen, Yan

2016-09-01

Infections are identified as the most common preventable cause of death in pediatric oncology patients. Assessing and stratifying risk of infections are essential to prevent infection in these patients. To date, no tool can fulfill this demand in China. This study aimed to develop a nursing work-based and Chinese-specific tool for pediatric nurses to assess risk of infection in oncology patients. This research was a modified Delphi study. Based on a literature review, a 37-item questionnaire rating on a 0-5 scale was developed. Twenty-four experts from 8 hospitals in 6 provinces of China were consulted for three rounds. Consensus for each item in the first round was defined as: the rating mean was>3 and the coefficient of variation (CV) was<0.5. Consensus for each item in the second round was defined as CV<0.3. Consensus among experts was defined as: P value of Kendall's coefficient of concordance ( W )<0.05. After three rounds of consultation, a two-part tool was developed: the Immune Status Scale (ISS) and the Checklist of Risk Factors of Infection (CRFI). There were 5 items in the ISS and 14 in the CRFI. Based on the ISS score, nurses could stratify children into the low-risk and high-risk groups. For high-risk children, nurses should screen risk factors of infection every day by the CRFI, and twice weekly for low-risk children. Further study is needed to verify this tool's efficacy. © 2016 the Journal of Biomedical Research. All rights reserved.

Development and pilot testing of an informed consent video for patients with limb trauma prior to debridement surgery using a modified Delphi technique.

PubMed

Lin, Yen-Ko; Chen, Chao-Wen; Lee, Wei-Che; Lin, Tsung-Ying; Kuo, Liang-Chi; Lin, Chia-Ju; Shi, Leiyu; Tien, Yin-Chun; Cheng, Yuan-Chia

2017-11-29

Ensuring adequate informed consent for surgery in a trauma setting is challenging. We developed and pilot tested an educational video containing information regarding the informed consent process for surgery in trauma patients and a knowledge measure instrument and evaluated whether the audiovisual presentation improved the patients' knowledge regarding their procedure and aftercare and their satisfaction with the informed consent process. A modified Delphi technique in which a panel of experts participated in successive rounds of shared scoring of items to forecast outcomes was applied to reach a consensus among the experts. The resulting consensus was used to develop the video content and questions for measuring the understanding of the informed consent for debridement surgery in limb trauma patients. The expert panel included experienced patients. The participants in this pilot study were enrolled as a convenience sample of adult trauma patients scheduled to receive surgery. The modified Delphi technique comprised three rounds over a 4-month period. The items given higher scores by the experts in several categories were chosen for the subsequent rounds until consensus was reached. The experts reached a consensus on each item after the three-round process. The final knowledge measure comprising 10 questions was developed and validated. Thirty eligible trauma patients presenting to the Emergency Department (ED) were approached and completed the questionnaires in this pilot study. The participants exhibited significantly higher mean knowledge and satisfaction scores after watching the educational video than before watching the video. Our process is promising for developing procedure-specific informed consent and audiovisual aids in medical and surgical specialties. The educational video was developed using a scientific method that integrated the opinions of different stakeholders, particularly patients. This video is a useful tool for improving the knowledge and satisfaction of trauma patients in the ED. The modified Delphi technique is an effective method for collecting experts' opinions and reaching a consensus on the content of educational materials for informed consent. Institutions should prioritize patient-centered health care and develop a structured informed consent process to improve the quality of care. The ClinicalTrials.gov Identifier is NCT01338480 . The date of registration was April 18, 2011 (retrospectively registered).

Assessment of Competence in EVAR Procedures: A Novel Rating Scale Developed by the Delphi Technique.

PubMed

Strøm, M; Lönn, L; Bech, B; Schroeder, T V; Konge, L

2017-07-01

To develop a procedure specific global rating scale for assessment of operator competence in endovascular aortic repair (EVAR). A Delphi approach was used to achieve expert consensus. A panel of 32 international experts (median 300 EVAR procedures, range 200-3000) from vascular surgery (n = 21) and radiology (n = 11) was established. The first Delphi round was based on a review of endovascular skills assessment papers, stent graft instructions for use, and structured interviews. It led to a primary pool of 83 items that were formulated as global rating scale items with tentative anchors. Iterative Delphi rounds were executed. The panellists rated the importance of each item on a 5 point Likert scale. Consensus was defined as 80% of the panel rating an item 4 or 5 in the primary round and 90% in subsequent rounds. Consensus on the final assessment tool was defined as Cronbach's alpha > .8 after a minimum of three rounds. Thirty-two of 35 invited experts participated. Three rounds of surveys were completed with a completion rate of 100% in the first two rounds and 91% in round three. The 83 primary assessment items were supplemented with five items suggested by the panel and reduced to seven pivotal assessment items that reached consensus, Cronbach's alpha = 0.82. The seven item rating scale covers key elements of competence in EVAR stent placement and deployment. Each item has well defined grades with explicit anchors at unacceptable, acceptable, and superior performance on a 5 point Likert scale. The Delphi methodology allowed for international consensus on a new procedure specific global rating scale for assessment of competence in EVAR. The resulting scale, EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), represents key elements in the procedure. EVARATE constitutes an assessment tool for providing structured feedback to endovascular operators in training. Copyright © 2017 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

[University studies plan in geriatric medicine developed using a modified Delphi technique].

PubMed

Vilches-Moraga, Arturo; Ariño-Blasco, Sergio; Verdejo-Bravo, Carlos; Mateos-Nozal, Jesús

2015-01-01

The increase in the number of frail elderly people has led to the necessity that all doctors of the future acquire sufficient knowledge on human ageing and the skills in the management of the patient of advanced age, as well as the diseases associated with ageing. Few countries offer geriatric medicine within undergraduate training. The purpose of the present project was to obtain a consensus between European geriatricians on the minimum requirements that medical students must achieve at the end of their university degree course. A modified Delphi process was used. Firstly, experts in education and geriatrics proposed a set of learning objectives based on a review of the literature. Three Delphi rounds were then performed, in which a panel of 49 experts representing 29 countries affiliated to the European Union of Medical Specialists took part. This enabled them to reach a consensus on a definitive study plan. The number of disagreements after the Delphi rounds 1 and 2 were 81 and 53, respectively. Full agreement was reached after the third round. The definitive study plan consisted of detailed objectives grouped under 10 general training objectives. A consensus has been reached between European geriatricians that sets specific training objectives for medical students. Great efforts will be required for the introduction of these requirements, given the variability there is in the quality of teaching in geriatrics. This study plan is a first step in helping to improve geriatrics teaching in faculties of medicine, and will also serve as a basis to make advances in the training in post-graduate geriatrics throughout Europe. Copyright © 2014 SEGG. Published by Elsevier Espana. All rights reserved.

Procedure competencies and job functions of the urologic advanced practice nurse.

PubMed

Kleier, Jo Ann

2009-01-01

A 2-round modified Delphi study recruited a panel urologic advanced practice nurse experts to identify the procedure competencies and job functions unique to the role of the advanced practice nurse specializing in the care of urology patients.

Psychosocial care for persons affected by emergencies and major incidents: a Delphi study to determine the needs of professional first responders for education, training and support.

PubMed

Drury, John; Kemp, Verity; Newman, Jonathan; Novelli, David; Doyle, Christopher; Walter, Darren; Williams, Richard

2013-10-01

The role of ambulance clinicians in providing psychosocial care in major incidents and emergencies is recognised in recent Department of Health guidance. The study described in this paper identified NHS professional first responders' needs for education about survivors' psychosocial responses, training in psychosocial skills, and continuing support. Ambulance staff participated in an online Delphi questionnaire, comprising 74 items (Round 1) on 7-point Likert scales. Second-round and third-round participants each received feedback based on the previous round, and responded to modified versions of the original items and to new items for clarification. One hundred and two participants took part in Round 1; 47 statements (64%) achieved consensus. In Round 2, 72 people from Round 1 participated; 15 out of 39 statements (38%) achieved consensus. In Round 3, 49 people from Round 2 participated; 15 out of 27 statements (59%) achieved consensus. Overall, there was consensus in the following areas: 'psychosocial needs of patients' (consensus in 34/37 items); 'possible sources of stress in your work' (8/9); 'impacts of distress in your work' (7/10); 'meeting your own emotional needs' (4/5); 'support within your organisation' (2/5); 'needs for training in psychosocial skills for patients' (15/15); 'my needs for psychosocial training and support' (5/6). Ambulance clinicians recognise their own education needs and the importance of their being offered psychosocial training and support. The authors recommend that, in order to meet patients' psychosocial needs effectively, ambulance clinicians are provided with education and training in a number of skills and their own psychosocial support should be enhanced.

National Delphi study to determine competencies for nursing leadership in public health.

PubMed

Misener, T R; Alexander, J W; Blaha, A J; Clarke, P N; Cover, C M; Felton, G M; Fuller, S G; Herman, J; Rodes, M M; Sharp, H F

1997-01-01

To identify competencies needed by nurse leaders in public health programs. Five-round national Delphi. Convenience sample of members of major public health nursing associations and nurse and non-nurse public health leaders in the USA. Mailed survey in 1994-1995 using a modified snowball technique based on a modification of the Pew Foundation health professions' competencies for Round 1. Four additional rounds produced consensus. Initially, 62 competencies were identified. Factor analysis resulted in four factors: political competencies, business acumen, program leadership, and management capabilities; 57 competencies were clustered in the four groupings and accounted for 91.4% of the variance. Graduate schools in nursing and public health must prepare students with broad-based competencies from a variety of disciplines. Findings of this national survey provide a database for curriculum development and evaluation of programs to prepare nurse leaders for roles in public health-based delivery systems.

Determination of clinically relevant content for a musculoskeletal anatomy curriculum for physical medicine and rehabilitation residents.

PubMed

Lisk, Kristina; Flannery, John F; Loh, Eldon Y; Richardson, Denyse; Agur, Anne M R; Woods, Nicole N

2014-01-01

To address the need for more clinical anatomy training in residency education, many postgraduate programs have implemented structured anatomy courses into their curriculum. Consensus often does not exist on specific content and level of detail of the content that should be included in such curricula. This article describes the use of the Delphi method to identify clinically relevant content to incorporate in a musculoskeletal anatomy curriculum for Physical Medicine and Rehabilitation (PM&R) residents. A two round modified Delphi involving PM&R experts was used to establish the curricular content. The anatomical structures and clinical conditions presented to the expert group were compiled using multiple sources: clinical musculoskeletal anatomy cases from the PM&R residency program at the University of Toronto; consultation with PM&R experts; and textbooks. In each round, experts rated the importance of each curricular item to PM&R residency education using a five-point Likert scale. Internal consistency (Cronbach's alpha) was used to determine consensus at the end of each round and agreement scores were used as an outcome measure to determine the content to include in the curriculum. The overall internal consistency in both rounds was 0.99. A total of 37 physiatrists from across Canada participated and the overall response rate over two rounds was 97%. The initial curricular list consisted of 361 items. After the second iteration, the list was reduced by 44%. By using a national consensus method we were able to objectively determine the relevant anatomical structures and clinical musculoskeletal conditions important in daily PM&R practice. © 2013 American Association of Anatomists.

Seeking an oracle: using the Delphi process to develop practice guidelines for the treatment of endometriosis with Chinese herbal medicine.

PubMed

Flower, Andrew; Lewith, George T; Little, Paul

2007-11-01

For most complementary and alternative medicine interventions, the absence of a high-quality evidence base to define good practice presents a serious problem for clinicians, educators, and researchers. The Delphi process may offer a pragmatic way to establish good practice guidelines until more rigorous forms of assessment can be undertaken. To use a modified Delphi to develop good practice guidelines for a feasibility study exploring the role of Chinese herbal medicine (CHM) in the treatment of endometriosis. To compare the outcomes from Delphi with data derived from a systematic review of the Chinese language database. An expert group was convened for a three-round Delphi that initially produced key statements relating to the CHM diagnosis and treatment of endometriosis (round 1) and then anonymously rated these on a 1-7 Likert scale (rounds 2 and 3). Statements with a median score of 5 and above were regarded as demonstrating positive group consensus. The differential diagnoses within Chinese Medicine and rating of the clinical value of individual herbs were then contrasted with comparable data from a review of Chinese language reports in the Chinese Biomedical Retrieval System (1978-2002), and China Academy of Traditional Chinese Medicine (1985-2002) databases and the Chinese TCM and magazine literature (1984-2004) databases. Consensus (good practice) guidelines for the CHM treatment of endometriosis relating to common diagnostic patterns, herb selection, dosage, and patient management were produced. The Delphi guidelines demonstrated a high degree of congruence with the information from the Chinese language databases. In the absence of rigorous evidence, Delphi offers a way to synthesize expert knowledge relating to diagnosis, patient management, and herbal selection in the treatment of endometriosis. The limitations of the expert group and the inability of Delphi to capture the subtle nuances of individualized clinical decision-making limit the usefulness of this approach.

Guidelines for Reporting Case Studies on Extracorporeal Treatments in Poisonings: Methodology

PubMed Central

Lavergne, Valéry; Ouellet, Georges; Bouchard, Josée; Galvao, Tais; Kielstein, Jan T; Roberts, Darren M; Kanji, Salmaan; Mowry, James B; Calello, Diane P; Hoffman, Robert S; Gosselin, Sophie; Nolin, Thomas D; Goldfarb, David S; Burdmann, Emmanuel A; Dargan, Paul I; Decker, Brian Scott; Hoegberg, Lotte C; Maclaren, Robert; Megarbane, Bruno; Sowinski, Kevin M; Yates, Christopher; Mactier, Robert; Wiegand, Timothy; Ghannoum, Marc

2014-01-01

A literature review performed by the EXtracorporeal TReatments In Poisoning (EXTRIP) workgroup highlighted deficiencies in the existing literature, especially the reporting of case studies. Although general reporting guidelines exist for case studies, there are none in the specific field of extracorporeal treatments in toxicology. Our goal was to construct and propose a checklist that systematically outlines the minimum essential items to be reported in a case study of poisoned patients undergoing extracorporeal treatments. Through a modified two-round Delphi technique, panelists (mostly chosen from the EXTRIP workgroup) were asked to vote on the pertinence of a set of items to identify those considered minimally essential for reporting complete and accurate case reports. Furthermore, independent raters validated the clarity of each selected items between each round of voting. All case reports containing data on extracorporeal treatments in poisoning published in Medline in 2011 were reviewed during the external validation rounds. Twenty-one panelists (20 from the EXTRIP workgroup and an invited expert on pharmacology reporting guidelines) participated in the modified Delphi technique. This group included journal editors and experts in nephrology, clinical toxicology, critical care medicine, emergency medicine, and clinical pharmacology. Three independent raters participated in the validation rounds. Panelists voted on a total of 144 items in the first round and 137 items in the second round, with response rates of 96.3% and 98.3%, respectively. Twenty case reports were evaluated at each validation round and the independent raters' response rate was 99.6% and 98.8% per validation round. The final checklist consists of 114 items considered essential for case study reporting. This methodology of alternate voting and external validation rounds was useful in developing the first reporting guideline for case studies in the field of extracorporeal treatments in poisoning. We believe that this guideline will improve the completeness and transparency of published case reports and that the systematic aggregation of information from case reports may provide early signals of effectiveness and/or harm, thereby improving healthcare decision-making. PMID:24890576

A consensus exercise identifying priorities for research into clinical effectiveness among children's orthopaedic surgeons in the United Kingdom.

PubMed

Perry, D C; Wright, J G; Cooke, S; Roposch, A; Gaston, M S; Nicolaou, N; Theologis, T

2018-05-01

Aims High-quality clinical research in children's orthopaedic surgery has lagged behind other surgical subspecialties. This study used a consensus-based approach to identify research priorities for clinical trials in children's orthopaedics. Methods A modified Delphi technique was used, which involved an initial scoping survey, a two-round Delphi process and an expert panel formed of members of the British Society of Children's Orthopaedic Surgery. The survey was conducted amongst orthopaedic surgeons treating children in the United Kingdom and Ireland. Results A total of 86 clinicians contributed to both rounds of the Delphi process, scoring priorities from one (low priority) to five (high priority). Elective topics were ranked higher than those relating to trauma, with the top ten elective research questions scoring higher than the top question for trauma. Ten elective, and five trauma research priorities were identified, with the three highest ranked questions relating to the treatment of slipped capital femoral epiphysis (mean score 4.6/ 5), Perthes' disease (4.5) and bone infection (4.5). Conclusion This consensus-based research agenda will guide surgeons, academics and funders to improve the evidence in children's orthopaedic surgery and encourage the development of multicentre clinical trials. Cite this article: Bone Joint J 2018;100-B:680-4.

Physical Restraints: Consensus of a Research Definition Using a Modified Delphi Technique.

PubMed

Bleijlevens, Michel H C; Wagner, Laura M; Capezuti, Elizabeth; Hamers, Jan P H

2016-11-01

To develop an internationally accepted research definition of physical restraint. Comprehensive literature search followed by a web-based, three-round, modified Delphi technique comprising reviews and feedback. Clinical care settings. An international group of 48 experts consisting of researchers and clinicians from 14 countries who have made sustained contribution to research and clinical application in the field of physical restraint in clinical care. Data were collected using an online survey program and one in-person meeting. Results of the online survey and the in-person meeting were used for distribution in subsequent rounds until consensus on a definition was reached. Consensus was defined as 90% of the participating experts agreeing with the proposed definition of physical restraint. Thirty-four different definitions were identified during the literature search and served as a starting point for the modified Delphi technique. After three rounds, 45 (95.7%) of 47 remaining experts agreed with the newly proposed definition: "Physical restraint is defined as any action or procedure that prevents a person's free body movement to a position of choice and/or normal access to his/her body by the use of any method, attached or adjacent to a person's body that he/she cannot control or remove easily." A multidisciplinary, internationally representative panel of experts reached consensus on a research definition for physical restraints in older persons. This is a necessary step toward improved comparisons of the prevalence of physical restraint use across studies and countries. This definition can further guide research interventions aimed at reducing use of physical restraints. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Development of an active behavioural physiotherapy intervention (ABPI) for acute whiplash-associated disorder (WAD) II management: a modified Delphi study.

PubMed

Wiangkham, Taweewat; Duda, Joan; Haque, M Sayeed; Rushton, Alison

2016-09-14

To develop an active behavioural physiotherapy intervention (ABPI) for managing acute whiplash-associated disorder (WAD) II using a modified Delphi method to develop consensus for the basic features of the ABPI. Modified Delphi study. Our systematic review and meta-analysis evaluating conservative management for acute WADII found that a combined ABPI may be a useful intervention to prevent patients progressing to chronicity. No previous research has considered a combined behavioural approach and active physiotherapy in the management of acute WADII patients. The ABPI was therefore developed using a rigorous consensus method using international research and local clinical whiplash experts. Descriptive statistics were used to assess consensus in each round. Online international survey. A purposive sample of 97 potential participants (aiming to recruit n=30) consisting of international research whiplash experts, UK private physiotherapists and UK postgraduate musculoskeletal physiotherapy students were invited to participate via electronic mail with an attached participant information sheet and consent form. 36 individuals signed and returned the consent form. In round 1, 32/36 participants (response rate=89%, mean age±SD=36.03±13.22 years) across 8 countries (Australia, Finland, Greece, India, Netherlands, Norway, Sweden and UK) contributed to round 1 questionnaire. Response rates were 78% and 75% for rounds 2 and 3, respectively. Following round 3, 12 underlying principles (eg, return to normal function as soon as possible, pain management, encouragement of self-management, reduce fear avoidance and anxiety) achieved consensus. The treatment components reaching consensus included behavioural (eg, education, reassurance, self-management) and physiotherapy components (eg, exercises for stability and mobility). No passive intervention achieved consensus. Experts suggested and agreed the underlying principles and treatment components of the ABPI for the management of acute WADII. The ABPI was underpinned by social cognitive theory focusing on self-efficacy enhancement prior to conducting a phase II trial. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

The U. S. transportation sector in the year 2030: results of a two-part Delphi survey.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Morrison, G.; Stephens, T.S.; Univ. of California at Davis)

2011-10-11

A two-part Delphi Survey was given to transportation experts attending the Asilomar Conference on Transportation and Energy in August, 2011. The survey asked respondents about trends in the US transportation sector in 2030. Topics included: alternative vehicles, high speed rail construction, rail freight transportation, average vehicle miles traveled, truck versus passenger car shares, vehicle fuel economy, and biofuels in different modes. The survey consisted of two rounds -- both asked the same set of seven questions. In the first round, respondents were given a short introductory paragraph about the topic and asked to use their own judgment in their responses.more » In the second round, the respondents were asked the same questions, but were also given results from the first round as guidance. The survey was sponsored by Argonne National Lab (ANL), the National Renewable Energy Lab (NREL), and implemented by University of California at Davis, Institute of Transportation Studies. The survey was part of the larger Transportation Energy Futures (TEF) project run by the Department of Energy, Office of Energy Efficiency and Renewable Energy. Of the 206 invitation letters sent, 94 answered all questions in the first round (105 answered at least one question), and 23 of those answered all questions in the second round. 10 of the 23 second round responses were at a discussion section at Asilomar, while the remaining were online. Means and standard deviations of responses from Round One and Two are given in Table 1 below. One main purpose of Delphi surveys is to reduce the variance in opinions through successive rounds of questioning. As shown in Table 1, the standard deviations of 25 of the 30 individual sub-questions decreased between Round One and Round Two, but the decrease was slight in most cases.« less

Development of quality indicators for low-risk labor care provided by midwives using a RAND-modified Delphi method.

PubMed

Ueda, Kayo; Ohtera, Shosuke; Kaso, Misato; Nakayama, Takeo

2017-09-22

In childbirth, most deliveries are low-risk, defined as spontaneous labor at full term without special high-risk facts or complications, especially in high-resource countries where maternal and perinatal mortality rates are very low. Indeed, the majority of mothers and infants have no serious conditions during labor. However, the quality of care provided is not assured, and performance may vary by birthing facility and provider. The overuse of technology in childbirth in some parts of the world is almost certainly based on assumptions like, "something can go wrong at any minute." There is a need to assess the quality of care provided for mothers and infants in low-risk labor. We aimed to develop specific quality indicators for low-risk labor care provided primarily by midwives in Japan. We used a RAND-modified Delphi method, which integrates evidence review with expert consensus development. The procedure comprises five steps: (1) literature review, including clinical practice guidelines, to extract and develop quality indicator candidates; (2) formation of a multidisciplinary panel; (3) independent panel ratings (Round 1); (4) panel meeting and independent panel ratings (Round 2); and (5) independent panel ratings (Round 3). The three independent panel ratings (Rounds 1-3) were held between July and December 2012. The assembled multidisciplinary panel comprised eight clinicians (two pediatricians, three obstetricians, and three midwives) and three mothers who were nonclinicians. Evidentiary review extracted 166 key recommendations from 32 clinical practice guidelines, and 31 existing quality indicators were added. After excluding duplicate recommendations and quality indicators, the panel discussed 25 candidate indicators. Of these, 18 were adopted, one was modified, six were not adopted, and four were added during the meeting, respectively. We established 23 quality indicators for low-risk labor care provided by midwives in labor units in Japan.

What should dental services for people with disabilities be like? Results of an Irish Delphi panel survey.

PubMed

Mac Giolla Phadraig, Caoimhin; Nunn, June; Dougall, Alison; O'Neill, Eunan; McLoughlin, Jacinta; Guerin, Suzanne

2014-01-01

This study aimed to generate prioritised goals for oral health services for people with disabilities as a first step in meeting the need for evidence based oral health services for people with disabilities in Ireland. The study used a three round modified e-Delphi method, involving dental service professionals and people with disabilities or their representatives, in Ireland. Three rounds were completed online using SurveyMonkey. Round 1 asked: "List what you think dental services for people with disabilities in Ireland should be like." Items for subsequent rounds were generated from responses to Round 1. Round 2 and Round 3 used 5 point Likert scales to rank these items by priority: from No Priority (1) to Top Priority (5). Consensus was achieved on each item where at least 80% of respondents considered an item either High or Top Priority. A consensus meeting concluded the process. Sixty-one panelists started and 48 completed the survey. The Delphi panel agreed on level of priority for 69 items and generated 16 consensus statements. These statements covered a range of topics such as access to care, availability of information and training, quality of care, dental treatment and cost. A recurrent theme relating to the appropriateness of care to individual need arose across topics suggesting a need to match service delivery according to the individual's needs, wants and expectations rather than the disability type/diagnosis based service which predominates today. This process produced a list of prioritised goals for dental services for people with disabilities. This creates a foundation for building evidence-based service models for people with disabilities in Ireland.

Multidisciplinary Delphi Development of a Scale to Evaluate Team Function in Obstetric Emergencies: The PETRA Scale.

PubMed

Balki, Mrinalini; Hoppe, David; Monks, David; Cooke, Mary Ellen; Sharples, Lynn; Windrim, Rory

2017-06-01

The objective of this study was to develop a new interdisciplinary teamwork scale, the Perinatal Emergency: Team Response Assessment (PETRA), for the management of obstetric crises, through consensus agreement of obstetric caregivers. This prospective study was performed using expert consensus, based on a Delphi method. The study investigators developed a new PETRA tool, specifically related to obstetric crisis management, based on the existing literature and discussions among themselves. The scale was distributed to a selected panel of experts in the field for the Delphi process. After each round of Delphi, every component of the scale was analyzed quantitatively by the percentage of agreement ratings and each comment reviewed by the blinded investigators. The assessment scale was then modified, with components of less than 80% agreement removed from the scale. The process was repeated on three occasions to reach a consensus and final PETRA scale. Fourteen of 24 invited experts participated in the Delphi process. The original PETRA scale included six categories and 48 items, one global scale item, and a 3-point rubric for rating. The overall percentage agreement by experts in the first, second, and third rounds was 95.0%, 93.2%, and 98.5%, respectively. The final scale after the third round of Delphi consisted of the following seven categories: shared mental model, communication, situational awareness, leadership, followership, workload management, and positive/effective behaviours and attitudes. There were 34 individual items within these categories, each with a 5-point rating rubric (1 = unacceptable to 5 = perfect). Using a structured Delphi method, we established the face and content validity of this assessment scale that focuses on important aspects of interdisciplinary teamwork in the management of obstetric crises. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study

PubMed Central

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-01-01

Objectives To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. Methods A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. Results In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Conclusions Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. PMID:24670554

Defining Malaysian Knowledge Society: Results from the Delphi Technique

NASA Astrophysics Data System (ADS)

Hamid, Norsiah Abdul; Zaman, Halimah Badioze

This paper outlines the findings of research where the central idea is to define the term Knowledge Society (KS) in Malaysian context. The research focuses on three important dimensions, namely knowledge, ICT and human capital. This study adopts a modified Delphi technique to seek the important dimensions that can contribute to the development of Malaysian's KS. The Delphi technique involved ten experts in a five-round iterative and controlled feedback procedure to obtain consensus on the important dimensions and to verify the proposed definition of KS. The finding shows that all three dimensions proposed initially scored high and moderate consensus. Round One (R1) proposed an initial definition of KS and required comments and inputs from the panel. These inputs were then used to develop items for a R2 questionnaire. In R2, 56 out of 73 items scored high consensus and in R3, 63 out of 90 items scored high. R4 was conducted to re-rate the new items, in which 8 out of 17 items scored high. Other items scored moderate consensus and no item scored low or no consensus in all rounds. The final round (R5) was employed to verify the final definition of KS. Findings and discovery of this study are significant to the definition of KS and the development of a framework in the Malaysian context.

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

Guiding Principles for Student Leadership Development in the Doctor of Pharmacy Program to Assist Administrators and Faculty Members in Implementing or Refining Curricula

PubMed Central

Boyle, Cynthia J.; Janke, Kristin K.

2013-01-01

Objective. To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Results. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Conclusions. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought. PMID:24371345

Guiding principles for student leadership development in the doctor of pharmacy program to assist administrators and faculty members in implementing or refining curricula.

PubMed

Traynor, Andrew P; Boyle, Cynthia J; Janke, Kristin K

2013-12-16

To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought.

Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi consensus approach.

PubMed

Wakai, Abel; O'Sullivan, Ronan; Staunton, Paul; Walsh, Cathal; Hickey, Fergal; Plunkett, Patrick K

2013-04-01

The objective of this study was to develop a consensus among emergency medicine (EM) specialists working in Ireland for emergency department (ED) key performance indicators (KPIs). The method employed was a three-round electronic modified-Delphi process. An online questionnaire with 54 potential KPIs was set up for round 1 of the Delphi process. The Delphi panel consisted of all registered EM specialists in Ireland. Each indicator on the questionnaire was rated using a five-point Likert-type rating scale. Agreement was defined as at least 70% of the responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using standard descriptive statistics. Data were also analysed as the mean of the Likert rating with 95% confidence intervals (95% CIs). Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Statistical analyses were carried out using SPSS version 16.0. The response rates in rounds 1, 2 and 3 were 86, 88 and 88%, respectively. Ninety-seven potential indicators reached agreement after the three rounds. In the context of the Donabedian structure-process-outcome framework of performance indicators, 41 (42%) of the agreed indicators were structure indicators, 52 (54%) were process indicators and four (4%) were outcome indicators. Overall, the top-three highest rated indicators were: presence of a dedicated ED clinical information system (4.7; 95% CI 4.6-4.9), ED compliance with minimum design standards (4.7; 95% CI 4.5-4.8) and time from ED arrival to first ECG in suspected cardiac chest pain (4.7; 95% CI 4.5-4.9). The top-three highest rated indicators specific to clinical care of children in EDs were: time to administration of antibiotics in children with suspected bacterial meningitis (4.6; 95% CI 4.5-4.8), separate area available within EDs (seeing both adults and children) to assess children (4.4; 95% CI 4.2-4.6) and time to administration of analgesia in children with forearm fractures (4.4; 95% CI 4.2-4.7). Employing a Delphi consensus process, it was possible to reach a consensus among EM specialists in Ireland on a suite of 97 KPIs for EDs.

Consensus in controversy: The modified Delphi method applied to Gynecologic Oncology practice.

PubMed

Cohn, David E; Havrilesky, Laura J; Osann, Kathryn; Lipscomb, Joseph; Hsieh, Susie; Walker, Joan L; Wright, Alexi A; Alvarez, Ronald D; Karlan, Beth Y; Bristow, Robert E; DiSilvestro, Paul A; Wakabayashi, Mark T; Morgan, Robert; Mukamel, Dana B; Wenzel, Lari

2015-09-01

To determine the degree of consensus regarding the probabilities of outcomes associated with IP/IV and IV chemotherapy. A survey was administered to an expert panel using the Delphi method. Ten ovarian cancer experts were asked to estimate outcomes for patients receiving IP/IV or IV chemotherapy. The clinical estimates were: 1) probability of completing six cycles of chemotherapy, 2) probability of surviving five years, 3) median survival, and 4) probability of ER/hospital visits during treatment. Estimates for two patients, one with a low comorbidity index (patient 1) and the other with a moderate index (patient 2), were included. The survey was administered in three rounds, and panelists could revise their subsequent responses based on review of the anonymous opinions of their peers. The ranges were smaller for IV compared with IP/IV therapy. Ranges decreased with each round. Consensus converged around outcomes related to IP/IV chemotherapy for: 1) completion of 6 cycles of therapy (type 1 patient, 62%, type 2 patient, 43%); 2) percentage of patients surviving 5 years (type 1 patient, 66%, type 2 patient, 47%); and 3) median survival (type 1 patient, 83 months, type 2 patient, 58 months). The group required three rounds to achieve consensus on the probabilities of ER/hospital visits (type 1 patient, 24%, type 2 patient, 35%). Initial estimates of survival and adverse events associated with IP/IV chemotherapy differ among experts. The Delphi process works to build consensus and may be a pragmatic tool to inform patients of their expected outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

Using a Delphi process to establish consensus on emergency medicine clerkship competencies.

PubMed

Penciner, Rick; Langhan, Trevor; Lee, Richard; McEwen, Jill; Woods, Robert A; Bandiera, Glen

2011-01-01

Currently, there is no consensus on the core competencies required for emergency medicine (EM) clerkships in Canada. Existing EM curricula have been developed through informal consensus or local efforts. The Delphi process has been used extensively as a means for establishing consensus. The purpose of this project was to define core competencies for EM clerkships in Canada, to validate a Delphi process in the context of national curriculum development, and to demonstrate the adoption of the CanMEDS physician competency paradigm in the undergraduate medical education realm. Using a modified Delphi process, we developed a consensus amongst a panel of expert emergency physicians from across Canada utilizing the CanMEDS 2005 Physician Competency Framework. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). This study demonstrated that a modified Delphi process can result in a strong consensus around a realistic number of core competencies for EM clerkships. We propose that such a method could be used by other medical specialties and health professions to develop rotation-specific core competencies.

Expert Consensus for Discharge Referral Decisions Using Online Delphi

PubMed Central

Bowles, Kathy H.; Holmes, John H.; Naylor, Mary D.; Liberatore, Matthew; Nydick, Robert

2003-01-01

This paper describes the results of using a modified Delphi approach designed to achieve consensus from eight discharge planning experts regarding the decision to refer hospitalized older adults for post-discharge follow-up. Experts reviewed 150 cases using an online website designed to facilitate their interaction and efforts to reach agreement on the need for a referral for post-discharge care and the appropriate site for such care. In contrast to an average of eight weeks to complete just 50 cases using the traditional mail method, the first online Delphi round for 150 cases were completed in six weeks. Data provided by experts suggest that online Delphi is a time efficient and acceptable methodology for reaching group consensus. Other benefits include instant access to Delphi decision results, live knowledge of the time requirements and progress of each expert, and cost savings in postage, paper, copying, and storage of paper documents. This online Delphi methodology is highly recommended. PMID:14728143

Effective self-management strategies for bipolar disorder: A community-engaged Delphi Consensus Consultation study.

PubMed

Michalak, Erin E; Suto, Melinda J; Barnes, Steven J; Hou, Sharon; Lapsley, Sara; Scott, Mike W; Murray, Greg; Austin, Jehannine; Elliott, Nusha Balram; Berk, Lesley; Crest Bd

2016-12-01

Self-management represents an important complement to psychosocial treatments for bipolar disorder (BD), but research is limited. Specifically, little is known about self-management approaches for elevated mood states; this study investigated self-management strategies for: (1) maintaining balance in mood, and (2) stopping progression into hypomania/mania. To identify the common components of BD self-management, Delphi Consensus Consultation methods were combined with a Community-Based Participatory Research (CBPR) approach across five study phases: (1) Qualitative dataset content analysis; (2) Academic/grey literature reviews; (3) Content analysis; (4) Two Delphi rounds (rating strategies on a 5-point Likert scale, Very Unhelpful-Very Helpful), and; (5) Quantitative analysis and interpretation. Participants were people with BD and healthcare providers. Phases 1 and 2 identified 262 and 3940 candidate strategies, respectively; 3709 were discarded as duplicates/unintelligible. The remaining 493 were assessed via Delphi methods in Phase 4: 101 people with BD and 52 healthcare providers participated in Round 1; 83 of the BD panel (82%) and 43 of the healthcare provider panel (83%) participated in Round 2-exploratory factor analysis (EFA) was conducted on Round 2 results. EFA was underpowered and sample was not ethnically diverse, limiting generalizability. High concordance was observed in ratings of strategy effectiveness between the two panels. Future research could usefully investigate the provisional discovery here of underlying factors which link individual strategies. For example, 'maintaining hope' underpinned strategies for maintaining balance, and 'decreasing use of stimulants' underpinned strategies to interrupt hypo/manic ascent. There is merit in combining CBPR and Delphi methods. Copyright © 2016 Elsevier B.V. All rights reserved.

Developing a research agenda for the American Society of Colon and Rectal Surgeons: results of a delphi approach.

PubMed

Burt, Caroline G; Cima, Robert R; Koltun, Walter A; Littlejohn, Charles E; Ricciardi, Rocco; Temple, Larissa K; Rothenberger, David A; Baxter, Nancy N

2009-05-01

By use of a systematic approach, the aim of this project was to survey a group of colorectal specialists and reach a consensus on the research questions of highest importance in terms of clinical care. A modified Delphi process was performed. In Round 1 research questions were solicited from members of The American Society of Colon and Rectal Surgeons. A review group categorized the results, combined similar questions, and presented them to The American Society of Colon and Rectal Surgeons membership in Round 2 for prioritizing according to importance. In Round 3 the 50 questions with the highest scores in Round 2 were reranked by The American Society of Colon and Rectal Surgeons membership to produce the 20 highest-priority research questions. A total of 203 respondents in Round 1 submitted 746 questions. The review team reduced these to 105 individual questions encompassing 21 topics in colorectal surgical practice. In Rounds 2 and 3, 399 and 360 respondents, respectively, prioritized the questions presented. The final 20 items included 14 questions related to colorectal cancer, and 6 were on benign disease topics. The research agenda produced by this study reflects the clinical issues of greatest importance to colorectal surgeons. The results are of potential benefit to researchers, funding organizations, medical journals, and ultimately, patients.

International identification of research priorities for postgraduate theses in musculoskeletal physiotherapy using a modified Delphi technique.

PubMed

Rushton, Alison; Moore, Ann

2010-04-01

Research priorities are established to identify gaps and maximise opportunities in developing an evidence base. Numerous postgraduate research theses are undertaken each year within the specialist area of musculoskeletal physiotherapy, and although some are published, greater potential for influence exists. This paper identifies international research priorities for postgraduate theses developed using a consensual Delphi process. A purposive sample included course tutors and expert clinicians nominated by Member Organisations of the International Federation of Orthopaedic Manipulative Physical Therapists (N=91). Round 1 requested >10 priorities for theses, and content analysis identified research themes. Round 2 requested participants rank the importance of each theme on a 1-5 scale, and round 3 requested ranking the importance and feasibility of the research question areas within each agreed theme. Descriptive analysis and use of Kendall's coefficient of concordance enabled interpretation of consensus. The response rate of 68% was good, identifying 23 research themes in round 1. Round 2 identified 14 research themes as important. Participant rating of the importance and feasibility of research question areas in round 3 supported 43 agreed priorities demonstrating good measurement validity. Establishing priorities provides a vision of how postgraduate theses can contribute to the developing evidence base and offer a focus for international collaboration. Copyright 2009 Elsevier Ltd. All rights reserved.

A Delphi study and ranking exercise to support commissioning services: future delivery of Thrombectomy services in England.

PubMed

Halvorsrud, Kristoffer; Flynn, Darren; Ford, Gary A; McMeekin, Peter; Bhalla, Ajay; Balami, Joyce; Craig, Dawn; White, Phil

2018-02-22

Intra-arterial thrombectomy is the gold standard treatment for large artery occlusive stroke. However, the evidence of its benefits is almost entirely based on trials delivered by experienced neurointerventionists working in established teams in neuroscience centres. Those responsible for the design and prospective reconfiguration of services need access to a comprehensive and complementary array of information on which to base their decisions. This will help to ensure the demonstrated effects from trials may be realised in practice and account for regional/local variations in resources and skill-sets. One approach to elucidate the implementation preferences and considerations of key experts is a Delphi survey. In order to support commissioning decisions, we aimed using an electronic Delphi survey to establish consensus on the options for future organisation of thrombectomy services among physicians with clinical experience in managing large artery occlusive stroke. A Delphi survey was developed with 12 options for future organisation of thrombectomy services in England. A purposive sampling strategy established an expert panel of stroke physicians from the British Association of Stroke Physicians (BASP) Clinical Standards and/or Executive Membership that deliver 24/7 intravenous thrombolysis. Options with aggregate scores falling within the lowest quartile were removed from the subsequent Delphi round. Options reaching consensus following the two Delphi rounds were then ranked in a final exercise by both the wider BASP membership and the British Society of Neuroradiologists (BSNR). Eleven stroke physicians from BASP completed the initial two Delphi rounds. Three options achieved consensus, with subsequently wider BASP (97%, n = 43) and BSNR members (86%, n = 21) assigning the highest approval rankings in the final exercise for transferring large artery occlusive stroke patients to nearest neuroscience centre for thrombectomy based on local CT/CT Angiography. The initial Delphi rounds ensured optimal reduction of options by an expert panel of stroke physicians, while subsequent ranking exercises allowed remaining options to be ranked by a wider group of experts within stroke to reach consensus. The preferred implementation option for thrombectomy is investigating suspected acute stroke patients by CT/CT Angiography and secondary transfer of large artery occlusive stroke patients to the nearest neuroscience (thrombectomy) centre.

Expert surgical consensus for prenatal counseling using the Delphi method.

PubMed

Berman, Loren; Jackson, Jordan; Miller, Kristen; Kowalski, Rebecca; Kolm, Paul; Luks, Francois I

2017-11-28

Pediatric surgeons frequently offer prenatal consultation for congenital pulmonary airway malformation (CPAM) and congenital diaphragmatic hernia (CDH); however, there is no evidence-based consensus to guide prenatal decision making and counseling for these conditions. Eliciting feedback from experts is integral to defining best practice regarding prenatal counseling and intervention. A Delphi consensus process was undertaken using a panel of pediatric surgeons identified as experts in fetal therapy to address current limitations. Areas of discrepancy in the literature on CPAM and CDH were identified and used to generate a list of content and intervention questions. Experts were invited to participate in an online Delphi survey. Items that did not reach first-round consensus were broken down into additional questions, and consensus was achieved in the second round. Fifty-four surgeons (69%) responded to at least one of the two survey rounds. During round one, consensus was reached on 54 of 89 survey questions (61%), and 45 new questions were developed. During round two, consensus was reached on 53 of 60 survey questions (88%). We determined expert consensus to establish guidelines regarding perinatal management of CPAM and CDH. Our results can help educate pediatric surgeons participating in perinatal care of these patients. V. Copyright © 2017 Elsevier Inc. All rights reserved.

Framework of behavioral indicators evaluating TB health promotion outcomes: a modified Delphi study of TB policymakers and health workers.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Oren, Eyal; Cao, Jia

2015-12-15

Although TB health promotion directed at policy makers and healthcare workers (HCWs) is considered important to tuberculosis (TB) control, no indicators currently assess the impact of such promotional activities. This article is the second in a series of papers that seek to establish a framework of behavioral indicators for outcome evaluation of TB health promotion, using the Delphi method. In the first article, we sought to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. The objective of this second article is to present an indicator framework that can be used to assess behavioral outcomes of TB health promotion directed at policy makers and HCWs. A two-round, modified Delphi method was used to establish the indicators. Sixteen experts who were knowledgeable and experienced in the field of TB control were consulted in Delphi surveys. A questionnaire was developed following 4 steps, and involved ranking indicators on a five-point Likert scale. The consensus level was 70 %. Median, mode, and Coefficient of variation (CV) were used to describe expert responses. An authority coefficient (Cr) was used to assess the degree of each expert's authority. Consensus was achieved following the two survey rounds and several iterations among the experts. For TB health-promotion activities directed at policymakers, the experts reached consensus on 2 domains ("Resource inputs" and "Policymaking and monitoring behaviors"), 4 subdomains ("Human resources" among others), and 13 indicators ("Human resources per 100,000 person" among others). For TB health-promotion activities directed at HCWs, the experts reached consensus on 5 domains ("Self-protective behaviors" among others), 6 sub-domains ("Preventing infection" among others), and 15 indicators ("Average hours of daily workplace disinfection by ultraviolet radiation" among others). This study identified a conceptual framework of core behavioral indicators to evaluate TB health-promotion activities directed at policymakers and HCWs involved in TB control. Validation in other parts of the world could lead to global consensus on behavioral indicators to evaluate TB health promotion targeted at policymakers and HCWs.

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study

PubMed Central

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-01

Objectives To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Setting Hospitals and community health centres in Taiwan. Method A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. Participants 15 Chinese healthcare practitioners with more than 6 months’ experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Results Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. Conclusions The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. PMID:28093428

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people

PubMed Central

Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Background Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Methods Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Results Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Conclusion Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond. PMID:29155870

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people.

PubMed

Stewart, Derek; Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond.

Defining the Key Competencies in Radiation Protection for Endovascular Procedures: A Multispecialty Delphi Consensus Study.

PubMed

Doyen, Bart; Maurel, Blandine; Cole, Jonathan; Maertens, Heidi; Mastracci, Tara; Van Herzeele, Isabelle

2018-02-01

Radiation protection training courses currently focus on broad knowledge topics which may not always be relevant in daily practice. The goal of this study was to determine the key competencies in radiation protection that every endovascular team member should possess and apply routinely, through multispecialty clinical content expert consensus. Consensus was obtained through a two round modified Delphi methodology. The expert panel consisted of European vascular surgeons, interventional radiologists, and interventional cardiologists/angiologists experienced in endovascular procedures. An initial list of statements, covering knowledge skills, technical skills and attitudes was created, based on a literature search. Additional statements could be suggested by the experts in the first Delphi round. Each of the statements had to be rated on a 5- point Likert scale. A statement was considered to be a key competency when the internal consistency was greater than alpha = 0.80 and at least 80% of the experts agreed (rating 4/5) or strongly agreed (rating 5/5) with the statement. Questionnaires were emailed to panel members using the Surveymonkey service. Forty-one of 65 (63.1%) invited experts agreed to participate in the study. The response rates were 36 out of 41 (87.8%): overall 38 out of 41(92.6%) in the first round and 36 out of 38 (94.7%) in the second round. The 71 primary statements were supplemented with nine items suggested by the panel. The results showed excellent consensus among responders (Cronbach's alpha = 0.937 first round; 0.958 s round). Experts achieved a consensus that 30 of 33 knowledge skills (90.9%), 23 of 27 technical skills (82.1%), and 15 of 20 attitudes (75.0%) should be considered as key competencies. A multispecialty European endovascular expert panel reached consensus about the key competencies in radiation protection. These results may serve to create practical and relevant radiation protection training courses in the future, enhancing radiation safety for both patients and the entire endovascular team. Copyright © 2017 European Society for Vascular Surgery. All rights reserved.

Assessing Consensus Between UK Renal Clinicians on Listing for Kidney Transplantation: A Modified Delphi Study.

PubMed

Tonkin-Crine, Sarah; Pruthi, Rishi; Taylor, Dominic M; Leydon, Geraldine M; Calestani, Melania; Oniscu, Gabriel C; Bradley, J Andrew; Tomson, Charles R; Bradley, Clare; Dudley, Christopher; Watson, Christopher J E; Draper, Heather; Johnson, Rachel J; Metcalfe, Wendy; Fogarty, Damian G; Ravanan, Rommel; Roderick, Paul

2018-05-01

It is well recognized that there is significant variation between centers in access to kidney transplantation. In the absence of high-grade evidence, it is unclear whether variation is due to patient case mix, other center factors, or individual clinician decisions. This study sought consensus between UK clinicians on factors that should influence access to kidney transplantation. As part of the Access to Transplantation and Transplant Outcome Measures project, consultant nephrologists and transplant surgeons in 71 centers were invited to participate in a Delphi study involving 2 rounds. During rounds 1 and 2, participants rated their agreement to 29 statements covering 8 topics regarding kidney transplantation. A stakeholder meeting was used to discuss statements of interest after the 2 rounds. In total, 122 nephrologists and 16 transplant surgeons from 45 units participated in rounds 1 and 2. After 2 rounds, 12 of 29 statements reached consensus. Fifty people participated in the stakeholder meeting. After the stakeholder meeting, a further 4 statements reached agreement. Of the 8 topics covered, consensus was reached in 6: use of a transplant protocol, patient age, body mass index, patient compliance with treatment, cardiac workup, and use of multidisciplinary meetings. Consensus was not reached on screening for malignancy and use of peripheral Doppler studies. The Delphi process identified factors upon which clinicians agreed and areas where consensus could not be achieved. The findings should inform national guidelines to support decision making in the absence of high quality evidence and to guide areas that warrant future research.

Assessing Consensus Between UK Renal Clinicians on Listing for Kidney Transplantation: A Modified Delphi Study

PubMed Central

Tonkin-Crine, Sarah; Pruthi, Rishi; Taylor, Dominic M.; Leydon, Geraldine M.; Calestani, Melania; Oniscu, Gabriel C.; Bradley, J. Andrew; Tomson, Charles R.; Bradley, Clare; Dudley, Christopher; Watson, Christopher J.E.; Draper, Heather; Johnson, Rachel J.; Metcalfe, Wendy; Fogarty, Damian G.; Ravanan, Rommel; Roderick, Paul

2018-01-01

Background It is well recognized that there is significant variation between centers in access to kidney transplantation. In the absence of high-grade evidence, it is unclear whether variation is due to patient case mix, other center factors, or individual clinician decisions. This study sought consensus between UK clinicians on factors that should influence access to kidney transplantation. Methods As part of the Access to Transplantation and Transplant Outcome Measures project, consultant nephrologists and transplant surgeons in 71 centers were invited to participate in a Delphi study involving 2 rounds. During rounds 1 and 2, participants rated their agreement to 29 statements covering 8 topics regarding kidney transplantation. A stakeholder meeting was used to discuss statements of interest after the 2 rounds. Results In total, 122 nephrologists and 16 transplant surgeons from 45 units participated in rounds 1 and 2. After 2 rounds, 12 of 29 statements reached consensus. Fifty people participated in the stakeholder meeting. After the stakeholder meeting, a further 4 statements reached agreement. Of the 8 topics covered, consensus was reached in 6: use of a transplant protocol, patient age, body mass index, patient compliance with treatment, cardiac workup, and use of multidisciplinary meetings. Consensus was not reached on screening for malignancy and use of peripheral Doppler studies. Conclusions The Delphi process identified factors upon which clinicians agreed and areas where consensus could not be achieved. The findings should inform national guidelines to support decision making in the absence of high quality evidence and to guide areas that warrant future research. PMID:29796414

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process.

PubMed

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-09-10

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention.

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process

PubMed Central

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-01-01

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention. PMID:26378557

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

Development of a Quality and Safety Competency Curriculum for Radiation Oncology Residency: An International Delphi Study.

PubMed

Adleman, Jenna; Gillan, Caitlin; Caissie, Amanda; Davis, Carol-Anne; Liszewski, Brian; McNiven, Andrea; Giuliani, Meredith

2017-06-01

To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through web conference discussion and reranked in Round 2. An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of a Quality and Safety Competency Curriculum for Radiation Oncology Residency: An International Delphi Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Adleman, Jenna; Gillan, Caitlin; Radiation Medicine Program, Princess Margaret Cancer Centre, Toronto, Ontario

Purpose: To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. Methods and Materials: A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through webmore » conference discussion and reranked in Round 2. Results: An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. Conclusions: This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs.« less

Clarifying concepts of food parenting practices. A Delphi study with an application to snacking behavior.

PubMed

Gevers, D W M; Kremers, S P J; de Vries, N K; van Assema, P

2014-08-01

Inconsistencies in measurements of food parenting practices continue to exist. Fundamental to this problem is the lack of clarity about what is understood by different concepts of food parenting practices. The purpose of this study was to clarify food parenting practice concepts related to snacking. A three round Delphi study among an international group of experts (n = 63) was conducted. In the first round, an open-ended survey was used to collect food parenting practice descriptions and concept labels associated with those practices. In the second round, participants were asked to match up descriptions with the appropriate concept labels. The third and final round allowed participants to reconsider how descriptions and concept labels were matched, taking into account the opinions expressed in round two. Round one produced 408 descriptions of food parenting practices and 110 different concept names. Round two started with 116 descriptions of food parenting practices and 20 concept names. On 40 descriptions, consensus regarding the underlying concept name was reached in round two. Of the remaining 76 descriptions, consensus on 47 descriptions regarding the underlying concept name was reached in round three. The present study supports the essential process of consensus development with respect to food parenting practices concepts. Copyright © 2014 Elsevier Ltd. All rights reserved.

A consensus-based gold standard for the evaluation of mass casualty triage systems.

PubMed

Lerner, E Brooke; McKee, Courtney H; Cady, Charles E; Cone, David C; Colella, M Riccardo; Cooper, Arthur; Coule, Phillip L; Lairet, Julio R; Liu, J Marc; Pirrallo, Ronald G; Sasser, Scott M; Schwartz, Richard; Shepherd, Greene; Swienton, Raymond E

2015-01-01

Accuracy and effectiveness analyses of mass casualty triage systems are limited because there are no gold standard definitions for each of the triage categories. Until there is agreement on which patients should be identified by each triage category, it will be impossible to calculate sensitivity and specificity or to compare accuracy between triage systems. To develop a consensus-based, functional gold standard definition for each mass casualty triage category. National experts were recruited through the lead investigators' contacts and their suggested contacts. Key informant interviews were conducted to develop a list of potential criteria for defining each triage category. Panelists were interviewed in order of their availability until redundancy of themes was achieved. Panelists were blinded to each other's responses during the interviews. A modified Delphi survey was developed with the potential criteria identified during the interview and delivered to all recruited experts. In the early rounds, panelists could add, remove, or modify criteria. In the final rounds edits were made to the criteria until at least 80% agreement was achieved. Thirteen national and local experts were recruited to participate in the project. Six interviews were conducted. Three rounds of voting were performed, with 12 panelists participating in the first round, 12 in the second round, and 13 in the third round. After the first two rounds, the criteria were modified according to respondent suggestions. In the final round, over 90% agreement was achieved for all but one criterion. A single e-mail vote was conducted on edits to the final criterion and consensus was achieved. A consensus-based, functional gold standard definition for each mass casualty triage category was developed. These gold standard definitions can be used to evaluate the accuracy of mass casualty triage systems after an actual incident, during training, or for research.

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study.

PubMed

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-09-01

To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Japanese Clinical Guidelines for Endoscopic Treatment of Pancreatolithiasis.

PubMed

Inui, Kazuo; Igarashi, Yoshinori; Irisawa, Atsushi; Ohara, Hirotaka; Tazuma, Susumu; Hirooka, Yoshiki; Fujita, Naotaka; Miyakawa, Hiroyuki; Sata, Naohiro; Shimosegawa, Tooru; Tanaka, Masao; Shiratori, Keiko; Sugiyama, Masanori; Takeyama, Yoshifumi

2015-10-01

In addition to surgery, procedures for patients with pancreatolithiasis are developing; therefore, establishing practical guidelines for the management of pancreatolithiasis is required. Three committees (the professional committee for asking clinical questions (CQs) and statements by Japanese endoscopists, the expert panel committee for rating statements by the modified Delphi method, and the evaluating committee by moderators) were organized. Eight endoscopists and a surgeon for pancreatolithiasis made the CQs and statements from a total of 694 reports of published literature by PubMed search (from 1983 to 2012). The expert panelists individually rated these clinical statements using a modified Delphi approach, in which a clinical statement receiving a median score greater than 7 on a 9-point scale from the panel was regarded as valid. The professional committee made 3, 7, and 10 CQs and statements for the concept and pathogenesis, diagnosis, and treatment, respectively. The expert panelists regarded them as valid after a 2-round modified Delphi approach. After evaluation by the moderators, the Japanese clinical guidelines for pancreatolithiasis were established. Further discussions and studies for international guidelines are needed.

Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology.

PubMed

Eubank, Breda H; Mohtadi, Nicholas G; Lafave, Mark R; Wiley, J Preston; Bois, Aaron J; Boorman, Richard S; Sheps, David M

2016-05-20

Patients presenting to the healthcare system with rotator cuff pathology do not always receive high quality care. High quality care occurs when a patient receives care that is accessible, appropriate, acceptable, effective, efficient, and safe. The aim of this study was twofold: 1) to develop a clinical pathway algorithm that sets forth a stepwise process for making decisions about the diagnosis and treatment of rotator cuff pathology presenting to primary, secondary, and tertiary healthcare settings; and 2) to establish clinical practice guidelines for the diagnosis and treatment of rotator cuff pathology to inform decision-making processes within the algorithm. A three-step modified Delphi method was used to establish consensus. Fourteen experts representing athletic therapy, physiotherapy, sport medicine, and orthopaedic surgery were invited to participate as the expert panel. In round 1, 123 best practice statements were distributed to the panel. Panel members were asked to mark "agree" or "disagree" beside each statement, and provide comments. The same voting method was again used for round 2. Round 3 consisted of a final face-to-face meeting. In round 1, statements were grouped and reduced to 44 statements that met consensus. In round 2, five statements reached consensus. In round 3, ten statements reached consensus. Consensus was reached for 59 statements representing five domains: screening, diagnosis, physical examination, investigations, and treatment. The final face-to-face meeting was also used to develop clinical pathway algorithms (i.e., clinical care pathways) for three types of rotator cuff pathology: acute, chronic, and acute-on-chronic. This consensus guideline will help to standardize care, provide guidance on the diagnosis and treatment of rotator cuff pathology, and assist in clinical decision-making for all healthcare professionals.

Classification of drugs with different risk profiles.

PubMed

Saedder, Eva Aggerholm; Brock, Birgitte; Nielsen, Lars Peter; Bonnerup, Dorthe Krogsgaard; Lisby, Marianne

2015-08-01

A risk stratification approach is needed to identify patients at high risk of medication errors and a resulting high need of medication review. The aim of this study was to perform risk stratification (distinguishing between low-risk, medium-risk and high-risk drugs) for drugs found to cause serious adverse reactions due to medication errors. The study employed a modified Delphi technique. Drugs from a systematic literature search were included into two rounds of a Delphi process. A panel of experts was asked to evaluate each identified drug's potential for harm and for clinically relevant drug-drug interactions on a scale from 1 (low risk) to 9 (high risk). A total of 36 experts were appointed to serve on the panel. Consensus was reached for 29/57 (51%) drugs or drug classes that cause harm, and for 32/57 (56%) of the drugs or drug classes that cause interactions. For the remaining drugs, a decision was made based on the median score. Two lists, one stating the drugs' potential for causing harm and the other stating clinically relevant drug-drug interactions, were stratified into low-risk, medium-risk and high-risk drugs. Based on a modified Delphi technique, we created two lists of drugs stratified into a low-risk, a medium-risk and a high-risk group of clinically relevant interactions or risk of harm to patients. The lists could be incorporated into a risk-scoring tool that stratifies the performance of medication reviews according to patients' risk of experiencing adverse reactions. none. not relevant.

Quality Metrics in Neonatal and Pediatric Critical Care Transport: A National Delphi Project.

PubMed

Schwartz, Hamilton P; Bigham, Michael T; Schoettker, Pamela J; Meyer, Keith; Trautman, Michael S; Insoft, Robert M

2015-10-01

The transport of neonatal and pediatric patients to tertiary care facilities for specialized care demands monitoring the quality of care delivered during transport and its impact on patient outcomes. In 2011, pediatric transport teams in Ohio met to identify quality indicators permitting comparisons among programs. However, no set of national consensus quality metrics exists for benchmarking transport teams. The aim of this project was to achieve national consensus on appropriate neonatal and pediatric transport quality metrics. Modified Delphi technique. The first round of consensus determination was via electronic mail survey, followed by rounds of consensus determination in-person at the American Academy of Pediatrics Section on Transport Medicine's 2012 Quality Metrics Summit. All attendees of the American Academy of Pediatrics Section on Transport Medicine Quality Metrics Summit, conducted on October 21-23, 2012, in New Orleans, LA, were eligible to participate. Candidate quality metrics were identified through literature review and those metrics currently tracked by participating programs. Participants were asked in a series of rounds to identify "very important" quality metrics for transport. It was determined a priori that consensus on a metric's importance was achieved when at least 70% of respondents were in agreement. This is consistent with other Delphi studies. Eighty-two candidate metrics were considered initially. Ultimately, 12 metrics achieved consensus as "very important" to transport. These include metrics related to airway management, team mobilization time, patient and crew injuries, and adverse patient care events. Definitions were assigned to the 12 metrics to facilitate uniform data tracking among programs. The authors succeeded in achieving consensus among a diverse group of national transport experts on 12 core neonatal and pediatric transport quality metrics. We propose that transport teams across the country use these metrics to benchmark and guide their quality improvement activities.

Terminating Sequential Delphi Survey Data Collection

ERIC Educational Resources Information Center

Kalaian, Sema A.; Kasim, Rafa M.

2012-01-01

The Delphi survey technique is an iterative mail or electronic (e-mail or web-based) survey method used to obtain agreement or consensus among a group of experts in a specific field on a particular issue through a well-designed and systematic multiple sequential rounds of survey administrations. Each of the multiple rounds of the Delphi survey…

Health Professionals' Perceptions of Sexual Assault Management: A Delphi Study

ERIC Educational Resources Information Center

Jancey, Jonine; Meuleners, Lynn; Phillips, Maureen

2011-01-01

Objective: To explore health professionals' perceptions of sexual assault management practices and identify issues related to these practices across Western Australia (WA). Design: A two-round electronic Delphi study was undertaken with health professionals (medical doctors, registered nurses, social workers and managers). Setting: Healthcare…

Insufficiently studied factors related to burnout in nursing: Results from an e-Delphi study

PubMed Central

2017-01-01

Objective This study aimed to identify potentially important factors in explaining burnout in nursing that have been insufficiently studied or ignored. Methods A three-round Delphi study via e-mail correspondence was conducted, with a group of 40 European experts. The e-Delphi questionnaire consisted of 52 factors identified from a literature review. Experts rated and scored the importance of factors in the occurrence of burnout and the degree of attention given by researchers to each of the variables listed, on a six-point Likert scale. We used the agreement percentage (>80%) to measure the level of consensus between experts. Furthermore, to confirm the level of consensus, we also calculated mean scores and modes. Regardless of the degree of consensus reached by the experts, we have calculated the mean of the stability of the answers for each expert (individual's qualitative stability) and the mean of the stability percentages of the experts (qualitative group stability). Results The response rate in the three rounds was 93.02% (n = 40). Eight new factors were suggested in the first round. After modified, the e-Delphi questionnaire in the second and third rounds had 60 factors. All the factors reached the third round with a consensus level above 80% in terms of the attention that researchers gave them in their studies. Moreover, the data show a total mean qualitative group stability of 96.21%. In the third round 9 factors were classified by experts as ‘studied very little’, 17 as ‘studied little’ and 34 as 'well studied' Conclusion Findings show that not all the factors that may influence nursing burnout have received the same attention from researchers. The panel of experts has identified factors that, although important in explaining burnout, have been poorly studied or even forgotten. Our results suggest that further study into factors such as a lack of recognition of part of the tasks that nurses perform, feminine stereotype or excessive bureaucracy is needed for a better understanding of this syndrome and improve the quality of life in nurses. PMID:28388660

Adaptation of a difficult-to-manage asthma programme for implementation in the Dutch context: a modified e-Delphi.

PubMed

Honkoop, Persijn J; Pinnock, Hilary; Kievits-Smeets, Regien M M; Sterk, Peter J; Dekhuijzen, P N Richard; In 't Veen, Johannes C C M

2017-02-09

Patients with difficult-to-manage asthma represent a heterogeneous subgroup of asthma patients who require extensive assessment and tailored management. The International Primary Care Respiratory Group approach emphasises the importance of differentiating patients with asthma that is difficult to manage from those with severe disease. Local adaptation of this approach, however, is required to ensure an appropriate strategy for implementation in the Dutch context. We used a modified three-round e-Delphi approach to assess the opinion of all relevant stakeholders (general practitioners, pulmonologists, practice nurses, pulmonary nurses and people with asthma). In the first round, the participants were asked to provide potentially relevant items for a difficult-to-manage asthma programme, which resulted in 67 items. In the second round, we asked participants to rate the relevance of specific items on a seven-point Likert scale, and 46 items were selected as relevant. In the third round, the selected items were categorised and items were ranked within the categories according to relevance. Finally, we created the alphabet acronym for the categories 'the A-I of difficult-to-manage asthma' to resonate with an established Dutch 'A-E acronym for determining asthma control'. This should facilitate implementation of this programme within the existing structure of educational material on asthma and chronic obstructive pulmonary disease (COPD) in primary care, with potential for improving management of difficult-to-manage asthma. Other countries could use a similar approach to create a locally adapted version of such a programme.

DIET@NET: Best Practice Guidelines for dietary assessment in health research.

PubMed

Cade, Janet E; Warthon-Medina, Marisol; Albar, Salwa; Alwan, Nisreen A; Ness, Andrew; Roe, Mark; Wark, Petra A; Greathead, Katharine; Burley, Victoria J; Finglas, Paul; Johnson, Laura; Page, Polly; Roberts, Katharine; Steer, Toni; Hooson, Jozef; Greenwood, Darren C; Robinson, Sian

2017-11-15

Dietary assessment is complex, and strategies to select the most appropriate dietary assessment tool (DAT) in epidemiological research are needed. The DIETary Assessment Tool NETwork (DIET@NET) aimed to establish expert consensus on Best Practice Guidelines (BPGs) for dietary assessment using self-report. The BPGs were developed using the Delphi technique. Two Delphi rounds were conducted. A total of 131 experts were invited, and of these 65 accepted, with 48 completing Delphi round I and 51 completing Delphi round II. In all, a total of 57 experts from North America, Europe, Asia and Australia commented on the 47 suggested guidelines. Forty-three guidelines were generated, grouped into the following four stages: Stage I. Define what is to be measured in terms of dietary intake (what? who? and when?); Stage II. Investigate different types of DATs; Stage III. Evaluate existing tools to select the most appropriate DAT by evaluating published validation studies; Stage IV. Think through the implementation of the chosen DAT and consider sources of potential biases. The Delphi technique consolidated expert views on best practice in assessing dietary intake. The BPGs provide a valuable guide for health researchers to choose the most appropriate dietary assessment method for their studies. These guidelines will be accessible through the Nutritools website, www.nutritools.org .

Allied health clinicians using translational research in action to develop a reliable stroke audit tool.

PubMed

Abery, Philip; Kuys, Suzanne; Lynch, Mary; Low Choy, Nancy

2018-05-23

To design and establish reliability of a local stroke audit tool by engaging allied health clinicians within a privately funded hospital. Design: Two-stage study involving a modified Delphi process to inform stroke audit tool development and inter-tester reliability. Allied health clinicians. A modified Delphi process to select stroke guideline recommendations for inclusion in the audit tool. Reliability study: 1 allied health representative from each discipline audited 10 clinical records with sequential admissions to acute and rehabilitation services. Recommendations were admitted to the audit tool when 70% agreement was reached, with 50% set as the reserve agreement. Inter-tester reliability was determined using intra-class correlation coefficients (ICCs) across 10 clinical records. Twenty-two participants (92% female, 50% physiotherapists, 17% occupational therapists) completed the modified Delphi process. Across 6 voting rounds, 8 recommendations reached 70% agreement and 2 reached 50% agreement. Two recommendations (nutrition/hydration; goal setting) were added to ensure representation for all disciplines. Substantial consistency across raters was established for the audit tool applied in acute stroke (ICC .71; range .48 to .90) and rehabilitation (ICC.78; range .60 to .93) services. Allied health clinicians within a privately funded hospital generally agreed in an audit process to develop a reliable stroke audit tool. Allied health clinicians agreed on stroke guideline recommendations to inform a stroke audit tool. The stroke audit tool demonstrated substantial consistency supporting future use for service development. This process, which engages local clinicians, could be adopted by other facilities to design reliable audit tools to identify local service gaps to inform changes to clinical practice. © 2018 John Wiley & Sons, Ltd.

Defining a Leader Role curriculum for radiation oncology: A global Delphi consensus study.

PubMed

Turner, Sandra; Seel, Matthew; Trotter, Theresa; Giuliani, Meredith; Benstead, Kim; Eriksen, Jesper G; Poortmans, Philip; Verfaillie, Christine; Westerveld, Henrike; Cross, Shamira; Chan, Ming-Ka; Shaw, Timothy

2017-05-01

The need for radiation oncologists and other radiation oncology (RO) professionals to lead quality improvement activities and contribute to shaping the future of our specialty is self-evident. Leadership knowledge, skills and behaviours, like other competencies, can be learned (Blumenthal et al., 2012). The objective of this study was to define a globally applicable competency set specific to radiation oncology for the CanMEDS Leader Role (Frank et al., 2015). A modified Delphi consensus process delivering two rounds of on-line surveys was used. Participants included trainees, radiation/clinical oncologists and other RO team members (radiation therapists, physicists, and nurses), professional educators and patients. 72 of 95 (76%) invitees from nine countries completed the Round 1 (R1) survey. Of the 72 respondents to RI, 70 completed Round 2 (R2) (97%). In R1, 35 items were deemed for 'inclusion' and 21 for 'exclusion', leaving 41 'undetermined'. After review of items, informed by participant comments, 14 competencies from the 'inclusion' group went into the final curriculum; 12 from the 'undetermined' group went to R2. In R2, 6 items reached consensus for inclusion. This process resulted in 20 RO Leader Role competencies with apparent global applicability. This is the first step towards developing learning, teaching and assessment tools for this important area of training. Copyright © 2017 Elsevier B.V. All rights reserved.

Engineering's Grand Challenges: Priorities and Integration Recommendations for Technology Education Curriculum Development

ERIC Educational Resources Information Center

Buelin, Jennifer; Clark, Aaron C.; Ernst, Jeremy V.

2016-01-01

In this study, the 14 Grand Challenges for Engineering in the 21st Century identified by the National Academy of Engineering were examined by a panel of experts in an effort to identify prospective curricular integration opportunities in the field of technology and engineering education. The study utilized a three-round modified Delphi methodology…

Validation of quality indicators for the organization of palliative care: a modified RAND Delphi study in seven European countries (the Europall project).

PubMed

Woitha, Kathrin; Van Beek, Karen; Ahmed, Nisar; Jaspers, Birgit; Mollard, Jean M; Ahmedzai, Sam H; Hasselaar, Jeroen; Menten, Johan; Vissers, Kris; Engels, Yvonne

2014-02-01

Validated quality indicators can help health-care professionals to evaluate their medical practices in a comparative manner to deliver optimal clinical care. No international set of quality indicators to measure the organizational aspects of palliative care settings exists. To develop and validate a set of structure and process indicators for palliative care settings in Europe. A two-round modified RAND Delphi process was conducted to rate clarity and usefulness of a previously developed set of 110 quality indicators. In total, 20 multi-professional palliative care teams of centers of excellence from seven European countries. In total, 56 quality indicators were rated as useful. These valid quality indicators concerned the following domains: the definition of a palliative care service (2 quality indicators), accessibility to palliative care (16 quality indicators), specific infrastructure to deliver palliative care (8 quality indicators), symptom assessment tools (1 quality indicator), specific personnel in palliative care services (9 quality indicators), documentation methodology of clinical data (14 quality indicators), evaluation of quality and safety procedures (1 quality indicator), reporting of clinical activities (1 quality indicator), and education in palliative care (4 quality indicator). The modified RAND Delphi process resulted in 56 international face-validated quality indicators to measure and compare organizational aspects of palliative care. These quality indicators, aimed to assess and improve the organization of palliative care, will be pilot tested in palliative care settings all over Europe and be used in the EU FP7 funded IMPACT project.

Expert validation of a teamwork assessment rubric: A modified Delphi study.

PubMed

Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

2016-01-01

Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with confidence in the university setting. Copyright © 2015 Elsevier Ltd. All rights reserved.

Use of a Web-based Delphi for identifying critical components of a professional science master's program in biotechnology

NASA Astrophysics Data System (ADS)

Kantz, Jeannine Wells

The primary purpose of this research was to develop a model for a professional science master's program combining biotechnology and business. The objectives were to identify stakeholder preferences for various dimensions of a professional science master's program combining biotechnology and business and to identify differences in priorities between subgroups. A secondary purpose was to examine user preferences between Web-based and traditional methods of conducting a Delphi study and the panelist's impressions of its usefulness for program development. Prior to the first round, demographic data were collected on panelists regarding their gender, age, years experience in their current field, position title and education levels. Round 1 started with eight open-ended questions designed to investigate (a) learning objectives, (b) internships, (c) thesis vs. non-thesis degrees, (d) program focus (e) possible entry level positions, (f) roles for the industry advisory board, (g) recommended hours of hands-on experience and (h) other issues of importance. The final round ended with three questions to assess the panelists' perception of the usefulness of the Delphi for program development in higher education. Twenty-four panelists started Round 1 and participation in subsequent rounds varied from 17 in Round 2 to 11 in Round 4. Education level varied and included all levels of education in science and business. Issues emerged early in the study regarding development of different program tracks and the program goals, which were clarified in subsequent rounds. Significant differences occurred between industry and academic subgroups for two tracks, six skills designated for tracks, method of evaluating the internship, and entry-level positions appropriate for new graduates. When analyzed by level of confidence (high confidence vs. low confidence), significant differences occurred for (a) the number of semesters of hands-on experience students should have upon graduation, (b) skills recommended for core curriculum, (c) skills recommended for tracks, (d) compensation level and (e) entry level positions for new graduates. Perceived usefulness of the Delphi for program development was varied with only 10 panelists responding---five in favor, three undecided, and two against.

USING THE DELPHI TECHNIQUE TO DEVELOP EFFECTIVENESS INDICATORS FOR SOCIAL MARKETING COMMUNICATION TO REDUCE HEALTH-RISK BEHAVIORS AMONG YOUTH.

PubMed

Vantamay, Nottakrit

2015-09-01

This study aimed to develop effectiveness indicators for social marketing communication to reduce health-risk behaviors among Thai youth by using the Delphi technique. The Delphi technique is a research approach used to gain consensus through a series of two or more rounds of questionnaire surveys where information and results are fed back to panel members between each round and it has been extensively used to generate many indicators relevant to health behaviors. The Delphi technique was conducted in 3 rounds by consulting a panel of 15 experts in the field of social marketing communication for public health campaigns in Thailand. We found forty-nine effectiveness indicators in eight core components reached consensus. These components were: 1) attitude about health-risk behavior reduction, 2) subjective norms, 3) perceived behavioral control, 4) intention to reduce health-risk behaviors, 5) practices for reducing health-risk behaviors, 6) knowledge about the dangers and impact of health-risk behaviors, 7) campaign brand equity, and 8) communication networks. These effectiveness indicators could be applied by health promotion organizations for evaluating the effectiveness of social marketing communication to effectively reduce health-risk behaviors among youth.

Development of post-disaster psychosocial evaluation and intervention for children: Results of a South Korean delphi panel survey

PubMed Central

Lee, Mi-Sun; Hwang, Jun-Won; Lee, Cheol-Soon; Kim, Ji-Youn; Lee, Ju-Hyun; Kim, Eunji; Chang, Hyoung Yoon; Bae, SeungMin; Park, Jang-Ho

2018-01-01

Objective This study aimed to administer a Delphi panel survey and provide evidence for the development of a psychological intervention protocol for use after disasters in South Korea. Method A three-round Delphi survey was conducted. In all rounds, respondents answered open- or closed-ended questions regarding their views on i) the concept of disaster, ii) evaluation, iii) intervention, and iv) considerations in a disaster. Data from Round 1 were subjected to content analysis. In Round 2, items with content validity ratios (CVRs) greater than 0.49 were included, and in Round 3, items with a CVR≥0.38 were accepted. Results The response rates for the Delphi survey were high: 83% (n = 15, Round 1), 80% (n = 16, Round 2), and 86% (n = 24, Round 3). The data collected during this survey showed a need for a support system for children; for preventive strategies, including disaster readiness plans; for the protection of children's safety; and for the development of post-disaster psychosocial care. Conclusions The panel experts reached a consensus regarding the steps they considered critical in post-disaster evaluation and intervention. The findings suggest a unified model for advancing the development of the Korean version of an intervention protocol for children and adolescents exposed to traumatic events. PMID:29596483

Chartered Society of Physiotherapy's identification of national research priorities for physiotherapy using a modified Delphi technique.

PubMed

Rankin, Gabrielle; Rushton, Alison; Olver, Pat; Moore, Ann

2012-09-01

To define research priorities to strategically inform the evidence base for physiotherapy practice. A modified Delphi method using SurveyMonkey software identified priorities for physiotherapy research through national consensus. An iterative process of three rounds provided feedback. Round 1 requested five priorities using pre-defined prioritisation criteria. Content analysis identified research themes and topics. Round 2 requested rating of the importance of the research topics using a 1-5 Likert scale. Round 3 requested a further process of rating. Quantitative and qualitative data informed decision-making. Level of consensus was established as mean rating ≥ 3.5, coefficient of variation ≤ 30%, and ≥ 55% agreement. Consensus across participants was evaluated using Kendall's W. Four expert panels (n=40-61) encompassing a range of stakeholders and reflecting four core areas of physiotherapy practice were established by steering groups (n=204 participants overall). Response rates of 53-78% across three rounds were good. The identification of 24/185 topics for musculoskeletal, 43/174 for neurology, 30/120 for cardiorespiratory and medical rehabilitation, and 30/113 for mental and physical health and wellbeing as priorities demonstrated discrimination of the process. Consensus between participants was good for most topics. Measurement validity of the research topics was good. The involvement of multiple stakeholders as participants ensured the current context of the intended use of the priorities. From a process of national consensus involving key stakeholders, including service users, physiotherapy research topics have been identified and prioritised. Setting priorities provides a vision of how research can contribute to the developing research base in physiotherapy to maximise focus. Copyright © 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Modified international e-Delphi survey to define healthcare professional competencies for working with teenagers and young adults with cancer

PubMed Central

Taylor, Rachel M; Feltbower, Richard G; Aslam, Natasha; Raine, Rosalind; Whelan, Jeremy S; Gibson, Faith

2016-01-01

Objectives To provide international consensus on the competencies required by healthcare professionals in order to provide specialist care for teenagers and young adults (TYA) with cancer. Design Modified e-Delphi survey. Setting International, multicentre study. Participants Experts were defined as professionals having worked in TYA cancer care for more than 12 months. They were identified through publications and professional organisations. Methods Round 1, developed from a previous qualitative study, included 87 closed-ended questions with responses on a nine-point Likert scale and further open-ended responses to identify other skills, knowledge and attitudes. Round 2 contained only items with no consensus in round 1 and suggestions of additional items of competency. Consensus was defined as a median score ranging from 7 to 9 and strength of agreement using mean absolute deviation of the median. Results A total of 179 registered to be members of the expert panel; valid responses were available from 158 (88%) in round 1 and 136/158 (86%) in round 2. The majority of participants were nurses (35%) or doctors (39%) from Europe (55%) or North America (35%). All 87 items in round 1 reached consensus with an additional 15 items identified for round 2, which also reached consensus. The strength of agreement was mostly high for statements. The areas of competence rated most important were agreed to be: ‘Identify the impact of disease on young people's life’ (skill), ‘Know about side effects of treatment and how this might be different to those experienced by children or older adults’ (knowledge), ‘Honesty’ (attitude) and ‘Listen to young people's concerns’ (aspect of communication). Conclusions Given the high degree of consensus, this list of competencies should influence education curriculum, professional development and inform workforce planning. Variation in strength of agreement for some competencies between professional groups should be explored further in pursuit of effective multidisciplinary team working. PMID:27142859

Measuring elimination of podoconiosis, endemicity classifications, case definition and targets: an international Delphi exercise.

PubMed

Deribe, Kebede; Wanji, Samuel; Shafi, Oumer; Muheki Tukahebwa, Edridah; Umulisa, Irenee; Davey, Gail

2015-09-01

Podoconiosis is one of the major causes of lymphoedema in the tropics. Nonetheless, currently there are no endemicity classifications or elimination targets to monitor the effects of interventions. This study aimed at establishing case definitions and indicators that can be used to assess endemicity, elimination and clinical outcomes of podoconiosis. This paper describes the result of a Delphi technique used among 28 experts. A questionnaire outlining possible case definitions, endemicity classifications, elimination targets and clinical outcomes was developed. The questionnaire was distributed to experts working on podoconiosis and other neglected tropical diseases in two rounds. The experts rated the importance of case definitions, endemic classifications, elimination targets and the clinical outcome measures. Median and mode were used to describe the central tendency of expert responses. The coefficient of variation was used to describe the dispersals of expert responses. Consensus on definitions and indicators for assessing endemicity, elimination and clinical outcomes of podoconiosis directed at policy makers and health workers was achieved following the two rounds of Delphi approach among the experts. Based on the two Delphi rounds we discuss potential indicators and endemicity classification of this disabling disease, and the ongoing challenges to its elimination in countries with the highest prevalence. Consensus will help to increase effectiveness of podoconiosis elimination efforts and ensure comparability of outcome data. © The Author 2015. Published by Oxford University Press on behalf of Royal Society of Tropical Medicine and Hygiene.

[The application of Delphi method in improving the score table for the hygienic quantifying and classification of hotels].

PubMed

Wang, Zi-yun; Liu, Yong-quan; Wang, Hong-bo; Zheng, Yang; Wu, Qi; Yang, Xia; Wu, Yong-wei; Zhao, Yi-ming

2009-04-01

By means of Delphi method and expert panel consultations, to choose suitable indicators and improve the score table for classifying the hygienic condition of hotels so that it can be widely used at nationwide. A two-round Delphi consultation was held to choose suitable indicators among 78 experts from 18 provinces, municipalities and autonomous regions. The suitable indicators were selected according to the importance recognized by experts. The average length of service in public health of the experts was (21.08 +/- 5.78) years and the average coefficient of experts' authorities C(r) was 0.89 +/- 0.07. The response rates of the two-round consultation were 98.72% (77/78) and 100.00% (77/77). The average feedback time were (8.49 +/- 4.48) d, (5.86 +/- 2.28) d, and the difference between two rounds was statistically significant (t = 4.60, P < 0.01). Kendall's coefficient were 0.26 (chi(2) = 723.63, P < 0.01), 0.32 (chi(2) = 635.65, P < 0.01) and opinions among experts became consistent. The score table for the hygienic quantifying and classification of hotels was composed of three first-class indicators (hygienic management, hygienic facilities and hygienic practices) and 36 second-class indicators. The weight coefficients of the three first-class indicators were 0.35, 0.34, 0.31. Delphi method might be used in a large-scale consultation among experts and be propitious to improve the score table for the hygienic quantifying and classification.

A Delphi Study: The Characteristics of Democratic Schools

ERIC Educational Resources Information Center

Korkmaz, H. Eylem; Erden, Münire

2014-01-01

The authors aim to identify characteristics of democratic schools. The Delphi technique used in this study is based on attaining a consensus among a group of experts over 3 rounds with 22 experts from 9 countries participating in the first round. By the end of the third round, 339 items referring to democratic school characteristics were…

Issues Facing Urban Agriscience Teachers: A Delphi Study

ERIC Educational Resources Information Center

Warner, Wendy J.; Washburn, Shannon G.

2009-01-01

This national study used the Delphi technique to identify the issues facing urban agriscience teachers. The first round of the study used a questionnaire with one open-ended question to generate responses from the expert panel. In the second round, respondents were asked to rate their level of agreement with 72 issues identified in round one using…

Standardizing hysteroscopy teaching: development of a curriculum using the Delphi method.

PubMed

Neveu, Marie-Emmanuelle; Debras, Elodie; Niro, Julien; Fernandez, Hervé; Panel, Pierre

2017-12-01

Hysteroscopy is performed often and in many indications but is challenging to learn. Hands-on training in live patients faces ethical, legal, and economic obstacles. Virtual reality simulation may hold promise as a hysteroscopy training tool. No validated curriculum specific in hysteroscopy exists. The aim of this study was to develop a hysteroscopy curriculum, using the Delphi method to identify skill requirements. Based on a literature review using the key words "curriculum," "simulation," and "hysteroscopy," we identified five technical and non-technical areas in which skills were required. Twenty hysteroscopy experts from different French hospital departments participated in Delphi rounds to select items in these five areas. The rounds were to be continued until 80-100% agreement was obtained for at least 60% of items. A curriculum was built based on the selected items and was evaluated in residents. From November 2014 to April 2015, 18 of 20 invited experts participated in three Delphi rounds. Of the 51 items selected during the first round, only 25 (49%) had 80-100% agreement during the second round, and a third round was therefore conducted. During this last round, 80-100% agreement was achieved for 31 (61%) items, which were used to create the curriculum. All 14 residents tested felt that a simulator training session was acceptable and helped them to improve their skills. We describe a simulation-based hysteroscopy curriculum focusing on skill requirements identified by a Delphi procedure. Its development allows standardization of training programs offered to residents.

Using the modified Delphi method to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy.

PubMed

Zang, Lei; Fan, Ning; Hai, Yong; Lu, S B; Su, Q J; Yang, J C; Du, Peng; Gao, Y J

2015-06-01

Although cervical radiculopathy is very common, there is no standard treatment for this condition, with little high-level evidence available to guide the treatment choice. Thus, this study aimed to review the current data on the management of cervical radiculopathy; and, further, to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy using the Delphi method. First, a systematic review of the previously established treatment guidelines and of articles related to cervical radiculopathy was conducted to establish a protocol for the clinical consensus of the treatment for cervical radiculopathy. Second, from February 2012 to June 2014, we performed a modified Delphi survey in which the current professional opinions from 30 experienced experts, representing almost all of the Chinese provinces, were gathered. Three rounds were performed, and consensus was defined as ≥70% agreement. Consensus of the treatments for cervical radiculopathy was reached on seven aspects, including the proportion of patients requiring only non-surgical therapies; the effectiveness of neck immobilization, physiotherapy, pharmacologic treatment; surgical indications; contraindications; surgery. The modified Delphi study conducted herein reached a consensus concerning several treatment issues for cervical radiculopathy. In the absence of high-level evidence, at present, these expert opinion findings will help guide health care providers to define the appropriate treatment in their regions. Items with no consensus provide excellent areas for future research.

Contemporary management of paraesophaegeal hernias: establishing a European expert consensus.

PubMed

Bonrath, E M; Grantcharov, T P

2015-08-01

The surgical treatment of paraesophageal hernias remains a challenge due to the lack of consensus regarding principles of operative treatment. The objectives of this study were to achieve consensus on key topics through expert opinion using a Delphi methodology. A Delphi survey combined with a face-to-face meeting was conducted. A panel of European experts in foregut surgery from high-volume centres generated items in the first survey round. In subsequent rounds, the panel rated agreement with statements on a 5-point Likert-type scale. Internal consistency (consensus) was predefined as Cronbach's α > .80. Items that >70 % of the panel either rated as irrelevant/unimportant, or relevant/important were selected as consensus items, while topics that did not reach this cut-off were termed "undecided/controversial". Three survey rounds were completed: 19 experts from 10 countries completed round one, 18 continued through rounds two and three. Internal consistency was high in rounds two and three (α > .90). Fifty-eight additional/revised items derived from comments and free-text entries were included in round three. In total, 118 items were rated; consensus agreement was achieved for 70 of these. Examples of consensus topics are the relevance of the disease profile for assessing surgical urgency and complexity, the role of clinical history as the mainstay of patient follow-up, indications for revision surgery, and training and credentialing recommendations. Topics with the most "undecided/controversial" items were follow-up, postoperative care and surgical technique. This Delphi study achieved expert consensus on key topics in the operative management of paraesophageal hernias, providing an overview of the current opinion among European foregut surgeons. Moreover, areas with substantial variability in opinions were identified reflecting the current lack of empirical evidence and opportunities for future research.

Toward an essential ethic for teaching science in the new millennium

NASA Astrophysics Data System (ADS)

Hays, Irene De La Bretonne

The purpose of this study was to identify and explore values and views that might underlie an essential ethic for teaching science in the new millennium. With such an ethic, teachers may be better able to prepare young people to form and fully participate in communities that restore and sustain Earth. Reviewed in the literature for this study were changing philosophies and theories from early indigenous cultures to the present on the nature of nature, the value of nature, and the human relationship with nature. These philosophies and theories were found to influence values that today underlie the work scientists do and the ways young people are educated in science. In the study, two groups of participants--Nature Writers and scientists--revealed the essence and meaning of their relationship with nature. A two-stage, modified Delphi method was used for collecting data. Stage One comprised the first "round" of the Delphi and involved content analysis of writings by a select group of U.S. Nature Writers from the early 1800s to the present. In Stage Two, comprising three rounds of the modified Delphi, perspectives of Nature Writers were imbedded in questionnaires and presented for response to a select group of scientists connected with research and education at National Laboratories across the country. Finally, results from each participant group were brought together in a recursive process, one with the other, to determine findings. Strong Earth-care values, including receptivity, responsibility, interdependence, respect, cooperation, love, and care, were found to be held in common by the Nature Writers and scientists in this study and could form the foundation for an essential ethic for teaching science. The strongest dissonance between Nature Writers and scientists was evident in emotional and spiritual domains--despite that many scientists revealed emotional and spiritual elements in stories told of their experiences with nature. Contrary to what might have been expected from scientists based on theories of science and practices of science education represented in the literature, few scientists revealed negative, utilitarian, or dominionistic affiliations with nature. In contrast, no Nature Writers revealed such affiliations.

The Norwegian General Practice--Nursing Home criteria (NORGEP-NH) for potentially inappropriate medication use: A web-based Delphi study.

PubMed

Nyborg, Gunhild; Straand, Jørund; Klovning, Atle; Brekke, Mette

2015-06-01

To develop a set of explicit criteria for pharmacologically inappropriate medication use in nursing homes. In an expert panel, a three-round Delphi consensus process was conducted via survey software. Norway. Altogether 80 participants - specialists in geriatrics or clinical pharmacology, physicians in nursing homes and experienced pharmacists - agreed to participate in the survey. Of these, 62 completed the first round, and 49 panellists completed all three rounds (75.4% of those ultimately entering the survey). The authors developed a list of 27 criteria based on the Norwegian General Practice (NORGEP) criteria, literature, and clinical experience. The main outcome measure was the panellists' evaluation of the clinical relevance of each suggested criterion on a digital Likert scale from 1 (no clinical relevance) to 10. In the first round panellists could also suggest new criteria to be included in the process. For each criterion, degree of consensus was based on the average Likert score and corresponding standard deviation (SD). A list of 34 explicit criteria for potentially inappropriate medication use in nursing homes was developed through a three-round web-based Delphi consensus process. Degree of consensus increased with each round. No criterion was voted out. Suggestions from the panel led to the inclusion of seven additional criteria in round two. The NORGEP-NH list may serve as a tool in the prescribing process and in medication list reviews and may also be used in quality assessment and for research purposes.

Adaptation of a difficult-to-manage asthma programme for implementation in the Dutch context: a modified e-Delphi

PubMed Central

Honkoop, Persijn J; Pinnock, Hilary; Kievits-Smeets, Regien M M; Sterk, Peter J; Dekhuijzen, P N Richard; in ’t Veen, Johannes C C M

2017-01-01

Patients with difficult-to-manage asthma represent a heterogeneous subgroup of asthma patients who require extensive assessment and tailored management. The International Primary Care Respiratory Group approach emphasises the importance of differentiating patients with asthma that is difficult to manage from those with severe disease. Local adaptation of this approach, however, is required to ensure an appropriate strategy for implementation in the Dutch context. We used a modified three-round e-Delphi approach to assess the opinion of all relevant stakeholders (general practitioners, pulmonologists, practice nurses, pulmonary nurses and people with asthma). In the first round, the participants were asked to provide potentially relevant items for a difficult-to-manage asthma programme, which resulted in 67 items. In the second round, we asked participants to rate the relevance of specific items on a seven-point Likert scale, and 46 items were selected as relevant. In the third round, the selected items were categorised and items were ranked within the categories according to relevance. Finally, we created the alphabet acronym for the categories ‘the A–I of difficult-to-manage asthma’ to resonate with an established Dutch ‘A–E acronym for determining asthma control’. This should facilitate implementation of this programme within the existing structure of educational material on asthma and chronic obstructive pulmonary disease (COPD) in primary care, with potential for improving management of difficult-to-manage asthma. Other countries could use a similar approach to create a locally adapted version of such a programme. PMID:28184039

Exploring Nurse Leaders' Policy Participation Within the Context of a Nursing Conceptual Framework.

PubMed

Waddell, Ashley; Adams, Jeffrey M; Fawcett, Jacqueline

2017-11-01

This study was designed to describe and quantify the experiences of nurse leaders working to influence policy and to build consensus for priority skills and knowledge useful in policy efforts within the context of a nursing conceptual framework. The conceptual model for nursing and health policy and the Adams influence model were combined into a conceptual framework used to guide this two-round modified Delphi study. Twenty-two nurse leaders who were members of a state action coalition participated in the Round 1 focus group; 15 of these leaders completed the Round 2 electronic survey. Round 1 themes indicated the value of a passion for policy, the importance of clear communication, and an understanding the who and when of policy work. Round 2 data reinforced the importance of clear communication regarding policy engagement; knowing the who and when of policy closely followed, and having a passion for policy work was identified as least important. These themes inform learning objectives for nursing education and preparation for interactions with public officials because influencing policy requires knowledge, skills, and persistence. Study findings begin to describe how nurse leaders influence policy within the context of a nursing conceptual framework and generate implications for research, education, and professional practice.

Building expert agreement on the importance and feasibility of workplace health promotion interventions for nurses and midwives: A modified Delphi consultation.

PubMed

Perry, Lin; Nicholls, Rachel; Duffield, Christine; Gallagher, Robyn

2017-11-01

To use a Delphi panel to determine the relative importance and feasibility of workplace health promotion interventions to promote and support the health of the Australian nursing and midwifery workforce. The nursing workforce experiences rates of ill health above that of other workforces, yet there is little investment in workplace health promotion. The study used a modified Delphi design conducted between September and November 2015. Eleven of 19 purposively selected expert panellists discussed, rated and provided feedback through two rounds of an electronic questionnaire about the relative importance and feasibility of 46 workplace health promotion interventions and processes for nurses and midwives. Scores for importance and feasibility were calculated and ranked and a composite score of importance multiplied by feasibility. Mental health strategies were prioritized as the most important and feasible of the intervention topics, followed closely by healthy eating and physical activity interventions; smoking cessation ranked lowest. The most highly ranked interventions targeted healthy eating, stress management and resilience training. Highest ranked processes to support development of a healthy work environment included intersectoral collaboration and employee wellness groups. Study findings prompt consideration of health promotion opportunities to support nurses' health and well-being. Findings identified key workplace health promotion priorities and provide direction for policy makers and managers to promote nursing and midwifery workforce health. © 2017 John Wiley & Sons Ltd.

Nature-based care opportunities and barriers in oncology contexts: a modified international e-Delphi survey.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-10-16

To develop recommendations regarding opportunities and barriers for nature-based care in oncology contexts using a structured knowledge generation process involving relevant healthcare and design experts. Four-round modified electronic Delphi study. Oncology patients' nature-based recommendations, uncovered in preceding qualitative investigation, were included in the first round for the expert participants' consideration. Key items (opportunities and barriers) were developed using data aggregation and synthesis, followed by item prioritisation and 10-point Likert scale ranking (1=not important, 10=very important). Descriptive statistics were calculated to assess items of highest importance representing expert recommendations. Online Delphi process constituting an electronic international survey. A purposive sample of 200 potential panellists (recruitment target n=40) comprising healthcare practitioners, managers, designers, architects and researchers were invited to participate; experts were identified via research networks, snowballing and systematic literature review. 38 experts across seven countries (Australia, USA, UK, New Zealand, Canada, Denmark and Sweden) returned questionnaire 1, which determined consent and acceptance for participation. Initial response rate was 19%, and subsequent response rates were 84%, 82% and 84% for rounds 2, 3 and 4, respectively. The Delphi panel developed recommendations consisting of 10 opportunities and 10 barriers. The following opportunities were rated to be of highest importance: window views from clinical areas onto nature; outdoor settings, gardens and courtyards with easy and effortless access; and nature-based physical exercise adapted to patient requirements. Highest-rated barriers for nature-based oncology care included lack of knowledge and awareness about benefits of nature engagement and inaccessibility, not considering access requirements for the very sick and frail. Experts suggested and agreed on a set of recommendations, which represent critical considerations for the safe adoption of nature-based oncology opportunities. These findings fill a gap in understanding about helpful nature-based oncology care and may translate into oncology design and innovation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Community Engagement in the CTSA Program: Stakeholder Responses from a National Delphi Process

PubMed Central

Seifer, Sarena D.; Stupak, Matthew; Martinez, Linda Sprague

2014-01-01

Abstract In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community‐Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. PMID:24841362

Community engagement in the CTSA program: stakeholder responses from a national Delphi process.

PubMed

Freeman, Elmer; Seifer, Sarena D; Stupak, Matthew; Martinez, Linda Sprague

2014-06-01

In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community-Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. © 2014 Wiley Periodicals, Inc.

A True Delphi Approach: Developing a Tailored Curriculum in Response to Local Agriscience Need

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rubenstein, Eric; Thoron, Andrew; Burleson, Sarah

2012-02-07

The Delphi approach is a structured communication technique, developed as a systematic, interactive forecasting method which relies on a panel of experts. In this specific case experts from Industry, Education and Extension fields addressed needs for educational programs in a traditional agriculturally-based community, environmentally conscious practices in order to restore environmental integrity and multi-disciplinary approach to solve sustainability problems facing the agricultural industry. The experts were divided into two main groups, (A) Secondary and (B) Post-secondary, and answered questionnaires in three rounds: • 1st Round – Participants generated a list of knowledge, skills, and competencies followed • 2nd Round –more » Panelists rated each item • 3rd Round – Panelists were given the opportunity to combine and add additional items As a result, top six items from both groups were not found similar, secondary panelists centralized around employment skills and post-secondary panelists focused on content areas. Implications include a need for content-based curriculum for post-secondary graduates, utilization of true-Delphi technique for future curriculum development research and further examination of students that complete secondary and post-secondary programs in biofuels/sustainable agriculture.« less

Engaging communication experts in a Delphi process to identify patient behaviors that could enhance communication in medical encounters

PubMed Central

2010-01-01

Background The communication literature currently focuses primarily on improving physicians' verbal and non-verbal behaviors during the medical interview. The Four Habits Model is a teaching and research framework for physician communication that is based on evidence linking specific communication behaviors with processes and outcomes of care. The Model conceptualizes basic communication tasks as "Habits" and describes the sequence of physician communication behaviors during the clinical encounter associated with improved outcomes. Using the Four Habits Model as a starting point, we asked communication experts to identify the verbal communication behaviors of patients that are important in outpatient encounters. Methods We conducted a 4-round Delphi process with 17 international experts in communication research, medical education, and health care delivery. All rounds were conducted via the internet. In round 1, experts reviewed a list of proposed patient verbal communication behaviors within the Four Habits Model framework. The proposed patient verbal communication behaviors were identified based on a review of the communication literature. The experts could: approve the proposed list; add new behaviors; or modify behaviors. In rounds 2, 3, and 4, they rated each behavior for its fit (agree or disagree) with a particular habit. After each round, we calculated the percent agreement for each behavior and provided these data in the next round. Behaviors receiving more than 70% of experts' votes (either agree or disagree) were considered as achieving consensus. Results Of the 14 originally-proposed patient verbal communication behaviors, the experts modified all but 2, and they added 20 behaviors to the Model in round 1. In round 2, they were presented with 59 behaviors and 14 options to remove specific behaviors for rating. After 3 rounds of rating, the experts retained 22 behaviors. This set included behaviors such as asking questions, expressing preferences, and summarizing information. Conclusion The process identified communication tasks and verbal communication behaviors for patients similar to those outlined for physicians in the Four Habits Model. This represents an important step in building a single model that can be applied to teaching patients and physicians the communication skills associated with improved satisfaction and positive outcomes of care. PMID:20403173

Setting a health policy research agenda for controlling cancer burden in Korea.

PubMed

Jang, Sung-In; Cho, Kyoung-Hee; Kim, Sun Jung; Lee, Kwang-Sig; Park, Eun-Cheol

2015-04-01

The aim of study was to provide suggestions for prioritizing research in effort to reduce cancer burden in Korea based on a comprehensive analysis of cancer burden and Delphi consensus among cancer experts. Twenty research plans covering 10 topics were selected based on an assessment of the literature, and e-mail surveys were analyzed using a two-round modified Delphi method. Thirty-four out of 79 experts were selected from four organizations to participate in round one, and 21 experts among them had completed round two. Each item had two questions; one regarding the agreement of the topic as a priority item to reduce cancer burden, and the other about the importance of the item on a nine-point scale. A consensus was defined to be an average lower coefficient of variation with less than 30% in importance. Seven plans that satisfied the three criteria were selected as priority research plans for reducing cancer burden. These plans are "research into advanced clinical guidelines for thyroid cancer given the current issue with over-diagnosis," "research into smoking management plans through price and non-price cigarette policy initiatives," "research into ways to measure the quality of cancer care," "research on policy development to expand hospice care," "research into the spread and management of Helicobacter pylori," "research on palliative care in a clinical setting," and "research into alternative mammography methods to increase the accuracy of breast cancer screenings." The seven plans identified in this study should be prioritized to reduce the burden of cancer in Korea. We suggest that policy makers and administrators study and invest significant effort in these plans.

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Developing tools for identifying employer and employee satisfaction of nursing new graduates in China.

PubMed

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study.

The Delphi Technique in Identifying Learning Objectives for the Development of Science, Technology and Society Modules for Palestinian Ninth Grade Science Curriculum

NASA Astrophysics Data System (ADS)

Abualrob, Marwan M. A.; Gnanamalar Sarojini Daniel, Esther

2013-10-01

This article outlines how learning objectives based upon science, technology and society (STS) elements for Palestinian ninth grade science textbooks were identified, which was part of a bigger study to establish an STS foundation in the ninth grade science curriculum in Palestine. First, an initial list of STS elements was determined. Second, using this list, ninth grade science textbooks and curriculum document contents were analyzed. Third, based on this content analysis, a possible list of 71 learning objectives for the integration of STS elements was prepared. This list of learning objectives was refined by using a two-round Delphi technique. The Delphi study was used to rate and to determine the consensus regarding which items (i.e. learning objectives for STS in the ninth grade science textbooks in Palestine) are to be accepted for inclusion. The results revealed that of the initial 71 objectives in round one, 59 objectives within round two had a mean score of 5.683 or higher, which indicated that the learning objectives could be included in the development of STS modules for ninth grade science in Palestine.

Characteristics of Viable and Sustainable Workers for the Year 2015.

ERIC Educational Resources Information Center

Dean, Brenda Pennington; West, Russell

A two-round Delphi study was conducted to identify the characteristics of viable and sustainable employees in northeastern Tennessee in 2015. The Delphi panel selected for the study consisted of 25 experts who represented a cross-section of the businesses and communities in the 10-county area of northeastern Tennessee served by Walters State…

Identification and Development of Items Comprising Organizational Citizenship Behaviors Among Pharmacy Faculty

PubMed Central

Semsick, Gretchen R.

2016-01-01

Objective. Identify behaviors that can compose a measure of organizational citizenship by pharmacy faculty. Methods. A four-round, modified Delphi procedure using open-ended questions (Round 1) was conducted with 13 panelists from pharmacy academia. The items generated were evaluated and refined for inclusion in subsequent rounds. A consensus was reached after completing four rounds. Results. The panel produced a set of 26 items indicative of extra-role behaviors by faculty colleagues considered to compose a measure of citizenship, which is an expressed manifestation of collegiality. Conclusions. The items generated require testing for validation and reliability in a large sample to create a measure of organizational citizenship. Even prior to doing so, the list of items can serve as a resource for mentorship of junior and senior faculty alike. PMID:28179717

Research priorities in Italian diabetes nursing care: findings from a Delphi study.

PubMed

Palese, A; Gentilini, S; Lo Grasso, G; Branca, M T; Chiandetti, R; Mansutti, I

2015-01-01

Defining a set of research priorities for diabetes nursing care in the Italian context. A two-step study design based on a modified Delphi technique was undertaken in 2013. In the first stage of research, five systematic reviews of literature were performed. Among them 865 recommendations in diabetes nursing care emerged, and 217 (25.1%) were categorized at level IV or lower, thus based on a lack of knowledge and therefore a potential research area. Homogeneous recommendations among the 217 emerged and were categorized by two researchers independently: 96 final recommendations were identified and transformed into items embodied into a questionnaire. A Likert scale ranging from 1 (very low) to 5 (very high) was used to collect the consensus regarding priority. For that purpose a sample of 200 nurses was randomly considered. Potential participants were invited to cooperate via email through a letter reporting aims and methods. In the first round 85 nurses participated; in the third and final round, only 13 nurses took part. Participants have identified 14 research priorities categorized into three main areas: 1) education strategies' effectiveness (n=7); 2) models of care delivery and advanced nursing education effectiveness (n=4); and 3) in specific clinical issues (n=3). More research on patient education and on models of care delivery and advanced nursing education should be included in any future Italian agenda.

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study.

PubMed

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-16

To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Hospitals and community health centres in Taiwan. A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. 15 Chinese healthcare practitioners with more than 6 months' experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Developing Canadian oncology education goals and objectives for medical students: a national modified Delphi study.

PubMed

Tam, Vincent C; Ingledew, Paris-Ann; Berry, Scott; Verma, Sunil; Giuliani, Meredith E

2016-01-01

Studies have shown that there is a deficiency in focused oncology teaching during medical school in Canada. This study aimed to develop oncology education goals and objectives for medical students through consensus of oncology educators from across Canada. In 2014 we created a comprehensive list of oncology education objectives using existing resources. Experts in oncology education and undergraduate medical education from all 17 Canadian medical schools were invited to participate in a 3-round modified Delphi process. In round 1, the participants scored the objectives on a 9-point Likert scale according to the degree to which they agreed an objective should be taught to medical students. Objectives with a mean score of 7.0 or greater were retained, those with a mean score of 1.0-3.9 were excluded, and those with a mean score of 4.0-6.9 were discussed at a round 2 Web meeting. In round 3, the participants voted on inclusion and exclusion of the round 2 objectives. Thirty-four (92%) of the 37 invited oncology educators, representing 14 medical schools, participated in the study. They included oncologists, family physicians, members of undergraduate medical education curriculum committees and a psychologist. Of the 214 objectives reviewed in round 1, 146 received a mean score of 7.0 or greater, and 68 were scored 4.0-6.9; no objective received a mean score below 4.0. Nine new objectives were suggested. The main themes of participants' comments were to minimize the number of objectives and to aim objectives at the knowledge level required for family physicians. In round 2, the participants were able to combine 28 of the objectives with other existing objectives. In round 3, 7 of the 49 objectives received consensus of at least 75% for inclusion. The final Canadian Oncology Goals and Objectives for Medical Students contained 10 goals and 153 objectives. Through a systematic process, we created a comprehensive, consensus-based set of oncology goals and objectives to facilitate the design of undergraduate medical education curricula and improve oncology education for medical students.

Developing Resident-Sensitive Quality Measures: A Model From Pediatric Emergency Medicine.

PubMed

Schumacher, Daniel J; Holmboe, Eric S; van der Vleuten, Cees; Busari, Jamiu O; Carraccio, Carol

2017-12-05

To begin closing the gap with respect to quality measures available for use among residents, the authors sought to identify and develop resident-sensitive quality measures (RSQMs) for use in the pediatric emergency department (PED) setting. In May 2016, the authors reviewed National Quality Measures Clearinghouse (NQMC) measures to identify resident-sensitive measures. To create additional measures focused on common, acute illnesses (acute asthma exacerbation, bronchiolitis, closed head injury [CHI]) in the PED, the authors used a nominal group technique (NGT) and Delphi process from September to December 2016. To achieve a local focus for developing these measures, all NGT and Delphi participants were from Cincinnati Children's Hospital Medical Center. Delphi participants rated measures developed through the NGT in two areas: importance of measure to quality care and likelihood that measure represents the work of a resident. The review of NQMC measures identified 28 of 183 as being potentially resident-sensitive. The NGT produced 67 measures for asthma, 46 for bronchiolitis, and 48 for CHI. These were used in the first round of the Delphi process. After two rounds, 18 measures for asthma, 21 for bronchiolitis, and 22 for CHI met automatic inclusion criteria. In round three, participants categorized the potential final measures by their top 10 and next 5. This study describes a template for identifying and developing RSQMs that may promote high-quality care delivery during and following training. Next steps should include implementing and seeking validity evidence for the locally developed measures.

Technical College Instructors' Perceptions of the Impact of Online Readiness and of Student Support Services on Student Success in Online Courses

ERIC Educational Resources Information Center

Dowd, Nathan

2012-01-01

The purpose of this study is to determine how Wisconsin Technical College (WTCS) administrators and online instructors perceive the impact of online learner readiness and student support services to be on student success in online courses. The study used a modified three-round Delphi technique to determine to collect data. The results indicated…

[A model for shared decision-making with frail older patients: consensus reached using Delphi technique].

PubMed

van de Pol, M H J; Fluit, C R M G; Lagro, J; Lagro-Janssen, A L M; Olde Rikkert, M G M

2017-01-01

To develop a model for shared decision-making with frail older patients. Online Delphi forum. We used a three-round Delphi technique to reach consensus on the structure of a model for shared decision-making with older patients. The expert panel consisted of 16 patients (round 1), and 59 professionals (rounds 1-3). In round 1, the panel of experts was asked about important steps in the process of shared decision-making and the draft model was introduced. Rounds 2 and 3 were used to adapt the model and test it for 'importance' and 'feasibility'. Consensus for the dynamic shared decision-making model as a whole was achieved for both importance (91% panel agreement) and feasibility (76% panel agreement). Shared decision-making with older patients is a dynamic process. It requires a continuous supportive dialogue between health care professional and patient.

Issues and Needs in Rural Early Childhood Special Education Services in Florida: A Delphi Study.

ERIC Educational Resources Information Center

Weiss, Keith E.; Correa, Vivian I.

A Delphi Technique was used to examine the problems of early childhood special education programs in rural Florida. Two rounds of questionnaires were completed by a panel of early childhood special education administrators and teachers from 14 of Florida's 27 rural counties. In response to the questionnaires, the panel developed 51 problem-related…

Consensus development on the essential competencies for Iranian public health nutritionists.

PubMed

Sadeghi-Ghotbabadi, Farzaneh; Shakibazadeh, Elham; Omidvar, Nasrin; Mortazavi, Fathieh; Kolahdooz, Fariba

2015-03-01

To assess key experts' opinion regarding essential competencies required for effective public health nutrition practice within the health-care system of Iran. Qualitative study using the modified Delphi technique through an email-delivered questionnaire. Iran. Fifty-five experts were contacted through email. The inclusion criterion for the study panel was being in a relevant senior-level position in nutrition science or public health nutrition in Iran. In the first round, forty-two out of fifty-five experts responded to the questionnaire (response rate=76 %). A sixty-five-item questionnaire was designed with nine competency areas, including 'nutrition science', 'planning and implementing nutritional interventions', 'health and nutrition services', 'advocacy and communication', 'assessment and analysis', 'evaluation', 'cultural, social and political aspects', 'using technology' and 'leadership and management'. All experts who had participated in the first round completed a modified version of the questionnaire with seventy-seven items in the second round. The experts scored 'nutrition science' as the most essential competency area, while more applied areas such as 'management and leadership' were less emphasized. In both rounds, the mean difference between the opinions of the necessity of each area was 5.6 %. The Iranian experts had general agreement on most of the core competency areas of public health nutritionists. The results indicated the need for capacity building and revisions to educational curricula for public health nutritionist programmes, with more emphasis on skill-based competency development.

Establishing key components of yoga interventions for musculoskeletal conditions: a Delphi survey

PubMed Central

2014-01-01

Background Evidence suggests yoga is a safe and effective intervention for the management of physical and psychosocial symptoms associated with musculoskeletal conditions. However, heterogeneity in the components and reporting of clinical yoga trials impedes both the generalization of study results and the replication of study protocols. The aim of this Delphi survey was to address these issues of heterogeneity, by developing a list of recommendations of key components for the design and reporting of yoga interventions for musculoskeletal conditions. Methods Recognised experts involved in the design, conduct, and teaching of yoga for musculoskeletal conditions were identified from a systematic review, and invited to contribute to the Delphi survey. Forty-one of the 58 experts contacted, representing six countries, agreed to participate. A three-round Delphi was conducted via electronic surveys. Round 1 presented an open-ended question, allowing panellists to individually identify components they considered key to the design and reporting of yoga interventions for musculoskeletal conditions. Thematic analysis of Round 1 identified items for quantitative rating in Round 2; items not reaching consensus were forwarded to Round 3 for re-rating. Results Thirty-six panellists (36/41; 88%) completed the three rounds of the Delphi survey. Panellists provided 348 comments to the Round 1 question. These comments were reduced to 49 items, grouped under five themes, for rating in subsequent rounds. A priori group consensus of ≥80% was reached on 28 items related to five themes concerning defining the yoga intervention, types of yoga practices to include in an intervention, delivery of the yoga protocol, domains of outcome measures, and reporting of yoga interventions for musculoskeletal conditions. Additionally, a priori consensus of ≥50% was reached on five items relating to minimum values for intervention parameters. Conclusions Expert consensus has provided a non-prescriptive reference list for the design and reporting of yoga interventions for musculoskeletal conditions. It is anticipated future research incorporating the Delphi guidelines will facilitate high quality international research in this field, increase homogeneity of intervention components and parameters, and enhance the comparison and reproducibility of research into the use of yoga for the management of musculoskeletal conditions. PMID:24942270

CATALISE: A Multinational and Multidisciplinary Delphi Consensus Study. Identifying Language Impairments in Children.

PubMed

Bishop, D V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2016-01-01

Delayed or impaired language development is a common developmental concern, yet there is little agreement about the criteria used to identify and classify language impairments in children. Children's language difficulties are at the interface between education, medicine and the allied professions, who may all adopt different approaches to conceptualising them. Our goal in this study was to use an online Delphi technique to see whether it was possible to achieve consensus among professionals on appropriate criteria for identifying children who might benefit from specialist services. We recruited a panel of 59 experts representing ten disciplines (including education, psychology, speech-language therapy/pathology, paediatrics and child psychiatry) from English-speaking countries (Australia, Canada, Ireland, New Zealand, United Kingdom and USA). The starting point for round 1 was a set of 46 statements based on articles and commentaries in a special issue of a journal focusing on this topic. Panel members rated each statement for both relevance and validity on a seven-point scale, and added free text comments. These responses were synthesised by the first two authors, who then removed, combined or modified items with a view to improving consensus. The resulting set of statements was returned to the panel for a second evaluation (round 2). Consensus (percentage reporting 'agree' or 'strongly agree') was at least 80 percent for 24 of 27 round 2 statements, though many respondents qualified their response with written comments. These were again synthesised by the first two authors. The resulting consensus statement is reported here, with additional summary of relevant evidence, and a concluding commentary on residual disagreements and gaps in the evidence base.

Identification of competencies for patient education in physiotherapy using a Delphi approach.

PubMed

Forbes, Roma; Mandrusiak, Allison; Smith, Michelle; Russell, Trevor

2018-06-01

Patient education is a critical part of physiotherapy practice however an empirically derived set of competencies for its use does not exist. This study aimed to generate a set of competencies for patient education in physiotherapy using a consensus approach. A Delphi study with two rounds using a panel of expert physiotherapists within Australia was undertaken. In the first round, the panel of 12 specialist physiotherapists identified competencies required for patient education in the physiotherapy setting. Framework analysis was applied to develop a set of competencies that were assessed in the second round where ≥80% agreement of importance from the panel indicated consensus. Response rates of specialist physiotherapists agreeing to participate were 67% for the first round and 100% for the second round. Analysis following the first round produced 25 competencies. The second round resulted in agreement on a final set of 22 competencies. This study developed a concise list of competencies for patient education with a high level of expert agreement. By identifying the key competencies in this area, there is potential to benchmark patient education training and assessment of physiotherapists for improved educational and professional outcomes. Copyright © 2017 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

An electronic delphi study to establish pediatric intensive care nursing research priorities in twenty European countries*.

PubMed

Tume, Lyvonne N; van den Hoogen, Agnes; Wielenga, Joke M; Latour, Jos M

2014-06-01

To identify and to establish research priorities for pediatric intensive care nursing science across Europe. A modified three-round electronic Delphi technique was applied. Questionnaires were translated into seven different languages. European PICUs. The participants included pediatric intensive care clinical nurses, managers, educators, and researchers. In round 1, the qualitative responses were analyzed by content analysis and a list of research statements and domains was generated. In rounds 2 and 3, the statements were ranked on a scale of one to six (not important to most important). Mean scores and SDs were calculated for rounds 2 and 3. None. Round 1 started with 90 participants, with round 3 completed by 64 (71%). The seven highest ranking statements (≥ 5.0 mean score) were related to end-of-life care, decision making around forgoing and sustaining treatment, prevention of pain, education and competencies for pediatric intensive care nurses, reducing healthcare-associated infections, identifying appropriate nurse staffing levels, and implementing evidence into nursing practice. Nine research domains were prioritized, and these were as follows: 1) clinical nursing care practices, 2) pain and sedation, 3) quality and safety, 4) respiratory and mechanical ventilation, 5) child- and family-centered care, 6) ethics, 7) professional issues in nursing, 8) hemodynamcis and resuscitation, and 9) trauma and neurocritical care. The results of this study inform the European Society of Pediatric and Neonatal Intensive Care's nursing research agenda in the future. The results allow nurse researchers within Europe to encourage collaborative initiatives for nursing research.

Framework of behavioral indicators for outcome evaluation of TB health promotion: a Delphi study of TB suspects and Tb patients

PubMed Central

2014-01-01

Background Health promotion for prevention and control of Tuberculosis (TB) is implemented worldwide because of its importance, but few reports have evaluated its impact on behavior due to a lack of standard outcome indicators. The objective of this study was to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. Methods A two-round modified Delphi method involving sixteen TB control experts was used to establish a framework of behavioral indicators for outcome evaluation of TB health promotion targeted at TB suspects and patients. Results Sixteen of seventeen invited experts in TB control (authority score of 0.91 on a 1.0 scale) participated in round 1 survey. All sixteen experts also participated in a second round survey. After two rounds of surveys and several iterations among the experts, there was consensus on a framework of indicators for measuring outcomes of TB health promotion for TB suspects and patients. For TB suspects, the experts reached consensus on 2 domains (“Healthcare seeking behavior” and “Transmission prevention”), 3 subdomains (“Seeking care after onset of TB symptoms”, “Pathways of seeking care” and “Interpersonal contact etiquette”), and 8 indicators (including among others, “Length of patient delay”). For TB patients, consensus was reached on 3 domains (“Adherence to treatment”, “Healthy lifestyle” and “Transmission prevention”), 8 subdomains (including among others, “Adherence to their medication”), and 14 indicators (including “Percentage of patients who adhered to their medication”). Operational definitions and data sources were provided for each indicator. Conclusions The findings of this study provide the basis for debate among international experts on a framework for achieving global consensus on outcome indicators for TB health promotion interventions targeted at TB patients and suspects. Such consensus will help to increase effectiveness of TB health promotion, while ensuring international comparability of outcome data. PMID:24884569

Framework of behavioral indicators for outcome evaluation of TB health promotion: a Delphi study of TB suspects and Tb patients.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Zhang, Yanqi; Wang, Qingya; Zhang, Shun; Cao, Jia

2014-05-16

Health promotion for prevention and control of Tuberculosis (TB) is implemented worldwide because of its importance, but few reports have evaluated its impact on behavior due to a lack of standard outcome indicators. The objective of this study was to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. A two-round modified Delphi method involving sixteen TB control experts was used to establish a framework of behavioral indicators for outcome evaluation of TB health promotion targeted at TB suspects and patients. Sixteen of seventeen invited experts in TB control (authority score of 0.91 on a 1.0 scale) participated in round 1 survey. All sixteen experts also participated in a second round survey. After two rounds of surveys and several iterations among the experts, there was consensus on a framework of indicators for measuring outcomes of TB health promotion for TB suspects and patients. For TB suspects, the experts reached consensus on 2 domains ("Healthcare seeking behavior" and "Transmission prevention"), 3 subdomains ("Seeking care after onset of TB symptoms", "Pathways of seeking care" and "Interpersonal contact etiquette"), and 8 indicators (including among others, "Length of patient delay"). For TB patients, consensus was reached on 3 domains ("Adherence to treatment", "Healthy lifestyle" and "Transmission prevention"), 8 subdomains (including among others, "Adherence to their medication"), and 14 indicators (including "Percentage of patients who adhered to their medication"). Operational definitions and data sources were provided for each indicator. The findings of this study provide the basis for debate among international experts on a framework for achieving global consensus on outcome indicators for TB health promotion interventions targeted at TB patients and suspects. Such consensus will help to increase effectiveness of TB health promotion, while ensuring international comparability of outcome data.

Future directions in clinical child and adolescent psychology: a Delphi survey.

PubMed

James, Rochelle L; Roberts, Michael C

2009-10-01

This study sought to identify the future directions in three domains: clinical practice, research, and training of clinical child and adolescent psychologists in the upcoming decade. Doctoral-level active members in the field were surveyed via a two-round Delphi survey (45 in round 1; 35 in round 2). Evidence-based practice received the greatest consensus by the participants and highest rank in each of the three domains. Other highly ranked clinical practice directions included prevention and early diagnosis and treatment, and clinical services for specific psychological problems. Research directions focused on biological and social factors interactions in the etiology and treatment and specific child and adolescent disorders. In the training domain, major directions included the pursuit of specialty training in child and adolescent psychology and training emphasizing the biological basis of behavior. Implications of these future directions are discussed.

Teaching Competencies for Community Preceptors.

PubMed

Brink, Darin; Simpson, Deb; Crouse, Byron; Morzinski, Jeffrey; Bower, Douglas; Westra, Ruth

2018-05-01

Although community physicians provide one-fourth of the outpatient training received in medical school, usually there is no formal training of the preceptor. Currently there is no agreed-upon list of teaching competencies for community physician-preceptors. Using a modified Delphi process, the authors aimed to identify core teaching competencies for community preceptors for use in training and evaluation. A medical educator and three faculty members with expertise in faculty development created a list of teaching competencies organized in five domains. These competencies were finalized through a multiround modified Delphi technique with key stakeholder groups including (1) nonphysician medical educators, (2) academic physicians involved in faculty development, (3) community physicians who regularly precept medical students, (4) family medicine residents, (5) third-year medical students in a 9-month-long longitudinal clerkship. Proposed competencies were retained if 70% of the participants ranked it as "very or extremely important." In the first round, 24 competencies were evaluated by 40 physician preceptors participating in a rural faculty development conference. These were refined, and four additional competencies were added by the cohort. Subsequent rounds utilized a survey approach with broader audiences resulting in a final list of 21 competencies in five domains. Five competency domains with 21 teaching competencies can now be used to guide community preceptors' training and evaluation.

Building a Privacy, Ethics, and Data Access Framework for Real World Computerised Medical Record System Data: A Delphi Study. Contribution of the Primary Health Care Informatics Working Group.

PubMed

Liyanage, H; Liaw, S-T; Di Iorio, C T; Kuziemsky, C; Schreiber, R; Terry, A L; de Lusignan, S

2016-11-10

Privacy, ethics, and data access issues pose significant challenges to the timely delivery of health research. Whilst the fundamental drivers to ensure that data access is ethical and satisfies privacy requirements are similar, they are often dealt with in varying ways by different approval processes. To achieve a consensus across an international panel of health care and informatics professionals on an integrated set of privacy and ethics principles that could accelerate health data access in data-driven health research projects. A three-round consensus development process was used. In round one, we developed a baseline framework for privacy, ethics, and data access based on a review of existing literature in the health, informatics, and policy domains. This was further developed using a two-round Delphi consensus building process involving 20 experts who were members of the International Medical Informatics Association (IMIA) and European Federation of Medical Informatics (EFMI) Primary Health Care Informatics Working Groups. To achieve consensus we required an extended Delphi process. The first round involved feedback on and development of the baseline framework. This consisted of four components: (1) ethical principles, (2) ethical guidance questions, (3) privacy and data access principles, and (4) privacy and data access guidance questions. Round two developed consensus in key areas of the revised framework, allowing the building of a newly, more detailed and descriptive framework. In the final round panel experts expressed their opinions, either as agreements or disagreements, on the ethics and privacy statements of the framework finding some of the previous round disagreements to be surprising in view of established ethical principles. This study develops a framework for an integrated approach to ethics and privacy. Privacy breech risk should not be considered in isolation but instead balanced by potential ethical benefit.

Development of a clinical definition for acute respiratory distress syndrome using the Delphi technique.

PubMed

Ferguson, Niall D; Davis, Aileen M; Slutsky, Arthur S; Stewart, Thomas E

2005-06-01

The objective of this study is to describe the implementation of formal consensus techniques in the development of a clinical definition for acute respiratory distress syndrome. A Delphi consensus process was conducted using e-mail. Sixteen panelists who were both researchers and opinion leaders were systematically recruited. The Delphi technique was performed over 4 rounds on the background of an explicit definition framework. Item generation was performed in round 1, item reduction in rounds 2 and 3, and definition evaluation in round 4. Explicit consensus thresholds were used throughout. Of the 16 panelists, 11 actually participated in developing a definition that met a priori consensus rules on the third iteration. New incorporations in the Delphi definition include the use of a standardized oxygenation assessment and the documentation of either a predisposing factor or decreased thoracic compliance. The panelists rated the Delphi definition as acceptable to highly acceptable (median score, 6; range, 5-7 on a 7-point Likert scale). We conclude that it is feasible to consider using formal consensus in the development of future definitions of acute respiratory distress syndrome. Testing of sensibility, reliability, and validity are needed for this preliminary definition; these test results should be incorporated into future iterations of this definition.

Research priorities in medical education at Shiraz University of Medical Sciences:categories and subcategories in the Iranian context

PubMed Central

NABEIEI, PARISA; AMINI, MITRA; GHANAVATI, SHIRIN; MARHAMATI, SAADAT

2016-01-01

Introduction Research in education is a globally significant issue without a long history. Due to the importance of the issue in Health System Development programs, this study intended to determine research priorities in medical education, considering their details and functions. By determining barriers existing in research in education progress, it is tried to make research priorities more functional by recommending acceptable strategies. Methods This is a qualitative-descriptive study in two descriptive phases. The goal of these phases was to determine research priorities subcategories in medical education by Nominal Group Technique (NGT) and two rounds of Delphi method. Through the first phase, subcategories of research priorities were determined, using Nominal Group Technique under medical education experts’ supervision. Through two rounds of Delphi, a questionnaire was constructed based on the subcategories. Eventually, research priorities were determined based on their highest score (scores more than 7 out of 10). Results In the first phase (NGT), 35 priorities in 5 major fields of medical education were presented. In the second phase, priorities were scored, using Delphi method. Medical Ethics and professionalism gained the highest scores (7.63±1.26) and educational evaluation the lowest (7.28±1.52). In this stage, 7 items were omitted but 2 of them were added again after experts’ revision in the third round of Delphi. Conclusion According to the results of the present study and based on previous studies, it really seems that the fields of “Learning and Teaching Approaches” and “Medical Ethics and Professionalism” were more important. Because of financial and resource limitations in our country and the importance of research priorities, it is recommended to frequently study “research priorities determination program” at universities. PMID:26793723

A proposed adaptation of the European Foundation for Quality Management Excellence Model to physical activity programmes for the elderly - development of a quality self-assessment tool using a modified Delphi process

PubMed Central

2011-01-01

Background There has been a growing concern in designing physical activity (PA) programmes for elderly people, since evidence suggests that such health promotion interventions may reduce the deleterious effects of the ageing process. Complete programme evaluations are a necessary prerequisite to continuous quality improvements. Being able to refine, adapt and create tools that are suited to the realities and contexts of PA programmes for the elderly in order to support its continuous improvement is, therefore, crucial. Thus, the aim of this study was to develop a self-assessment tool for PA programmes for the elderly. Methods A 3-round Delphi process was conducted via the Internet with 43 national experts in PA for the elderly, management and delivery of PA programmes for the elderly, sports management, quality management and gerontology, asking experts to identify the propositions that they considered relevant for inclusion in the self-assessment tool. Experts reviewed a list of proposed statements, based on the criteria and sub-criteria from the European Foundation for Quality Management Excellence Model (EFQM) and PA guidelines for older adults and rated each proposition from 1 to 8 (disagree to agree) and modified and/or added propositions. Propositions receiving either bottom or top scores of greater than 70% were considered to have achieved consensus to drop or retain, respectively. Results In round 1, of the 196 originally-proposed statements (best practice principles), the experts modified 41, added 1 and achieved consensus on 93. In round 2, a total of 104 propositions were presented, of which experts modified 39 and achieved consensus on 53. In the last round, of 51 proposed statements, the experts achieved consensus on 19. After 3 rounds of rating, experts had not achieved consensus on 32 propositions. The resulting tool consisted of 165 statements that assess nine management areas involved in the development of PA programmes for the elderly. Conclusion Based on experts' opinions, a self-assessment tool was found in order to access quality of PA programmes for the elderly. Information obtained with evaluations would be useful to organizations seeking to improve their services, customer satisfaction and, consequently, adherence to PA programmes, targeting the ageing population. PMID:21958203

Identifying opportunities for nature engagement in cancer care practice and design: protocol for four-round modified electronic Delphi.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-03-08

Opportunities to engage with nature have shown relevance in experiences of health and recovery of patients with cancer and are attracting interest in cancer care practice and design. Such healthcare innovations can widen the horizon of possible supportive care solutions but require deliberate and rigorous investigation to ensure responsible action is taken and wastage avoided. This protocol outlines a study designed to solicit knowledge from relevant experts drawn from a range of healthcare practitioners, management representatives, designers and researchers to explore levels of opinion consensus for determining opportunities for, and barriers to, providing helpful nature engagement in cancer care settings. A 4-round modified electronic Delphi methodology will be used to conduct a structured, iterative feedback process for querying and synthesising expert opinion. Round 1 administers an open-ended questionnaire to a panel of selected, relevant experts who will consider the own recommendations of patients with cancer for nature engagement (drawn from a preceding investigation) before contributing salient issues (items) with relevance to the topic. Round 2 circulates anonymised summaries of responses back to the experts who verify and, if they wish, reconsider their own responses. Rounds 3 and 4 determine and rank experts' top 10 items using a 10-point Likert-type scale. Descriptive statistics (median and mean scores) will be calculated to indicate the items' relative importance. Levels of consensus will be explored with consensus defined as 75% agreement. Ethics approval for this study was obtained from the Institution's Human Research Ethics Committee (blinded for review). It is anticipated that the results will be published in peer-reviewed journals and presented in a variety of forums. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Teacher Competencies in Health Education: Results of a Delphi Study

PubMed Central

Moynihan, Sharon; Paakkari, Leena; Välimaa, Raili; Jourdan, Didier; Mannix-McNamara, Patricia

2015-01-01

Objective The aim of this research study was to identify the core competencies for health education teachers in supporting the development of health literacy among their students. Method/Results A three round Delphi method was employed. Experts in health education were asked to identify core competencies for school health educators. Twenty six participants from the academic field were invited to participate in the study. Twenty participants completed the first round of the Delphi, while eighteen took part in round two and fifteen participated in the final round. Data were collected using an electronic questionnaire. The first round contained an open ended question in which participants were asked to name and define all the competencies they perceived were important. Thematic analysis was undertaken on these data. A list of 36 competencies was created from this round. This list was then returned to the same participants and they were asked to rate each competency on a 7 point semantic differential scale in terms of importance. The resulting data were then analysed. For the final round, participants were presented with a list of 33 competencies and were asked to rank them again, in order of importance. Conclusion Twelve core competencies emerged from the analysis and these competencies comprised of a mixture of knowledge, attitude and skills. The authors suggest that how these competencies are achieved and operationalised in the school context can be quite complex and multi-faceted. While the authors do not seek to generalise from the study they suggest that these competencies are an important input for all stakeholders, in order to question national and international teacher guidelines. In addition the competencies identified may provide a useful starting point for others to undertake deeper analysis of what it means to be an effective health educator in schools. PMID:26630180

Standardized reporting guidelines for emergency department syncope risk-stratification research.

PubMed

Sun, Benjamin C; Thiruganasambandamoorthy, Venkatesh; Cruz, Jeffrey Dela

2012-06-01

There is increasing research interest in the risk stratification of emergency department (ED) syncope patients. A major barrier to comparing and synthesizing existing research is wide variation in the conduct and reporting of studies. The authors wanted to create standardized reporting guidelines for ED syncope risk-stratification research using an expert consensus process. In that pursuit, a panel of syncope researchers was convened and a literature review was performed to identify candidate reporting guideline elements. Candidate elements were grouped into four sections: eligibility criteria, outcomes, electrocardiogram (ECG) findings, and predictors. A two-round, modified Delphi consensus process was conducted using an Internet-based survey application. In the first round, candidate elements were rated on a five-point Likert scale. In the second round, panelists rerated items after receiving information about group ratings from the first round. Items that were rated by >80% of the panelists at the two highest levels of the Likert scale were included in the final guidelines. There were 24 panelists from eight countries who represented five clinical specialties. The panel identified an initial set of 183 candidate elements. After two survey rounds, the final reporting guidelines included 92 items that achieved >80% consensus. These included 10 items for study eligibility, 23 items for outcomes, nine items for ECG abnormalities, and 50 items for candidate predictors. Adherence to these guidelines should facilitate comparison of future research in this area. © 2012 by the Society for Academic Emergency Medicine.

STEM integration in middle school career and technical education programs: A Delphi design study

NASA Astrophysics Data System (ADS)

Wu-Rorrer, Billy Ray

The purpose of this qualitative method study with a Delphi research design sought to determine how STEM programs can be effectively integrated into middle school career and technical education programs by local, state, and national educators, administrators, directors, specialists, and curriculum writers. The significance of the study is to provide leaders in CTE with a greater awareness, insight, and strategies about how CTE programs can more effectively integrate academics into career and technical education programs through STEM-related programming. The findings will increase the limited amount of available literature providing best practice strategies for the integration of STEM curriculum into middle school CTE programs. One basic question has guided this research: How can STEM programs be effectively integrated into middle school career and technical education programs? A total of twelve strategies were identified. The strategies of real-world applications and administrative buy-in were the two predominant strategies consistently addressed throughout the review of literature and all three sub-questions in the research study. The Delphi design study consisted of pilot round and three rounds of data collection on barriers, strategies, and professional development for STEM integration in middle school career and technical education programs. Four panelists participated in the pilot round, and 16 panel members not involved in the pilot round participated in the three rounds of questioning and consensus building. In the future, more comprehensive studies can build upon this foundational investigation of middle school CTE programs.

Development of an Index of Engagement in HIV Care: An Adapted Internet-Based Delphi Process

PubMed Central

Koester, Kimberly A; Wood, Troy; Neilands, Torsten B; Pomeranz, Jamie L; Christopoulos, Katerina A

2017-01-01

Background Improving engagement in medical care among persons living with human immunodeficiency virus (HIV) is critical to optimizing clinical outcomes and reducing onward transmission of HIV. However, a clear conceptualization of what it means to be engaged in HIV care is lacking, and thus efforts to measure and enhance engagement in care are limited. Objective This paper describes the use of a modified online Delphi process of consensus building to solicit input from a range of HIV and non-HIV researchers and providers, and to integrate that input with focus group data conducted with HIV-infected patients. The overarching goal was to generate items for a patient-centered measure of engagement in HIV care for use in future research and clinical practice. Methods We recruited 66 expert panelists from around the United States. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. Results We recruited 66 expert panelists from around the United States and 64 (97%) were retained for four rounds of data collection. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. The process resulted in an expansion to 120 topics that were subsequently reduced to 13 candidate items for the planned assessment measure. Conclusions The process was an efficient method of soliciting input from geographically separated and busy experts across a range of disciplines and professional roles with the aim of arriving at a coherent definition of engagement in HIV care and a manageable set of survey items to assess it. Next steps are to validate the utility of the new measure in predicting retention in care, adherence to treatment, and clinical outcomes among patients living with HIV. PMID:29208589

Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment.

PubMed

Hepworth, Lauren R; Rowe, Fiona J

2018-02-01

The aim of this study was to ascertain what items stroke survivors and stroke care professionals think are important when assessing quality of life for stroke survivors with visual impairment for inclusion in the new patient-reported outcome measure. A reactive Delphi process was used in a three-round electronic-based survey. The items presented consisted of 62 items originally sourced from a systematic review of existing vision-related quality of life instruments and stroke survivor interviews, reduced and refined following a ranking exercise and pilot with stroke survivors with visual impairment. Stakeholders (stroke survivors/clinicians) were invited to take part in the process. A consensus definition of ≥70% was decided a priori. Participants were asked to rank importance on a 9-point scale and categorize the items by relevance to types of visual impairment following stroke or not relevant. Analysis of consensus, stability, and agreement was conducted. In total, 113 participants registered for the Delphi survey of which 47 (41.6%) completed all three rounds. Response rates to the three rounds were 78/113 (69.0%), 61/76 (81.3%), and 49/64 (76.6%), respectively. The participants included orthoptists (45.4%), occupational therapists (44.3%), and stroke survivors (10.3%). Consensus was reached on 56.5% of items in the three-round process, all for inclusion. A consensus was reached for 83.8% in the categorization of items. The majority (82.6%) of consensus were for relevant to 'all visual impairment following stroke'; two items were deemed 'not relevant'. The lack of item reduction achieved by this Delphi process highlights the need for additional methods of item reduction in the development of a new PROM for visual impairment following stroke. These results will be considered alongside Rasch analysis to achieve further item reduction. However, the Delphi survey remains important as it provides clinical and patient insight into each item rather than purely relying on the psychometric data.

Application of the Delphi technique in healthcare maintenance.

PubMed

Njuangang, Stanley; Liyanage, Champika; Akintoye, Akintola

2017-10-09

Purpose The purpose of this paper is to examine the research design, issues and considerations in the application of the Delphi technique to identify, refine and rate the critical success factors and performance measures in maintenance-associated infections. Design/methodology/approach In-depth literature review through the application of open and axial coding were applied to formulate the interview and research questions. These were used to conduct an exploratory case study of two healthcare maintenance managers, randomly selected from two National Health Service Foundation Trusts in England. The results of exploratory case study provided the rationale for the application of the Delphi technique in this research. The different processes in the application of the Delphi technique in healthcare research are examined thoroughly. Findings This research demonstrates the need to apply and integrate different research methods to enhance the validity of the Delphi technique. The rationale for the application of the Delphi technique in this research is because some healthcare maintenance managers lack knowledge about basic infection control (IC) principles to make hospitals safe for patient care. The result of first round of the Delphi exercise is a useful contribution in its own rights. It identified a number of salient issues and differences in the opinions of the Delphi participants, noticeably between healthcare maintenance managers and members of the infection control team. It also resulted in useful suggestions and comments to improve the quality and presentation of the second- and third-round Delphi instruments. Practical implications This research provides a research methodology that can be adopted by researchers investigating new and emerging issues in the healthcare sector. As this research demonstrates, the Delphi technique is relevant in soliciting expert knowledge and opinion to identify performance measures to control maintenance-associated infections in hospitals. The methodology provided here could be applied by other researchers elsewhere to probe, investigate and generate rich information about new and emerging healthcare research topics. Originality/value The authors demonstrate how different research methods can be integrated to enhance the validity of the Delphi technique. For example, the results of an exploratory case study provided the rationale for the application of the Delphi technique investigating the key performance measures in maintenance-associated infections. The different processes involved in the application of the Delphi technique are also carefully explored and discussed in depth.

Development of quality indicators to evaluate antibiotic treatment of patients with community-acquired pneumonia in Indonesia.

PubMed

Farida, Helmia; Rondags, Angelique; Gasem, M Hussein; Leong, Katharina; Adityana, A; van den Broek, Peterhans J; Keuter, Monique; Natsch, Stephanie

2015-04-01

To develop an instrument for evaluating the quality of antibiotic management of patients with community-acquired pneumonia (CAP) applicable in a middle-income developing country. A previous study and Indonesian guidelines were reviewed to derive potential quality of care indicators (QIs). An expert panel performed a two-round Delphi consensus procedure on the QI's relevance to patient recovery, reduction of antimicrobial resistance and cost containment. Applicability in practice, including reliability, feasibility and opportunity for improvement, was determined in a data set of 128 patients hospitalised with CAP in Semarang, Indonesia. Fifteen QIs were selected by the consensus procedure. Five QIs did not pass feasibility criteria, because of inappropriate documentation, inefficient laboratory services or patient factors. Three QIs provided minor opportunity for improvement. Two QIs contradicted each other; one of these was considered not valid and excluded. A final set of six QIs was defined for use in the Indonesian setting. Using the Delphi method, we defined a list of QIs for assessing the quality of care, in particular antibiotic treatment, for CAP in Indonesia. For further improvement, a modified Delphi method that includes discussion, a sound medical documentation system, improvement of microbiology laboratory services, and multi-center applicability tests are needed to develop a valid and applicable QI list for the Indonesian setting. © 2014 John Wiley & Sons Ltd.

Three nested randomized controlled trials of peer-only or multiple stakeholder group feedback within Delphi surveys during core outcome and information set development.

PubMed

Brookes, Sara T; Macefield, Rhiannon C; Williamson, Paula R; McNair, Angus G; Potter, Shelley; Blencowe, Natalie S; Strong, Sean; Blazeby, Jane M

2016-08-17

Methods for developing a core outcome or information set require involvement of key stakeholders to prioritise many items and achieve agreement as to the core set. The Delphi technique requires participants to rate the importance of items in sequential questionnaires (or rounds) with feedback provided in each subsequent round such that participants are able to consider the views of others. This study examines the impact of receiving feedback from different stakeholder groups, on the subsequent rating of items and the level of agreement between stakeholders. Randomized controlled trials were nested within the development of three core sets each including a Delphi process with two rounds of questionnaires, completed by patients and health professionals. Participants rated items from 1 (not essential) to 9 (absolutely essential). For round 2, participants were randomized to receive feedback from their peer stakeholder group only (peer) or both stakeholder groups separately (multiple). Decisions as to which items to retain following each round were determined by pre-specified criteria. Whilst type of feedback did not impact on the percentage of items for which a participant subsequently changed their rating, or the magnitude of change, it did impact on items retained at the end of round 2. Each core set contained discordant items retained by one feedback group but not the other (3-22 % discordant items). Consensus between patients and professionals in items to retain was greater amongst those receiving multiple group feedback in each core set (65-82 % agreement for peer-only feedback versus 74-94 % for multiple feedback). In addition, differences in round 2 scores were smaller between stakeholder groups receiving multiple feedback than between those receiving peer group feedback only. Variability in item scores across stakeholders was reduced following any feedback but this reduction was consistently greater amongst the multiple feedback group. In the development of a core outcome or information set, providing feedback within Delphi questionnaires from all stakeholder groups separately may influence the final core set and improve consensus between the groups. Further work is needed to better understand how participants rate and re-rate items within a Delphi process. The three randomized controlled trials reported here were each nested within the development of a core information or outcome set to investigate processes in core outcome and information set development. Outcomes were not health-related and therefore trial registration was not applicable.

Personalising care of adults with asthma from Asia: a modified e-Dephi consensus study to inform management tailored to attitude and control profiles.

PubMed

Chisholm, Alison; Price, David B; Pinnock, Hilary; Lee, Tan Tze; Roa, Camilo; Cho, Sang-Heon; David-Wang, Aileen; Wong, Gary; van der Molen, Thys; Ryan, Dermot; Castillo-Carandang, Nina; Yong, Yee Vern

2017-01-05

REALISE Asia-an online questionnaire-based study of Asian asthma patients-identified five patient clusters defined in terms of their control status and attitude towards their asthma (categorised as: 'Well-adjusted and at least partly controlled'; 'In denial about symptoms'; 'Tolerating with poor control'; 'Adrift and poorly controlled'; 'Worried with multiple symptoms'). We developed consensus recommendations for tailoring management of these attitudinal-control clusters. An expert panel undertook a three-round electronic Delphi (e-Delphi): Round 1: panellists received descriptions of the attitudinal-control clusters and provided free text recommendations for their assessment and management. Round 2: panellists prioritised Round 1 recommendations and met (or joined a teleconference) to consolidate the recommendations. Round 3: panellists voted and prioritised the remaining recommendations. Consensus was defined as Round 3 recommendations endorsed by >50% of panellists. Highest priority recommendations were those receiving the highest score. The multidisciplinary panellists (9 clinicians, 1 pharmacist and 1 health social scientist; 7 from Asia) identified consensus recommendations for all clusters. Recommended pharmacological (e.g., step-up/down; self-management; simplified regimen) and non-pharmacological approaches (e.g., trigger management, education, social support; inhaler technique) varied substantially according to each cluster's attitude to asthma and associated psychosocial drivers of behaviour. The attitudinal-control clusters defined by REALISE Asia resonated with the international panel. Consensus was reached on appropriate tailored management approaches for all clusters. Summarised and incorporated into a structured management pathway, these recommendations could facilitate personalised care. Generalisability of these patient clusters should be assessed in other socio-economic, cultural and literacy groups and nationalities in Asia.

Which Dimensions of Patient-Centeredness Matter? - Results of a Web-Based Expert Delphi Survey.

PubMed

Zill, Jördis M; Scholl, Isabelle; Härter, Martin; Dirmaier, Jörg

2015-01-01

Present models and definitions of patient-centeredness revealed a lack of conceptual clarity. Based on a prior systematic literature review, we developed an integrative model with 15 dimensions of patient-centeredness. The aims of this study were to 1) validate, and 2) prioritize these dimensions. A two-round web-based Delphi study was conducted. 297 international experts were invited to participate. In round one they were asked to 1) give an individual rating on a nine-point-scale on relevance and clarity of the dimensions, 2) add missing dimensions, and 3) prioritize the dimensions. In round two, experts received feedback about the results of round one and were asked to reflect and re-rate their own results. The cut-off for the validation of a dimension was a median < 7 on one of the criteria. 105 experts participated in round one and 71 in round two. In round one, one new dimension was suggested and included for discussion in round two. In round two, this dimension did not reach sufficient ratings to be included in the model. Eleven dimensions reached a median ≥ 7 on both criteria (relevance and clarity). Four dimensions had a median < 7 on one or both criteria. The five dimensions rated as most important were: patient as a unique person, patient involvement in care, patient information, clinician-patient communication and patient empowerment. 11 out of the 15 dimensions have been validated through experts' ratings. Further research on the four dimensions that received insufficient ratings is recommended. The priority order of the dimensions can help researchers and clinicians to focus on the most important dimensions of patient-centeredness. Overall, the model provides a useful framework that can be used in the development of measures, interventions, and medical education curricula, as well as the adoption of a new perspective in health policy.

Which Dimensions of Patient-Centeredness Matter? - Results of a Web-Based Expert Delphi Survey

PubMed Central

Zill, Jördis M.; Scholl, Isabelle; Härter, Martin; Dirmaier, Jörg

2015-01-01

Background Present models and definitions of patient-centeredness revealed a lack of conceptual clarity. Based on a prior systematic literature review, we developed an integrative model with 15 dimensions of patient-centeredness. The aims of this study were to 1) validate, and 2) prioritize these dimensions. Method A two-round web-based Delphi study was conducted. 297 international experts were invited to participate. In round one they were asked to 1) give an individual rating on a nine-point-scale on relevance and clarity of the dimensions, 2) add missing dimensions, and 3) prioritize the dimensions. In round two, experts received feedback about the results of round one and were asked to reflect and re-rate their own results. The cut-off for the validation of a dimension was a median < 7 on one of the criteria. Results 105 experts participated in round one and 71 in round two. In round one, one new dimension was suggested and included for discussion in round two. In round two, this dimension did not reach sufficient ratings to be included in the model. Eleven dimensions reached a median ≥ 7 on both criteria (relevance and clarity). Four dimensions had a median < 7 on one or both criteria. The five dimensions rated as most important were: patient as a unique person, patient involvement in care, patient information, clinician-patient communication and patient empowerment. Discussion 11 out of the 15 dimensions have been validated through experts’ ratings. Further research on the four dimensions that received insufficient ratings is recommended. The priority order of the dimensions can help researchers and clinicians to focus on the most important dimensions of patient-centeredness. Overall, the model provides a useful framework that can be used in the development of measures, interventions, and medical education curricula, as well as the adoption of a new perspective in health policy. PMID:26539990

The trials methodological research agenda: results from a priority setting exercise.

PubMed

Tudur Smith, Catrin; Hickey, Helen; Clarke, Mike; Blazeby, Jane; Williamson, Paula

2014-01-23

Research into the methods used in the design, conduct, analysis, and reporting of clinical trials is essential to ensure that effective methods are available and that clinical decisions made using results from trials are based on the best available evidence, which is reliable and robust. An on-line Delphi survey of 48 UK Clinical Research Collaboration registered Clinical Trials Units (CTUs) was undertaken. During round one, CTU Directors were asked to identify important topics that require methodological research. During round two, their opinion about the level of importance of each topic was recorded, and during round three, they were asked to review the group's average opinion and revise their previous opinion if appropriate. Direct reminders were sent to maximise the number of responses at each round. Results are summarised using descriptive methods. Forty one (85%) CTU Directors responded to at least one round of the Delphi process: 25 (52%) responded in round one, 32 (67%) responded in round two, 24 (50%) responded in round three. There were only 12 (25%) who responded to all three rounds and 18 (38%) who responded to both rounds two and three. Consensus was achieved amongst CTU Directors that the top three priorities for trials methodological research were 'Research into methods to boost recruitment in trials' (considered the highest priority), 'Methods to minimise attrition' and 'Choosing appropriate outcomes to measure'. Fifty other topics were included in the list of priorities and consensus was reached that two topics, 'Radiotherapy study designs' and 'Low carbon trials', were not priorities. This priority setting exercise has identified the research topics felt to be most important to the key stakeholder group of Directors of UKCRC registered CTUs. The use of robust methodology to identify these priorities will help ensure that this work informs the trials methodological research agenda, with a focus on topics that will have most impact and relevance.

Prevention and control of major non-communicable diseases in China from 1990 to 2009: results of a two-round Delphi survey.

PubMed

Lv, Jun; Liu, Miao; Jiang, Yu; Li, Li-Ming

2013-02-12

The aim of this study was to learn about the progress of the prevention and control of major non-communicable diseases (NCDs) in China from 1990 to 2009 and to determine what prevention and control gaps remain based on the opinions of a group of panellists. Sixty-four panellists, who are members of the Subcommittee of the Non-Communicable Diseases, the Expert Committee on Disease Control and Prevention established by China's Ministry of Health in 2010, were invited to participate in an email-based, two-round Delphi survey. In each round, a structured questionnaire was given to participants, who were asked to rate the importance and practical implementation of items relevant to the prevention and control of NCDs over two periods, 1990-1999 and 2000-2009, on a 10-point scale. Of the 64 panellists invited, 20 (31.3%) completed the first-round survey, and, of those, 14 (70.0%) completed the second-round survey. Of the 237 common variables in the two survey rounds, there were 161 (67.9%) and 209 (88.2%) with an interquartile range ≤2 in the first round and second round, respectively. These results indicated a better expert consensus in the second round. There were 92 items in total in the second round of the questionnaire, 88 (95.7%) of which had median importance rating scores of equal to or greater than 7.00. The median scores for the practical implementation items during 2000-2009 were greater than those for the 1990-1999 period. The results indicate improved implementation in the recent decade. China has made progress in the prevention and control of NCDs during the 21st century. However, these intuitive rating results indicate that there are still large action gaps in the fight against epidemic NCDs in China.

The trials methodological research agenda: results from a priority setting exercise

PubMed Central

2014-01-01

Background Research into the methods used in the design, conduct, analysis, and reporting of clinical trials is essential to ensure that effective methods are available and that clinical decisions made using results from trials are based on the best available evidence, which is reliable and robust. Methods An on-line Delphi survey of 48 UK Clinical Research Collaboration registered Clinical Trials Units (CTUs) was undertaken. During round one, CTU Directors were asked to identify important topics that require methodological research. During round two, their opinion about the level of importance of each topic was recorded, and during round three, they were asked to review the group’s average opinion and revise their previous opinion if appropriate. Direct reminders were sent to maximise the number of responses at each round. Results are summarised using descriptive methods. Results Forty one (85%) CTU Directors responded to at least one round of the Delphi process: 25 (52%) responded in round one, 32 (67%) responded in round two, 24 (50%) responded in round three. There were only 12 (25%) who responded to all three rounds and 18 (38%) who responded to both rounds two and three. Consensus was achieved amongst CTU Directors that the top three priorities for trials methodological research were ‘Research into methods to boost recruitment in trials’ (considered the highest priority), ‘Methods to minimise attrition’ and ‘Choosing appropriate outcomes to measure’. Fifty other topics were included in the list of priorities and consensus was reached that two topics, ‘Radiotherapy study designs’ and ‘Low carbon trials’, were not priorities. Conclusions This priority setting exercise has identified the research topics felt to be most important to the key stakeholder group of Directors of UKCRC registered CTUs. The use of robust methodology to identify these priorities will help ensure that this work informs the trials methodological research agenda, with a focus on topics that will have most impact and relevance. PMID:24456928

Expert consensus on facilitators and barriers to return-to-work following surgery for non-traumatic upper extremity conditions: a Delphi study.

PubMed

Peters, S E; Johnston, V; Ross, M; Coppieters, M W

2017-02-01

This Delphi study aimed to reach consensus on important facilitators and barriers for return-to-work following surgery for non-traumatic upper extremity conditions. In Round 1, experts ( n = 42) listed 134 factors, which were appraised in Rounds 2 and 3. Consensus (⩾85% agreement) was achieved for 13 facilitators (high motivation to return-to-work; high self-efficacy for return-to-work and recovery; availability of modified/alternative duties; flexible return-to-work arrangements; positive coping skills; limited heavy work exertion; supportive return-to-work policies; supportive supervisor/management; no catastrophic thinking; no fear avoidance to return-to-work; no fear avoidance to pain/activity; return to meaningful work duties; high job satisfaction) and six barriers (mood disorder diagnosis; pain/symptoms at more than one musculoskeletal site; heavy upper extremity exertions at work; lack of flexible return-to-work arrangements; lack of support from supervisor/management; high level of pain catastrophizing). Future prognostic studies are required to validate these biopsychosocial factors to further improve return-to-work outcomes. V.

Defining the role of a forensic hospital registered nurse using the Delphi method.

PubMed

Newman, Claire; Patterson, Karen; Eason, Michelle; Short, Ben

2016-11-01

A Delphi survey was undertaken to refine the position description of a registered nurse working in a forensic hospital, in New South Wales, Australia. Prior to commencing operation in 2008, position descriptions were developed from a review of legislation, as well as policies and procedures used by existing forensic mental health services in Australia. With an established workforce and an evolving model of care, a review of the initial registered nurse position description was required. An online Delphi survey was undertaken. Eight executive (88.9%) and 12 (58.3%) senior nursing staff participated in the first survey round. A total of four survey rounds were completed. At the final round, there was consensus (70%) that the revised position description was either very or somewhat suitable. There were a total of nine statements, from 31 originally produced in round 1, that did not reach consensus. The Delphi survey enabled a process for refining the Forensic Hospital registered nurse position description. Methods that facilitate executive and senior nursing staff consensus in the development and review of position descriptions should be considered in nursing management. © 2016 John Wiley & Sons Ltd.

Development of an evidence-based protocol for care of pilonidal sinus wounds healing by secondary intent using a modified reactive Delphi procedure. Part one: the literature review*.

PubMed

Harris, Connie L; Holloway, Samantha

2012-04-01

This article is in two parts. The overall aim of this section was to review the literature in relation to pilonidal sinus wounds (PSW) healing by secondary intent for a Master's of Science in Wound Healing and Tissue Repair thesis. The purpose of the literature review was to determine if an evidence-based guideline or consensus document existed for the care of these wounds, and if not, to determine the topics from which to develop items for the first round of a modified reactive Delphi questionnaire. Part two will describe the iterative process, the analysis and the results. The review found no best practice guidelines concerning PSW, and only one clinical pathway. Seventeen areas of interest were identified that may contribute to optimal healing conditions or to delayed healing. These included microbiology of infected PSW, signs and symptoms of localised or deeper (spreading) chronic wound infection, swab for c&s, role of topical antiseptics or antimicrobials, systemic antibiotics, local wound interventions, optimal positioning, wound cleansing, principles of moist wound healing/dressing selection, topical negative pressure (TNP) therapy, peri-wound skin decontamination and depilation, pain control, physical activities, optimal nutrition and patient education. © 2011 The Authors. © 2011 Blackwell Publishing Ltd and Medicalhelplines.com Inc.

The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study

PubMed Central

Gagliardi, Diana; Rondinone, Bruna M; Mirabile, Marco; Buresti, Giuliana; Ellwood, Peter; Hery, Michel; Paszkiewicz, Peter; Valenti, Antonio; Iavicoli, Sergio

2017-01-01

Objectives This study, developed within the frame of the Partnership for European Research on Occupational Safety and Health joint research activities and based on the frame designed by the 2013 European Agency for Safety and Health at Work (EU-OSHA) study, is the first example of using the points of view of European occupational safety and health (OSH) researchers. The objective is to identify priorities for OSH research that may contribute to the achievement of present and future sustainable growth objectives set by the European strategies. Methods The study was carried out using a modified Delphi method with a two-round survey. Each round involved a panel of about 110 researchers representing the network member institutes was selected according to specific criteria, including the ownership of research expertise in at least one of the four macroareas identified by the reference report developed by EU-OSHA in 2013. Results The study identified some innovative research topics (for example, ‘Emerging technological devices’ and ‘OSH consequences of markets integration’) and research priorities (ie, crowdsourcing, e-work, zero-hours contracts) that are not reflected in previous studies of this nature. The absence of any reference to violence and harassment at work among the researchers’ proposals is a major difference from previous similar studies, while topics related to gender issues and electromagnetic fields show a lower importance. Conclusions The innovative design of a research priorities identification process, which takes advantage of a large, representative and qualified panel of European researchers allowed the definition of a number of research priorities able to support the inclusion of innovative OSH research issues in the scope of the next European research agenda. PMID:28645965

Development of community based curriculum on ophthalmology for under graduate medical course in Bangladesh.

PubMed

Khan, A K; Hussain, A Z M I

2012-08-01

The curriculum represents the expression of educational ideas in practice. Ophthalmic education is the corner stone to improve eye care globally. Curriculum needs continuous modification varying in different geographic locations. Though 90% of common conditions are either preventable or curable but emphasis on the common conditions is inadequate. This is a stepwise descriptive study aiming to develop a community based ophthalmology curriculum for undergraduate medical course in Bangladesh conducted during March 2007 to February 2008 at UniSA School of Public Health and Life Sciences, University of South Asia, Banani, Dhaka. Delphi technique, a modified qualitative method was used to accumulate data and reaching a consensus opinion for developing the curriculum. Study approach includes two iterative rounds and finally a workshop. Iteration of round-I was "What are the eye diseases with overall knowledge of their management one MBBS physician should acquire"; followed by a list of eye diseases and topics for expert opinion. The response was collated. Iteration round-II was "How much a MBBS student should have percentage of knowledge, attitude and skills on each topic while being taught". The response was collated and presented to panel of expert ophthalmologists for discussion and validation. In the round-I Delphi, 400 (62%) out to total 641 ophthalmologist were randomly selected dividing in categories (62% in each) of Professor-22, Associate Professor-12, Assistant Professor-26, Consultant-27, ophthalmologists working in NGO-56 and ophthalmologists in private sector-257. Sixty (15%) responded with opinion. In the round-II, 200 (31%) including 60 of round-I, selected randomly but proportionately as before. Forty five (22.5%) responded with opinion. Result collated. The results and opinion of respondents were presented at a workshop attended by 24 (80%), out of 30 invited expert ophthalmic specialists for discussion, criticism, opinion, addition, modification and finally for validation. On the basis of the opinion of the respondents, reviewing literature, analyzing the ocular disease pattern in Bangladesh and also analyzing the present ophthalmology curriculum, a community and need based ophthalmology curriculum for undergraduate medical course in Bangladesh was developed. This research would help developing community and need based ophthalmology curriculum for undergraduate medical course in Bangladesh.

Using a Delphi process to define priorities for prison health research in Canada

PubMed Central

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-01

Objectives A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. Setting We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. Participants We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators’ professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Primary and secondary outcome measures Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. Results In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Conclusions Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. PMID:26769790

From control to causation: Validating a 'complex systems model' of running-related injury development and prevention.

PubMed

Hulme, A; Salmon, P M; Nielsen, R O; Read, G J M; Finch, C F

2017-11-01

There is a need for an ecological and complex systems approach for better understanding the development and prevention of running-related injury (RRI). In a previous article, we proposed a prototype model of the Australian recreational distance running system which was based on the Systems Theoretic Accident Mapping and Processes (STAMP) method. That model included the influence of political, organisational, managerial, and sociocultural determinants alongside individual-level factors in relation to RRI development. The purpose of this study was to validate that prototype model by drawing on the expertise of both systems thinking and distance running experts. This study used a modified Delphi technique involving a series of online surveys (December 2016- March 2017). The initial survey was divided into four sections containing a total of seven questions pertaining to different features associated with the prototype model. Consensus in opinion about the validity of the prototype model was reached when the number of experts who agreed or disagreed with survey statement was ≥75% of the total number of respondents. A total of two Delphi rounds was needed to validate the prototype model. Out of a total of 51 experts who were initially contacted, 50.9% (n = 26) completed the first round of the Delphi, and 92.3% (n = 24) of those in the first round participated in the second. Most of the 24 full participants considered themselves to be a running expert (66.7%), and approximately a third indicated their expertise as a systems thinker (33.3%). After the second round, 91.7% of the experts agreed that the prototype model was a valid description of the Australian distance running system. This is the first study to formally examine the development and prevention of RRI from an ecological and complex systems perspective. The validated model of the Australian distance running system facilitates theoretical advancement in terms of identifying practical system-wide opportunities for the implementation of sustainable RRI prevention interventions. This 'big picture' perspective represents the first step required when thinking about the range of contributory causal factors that affect other system elements, as well as runners' behaviours in relation to RRI risk. Copyright © 2017 Elsevier Ltd. All rights reserved.

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Development and validation of a mass casualty conceptual model.

PubMed

Culley, Joan M; Effken, Judith A

2010-03-01

To develop and validate a conceptual model that provides a framework for the development and evaluation of information systems for mass casualty events. The model was designed based on extant literature and existing theoretical models. A purposeful sample of 18 experts validated the model. Open-ended questions, as well as a 7-point Likert scale, were used to measure expert consensus on the importance of each construct and its relationship in the model and the usefulness of the model to future research. Computer-mediated applications were used to facilitate a modified Delphi technique through which a panel of experts provided validation for the conceptual model. Rounds of questions continued until consensus was reached, as measured by an interquartile range (no more than 1 scale point for each item); stability (change in the distribution of responses less than 15% between rounds); and percent agreement (70% or greater) for indicator questions. Two rounds of the Delphi process were needed to satisfy the criteria for consensus or stability related to the constructs, relationships, and indicators in the model. The panel reached consensus or sufficient stability to retain all 10 constructs, 9 relationships, and 39 of 44 indicators. Experts viewed the model as useful (mean of 5.3 on a 7-point scale). Validation of the model provides the first step in understanding the context in which mass casualty events take place and identifying variables that impact outcomes of care. This study provides a foundation for understanding the complexity of mass casualty care, the roles that nurses play in mass casualty events, and factors that must be considered in designing and evaluating information-communication systems to support effective triage under these conditions.

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors

PubMed Central

Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

Background The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Methods Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. Findings All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. Conclusions This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention. PMID:26726801

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors.

PubMed

Balaguer, Albert; Monforte-Royo, Cristina; Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention.

Using the Delphi method to develop nursing-sensitive quality indicators for the NICU.

PubMed

Chen, Lin; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-02-01

To develop nursing-sensitive quality indicators consistent with current medical practices in Chinese neonatal intensive care units. The development of nursing-sensitive quality indicators has become a top priority in nursing management. To the best of our knowledge, there has been no objective, scientific and sensitive evaluation of the quality of neonatal intensive care unit nursing in China. A modified Delphi technique was used to seek opinions from experts about what should be used and prioritised as indicators of quality care in neonatal intensive care unit nursing. Based on a literature review, we identified 21 indicators of nursing-sensitive quality in the neonatal intensive care unit. Our group of 11 consultants chose 13 indicators to be discussed using the Delphi method. In October and November 2014, 39 neonatal intensive care unit experts in 18 tertiary hospitals spread across six provinces participated in two rounds of Delphi panels. Of the 13 indicators discussed, 11 were identified as indicators of nursing-sensitive quality in the neonatal intensive care unit: rate of nosocomial infections, rate of accidental endotracheal extubation, rate of errors in medication administration, rate of treatment for pain, rate of peripheral venous extravasation, rate of compliance with handwashing techniques, incidence of pressure ulcers, incidence of noise, the bed-to-care ratio, the proportion of nurses with greater than five years neonatal intensive care unit experience and incidence of retinopathy. The 11 neonatal intensive care unit nursing-sensitive indicators identified by the Delphi method integrated with basic Chinese practices provide a basis for nursing management and the monitoring of nursing quality. This study identified nursing-sensitive quality indicators for neonatal intensive care unit care that are suitable for current clinical practice in China. © 2016 John Wiley & Sons Ltd.

An international survey and modified Delphi process revealed editors’ perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals

PubMed Central

Galipeau, James; Cobey, Kelly D.; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants’ list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 “highly rated” competency-related statements and another 86 “included” items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future. PMID:28979768

An international survey and modified Delphi process revealed editors' perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals.

PubMed

Galipeau, James; Cobey, Kelly D; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants' list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 "highly rated" competency-related statements and another 86 "included" items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future.

Obstacles to comprehensive dental care in patients with sustained limitations of their decision-making abilities: findings from a Delphi study.

PubMed

Blaizot, Alessandra; Catteau, Céline; Delfosse, Caroline; Hamel, Olivier; Trentesaux, Thomas

2018-06-01

The objective of this study was to explore the therapeutic limitations experienced by a panel of special-care dentists in France when treating patients with sustained limitations of their decision-making abilities. We used a Delphi technique conducted in three rounds from 01 June 2014 to 30 September 2015. A first questionnaire comprising open-ended questions was addressed to 72 panellists. A content analysis of the returned questionnaires served to draft a second questionnaire comprising closed-ended questions; this was sent to the 28 panellists who responded in the first round. A third questionnaire was sent to the 20 panellists who responded in the second round to give them an opportunity to reconsider their response in the context of the second-round response group. Sixteen panellists answered the last round. A large majority agreed on the importance of providing comprehensive care, but they encountered obstacles at two time points: (i) when proposing the care; and (ii) when setting it up. The panel put forward recommendations in two main areas: (i) the training of those involved in oral health decisions; and (ii) dental care management and organization of the care system. The study provided a foundation for building future orientations in health care for patients with limited decision-making abilities. © 2018 Eur J Oral Sci.

Feasibility of multi-sector policy measures that create activity-friendly environments for children: results of a Delphi study.

PubMed

Aarts, Marie-Jeanne; Schuit, Albertine J; van de Goor, Ien Am; van Oers, Hans Am

2011-12-15

Although multi-sector policy is a promising strategy to create environments that stimulate physical activity among children, little is known about the feasibility of such a multi-sector policy approach. The aims of this study were: to identify a set of tangible (multi-sector) policy measures at the local level that address environmental characteristics related to physical activity among children; and to assess the feasibility of these measures, as perceived by local policy makers. In four Dutch municipalities, a Delphi study was conducted among local policy makers of different policy sectors (public health, sports, youth and education, spatial planning/public space, traffic and transportation, and safety). In the first Delphi round, respondents generated a list of possible policy measures addressing three environmental correlates of physical activity among children (social cohesion, accessibility of facilities, and traffic safety). In the second Delphi round, policy makers weighted different feasibility aspects (political feasibility, cultural/community acceptability, technical feasibility, cost feasibility, and legal feasibility) and assessed the feasibility of the policy measures derived from the first round. The third Delphi round was aimed at reaching consensus by feedback of group results. Finally, one overall feasibility score was calculated for each policy measure. Cultural/community acceptability, political feasibility, and cost feasibility were considered most important feasibility aspects. The Delphi studies yielded 16 feasible policy measures aimed at physical and social environmental correlates of physical activity among children. Less drastic policy measures were considered more feasible, whereas environmental policy measures were considered less feasible. This study showed that the Delphi technique can be a useful tool in reaching consensus about feasible multi-sector policy measures. The study yielded several feasible policy measures aimed at physical and social environmental correlates of physical activity among children and can assist local policy makers in designing multi-sector policies aimed at an activity-friendly environment for children.

Towards an International Classification for Patient Safety: a Delphi survey.

PubMed

Thomson, Richard; Lewalle, Pierre; Sherman, Heather; Hibbert, Peter; Runciman, William; Castro, Gerard

2009-02-01

Interpretation and comparison of patient safety information have been compromised by the lack of a common understanding of the concepts involved. The World Alliance set out to develop an International Classification for Patient Safety (ICPS) to address this, and to test the relevance and acceptability of the draft ICPS and progressively refine it prior to field testing. Two-stage Delphi survey. Quantitative and qualitative analyses informed the review of the ICPS. International web-based survey of expert opinion. Experts in the fields of patient safety, health policy, reporting systems, safety and quality control, classification theory and development, health informatics, consumer advocacy, law and medicine; 253 responded to the first round survey, 30% of whom responded to the second round. In the first round, 14% felt that the conceptual framework was missing at least one class, although it was apparent that most respondents were actually referring to concepts they felt should be included within the classes rather than the classes themselves. There was a need for clarification of several components of the classification, particularly its purpose, structure and depth. After revision and feedback, round 2 results were more positive, but further significant changes were made to the conceptual framework and to the major classes in response to concerns about terminology and relationships between classes. The Delphi approach proved invaluable, as both a consensus-building exercise and consultation process, in engaging stakeholders to support completion of the final draft version of the ICPS. Further refinement will occur.

Towards an International Classification for Patient Safety: a Delphi survey

PubMed Central

Thomson, Richard; Lewalle, Pierre; Sherman, Heather; Hibbert, Peter; Runciman, William; Castro, Gerard

2009-01-01

Objective Interpretation and comparison of patient safety information have been compromised by the lack of a common understanding of the concepts involved. The World Alliance set out to develop an International Classification for Patient Safety (ICPS) to address this, and to test the relevance and acceptability of the draft ICPS and progressively refine it prior to field testing. Design Two-stage Delphi survey. Quantitative and qualitative analyses informed the review of the ICPS. Setting International web-based survey of expert opinion. Participants Experts in the fields of patient safety, health policy, reporting systems, safety and quality control, classification theory and development, health informatics, consumer advocacy, law and medicine; 253 responded to the first round survey, 30% of whom responded to the second round. Results In the first round, 14% felt that the conceptual framework was missing at least one class, although it was apparent that most respondents were actually referring to concepts they felt should be included within the classes rather than the classes themselves. There was a need for clarification of several components of the classification, particularly its purpose, structure and depth. After revision and feedback, round 2 results were more positive, but further significant changes were made to the conceptual framework and to the major classes in response to concerns about terminology and relationships between classes. Conclusions The Delphi approach proved invaluable, as both a consensus-building exercise and consultation process, in engaging stakeholders to support completion of the final draft version of the ICPS. Further refinement will occur. PMID:19147596

International perspective on common core competencies for occupational physicians: a modified Delphi study.

PubMed

Lalloo, Drushca; Demou, Evangelia; Kiran, Sibel; Cloeren, Marianne; Mendes, René; Macdonald, Ewan B

2016-07-01

The competencies required of occupational physicians (OPs) have been the subject of peer-reviewed research in Europe and individual countries around the world. In the European Union (EU), there has been development of guidance on training and common competencies, but little research has extended beyond this. The aim of this study was to obtain consensus on and identify the common core competencies required of OPs around the world. A modified Delphi study was carried out among representative organisations and networks of OPs in a range of countries around the world. It was conducted in 2 rounds using a questionnaire based on the specialist training syllabus of a number of countries, expert panel reviews and conference discussions. Responses were received from 51 countries around the world, with the majority from Europe (60%; 59%) and North and South America (24%; 32%) in rounds 1 and 2, respectively. General principles of assessment and management of occupational hazards to health and good clinical care were jointly considered most important in ranking when compared with the other topic areas. Assessment of disability and fitness for work, communication skills and legal and ethical issues completed the top five. In both rounds, research methods and teaching and educational supervision were considered least important. This study has established the current priorities among OPs across 51 countries of the common competencies required for occupational health (OH) practice. These findings can serve as a platform for the development of common core competencies/qualifications within specific geographical regions or internationally. This is particularly pertinent with globalisation of commerce and free movement within the EU. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

The Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE): Construct and Content Validation Using a Modified Delphi Method.

PubMed

Paquette-Warren, Jann; Tyler, Marie; Fournie, Meghan; Harris, Stewart B

2017-06-01

In order to scale-up successful innovations, more evidence is needed to evaluate programs that attempt to address the rising prevalence of diabetes and the associated burdens on patients and the healthcare system. This study aimed to assess the construct and content validity of the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE), a tool developed to guide the evaluation, design and implementation with built-in knowledge translation principles. A modified Delphi method, including 3 individual rounds (questionnaire with 7-point agreement/importance Likert scales and/or open-ended questions) and 1 group round (open discussion) were conducted. Twelve experts in diabetes, research, knowledge translation, evaluation and policy from Canada (Ontario, Quebec and British Columbia) and Australia participated. Quantitative consensus criteria were an interquartile range of ≤1. Qualitative data were analyzed thematically and confirmed by participants. An importance scale was used to determine a priority multi-level indicator set. Items rated very or extremely important by 80% or more of the experts were reviewed in the final group round to build the final set. Participants reached consensus on the content and construct validity of DEFINE, including its title, overall goal, 5-step evaluation approach, medical and nonmedical determinants of health schematics, full list of indicators and associated measurement tools, priority multi-level indicator set and next steps in DEFINE's development. Validated by experts, DEFINE has the right theoretic components to evaluate comprehensively diabetes prevention and management programs and to support acquisition of evidence that could influence the knowledge translation of innovations to reduce the burden of diabetes. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Use of the Delphi process in paediatric cataract management.

PubMed

Serafino, Massimiliano; Trivedi, Rupal H; Levin, Alex V; Wilson, M Edward; Nucci, Paolo; Lambert, Scott R; Nischal, Ken K; Plager, David A; Bremond-Gignac, Dominique; Kekunnaya, Ramesh; Nishina, Sachiko; Tehrani, Nasrin N; Ventura, Marcelo C

2016-05-01

To identify areas of consensus and disagreement in the management of paediatric cataract using a modified Delphi approach among individuals recognised for publishing in this field. A modified Delphi method. International paediatric cataract experts with a publishing record in paediatric cataract management. The process consisted of three rounds of anonymous electronic questionnaires followed by a face-to-face meeting, followed by a fourth anonymous electronic questionnaire. The executive committee created questions to be used for the electronic questionnaires. Questions were designed to have unit-based, multiple choice or true-false answers. The questionnaire included issues related to the preoperative, intraoperative and postoperative management of paediatric cataract. Consensus based on 85% of panellists being in agreement for electronic questionnaires or 80% for the face-to-face meeting, and near consensus based on 70%. Sixteen of 22 invited paediatric cataract surgeons agreed to participate. We arrived at consensus or near consensus for 85/108 (78.7%) questions and non-consensus for the remaining 23 (21.3%) questions. Those questions where consensus was not reached highlight areas of either poor evidence or contradicting evidence, and may help investigators identify possible research questions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

A Screening Tool to Identify Spasticity in Need of Treatment

PubMed Central

Zorowitz, Richard D.; Wein, Theodore H.; Dunning, Kari; Deltombe, Thierry; Olver, John H.; Davé, Shashank J.; Dimyan, Michael A.; Kelemen, John; Pagan, Fernando L.; Evans, Christopher J.; Gillard, Patrick J.; Kissela, Brett M.

2017-01-01

Objective To develop a clinically useful patient-reported screening tool for health care providers to identify patients with spasticity in need of treatment regardless of etiology. Design Eleven spasticity experts participated in a modified Delphi panel and reviewed and revised 2 iterations of a screening tool designed to identify spasticity symptoms and impact on daily function and sleep. Spasticity expert panelists evaluated items pooled from existing questionnaires to gain consensus on the screening tool content. The study also included cognitive interviews of 20 patients with varying spasticity etiologies to determine if the draft screening tool was understandable and relevant to patients with spasticity. Results The Delphi panel reached an initial consensus on 21 of 47 items for the screening tool and determined that the tool should have no more than 11 to 15 items and a 1-month recall period for symptom and impact items. After 2 rounds of review, 13 items were selected and modified by the expert panelists. Most patients (n = 16 [80%]) completed the cognitive interview and interpreted the items as intended. Conclusions Through the use of a Delphi panel and patient interviews, a 13-item spasticity screening tool was developed that will be practical and easy to use in routine clinical practice. PMID:27552355

Study plan to identify long term national telecommunications need and priorities applying Delphi techniques (handbook). [technological forecasting - United States of America

NASA Technical Reports Server (NTRS)

1974-01-01

A handbook that explains the basic Delphi methodology and discusses modified Delphi techniques is presented. The selection of communications experts to participate in a study, the construction of questionnaires on potential communications developments, and requisite technology is treated. No two modified Delphi studies were the same, which reflects the flexibility and adaptability of the technique. Each study must be specifically tailored to a particular case, and consists of seeking a consensus of opinion among experts about a particular subject and attendant conditions that may prevail in the future.

Global research priorities for interpersonal violence prevention: a modified Delphi study.

PubMed

Mikton, Christopher R; Tanaka, Masako; Tomlinson, Mark; Streiner, David L; Tonmyr, Lil; Lee, Bandy X; Fisher, Jane; Hegadoren, Kathy; Pim, Joam Evans; Wang, Shr-Jie Sharlenna; MacMillan, Harriet L

2017-01-01

To establish global research priorities for interpersonal violence prevention using a systematic approach. Research priorities were identified in a three-round process involving two surveys. In round 1, 95 global experts in violence prevention proposed research questions to be ranked in round 2. Questions were collated and organized according to the four-step public health approach to violence prevention. In round 2, 280 international experts ranked the importance of research in the four steps, and the various substeps, of the public health approach. In round 3, 131 international experts ranked the importance of detailed research questions on the public health step awarded the highest priority in round 2. In round 2, "developing, implementing and evaluating interventions" was the step of the public health approach awarded the highest priority for four of the six types of violence considered (i.e. child maltreatment, intimate partner violence, armed violence and sexual violence) but not for youth violence or elder abuse. In contrast, "scaling up interventions and evaluating their cost-effectiveness" was ranked lowest for all types of violence. In round 3, research into "developing, implementing and evaluating interventions" that addressed parenting or laws to regulate the use of firearms was awarded the highest priority. The key limitations of the study were response and attrition rates among survey respondents. However, these rates were in line with similar priority-setting exercises. These findings suggest it is premature to scale up violence prevention interventions. Developing and evaluating smaller-scale interventions should be the funding priority.

Global research priorities for interpersonal violence prevention: a modified Delphi study

PubMed Central

Tanaka, Masako; Tomlinson, Mark; Streiner, David L; Tonmyr, Lil; Lee, Bandy X; Fisher, Jane; Hegadoren, Kathy; Pim, Joam Evans; Wang, Shr-Jie Sharlenna; MacMillan, Harriet L

2017-01-01

Abstract Objective To establish global research priorities for interpersonal violence prevention using a systematic approach. Methods Research priorities were identified in a three-round process involving two surveys. In round 1, 95 global experts in violence prevention proposed research questions to be ranked in round 2. Questions were collated and organized according to the four-step public health approach to violence prevention. In round 2, 280 international experts ranked the importance of research in the four steps, and the various substeps, of the public health approach. In round 3, 131 international experts ranked the importance of detailed research questions on the public health step awarded the highest priority in round 2. Findings In round 2, “developing, implementing and evaluating interventions” was the step of the public health approach awarded the highest priority for four of the six types of violence considered (i.e. child maltreatment, intimate partner violence, armed violence and sexual violence) but not for youth violence or elder abuse. In contrast, “scaling up interventions and evaluating their cost–effectiveness” was ranked lowest for all types of violence. In round 3, research into “developing, implementing and evaluating interventions” that addressed parenting or laws to regulate the use of firearms was awarded the highest priority. The key limitations of the study were response and attrition rates among survey respondents. However, these rates were in line with similar priority-setting exercises. Conclusion These findings suggest it is premature to scale up violence prevention interventions. Developing and evaluating smaller-scale interventions should be the funding priority. PMID:28053363

PIM-Check: development of an international prescription-screening checklist designed by a Delphi method for internal medicine patients.

PubMed

Desnoyer, Aude; Blanc, Anne-Laure; Pourcher, Valérie; Besson, Marie; Fonzo-Christe, Caroline; Desmeules, Jules; Perrier, Arnaud; Bonnabry, Pascal; Samer, Caroline; Guignard, Bertrand

2017-07-31

Potentially inappropriate medication (PIM) occurs frequently and is a well-known risk factor for adverse drug events, but its incidence is underestimated in internal medicine. The objective of this study was to develop an electronic prescription-screening checklist to assist residents and young healthcare professionals in PIM detection. Five-step study involving selection of medical domains, literature review and 17 semistructured interviews, a two-round Delphi survey, a forward/back-translation process and an electronic tool development. 22 University and general hospitals from Canada, Belgium, France and Switzerland. 40 physicians and 25 clinical pharmacists were involved in the study.Agreement with the checklist statements and their usefulness for healthcare professional training were evaluated using two 6-point Likert scales (ranging from 0 to 5). Agreement and usefulness ratings were defined as: >65% of the experts giving the statement a rating of 4 or 5, during the first Delphi-round and >75% during the second. 166 statements were generated during the first two steps. Mean agreement and usefulness ratings were 4.32/5 (95% CI 4.28 to 4.36) and 4.11/5 (4.07 to 4.15), respectively, during the first Delphi-round and 4.53/5 (4.51 to 4.56) and 4.36/5 (4.33 to 4.39) during the second (p<0.001). The final checklist includes 160 statements in 17 medical domains and 56 pathologies. An algorithm of approximately 31 000 lines was developed including comorbidities and medications variables to create the electronic tool. PIM-Check is the first electronic prescription-screening checklist designed to detect PIM in internal medicine. It is intended to help young healthcare professionals in their clinical practice to detect PIM, to reduce medication errors and to improve patient safety. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

PIM-Check: development of an international prescription-screening checklist designed by a Delphi method for internal medicine patients

PubMed Central

Desnoyer, Aude; Blanc, Anne-Laure; Pourcher, Valérie; Besson, Marie; Fonzo-Christe, Caroline; Desmeules, Jules; Perrier, Arnaud; Bonnabry, Pascal; Samer, Caroline; Guignard, Bertrand

2017-01-01

Objectives Potentially inappropriate medication (PIM) occurs frequently and is a well-known risk factor for adverse drug events, but its incidence is underestimated in internal medicine. The objective of this study was to develop an electronic prescription-screening checklist to assist residents and young healthcare professionals in PIM detection. Design Five-step study involving selection of medical domains, literature review and 17 semistructured interviews, a two-round Delphi survey, a forward/back-translation process and an electronic tool development. Setting 22 University and general hospitals from Canada, Belgium, France and Switzerland. Participants 40 physicians and 25 clinical pharmacists were involved in the study. Agreement with the checklist statements and their usefulness for healthcare professional training were evaluated using two 6-point Likert scales (ranging from 0 to 5). Primary and secondary outcome measures Agreement and usefulness ratings were defined as: >65% of the experts giving the statement a rating of 4 or 5, during the first Delphi-round and >75% during the second. Results 166 statements were generated during the first two steps. Mean agreement and usefulness ratings were 4.32/5 (95% CI 4.28 to 4.36) and 4.11/5 (4.07 to 4.15), respectively, during the first Delphi-round and 4.53/5 (4.51 to 4.56) and 4.36/5 (4.33 to 4.39) during the second (p<0.001). The final checklist includes 160 statements in 17 medical domains and 56 pathologies. An algorithm of approximately 31 000 lines was developed including comorbidities and medications variables to create the electronic tool. Conclusion PIM-Check is the first electronic prescription-screening checklist designed to detect PIM in internal medicine. It is intended to help young healthcare professionals in their clinical practice to detect PIM, to reduce medication errors and to improve patient safety. PMID:28760793

1988 Delphi survey of nursing research priorities for New York State.

PubMed

Shortridge, L; Doswell, W; Evans, M E; Levin, R F; Millor, G K; Carter, E

1989-09-01

In order to inform decisions about nursing research and health care policy, the Council on Nursing Research of the New York State Nurses Association (NYSNA) conducted a Delphi survey to identify the priorities for nursing research in New York state. The Delphi technique is a method of eliciting judgements from experts for the purpose of short-term forecasting and planning. The survey was conducted by mail in three rounds during 1988. Round I required participants to identify three primary research priorities for the nursing profession. In Round II participants ranked the 37 most frequently identified categories from Round I. The highest 16 categories from Round II were ranked by participants in Round III to provide the final 10 nursing research priority categories for New York state. All members of the New York State Nurses Association holding a minimum of a master's degree in nursing were invited to participate. The response rates were: Round I, 34% (N = 872); Round II, 38% (N = 985); Round III 37% (N = 974). Of the 10 nursing research priority categories identified in the final round, 5 relate to nurses, 2 relate to nursing, and 3 relate to clients. None of the high-risk conditions or populations with whom nurses work appear in the top 10, and only 2 of these are ranked in the top 15 priority categories. These priority categories will be used by the NYSNA Council on Nursing Research to influence its future agenda and activities. They can be used by the nursing profession and others for planning, policy making, and establishing nursing research funding priorities.(ABSTRACT TRUNCATED AT 250 WORDS)

Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

PubMed

Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

2014-06-25

The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our study. Based upon this consultation process, a guideline will be developed on instrument selection for outcomes to be included in a COS.

A Delphi Consensus of the Crucial Steps in Gastric Bypass and Sleeve Gastrectomy Procedures in the Netherlands.

PubMed

Kaijser, Mirjam A; van Ramshorst, Gabrielle H; Emous, Marloes; Veeger, Nic J G M; van Wagensveld, Bart A; Pierie, Jean-Pierre E N

2018-04-09

Bariatric procedures are technically complex and skill demanding. In order to standardize the procedures for research and training, a Delphi analysis was performed to reach consensus on the practice of the laparoscopic gastric bypass and sleeve gastrectomy in the Netherlands. After a pre-round identifying all possible steps from literature and expert opinion within our study group, questionnaires were send to 68 registered Dutch bariatric surgeons, with 73 steps for bypass surgery and 51 steps for sleeve gastrectomy. Statistical analysis was performed to identify steps with and without consensus. This process was repeated to reach consensus of all necessary steps. Thirty-eight participants (56%) responded in the first round and 32 participants (47%) in the second round. After the first Delphi round, 19 steps for gastric bypass (26%) and 14 for sleeve gastrectomy (27%) gained full consensus. After the second round, an additional amount of 10 and 12 sub-steps was confirmed as key steps, respectively. Thirteen steps in the gastric bypass and seven in the gastric sleeve were deemed advisable. Our expert panel showed a high level of consensus expressed in a Cronbach's alpha of 0.82 for the gastric bypass and 0.87 for the sleeve gastrectomy. The Delphi consensus defined 29 steps for gastric bypass and 26 for sleeve gastrectomy as being crucial for correct performance of these procedures to the standards of our expert panel. These results offer a clear framework for the technical execution of these procedures.

A Delphi study on research priorities for trauma nursing.

PubMed

Bayley, E W; Richmond, T; Noroian, E L; Allen, L R

1994-05-01

To identify and prioritize research questions of importance to trauma patient care and of interest to trauma nurses. A three-round Delphi technique was used to solicit, identify, and prioritize problems for trauma nursing research. In round 1, experienced trauma nurses (N = 208) generated 513 problems, which were analyzed, categorized, and collapsed into 111 items for subsequent rounds. Round 2 participants rated each research question on a 1 to 7 scale on two criteria: impact on patient welfare and value for practicing nurses. Group median scores provided by 166 round 2 respondents and respondents' individual round 2 scores were indicated on the round 3 questionnaire. Subjects rated the questions again on the same criteria and indicated whether nurses, independently or in collaboration with other health professionals, should assume responsibility for that research. Median and mean scores and rank order were determined for each item. Respondents who completed all three rounds (n = 137) had a mean of 8.3 years of trauma experience. Nine research questions ranked within the top 20 on both criteria. The two research questions that ranked highest on both criteria were: What are the most effective nursing interventions in the prevention of pulmonary and circulatory complications in trauma patients? and What are the most effective methods for preventing aspiration in trauma patients during the postoperative phase? The third-ranked question regarding patient welfare was: What psychological and lifestyle changes result from traumatic injury? Regarding value for practicing nurses, What are the most effective educational methods to prepare and maintain proficiency in trauma care providers? ranked third. These research priorities provide impetus and direction for nursing and collaborative investigation in trauma care.

Using a web-based survey tool to undertake a Delphi study: application for nurse education research.

PubMed

Gill, Fenella J; Leslie, Gavin D; Grech, Carol; Latour, Jos M

2013-11-01

The Internet is increasingly being used as a data collection medium to access research participants. This paper reports on the experience and value of using web-survey software to conduct an eDelphi study to develop Australian critical care course graduate practice standards. The eDelphi technique used involved the iterative process of administering three rounds of surveys to a national expert panel. The survey was developed online using SurveyMonkey. Panel members responded to statements using one rating scale for round one and two scales for rounds two and three. Text boxes for panel comments were provided. For each round, the SurveyMonkey's email tool was used to distribute an individualized email invitation containing the survey web link. The distribution of panel responses, individual responses and a summary of comments were emailed to panel members. Stacked bar charts representing the distribution of responses were generated using the SurveyMonkey software. Panel response rates remained greater than 85% over all rounds. An online survey provided numerous advantages over traditional survey approaches including high quality data collection, ease and speed of survey administration, direct communication with the panel and rapid collation of feedback allowing data collection to be undertaken in 12 weeks. Only minor challenges were experienced using the technology. Ethical issues, specific to using the Internet to conduct research and external hosting of web-based software, lacked formal guidance. High response rates and an increased level of data quality were achieved in this study using web-survey software and the process was efficient and user-friendly. However, when considering online survey software, it is important to match the research design with the computer capabilities of participants and recognize that ethical review guidelines and processes have not yet kept pace with online research practices. Copyright © 2013 Elsevier Ltd. All rights reserved.

Standardised method for reporting exercise programmes: protocol for a modified Delphi study.

PubMed

Slade, Susan C; Dionne, Clermont E; Underwood, Martin; Buchbinder, Rachelle

2014-12-30

Exercise is integral to health across the lifespan and important for people with chronic health conditions. A systematic review of exercise trials for chronic conditions reported suboptimal descriptions of the evaluated interventions and concluded that this hinders interpretation and replication. The aim of this project is to develop a standardised method for reporting essential exercise programme details being evaluated in clinical trials. A modified Delphi technique will be used to gain consensus among international exercise experts. We will use three sequential rounds of anonymous online questionnaires to refine a standardised checklist. A draft checklist of potentially relevant items was developed based on the results of a systematic review of exercise systematic reviews. An international panel of experts was identified by exercise systematic review authorship, established international profile in exercise research and practice and by peer referral. In round 1, the international panel of experts will be asked to rate the importance of each draft item and provide additional suggestions for revisions or new items. Consensus will be considered reached if at least 70% of the panel strongly agree/disagree that an item should be included or excluded. Where agreement is not reached or there are suggestions for altered or new items, these will be taken to round 2 together with an aggregated summary of round 1 responses. Following the second round, a ranking of item importance will be made to rationalise the number of items. The final template will be distributed to panel members for approval. Ethics approval was received from The Cabrini Institute Ethics Committee, Melbourne, Australia (HREC 02-07-04-14). We plan to use a stepwise process to develop and refine a standardised and internationally agreed template for explicit reporting of exercise programmes. The template will be generalisable across all types of exercise interventions. The findings will be disseminated through peer-reviewed publications and conference presentations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

The use of advanced web-based survey design in Delphi research.

PubMed

Helms, Christopher; Gardner, Anne; McInnes, Elizabeth

2017-12-01

A discussion of the application of metadata, paradata and embedded data in web-based survey research, using two completed Delphi surveys as examples. Metadata, paradata and embedded data use in web-based Delphi surveys has not been described in the literature. The rapid evolution and widespread use of online survey methods imply that paper-based Delphi methods will likely become obsolete. Commercially available web-based survey tools offer a convenient and affordable means of conducting Delphi research. Researchers and ethics committees may be unaware of the benefits and risks of using metadata in web-based surveys. Discussion paper. Two web-based, three-round Delphi surveys were conducted sequentially between August 2014 - January 2015 and April - May 2016. Their aims were to validate the Australian nurse practitioner metaspecialties and their respective clinical practice standards. Our discussion paper is supported by researcher experience and data obtained from conducting both web-based Delphi surveys. Researchers and ethics committees should consider the benefits and risks of metadata use in web-based survey methods. Web-based Delphi research using paradata and embedded data may introduce efficiencies that improve individual participant survey experiences and reduce attrition across iterations. Use of embedded data allows the efficient conduct of multiple simultaneous Delphi surveys across a shorter timeframe than traditional survey methods. The use of metadata, paradata and embedded data appears to improve response rates, identify bias and give possible explanation for apparent outlier responses, providing an efficient method of conducting web-based Delphi surveys. © 2017 John Wiley & Sons Ltd.

Identifying Psychological Contract Breaches to Guide Improvements in Faculty Recruitment, Retention, and Development

PubMed Central

Desselle, Shane P.; Draugalis, JoLaine R.; Spies, Alan R.; Davis, Tamra S.; Bolino, Mark

2012-01-01

Objective. To identify pharmacy faculty members’ perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. Methods. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Results. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. Conclusion. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development. PMID:22919084

Identifying psychological contract breaches to guide improvements in faculty recruitment, retention, and development.

PubMed

Peirce, Gretchen L; Desselle, Shane P; Draugalis, JoLaine R; Spies, Alan R; Davis, Tamra S; Bolino, Mark

2012-08-10

To identify pharmacy faculty members' perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development.

Establishing nursing-sensitive quality indicators for the operating room: A cross-sectional Delphi survey conducted in China.

PubMed

Wu, Qi; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-01-01

Nursing-sensitive quality indicators comprise principles, procedures, and assessments to quantify the level of nursing quality in hospital departments. Although studies have demonstrated that quality indicators are essential for monitoring nursing practice in the operating room (OR), nursing quality in China is highly subjective and localised OR nursing-sensitive quality indicators are lacking. This study aimed to establish scientific, objective and comprehensive nursing-sensitive quality indicators for the OR to evaluate and monitor OR nursing care quality in China. Literature search for relevant evidence-based studies was performed using Cochrane, Medline, PubMed, Embase, and other databases, followed by literature review and group discussion by the expert panel. Two successive rounds of Delphi surveys were conducted using questionnaires completed by the expert panel to reach consensus and define nursing-sensitive quality indicators for the OR. Two rounds of Delphi surveys each had 100% questionnaire retrieval rate, with Kendall W coordination coefficients ranging from 0.096 to 0.263 (P<0.001). In round 1 of expert evaluation of 26 indicators, Kendall's W was 0.263 for importance, 0.126 for rationality, and 0.125 for feasibility of data collection (all P<0.001). After round 2, 23 items were established as OR nursing-sensitive quality indicators, including rates of work time wastage, surgery start-time delay, OR turnover time between surgeries, same-day surgery cancellation, and number of monthly surgeries in each OR; checking surgical patients, surgery site marking, allergy history, and antibiotics use 60min before incision; and also assessing expected surgical time, sterilisation indicator results, availability of surgical instruments and materials, and instrument count. Scientific, practical, and reliable OR nursing-sensitive quality indicators can be established based on evidence-based studies and expert consensus using the Delphi method. The quality indicators developed in this study may provide an objective and quantitative reference for evaluating nursing quality in Chinese ORs. Copyright © 2016 Australian College of Critical Care Nurses Ltd. Published by Elsevier Ltd. All rights reserved.

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

A cross-validation Delphi method approach to the diagnosis and treatment of personality disorders in older adults.

PubMed

Rosowsky, Erlene; Young, Alexander S; Malloy, Mary C; van Alphen, S P J; Ellison, James M

2018-03-01

The Delphi method is a consensus-building technique using expert opinion to formulate a shared framework for understanding a topic with limited empirical support. This cross-validation study replicates one completed in the Netherlands and Belgium, and explores US experts' views on the diagnosis and treatment of older adults with personality disorders (PD). Twenty-one geriatric PD experts participated in a Delphi survey addressing diagnosis and treatment of older adults with PD. The European survey was translated and administered electronically. First-round consensus was reached for 16 out of 18 items relevant to diagnosis and specific mental health programs for personality disorders in older adults. Experts agreed on the usefulness of establishing criteria for specific types of treatments. The majority of psychologists did not initially agree on the usefulness of pharmacotherapy. Expert consensus was reached following two subsequent rounds after clarification addressing medication use. Study results suggest consensus among regarding psychosocial treatments. Limited acceptance amongst US psychologists about the suitability of pharmacotherapy for late-life PDs contrasted with the views expressed by experts surveyed in Netherlands and Belgium studies.

What Is Next for Functional Requirements for Bibliographic Records? A Delphi Study

ERIC Educational Resources Information Center

Zhang, Yin; Salaba, Athena

2009-01-01

This article reports on a Delphi study conducted to determine key issues and challenges facing Functional Requirements for Bibliographic Records (FRBR) research and practice. The Delphi panel consisted of thirty-three experts in the field who participated in a three-round issue-raising and consensus-building process via a Web-based survey…

Career and Technical Education at a Crossroads: A Delphi Study

ERIC Educational Resources Information Center

Cutright, Michael W.

2011-01-01

Career and technical education in the United States has reached a critical juncture. A three round Delphi method was used to determine a consensus on the future events of career and technical education to better inform educational decision makers. Forty-one individual experts in the field were invited to serve as panelists for the Delphi study and…

Which Behavior Change Techniques May Help Waterpipe Smokers to Quit? An Expert Consensus Using a Modified Delphi Technique.

PubMed

O'Neill, Nancy; Dogar, Omara; Jawad, Mohammed; Kellar, Ian; Kanaan, Mona; Siddiqi, Kamran

2018-01-05

Waterpipe smoking is addictive and harmful. The determinants of waterpipe smoking may differ from those of cigarette smoking; therefore, behavioral approaches to support quitting may also differ between these two tobacco products. While some evidence exists on effective behavioral change techniques (BCTs) to facilitate cigarette smoking cessation, there is little research on waterpipe smoking cessation. Twenty-four experts were selected from the author lists of peer-reviewed, randomized controlled trials on waterpipe smoking cessation. They were invited to two rounds of a consensus development exercise using modified Delphi technique. Experts ranked 55 BCTs categorized further into those that promote; "awareness of harms of waterpipe smoking and advantages of quitting" (14), "preparation and planning to quit" (29), and "relapse prevention and sustaining an ex-smoker identity" (12) on their potential effectiveness. Kendall's W statistics was used to assess agreement. Fifteen experts responded in round 1 and 14 completed both rounds. A strong consensus was achieved for BCTs that help in "relapse prevention and sustaining ex-smoker identity" (w = 0.7; p < .001) and a moderate for those that promote "awareness of harms of waterpipe smoking and advantages of quitting" (w = 0.6; p < .001) and "preparation and planning to quit" (w = 0.6; p < .001). Providing information on the consequences of waterpipe smoking and its cessation, assessing readiness and ability to quit, and making people aware of the withdrawal symptoms, were the three highest-ranking BCTs. Based on expert consensus, an inventory of BCTs ordered for their potential effectiveness can be useful for health professionals offering cessation support to waterpipe smokers. Waterpipe smoking is addictive, harmful, and gaining global popularity, particularly among youth. An expert consensus on behavior change techniques, likely to be effective in supporting waterpipe smokers to quit, has practice and research implications. Smoking cessation advisors can use these techniques to counsel waterpipe smokers who wish to quit. Behavioral and public health scientists can also use these to develop and evaluate behavioral support interventions for this client group. © The Author(s) 2016. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Nurses' Empowerment Scale for ICU patients' families: an instrument development study.

PubMed

Li, Hong; Liu, Ya-Lan; Qiu, Li; Chen, Qiao-Ling; Wu, Jing-Bing; Chen, Li-Li; Li, Na

2016-09-01

Family members provide essential support for ICU patients, contributing to their mental and physical recovery. Empowering ICU patients' families may help them overcome inadequacies and meet their own and patients' acknowledged needs. Nursing should understand and address patients' families' empowerment status. To develop a tool, the Nurses' Empowerment Scale for Intensive Care Unit (ICU) Patients' Families (NESIPF), to help ICU nursing staff assess the empowerment status of patients' families. Four-phase instrument development study. A 19-item instrument was initially generated based on literature review and interviews with family members of ICU patients. The Delphi research method was applied to gain expert opinion and consensus via rounds of questionnaires. A panel of 27 experts experienced in critical care medicine, nursing and psychology participated in two Delphi rounds and their input helped formulate an 18-item pretest instrument. Families of 20 patients were recruited to examine instrument readability. After a 2-week interval, another 20 patients' families were recruited to examine test-retest reliability. Two hundred questionnaires were then administered and analysed to examine the instrument's construct validity, criterion-related validity and internal consistency. Expert authority coefficients of two Delphi rounds reached 0·89 and 0·91. Kendall' W coefficients of 0·113 (P < 0·001) in round 1 and 0·220 (P < 0·001) in round 2 indicated slight to fair agreement among experts. Content validity index (CVI) reached 1·0 for 12 items; the CVI for item 13 was <0·7 so it was excluded. Cronbach's α coefficient was 0·92, indicating acceptable internal consistency reliability. The coefficient of internal consistency of each dimension was 0·717-0·921. The Pearson correlation coefficient >0·9 (P < 0·05) showed an acceptable test-retest reliability. The instrument has acceptable reliability and validity and can assess the empowerment status of families of critically ill patients. Knowledge of families' empowerment status may help to address their psychological needs and their ability to provide family support. © 2014 British Association of Critical Care Nurses.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology.

PubMed

King, Andrew; Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-10-25

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development.

Using a Delphi process to define priorities for prison health research in Canada.

PubMed

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-14

A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators' professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Delphi survey to identify topics to be addressed at the initial follow-up consultation after oesophageal cancer surgery.

PubMed

Jacobs, M; Henselmans, I; Macefield, R C; Blencowe, N S; Smets, E M A; de Haes, J C J M; Sprangers, M A G; Blazeby, J M; van Berge Henegouwen, M I

2014-12-01

There is no consensus among patients and healthcare professionals (HCPs) on the topics that need to be addressed after oesophageal cancer surgery. The aim of this study was to identify these topics, using a two-round Delphi survey. In round 1, patients and HCPs (surgeons, dieticians, nurses) were invited to rate the importance of 49 topics. The proportion of panellists that considered a topic to be of low, moderate or high importance was then calculated for each of these two groups. Based on these proportions and the i.q.r., topics were categorized as: 'consensus to be included', 'consensus to be excluded' and 'no consensus'. Only topics in the first category were included in the second round. In round 2, panellists were provided with individual and group feedback. To be included in the final list, topics had to meet criteria for consensus and stability. There were 108 patients and 77 HCPs in the round 2 analyses. In general, patients and HCPs considered the same topics important. The final list included 23 topics and revealed that it was most important to address: cancer removed/lymph nodes, the new oesophagus, eating and drinking, surgery, alarming new complaints and the recovery period. The study provides surgeons with a list of topics selected by patients and HCPs that may be addressed systematically at the initial follow-up consultation after oesophageal cancer surgery. © 2014 BJS Society Ltd. Published by John Wiley & Sons Ltd.

A Delphi survey on diagnosis and management of stress velopharyngeal insufficiency in wind musicians.

PubMed

Evans, Alison; Driscoll, Tim; Ackermann, Bronwen

2014-10-01

The aim of this study was to identify current trends in clinical assessment and management of stress velopharyngeal insufficiency (VPI) in wind musicians. This was an online two-round Delphi survey of health practitioners familiar with assessing and treating musicians with stress VPI. Fourteen specialists (seven otolaryngologists and seven speech-language pathologists) from four countries participated in the Delphi survey. From the first round questionnaire, 32 items were identified as being causes, assessment tools, diagnostic indicators, and treatment methods for stress VPI. The second round questionnaire revealed that prolonged exposure to high intra-oral pressures was important in determining the cause of stress VPI. The most important assessment tools for stress VPI were case history and nasendoscopy. The most important indicator for stress VPI was self-reported symptoms. There was no clear agreement identified on the management methods for stress VPI for musicians. However, the trend followed by most of the survey participants was a combination of conservative management approaches (including rest or watch and wait, speech-language pathology intervention, velopharyngeal muscle training, and changes to the instrument or reed), and then, if symptoms persist, to use injection pharyngoplasty or pharyngeal flap. This survey demonstrates that no standard management protocol currently exists for musicians diagnosed with stress VPI, but provides current trends in the assessment and management which can be used in future guidelines for health professionals who treat wind musicians.

Medication dispensing errors in Palestinian community pharmacy practice: a formal consensus using the Delphi technique.

PubMed

Shawahna, Ramzi; Haddad, Aseel; Khawaja, Baraa; Raie, Rand; Zaneen, Sireen; Edais, Tasneem

2016-10-01

Background Medication dispensing errors (MDEs) are frequent in community pharmacy practice. A definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice were not previously approached using formal consensus techniques. Objective This study was conducted to achieve consensus on a definition of MDEs and a wide range of scenarios that should or should not be considered as MDEs in Palestinian community pharmacy practice by a panel of community pharmacists. Setting Community pharmacy practice in Palestine. Method This was a descriptive study using the Delphi technique. A panel of fifty community pharmacists was recruited from different geographical locations of the West Bank of Palestine. A three round Delphi technique was followed to achieve consensus on a proposed definition of MDEs and 83 different scenarios representing potential MDEs using a nine-point scale. Main outcome measure Agreement or disagreement of a panel of community pharmacists on a proposed definition of MDEs and a series of scenarios representing potential MDEs. Results In the first Delphi round, views of key contact community pharmacists on MDEs were explored and situations representing potential MDEs were collected. In the second Delphi round, consensus was achieved to accept the proposed definition and to include 49 (59 %) of the 83 proposed scenarios as MDEs. In the third Delphi round, consensus was achieved to include further 13 (15.7 %) scenarios as MDEs, exclude 9 (10.8 %) scenarios and the rest of 12 (14.5 %) scenarios were considered equivocal based on the opinions of the panelists. Conclusion Consensus on a definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice was achieved using a formal consensus technique. The use of consensual definitions and scenarios representing MDE situations in community pharmacy practice might minimize methodological variations and their significant effects on the number and rate of MDEs reported in different studies.

Development of key indicators of hospital resilience: a modified Delphi study.

PubMed

Zhong, Shuang; Clark, Michele; Hou, Xiang-Yu; Zang, Yuli; FitzGerald, Gerard

2015-04-01

Hospital resilience is an emerging concept, which can be defined as 'a hospital's ability to resist, absorb, and respond to the shock of disasters while maintaining its critical health care functions, and then recover to its original state or adapt to a new one'. Our aim was to develop a comprehensive framework of key indicators of hospital resilience. A panel of 33 Chinese experts was invited to participate in a three-round, modified Delphi study to develop a set of potential measures previously derived from a literature review. In the first round, these potential measures were modified to cover the comprehensive domains of hospital resilience. The importance of proposed measures was scored by experts on a five-point Likert scale. Subsequently, the experts reconsidered their voting in light of the previous aggregated results. Agreement on measures was defined as at least 70% of the responders agreeing or strongly agreeing to the inclusion of a measure. A large proportion of preliminary measures (89.5%) were identified as having good potential for assessing hospital resilience. These measures were categorized into eight domains, 17 subdomains, and 43 indicators. The highest rated indicators (mean score) were: equipment for on-site rescue (4.7), plan initiation (4.6), equipment for referral of patients with complex care needs (4.5), the plan execution (4.4), medication management strategies (4.4), emergency medical treatment conditions (4.4), disaster committee (4.4), stock types and quantities for essential medications (4.4), surge capacity of emergency beds (4.4), and mass-casualty triage protocols (4.4). This framework identifies a comprehensive set of indicators of hospital resilience. It can be used for hospital assessment, as well as informing priority practices to address future disasters better. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Modified Policy-Delphi study for exploring obesity prevention priorities

PubMed Central

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-01-01

Introduction Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of ‘intrusiveness’ has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. Methods and analysis The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethics and dissemination Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. PMID:27601495

Modified Policy-Delphi study for exploring obesity prevention priorities.

PubMed

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-09-06

Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of 'intrusiveness' has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Development of the Korean framework for senior-friendly hospitals: a Delphi study.

PubMed

Kim, Yoon-Sook; Han, Seol-Heui; Hwang, Jeong-Hae; Park, Jae-Min; Lee, Jongmin; Choi, Jaekyung; Moon, Yeonsil; Kim, Hee Joung; Shin, Grace Jung Eun; Lee, Ji-Sun; Choi, Ye Ji; Uhm, Kyeong Eun; Kim, In Ae; Nam, Ji-Won

2017-08-04

Aging is an inevitable part of life. One can maintain well-being and wellness even after discharge and/or transition if his or her functional decline is minimized, sudden decline is prevented, and functioning is promoted during hospitalization. Caring appropriately for elderly patients requires the systematic application of Senior-Friendly Hospital principles to all operating systems, including medical centres' organization and environment, as well as patient treatment processes. The Senior-Friendly Hospital framework is valid and important for patient safety and quality improvement. This study aimed to make recommendations regarding the development of the Korean Framework for Senior-Friendly Hospitals for older patients' care management, patient safety interventions, and health promotion, via a Delphi survey. Two rounds of Delphi surveying were conducted with 15 participants who had at least 3 years' experience in accreditation surveying and medical accreditation standards, survey methods, and accreditation investigator education. In each round, we calculated statistics describing each standard's validity and feasibility. The Korean Framework for Senior-Friendly Hospitals included 4 Chapters, 11 categories, and 67 standards through consensus of the Senior-Friendly Hospitals task force and experts' peer review. After the two rounds of Delphi surveying, validity evaluation led to no changes in standards of the Senior-Friendly Hospitals; however, the number of standards showing adequate validity decreased from 67 to 58. Regarding feasibility, no changes were necessary in the standards; however, the number of categories showing adequate feasibility decreased from 11 to 8 and from 67 to 30, respectively. The excluded categories were 3.2, 4.2, and 4.3 (service, transportation, and signage and identification). The highest feasibility values were given to standards 2.1.1, 4.1.4, and 4.1.6. The highest feasibility score was given to standard 2.4.2. The Korean Framework for Senior-Friendly Hospitals needs to include 4 Chapters, 8 categories, and 30 standards. The Accreditation Program for Healthcare Organizations should include Senior-Friendly Hospitals -relevant standards considering Korea's medical environment.

Medication administration errors from a nursing viewpoint: a formal consensus of definition and scenarios using a Delphi technique.

PubMed

Shawahna, Ramzi; Masri, Dina; Al-Gharabeh, Rawan; Deek, Rawan; Al-Thayba, Lama; Halaweh, Masa

2016-02-01

To develop and achieve formal consensus on a definition of medication administration errors and scenarios that should or should not be considered as medication administration errors in hospitalised patient settings. Medication administration errors occur frequently in hospitalised patient settings. Currently, there is no formal consensus on a definition of medication administration errors or scenarios that should or should not be considered as medication administration errors. This was a descriptive study using Delphi technique. A panel of experts (n = 50) recruited from major hospitals, nursing schools and universities in Palestine took part in the study. Three Delphi rounds were followed to achieve consensus on a proposed definition of medication administration errors and a series of 61 scenarios representing potential medication administration error situations formulated into a questionnaire. In the first Delphi round, key contact nurses' views on medication administration errors were explored. In the second Delphi round, consensus was achieved to accept the proposed definition of medication administration errors and to include 36 (59%) scenarios and exclude 1 (1·6%) as medication administration errors. In the third Delphi round, consensus was achieved to consider further 14 (23%) and exclude 2 (3·3%) as medication administration errors while the remaining eight (13·1%) were considered equivocal. Of the 61 scenarios included in the Delphi process, experts decided to include 50 scenarios as medication administration errors, exclude three scenarios and include or exclude eight scenarios depending on the individual clinical situation. Consensus on a definition and scenarios representing medication administration errors can be achieved using formal consensus techniques. Researchers should be aware that using different definitions of medication administration errors, inclusion or exclusion of medication administration error situations could significantly affect the rate of medication administration errors reported in their studies. Consensual definitions and medication administration error situations can be used in future epidemiology studies investigating medication administration errors in hospitalised patient settings which may permit and promote direct comparisons of different studies. © 2015 John Wiley & Sons Ltd.

Mapping the Demand for Serious Games in Postgraduate Medical Education Using the Entrustable Professional Activities Framework.

PubMed

Graafland, Maurits; Ten Cate, Olle; van Seventer, Jan-Pieter; Schraagen, Jan Maarten C; Schijven, Marlies P

2015-10-01

Serious games are potentially powerful tools for residency training and increasingly attract attention from medical educators. At present, serious games have little evidence-based relations with competency-based medical education, which may impede their incorporation into residency training programs. The aim of this study was to identify highly valued entrustable professional activities (EPAs) to support designers in the development of new, serious games built on a valid needs-assessment. All 149 licensed medical specialists from seven specialties in one academic hospital participated in seven different Delphi expert panels. They filled out a two-round Delphi survey, aimed at identifying the most valuable EPAs in their respective curricula. Specialists were asked to name the most highly valued EPA in their area in the first Delphi round. In the second round, the generated responses were presented and ranked according to priority by the medical specialists. Sixty-two EPAs were identified as valuable training subjects throughout five specialties. Eleven EPAs--"management of trauma patient," "chest tube placement," "laparoscopic cholecystectomy," "assessment of vital signs," "airway management," "induction of general anesthesia," "assessment of suicidal patient," "psychiatric assessment," "gastroscopy," "colonoscopy," and "resuscitation of emergency patients"--were consistently given a high score. The future medical specialist is an active learner, comfortable with digital techniques and learning strategies such as serious gaming. In order to maximize the impact and acceptance of new serious games, it is vital to select the most relevant training subjects. Although some serious games have already targeted top-priority EPAs, plenty of opportunities remain.

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

PubMed

Bank, Ilana; Cheng, Adam; McLeod, Peter; Bhanji, Farhan

2015-11-01

By the end of residency training, pediatric emergency medicine (PEM) residents are expected to have developed the confidence and abilities required to manage acutely ill children. Acquisition of competence requires exposure and/or supplemental formal education for critical and noncritical medical clinical presentations. Simulation can provide experiential learning and can improve trainees' knowledge, skills, and attitudes. The primary objective of this project was to identify the content for a simulation-based national curriculum for PEM training. We recruited participants for the Delphi study by contacting current PEM program directors and immediate past program directors as well as simulation experts at all of the Canadian PEM fellowship sites. We determined the appropriate core content for the Delphi study by combining the PEM core content requirements of the Royal College of Physicians and Surgeons of Canada (RCPSC) and the American Board of Pediatrics (ABP). Using the Delphi method, we achieved consensus amongst the national group of PEM and simulation experts. The participants completed a three-round Delphi (using a four-point Likert scale). Response rates for the Delphi were 85% for the first round and 77% for second and third rounds. From the initial 224 topics, 53 were eliminated (scored <2). Eighty-five topics scored between 2 and 3, and 87 scored between 3 and 4. The 48 topics, which were scored between 3.5 and 4.0, were labeled as "key curriculum topics." We have iteratively identified a consensus for the content of a national simulation-based curriculum.

Follow-up intervals in patients with Cushing's disease: recommendations from a panel of experienced pituitary clinicians.

PubMed

Geer, Eliza B; Ayala, Alejandro; Bonert, Vivien; Carmichael, John D; Gordon, Murray B; Katznelson, Laurence; Manuylova, Ekaterina; Shafiq, Ismat; Surampudi, Vijaya; Swerdloff, Ronald S; Broder, Michael S; Cherepanov, Dasha; Eagan, Marianne; Lee, Jackie; Said, Qayyim; Neary, Maureen P; Biller, Beverly M K

2017-08-01

Follow-up guidelines are needed to assess quality of care and to ensure best long-term outcomes for patients with Cushing's disease (CD). The purpose of this study was to assess agreement by experts on recommended follow-up intervals for CD patients at different phases in their treatment course. The RAND/UCLA modified Delphi process was used to assess expert consensus. Eleven clinicians who regularly manage CD patients rated 79 hypothetical patient scenarios before and after ("second round") an in-person panel discussion to clarify definitions. Scenarios described CD patients at various time points after treatment. For each scenario, panelists recommended follow-up intervals in weeks. Panel consensus was assigned as follows: "agreement" if no more than two responses were outside a 2 week window around the median response; "disagreement" if more than two responses were outside a 2 week window around the median response. Recommendations were developed based on second round results. Panel agreement was 65.9% before and 88.6% after the in-person discussion. The panel recommended follow-up within 8 weeks for patients in remission on glucocorticoid replacement and within 1 year of surgery; within 4 weeks for patients with uncontrolled persistent or recurrent disease; within 8-24 weeks in post-radiotherapy patients controlled on medical therapy; and within 24 weeks in asymptomatic patients with stable plasma ACTH concentrations after bilateral adrenalectomy. With a high level of consensus using the Delphi process, panelists recommended regular follow-up in most patient scenarios for this chronic condition. These recommendations may be useful for assessment of CD care both in research and clinical practice.

Standards for UNiversal reporting of patient Decision Aid Evaluation studies: the development of SUNDAE Checklist.

PubMed

Sepucha, Karen R; Abhyankar, Purva; Hoffman, Aubri S; Bekker, Hilary L; LeBlanc, Annie; Levin, Carrie A; Ropka, Mary; Shaffer, Victoria A; Sheridan, Stacey L; Stacey, Dawn; Stalmeier, Peep; Vo, Ha; Wills, Celia E; Thomson, Richard

2018-05-01

Patient decision aids (PDAs) are evidence-based tools designed to help patients make specific and deliberated choices among healthcare options. The International Patient Decision Aid Standards (IPDAS) Collaboration review papers and Cochrane systematic review of PDAs have found significant gaps in the reporting of evaluations of PDAs, including poor or limited reporting of PDA content, development methods and delivery. This study sought to develop and reach consensus on reporting guidelines to improve the quality of publications evaluating PDAs. An international workgroup, consisting of members from IPDAS Collaboration, followed established methods to develop reporting guidelines for PDA evaluation studies. This paper describes the results from three completed phases: (1) planning, (2) drafting and (3) consensus, which included a modified, two-stage, online international Delphi process. The work was conducted over 2 years with bimonthly conference calls and three in-person meetings. The workgroup used input from these phases to produce a final set of recommended items in the form of a checklist. The SUNDAE Checklist (Standards for UNiversal reporting of patient Decision Aid Evaluations) includes 26 items recommended for studies reporting evaluations of PDAs. In the two-stage Delphi process, 117/143 (82%) experts from 14 countries completed round 1 and 96/117 (82%) completed round 2. Respondents reached a high level of consensus on the importance of the items and indicated strong willingness to use the items when reporting PDA studies. The SUNDAE Checklist will help ensure that reports of PDA evaluation studies are understandable, transparent and of high quality. A separate Explanation and Elaboration publication provides additional details to support use of the checklist. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Evaluation of the Walking Index for Spinal Cord Injury II (WISCI-II) in children with Spinal Cord Injury (SCI).

PubMed

Calhoun Thielen, C; Sadowsky, C; Vogel, L C; Taylor, H; Davidson, L; Bultman, J; Gaughan, J; Mulcahey, M J

2017-05-01

Mixed methods were used in this study. The appropriateness of the levels of the Walking Index for Spinal Cord Injury II (WISCI-II) for application in children was critically reviewed by physical therapists using the Modified Delphi Technique, and the inter- and intra-rater reliability of the WISCI-II in children was evaluated. To examine the construct validity, and to establish reliability of the WISCI-II related to its use in children with spinal cord injury (SCI). United States of America. Using a Modified Delphi Technique, physical therapists critically reviewed the WISCI-II levels for pediatric utilization. Concurrently, ambulatory children under age 18 years with SCI were evaluated using the WISCI-II on two occasions by the same therapist to establish intra-rater reliability. One trial was photographed and de-identified. Each photograph was reviewed by four different physical therapists who gave WISCI-II scores to establish inter-rater reliability. Summary and descriptive statistics were used to calculate the frequency of yes/no responses for each WISCI-II level question and to determine the percent agreement for each question. Inter- and intra-rater reliability was calculated using interclass correlation coefficients (ICCs) with 95% confidence intervals (CI). Construct validity was confirmed after one Delphi round during which at least 80% agreement was established by 51 physical therapists on the appropriateness of the WISCI-II levels for children. Fifty-two children with SCI aged 2-17 years completed repeated WISCI-II assessments and 40 de-identified photographs were scored by four physical therapists. Intra- and inter-rater reliability was high (ICC=0.997, CI=0.995-0.998 and ICC=0.97, CI=0.95-0.98, respectively). This study demonstrates support for the use of the WISCI-II in ambulatory children with SCI. This study was funded by the Craig H Neilsen Foundation, Spinal Cord Injury Research on the Translation Spectrum, Senior Research Award #282592 (Mulcahey, PI).

Constructing post-surgical discharge instructions through a Delphi consensus methodology.

PubMed

Scott, Aaron R; Sanderson, Cody J; Rush, Augustus J; Alore, Elizabeth A; Naik, Aanand D; Berger, David H; Suliburk, James W

2018-05-01

Patient education materials are a crucial part of physician-patient communication. We hypothesize that available discharge instructions are difficult to read and fail to address necessary topics. Our objective is to evaluate readability and content of surgical discharge instructions using thyroidectomy to develop standardized discharge materials. Thyroidectomy discharge materials were analyzed for readability and assessed for content. Fifteen endocrine surgeons participated in a modified Delphi consensus panel to select necessary topics. Using readability best practices, we created standardized discharge instructions which included all selected topics. The panel evaluated 40 topics, selected 23, deemed 4 inappropriate, consolidated 5, and did not reach consensus on 8 topics after 4 rounds. The evaluated instructions' reading levels ranged from grade 6.5 to 13.2; none contained all consensus topics. Current post surgical thyroidectomy discharge instructions are more difficult to read than recommended by literacy standards and omit consensus warning signs of major complications. Our easy-to-read discharge instructions cover pertinent topics and may enhance patient education. Delphi methodology is useful for developing post-surgical instructions. Patient education materials need appropriate readability levels and content. We recommend the Delphi method to select content using consensus expert opinion whenever higher level data is lacking. Copyright © 2017 Elsevier B.V. All rights reserved.

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

What do we mean by "socialization to the model"? A Delphi study.

PubMed

Roos, Jo; Wearden, Alison

2009-05-01

The term "socialization to the model" is frequently used in the Cognitive Behavioural Therapy (CBT) literature, but it is unclear exactly what constitutes socialization to the model and there is a paucity of research in this area. This study aimed to develop a working definition of "socialization to the model". A three-round electronic Delphi technique was used to generate data and to achieve a consensus agreement amongst a panel of experts (N = 9) in response to two questions pertaining to what constitutes "socialization to the model". All elements generated in response to the primary question at the first round were retained throughout and scored an IQR of

Consensus-based cross-European recommendations for the identification, measurement and valuation of costs in health economic evaluations: a European Delphi study.

PubMed

van Lier, Lisanne I; Bosmans, Judith E; van Hout, Hein P J; Mokkink, Lidwine B; van den Hout, Wilbert B; de Wit, G Ardine; Dirksen, Carmen D; Nies, Henk L G R; Hertogh, Cees M P M; van der Roest, Henriëtte G

2017-12-19

Differences between country-specific guidelines for economic evaluations complicate the execution of international economic evaluations. The aim of this study was to develop cross-European recommendations for the identification, measurement and valuation of resource use and lost productivity in economic evaluations using a Delphi procedure. A comprehensive literature search was conducted to identify European guidelines on the execution of economic evaluations or costing studies as part of economic evaluations. Guideline recommendations were extracted by two independent reviewers and formed the basis for the first round of the Delphi study, which was conducted among European health economic experts. During three written rounds, consensus (agreement of 67% or higher) was sought on items concerning the identification, measurement and valuation of costs. Recommendations from 18 guidelines were extracted. Consensus among 26 panellists from 17 European countries was reached on 61 of 68 items. The recommendations from the Delphi study are to adopt a societal perspective, to use patient report for measuring resource use and lost productivity, to value both constructs with use of country-specific standardized/unit costs and to use country-specific discounting rates. This study provides consensus-based cross-European recommendations on how to measure and value resource use and lost productivity in economic evaluations. These recommendations are expected to support researchers, healthcare professionals, and policymakers in executing and appraising economic evaluations performed in international contexts.

A process for developing standards to promote quality in general practice.

PubMed

Khoury, Julie; Krejany, Catherine J; Versteeg, Roald W; Lodewyckx, Michaela A; Pike, Simone R; Civil, Michael S; Jiwa, Moyez

2018-06-02

Since 1991, the Royal Australian College of General Practitioners' (RACGP) Standards for General Practices (the Standards) have provided a framework for quality care, risk management and best practice in the operation of Australian general practices. The Standards are also linked to incentives for general practice remuneration. These Standards were revised in 2017. The objective of this study is to describe the process undertaken to develop the fifth edition Standards published in 2017 to inform future standards development both nationally and internationally. A modified Delphi process was deployed to develop the fifth edition Standards. Development was directed by the RACGP and led by an expert panel of GPs and representatives of stakeholder groups who were assisted and facilitated by a team from RACGP. Each draft was released for stakeholder feedback and tested twice before the final version was submitted for approval by the RACGP board. Four rounds of consultation and two rounds of piloting were carried out over 32 months. The Standards were redrafted after each round. One hundred and fifty-two individuals and 225 stakeholder groups participated in the development of the Standards. Twenty-three new indicators were recommended and grouped into three sections in a new modular structure that was different from the previous edition. The Standards represent the consensus view of national stakeholders on the indicators of quality and safety in Australian general practice and primary care.

Acne severity grading: determining essential clinical components and features using a Delphi consensus.

PubMed

Tan, Jerry; Wolfe, Barat; Weiss, Jonathan; Stein-Gold, Linda; Bikowski, Joseph; Del Rosso, James; Webster, Guy F; Lucky, Anne; Thiboutot, Diane; Wilkin, Jonathan; Leyden, James; Chren, Mary-Margaret

2012-08-01

There are multiple global scales for acne severity grading but no singular standard. Our objective was to determine the essential clinical components (content items) and features (property-related items) for an acne global grading scale for use in research and clinical practice using an iterative method, the Delphi process. Ten acne experts were invited to participate in a Web-based Delphi survey comprising 3 iterative rounds of questions. In round 1, the experts identified the following clinical components (primary acne lesions, number of lesions, extent, regional involvement, secondary lesions, and patient experiences) and features (clinimetric properties, ease of use, categorization of severity based on photographs or text, and acceptance by all stakeholders). In round 2, consensus for inclusion in the scale was established for primary lesions, number, sites, and extent; as well as clinimetric properties and ease of use. In round 3, consensus for inclusion was further established for categorization and acceptance. Patient experiences were excluded and no consensus was achieved for secondary lesions. The Delphi panel consisted solely of the United States (U.S.)-based acne experts. Using an established method for achieving consensus, experts in acne vulgaris concluded that an ideal acne global grading scale would comprise the essential clinical components of primary acne lesions, their quantity, extent, and facial and extrafacial sites of involvement; with features of clinimetric properties, categorization, efficiency, and acceptance. Copyright © 2011 American Academy of Dermatology, Inc. Published by Mosby, Inc. All rights reserved.

Competency model for dentists in China: Results of a Delphi study

PubMed Central

Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

Objective With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Methods Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Results Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. Conclusion In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China. PMID:29566048

Competency model for dentists in China: Results of a Delphi study.

PubMed

Geng, Yunxia; Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China.

The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study.

PubMed

Gagliardi, Diana; Rondinone, Bruna M; Mirabile, Marco; Buresti, Giuliana; Ellwood, Peter; Hery, Michel; Paszkiewicz, Peter; Valenti, Antonio; Iavicoli, Sergio

2017-06-23

This study, developed within the frame of the Partnership for European Research on Occupational Safety and Health joint research activities and based on the frame designed by the 2013 European Agency for Safety and Health at Work (EU-OSHA) study, is the first example of using the points of view of European occupational safety and health (OSH) researchers.The objective is to identify priorities for OSH research that may contribute to the achievement of present and future sustainable growth objectives set by the European strategies. The study was carried out using a modified Delphi method with a two-round survey. Each round involved a panel of about 110 researchers representing the network member institutes was selected according to specific criteria, including the ownership of research expertise in at least one of the four macroareas identified by the reference report developed by EU-OSHA in 2013. The study identified some innovative research topics (for example, 'Emerging technological devices' and 'OSH consequences of markets integration') and research priorities (ie, crowdsourcing, e-work, zero-hours contract s ) that are not reflected in previous studies of this nature.The absence of any reference to violence and harassment at work among the researchers' proposals is a major difference from previous similar studies, while topics related to gender issues and electromagnetic fields show a lower importance. The innovative design of a research priorities identification process, which takes advantage of a large, representative and qualified panel of European researchers allowed the definition of a number of research priorities able to support the inclusion of innovative OSH research issues in the scope of the next European research agenda. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

An examination of the research priorities for a hospice service in New Zealand: A Delphi study.

PubMed

de Vries, Kay; Walton, Jo; Nelson, Katherine; Knox, Rhondda

2016-06-01

Palliative care research is relatively diverse and prioritizing research in this field is dependent on multiple factors such as complex ethical decisions in designing and conducting the research; access to participants who may be deemed "vulnerable" and an increasingly medically focused approach to care. The aim of this study was to inform organizational decision-making and policy development regarding future research priorities for a hospice service in New Zealand. A modified three-round Delphi technique was employed. Participants were drawn from one dedicated specialist palliative care service that delivers care in the community, day-care, hospice inpatient, aged residential care, and acute hospital palliative care service. A purposive sample included palliative care staff (n = 10, 18, 9, for rounds 1-3, respectively) volunteers (n = 10, 12, 11); and patients and family carers (n = 6, 8, for rounds 1 and 2). Patients and family carers were not involved in the third round. At final ranking of six research themes encompassing 23 research topics were identified by staff and volunteers. These were: symptom management; aged care; education; community; patient and family; and bereavement support and young people. Patients and family carers agreed on four themes, made up of 10 research topics. These were: decision-making, bereavement and loss, symptom management; and recognition of need and response of service. The study generated a rich set of research themes and specific research topics. The perspectives of staff and volunteers are significantly different from those of patients and family members, in spite of the recognition by all concerned that palliative care services work within a philosophy of patient-centered care. Open discussion of ideas has the potential to engage both staff and patients and carers in quality improvement initiatives, and to reinforce the value of research for patient care.

Management of Helicobacter pylori infection in Latin America: A Delphi technique-based consensus

PubMed Central

Rollan, Antonio; Arab, Juan Pablo; Camargo, M Constanza; Candia, Roberto; Harris, Paul; Ferreccio, Catterina; Rabkin, Charles S; Gana, Juan Cristóbal; Cortés, Pablo; Herrero, Rolando; Durán, Luisa; García, Apolinaria; Toledo, Claudio; Espino, Alberto; Lustig, Nicole; Sarfatis, Alberto; Figueroa, Catalina; Torres, Javier; Riquelme, Arnoldo

2014-01-01

AIM: To optimize diagnosis and treatment guidelines for this geographic region, a panel of gastroenterologists, epidemiologists, and basic scientists carried out a structured evaluation of available literature. METHODS: Relevant questions were distributed among the experts, who generated draft statements for consideration by the entire panel. A modified three-round Delphi technique method was used to reach consensus. Critical input was also obtained from representatives of the concerned medical community. The quality of the evidence and level of recommendation supporting each statement was graded according to United States Preventive Services Task Force criteria. RESULTS: A group of ten experts was established. The survey included 15 open-ended questions that were distributed among the experts, who assessed the articles associated with each question. The levels of agreement achieved by the panel were 50% in the first round, 73.3% in the second round and 100% in the third round. Main consensus recommendations included: (1) when available, urea breath and stool antigen test (HpSA) should be used for non-invasive diagnosis; (2) detect and eradicate Helicobacter pylori (H. pylori) in all gastroscopy patients to decrease risk of peptic ulcer disease, prevent o retard progression in patients with preneoplastic lesions, and to prevent recurrence in patients treated for gastric cancer; (3) further investigate implementation issues and health outcomes of H. pylori eradication for primary prevention of gastric cancer in high-risk populations; (4) prescribe standard 14-d triple therapy or sequential therapy for first-line treatment; (5) routinely assess eradication success post-treatment in clinical settings; and (6) select second- and third-line therapies according to antibiotic susceptibility testing. CONCLUSION: These achievable steps toward better region-specific management can be expected to improve clinical health outcomes. PMID:25152601

Development of a core outcome set for effectiveness trials aimed at optimising prescribing in older adults in care homes.

PubMed

Millar, Anna N; Daffu-O'Reilly, Amrit; Hughes, Carmel M; Alldred, David P; Barton, Garry; Bond, Christine M; Desborough, James A; Myint, Phyo K; Holland, Richard; Poland, Fiona M; Wright, David

2017-04-12

Prescribing medicines for older adults in care homes is known to be sub-optimal. Whilst trials testing interventions to optimise prescribing in this setting have been published, heterogeneity in outcome reporting has hindered comparison of interventions, thus limiting evidence synthesis. The aim of this study was to develop a core outcome set (COS), a list of outcomes which should be measured and reported, as a minimum, for all effectiveness trials involving optimising prescribing in care homes. The COS was developed as part of the Care Homes Independent Pharmacist Prescribing Study (CHIPPS). A long-list of outcomes was identified through a review of published literature and stakeholder input. Outcomes were reviewed and refined prior to entering a two-round online Delphi exercise and then distributed via a web link to the CHIPPS Management Team, a multidisciplinary team including pharmacists, doctors and Patient Public Involvement representatives (amongst others), who comprised the Delphi panel. The Delphi panellists (n = 19) rated the importance of outcomes on a 9-point Likert scale from 1 (not important) to 9 (critically important). Consensus for an outcome being included in the COS was defined as ≥70% participants scoring 7-9 and <15% scoring 1-3. Exclusion was defined as ≥70% scoring 1-3 and <15% 7-9. Individual and group scores were fed back to participants alongside the second questionnaire round, which included outcomes for which no consensus had been achieved. A long-list of 63 potential outcomes was identified. Refinement of this long-list of outcomes resulted in 29 outcomes, which were included in the Delphi questionnaire (round 1). Following both rounds of the Delphi exercise, 13 outcomes (organised into seven overarching domains: medication appropriateness, adverse drug events, prescribing errors, falls, quality of life, all-cause mortality and admissions to hospital (and associated costs)) met the criteria for inclusion in the final COS. We have developed a COS for effectiveness trials aimed at optimising prescribing in older adults in care homes using robust methodology. Widespread adoption of this COS will facilitate evidence synthesis between trials. Future work should focus on evaluating appropriate tools for these key outcomes to further reduce heterogeneity in outcome measurement in this context.

Corruption and oil exploration: expert agreement about the prevention of HIV/AIDS in the Niger Delta of Nigeria.

PubMed

Udoh, Isidore A; Stammen, Ronald M; Mantell, Joanne E

2008-08-01

The Niger Delta, according to the Nigerian Ministry of Health, has a disproportionately high HIV infection rate, which is double the national average. The United Nations Development Program attributes the spiraling HIV infection rate in the region to poverty, migration and gender inequality. This paper examines two complementary suppositions: Is the high prevalence of HIV in the Niger Delta related to incompetent leadership and corruption? Is it related to the negative effects of oil exploration in the region? Currently, there is a dearth of research on the effectiveness of government programs or the role of the oil industry on the impact of AIDS in Nigeria. To address this gap, we conducted a survey with 27 internationally renowned experts from diverse disciplines using a three-round modified Delphi to formulate consensus about the impact of weak governance and oil corruption on AIDS in the Niger Delta. Results from the Delphi suggest that these factors and others have exacerbated the transmission of HIV in the region. To mitigate the impact of AIDS in the region, efforts to engage oil companies in implementing HIV prevention programs as part of their corporate environmental responsibility to the community are urgently needed.

Priorities for research in child maltreatment, intimate partner violence and resilience to violence exposures: results of an international Delphi consensus development process.

PubMed

Wathen, C Nadine; MacGregor, Jennifer C D; Hammerton, Joanne; Coben, Jeffrey H; Herrman, Helen; Stewart, Donna E; MacMillan, Harriet L

2012-08-21

Intimate partner violence (IPV) and child maltreatment (CM) are major global public health problems. The Preventing Violence Across the Lifespan (PreVAiL) Research Network, an international group of over 60 researchers and national and international knowledge-user partners in CM and IPV, sought to identify evidence-based research priorities in IPV and CM, with a focus on resilience, using a modified Delphi consensus development process. Review of existing empirical evidence, PreVAiL documents and team discussion identified a starting list of 20 priorities in the following categories: resilience to violence exposure (RES), CM, and IPV, as well as priorities that cross-cut the content areas (CC), and others specific to research methodologies (RM) in violence research. PreVAiL members (N = 47) completed two online survey rounds, and one round of discussions via three teleconference calls to rate, rank and refine research priorities. Research priorities were: to examine key elements of promising or successful programmes in RES/CM/IPV to build intervention pilot work; CC: to integrate violence questions into national and international surveys, and RM: to investigate methods for collecting and collating datasets to link data and to conduct pooled, meta and sub-group analyses to identify promising interventions for particular groups. These evidence-based research priorities, developed by an international team of violence, gender and mental health researchers and knowledge-user partners, are of relevance for prevention and resilience-oriented research in the areas of IPV and CM.

[A Delphi Method Survey of the Core Competences of Post-Acute-Care Nurses in Caring for Acute Stroke Patients].

PubMed

Chi, Shu-Ching; Yeh, Lily; Lu, Meei-Shiow; Lin, Pei-Yu

2015-12-01

Post-acute care (PAC) service is becoming increasingly important in Taiwan as a core focus of government policies that are designed to ensure continuity of care. In order to improve PAC nursing education and quality of care, the present study applies a modified Delphi method to identify the core competences of nurses who provide PAC services to acute stroke patients. We surveyed 18 experts in post-acute care and long-term care anonymously using a 29-question questionnaire in order to identify the essential professional skills that are required to perform PAC effectively. The results of this survey indicate that the core competences of PAC may be divided into two categories: Case Management and Care Management. Case Management includes Direct Care, Communication, Health Care Education, Nursing Consulting, and Family Assessment & Health Care. Care Management includes Interdisciplinary Teamwork, Patient Care Management, and Resource Integration. The importance and practicality of each item was evaluated using a 7-point Likert scale. The experts required 2 rounds to reach a consensus about the importance and 3 rounds to determine the practicality of PAC core competences. This process highlighted the differing points of view that are held by professionals in the realms of nursing, medicine, and national health policy. The PAC in-job training program in its current form inadequately cul-tivates core competence in Care Management. The results of the present study may be used to inform the development of PAC nurse orientation training programs and continuing education courses.

Priorities for research in child maltreatment, intimate partner violence and resilience to violence exposures: results of an international Delphi consensus development process

PubMed Central

2012-01-01

Background Intimate partner violence (IPV) and child maltreatment (CM) are major global public health problems. The Preventing Violence Across the Lifespan (PreVAiL) Research Network, an international group of over 60 researchers and national and international knowledge-user partners in CM and IPV, sought to identify evidence-based research priorities in IPV and CM, with a focus on resilience, using a modified Delphi consensus development process. Methods Review of existing empirical evidence, PreVAiL documents and team discussion identified a starting list of 20 priorities in the following categories: resilience to violence exposure (RES), CM, and IPV, as well as priorities that cross-cut the content areas (CC), and others specific to research methodologies (RM) in violence research. PreVAiL members (N = 47) completed two online survey rounds, and one round of discussions via three teleconference calls to rate, rank and refine research priorities. Results Research priorities were: to examine key elements of promising or successful programmes in RES/CM/IPV to build intervention pilot work; CC: to integrate violence questions into national and international surveys, and RM: to investigate methods for collecting and collating datasets to link data and to conduct pooled, meta and sub-group analyses to identify promising interventions for particular groups. Conclusions These evidence-based research priorities, developed by an international team of violence, gender and mental health researchers and knowledge-user partners, are of relevance for prevention and resilience-oriented research in the areas of IPV and CM. PMID:22908894

Competencies for Student Leadership Development in Doctor of Pharmacy Curricula to Assist Curriculum Committees and Leadership Instructors

PubMed Central

Traynor, Andrew P.; Boyle, Cynthia J.

2013-01-01

Objective. To assist curriculum committees and leadership instructors by gathering expert opinion to define student leadership development competencies for pharmacy curricula. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define competencies for student leadership development in pharmacy curricula. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes. Round 2 grouped responses for agreement rating and comment. Round 3 allowed rating and comment on competencies not yet meeting consensus, which was prospectively set at 80%. Results. Eleven competencies attained 80% consensus or higher and were grouped into 3 areas: leadership knowledge, personal leadership commitment, and leadership skill development. Connections to contemporary leadership development literature were outlined for each competency as a means of verifying the panel’s work. Conclusions. The leadership competencies will aid students in addressing: What is leadership? Who am I as a leader? What skills and abilities do I need to be effective? The competencies will help curriculum committees and leadership instructors to focus leadership development opportunities, identify learning assessments, and define program evaluation. PMID:24371346

Competencies for student leadership development in doctor of pharmacy curricula to assist curriculum committees and leadership instructors.

PubMed

Janke, Kristin K; Traynor, Andrew P; Boyle, Cynthia J

2013-12-16

To assist curriculum committees and leadership instructors by gathering expert opinion to define student leadership development competencies for pharmacy curricula. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define competencies for student leadership development in pharmacy curricula. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes. Round 2 grouped responses for agreement rating and comment. Round 3 allowed rating and comment on competencies not yet meeting consensus, which was prospectively set at 80%. Eleven competencies attained 80% consensus or higher and were grouped into 3 areas: leadership knowledge, personal leadership commitment, and leadership skill development. Connections to contemporary leadership development literature were outlined for each competency as a means of verifying the panel's work. The leadership competencies will aid students in addressing: What is leadership? Who am I as a leader? What skills and abilities do I need to be effective? The competencies will help curriculum committees and leadership instructors to focus leadership development opportunities, identify learning assessments, and define program evaluation.

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study.

PubMed

Blackwood, Bronagh; Ringrow, Suzanne; Clarke, Mike; Marshall, John; Rose, Louise; Williamson, Paula; McAuley, Danny

2015-08-20

Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children. We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes. The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

Return to play criteria after hamstring muscle injury in professional football: a Delphi consensus study.

PubMed

Zambaldi, Mattia; Beasley, Ian; Rushton, Alison

2017-08-01

Hamstring muscle injury (HMI) is the most common injury in professional football and has a high re-injury rate. Despite this, there are no validated criteria to support return to play (RTP) decisions. To use the Delphi method to reach expert consensus on RTP criteria after HMI in professional football. All professional football clubs in England (n=92) were invited to participate in a 3-round Delphi study. Round 1 requested a list of criteria used for RTP decisions after HMI. Responses were independently collated by 2 researchers under univocal definitions of RTP criteria. In round 2 participants rated their agreement for each RTP criterion on a 1-5 Likert Scale. In round 3 participants re-rated the criteria that had reached consensus in round 2. Descriptive statistics and Kendall's coefficient of concordance enabled interpretation of consensus. Participation rate was limited at 21.7% (n=20), while retention rate was high throughout the 3 rounds (90.0%, 85.0%, 90.0%). Round 1 identified 108 entries with varying definitions that were collated into a list of 14 RTP criteria. Rounds 2 and 3 identified 13 and 12 criteria reaching consensus, respectively. Five domains of RTP assessment were identified: functional performance, strength, flexibility, pain and player's confidence. The highest-rated criteria were in the functional performance domain, with particular importance given to sprint ability. This study defined a list of consensually agreed RTP criteria for HMI in professional football. Further work is now required to determine the validity of the identified criteria. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

TCM Pattern Questionnaire for Lateral Elbow Pain: Development of an Instrument via a Delphi Process

PubMed Central

Bian, Zhao-Xiang

2016-01-01

Individualized acupuncture treatment has been practiced for pain therapy. This study used acupuncture treatment for lateral elbow pain (LEP) as an example to study the diagnostic practice of individualized acupuncture treatment. A provisional version of LEP pattern questionnaire was developed based on a recent systematic review on TCM pattern diagnosis for LEP. A Delphi panel of 33 clinical experts from seven different countries was formed, and the Delphi survey was conducted in Chinese and English language for two rounds. Consensus was achieved from all 26 panelists who responded to the second round on 243 items of the instrument, which included a 72-question-long questionnaire. The mean level of expert consensus on the items of the final questionnaire was 85%. Consensus was found on four TCM patterns that could underlie LEP, namely, the wind-cold-dampness pattern, the qi stagnation and blood stasis pattern, the dual deficiency of qi and blood pattern, and the retained dampness-heat pattern. A list of signs and symptoms indicating one of the four TCM patterns and a list of preferred treatment modalities for each pattern were also generated. Our instrument shows considerable content validity. Further validity and reliability studies are under way. PMID:27525024

Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure

PubMed Central

2013-01-01

Background The quantity and quality of studies in child and adolescent physical activity and sedentary behaviour have rapidly increased, but research directions are often pursued in a reactive and uncoordinated manner. Aim To arrive at an international consensus on research priorities in the area of child and adolescent physical activity and sedentary behaviour. Methods Two independent panels, each consisting of 12 experts, undertook three rounds of a Delphi methodology. The Delphi methodology required experts to anonymously answer questions put forward by the researchers with feedback provided between each round. Results The primary outcome of the study was a ranked set of 29 research priorities that aimed to be applicable for the next 10 years. The top three ranked priorities were: developing effective and sustainable interventions to increase children’s physical activity long-term; policy and/or environmental change and their influence on children’s physical activity and sedentary behaviour; and prospective, longitudinal studies of the independent effects of physical activity and sedentary behaviour on health. Conclusions These research priorities can help to guide decisions on future research directions. PMID:24228891

Quality indicators for in-hospital geriatric co-management programmes: a systematic literature review and international Delphi study

PubMed Central

Van Grootven, Bastiaan; McNicoll, Lynn; Mendelson, Daniel A; Friedman, Susan M; Fagard, Katleen; Milisen, Koen; Flamaing, Johan; Deschodt, Mieke

2018-01-01

Objective To find consensus on appropriate and feasible structure, process and outcome indicators for the evaluation of in-hospital geriatric co-management programmes. Design An international two-round Delphi study based on a systematic literature review (searching databases, reference lists, prospective citations and trial registers). Setting Western Europe and the USA. Participants Thirty-three people with at least 2 years of clinical experience in geriatric co-management were recruited. Twenty-eight experts (16 from the USA and 12 from Europe) participated in both Delphi rounds (85% response rate). Measures Participants rated the indicators on a nine-point scale for their (1) appropriateness and (2) feasibility to use the indicator for the evaluation of geriatric co-management programmes. Indicators were considered appropriate and feasible based on a median score of seven or higher. Consensus was based on the level of agreement using the RAND/UCLA Appropriateness Method. Results In the first round containing 37 indicators, there was consensus on 14 indicators. In the second round containing 44 indicators, there was consensus on 31 indicators (structure=8, process=7, outcome=16). Experts indicated that co-management should start within 24 hours of hospital admission using defined criteria for selecting appropriate patients. Programmes should focus on the prevention and management of geriatric syndromes and complications. Key areas for comprehensive geriatric assessment included cognition/delirium, functionality/mobility, falls, pain, medication and pressure ulcers. Key outcomes for evaluating the programme included length of stay, time to surgery and the incidence of complications. Conclusion The indicators can be used to assess the performance of geriatric co-management programmes and identify areas for improvement. Furthermore, the indicators can be used to monitor the implementation and effect of these programmes. PMID:29549210

Achieving Consensus for the Design and Delivery of an Online Intervention to Support Midwives in Work-Related Psychological Distress: Results From a Delphi Study.

PubMed

Pezaro, Sally; Clyne, Wendy

2016-07-12

Some midwives are known to experience both professional and organizational sources of psychological distress, which can manifest as a result of the emotionally demanding midwifery work, and the traumatic work environments they endure. An online intervention may be one option midwives may engage with in pursuit of effective support. However, the priorities for the development of an online intervention to effectively support midwives in work-related psychological distress have yet to be explored. The aim of this study was to explore priorities in the development of an online intervention to support midwives in work-related psychological distress. A two-round online Delphi study was conducted. This study invited both qualitative and quantitative data from experts recruited via a scoping literature search and social media channels. In total, 185 experts were invited to participate in this Delphi study. Of all participants invited to contribute, 35.7% (66/185) completed Round 1 and of those who participated in this first round, 67% (44/66) continued to complete Round 2. Out of 39 questions posed over two rounds, 18 statements (46%) achieved consensus, 21 (54%) did not. Participants were given the opportunity to write any additional comments as free text. In total, 1604 free text responses were collected and categorized into 2446 separate statements of opinion, creating a total of 442 themes. Overall, participants agreed that in order to effectively support midwives in work-related psychological distress, online interventions should make confidentiality and anonymity a high priority, along with 24-hour mobile access, effective moderation, an online discussion forum, and additional legal, educational, and therapeutic components. It was also agreed that midwives should be offered a simple user assessment to identify those people deemed to be at risk of either causing harm to others or experiencing harm themselves, and direct them to appropriate support. This study has identified priorities for the development of online interventions to effectively support midwives in work-related psychological distress. The impact of any future intervention of this type will be optimized by utilizing these findings in the development process.

Achieving Consensus for the Design and Delivery of an Online Intervention to Support Midwives in Work-Related Psychological Distress: Results From a Delphi Study

PubMed Central

Clyne, Wendy

2016-01-01

Background Some midwives are known to experience both professional and organizational sources of psychological distress, which can manifest as a result of the emotionally demanding midwifery work, and the traumatic work environments they endure. An online intervention may be one option midwives may engage with in pursuit of effective support. However, the priorities for the development of an online intervention to effectively support midwives in work-related psychological distress have yet to be explored. Objective The aim of this study was to explore priorities in the development of an online intervention to support midwives in work-related psychological distress. Methods A two-round online Delphi study was conducted. This study invited both qualitative and quantitative data from experts recruited via a scoping literature search and social media channels. Results In total, 185 experts were invited to participate in this Delphi study. Of all participants invited to contribute, 35.7% (66/185) completed Round 1 and of those who participated in this first round, 67% (44/66) continued to complete Round 2. Out of 39 questions posed over two rounds, 18 statements (46%) achieved consensus, 21 (54%) did not. Participants were given the opportunity to write any additional comments as free text. In total, 1604 free text responses were collected and categorized into 2446 separate statements of opinion, creating a total of 442 themes. Overall, participants agreed that in order to effectively support midwives in work-related psychological distress, online interventions should make confidentiality and anonymity a high priority, along with 24-hour mobile access, effective moderation, an online discussion forum, and additional legal, educational, and therapeutic components. It was also agreed that midwives should be offered a simple user assessment to identify those people deemed to be at risk of either causing harm to others or experiencing harm themselves, and direct them to appropriate support. Conclusions This study has identified priorities for the development of online interventions to effectively support midwives in work-related psychological distress. The impact of any future intervention of this type will be optimized by utilizing these findings in the development process. PMID:27405386

Reaching Consensus on Essential Biomedical Science Learning Objectives in a Dental Curriculum.

PubMed

Best, Leandra; Walton, Joanne N; Walker, Judith; von Bergmann, HsingChi

2016-04-01

This article describes how the University of British Columbia Faculty of Dentistry reached consensus on essential basic biomedical science objectives for DMD students and applied the information to the renewal of its DMD curriculum. The Delphi Method was used to build consensus among dental faculty members and students regarding the relevance of over 1,500 existing biomedical science objectives. Volunteer panels of at least three faculty members (a basic scientist, a general dentist, and a dental specialist) and a fourth-year dental student were formed for each of 13 biomedical courses in the first two years of the program. Panel members worked independently and anonymously, rating each course objective as "need to know," "nice to know," "irrelevant," or "don't know." Panel members were advised after each round which objectives had not yet achieved a 75% consensus and were asked to reconsider their ratings. After a maximum of three rounds to reach consensus, a second group of faculty experts reviewed and refined the results to establish the biomedical science objectives for the renewed curriculum. There was consensus on 46% of the learning objectives after round one, 80% after round two, and 95% after round three. The second expert group addressed any remaining objectives as part of its review process. Only 47% of previous biomedical science course objectives were judged to be essential or "need to know" for the general dentist. The consensus reached by participants in the Delphi Method panels and a second group of faculty experts led to a streamlined, better integrated DMD curriculum to prepare graduates for future practice.

Structured reporting for fibrosing lung disease: a model shared by radiologist and pulmonologist.

PubMed

Sverzellati, Nicola; Odone, Anna; Silva, Mario; Polverosi, Roberta; Florio, Carlo; Cardinale, Luciano; Cortese, Giancarlo; Addonisio, Giancarlo; Zompatori, Maurizio; Dalpiaz, Giorgia; Piciucchi, Sara; Larici, Anna Rita

2018-04-01

To apply the Delphi exercise with iterative involvement of radiologists and pulmonologists with the aim of defining a structured reporting template for high-resolution computed tomography (HRCT) of patients with fibrosing lung disease (FLD). The writing committee selected the HRCT criteria-the Delphi items-for rating from both radiology panelists (RP) and pulmonology panelists (PP). The Delphi items were first rated by RPs as "essential", "optional", or "not relevant". The items rated "essential" by < 80% of the RP were selected for the PP rating. The format of reporting was rated by both RP and PP. A total of 42 RPs and 12 PPs participated to the survey. In both Delphi round 1 and 2, 10/27 (37.7%) items were rated "essential" by more than 80% of RP. The remaining 17/27 (63.3%) items were rated by the PP in round 3, with 2/17 items (11.7%) rated "essential" by the PP. PP proposed additional items for conclusion domain, which were rated by RPs in the fourth round. Poor consensus was observed for the format of reporting. This study provides a template for structured report of FLD that features essential items as agreed by expert thoracic radiologists and pulmonologists.

Defining the Medical Library Association research agenda: methodology and final results from a consensus process

PubMed Central

Eldredge, Jonathan D.; Harris, Martha R.; Ascher, Marie T.

2009-01-01

Objective: Using a group consensus methodology, the research sought to generate a list of the twelve to fifteen most important and answerable research questions in health sciences librarianship as part of a broader effort to implement the new Medical Library Association (MLA) research policy. Methods: The delphi method was used. The committee distributed a brief survey to all estimated 827 MLA leaders and 237 MLA Research Section members, requesting they submit what they considered to be the most important and answerable research questions facing the profession. The submitted questions were then subjected to 2 rounds of voting to produce a short list of top-ranked questions. Results: The survey produced 62 questions from 54 MLA leaders and MLA Research Section members, who responded from an estimated potential population of 1,064 targeted colleagues. These questions were considered by the process participants to be the most important and answerable research questions facing the profession. Through 2 rounds of voting, these 62 questions were reduced to the final 12 highest priority questions. Conclusion: The modified delphi method accomplished its desired survey and consensus goals. Future survey and consensus processes will be revised to generate more initial questions and to distill a larger number of ranked prioritized research questions. PMID:19626143

Definition of a COPD self-management intervention: International Expert Group consensus.

PubMed

Effing, Tanja W; Vercoulen, Jan H; Bourbeau, Jean; Trappenburg, Jaap; Lenferink, Anke; Cafarella, Paul; Coultas, David; Meek, Paula; van der Valk, Paul; Bischoff, Erik W M A; Bucknall, Christine; Dewan, Naresh A; Early, Frances; Fan, Vincent; Frith, Peter; Janssen, Daisy J A; Mitchell, Katy; Morgan, Mike; Nici, Linda; Patel, Irem; Walters, Haydn; Rice, Kathryn L; Singh, Sally; Zuwallack, Richard; Benzo, Roberto; Goldstein, Roger; Partridge, Martyn R; van der Palen, Job

2016-07-01

There is an urgent need for consensus on what defines a chronic obstructive pulmonary disease (COPD) self-management intervention. We aimed to obtain consensus regarding the conceptual definition of a COPD self-management intervention by engaging an international panel of COPD self-management experts using Delphi technique features and an additional group meeting.In each consensus round the experts were asked to provide feedback on the proposed definition and to score their level of agreement (1=totally disagree; 5=totally agree). The information provided was used to modify the definition for the next consensus round. Thematic analysis was used for free text responses and descriptive statistics were used for agreement scores.In total, 28 experts participated. The consensus round response rate varied randomly over the five rounds (ranging from 48% (n=13) to 85% (n=23)), and mean definition agreement scores increased from 3.8 (round 1) to 4.8 (round 5) with an increasing percentage of experts allocating the highest score of 5 (round 1: 14% (n=3); round 5: 83% (n=19)).In this study we reached consensus regarding a conceptual definition of what should be a COPD self-management intervention, clarifying the requisites for such an intervention. Operationalisation of this conceptual definition in the near future will be an essential next step. The content of this work is not subject to copyright. Design and branding are copyright ©ERS 2016.

Chiropractic Integrated Care Pathway for Low Back Pain in Veterans: Results of a Delphi Consensus Process.

PubMed

Lisi, Anthony J; Salsbury, Stacie A; Hawk, Cheryl; Vining, Robert D; Wallace, Robert B; Branson, Richard; Long, Cynthia R; Burgo-Black, A Lucille; Goertz, Christine M

2018-02-01

The purpose of this study was to develop an integrated care pathway for doctors of chiropractic, primary care providers, and mental health professionals who manage veterans with low back pain, with or without mental health comorbidity, within Department of Veterans Affairs health care facilities. The research method used was a consensus process. A multidisciplinary investigative team reviewed clinical guidelines and Veterans Affairs pain and mental health initiatives to develop seed statements and care algorithms to guide chiropractic management and collaborative care of veterans with low back pain. A 5-member advisory committee approved initial recommendations. Veterans Affairs-based panelists (n = 58) evaluated the pathway via e-mail using a modified RAND/UCLA methodology. Consensus was defined as agreement by 80% of panelists. The modified Delphi process was conducted in July to December 2016. Most (93%) seed statements achieved consensus during the first round, with all statements reaching consensus after 2 rounds. The final care pathway addressed the topics of informed consent, clinical evaluation including history and examination, screening for red flags, documentation, diagnostic imaging, patient-reported outcomes, adverse event reporting, chiropractic treatment frequency and duration standards, tailored approaches to chiropractic care in veteran populations, and clinical presentation of common mental health conditions. Care algorithms outlined chiropractic case management and interprofessional collaboration and referrals between doctors of chiropractic and primary care and mental health providers. This study offers an integrative care pathway that includes chiropractic care for veterans with low back pain. Copyright © 2018. Published by Elsevier Inc.

Content Validity of a Psychotherapeutic Intervention Model in Nursing: A Modified e-Delphi Study.

PubMed

Sampaio, Francisco Miguel Correia; Sequeira, Carlos; Lluch Canut, Teresa

2017-04-01

To estimate the content validity of a psychotherapeutic intervention model in nursing. Mental health nurses encounter great extrinsic difficulties when it comes to providing psychotherapeutic interventions due to the fact that they are not allowed to perform such practice in some countries. In this light, the pursuit of a psychotherapeutic intervention model in nursing seems germane to guide the professionals' psychotherapeutic practice, contributing hereof to increase mental health nurses' professional autonomy. Modified e-Delphi. Data were collected from October 2015 to January 2016 by means of three rounds of online questionnaires. The initial questionnaire was structured into five sections: general structure of the model, patients' exclusion criteria, assessment framework, nursing diagnoses, and nursing psychotherapeutic interventions. From the 42 experts invited, at least twenty (20) participated in each round. The experts achieved consensus with regard to the conclusion that nursing psychotherapeutic interventions should always seek to address a nursing diagnosis. These defined furthermore that a psychotherapeutic intervention model in nursing should be exercised by means of 3 to 12 sessions using Nursing Interventions Classification (NIC) as a resource. Finally, experts deemed that the model should follow the principles of integrative psychotherapy, so that techniques from different schools of psychotherapy could therefore be used in conjunction to promote the resolution of a nursing diagnosis. Achieving consensus about the structure of a psychotherapeutic intervention model in nursing is imperative to guide nurses in the provision of nursing psychotherapeutic interventions and to enable an effective evaluation of the health gains associated with its implementation. Copyright © 2016 Elsevier Inc. All rights reserved.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology

PubMed Central

Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-01-01

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development. PMID:29282445

Engaging Patients and Caregivers Managing Rare Diseases to Improve the Methods of Clinical Guideline Development: A Research Protocol

PubMed Central

Kinnett, Kathi; Grant, Sean; Lucas, Ann; Martin, Ann; Denger, Brian; Peay, Holly; Coulter, Ian; Fink, Arlene

2017-01-01

Background Clinical guidelines provide systematically developed recommendations for deciding on appropriate health care options for specific conditions and clinical circumstances. Up until recently, patients and caregivers have rarely been included in the process of developing care guidelines. Objective This project will develop and test a new online method for including patients and their caregivers in this process using Duchenne muscular dystrophy (DMD) care guidelines as an example. The new method will mirror and complement the RAND/UCLA Appropriateness Method (RAM)—the gold standard approach for conducting clinical expert panels that uses a modified Delphi format. RAM is often used in clinical guideline development to determine care appropriateness and necessity in situations where existing clinical evidence is uncertain, weak, or unavailable. Methods To develop the new method for engaging patients and their caregivers in guideline development, we will first conduct interviews with experts on RAM, guideline development, patient engagement, and patient-centeredness and engage with Duchenne patients and caregivers to identify how RAM should be modified for the purposes of patient engagement and what rating criteria should patients and caregivers use to provide their input during the process of guideline development. Once the new method is piloted, we will test it by conducting two concurrently run patient/caregiver panels that will rate patient-centeredness of a subset of DMD care management recommendations already deemed clinically appropriate and necessary. The ExpertLens™ system—a previously evaluated online modified Delphi system that combines two rounds of rating with a round of feedback and moderated online discussions—will be used to conduct these panels. In addition to developing and testing the new engagement method, we will work with the members of our project’s Advisory Board to generate a list of best practices for enhancing the level of patient and caregiver involvement in the guideline development process. We will solicit input on these best practice from Duchenne patients, caregivers, and clinicians by conducting a series of round-table discussions and making a presentation at an annual conference on Duchenne. Results The study protocol was reviewed by RAND’s Human Subjects Protection Committee, which determined it to be exempt from review. Interviews with RAM experts have been completed. The projected study completion date is May 2020. Conclusions We expect that the new method will make it easier to engage large numbers of patients and caregivers in the process of guideline development in a rigorous and culturally appropriate manner that is consistent with the way clinicians participate in guideline development. Moreover, this project will develop best practices that could help involve patients and caregivers in the clinical guideline development process in other clinical areas, thereby facilitating the work of guideline developers. PMID:28455279

Algorithms for monitoring warfarin use: Results from Delphi Method.

PubMed

Kano, Eunice Kazue; Borges, Jessica Bassani; Scomparini, Erika Burim; Curi, Ana Paula; Ribeiro, Eliane

2017-10-01

Warfarin stands as the most prescribed oral anticoagulant. New oral anticoagulants have been approved recently; however, their use is limited and the reversibility techniques of the anticoagulation effect are little known. Thus, our study's purpose was to develop algorithms for therapeutic monitoring of patients taking warfarin based on the opinion of physicians who prescribe this medicine in their clinical practice. The development of the algorithm was performed in two stages, namely: (i) literature review and (ii) algorithm evaluation by physicians using a Delphi Method. Based on the articles analyzed, two algorithms were developed: "Recommendations for the use of warfarin in anticoagulation therapy" and "Recommendations for the use of warfarin in anticoagulation therapy: dose adjustment and bleeding control." Later, these algorithms were analyzed by 19 medical doctors that responded to the invitation and agreed to participate in the study. Of these, 16 responded to the first round, 11 to the second and eight to the third round. A 70% consensus or higher was reached for most issues and at least 50% for six questions. We were able to develop algorithms to monitor the use of warfarin by physicians using a Delphi Method. The proposed method is inexpensive and involves the participation of specialists, and it has proved adequate for the intended purpose. Further studies are needed to validate these algorithms, enabling them to be used in clinical practice.

Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies.

PubMed

Diamond, Ivan R; Grant, Robert C; Feldman, Brian M; Pencharz, Paul B; Ling, Simon C; Moore, Aideen M; Wales, Paul W

2014-04-01

To investigate how consensus is operationalized in Delphi studies and to explore the role of consensus in determining the results of these studies. Systematic review of a random sample of 100 English language Delphi studies, from two large multidisciplinary databases [ISI Web of Science (Thompson Reuters, New York, NY) and Scopus (Elsevier, Amsterdam, NL)], published between 2000 and 2009. About 98 of the Delphi studies purported to assess consensus, although a definition for consensus was only provided in 72 of the studies (64 a priori). The most common definition for consensus was percent agreement (25 studies), with 75% being the median threshold to define consensus. Although the authors concluded in 86 of the studies that consensus was achieved, consensus was only specified a priori (with a threshold value) in 42 of these studies. Achievement of consensus was related to the decision to stop the Delphi study in only 23 studies, with 70 studies terminating after a specified number of rounds. Although consensus generally is felt to be of primary importance to the Delphi process, definitions of consensus vary widely and are poorly reported. Improved criteria for reporting of methods of Delphi studies are required. Copyright © 2014 Elsevier Inc. All rights reserved.

International Occupational Therapy Research Priorities.

PubMed

Mackenzie, Lynette; Coppola, Susan; Alvarez, Liliana; Cibule, Lolita; Maltsev, Sergey; Loh, Siew Yim; Mlambo, Tecla; Ikiugu, Moses N; Pihlar, Zdenka; Sriphetcharawut, Sarinya; Baptiste, Sue; Ledgerd, Richard

2017-04-01

Occupational therapy is a global profession represented by the World Federation of Occupational Therapists (WFOT). International research priorities are needed for strategic guidance on global occupational therapy practice. The objective of this study was to develop international research priorities to reflect global occupational therapy practice. A Delphi study using three rounds of electronic surveys, distributed to WFOT member organizations and WFOT accredited universities, was conducted. Data were analyzed after each round, and priorities were presented for rating and ranking in order of importance. Forty-six (53%) out of 87 WFOT member countries participated in the Delphi process. Eight research priorities were confirmed by the final electronic survey round. Differences were observed in rankings given by member organizations and university respondents. Despite attrition at Round 3, the final research priorities will help to focus research efforts in occupational therapy globally. Follow-up research is needed to determine how the research priorities are being adopted internationally.

What should be included in the assessment of laypersons' paediatric basic life support skills? Results from a Delphi consensus study.

PubMed

Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim; Bohnstedt, Cathrine; Sønderskov, Claus; Østergaard, Doris; Tolsgaard, Martin Grønnebæk

2018-01-18

Assessment of laypersons' Paediatric Basic Life Support (PBLS) skills is important to ensure acquisition of effective PBLS competencies. However limited evidence exists on which PBLS skills are essential for laypersons. The same challenges exist with respect to the assessment of foreign body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts suggested items to assess laypersons' PBLS and FBAOM skills. In the second round, the suggested items received comments from and were rated by 26 experts (93%) on a 5-point scale (1 = not relevant to 5 = essential). Revised items were anonymously presented in a third round for comments and 23 (82%) experts completed a re-rating. Items with a score above 3 by more than 80% of the experts in the third round were included in an assessment instrument. In the first round, 19 and 15 items were identified to assess PBLS and FBAOM skills, respectively. The ratings and comments from the last two rounds resulted in nine and eight essential assessment items for PBLS and FBAOM skills, respectively. The PBLS items included: "Responsiveness"," Call for help", "Open airway"," Check breathing", "Rescue breaths", "Compressions", "Ventilations", "Time factor" and "Use of AED". The FBAOM items included: "Identify different stages of foreign body airway obstruction", "Identify consciousness", "Call for help", "Back blows", "Chest thrusts/abdominal thrusts according to age", "Identify loss of consciousness and change to CPR", "Assessment of breathing" and "Ventilation". For assessment of laypersons some PBLS and FBAOM skills described in guidelines are more important than others. Four out of nine of PBLS skills focus on airway and breathing skills, supporting the major importance of these skills for laypersons' resuscitation attempts. International consensus on how to assess laypersons' paediatric basic life support and foreign body airway obstruction management skills was established. The assessment of these skills may help to determine when laypersons have acquired competencies. Not relevant.

Organizational readiness for knowledge translation in chronic care: a Delphi study.

PubMed

Attieh, Randa; Gagnon, Marie-Pierre; Estabrooks, Carole A; Légaré, France; Ouimet, Mathieu; Vazquez, Patricia; Nuño, Roberto

2014-11-08

Health-care organizations need to be ready prior to implement evidence-based interventions. In this study, we sought to achieve consensus on a framework to assess the readiness of health-care organizations to implement evidence-based interventions in the context of chronic care. We conducted a web-based modified Delphi study between March and May 2013. We contacted 76 potentially eligible international experts working in the fields of organizational readiness (OR), knowledge translation (KT), and chronic care to comment upon the 76 elements resulting from our proposed conceptual map. This conceptual map was based on a systematic review of the existing frameworks of Organizational Readiness for Change (ORC) in health-care. We developed a conceptual map that proposed a set of core concepts and their associated 17 dimensions and 59 sub-dimensions. Experts rated their agreement concerning the applicability and importance of ORC elements on a 5-point Likert scale, where 1 indicates total disagreement and 5 indicates total agreement. Two rounds were needed to get a consensus from the experts. Consensus was a priori defined as strong (≥75%) or moderate (60-74%). Simple descriptive statistics was used. In total, 14 participants completed the first round and 10 completed the two rounds. Panel members reached consensus on the applicability and importance of 6 out of 17 dimensions and 28 out of 59 sub-dimensions to assess OR for KT in the context of chronic care. A strong level of consensus (≥75%) was attained on the Organizational contextual factors, Leadership/participation, Organizational support, and Motivation dimensions. The Organizational climate for change and Change content dimensions reached a moderate consensus (60-74%). Experts also reached consensus on 28 out of 59 sub-dimensions to assess OR for KT. Twenty-one sub-dimensions reached a strong consensus (≥75%) and seven a moderate consensus (60-74%). This study results provided the most important and applicable dimensions and sub-dimensions for assessing OR-KT in the context of chronic care. They can be used to guide the design of an assessment tool to improve knowledge translation in the field of chronic care.

Healthcare Quality Indicators for Physiotherapy Management in Hip and Knee Osteoarthritis and Rheumatoid Arthritis: A Delphi Study.

PubMed

Peter, W F; Hurkmans, E J; van der Wees, P J; Hendriks, E J M; van Bodegom-Vos, L; Vliet Vlieland, T P M

2016-12-01

The aim of the present study was to develop healthcare quality indicators (HCQIs) for the physiotherapy (PT) management of patients with hip or knee osteoarthritis (HKOA) or rheumatoid arthritis (RA) in the Netherlands. Two multidisciplinary expert panels, including patients, were instituted. A draft HCQI set was derived from recommendations included in two existing Dutch PT guidelines for HKOA and RA. The panels suggested additional topics, after which a Delphi procedure was performed. All propositions were scored for their potential to represent good-quality PT care (score range 0-9). Based on predefined rules, the Delphi panel HCQIs were discussed and selected. Lastly, every indicator was rephrased, resulting in its output consisting of a numerator and denominator, to facilitate comparisons within and among practices. After two Delphi rounds, two final sets of 17 HCQI - one for HKOA and one for RA - were composed, both containing 16 process indicators (regarding initial assessment, treatment and evaluation) and one outcome indicator. Two sets of HCQIs for PT management in HKOA and RA were developed for measuring the quality of PT care in daily clinical practice. Each indicator was formulated in a measurable way. Future research should focus on the feasibility of both indicator sets for daily clinical practice. Copyright © 2016 John Wiley & Sons, Ltd.

A Delphi study to develop practical diagnostic guidelines for visual stress (pattern-related visual stress).

PubMed

Evans, Bruce J W; Allen, Peter M; Wilkins, Arnold J

Visual stress (VS) is characterised by symptoms of visual perceptual distortions and eyestrain when viewing text, symptoms that are alleviated by individually prescribed coloured filters. A recent review supports the existence of VS and its treatment, but noted that controversy remains, in part due to inconsistencies in the diagnosis of the condition. The present paper reviews the diagnostic criteria for VS in the literature and reports a Delphi analysis of the criteria currently used in clinical practice. Twenty-six eyecare practitioners were invited to participate in a Delphi study. They were selected because they were frequent prescribers of precision tinted lenses. In the first round they were sent a list of the indicators for which there is literature to suggest a relevance in the diagnosis of VS. The practitioners were invited to rank the indicators and add any additional criteria they use in diagnosis. In the second round a revised list was circulated, including items added from the responses in the first round. The respondents included optometrists, orthoptists and opticians. In the first round the response rate was 85%. Ninety-one percent of those who participated in the first round also responded in the second round. Strong indicators in the second round included the symptom of words moving when reading, voluntary use of an overlay for a prolonged period, improved performance of ≥15% with an overlay on the Wilkins Rate of Reading test, and an abnormally high score on the Pattern Glare Test. The strongest diagnostic criteria are combined in a diagnostic tool. This is proposed as a guide for clinical practice and further research. Copyright © 2016 Spanish General Council of Optometry. Published by Elsevier España, S.L.U. All rights reserved.

Identifying Ethical Issues in Mental Health Research with Minors Adolescents: Results of a Delphi Study

PubMed Central

Hiriscau, Elisabeta Ioana; Stingelin-Giles, Nicola; Wasserman, Danuta; Reiter-Theil, Stella

2016-01-01

Research with minors, especially for preventive purposes, e.g., suicide prevention, investigating risk or self-destructive behaviors such as deviance, drug abuse, or suicidal behavior, is ethically sensitive. We present a Delphi study exploring the ethical implications of the needs formulated by researchers in an international pre-conference who would benefit from ethics support and guidance in conducting Mental Health Research with minors. The resulting List of Ethical Issues (LEI) was submitted to a 2-rounds Delphi process via the Internet, including 34 multidisciplinary experts. In the first round, the experts reviewed the LEI and completed a questionnaire. Results from this round were analyzed and grouped in nine categories comprising 40 items. In the second round, the experts had to agree/disagree with the needs expressed in the LEI leading to a final list of 25 ethical issues considered relevant for Mental Health Research with minors such as: confidentiality of the sensitive data, competence for consenting alone and risk of harm and stigma related to the methodology used in research. It was shown that studies like SEYLE (Saving and Empowering Young Lives in Europe) trigger among researchers wishes to obtain specific recommendations helping to comply with standards for good practice in conducting research with minors. PMID:27187425

Identifying Ethical Issues in Mental Health Research with Minors Adolescents: Results of a Delphi Study.

PubMed

Hiriscau, Elisabeta Ioana; Stingelin-Giles, Nicola; Wasserman, Danuta; Reiter-Theil, Stella

2016-05-11

Research with minors, especially for preventive purposes, e.g., suicide prevention, investigating risk or self-destructive behaviors such as deviance, drug abuse, or suicidal behavior, is ethically sensitive. We present a Delphi study exploring the ethical implications of the needs formulated by researchers in an international pre-conference who would benefit from ethics support and guidance in conducting Mental Health Research with minors. The resulting List of Ethical Issues (LEI) was submitted to a 2-rounds Delphi process via the Internet, including 34 multidisciplinary experts. In the first round, the experts reviewed the LEI and completed a questionnaire. Results from this round were analyzed and grouped in nine categories comprising 40 items. In the second round, the experts had to agree/disagree with the needs expressed in the LEI leading to a final list of 25 ethical issues considered relevant for Mental Health Research with minors such as: confidentiality of the sensitive data, competence for consenting alone and risk of harm and stigma related to the methodology used in research. It was shown that studies like SEYLE (Saving and Empowering Young Lives in Europe) trigger among researchers wishes to obtain specific recommendations helping to comply with standards for good practice in conducting research with minors.

A Delphi Study of Agriculture Teacher Perceptions of Problems in Student Retention.

ERIC Educational Resources Information Center

Dyer, James E.; Breja, Lisa M.; Ball, Anna L.

2003-01-01

A four-round Delphi study of secondary agriculture teachers (17, 17, 22, and 21 responses) identified and rated student retention problems. Consensus was reached on these items: scheduling difficulties, lack of counselor support, image, increased graduation requirements, college entrance requirements, competition from other activities, block…

Single-Parent Nontraditional Students: Faculty Support within the Classroom Environment

ERIC Educational Resources Information Center

Allen-Drewry, Lisa M.

2017-01-01

Purpose: The purpose of this Delphi study was to explore single-parent nontraditional student experiences within nontraditional university classroom environments and to determine methods for providing better support within the classroom setting. Methodology: The Delphi technique was conducted through 3 survey rounds to explore ways professors and…

Youth injury prevention in Canada: use of the Delphi method to develop recommendations.

PubMed

Pike, Ian; Piedt, Shannon; Davison, Colleen M; Russell, Kelly; Macpherson, Alison K; Pickett, William

2015-12-22

The Health Behaviour in School-aged Children Survey is one of very few cross-national health surveys that includes information on injury occurrence and prevention within adolescent populations. A collaboration to develop a Canadian youth injury report using these data resulted in, Injury among Young Canadians: A national study of contextual determinants. The objective of this study was to develop specific evidence-based, policy-oriented recommendations arising from the national report, using a modified-Delphi process with a panel of expert stakeholders. Eight injury prevention experts and a 3-person youth advisory team associated with a Canadian injury prevention organization (Parachute Canada) reviewed, edited and commented on report recommendations through a three-stage iterative modified-Delphi process. From an initial list of 27 draft recommendations, the modified-Delphi process resulted in a final list of 19 specific recommendations, worded to resonate with the group(s) responsible to lead or take the recommended action. Two recommendations were rated as "extremely important" or "very important" by 100 % of the expert panel, two were deleted, a further two recommendations were deleted but the content included as text in the report, and four were merged with other existing recommendations. The modified-Delphi process was an appropriate method to achieve agreement on 19 specific evidence-based, policy-oriented recommendations to complement the national youth injury report. In providing their input, it is noted that the injury stakeholders each acted as individual experts, unattached to any organizational position or policy. These recommendations will require multidisciplinary collaborations in order to support the proposed policy development, additional research, programming and clear decision-making for youth injury prevention.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.

PubMed

Birko, Stanislav; Dove, Edward S; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts' variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions. PMID:26270647

Anatomical Society core regional anatomy syllabus for undergraduate medicine: the Delphi process.

PubMed

Smith, C F; Finn, G M; Stewart, J; McHanwell, S

2016-01-01

A modified Delphi method was employed to seek consensus when revising the UK and Ireland's core syllabus for regional anatomy in undergraduate medicine. A Delphi panel was constructed involving 'expert' (individuals with at least 5 years' experience in teaching medical students anatomy at the level required for graduation). The panel (n = 39) was selected and nominated by members of Council and/or the Education Committee of the Anatomical Society and included a range of specialists including surgeons, radiologists and anatomists. The experts were asked in two stages to 'accept', 'reject' or 'modify' (first stage only) each learning outcome. A third stage, which was not part of the Delphi method, then allowed the original authors of the syllabus to make changes either to correct any anatomical errors or to make minor syntax changes. From the original syllabus of 182 learning outcomes, removing the neuroanatomy component (163), 23 learning outcomes (15%) remained unchanged, seven learning outcomes were removed and two new learning outcomes added. The remaining 133 learning outcomes were modified. All learning outcomes on the new core syllabus achieved over 90% acceptance by the panel. © 2015 Anatomical Society.

Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

PubMed

Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

2016-07-01

To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

A core outcome set for localised prostate cancer effectiveness trials: protocol for a systematic review of the literature and stakeholder involvement through interviews and a Delphi survey.

PubMed

MacLennan, Steven; Bekema, Hendrika J; Williamson, Paula R; Campbell, Marion K; Stewart, Fiona; MacLennan, Sara J; N'Dow, James M O; Lam, Thomas B L

2015-03-04

Prostate cancer is a growing health problem worldwide. The management of localised prostate cancer is controversial. It is unclear which of several surgical, radiotherapeutic, ablative, and surveillance treatments is the most effective. All have cost, process and recovery, and morbidity implications which add to treatment decision-making complexity for patients and healthcare professionals. Evidence from randomised controlled trials (RCTs) is not optimal because of uncertainty as to what constitutes important outcomes. Another issue hampering evidence synthesis is heterogeneity of outcome definition, measurement, and reporting. This project aims to determine which outcomes are the most important to patients and healthcare professionals, and use these findings to recommend a standardised core outcome set for comparative effectiveness trials of treatments for localised prostate cancer, to optimise decision-making. The range of potentially important outcomes and measures will be identified through systematic reviews of the literature and semi-structured interviews with patients. A consultation exercise involving representatives from two key stakeholder groups (patients and healthcare professionals) will ratify the list of outcomes to be entered into a three round Delphi study. The Delphi process will refine and prioritise the list of identified outcomes. A methodological substudy (nested RCT design) will also be undertaken. Participants will be randomised after round one of the Delphi study to one of three feedback groups, based on different feedback strategies, in order to explore the potential impact of feedback strategies on participant responses. This may assist the design of a future core outcome set and Delphi studies. Following the Delphi study, a final consensus meeting attended by representatives from both stakeholder groups will determine the final recommended core outcome set. This study will inform clinical practice and future trials of interventions of localised prostate cancer by standardising a core outcome set which should be considered in comparative effectiveness studies for localised prostate cancer.

Determining the Essential Components of State and Institution Dual Credit Program Policy in New Mexico: A Delphi Study with High School and College Experts

ERIC Educational Resources Information Center

Carlson, Gregory Dean

2013-01-01

The purpose of this Delphi study was to determine the essential components of dual credit in New Mexico. Dual credit experts from colleges and high schools in New Mexico were asked to participate in a three-round Delphi study to determine what the future policy of dual credit should be, and why it should be that way. Definitions of dual credit may…

Identifying seminal papers in the Australasian Journal on Ageing 1982-2011: a Delphi consensus approach.

PubMed

Parkinson, Lynne; Richardson, Kristy; Sims, Jane; Wells, Yvonne; Naganathan, Vasi; Brooke, Elizabeth; Lindley, Richard

2013-10-01

The aim of this study was to identify seminal Australasian Journal on Ageing papers published over 30 years through a Delphi consensus process. The main data collection was a three-round Delphi consensus study with 38 past and current members of the Australasian Journal on Ageing Editorial Board, Editorial Team and Management Committee. Three papers were agreed as top-ranking. One of the top-ranking articles was also highly cited. One article was published in the 1990 s, two in 2001. While it is difficult to judge how well the top-ranking papers represent seminal papers arising over 30 years, these papers do represent three different research strengths in Australasia, they do span three different disciplines, and they do reflect some of the diversity that characterises ageing research in Australasia over 30 years. © 2013 ACOTA.

Addressing the workplace needs of Western Australian midwives: a Delphi study.

PubMed

Hauck, Yvonne L; Bayes, Sara J; Robertson, Jeanette M

2012-05-01

To determine the workplace needs of Western Australian midwives working in public metropolitan secondary hospitals. Using a three-round Delphi approach, Round 1 incorporated focus groups and a questionnaire. Fifteen focus groups were conducted with midwives also having the option of contributing through an open-ended questionnaire. During Round 2, 38 items reflecting seven themes were prioritised with a final ranking performed in Round 3. In total, 114 midwives participated in Round 1, 72 in Round 2 and 89 in Round 3. During Round 1, workplace needs identified as being met included: working across all areas of midwifery; ability to work in areas of interest; opportunity to work with low to moderate risk women; supportive colleagues; accessible parking; hospital close to home and friendly work atmosphere. Round 2 items revealed the five top unmet needs as: adequate midwifery staff coverage; access to maintained equipment; competitive pay scales; patient safety issues and opportunities to implement midwifery models. The top ranked needs from Round 3 included: recognising the unpredictable nature of midwifery services; provision of competent medical coverage, and adequate midwifery staff coverage. Demand for maternity services is unpredictable; however, in order to maintain a sustainable maternity workforce, WA midwives' prioritised needs would suggest health management focus upon expanding the availability of midwifery models of care, fostering flexible working conditions and ensuring collaboration between maternity health professionals occurs within clinically safe staffing levels.

Assessment of mastication in healthy children and children with cerebral palsy: a validity and consistency study.

PubMed

Remijn, L; Speyer, R; Groen, B E; Holtus, P C M; van Limbeek, J; Nijhuis-van der Sanden, M W G

2013-05-01

The aim of this study was to develop the Mastication Observation and Evaluation instrument for observing and assessing the chewing ability of children eating solid and lumpy foods. This study describes the process of item definition and item selection and reports the content validity, reproducibility and consistency of the instrument. In the developmental phase, 15 experienced speech therapists assessed item relevance and descriptions over three Delphi rounds. Potential items were selected based on the results from a literature review. At the initial Delphi round, 17 potential items were included. After three Delphi rounds, 14 items that regarded as providing distinctive value in assessment of mastication (consensus >75%) were included in the Mastication Observation and Evaluation instrument. To test item reproducibility and consistency, two experts and five students evaluated video recordings of 20 children (10 children with cerebral palsy aged 29-65 months and 10 healthy children aged 11-42 months) eating bread and a biscuit. Reproducibility was estimated by means of the intraclass correlation coefficient (ICC). With the exception of one item concerning chewing duration, all items showed good to excellent intra-observer agreement (ICC students: 0.73-1.0). With the exception of chewing duration and number of swallows, inter-observer agreement was fair to excellent for all items (ICC experts: 0.68-1.0 and ICC students: 0.42-1.0). Results indicate that this tool is a feasible instrument and could be used in clinical practice after further research is completed on the reliability of the tool. © 2013 Blackwell Publishing Ltd.

A Composite Indicator to Assess the Quality of Care in the Management of Patients With Rheumatoid Arthritis in Outpatient Rheumatology Clinics.

PubMed

Martín-Martínez, María Auxiliadora; Andreu-Sanchez, Jose Luis; Sanchez-Alonso, Fernando; Corominas, Hector; Perez-Venegas, Jose Javier; Roman-Ivorra, Jose Andres; Alperi, Mercedes; Blanco-Alonso, Ricardo; Caliz, Rafael; Chamizo-Carmona, Eugenio; Graña-Gil, Jenaro; Hernández, Blanca; Marras, Carlos; Mazzucchelli, Ramon; Medina Luezas, Julio Antonio; Naranjo-Hernández, Antonio; Ortiz, Ana; Roselló, Rosa; Sanchez-Nievas, Ginés; Sanmartí, Raimon; Vela-Casasempere, Paloma

2017-08-05

The current guidelines in the treatment of rheumatoid arthritis (RA) include the early diagnosis and early use of disease modifying drugs to achieve remission or low disease activity level, known as "Treat to Target" (T2T). The objective of this study is to develop a composite indicator (CI) to evaluate the quality of care in the management of patients with RA, according to the T2T strategy and other general recommendations concerning the management of these patients. The phases of the construction of the CI were: 1) selection of quality criteria through expert judgment; 2) prioritization of the criteria, according to relevance and feasibility, applying the Delphi methodology (two rounds) involving 20 experts; 3) design of quality indicators; and 4) calculation of the weighted CI, using the mean value in relevance and feasibility granted by the experts. The source of information for the calculation of the CI are the medical records of patients with RA. Twelve criteria out of 37 required a second Delphi round. Thirty-one criteria were prioritized. These criteria presented a median in relevance and feasibility greater than or equal to 7.5, with an interquartile range of less than 3.5, and a level of agreement (score greater than or equal to 8) greater than or equal to 80%. The constructed CI allows us to evaluate the quality of care of patients with RA following the T2T strategy in the rheumatology units of Spanish hospitals, offering a valid and easily interpretable summary measure. Copyright © 2017 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Operationalising elaboration theory for simulation instruction design: a Delphi study.

PubMed

Haji, Faizal A; Khan, Rabia; Regehr, Glenn; Ng, Gary; de Ribaupierre, Sandrine; Dubrowski, Adam

2015-06-01

The aim of this study was to assess the feasibility of incorporating the Delphi process within the simplifying conditions method (SCM) described in elaboration theory (ET) to identify conditions impacting the complexity of procedural skills for novice learners. We generated an initial list of conditions impacting the complexity of lumbar puncture (LP) from key informant interviews (n = 5) and a literature review. Eighteen clinician-educators from six different medical specialties were subsequently recruited as expert panellists. Over three Delphi rounds, these panellists rated: (i) their agreement with the inclusion of the simple version of the conditions in a representative ('epitome') training scenario, and (ii) how much the inverse (complex) version increases LP complexity for a novice. Cronbach's α-values were used to assess inter-rater agreement. All panellists completed Rounds 1 and 2 of the survey and 17 completed Round 3. In Round 1, Cronbach's α-values were 0.89 and 0.94 for conditions that simplify and increase LP complexity, respectively; both values increased to 0.98 in Rounds 2 and 3. With the exception of 'high CSF (cerebral spinal fluid) pressure', panellists agreed with the inclusion of all conditions in the simplest (epitome) training scenario. Panellists rated patient movement, spinal anatomy, patient cooperativeness, body habitus, and the presence or absence of an experienced assistant as having the greatest impact on the complexity of LP. This study demonstrated the feasibility of using expert consensus to establish conditions impacting the complexity of procedural skills, and the benefits of incorporating the Delphi method into the SCM. These data can be used to develop and sequence simulation scenarios in a progressively challenging manner. If the theorised learning gains associated with ET are realised, the methods described in this study may be applied to the design of simulation training for other procedural and non-procedural skills, thereby advancing the agenda of theoretically based instruction design in health care simulation. © 2015 John Wiley & Sons Ltd.

A core outcome set for evaluating self-management interventions in people with comorbid diabetes and severe mental illness: study protocol for a modified Delphi study and systematic review.

PubMed

Taylor, Johanna; Böhnke, Jan R; Wright, Judy; Kellar, Ian; Alderson, Sarah L; Hughes, Tom; Holt, Richard I G; Siddiqi, Najma

2017-02-14

People with diabetes and comorbid severe mental illness (SMI) form a growing population at risk of increased mortality and morbidity compared to those with diabetes or SMI alone. There is increasing interest in interventions that target diabetes in SMI in order to help to improve physical health and reduce the associated health inequalities. However, there is a lack of consensus about which outcomes are important for this comorbid population, with trials differing in their focus on physical and mental health. A core outcome set, which includes outcomes across both conditions that are relevant to patients and other key stakeholders, is needed. This study protocol describes methods to develop a core outcome set for use in effectiveness trials of self-management interventions for adults with comorbid type-2 diabetes and SMI. We will use a modified Delphi method to identify, rank, and agree core outcomes. This will comprise a two-round online survey and multistakeholder workshops involving patients and carers, health and social care professionals, health care commissioners, and other experts (e.g. academic researchers and third sector organisations). We will also select appropriate measurement tools for each outcome in the proposed core set and identify gaps in measures, where these exist. The proposed core outcome set will provide clear guidance about what outcomes should be measured, as a minimum, in trials of interventions for people with coexisting type-2 diabetes and SMI, and improve future synthesis of trial evidence in this area. We will also explore the challenges of using online Delphi methods for this hard-to-reach population, and examine differences in opinion about which outcomes matter to diverse stakeholder groups. COMET registration: http://www.comet-initiative.org/studies/details/911 . Registered on 1 July 2016.

Current and Emerging Ethical Issues in Counseling: A Delphi Study of Expert Opinions

ERIC Educational Resources Information Center

Herlihy, Barbara; Dufrene, Roxane L.

2011-01-01

A Delphi study was conducted to ascertain the opinions of panel experts regarding the most important current and emerging ethical issues facing the counseling profession. Expert opinions on ethical issues in counselor preparation also were sought. Eighteen panelists responded to 3 rounds of data collection interspersed with feedback. Themes that…

Development of a School Nursing Research Agenda in Florida: A Delphi Study

ERIC Educational Resources Information Center

Gordon, Shirley C.; Barry, Charlotte D.

2006-01-01

Research is important to the image, visibility, and viability of school nursing. Each state school nursing association should evaluate member commitment to school nursing research based on their unique set of financial, educational, and organizational resources. A 3-round Delphi study was conducted in which Florida school nurses identified…

Rehabilitation Counselor Competencies When Working With Hispanic/Latino Immigrant Injured Workers: A Delphi Study

ERIC Educational Resources Information Center

Santos Román, Leslie M.; Estrada-Hernández, Noel

2017-01-01

Purpose: To explore and identify attitudes, knowledge, and skills rehabilitation practitioners in the private sector need when working with Hispanic/Latino immigrant injured workers. Methods: This study employed a 3-round Delphi study to obtain a consensus of 8 rehabilitation practitioners who had experience and expertise working with…

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists

PubMed Central

2017-01-01

Purpose This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. Methods A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects’ responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Results Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Conclusion Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience. PMID:28900069

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists.

PubMed

Hwang, Yoon-Sook; Kang, Hyun-Sook; Kim, Soo-Hwa; Moon, Hee-Jung; Lee, Sun-Mi; Jung, Jae-Yeon; Hwang, Su-Jeong; Ha, Jung-Eun

2017-01-01

This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects' responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience.

International definition of a point-of-care test in family practice: a modified e-Delphi procedure.

PubMed

Schols, Angel M R; Dinant, Geert-Jan; Hopstaken, Rogier; Price, Christopher P; Kusters, Ron; Cals, Jochen W L

2018-01-29

The use of point-of-care tests (POCTs) in family practice is increasing, and the term POCT is often used in medical literature and clinical practice. Yet, no widely supported definition by several professional fields exists. To reach consensus on an international definition of a POCT in family practice. We performed a modified international e-Delphi procedure of four rounds among expert panel members from different professional backgrounds-family practitioners, laboratory specialists, policymakers, researchers and manufacturers. Of 27 panel members from seven different countries, 26 participated in all rounds. Most panel members were active in POCT research or policymaking and 70% worked in family medicine. After choosing important components, structuring of answers and feedback, the following definition was chosen as the best or second best definition by 81% of panel members: a point-of-care test in family practice is a test to support clinical decision making, which is performed by a qualified member of the practice staff nearby the patient and on any part of the patient's body or its derivatives, during or very close to the time of consultation, to help the patient and physician to decide upon the best suited approach, and of which the results should be known at the time of the clinical decision making. The definition emerging from this study can inform family practitioners, laboratory specialists, policymakers and manufacturers on the most widely supported and recognized definition and could act as a clear starting point for the organization and execution of professional point-of-care testing in family practice worldwide. © The Author(s) 2018. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

[Applying the Modified Delphi Technique to Develop the Role of HIV Case Managers and Essential Nursing Competencies in HIV Care].

PubMed

Ko, Nai-Ying; Hsieh, Chia-Yin; Chen, Yen-Chin; Tsai, Chen-Hsi; Liu, Hsiao-Ying; Liu, Li-Fang

2015-08-01

Since 2005, the Taiwan Centers for Disease Control (Taiwan CDC) initiated an HIV case management program in AIDS-designated hospitals to provide integrative services and risk-reduction counseling for HIV-infected individuals. In light of the increasingly complex and highly specialized nature of clinical care, expanding and improving competency-based professional education is important to enhance the quality of HIV/AIDS care. The aim of this study was to develop the essential competency framework for HIV care for HIV case managers in Taiwan. We reviewed essential competencies of HIV care from Canada, the United Kingdom, and several African countries and devised descriptions of the roles of case managers and of the associated core competencies for HIV care in Taiwan. The modified Delphi technique was used to evaluate the draft framework of these roles and core competencies. A total of 15 HIV care experts were invited to join the expert panel to review and rank the draft framework. The final framework consisted of 7 roles and 27 competencies for HIV case managers. In Round 1, only 3 items did not receive consensus approval from the experts. After modification based on opinions of the experts, 7 roles and 27 competencies received 97.06% consensus approval in Round 2 and were organized into the final framework for HIV case managers. These roles and associated core competencies were: HIV Care Expert (9 competencies), Communicator (1 competency), Collaborator (4 competencies), Navigator (2 competencies), Manager (4 competencies), Advocate (2 competencies), and Professional (5 competencies). The authors developed an essential competency framework for HIV care using the consensus of a multidisciplinary expert panel. Curriculum developers and advanced nurses and practitioners may use this framework to support developments and to ensure a high quality of HIV care.

Consensus-based training and assessment model for general surgery.

PubMed

Szasz, P; Louridas, M; de Montbrun, S; Harris, K A; Grantcharov, T P

2016-05-01

Surgical education is becoming competency-based with the implementation of in-training milestones. Training guidelines should reflect these changes and determine the specific procedures for such milestone assessments. This study aimed to develop a consensus view regarding operative procedures and tasks considered appropriate for junior and senior trainees, and the procedures that can be used as technical milestone assessments for trainee progression in general surgery. A Delphi process was followed where questionnaires were distributed to all 17 Canadian general surgery programme directors. Items were ranked on a 5-point Likert scale, with consensus defined as Cronbach's α of at least 0·70. Items rated 4 or above on the 5-point Likert scale by 80 per cent of the programme directors were included in the models. Two Delphi rounds were completed, with 14 programme directors taking part in round one and 11 in round two. The overall consensus was high (Cronbach's α = 0·98). The training model included 101 unique procedures and tasks, 24 specific to junior trainees, 68 specific to senior trainees, and nine appropriate to all. The assessment model included four procedures. A system of operative procedures and tasks for junior- and senior-level trainees has been developed along with an assessment model for trainee progression. These can be used as milestones in competency-based assessments. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

[Construction of a psychological aging scale for healthy people].

PubMed

Lin, Fei; Long, Yao; Zeng, Ni; Wu, Lei; Huang, Helang

2017-04-28

To construct a psychological aging scale, and to provide a tool and indexes for scientific evaluation on aging.
 Methods: The age-related psychological items were collected through literature screening and expert interview. The importance, feasibilityand the degree of authority for the psychological index system were graded by two rounds of Delphi method. Using analytic hierarchy process, the weight of dimensions and items were determined. The analysis for internal consistency reliability, correlation and exploratory factor was performed to evaluate the reliability and validity of the scales.
 Results: By two rounds of Delphi method, 17 experts offered the results as follows: the coefficient of expert authorities was 0.88±0.06, the coordination coefficients for the importance and feasibility in second round were 0.456 (P<0.01) and 0.666 (P<0.01), respectively. The consistency was good. The psychological aging scale for healthy people included 4 dimensions as follows: cognitive function, emotion, personality and motivation. The weight coefficients for the 4 dimensions were 0.338, 0.250, 0.166 and 0.258, respectively. The Cronbach's α coefficient for the scale was 0.822, the reliability was 0.817, the content validity index (CVI) was 0.847, and the cumulative contribution rate for the 5 factors was51.42%.
 Conclusion: The psychological aging scale is satisfied, which can provide reference for the evaluation for aging. The indicators were representative and well-recognized.

Corruption and oil exploration: expert agreement about the prevention of HIV/AIDS in the Niger Delta of Nigeria

PubMed Central

Udoh, Isidore A.; Stammen, Ronald M.; Mantell, Joanne E.

2008-01-01

The Niger Delta, according to the Nigerian Ministry of Health, has a disproportionately high HIV infection rate, which is double the national average. The United Nations Development Program attributes the spiraling HIV infection rate in the region to poverty, migration and gender inequality. This paper examines two complementary suppositions: Is the high prevalence of HIV in the Niger Delta related to incompetent leadership and corruption? Is it related to the negative effects of oil exploration in the region? Currently, there is a dearth of research on the effectiveness of government programs or the role of the oil industry on the impact of AIDS in Nigeria. To address this gap, we conducted a survey with 27 internationally renowned experts from diverse disciplines using a three-round modified Delphi to formulate consensus about the impact of weak governance and oil corruption on AIDS in the Niger Delta. Results from the Delphi suggest that these factors and others have exacerbated the transmission of HIV in the region. To mitigate the impact of AIDS in the region, efforts to engage oil companies in implementing HIV prevention programs as part of their corporate environmental responsibility to the community are urgently needed. PMID:17906312

Quality pharmacy services and key performance indicators in Polish NICUs: a Delphi approach.

PubMed

Krzyżaniak, Natalia; Pawłowska, Iga; Bajorek, Beata

2018-03-31

Background Currently, there is no literature describing what a quality level of practice entails in Polish neonatal intensive care units (NICUs), nor are there any means of currently measuring the quality of pharmaceutical care provided to NICU patients. Objective To identify a set of essential pharmacist roles and pharmacy-relevant key performance indicators (KPI's) suitable for Polish neonatal intensive units (NICUs). Setting Polish hospital pharmacies and NICUs. Method Using a modified Delphi technique, potential KPI's structured along Donabedian's domains as well as pharmacy services were presented to an expert panel of stakeholders. Two online, consecutive Delphi rounds, were completed by panellists between August and September 2017. Main outcome measure To identify the minimum level of pharmacy services that should be consistently provided to NICU patients. Results A total of 16 panellists contributed to the expert panel. Overall, consensus of 75% was reached for 23 indicators and for 28 roles. When considering pharmacy services for the NICU, the experts were found to highly value traditional pharmacy roles, such as dispensing and extemporaneous compounding, however, they were still eager for roles in the other domains, such as educational and clinical services, to be listed as essential for NICU practice. Panellists were found to positively value the list of indicators presented, and excluded only 9 out of the total list. Conclusion There is a need for future research to establish a minimum standard of practice for Polish pharmacists to encourage the progression and standardisation of hospital pharmacy services to meet the level of practice seen in NICUs worldwide.

Development and face validation of strategies for improving consultation skills.

PubMed

Lefroy, Janet; Thomas, Adam; Harrison, Chris; Williams, Stephen; O'Mahony, Fidelma; Gay, Simon; Kinston, Ruth; McKinley, R K

2014-12-01

While formative workplace based assessment can improve learners' skills, it often does not because the procedures used do not facilitate feedback which is sufficiently specific to scaffold improvement. Provision of pre-formulated strategies to address predicted learning needs has potential to improve the quality and automate the provision of written feedback. To systematically develop, validate and maximise the utility of a comprehensive list of strategies for improvement of consultation skills through a process involving both medical students and their clinical primary and secondary care tutors. Modified Delphi study with tutors, modified nominal group study with students with moderation of outputs by consensus round table discussion by the authors. 35 hospital and 21 GP tutors participated in the Delphi study and contributed 153 new or modified strategies. After review of these and the 205 original strategies, 265 strategies entered the nominal group study to which 46 year four and five students contributed, resulting in the final list of 249 validated strategies. We have developed a valid and comprehensive set of strategies which are considered useful by medical students. This list can be immediately applied by any school which uses the Calgary Cambridge Framework to inform the content of formative feedback on consultation skills. We consider that the list could also be mapped to alternative skills frameworks and so be utilised by schools which do not use the Calgary Cambridge Framework.

Developing consensus-based policy solutions for medicines adherence for Europe: a delphi study

PubMed Central

2012-01-01

Background Non-adherence to prescribed medication is a pervasive problem that can incur serious effects on patients’ health outcomes and well-being, and the availability of resources in healthcare systems. This study aimed to develop practical consensus-based policy solutions to address medicines non-adherence for Europe. Methods A four-round Delphi study was conducted. The Delphi Expert Panel comprised 50 participants from 14 countries and was representative of: patient/carers organisations; healthcare providers and professionals; commissioners and policy makers; academics; and industry representatives. Participants engaged in the study remotely, anonymously and electronically. Participants were invited to respond to open questions about the causes, consequences and solutions to medicines non-adherence. Subsequent rounds refined responses, and sought ratings of the relative importance, and operational and political feasibility of each potential solution to medicines non-adherence. Feedback of individual and group responses was provided to participants after each round. Members of the Delphi Expert Panel and members of the research group participated in a consensus meeting upon completion of the Delphi study to discuss and further refine the proposed policy solutions. Results 43 separate policy solutions to medication non-adherence were agreed by the Panel. 25 policy solutions were prioritised based on composite scores for importance, and operational and political feasibility. Prioritised policy solutions focused on interventions for patients, training for healthcare professionals, and actions to support partnership between patients and healthcare professionals. Few solutions concerned actions by governments, healthcare commissioners, or interventions at the system level. Conclusions Consensus about practical actions necessary to address non-adherence to medicines has been developed for Europe. These actions are also applicable to other regions. Prioritised policy solutions for medicines non-adherence offer a benefit to policymakers and healthcare providers seeking to address this multifaceted, complex problem. PMID:23176439

Using a Delphi consensus process to develop an acupuncture treatment protocol by consensus for women undergoing Assisted Reproductive Technology (ART) treatment

PubMed Central

2012-01-01

Background Assisted reproductive technologies (ART) are increasingly utilised for resolving difficulties conceiving. These technologies are expensive to both the public purse and the individual consumers. Acupuncture is widely used as an adjunct to ART with indications that it may assist reducing the time to conception and increasing live birth rates. Heterogeneity is high between treatment protocols. The aim of this study was to examine what fertility acupuncturists consider key components of best practice acupuncture during an ART cycle, and to establish an acupuncture protocol by consensus. Methods Fifteen international acupuncturists with extensive experience treating women during ART interventions participated in 3 rounds of Delphi questionnaires. The first round focused on identifying the parameters of acupuncture treatment as adjunct to ART, the second round evaluated statements derived from the earlier round, and the third evaluated specific parameters for a proposed trial protocol. Consensus was defined as greater than 80% agreement. Results Significant agreement was achieved on the parameters of best practice acupuncture, including an acupuncture protocol suitable for future research. Study participants confirmed the importance of needling aspects relating to the dose of acupuncture, the therapeutic relationship, tailoring treatment to the individual, and the role of co-interventions. From two rounds of the Delphi a consensus was achieved on seven treatment parameters for the design of the acupuncture treatment to be used in a clinical trial of acupuncture as an adjunct to ART. The treatment protocol includes the use of the traditional Chinese medicine acupuncture, use of manual acupuncture, a first treatment administered between day 6–8 of the stimulated ART cycle which is individualised to the participant, two treatments will be administered on the day of embryo transfer, and will include points SP8, SP10, LR3, ST29, CV4, and post transfer include: GV20, KD3, ST36, SP6, and PC6. Auricular points Shenmen and Zigong will be used. Practitioner intent or yi will be addressed in the treatment protocol. Conclusions Despite a lack of homogeneity in the research and clinical literature on ART and acupuncture, a consensus amongst experts on key components of a best practice treatment protocol was possible. Such consensus offers guidance for further research. PMID:22769059

Designing a Standardized Laparoscopy Curriculum for Gynecology Residents: A Delphi Approach

PubMed Central

Shore, Eliane M.; Lefebvre, Guylaine G.; Husslein, Heinrich; Bjerrum, Flemming; Sorensen, Jette Led; Grantcharov, Teodor P.

2015-01-01

Background Evidence suggests that simulation leads to improved operative skill, shorter operating room time, and better patient outcomes. Currently, no standardized laparoscopy curriculum exists for gynecology residents. Objective To design a structured laparoscopy curriculum for gynecology residents using Delphi consensus methodology. Methods This study began with Delphi methodology to determine expert consensus on the components of a gynecology laparoscopic skills curriculum. We generated a list of cognitive content, technical skills, and nontechnical skills for training in laparoscopic surgery, and asked 39 experts in gynecologic education to rate the items on a Likert scale (1–5) for inclusion in the curriculum. Consensus was predefined as Cronbach α of ≥ 0.80. We then conducted another Delphi survey with 9 experienced users of laparoscopic virtual reality simulators to delineate relevant curricular tasks. Finally, a cross-sectional design defined benchmark scores for all identified tasks, with 10 experienced gynecologic surgeons performing the identified tasks at basic, intermediate, and advanced levels. Results Consensus (Cronbach α = 0.85) was achieved in the first round of the curriculum Delphi, and after 2 rounds (Cronbach α = 0.80) in the virtual reality curriculum Delphi. Consensus was reached for cognitive, technical, and nontechnical skills as well as for 6 virtual reality tasks. Median time and economy of movement scores defined benchmarks for all tasks. Conclusions This study used Delphi consensus to develop a comprehensive curriculum for teaching gynecologic laparoscopy. The curriculum conforms to current educational standards of proficiency-based training, and is suggested as a standard in residency programs. PMID:26221434

Quality indicators for in-hospital geriatric co-management programmes: a systematic literature review and international Delphi study.

PubMed

Van Grootven, Bastiaan; McNicoll, Lynn; Mendelson, Daniel A; Friedman, Susan M; Fagard, Katleen; Milisen, Koen; Flamaing, Johan; Deschodt, Mieke

2018-03-16

To find consensus on appropriate and feasible structure, process and outcome indicators for the evaluation of in-hospital geriatric co-management programmes. An international two-round Delphi study based on a systematic literature review (searching databases, reference lists, prospective citations and trial registers). Western Europe and the USA. Thirty-three people with at least 2 years of clinical experience in geriatric co-management were recruited. Twenty-eight experts (16 from the USA and 12 from Europe) participated in both Delphi rounds (85% response rate). Participants rated the indicators on a nine-point scale for their (1) appropriateness and (2) feasibility to use the indicator for the evaluation of geriatric co-management programmes. Indicators were considered appropriate and feasible based on a median score of seven or higher. Consensus was based on the level of agreement using the RAND/UCLA Appropriateness Method. In the first round containing 37 indicators, there was consensus on 14 indicators. In the second round containing 44 indicators, there was consensus on 31 indicators (structure=8, process=7, outcome=16). Experts indicated that co-management should start within 24 hours of hospital admission using defined criteria for selecting appropriate patients. Programmes should focus on the prevention and management of geriatric syndromes and complications. Key areas for comprehensive geriatric assessment included cognition/delirium, functionality/mobility, falls, pain, medication and pressure ulcers. Key outcomes for evaluating the programme included length of stay, time to surgery and the incidence of complications. The indicators can be used to assess the performance of geriatric co-management programmes and identify areas for improvement. Furthermore, the indicators can be used to monitor the implementation and effect of these programmes. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Characteristics of student preparedness for clinical learning: clinical educator perspectives using the Delphi approach

PubMed Central

2012-01-01

Background During clinical placements, clinical educators facilitate student learning. Previous research has defined the skills, attitudes and practices that pertain to an ideal clinical educator. However, less attention has been paid to the role of student readiness in terms of foundational knowledge and attitudes at the commencement of practice education. Therefore, the aim of this study was to ascertain clinical educators’ views on the characteristics that they perceive demonstrate that a student is well prepared for clinical learning. Methods A two round on-line Delphi study was conducted. The first questionnaire was emailed to a total of 636 expert clinical educators from the disciplines of occupational therapy, physiotherapy and speech pathology. Expert clinical educators were asked to describe the key characteristics that indicate a student is prepared for a clinical placement and ready to learn. Open-ended responses received from the first round were subject to a thematic analysis and resulted in six themes with 62 characteristics. In the second round, participants were asked to rate each characteristic on a 7 point Likert Scale. Results A total of 258 (40.56%) responded to the first round of the Delphi survey while 161 clinical educators completed the second (62.40% retention rate). Consensus was reached on 57 characteristics (six themes) using a cut off of greater than 70% positive respondents and an interquartile deviation IQD of equal or less than 1. Conclusions This study identified 57 characteristics (six themes) perceived by clinical educators as indicators of a student who is prepared and ready for clinical learning. A list of characteristics relating to behaviours has been compiled and could be provided to students to aid their preparation for clinical learning and to universities to incorporate within curricula. In addition, the list provides a platform for discussions by professional bodies about the role of placement education. PMID:23145840

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research.

PubMed

Staniszewska, S; Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. One hundred forty-three participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites.

Development of clinical practice guidelines for supportive care in childhood cancer--prioritization of topics using a Delphi approach.

PubMed

Loeffen, E A H; Mulder, R L; Kremer, L C M; Michiels, E M C; Abbink, F C H; Ball, L M; Segers, H; Mavinkurve-Groothuis, A M C; Smit, F J; Vonk, I J M; Vd Wetering, M D; Tissing, W J E

2015-07-01

Currently, very few guidelines for supportive care for children with cancer exist. In the Netherlands, nationwide guidelines are over 10 years old and mostly based on expert opinion. Consequently, there is growing support and need for clinical practice guidelines (CPGs), which ought to be developed with a well-defined methodology and include a systematic search of literature, evidence summaries, and a transparent description of the decision process for the final recommendations. Development of CPGs is time consuming; therefore, it is important to prioritize topics for which there is the greatest clinical demand. This study aims to prioritize childhood cancer supportive care topics for development of CPGs. A Delphi survey consisting of two rounds was conducted to prioritize relevant childhood cancer supportive care topics for the development of CPGs. A group of experts comprising 15 pediatric oncologists, 15 pediatric oncology nurses, and 15 general pediatricians involved in care for childhood cancer patients were invited to participate. All relevant supportive care topics in childhood cancer were rated. In both rounds, 36 panellists (82%) responded. Agreement between panellists was very good, with an intraclass correlation coefficient of 0.918 (95% confidence interval (CI) = 0.849-0.966, p < 0.001) in round 2. The ten topics with the highest score in the final round were infection, sepsis, febrile neutropenia, pain, nausea/vomiting, restrictions in daily life and activities, palliative care, procedural sedation, terminal care, and oral mucositis. We successfully used a Delphi survey to prioritize childhood cancer supportive care topics for the development of CPGs. This is a first step towards uniform and evidence-based Dutch guidelines in supportive care in childhood cancer. Even though performed nationally, we believe that this study can also be regarded as an example starting point for international development of CPGs in the field of supportive care in cancer or any other field for that matter.

The Underutilization of Information and Communication Technology-Assisted Collaborative Project-Based Learning among International Educators: A Delphi Study

ERIC Educational Resources Information Center

Kramer, Barry S.; Walker, Andrew E.; Brill, Jennifer M.

2007-01-01

This study explores the barriers associated with teachers implementing information and communication technology-assisted collaborative project-based learning (ICTCPrjBL) as a classroom teaching methodology with students. We used a Web-based Delphi method to engage experienced educators in anonymous consensus building consisting of three rounds of…

A Delphi Study on Technology Enhanced Learning (TEL) Applied on Computer Science (CS) Skills

ERIC Educational Resources Information Center

Porta, Marcela; Mas-Machuca, Marta; Martinez-Costa, Carme; Maillet, Katherine

2012-01-01

Technology Enhanced Learning (TEL) is a new pedagogical domain aiming to study the usage of information and communication technologies to support teaching and learning. The following study investigated how this domain is used to increase technical skills in Computer Science (CS). A Delphi method was applied, using three-rounds of online survey…

The Essential Components of Coach Training for Mental Health Professionals: A Delphi Study

ERIC Educational Resources Information Center

Moriarity, Marlene Therese

2010-01-01

Purpose. The purpose of this study was to discover how coach training experts define coaching and what they would identify to be the essential components of a coach training program for mental health professionals. Methods. A panel of nine experts, through an iterative Delphi process of responding to three rounds of questionnaires, provided…

Identifying Core Mobile Learning Faculty Competencies Based Integrated Approach: A Delphi Study

ERIC Educational Resources Information Center

Elbarbary, Rafik Said

2015-01-01

This study is based on the integrated approach as a concept framework to identify, categorize, and rank a key component of mobile learning core competencies for Egyptian faculty members in higher education. The field investigation framework used four rounds Delphi technique to determine the importance rate of each component of core competencies…

How to use the nominal group and Delphi techniques.

PubMed

McMillan, Sara S; King, Michelle; Tully, Mary P

2016-06-01

Introduction The Nominal Group Technique (NGT) and Delphi Technique are consensus methods used in research that is directed at problem-solving, idea-generation, or determining priorities. While consensus methods are commonly used in health services literature, few studies in pharmacy practice use these methods. This paper provides an overview of the NGT and Delphi technique, including the steps involved and the types of research questions best suited to each method, with examples from the pharmacy literature. Methodology The NGT entails face-to-face discussion in small groups, and provides a prompt result for researchers. The classic NGT involves four key stages: silent generation, round robin, clarification and voting (ranking). Variations have occurred in relation to generating ideas, and how 'consensus' is obtained from participants. The Delphi technique uses a multistage self-completed questionnaire with individual feedback, to determine consensus from a larger group of 'experts.' Questionnaires have been mailed, or more recently, e-mailed to participants. When to use The NGT has been used to explore consumer and stakeholder views, while the Delphi technique is commonly used to develop guidelines with health professionals. Method choice is influenced by various factors, including the research question, the perception of consensus required, and associated practicalities such as time and geography. Limitations The NGT requires participants to personally attend a meeting. This may prove difficult to organise and geography may limit attendance. The Delphi technique can take weeks or months to conclude, especially if multiple rounds are required, and may be complex for lay people to complete.

[Medical expert consensus in AH on the clinical use of triple fixed-dose antihypertensive therapy in Spain].

PubMed

Mazón, P; Galve, E; Gómez, J; Gorostidi, M; Górriz, J L; Mediavilla, J D

The opinion of experts (different specialties) on the triple fixed-dose antihypertensive therapy in clinical practice may differ. Online questionnaire with controversial aspects of the triple therapy answered by panel of experts in hypertension (HT) using two-round modified Delphi method. The questionnaire was completed by 158 experts: Internal Medicine (49), Nephrology (26), Cardiology (83). Consensus was reached (agreement) on 27/45 items (60%); 7 items showed differences statistically significant. Consensus was reached regarding: Predictive factors in the need for combination therapy and its efficacy vs. increasing the dose of a pretreatment, and advantage of triple therapy (prescription/adherence/cost/pressure control) vs. free combination. This consensus provides an overview of the clinical use of triple therapy in moderate-severe and resistant/difficult to control HT. Copyright © 2016 SEH-LELHA. Publicado por Elsevier España, S.L.U. All rights reserved.

A consensus definition and core competencies for being an advocate for pharmacy.

PubMed

Bzowyckyj, Andrew S; Janke, Kristin K

2013-03-12

To develop a consensus definition for "advocacy for the profession of pharmacy" and core competencies for doctor of pharmacy (PharmD) graduates to be effective advocates for the profession. A 3-round modified Delphi process was conducted using a panel of 9 experts. Participants revised a definition for "advocacy for the profession" and ultimately rated their agreement using a 5-point Likert scale. Competency statements were developed and subsequently rated for importance for being an advocate and importance to address in PharmD curricula. A consensus-derived definition was developed. Two competency statements achieved consensus for both measures of importance. Four competency statements achieved consensus for only 1 measure and another 4 did not reach consensus for either measure. A consensus-derived definition was developed describing advocacy for the profession of pharmacy and began laying the groundwork for the knowledge and skills necessary to be an effective advocate for the profession of pharmacy.

Core Items for a Standardized Resource Use Measure: Expert Delphi Consensus Survey.

PubMed

Thorn, Joanna C; Brookes, Sara T; Ridyard, Colin; Riley, Ruth; Hughes, Dyfrig A; Wordsworth, Sarah; Noble, Sian M; Thornton, Gail; Hollingworth, William

2018-06-01

Resource use measurement by patient recall is characterized by inconsistent methods and a lack of validation. A validated standardized resource use measure could increase data quality, improve comparability between studies, and reduce research burden. To identify a minimum set of core resource use items that should be included in a standardized adult instrument for UK health economic evaluation from a provider perspective. Health economists with experience of UK-based economic evaluations were recruited to participate in an electronic Delphi survey. Respondents were asked to rate 60 resource use items (e.g., medication names) on a scale of 1 to 9 according to the importance of the item in a generic context. Items considered less important according to predefined consensus criteria were dropped and a second survey was developed. In the second round, respondents received the median score and their own score from round 1 for each item alongside summarized comments and were asked to rerate items. A final project team meeting was held to determine the recommended core set. Forty-five participants completed round 1. Twenty-six items were considered less important and were dropped, 34 items were retained for the second round, and no new items were added. Forty-two respondents (93.3%) completed round 2, and greater consensus was observed. After the final meeting, 10 core items were selected, with further items identified as suitable for "bolt-on" questionnaire modules. The consensus on 10 items considered important in a generic context suggests that a standardized instrument for core resource use items is feasible. Copyright © 2018. Published by Elsevier Inc.

Development of a scale for the evaluation of patients’ rights prerequisites at educational hospitals in Iran: a study using the Delphi technique

PubMed Central

Aazami, Sanaz; Mozafari, Mosayeb

2015-01-01

The patients’ rights status is one of the essential elements in defining norms related to the concept of clinical governance system. In addition, the patients’ rights status is an important index for quality of care offered in the health care system. However, the lack of a coherent instrument makes it difficult to evaluate patients’ rights status in hospitals and clinics. The aim of this study was to develop an instrument for the evaluation of patients’ rights prerequisites at educational hospitals in Iran. This study was conducted using the modified Delphi technique. In this study, 36 experts in the fields of law, medicine, and professional ethics were participated. The panel of experts participated in 3 rounds. First, experts were asked to judge some pre-identified items, and then, excluded items were judged again in the second round. At the end of the third round, all of the agreed items were included in the final list to form an evaluative scale on practice of patients’ rights. Experts were asked to judge a total 171 items in 3 rounds. Around 31% (n = 53) of items obtained the panel’s approval to be included in the final version of the scale. The experts’ opinions were collected using face-to-face interviews and electronic email during a 6-month period of data collection from October 2013 to February 2014. This study developed a 53-item scale for evaluation of patients’ rights prerequisites in educational hospitals in Iran. This scale was developed in 7 areas of commitments including university education, research, supervision, process management, physical structure, organizational policy, and human resources management. This study developed an evaluative scale to assess the practice of patients’ rights in educational hospitals. The items in the final version of this scale were obtained from a consensus of experts and the instrument can be used to evaluate the context and prerequisites for practice of patients’ rights in Iranian educational hospitals. PMID:27354900

Aspects relevant for functioning in patients with ankylosing spondylitis according to the health professionals: a Delphi study with the ICF as reference.

PubMed

Boonen, Annelies; van Berkel, Monique; Kirchberger, Inge; Cieza, Alarcos; Stucki, Gerald; van der Heijde, Désirée

2009-08-01

In AS there is no agreed definition of which aspects are important when describing functioning. This limits the possibility to classify, evaluate and investigate the consequences of the disease. This study aimed to achieve consensus among health professionals on which aspects of functioning are typical and relevant for AS patients using the International Classification of Functioning, Disability and Health (ICF) as reference. An international Delphi study through e-mail was performed among different health professions. Answers to open questions on areas relevant for functioning in the first round were linked to ICF categories and analysed in the two following two rounds for the degree of consensus. Of the 267 experts invited, 126 agreed to participate and 74 participated in all rounds; 28 were rheumatologists, 6 rheumatology nurses, 24 physiotherapists, 2 occupational therapists, 4 psychologists, 8 rehabilitation physicians and 2 social workers. More than 80% agreement was reached on 141 ICF categories, of which 30 (21%) were part of Body functions; 27 (19%) of Body structures; 56 (40%) of Activities and Participation; and 28 (20%) of Environmental factors. In addition, two Personal factors-illness knowledge and coping-were agreed upon. 141 ICF categories and two personal factors represent the reference of functioning in AS from the perspective of health professional. The largest number of categories concerned restrictions in activities. Also, the impact of AS on participation in life situations and the role of environmental factors were underscored. This broadens the view on functioning in AS and has implications for future research into functioning.

Improving Patient Safety in Public Hospitals: Developing Standard Measures to Track Medical Errors and Process Breakdowns.

PubMed

Ackerman, Sara L; Gourley, Gato; Le, Gem; Williams, Pamela; Yazdany, Jinoos; Sarkar, Urmimala

2018-03-14

The aim of the study was to develop standards for tracking patient safety gaps in ambulatory care in safety net health systems. Leaders from five California safety net health systems were invited to participate in a modified Delphi process sponsored by the Safety Promotion Action Research and Knowledge Network (SPARKNet) and the California Safety Net Institute in 2016. During each of the three Delphi rounds, the feasibility and validity of 13 proposed patient safety measures were discussed and prioritized. Surveys and transcripts from the meetings were analyzed to understand the decision-making process. The Delphi process included eight panelists. Consensus was reached to adopt 9 of 13 proposed measures. All 9 measures were unanimously considered valid, but concern was expressed about the feasibility of implementing several of the measures. Although safety net health systems face high barriers to standardized measurement, our study demonstrates that consensus can be reached on acceptable and feasible methods for tracking patient safety gaps in safety net health systems. If accompanied by the active participation key stakeholder groups, including patients, clinicians, staff, data system professionals, and health system leaders, the consensus measures reported here represent one step toward improving ambulatory patient safety in safety net health systems.

How to Choose? Using the Delphi Method to Develop Consensus Triggers and Indicators for Disaster Response.

PubMed

Lis, Rebecca; Sakata, Vicki; Lien, Onora

2017-08-01

To identify key decisions along the continuum of care (conventional, contingency, and crisis) and the critical triggers and data elements used to inform those decisions concerning public health and health care response during an emergency. A classic Delphi method, a consensus-building survey technique, was used with clinicians around Washington State to identify regional triggers and indicators. Additionally, using a modified Delphi method, we combined a workshop and single-round survey with panelists from public health (state and local) and health care coalitions to identify consensus state-level triggers and indicators. In the clinical survey, 122 of 223 proposed triggers or indicators (43.7%) reached consensus and were deemed important in regional decision-making during a disaster. In the state-level survey, 110 of 140 proposed triggers or indicators (78.6%) reached consensus and were deemed important in state-level decision-making during a disaster. The identification of consensus triggers and indicators for health care emergency response is crucial in supporting a comprehensive health care situational awareness process. This can inform the creation of standardized questions to ask health care, public health, and other partners to support decision-making during a response. (Disaster Med Public Health Preparedness. 2017;11:467-472).

Evidence-based algorithm for diagnosis and assessment in psoriatic arthritis: results by Italian DElphi in psoriatic Arthritis (IDEA).

PubMed

Lapadula, G; Marchesoni, A; Salaffi, F; Ramonda, R; Salvarani, C; Punzi, L; Costa, L; Caso, F; Simone, D; Baiocchi, G; Scioscia, C; Di Carlo, M; Scarpa, R; Ferraccioli, G

2016-12-16

Psoriatic arthritis (PsA) is a chronic inflammatory disease involving skin, peripheral joints, entheses, and axial skeleton. The disease is frequently associated with extrarticular manifestations (EAMs) and comorbidities. In order to create a protocol for PsA diagnosis and global assessment of patients with an algorithm based on anamnestic, clinical, laboratory and imaging procedures, we established a DElphi study on a national scale, named Italian DElphi in psoriatic Arthritis (IDEA). After a literature search, a Delphi poll, involving 52 rheumatologists, was performed. On the basis of the literature search, 202 potential items were identified. The steering committee planned at least two Delphi rounds. In the first Delphi round, the experts judged each of the 202 items using a score ranging from 1 to 9 based on its increasing clinical relevance. The questions posed to experts were How relevant is this procedure/observation/sign/symptom for assessment of a psoriatic arthritis patient? Proposals of additional items, not included in the questionnaire, were also encouraged. The results of the poll were discussed by the Steering Committee, which evaluated the necessity for removing selected procedures or adding additional ones, according to criteria of clinical appropriateness and sustainability. A total of 43 recommended diagnosis and assessment procedures, recognized as items, were derived by combination of the Delphi survey and two National Expert Meetings, and grouped in different areas. Favourable opinion was reached in 100% of cases for several aspects covering the following areas: medical (familial and personal) history, physical evaluation, imaging tool, second level laboratory tests, disease activity measurement and extrarticular manifestations. After performing PsA diagnosis, identification of specific disease activity scores and clinimetric approaches were suggested for assessing the different clinical subsets. Further, results showed the need for investigation on the presence of several EAMs and risk factors. In the context of any area, a rank was assigned for each item by Expert Committee members, in order to create the logical sequence of the algorithm. The final list of recommended diagnosis and assessment procedures, by the Delphi survey and the two National Expert Meetings, was also reported as an algorithm. This study shows results obtained by the combination of a DElphi survey of a group of Italian rheumatologists and two National Expert Meetings, created with the aim of establishing a clinical procedure and algorithm for the diagnosis and the assessment of PsA patients. In order to find accurate and practical diagnostic and assessment items in clinical practice, we have focused our attention on evaluating the different PsA domains. Hence, we conceived the IDEA algorithm in order to address PsA diagnosis and assessment in the context of daily clinical practice. The IDEA algorithm might eventually lead to a multidimensional approach and could represent a useful and practical tool for addressing diagnosis and for assessing the disease appropriately. However, the elaborated algorithm needs to be further investigated in daily practice, for evidencing and proving its eventual efficacy in detecting and staging PsA and its heterogeneous spectrum appropriately.

Exploring International Views on Key Concepts for Mass-gathering Health through a Delphi Process.

PubMed

Steenkamp, Malinda; Hutton, Alison E; Ranse, Jamie C; Lund, Adam; Turris, Sheila A; Bowles, Ron; Arbuthnott, Katherine; Arbon, Paul A

2016-08-01

Introduction The science underpinning mass-gathering health (MGH) is developing rapidly. However, MGH terminology and concepts are not yet well defined or used consistently. These variations can complicate comparisons across settings. There is, therefore, a need to develop consensus and standardize concepts and data points to support the development of a robust MGH evidence-base for governments, event planners, responders, and researchers. This project explored the views and sought consensus of international MGH experts on previously published concepts around MGH to inform the development of a transnational minimum data set (MDS) with an accompanying data dictionary (DD). Report A two-round Delphi process was undertaken involving volunteers from the World Health Organization (WHO) Virtual Interdisciplinary Advisory Group (VIAG) on Mass Gatherings (MGs) and the MG section of the World Association for Disaster and Emergency Medicine (WADEM). The first online survey tested agreement on six key concepts: (1) using the term "MG HEALTH;" (2) purposes of the proposed MDS and DD; (3) event phases; (4) two MG population models; (5) a MGH conceptual diagram; and (6) a data matrix for organizing MGH data elements. Consensus was defined as ≥80% agreement. Round 2 presented five refined MGH principles based on Round 1 input that was analyzed using descriptive statistics and content analysis. Thirty-eight participants started Round 1 with 36 completing the survey and 24 (65% of 36) completing Round 2. Agreement was reached on: the term "MGH" (n=35/38; 92%); the stated purposes for the MDS (n=38/38; 100%); the two MG population models (n=31/36; 86% and n=30/36; 83%, respectively); and the event phases (n=34/36; 94%). Consensus was not achieved on the overall conceptual MGH diagram (n=25/37; 67%) and the proposed matrix to organize data elements (n=28/37; 77%). In Round 2, agreement was reached on all the proposed principles and revisions, except on the MGH diagram (n=18/24; 75%). Discussion/Conclusions Event health stakeholders require sound data upon which to build a robust MGH evidence-base. The move towards standardization of data points and/or reporting items of interest will strengthen the development of such an evidence-base from which governments, researchers, clinicians, and event planners could benefit. There is substantial agreement on some broad concepts underlying MGH amongst an international group of MG experts. Refinement is needed regarding an overall conceptual diagram and proposed matrix for organizing data elements. Steenkamp M , Hutton AE , Ranse JC , Lund A , Turris SA , Bowles R , Arbuthnott K , Arbon PA . Exploring international views on key concepts for mass-gathering health through a Delphi process. Prehosp Disaster Med. 2016;31(4):443-453.

Pharmacy executive leadership issues and associated skills, knowledge, and abilities.

PubMed

Meadows, Andrew B; Maine, Lucinda L; Keyes, Elizabeth K; Pearson, Kathy; Finstuen, Kenn

2005-01-01

To identify challenges that current and future pharmacy executives are facing or will face in the future and to define what skills, knowledge, and abilities (SKAs) are required to successfully negotiate these challenges. Delphi method for executive decision making. Civilian pharmacy profession. 110 pharmacists who graduated from the GlaxoSmithKline Executive Management Program for Pharmacy Leaders. Two iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants were asked to identify five major issues they believed to be of greatest importance to pharmacy leaders in the next 5-10 years and name specific SKAs that might be needed by future leaders to successfully deal with those issues. An expert panel reviewed the issues, classified issues into specific domains, and titled each domain. Round 2-participants rated the SKAs on a 7-point scale according to their individual assessment of importance in each domain. For Delphi rounds 1 and 2, response rates were 21.8% and 18.2%, respectively. More than 100 total issue statements were identified. The expert panel sorted the issues into five domains: management and development of the pharmacy workforce, pharmacy finance, total quality management of work-flow systems, influences on the practice of pharmacy, and professional pharmacy leadership. Five of the top 15 SKAs-and all four highest ranked items--came from the professional pharmacy leadership domain, including ability to see the big picture, ability to demonstrate the value of pharmacy services, ability to lead and manage in an ethical manner, and skills for influencing an organization's senior leadership. Through successful integration of communication skills, critical thinking, and problem solving techniques, future public-sector pharmacy executives will be better equipped to effectively position their organizations and the profession for the challenges that lie ahead.

Surviving critical illness: what is next? An expert consensus statement on physical rehabilitation after hospital discharge.

PubMed

Major, M E; Kwakman, R; Kho, M E; Connolly, B; McWilliams, D; Denehy, L; Hanekom, S; Patman, S; Gosselink, R; Jones, C; Nollet, F; Needham, D M; Engelbert, R H H; van der Schaaf, M

2016-10-29

The study objective was to obtain consensus on physical therapy (PT) in the rehabilitation of critical illness survivors after hospital discharge. Research questions were: what are PT goals, what are recommended measurement tools, and what constitutes an optimal PT intervention for survivors of critical illness? A Delphi consensus study was conducted. Panelists were included based on relevant fields of expertise, years of clinical experience, and publication record. A literature review determined five themes, forming the basis for Delphi round one, which was aimed at generating ideas. Statements were drafted and ranked on a 5-point Likert scale in two additional rounds with the objective to reach consensus. Results were expressed as median and semi-interquartile range, with the consensus threshold set at ≤0.5. Ten internationally established researchers and clinicians participated in this Delphi panel, with a response rate of 80 %, 100 %, and 100 % across three rounds. Consensus was reached on 88.5 % of the statements, resulting in a framework for PT after hospital discharge. Essential handover information should include information on 15 parameters. A core set of outcomes should test exercise capacity, skeletal muscle strength, function in activities of daily living, mobility, quality of life, and pain. PT interventions should include functional exercises, circuit and endurance training, strengthening exercises for limb and respiratory muscles, education on recovery, and a nutritional component. Screening tools to identify impairments in other health domains and referral to specialists are proposed. A consensus-based framework for optimal PT after hospital discharge is proposed. Future research should focus on feasibility testing of this framework, developing risk stratification tools and validating core outcome measures for ICU survivors.

POPI (Pediatrics: Omission of Prescriptions and Inappropriate Prescriptions): Development of a Tool to Identify Inappropriate Prescribing

PubMed Central

Prot-Labarthe, Sonia; Weil, Thomas; Angoulvant, François; Boulkedid, Rym; Alberti, Corinne; Bourdon, Olivier

2014-01-01

Introduction Rational prescribing for children is an issue for all countries and has been inadequately studied. Inappropriate prescriptions, including drug omissions, are one of the main causes of medication errors in this population. Our aim is to develop a screening tool to identify omissions and inappropriate prescriptions in pediatrics based on French and international guidelines. Methods A selection of diseases was included in the tool using data from social security and hospital statistics. A literature review was done to obtain criteria which could be included in the tool called POPI. A 2-round-Delphi consensus technique was used to establish the content validity of POPI; panelists were asked to rate their level of agreement with each proposition on a 9-point Likert scale and add suggestions if necessary. Results 108 explicit criteria (80 inappropriate prescriptions and 28 omissions) were obtained and submitted to a 16-member expert panel (8 pharmacists, 8 pediatricians hospital-based −50%- or working in community −50%-). Criteria were categorized according to the main physiological systems (gastroenterology, respiratory infections, pain, neurology, dermatology and miscellaneous). Each criterion was accompanied by a concise explanation as to why the practice is potentially inappropriate in pediatrics (including references). Two round of Delphi process were completed via an online questionnaire. 104 out of the 108 criteria submitted to experts were selected after 2 Delphi rounds (79 inappropriate prescriptions and 25 omissions). Discussion Conclusion POPI is the first screening-tool develop to detect inappropriate prescriptions and omissions in pediatrics based on explicit criteria. Inter-user reliability study is necessary before using the tool, and prospective study to assess the effectiveness of POPI is also necessary. PMID:24978045

Developing a Clinician Friendly Tool to Identify Useful Clinical Practice Guidelines: G-TRUST.

PubMed

Shaughnessy, Allen F; Vaswani, Akansha; Andrews, Bonnie K; Erlich, Deborah R; D'Amico, Frank; Lexchin, Joel; Cosgrove, Lisa

2017-09-01

Clinicians are faced with a plethora of guidelines. To rate guidelines, they can select from a number of evaluation tools, most of which are long and difficult to apply. The goal of this project was to develop a simple, easy-to-use checklist for clinicians to use to identify trustworthy, relevant, and useful practice guidelines, the Guideline Trustworthiness, Relevance, and Utility Scoring Tool (G-TRUST). A modified Delphi process was used to obtain consensus of experts and guideline developers regarding a checklist of items and their relative impact on guideline quality. We conducted 4 rounds of sampling to refine wording, add and subtract items, and develop a scoring system. Multiple attribute utility analysis was used to develop a weighted utility score for each item to determine scoring. Twenty-two experts in evidence-based medicine, 17 developers of high-quality guidelines, and 1 consumer representative participated. In rounds 1 and 2, items were rewritten or dropped, and 2 items were added. In round 3, weighted scores were calculated from rankings and relative weights assigned by the expert panel. In the last round, more than 75% of experts indicated 3 of the 8 checklist items to be major indicators of guideline usefulness and, using the AGREE tool as a reference standard, a scoring system was developed to identify guidelines as useful, may not be useful, and not useful. The 8-item G-TRUST is potentially helpful as a tool for clinicians to identify useful guidelines. Further research will focus on its reliability when used by clinicians. © 2017 Annals of Family Medicine, Inc.

Validating competencies for an undergraduate training program in rural medicine using the Delphi technique.

PubMed

Gouveia, Eneline Ah; Braga, Taciana D; Heráclio, Sandra A; Pessoa, Bruno Henrique S

2016-01-01

Worldwide, half the population lives in rural or remote areas; however, less than 25% of doctors work in such regions. Despite the continental dimensions of Brazil and its enormous cultural diversity, only some medical schools in this country offer students the opportunity to acquire work experience focused on medicine in rural or remote areas. The objective of the present study was to develop a framework of competencies for a longitudinal medical training program in rural medicine as an integrated part of medical training in Brazil. Two rounds of a modified version of the Delphi technique were conducted. Initially, a structured questionnaire was elaborated, based on a literature review. This questionnaire was submitted to the opinion of 20 panelists affiliated with the Rural Medicine Working Party of the Brazilian Society of Family and Community Medicine. The panelists were asked to evaluate the relevance of the competencies using a five-point Likert-type scale. In this study, the consensus criterion for a competency to be included in the framework was it being deemed 'very important' or 'indispensable' by a simple majority of the participants, while the criterion for excluding a competency was that a simple majority of the panel members considered that it 'should not be included' or was 'of little importance'. When a consensus was not reached regarding a given competency, it was submitted to a second round to enable the panelists to re-evaluate the now dichotomized questions. Compliance in responding to the questionnaire was better among the panelists predominantly involved in teaching activities (85%; n=12) compared to those working principally in patient care (45%; n=8). The questionnaire consisted of 26 core competencies and 165 secondary competencies. After evaluation by the specialists, all the 26 core competencies were classified as relevant, with none being excluded and only eight secondary competencies failing to achieve a consensus. No new competencies were suggested. Of the competencies that failed to reach a consensus in the first round, seven were excluded from the framework in the second round, with most of these being associated with hospital procedures. A framework of competencies for a program in rural medicine was developed and validated. It consists of 26 core competencies and 158 secondary competencies that should be useful when constructing competency-based curricula in rural medicine for medical education in Brazil.

What Is Standard Care for People with Learning Disabilities and Behaviour That Challenges and What Does It Cost?

ERIC Educational Resources Information Center

Iemmi, Valentina; Knapp, Martin; Gore, Nick; Cooper, Vivien; Brown, Freddy Jackson; Reid, Caroline; Saville, Maria

2016-01-01

Background: We describe current care arrangements in England for children, young people and adults with learning disabilities and behaviour that challenges, and estimate their comparative costs. Materials and Methods: A two-round Delphi exercise was performed in March and April 2014, followed by a costing exercise. Results: The study finds a mixed…

Establishing a Taxonometric Structure for the Study of Biotechnology in Secondary School Technology Education.

ERIC Educational Resources Information Center

Wells, John G.

1994-01-01

A Delphi panel of 19 experts identified 8 main knowledge areas of biotechnology: bioprocessing, foundations, genetic engineering, agriculture, biochemistry, medicine, environment, and bioethics. Round 2 elicited 84 subdivisions and round 3 adjusted the ratings. The resulting classification suggests a different context and focus for technology…

Devising a consensus definition and framework for non-technical skills in healthcare to support educational design: A modified Delphi study.

PubMed

Gordon, Morris; Baker, Paul; Catchpole, Ken; Darbyshire, Daniel; Schocken, Dawn

2015-01-01

Non-technical skills are a subset of human factors that focus on the individual and promote safety through teamwork and awareness. There is no widely adopted competency- or outcome-based framework for non-technical skills training in healthcare. The authors set out to devise such a framework using a modified Delphi approach. An exhaustive list of published and team suggested items was presented to the expert panel for ranking and to propose a definition. In the second round, a focused list was presented, as well as the proposed definition elements. The finalised framework was sent to the panel for review. Sixteen experts participated. The final framework consists of 16 competencies for all and eight specific competencies for team leaders. The consensus definition describes non-technical skills as "a set of social (communication and team work) and cognitive (analytical and personal behaviour) skills that support high quality, safe, effective and efficient inter-professional care within the complex healthcare system". The authors have produced a new competency framework, through the works of an International expert panel, which is not discipline specific that can be used by curriculum developers, educational innovators and clinical teachers to support developments in the field.

Developing a Physiotherapy-Specific Preliminary Clinical Decision-Making Tool for Oxygen Titration: A Modified Delphi Study

PubMed Central

Duong, Michelle; Bertin, Kendra; Henry, Renee; Singh, Deepti; Timmins, Nolla; Brooks, Dina; Mathur, Sunita

2014-01-01

ABSTRACT Purpose: To develop and evaluate a preliminary clinical decision-making tool (CDMT) to assist physiotherapists in titrating oxygen for acutely ill adults in Ontario. Methods: A panel of 14 experienced cardiorespiratory physiotherapists was recruited. Factors relating to oxygen titration were identified using a modified Delphi technique. Four rounds of questionnaires were conducted, during which the goals were to (1) generate factors, (2) reduce factors and debate contentious factors, (3) finalize factors and develop the preliminary CDMT, and (4) evaluate the usability of the tool in a clinical context. Results: The panel reached consensus on a total of 89 factors, which were compiled to create the preliminary CDMT. The global tool reached consensus for sensibility, receiving a mean score of 6/7 on a 7-point Likert-type scale (1=unacceptable; 7=excellent). Five of the nine individual components of evaluation of the tool achieved scores ≥6.0; the remaining four had mean scores between 5.4 and 5.9. Conclusion: This study produced a preliminary CDMT for oxygen titration, which the panel agreed was highly comprehensible and globally sensible. Further research is necessary to evaluate the sensibility and applicability of the tool in a clinical setting. PMID:25125782

[Episodic breathlessness: translation and consenting of the international definition using the Delphi method].

PubMed

Simon, S T; Weingärtner, V; Voltz, R; Bausewein, C

2014-10-01

Similar to pain, refractory breathlessness can occur episodically. Episodic Breathlessness is a distressing symptom in patients with advanced life-limiting disease. The lack of a universal definition impedes symptom understanding in clinical practice and effective management, respectively. The aim of the study was to formally consent a German translation of the English definition and terminology of episodic breathlessness. A web-based Delphi survey was conducted with German breathlessness experts (breathlessness working group of Germany's National Guideline (S3) for Palliative Care). Drafts of German-language definitions und terminology were assessed using structured questionnaires by binary rating or rankings, respectively. Optional comments were analysed by content analysis. Consensus was defined by ≥ 70% agreement among participants. In two resulting Delphi-rounds 8/16 (50%) und 11/16 (69%) experts, 30-59 years of age, 50%/55% female, participated. After the second round, consensus was reached for the symptom's description "Atemnotattacke" (73%) and a German-language definition (90%). The terms "vorhersehbar" vs. "unvorhersehbar" were directly consented for the categorization (88%). The formally consented German definition and terminology of episodic breathlessness enable clearer symptom understanding and provide a precise basis for education and research on the symptom and its management also in Germany. Effective management options are warranted to improve quality of life of suffering patients and their relatives. © Georg Thieme Verlag KG Stuttgart · New York.

Consulting the oracle: ten lessons from using the Delphi technique in nursing research.

PubMed

Keeney, Sinead; Hasson, Felicity; McKenna, Hugh

2006-01-01

The aim of this paper was to provide insight into the Delphi technique by outlining our personal experiences during its use over a 10-year period in a variety of applications. As a means of achieving consensus on an issue, the Delphi research method has become widely used in healthcare research generally and nursing research in particular. The literature on this technique is expanding, mainly addressing what it is and how it should be used. However, there is still much confusion and uncertainty surrounding it, particularly about issues such as modifications, consensus, anonymity, definition of experts, how 'experts' are selected and how non-respondents are pursued. This issues that arise when planning and carrying out a Delphi study include the definition of consensus; the issue of anonymity vs. quasi-anonymity for participants; how to estimate the time needed to collect the data, analyse each 'round', feed back results to participants, and gain their responses to this feedback; how to define and select the 'experts' who will be asked to participate; how to enhance response rates; and how many 'rounds' to conduct. Many challenges and questions are raised when using the Delphi technique, but there is no doubt that it is an important method for achieving consensus on issues where none previously existed. Researchers need to adapt the method to suit their particular study.

Experience of Delphi technique in the process of establishing consensus on core competencies.

PubMed

Raghav, Pankaja Ravi; Kumar, Dewesh; Bhardwaj, Pankaj

2016-01-01

The Department of Community Medicine and Family Medicine (CMFM) has been started as a new model for imparting the components of family medicine and delivering health-care services at primary and secondary levels in all six newly established All India Institute of Medical Sciences (AIIMS), but there is no competency-based curriculum for it. The paper aims to share the experience of Delphi method in the process of developing consensus on core competencies of the new model of CMFM in AIIMS for undergraduate medical students in India. The study adopted different approaches and methods, but Delphi was the most critical method used in this research. In Delphi, the experts were contacted by e-mail and their feedback on the same was analyzed. Two rounds of Delphi were conducted in which 150 participants were contacted in Delphi-I but only 46 responded. In Delphi-II, 26 participants responded whose responses were finally considered for analysis. Three of the core competencies namely clinician, primary-care physician, and professionalism were agreed by all the participants, and the least agreement was observed in the competencies of epidemiologist and medical teacher. The experts having more experience were less consistent as responses were changed from agree to disagree in more than 15% of participants and 6% changed from disagree to agree. Within the given constraints, the final list of competencies and skills for the discipline of CMFM compiled after the Delphi process will provide a useful insight into the development of competency-based curriculum of the subject.

Validation of public health competencies and impact variables for low- and middle-income countries.

PubMed

Zwanikken, Prisca Ac; Alexander, Lucy; Huong, Nguyen Thanh; Qian, Xu; Valladares, Laura Magana; Mohamed, Nazar A; Ying, Xiao Hua; Gonzalez-Robledo, Maria Cecilia; Linh, Le Cu; Wadidi, Marwa Se Abuzaid; Tahir, Hanan; Neupane, Sunisha; Scherpbier, Albert

2014-01-20

The number of Master of Public Health (MPH) programmes in low- and middle-income countries (LMICs) is increasing, but questions have been raised regarding the relevance of their outcomes and impacts on context. Although processes for validating public health competencies have taken place in recent years in many high-income countries, validation in LMICs is needed. Furthermore, impact variables of MPH programmes in the workplace and in society have not been developed. A set of public health competencies and impact variables in the workplace and in society was designed using the competencies and learning objectives of six participating institutions offering MPH programmes in or for LMICs, and the set of competencies of the Council on Linkages Between Academia and Public Health Practice as a reference. The resulting competencies and impact variables differ from those of the Council on Linkages in scope and emphasis on social determinants of health, context specificity and intersectoral competencies. A modified Delphi method was used in this study to validate the public health competencies and impact variables; experts and MPH alumni from China, Vietnam, South Africa, Sudan, Mexico and the Netherlands reviewed them and made recommendations. The competencies and variables were validated across two Delphi rounds, first with public health experts (N = 31) from the six countries, then with MPH alumni (N = 30). After the first expert round, competencies and impact variables were refined based on the quantitative results and qualitative comments. Both rounds showed high consensus, more so for the competencies than the impact variables. The response rate was 100%. This is the first time that public health competencies have been validated in LMICs across continents. It is also the first time that impact variables of MPH programmes have been proposed and validated in LMICs across continents. The high degree of consensus between experts and alumni suggests that these public health competencies and impact variables can be used to design and evaluate MPH programmes, as well as for individual and team assessment and continuous professional development in LMICs.

Selective mutism: a consensus based care pathway of good practice.

PubMed

Keen, D V; Fonseca, S; Wintgens, A

2008-10-01

Selective mutism (SM) now acknowledged as an anxiety condition, tends to be a poorly understood, highly complex and vastly under-recognised clinical entity. Children with SM are a vulnerable group as the condition is not the remit of any one professional group. This inevitably leads to delay in formal diagnosis and management. There is a lack of systematic research on which to base guidelines for management. To develop, agree and validate key principles underlying the management of SM through a consensus process involving international experts, in order to create a local care pathway. A local multi-agency consultation process developed 11 statements, which were felt to be the key principles underpinning a potential care pathway for managing SM. Thirteen recognised experts from North America, Europe and Australia participated in a modified Delphi process involving two rounds using a Likert-scale and free commentary. Both quantitative and qualitative analyses were used in the validation or revision of the statements at each stage. Response rates were 100% for Round 1 and 84.6% for Round 2. Despite the differing professional backgrounds and service contexts, by successive revision and/or revalidation of statements, it was possible to arrive at a consensus about key principles relating to early recognition, assessment and intervention. The agreed key principles are presented together with the resulting local care pathway. Through a Delphi process, agreement was reached by a multidisciplinary group of professionals, on key principles that underpin the timely identification, assessment and management of children with SM. These include the potential for staff in school/preschool settings to identify SM and that intervention programmes should generally be based in these settings. Children with SM should receive assessment for possible coexisting disorders, whether developmental, emotional or behavioural and additional specific intervention given for these. Agreement was reached as to what constitutes clinical progress, intervals for monitoring progress, criteria for referral onwards for multidisciplinary specialist assessment and the role of selective serotonin reuptake inhibitor (SSRI) medication. A consensus methodology has been successfully used to compensate for the lack of evidence base and harness the expertise of a relatively small number of experienced professionals in order to provide a basis for the future development of services.

Validation of public health competencies and impact variables for low- and middle-income countries

PubMed Central

2014-01-01

Background The number of Master of Public Health (MPH) programmes in low- and middle-income countries (LMICs) is increasing, but questions have been raised regarding the relevance of their outcomes and impacts on context. Although processes for validating public health competencies have taken place in recent years in many high-income countries, validation in LMICs is needed. Furthermore, impact variables of MPH programmes in the workplace and in society have not been developed. Method A set of public health competencies and impact variables in the workplace and in society was designed using the competencies and learning objectives of six participating institutions offering MPH programmes in or for LMICs, and the set of competencies of the Council on Linkages Between Academia and Public Health Practice as a reference. The resulting competencies and impact variables differ from those of the Council on Linkages in scope and emphasis on social determinants of health, context specificity and intersectoral competencies. A modified Delphi method was used in this study to validate the public health competencies and impact variables; experts and MPH alumni from China, Vietnam, South Africa, Sudan, Mexico and the Netherlands reviewed them and made recommendations. Results The competencies and variables were validated across two Delphi rounds, first with public health experts (N = 31) from the six countries, then with MPH alumni (N = 30). After the first expert round, competencies and impact variables were refined based on the quantitative results and qualitative comments. Both rounds showed high consensus, more so for the competencies than the impact variables. The response rate was 100%. Conclusion This is the first time that public health competencies have been validated in LMICs across continents. It is also the first time that impact variables of MPH programmes have been proposed and validated in LMICs across continents. The high degree of consensus between experts and alumni suggests that these public health competencies and impact variables can be used to design and evaluate MPH programmes, as well as for individual and team assessment and continuous professional development in LMICs. PMID:24438672

Specialty Training's Organizational Readiness for curriculum Change (STORC): development of a questionnaire in a Delphi study.

PubMed

Bank, Lindsay; Jippes, Mariëlle; van Luijk, Scheltus; den Rooyen, Corry; Scherpbier, Albert; Scheele, Fedde

2015-08-05

In postgraduate medical education (PGME), programs have been restructured according to competency-based frameworks. The scale and implications of these adjustments justify a comprehensive implementation plan. Organizational Readiness for Change (ORC) is seen as a critical precursor for a successful implementation of change initiatives. Though, ORC in health care settings is mostly assessed in small scale settings and in relation to new policies and practices rather than educational change. Therefore our aim with this work was to develop an instrument to asses Specialty Training's Organizational Readiness for curriculum Change (STORC). A Delphi procedure was conducted to examine the applicability of a preliminary questionnaire in PGME, which was based on existing instruments designed for business and health care organizations. The 41 panellists (19 trainees and 22 supervisors from 6 specialties) from four different countries who were confronted with an apparent curriculum change, or would be in the near future, were asked to rate the relevance of a 89-item web-based questionnaire with regard to changes in specialty training on a 5-point Likert scale. Furthermore, they were invited to make qualitative comments on the items. In two rounds the 89-item preliminary questionnaire was reduced to 44 items. Items were either removed, kept, adapted or added based on individual item scores and qualitative comments. In the absence of a gold standard, this Delphi procedure was considered complete when the overall questionnaire rating exceeded 4.0 (scale 0-5). The overall item score reached 4.1 in the second round, meeting our criteria for completion of this Delphi procedure. This Delphi study describes the initial validating step in the development of an instrument to asses Specialty Training's Organisational Readiness for curriculum Change (STORC). Since ORC is measured on various subscales and presented as such, its strength lies in analysing these subscales. The latter makes it possible for educational leaders to identify and anticipate on hurdles in the implementation process and subsequently optimize efforts for successful curriculum change.

Linking NHS data for pediatric pharmacovigilance: Results of a Delphi survey.

PubMed

Hopf, Y M; Francis, J; Helms, P J; Haughney, J; Bond, C

2016-01-01

Adverse drug events are a major cause of patient safety incidents. Current systems of pharmacovigilance under-report adverse drug reactions (ADRs), especially in children, leading to delays in their identification. This is of particular concern, as children especially have an increased vulnerability to ADRs. The objective was to seek consensus among healthcare professionals (HCPs) about barriers and facilitators to the linkage of routinely collected health data for pediatric pharmacovigilance in Scotland. A Delphi survey was conducted with a random sample of HCPs including nurses, pharmacists and doctors, working in primary or secondary care, in Scotland. Participants were identified from sampling frames of the target professionals such as an NHS workforce list for general practitioners and recruited by postal invitation. A total of 819 HCPs were invited to take part. Those agreeing to participate were given the option of completing the questionnaires online or as hard copy. Reminders were sent twice at a fortnightly interval. Questions content included description of professional role as well as testing for the willingness to support the proposed project and was informed by the Theoretical Domains Framework of Behavior Change (TDF) and earlier qualitative work. Three Delphi rounds were administered, including a first round for item generation. 121 of those invited agreed to take part (15%). The first round of the Delphi study included 21 open questions and generated over a 1000 individual statements from 61 participants that returned the questionnaires (50.4%). These were rationalized to 149 items for the second round in which participants rated their views on the importance (or not) of each item on a 9-point Likert scale (strongly disagree - strongly agree). After the third round, there was consensus on items that focused on professional standards, and practical requirements, overall there was support for data linkage and a multi-professional approach. It would be acceptable to stakeholders to introduce a data linkage system for pharmacovigilance as long as identified concerns are addressed. Concerns included adherence to current professional, legal and ethical standards, as well resolving practical issues. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Evaluation Criteria for Nursing Student Application of Evidence-Based Practice: A Delphi Study.

PubMed

Bostwick, Lina; Linden, Lois

2016-06-01

Core clinical evaluation criteria do not exist for measuring prelicensure baccalaureate nursing students' application of evidence-based practice (EBP) during direct care assignments. The study objective was to achieve consensus among EBP nursing experts to create clinical criteria for faculty to use in evaluating students' application of EBP principles. A three-round Delphi method was used. Experts were invited to participate in Web-based surveys. Data were analyzed using qualitative coding and categorizing. Quantitative analyses were descriptive calculations for rating and ranking. Expert consensus occurred in the Delphi rounds. The study provides a set of 10 core clinical evaluation criteria for faculty evaluating students' progression toward competency in their application of EBP. A baccalaureate program curriculum requiring the use of Bostwick's EBP Core Clinical Evaluation Criteria will provide a clear definition for understanding basic core EBP competence as expected for the assessment of student learning. [J Nurs Educ. 2016;55(5):336-341.]. Copyright 2016, SLACK Incorporated.

Diagnosis and Management of Iliac Artery Endofibrosis: Results of a Delphi Consensus Study.

PubMed

2016-07-01

Iliac endofibrosis is a rare condition that may result in a reduction of blood flow to the lower extremity in young, otherwise healthy individuals. The data to inform everyday clinical management are weak and therefore a Delphi consensus methodology was used to explore areas of consensus and disagreement concerning the diagnosis and management of patients with suspected iliac endofibrosis. A three-round Delphi questionnaire approach was used among vascular surgeons, sports physicians, sports scientists, radiologists, and clinical vascular scientists with experience of treating this condition to explore diagnosis and clinical management issues for patients with suspected iliac artery endofibrosis. Analysis is based on 18 responses to round 2 and 14 responses to round 3, with agreement reported when 70% of respondents were in agreement. Initially there was agreement on the typical symptoms at presentation and the need for an exercise test in the diagnosis. Round 3 clarified that duplex ultrasound was a useful tool in the diagnosis of endofibrosis. There was consensus on the most appropriate type of surgery (endarterectomy and vein patch) and that endovascular interventions were inadvisable. The final round helped to inform aspects of the natural history and post-operative surveillance. Progression of the disease was likely with continued exercise but cessation may prevent progression. Surveillance after surgery is generally recommended yearly with at least a clinical assessment. There is broad agreement about the presenting symptoms and the investigations required to confirm (or exclude) the diagnosis of iliac endofibrosis. There was consensus on the surgical approach to repair. Disagreement existed about the specific diagnostic criteria that should be applied during non-invasive testing and about post-operative care and resumption of exercise. Copyright © 2016 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Latin American Consensus for Pediatric Cardiopulmonary Resuscitation 2017: Latin American Pediatric Critical Care Society Pediatric Cardiopulmonary Resuscitation Committee.

PubMed

López-Herce, Jesús; Almonte, Enma; Alvarado, Manuel; Bogado, Norma Beatriz; Cyunel, Mariana; Escalante, Raffo; Finardi, Christiane; Guzmán, Gustavo; Jaramillo-Bustamante, Juan C; Madrid, Claudia C; Matamoros, Martha; Moya, Luis Augusto; Obando, Grania; Reboredo, Gaspar; López, Lissette R; Scheu, Christian; Valenzuela, Alejandro; Yerovi, Rocío; Yock-Corrales, Adriana

2018-03-01

To develop a Latin American Consensus about Pediatric Cardiopulmonary Resuscitation. To clarify, reinforce, and adapt some specific recommendations for pediatric patients and to stimulate the implementation of these recommendations in clinical practice. Expert consensus recommendations with Delphi methodology. Latin American countries. Experts in pediatric cardiopulmonary resuscitation from 19 Latin American countries. Delphi methodology for expert consensus. The goal was to reach consensus with all the participating experts for every recommendation. An agreement of at least 80% of the participating experts had to exist in order to deliver a recommendation. Two Delphi voting rounds were sent out electronically. The experts were asked to score between 1 and 9 their level of agreement for each recommendation. The score was then classified into three groups: strong agreement (score 7-9), moderate agreement (score 4-6), and disagreement (score 1-3). Nineteen experts from 19 countries participated in both voting rounds and in the whole process of drafting the recommendations. Sixteen recommendations about organization of cardiopulmonary resuscitation, prevention, basic resuscitation, advanced resuscitation, and postresuscitation measures were approved. Ten of them had a consensus of 100%. Four of them were agreed by all the participants except one (94.7% consensus). One recommendation was agreed by all except two experts (89.4%), and finally, one was agreed by all except three experts (84.2%). All the recommendations reached a level of agreement. This consensus adapts 16 international recommendations to Latin America in order to improve the practice of cardiopulmonary resuscitation in children. Studies should be conducted to analyze the effectiveness of the implementation of these recommendations.

Developing a clinical pathway for the identification and management of anxiety and depression in adult cancer patients: an online Delphi consensus process.

PubMed

Shaw, Joanne M; Price, Melanie A; Clayton, Josephine M; Grimison, Peter; Shaw, Tim; Rankin, Nicole; Butow, Phyllis N

2016-01-01

People with cancer and their families experience high levels of psychological morbidity. However, many cancer services do not routinely screen patients for anxiety and depression, and there are no standardized clinical referral pathways. This study aimed to establish consensus on elements of a draft clinical pathway tailored to the Australian context. A two-round Delphi study was conducted to gain consensus among Australian oncology and psycho-oncology clinicians about the validity of 39 items that form the basis of a clinical pathway that includes screening, assessment, referral and stepped care management of anxiety and depression in the context of cancer. The expert panel comprised 87 multidisciplinary clinician members of the Australian Psycho-oncology Co-operative Research Group (PoCoG). Respondents rated their level of agreement with each statement on a 5-point Likert scale. Consensus was defined as >80% of respondents scoring within 2 points on the Likert scale. Consensus was reached for 21 of 39 items, and a further 15 items approached consensus except for specific contextual factors, after two Delphi rounds. Formal screening for anxiety and depression, a stepped care model of management and recommendations for inclusion of length of treatment and time to review were endorsed. Consensus was not reached on items related to roles and responsibilities, particularly those not applicable across cancer settings. This study identified a core set of evidence- and consensus-based principles considered essential to a stepped care model of care incorporating identification, referral and management of anxiety and depression in adult cancer patients.

Defining the activities of publicness for Korea's public community hospitals using the Delphi method.

PubMed

Lee, Kunsei; Kim, Hyun Joo; You, Myoungsoon; Lee, Jin-Seok; Eun, Sang Jun; Jeong, Hyoseon; Ahn, Hye Mi; Lee, Jin Yong

2017-03-01

This study aims to identify which activities of a public community hospital (PHC) should be included in their definition of publicness and tries to achieve a consensus among experts using the Delphi method. We conduct 2 rounds of the Delphi process with 17 panel members using a developed draft of tentative activities for publicness including 5 main categories covering 27 items. The questions remain the same in both rounds and the applicability of each of the 27 items to publicness is measured on a 9-point scale. If the participants believe government funding is needed, we ask how much they think the government should support each item on a 0% to 100% scale. After conducting 2 rounds of the Delphi process, 22 out of the 27 items reached a consensus as activities defining the publicness of the PHCs. Among the 5 major categories, in category C, activities preventing market failure, all 10 items were considered activities of publicness. Nine of these were evaluated as items that should be compensated at 100% of total financial loss by the Korean government. Throughout results, we were able to define the activities of the PCH that encompassed its publicness and confirm that there are "good deficits" in the context of the PCHs. Thus, some PCH deficits are unavoidable and not wasted as these monies support a necessary role and function in providing public health. The Korean government should therefore consider taking actions such as exempting such "good deficits" or providing additional financial aid to reimburse the PHCs for "good deficits."

Subjective and clinical assessment criteria suggestive for five clinical patterns discernible in nonspecific neck pain patients. A Delphi-survey of clinical experts.

PubMed

Dewitte, Vincent; Peersman, Wim; Danneels, Lieven; Bouche, Katie; Roets, Arne; Cagnie, Barbara

2016-12-01

Nonspecific neck pain patients form a heterogeneous group with different musculoskeletal impairments. Classifying nonspecific neck pain patients into subgroups based on clinical characteristics might lead to more comprehensive diagnoses and can guide effective management. To establish consensus among a group of experts regarding the clinical criteria suggestive of a clinical dominance of 'articular', 'myofascial', 'neural', 'central' and 'sensorimotor control' dysfunction patterns distinguishable in patients with nonspecific neck pain. Delphi study. A focus group with 10 academic experts was organized to elaborate on the different dysfunction patterns discernible in neck pain patients. Consecutively, a 3-round online Delphi-survey was designed to obtain consensual symptoms and physical examination findings for the 5 distinct dysfunction patterns resulting from the focus group. A total of 21 musculoskeletal physical therapists from Belgium and the Netherlands experienced in assessing and treating neck pain patients completed the 3-round Delphi-survey. Respectively, 33 (response rate, 100.0%), 27 (81.8%) and 21 (63.6%) respondents replied to rounds 1, 2 and 3. Eighteen 'articular', 16 'myofascial', 20 'neural', 18 'central' and 10 'sensorimotor control' clinical indicators reached a predefined ≥80% consensus level. These indicators suggestive of a clinical dominance of 'articular', 'myofascial', 'neural', 'central', and 'sensorimotor control' dysfunction patterns may help clinicians to assess and diagnose patients with nonspecific neck pain. Future validity testing is needed to determine how these criteria may help to improve the outcome of physical therapy interventions in nonspecific neck pain patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

Current opinion and consensus statement regarding the diagnosis, prognosis, and treatment of patients with essential thrombocythemia: a survey of the Spanish Group of Ph-negative Myeloproliferative Neoplasms (GEMFIN) using the Delphi method.

PubMed

Besses, C; Hernández-Boluda, J C; Pérez Encinas, M; Raya, J M; Hernández-Rivas, J M; Jiménez Velasco, A; Martínez Lopez, J; Vicente, V; Burgaleta, C

2016-04-01

The current consensus on the diagnosis, prognosis, and treatment of essential thrombocythemia (ET) is based on experts' recommendations. However, several aspects of the diagnosis of, prognosis of, and therapy for ET are still controversial. The Delphi method was employed with an expert panel of members of the Spanish Group of Ph-negative Myeloproliferative Neoplasms in order to identify the degree of agreement on the diagnosis, prognosis, and treatment of ET. Nine leading experts selected a total of 41 clinical hematologists with well-known expertise in ET. An electronic questionnaire was used to collect the questions rated in a four-step scale. The questions were grouped into four blocks: diagnosis, risk stratification, goals of therapy, and treatment strategy. After the first round consisting of 80 questions, a second round including 14 additional questions focused on the recommendations advocated by experts of the European LeukemiaNet in 2011 was analyzed. The median and mean values for the first and second rounds were calculated. A summary of the conclusions considered as the most representative of each block of questions is presented. The Delphi method is a powerful instrument to address the current approaches and controversies surrounding ET.

The Canadian Assessment of Physical Literacy: Development of a Model of Children's Capacity for a Healthy, Active Lifestyle Through a Delphi Process.

PubMed

Francis, Claire E; Longmuir, Patricia E; Boyer, Charles; Andersen, Lars Bo; Barnes, Joel D; Boiarskaia, Elena; Cairney, John; Faigenbaum, Avery D; Faulkner, Guy; Hands, Beth P; Hay, John A; Janssen, Ian; Katzmarzyk, Peter T; Kemper, Han C; Knudson, Duane; Lloyd, Meghann; McKenzie, Thomas L; Olds, Tim S; Sacheck, Jennifer M; Shephard, Roy J; Zhu, Weimo; Tremblay, Mark S

2016-02-01

The Canadian Assessment of Physical Literacy (CAPL) was conceptualized as a tool to monitor children's physical literacy. The original model (fitness, activity behavior, knowledge, motor skill) required revision and relative weights for calculating/interpreting scores were required. Nineteen childhood physical activity/fitness experts completed a 3-round Delphi process. Round 1 was open-ended questions. Subsequent rounds rated statements using a 5-point Likert scale. Recommendations were sought regarding protocol inclusion, relative importance within composite scores and score interpretation. Delphi participant consensus was achieved for 64% (47/73) of statement topics, including a revised conceptual model, specific assessment protocols, the importance of longitudinal tracking, and the relative importance of individual protocols and composite scores. Divergent opinions remained regarding the inclusion of sleep time, assessment/ scoring of the obstacle course assessment of motor skill, and the need for an overall physical literacy classification. The revised CAPL model (overlapping domains of physical competence, motivation, and knowledge, encompassed by daily behavior) is appropriate for monitoring the physical literacy of children aged 8 to 12 years. Objectively measured domains (daily behavior, physical competence) have higher relative importance. The interpretation of CAPL results should be reevaluated as more data become available.

The development of ethical guidelines for nurses' collegiality using the Delphi method.

PubMed

Kangasniemi, Mari; Arala, Katariina; Becker, Eve; Suutarla, Anna; Haapa, Toni; Korhonen, Anne

2017-08-01

Nurses' collegiality is topical because patient care is complicated, requiring shared knowledge and working methods. Nurses' collaboration has been supported by a number of different working models, but there has been less focus on ethics. This study aimed to develop nurses' collegiality guidelines using the Delphi method. Two online panels of Finnish experts, with 35 and 40 members, used the four-step Delphi method in December 2013 and January 2014. They reformulated the items of nurses' collegiality identified by the literature and rated based on validity and importance. Content analysis and descriptive statistical methods were used to analyze the data, and the nurses' collegiality guidelines were formulated. Ethical considerations: Organizational approval was received, and an informed consent was obtained from all participants. Information about the voluntary nature of participation was provided. During the first Delphi panel round, a number of items were reformulated and added, resulting in 32 reformulated items. As a result of the second round, 8 of the 32 items scored an agreement rate of more than 75%, with the most rated item being collegiality means that professionals respect each other. The item with second highest rating was collegiality has a common objective: what is best for patients, followed by the third highest which was professional ethics is the basis of collegiality. Nurses' collegiality and its content are well recognized in clinical practice but seldom studied. Collegiality can be supported by guidelines, and nurses working in clinical practice, together with teachers and managers, have shared responsibilities to support and develop it. More research in different nursing environments is needed to improve understanding of the content and practice of nursing collegiality.

Core outcome sets for prevention and treatment of postpartum haemorrhage: an international Delphi consensus study.

PubMed

Meher, Shireen; Cuthbert, Anna; Kirkham, Jamie J; Williamson, Paula; Abalos, Edgardo; Aflaifel, Nasreen; Bhutta, Zulfiqar A; Bishop, Alina; Blum, Jennifer; Collins, Peter; Devane, Declan; Ducloy-Bouthors, Anne-Sophie; Fawole, Bukola; Gülmezoglu, A Metin; Gutteridge, Kathryn; Gyte, Gill; Homer, Caroline S E; Mallaiah, Shuba; Smith, Jeffrey M; Weeks, Andrew D; Alfirevic, Zarko

2018-06-19

To develop core outcome sets (COS) for studies evaluating interventions for (1) prevention and (2) treatment of PPH, and recommendations on how to report the COS. A two-round Delphi survey and face-to-face meeting. Health care professionals and women's representatives. Outcomes were identified from systematic reviews of PPH studies and stakeholder consultation. Participants scored each outcome in the Delphi on a Likert scale between 1 (not important) and 9 (critically important). Results were discussed at the face-to-face meeting to agree the final COS. Consensus at the meeting was defined as ≥ 70% of participants scoring the outcome as critically important (7-9). Lectures, discussion and voting were used to agree how to report COS outcomes. outcomes from systematic reviews and consultations. Both Delphi rounds were completed by 152/205 (74%) participants for prevention and 143/197 (73%) for treatment. For prevention of PPH, nine core outcomes were selected: blood loss, shock, maternal death, use of additional uterotonics, blood transfusion, transfer for higher level of care, women's sense of wellbeing, acceptability and satisfaction with the intervention, breastfeeding and adverse effects. For treatment of PPH, 12 core outcomes were selected: blood loss, shock, coagulopathy, hysterectomy, organ dysfunction, maternal death, blood transfusion, use of additional haemostatic intervention, transfer for higher level of care, women's sense of wellbeing, acceptability and satisfaction with the intervention, breastfeeding and adverse effects. Recommendations were developed on how to report these outcomes where possible. These COS will help standardise outcome reporting in PPH trials. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Which information on women's issues in epilepsy does a community pharmacist need to know? A Delphi consensus study.

PubMed

Shawahna, Ramzi

2017-12-01

The aim of this study was to develop and achieve consensus on a core list of important knowledge items that community pharmacists should know on women's issues in epilepsy. This was a consensual study using a modified Delphi technique. Knowledge items were collected from the literature and from nine key contacts who were interviewed on their views on what information community pharmacists should have on women's issues in epilepsy. More knowledge items were suggested by five researchers with interest in women's issues who were contacted to rate and comment on the knowledge items collected. Two iterative Delphi rounds were conducted among a panel of pharmacists (n=30) to achieve consensus on the knowledge items to be included in the core list. Ten panelists ranked the knowledge items by their importance using the Analytical Hierarchy Process (AHP). Consensus was achieved to include 68 knowledge under 13 categories in the final core list. Items ranked by their importance were related to the following: teratogenicity (10.3%), effect of pregnancy on epilepsy (7.4%), preconception counseling (10.3%), bone health (5.9%), catamenial epilepsy (7.4%), menopause and hormonal replacement therapy (2.9%), contraception (14.7%), menstrual disorders and infertility (8.8%), eclampsia (2.9%), breastfeeding (4.4%), folic acid and vitamin K (5.9%), counseling on general issues (14.7%), and sexuality (4.4%). Using consensual knowledge lists might promote congruence in educating and/or training community pharmacists on women's issues in epilepsy. Future studies are needed to investigate if such lists can improve health services provided to women with epilepsy (WWE). Copyright © 2017 Elsevier Inc. All rights reserved.

Measuring organisational readiness for patient engagement (MORE): an international online Delphi consensus study.

PubMed

Oostendorp, Linda J M; Durand, Marie-Anne; Lloyd, Amy; Elwyn, Glyn

2015-02-14

Widespread implementation of patient engagement by organisations and clinical teams is not a reality yet. The aim of this study is to develop a measure of organisational readiness for patient engagement designed to monitor and facilitate a healthcare organisation's willingness and ability to effectively implement patient engagement in healthcare. The development of the MORE (Measuring Organisational Readiness for patient Engagement) scale was guided by Weiner's theory of organisational readiness for change. Weiner postulates that an organisation's readiness is determined by both the willingness and ability to implement the change (i.e. in this context: patient engagement). A first version of the scale was developed based on a literature search and evaluation of pre-existing tools. We invited multi-disciplinary stakeholders to participate in a two-round online Delphi survey. Respondents were asked to rate the importance of each proposed item, and to comment on the proposed domains and items. Second round participants received feedback from the first round and were asked to re-rate the importance of the revised, new and unchanged items, and to provide comments. The first version of the scale contained 51 items divided into three domains: (1) Respondents' characteristics; (2) the organisation's willingness to implement patient engagement; and (3) the organisation's ability to implement patient engagement. 131 respondents from 16 countries (health care managers, policy makers, clinicians, patients and patient representatives, researchers, and other stakeholders) completed the first survey, and 72 of them also completed the second survey. During the Delphi process, 34 items were reworded, 8 new items were added, 5 items were removed, and 18 were combined. The scale's instructions were revised. The final version of MORE totalled 38 items; 5 on stakeholders, 13 on an organisation's willingness to implement, and 20 on an organisation's ability to implement patient engagement in healthcare. The Delphi technique was successfully used to refine the scale's instructions, domains and items, using input from a broad range of international stakeholders, hoping that MORE can be applied in a variety of healthcare contexts worldwide. Further assessment is needed to determine the psychometric properties of the scale.

What Are We Aiming For?--A Delphi Study on the Development of Civic Scientific Literacy in Sweden

ERIC Educational Resources Information Center

Chang Rundgren, Shu-Nu; Rundgren, Carl-Johan

2017-01-01

Based on the EU FP 7 project, PROFILES, this article presents our findings from a three-round Delphi study conducted in Sweden that aimed at establishing a consensus on how science education should be developed for citizens to enhance civic scientific literacy. A total of 100 stakeholders (9th graders, school teachers, scientists, and science…

MOMENT--Management of Otitis Media with Effusion in Cleft Palate: protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey.

PubMed

Harman, Nicola L; Bruce, Iain A; Callery, Peter; Tierney, Stephanie; Sharif, Mohammad Owaise; O'Brien, Kevin; Williamson, Paula R

2013-03-12

Cleft palate (CP) has an incidence of approximately 1 in 700. Children with CP are also susceptible to otitis media with effusion (OME), with approximately 90% experiencing nontrivial OME. There are several approaches to the management of OME in children with CP. The Management of Otitis Media with Effusion in Children with Cleft Palate (MOMENT) study is a feasibility study that includes the development of a core outcome set for use in future trials of the management of OME in children with CP. The MOMENT study will include a systematic review of the literature to identify a list of outcomes that have previously been reported. This list of outcomes will be used in a Delphi study with cleft clinicians. The Delphi study is anticipated to include three rounds. The first round will ask clinicians to score the outcome list and to add any outcomes they think are relevant. The second round involves presentation of scores according to stakeholder group and the opportunity for participants to rescore outcomes. To ensure that the opinion of parents and children are sought, qualitative interviews will be completed with a purposive sample in parallel. In the final round of the Delphi process, participants will be shown the distribution of scores, for each outcome, for all stakeholder groups separately as well as a summary of the results concerning outcomes from the qualitative interviews with parents. A final consensus meeting will be held with all stakeholders, including parents and children, to review outcomes. A core outcome set represents the minimum that should be measured in a clinical trial for a particular condition. The MOMENT study will aim to identify a core outcome set that can be used in future trials of the management of OME, improving the consistency of research in this clinical area.

Indicators for evaluating European population health: a Delphi selection process.

PubMed

Freitas, Ângela; Santana, Paula; Oliveira, Mónica D; Almendra, Ricardo; Bana E Costa, João C; Bana E Costa, Carlos A

2018-04-27

Indicators are essential instruments for monitoring and evaluating population health. The selection of a multidimensional set of indicators should not only reflect the scientific evidence on health outcomes and health determinants, but also the views of health experts and stakeholders. The aim of this study is to describe the Delphi selection process designed to promote agreement on indicators considered relevant to evaluate population health at the European regional level. Indicators were selected in a Delphi survey conducted using a web-platform designed to implement and monitor participatory processes. It involved a panel of 51 experts and 30 stakeholders from different areas of knowledge and geographies. In three consecutive rounds the panel indicated their level of agreement or disagreement with indicator's relevance for evaluating population health in Europe. Inferential statistics were applied to draw conclusions on observed level of agreement (Scott's Pi interrater reliability coefficient) and opinion change (McNemar Chi-square test). Multivariate analysis of variance was conducted to check if the field of expertise influenced the panellist responses (Wilk's Lambda test). The panel participated extensively in the study (overall response rate: 80%). Eighty indicators reached group agreement for selection in the areas of: economic and social environment (12); demographic change (5); lifestyle and health behaviours (8); physical environment (6); built environment (12); healthcare services (11) and health outcomes (26). Higher convergence of group opinion towards agreement on the relevance of indicators was seen for lifestyle and health behaviours, healthcare services, and health outcomes. The panellists' field of expertise influenced responses: statistically significant differences were found for economic and social environment (p < 0.05 in round 1 and 2), physical environment (p < 0.01 in round 1) and health outcomes (p < 0.01 in round 3). The high levels of participation observed in this study, by involving experts and stakeholders and ascertaining their views, underpinned the added value of using a transparent Web-Delphi process to promote agreement on what indicators are relevant to appraise population health.

Return to play after hamstring injuries in football (soccer): a worldwide Delphi procedure regarding definition, medical criteria and decision-making.

PubMed

van der Horst, Nick; Backx, Fjg; Goedhart, Edwin A; Huisstede, Bionka Ma

2017-11-01

There are three major questions about return to play (RTP) after hamstring injuries: How should RTP be defined? Which medical criteria should support the RTP decision? And who should make the RTP decision? The study aimed to provide a clear RTP definition and medical criteria for RTP and to clarify RTP consultation and responsibilities after hamstring injury. The study used the Delphi procedure. The results of a systematic review were used as a starting point for the Delphi procedure. Fifty-eight experts in the field of hamstring injury management selected by 28 FIFA Medical Centres of Excellence worldwide participated. Each Delphi round consisted of a questionnaire, an analysis and an anonymised feedback report. After four Delphi rounds, with more than 83% response for each round, consensus was achieved that RTP should be defined as 'the moment a player has received criteria-based medical clearance and is mentally ready for full availability for match selection and/or full training'. The experts reached consensus on the following criteria to support the RTP decision: medical staff clearance, absence of pain on palpation, absence of pain during strength and flexibility testing, absence of pain during/after functional testing, similar hamstring flexibility, performance on field testing, and psychological readiness. It was also agreed that RTP decisions should be based on shared decision-making, primarily via consultation with the athlete, sports physician, physiotherapist, fitness trainer and team coach. The consensus regarding aspects of RTP should provide clarity and facilitate the assessment of when RTP is appropriate after hamstring injury, so as to avoid or reduce the risk of injury recurrence because of a premature RTP. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Defining Advance Care Planning for Adults: A Consensus Definition from a Multidisciplinary Delphi Panel

PubMed Central

Sudore, Rebecca L.; Lum, Hillary D.; You, John J.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Matlock, Daniel D.; Rietjens, Judith A. C.; Korfage, Ida J.; Ritchie, Christine S.; Kutner, Jean S.; Teno, Joan M.; Thomas, Judy; McMahan, Ryan D.; Heyland, Daren K.

2017-01-01

Background Despite increasing interest in advance care planning (ACP) and prior ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. Objective To develop a consensus definition of ACP for adults. Design Delphi Panel Setting/Participants Participants included a multidisciplinary panel of international ACP experts consisting of 52 clinicians, researchers, and policy leaders from 4 countries, and a patient/surrogate advisory committee. Measurements We conducted 10 rounds of a modified Delphi method and qualitatively analyzed panelists’ input. Panelists identified several themes lacking consensus, and iteratively discussed and developed a final consensus definition. Results Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients’ values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: “Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness.” The panel also described strategies to best support adults in ACP. Conclusions A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. PMID:28062339

Defining Advance Care Planning for Adults: A Consensus Definition From a Multidisciplinary Delphi Panel.

PubMed

Sudore, Rebecca L; Lum, Hillary D; You, John J; Hanson, Laura C; Meier, Diane E; Pantilat, Steven Z; Matlock, Daniel D; Rietjens, Judith A C; Korfage, Ida J; Ritchie, Christine S; Kutner, Jean S; Teno, Joan M; Thomas, Judy; McMahan, Ryan D; Heyland, Daren K

2017-05-01

Despite increasing interest in advance care planning (ACP) and previous ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. The aim of this study was to develop a consensus definition of ACP for adults. We convened a Delphi panel of multidisciplinary, international ACP experts consisting of 52 clinicians, researchers, and policy leaders from four countries and a patient/surrogate advisory committee. We conducted 10 rounds using a modified Delphi method and qualitatively analyzed panelists' input. Panelists identified several themes lacking consensus and iteratively discussed and developed a final consensus definition. Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients' values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: "Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness." The panel also described strategies to best support adults in ACP. A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. Published by Elsevier Inc.

Required competencies of occupational physicians: a Delphi survey of UK customers.

PubMed

Reetoo, K N; Harrington, J M; Macdonald, E B

2005-06-01

Occupational physicians can contribute to good management in healthy enterprises. The requirement to take into account the needs of the customers when planning occupational health services is well established. To establish the priorities of UK employers, employees, and their representatives regarding the competencies they require from occupational physicians; to explore the reasons for variations of the priorities in different groups; and to make recommendations for occupational medicine training curricula in consideration of these findings. This study involved a Delphi survey of employers and employees from public and private organisations of varying business sizes, and health and safety specialists as well as trade union representatives throughout the UK. It was conducted in two rounds by a combination of computer assisted telephone interview (CATI) and postal survey techniques, using a questionnaire based on the list of competencies described by UK and European medical training bodies. There was broad consensus about the required competencies of occupational physicians among the respondent subgroups. All the competencies in which occupational physicians are trained were considered important by the customers. In the order of decreasing importance, the competencies were: Law and Ethics, Occupational Hazards, Disability and Fitness for Work, Communication, Environmental Exposures, Research Methods, Health Promotion, and Management. The priorities of customers differed from previously published occupational physicians' priorities. Existing training programmes for occupational physicians should be regularly reviewed and where necessary, modified to ensure that the emphasis of training meets customer requirements.

Academic Primer Series: Key Papers About Competency-Based Medical Education.

PubMed

Cooney, Robert; Chan, Teresa M; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-06-01

Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Based on the online discussions of the 2016-2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs.

Research priorities for multi-institutional collaborative research in surgical education.

PubMed

Stefanidis, Dimitrios; Cochran, Amalia; Sevdalis, Nick; Mellinger, John; Phitayakorn, Roy; Sullivan, Maura; Barney, Linda

2015-01-01

Research in surgical education has seen unprecedented growth but originates from single institutions and remains uncoordinated; this study aimed to generate a list of research priorities in surgical educational topics. The membership of the Association for Surgical Education was asked to submit up to 5 research questions concerned with multi-institutional collaborative surgical education research and to identify challenges faced by surgical education researchers. A modified Delphi methodology was used to create the research agenda based on these responses. Surgical educators responded to 3 survey rounds. Categories of submitted questions included teaching methods and curriculum development; assessment and competency; simulation; medical student preparation and selection; impact of work hour restrictions; and faculty development. Participants cited institutional culture and practice variability and lack of institutional review board coordination as common barriers to collaborative research, while identifying extensive planning, frequent communication, and availability of dedicated research coordinators as the most important facilitators. Using a Delphi methodology, a prioritized agenda for multi-institutional surgical education research was developed that may help advance surgeon education. Copyright © 2015 Elsevier Inc. All rights reserved.

Developing an industry-oriented safety curriculum using the Delphi technique.

PubMed

Chen, Der-Fa; Wu, Tsung-Chih; Chen, Chi-Hsiang; Chang, Shu-Hsuan; Yao, Kai-Chao; Liao, Chin-Wen

2016-09-01

In this study, we examined the development of industry-oriented safety degree curricula at a college level. Based on a review of literature on the practices and study of the development of safety curricula, we classified occupational safety and health curricula into the following three domains: safety engineering, health engineering, and safety and health management. We invited 44 safety professionals to complete a four-round survey that was designed using a modified Delphi technique. We used Chi-square statistics to test the panel experts' consensus on the significance of the items in the three domains and employed descriptive statistics to rank the participants' rating of each item. The results showed that the top three items for each of the three domains were Risk Assessment, Dangerous Machinery and Equipment, and Fire and Explosion Prevention for safety engineering; Ergonomics, Industrial Toxicology, and Health Risk Assessment for health engineering; and Industrial Safety and Health Regulations, Accident Investigation and Analysis, and Emergency Response for safety and health management. Only graduates from safety programmes who possess practical industry-oriented abilities can satisfy industry demands and provide value to the existence of college safety programmes.

Core competencies for emergency medicine clerkships: results of a Canadian consensus initiative.

PubMed

Penciner, Rick; Woods, Robert A; McEwen, Jill; Lee, Richard; Langhan, Trevor; Bandiera, Glen

2013-01-01

There is no consensus on what constitutes the core competencies for emergency medicine (EM) clerkship rotations in Canada. Existing EM curricula have been developed through informal consensus and often focus on EM content to be known at the end of training rather than what is an appropriate focus for a time-limited rotation in EM. We sought to define the core competencies for EM clerkship in Canada through consensus among an expert panel of Canadian EM educators. We used a modified Delphi method and the CanMEDS 2005 Physician Competency Framework to develop a consensus among expert EM educators from across Canada. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). A complete list of competencies is provided. This study established a national consensus defining the core competencies for EM clerkship in Canada.

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study

PubMed Central

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-01-01

Background The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. Objective This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. Design A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Results Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. Discussion and conclusions This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. PMID:27540101

Futurescapes: evidence expectations in the USA for comparative effectiveness research for drugs in 2020.

PubMed

Messner, Donna A; Mohr, Penny; Towse, Adrian

2015-08-01

Explore key factors influencing future expectations for the production of evidence from comparative effectiveness research for drugs in the USA in 2020 and construct three plausible future scenarios. Semistructured key informant interviews and three rounds of modified Delphi with systematic scenario-building methods. Most influential key factors were: health delivery system integration; electronic health record development; exploitation of very large databases and mixed data sources; and proactive patient engagement in research. The scenario deemed most likely entailed uneven development of large integrated health systems with pockets of increased provider risk for patient care, enhanced data collection systems, changing incentives to do comparative effectiveness research and new opportunities for evidence generation partnerships.

Clinical assessment of acute lateral ankle sprain injuries (ROAST): 2019 consensus statement and recommendations of the International Ankle Consortium.

PubMed

Delahunt, Eamonn; Bleakley, Chris M; Bossard, Daniela S; Caulfield, Brian M; Docherty, Carrie L; Doherty, Cailbhe; Fourchet, François; Fong, Daniel T; Hertel, Jay; Hiller, Claire E; Kaminski, Thomas W; McKeon, Patrick O; Refshauge, Kathryn M; Remus, Alexandria; Verhagen, Evert; Vicenzino, Bill T; Wikstrom, Erik A; Gribble, Phillip A

2018-06-09

Lateral ankle sprain injury is the most common musculoskeletal injury incurred by individuals who participate in sports and recreational physical activities. Following initial injury, a high proportion of individuals develop long-term injury-associated symptoms and chronic ankle instability. The development of chronic ankle instability is consequent on the interaction of mechanical and sensorimotor insufficiencies/impairments that manifest following acute lateral ankle sprain injury. To reduce the propensity for developing chronic ankle instability, clinical assessments should evaluate whether patients in the acute phase following lateral ankle sprain injury exhibit any mechanical and/or sensorimotor impairments. This modified Delphi study was undertaken under the auspices of the executive committee of the International Ankle Consortium. The primary aim was to develop recommendations, based on expert (n=14) consensus, for structured clinical assessment of acute lateral ankle sprain injuries. After two modified Delphi rounds, consensus was achieved on the clinical assessment of acute lateral ankle sprain injuries. Consensus was reached on a minimum standard clinical diagnostic assessment. Key components of this clinical diagnostic assessment include: establishing the mechanism of injury, as well as the assessment of ankle joint bones and ligaments. Through consensus, the expert panel also developed the International Ankle Consortium Rehabilitation-Oriented ASsessmenT (ROAST). The International Ankle Consortium ROAST will help clinicians identify mechanical and/or sensorimotor impairments that are associated with chronic ankle instability. This consensus statement from the International Ankle Consortium aims to be a key resource for clinicians who regularly assess individuals with acute lateral ankle sprain injuries. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Consensus-based guidelines for Video EEG monitoring in the pre-surgical evaluation of children with epilepsy in the UK.

PubMed

Pressler, Ronit M; Seri, Stefano; Kane, Nick; Martland, Tim; Goyal, Sushma; Iyer, Anand; Warren, Elliott; Notghi, Lesley; Bill, Peter; Thornton, Rachel; Appleton, Richard; Doyle, Sarah; Rushton, Sarah; Worley, Alan; Boyd, Stewart G

2017-08-01

Paediatric Epilepsy surgery in the UK has recently been centralised in order to improve expertise and quality of service available to children. Video EEG monitoring or telemetry is a highly specialised and a crucial component of the pre-surgical evaluation. Although many Epilepsy Monitoring Units work to certain standards, there is no national or international guideline for paediatric video telemetry. Due to lack of evidence we used a modified Delphi process utilizing the clinical and academic expertise of the clinical neurophysiology sub-specialty group of Children's Epilepsy Surgical Service (CESS) centres in England and Wales. This process consisted of the following stages I: Identification of the consensus working group, II: Identification of key areas for guidelines, III: Consensus practice points and IV: Final review. Statements that gained consensus (median score of either 4 or 5 using a five-point Likerttype scale) were included in the guideline. Two rounds of feedback and amendments were undertaken. The consensus guidelines includes the following topics: referral pathways, neurophysiological equipment standards, standards of recording techniques, with specific emphasis on safety of video EEG monitoring both with and without drug withdrawal, a protocol for testing patient's behaviours, data storage and guidelines for writing factual reports and conclusions. All statements developed received a median score of 5 and were adopted by the group. Using a modified Delphi process we were able to develop universally-accepted video EEG guidelines for the UK CESS. Although these recommendations have been specifically developed for the pre-surgical evaluation of children with epilepsy, it is assumed that most components are transferable to any paediatric video EEG monitoring setting. Copyright © 2017 British Epilepsy Association. Published by Elsevier Ltd. All rights reserved.

Essential Concepts of Nanoscale Science and Technology for High School Students Based on a Delphi Study by the Expert Community

ERIC Educational Resources Information Center

Sakhnini, Sohair; Blonder, Ron

2015-01-01

Nanoscale science and technology (NST) is an important new field in modern science. In the current study, we seek to answer the question: "What are the essential concepts of NST that should be taught in high school"? A 3-round Delphi study methodology was applied based on 2 communities of experts in nanotechnology research and science…

Frontline over ivory tower: key competencies in community-based curricula.

PubMed

Millar, Adam; Malcolm, Janine; Cheng, Alice; Fine, Rebecca; Wong, Rene

2015-01-01

The Royal College of Physicians and Surgeons of Canada mandates that community experiences be incorporated into medicine-based specialties. Presently there is wide variability in community endocrine experiences across Canadian training programs. This is complicated by the paucity of literature providing guidance on what constitutes a 'community' rotation. A modified Delphi technique was used to determine the CanMEDS competencies best taught in a community endocrinology curriculum. The Delphi technique is a qualitative-research method that uses a series of questionnaires sent to a group of experts with controlled feedback provided by the researchers after each survey round. The experts in this study included endocrinology program directors, community endocrinologists, endocrinology residents and recent endocrinology graduates. Thirty four out of 44 competencies rated by the panel were deemed suitable for a community curriculum. The experts considered the "Manager" role best taught in the community, while they considered the community least suitable to learn the "Medical Expert" competency. To our knowledge, this is the first time the content of a community-based subspecialty curriculum was determined using the Delphi process in Canada. These findings suggest that community settings have potential to fill in gaps in residency training in regards to the CanMEDS Manager role. The results will aid program directors in designing competency-based community endocrinology rotations and competency-based community rotations in other medical subspecialty programs.

From equity to power: Critical Success Factors for Twinning between midwives, a Delphi study.

PubMed

Cadée, Franka; Nieuwenhuijze, Marianne J; Lagro-Janssen, Antoine L M; de Vries, Raymond

2018-02-28

To gain consensus for Critical Success Factors associated with Twinning in Midwifery. International publications identify midwifery as important for improving maternity care worldwide. Midwifery is a team effort where midwives play a key role. Yet their power to take on this role is often lacking. Twinning has garnered potential to develop power in professionals, however, its success varies because implementation is not always optimal. Critical Success Factors have demonstrated positive results in the managerial context and can be helpful to build effective Twinning relationships. We approached 56 midwife Twinning experts from 19 countries to participate in three Delphi rounds between 2016 - 2017. In round 1, experts gave input through an open ended questionnaire and this was analysed to formulate Critical Success Factors statements that were scored on a 1-7 Likert scale aiming to gain consensus in rounds 2 and 3. These statements were operationalized for practical use such as a check list in planning, monitoring and evaluation in the field. Thirty-three experts from 14 countries took part in all three Delphi rounds, producing 58 initial statements. This resulted in 25 Critical Success Factors covering issues of management, communication, commitment and values, most focus on equity. The Critical Success Factors formulated represent the necessary ingredients for successful Twinning by providing a practical implementation framework and promote further research into the effect of Twinning. Findings show that making equity explicit in Twinning may contribute towards the power of midwives to take on their identified key role. © 2018 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Characteristics of a global classification system for perinatal deaths: a Delphi consensus study.

PubMed

Wojcieszek, Aleena M; Reinebrant, Hanna E; Leisher, Susannah Hopkins; Allanson, Emma; Coory, Michael; Erwich, Jan Jaap; Frøen, J Frederik; Gardosi, Jason; Gordijn, Sanne; Gulmezoglu, Metin; Heazell, Alexander E P; Korteweg, Fleurisca J; McClure, Elizabeth; Pattinson, Robert; Silver, Robert M; Smith, Gordon; Teoh, Zheyi; Tunçalp, Özge; Flenady, Vicki

2016-08-15

Despite the global burden of perinatal deaths, there is currently no single, globally-acceptable classification system for perinatal deaths. Instead, multiple, disparate systems are in use world-wide. This inconsistency hinders accurate estimates of causes of death and impedes effective prevention strategies. The World Health Organisation (WHO) is developing a globally-acceptable classification approach for perinatal deaths. To inform this work, we sought to establish a consensus on the important characteristics of such a system. A group of international experts in the classification of perinatal deaths were identified and invited to join an expert panel to develop a list of important characteristics of a quality global classification system for perinatal death. A Delphi consensus methodology was used to reach agreement. Three rounds of consultation were undertaken using a purpose built on-line survey. Round one sought suggested characteristics for subsequent scoring and selection in rounds two and three. The panel of experts agreed on a total of 17 important characteristics for a globally-acceptable perinatal death classification system. Of these, 10 relate to the structural design of the system and 7 relate to the functional aspects and use of the system. This study serves as formative work towards the development of a globally-acceptable approach for the classification of the causes of perinatal deaths. The list of functional and structural characteristics identified should be taken into consideration when designing and developing such a system.

Suicide first aid guidelines for Sri Lanka: a Delphi consensus study.

PubMed

De Silva, Saranga A; Colucci, Erminia; Mendis, Jayan; Kelly, Claire M; Jorm, Anthony F; Minas, Harry

2016-01-01

Sri Lanka has one of the highest suicide rates in the world. Gatekeeper programs aimed at specific target groups could be a promising suicide prevention strategy in the country. The aim of this study was to develop guidelines that help members of the public to provide first aid to persons in Sri Lanka who are at risk of suicide. The Delphi method was used to elicit consensus on potential helping statements to include in the guidelines. These statements describe information members of the public should have and actions they can take to help a person who is experiencing suicidal thoughts. An expert panel, comprised of mental health and suicide experts in Sri Lanka, rated each statement. The panellists were encouraged to suggest any additional action that was not included in the original questionnaire and, in particular, to include items that were culturally appropriate or gender specific. Responses to open-ended questions were used to generate new items. These items were included in the subsequent Delphi rounds. Three Delphi rounds were carried out. Statements were accepted for inclusion in the guidelines if they were endorsed (rated as essential or important) by at least 80 % of the panel. Statements endorsed by 70-79 % of the panel were re-rated in the following round. Statements with less than 70 % endorsement, or re-rated items that did not receive 80 % or higher endorsement were rejected. The output from the Delphi process was a set of endorsed statements. In the first round questionnaire 473 statements were presented to the panel and 58 new items were generated from responses to the open-ended questions. Of the total 531 statements presented, 304 were endorsed. These statements were used to develop the suicide first aid guidelines for Sri Lanka. By engaging Sri Lankans who are experts in the field of mental health or suicide this research developed culturally appropriate guidelines for providing mental health first aid to a person at risk of suicide in Sri Lanka. The guidelines may serve as a basis for developing training for members of the public to provide mental health first aid to persons at risk of suicide as part of Sri Lanka's suicide prevention strategy.

Information needs of patients with whiplash associated disorders: A Delphi study of patient beliefs.

PubMed

Sterling, Joanna; Maujean, Annick; Sterling, Michele

2018-02-01

Whiplash associated disorders (WAD) result in significant personal and economic costs. Patient education and reassurance are recommended treatments for acute WAD but the information needs of patients have not been investigated. To determine what information whiplash-injured patients believe is important to help recovery in the acute stage of injury. A Delphi design survey series with three rounds. Thirty-three participants who had sustained a whiplash injury within the last three years were invited to participate. Participants were asked to provide five statements, in response to an open-ended question, regarding what they believed was the most important information to provide to patients following a whiplash injury. Nineteen patients responded and 85 statements were collected and reviewed independently by two of the authors to remove duplicates. The importance of the remaining items was rated by the participants in the second survey round. Items rated by >50% of participants as important were included in the third survey round. To be deemed key information, >80% of participants had to rate an item as important in this final round. Eighteen items met the criteria for key information. These points addressed four areas: assessment and treatment, recovery and symptoms, patient attitudes during treatment and relationships with health practitioners. The key information points endorsed by patients in this study may provide useful information to constitute a basis for reassurance and education provided to patients with WAD. The results also suggest that improved relationships between patients with whiplash and health practitioners is required. Copyright © 2017 Elsevier Ltd. All rights reserved.

Controversy between anesthesiologists and obstetricians on the labour ward: the Delphi method is used as a consensus-building technique.

PubMed

Nguyen-Lu, Nhathien; Downey, Kristi; Carvalho, Jose C A

2015-03-01

Obstetricians and anesthesiologists may interpret medical evidence differently, which could potentially generate conflict and compromise patient care. We sought to identify the most important controversial topics involving obstetricians and anesthesiologists on the labour ward that had the potential to affect patient outcome. We conducted a consensus-building study based on the Delphi technique. A panel of experts comprised of obstetric anesthesiologists and obstetricians responded to a series of four parallel sequential questionnaires interspersed with feedback. The first round consisted of an open questionnaire: Which topics in patient management would rouse a difference of opinion between anesthesiologists and obstetricians that may interfere with patient outcome, and why? The second round sought agreement on the topics, and the third round sought to rank the topics, and their underlying reasons, that scored at least 60% agreement. The final round allowed each discipline insight into the controversies gathered by the other discipline. Ten anesthesiologists and ten obstetricians participated in the study. Anesthesiologists identified twice as many controversial topics as the obstetricians (six vs three, respectively). The obstetricians agreed with all topics identified by the anesthesiologists, but agreed with only five of the 18 (28%) reasons to support them. Anesthesiologists agreed with all topics raised by the obstetricians, but agreed with only three of the six (50%) reasons to support them. Both the obstetricians and the anesthesiologists identified several controversial topics that may influence clinical practice on the labour ward. This information could serve as the basis to develop educational programs and strategies to improve communication between the two disciplines.

Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study

PubMed Central

Walsh, Kieran; Westerman, Michiel; Scheele, Fedde

2018-01-01

Background The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. Objective We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. Methods We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. Results In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. Conclusions This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. PMID:29699970

Core outcome domains for clinical trials in non-specific low back pain.

PubMed

Chiarotto, Alessandro; Deyo, Richard A; Terwee, Caroline B; Boers, Maarten; Buchbinder, Rachelle; Corbin, Terry P; Costa, Leonardo O P; Foster, Nadine E; Grotle, Margreth; Koes, Bart W; Kovacs, Francisco M; Lin, Chung-Wei Christine; Maher, Chris G; Pearson, Adam M; Peul, Wilco C; Schoene, Mark L; Turk, Dennis C; van Tulder, Maurits W; Ostelo, Raymond W

2015-06-01

Inconsistent reporting of outcomes in clinical trials of patients with non-specific low back pain (NSLBP) hinders comparison of findings and the reliability of systematic reviews. A core outcome set (COS) can address this issue as it defines a minimum set of outcomes that should be reported in all clinical trials. In 1998, Deyo et al. recommended a standardized set of outcomes for LBP clinical research. The aim of this study was to update these recommendations by determining which outcome domains should be included in a COS for clinical trials in NSLBP. An International Steering Committee established the methodology to develop this COS. The OMERACT Filter 2.0 framework was used to draw a list of potential core domains that were presented in a Delphi study. Researchers, care providers and patients were invited to participate in three Delphi rounds and were asked to judge which domains were core. A priori criteria for consensus were established before each round and were analysed together with arguments provided by panellists on importance, overlap, aggregation and/or addition of potential core domains. The Steering Committee discussed the final results and made final decisions. A set of 280 experts was invited to participate in the Delphi; response rates in the three rounds were 52, 50 and 45%. Of 41 potential core domains presented in the first round, 13 had sufficient support to be presented for rating in the third round. Overall consensus was reached for the inclusion of three domains in this COS: 'physical functioning', 'pain intensity' and 'health-related quality of life'. Consensus on 'physical functioning' and 'pain intensity' was consistent across all stakeholders, 'health-related quality of life' was not supported by the patients, and all the other domains were not supported by two or more groups of stakeholders. Weighting all possible argumentations, the Steering Committee decided to include in the COS the three domains that reached overall consensus and the domain 'number of deaths'. The following outcome domains were included in this updated COS: 'physical functioning', 'pain intensity', 'health-related quality of life' and 'number of deaths'. The next step for the development of this COS will be to determine which measurement instruments best measure these domains.

Determining the Criteria and Their Weights for Medical Schools' Ranking: A National Consensus.

PubMed

Mojtahedzadeh, Rita; Mohammadi, Aeen; Kohan, Noushin; Gharib, Mitra; Zolfaghari, Mitra

2016-06-01

Delphi as a consensus development technique enables anonymous, systematic refinement of expert opinion with the aim of arriving at a combined or consensual position. In this study, we determined the criteria and their weights for Iranian Medical Schools' ranking through a Delphi process. An expert committee devised 13 proposed criteria with 32 indicators with their weights, which were arranged hierarchically in the form of a tree diagram. We used the Delphi technique to reach a consensus on these criteria and weights among the deans of 38 public Iranian medical schools. For this purpose, we devised and sent a questionnaire to schools and asked them to suggest or correct the criteria and their weights. We repeated this process in two rounds till all the schools reached an acceptable consensus on them. All schools reached a consensus on the set of 13 criteria and 30 indicators and their weights in three main contexts of education, research and facilities, and equipment which were used for Medical Schools' ranking. Using Delphi technique for devising the criteria and their weights in evaluation processes such as ranking makes their results more acceptable among universities.

Projecting Agricultural Education Programs for the 21st Century Using a Modified Delphi Technique.

ERIC Educational Resources Information Center

Iverson, Maynard J.

A modified three-step Delphi procedure was used to conduct a series of national studies of futurists regarded by their peers as top experts in agricultural education. The primary objective was to project enrollments in agricultural education programs for the 21st century. Other study objectives were to ascertain whether the Delphi technique could…

Optimizing the assessment of pediatric injury severity in low-resource settings: Consensus generation through a modified Delphi analysis.

PubMed

St-Louis, Etienne; Deckelbaum, Dan Leon; Baird, Robert; Razek, Tarek

2017-06-01

Although a plethora of pediatric injury severity scoring systems is available, many of them present important challenges and limitations in the low resource setting. Our aim is to generate consensus among a group of experts regarding the optimal parameters, outcomes, and methods of estimating injury severity for pediatric trauma patients in low resource settings. A systematic review of the literature was conducted to identify and compare existing injury scores used in pediatric patients. Qualitative data was extracted from the systematic review, including scoring parameters, settings and outcomes. In order to establish consensus regarding which of these elements are most adapted to pediatric patients in low-resource settings, they were subjected to a modified Delphi survey for external validation. The Delphi process is a structured communication technique that relies on a panel of experts to develop a systematic, interactive consensus method. We invited a group of 38 experts, including adult and pediatric surgeons, emergency physicians and anesthesiologists trauma team leaders from a level 1 trauma center in Montreal, Canada, and a pediatric referral trauma hospital in Santiago, Chile to participate in two successive rounds of our survey. Consensus was reached regarding various features of an ideal pediatric trauma score. Specifically, our experts agreed pediatric trauma scoring tool should differ from its adult counterpart, that it can be derived from point of care data available at first assessment, that blood pressure is an important variable to include in a predictive model for pediatric trauma outcomes, that blood pressure is a late but specific marker of shock in pediatric patients, that pulse rate is a more sensitive marker of hemodynamic instability than blood pressure, that an assessment of airway status should be included as a predictive variable for pediatric trauma outcomes, that the AVPU classification of neurologic status is simple and reliable in the acute setting, and more so than GCS at all ages. Therefore, we conclude that an opportunity exists to develop a new pediatric trauma score, combining the above consensus-generating ideas, that would be best adapted for use in low-resource settings. Copyright © 2017 Elsevier Ltd. All rights reserved.

Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi.

PubMed

Pinnock, Hilary; Epiphaniou, Eleni; Sheikh, Aziz; Griffiths, Chris; Eldridge, Sandra; Craig, Peter; Taylor, Stephanie J C

2015-03-30

Dissemination and implementation of health care interventions are currently hampered by the variable quality of reporting of implementation research. Reporting of other study types has been improved by the introduction of reporting standards (e.g. CONSORT). We are therefore developing guidelines for reporting implementation studies (StaRI). Using established methodology for developing health research reporting guidelines, we systematically reviewed the literature to generate items for a checklist of reporting standards. We then recruited an international, multidisciplinary panel for an e-Delphi consensus-building exercise which comprised an initial open round to revise/suggest a list of potential items for scoring in the subsequent two scoring rounds (scale 1 to 9). Consensus was defined a priori as 80% agreement with the priority scores of 7, 8, or 9. We identified eight papers from the literature review from which we derived 36 potential items. We recruited 23 experts to the e-Delphi panel. Open round comments resulted in revisions, and 47 items went forward to the scoring rounds. Thirty-five items achieved consensus: 19 achieved 100% agreement. Prioritised items addressed the need to: provide an evidence-based justification for implementation; describe the setting, professional/service requirements, eligible population and intervention in detail; measure process and clinical outcomes at population level (using routine data); report impact on health care resources; describe local adaptations to the implementation strategy and describe barriers/facilitators. Over-arching themes from the free-text comments included balancing the need for detailed descriptions of interventions with publishing constraints, addressing the dual aims of reporting on the process of implementation and effectiveness of the intervention and monitoring fidelity to an intervention whilst encouraging adaptation to suit diverse local contexts. We have identified priority items for reporting implementation studies and key issues for further discussion. An international, multidisciplinary workshop, where participants will debate the issues raised, clarify specific items and develop StaRI standards that fit within the suite of EQUATOR reporting guidelines, is planned. The protocol is registered with Equator: http://www.equator-network.org/library/reporting-guidelines-under-development/#17 .

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research

PubMed Central

Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

Background While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. Objective To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. Methods The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. Results 143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. Conclusions GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites. PMID:28768629

Defining the Bobath concept using the Delphi technique.

PubMed

Raine, Sue

2006-03-01

The Bobath concept, based on the work of Berta and Karel Bobath, offers therapists working in the field of neurological rehabilitation a framework for their clinical interventions. It is the most commonly used approach in the UK. Although they recognize that over the last half-century the concept has undergone considerable developments, proponents of the Bobath concept have been criticized for not publishing these changes. The aim of the present study was to use the Delphi technique to enable experts in the field to define the current Bobath concept. A four-round Delphi study design was used. The sample included all members of the British Bobath Tutor's Association, who are considered experts in the field. Initial statements were identified from the literature, with respondents generating additional statements during the study. The level of agreement was determined using a five-point Likert scale. The respondents were then provided with feedback on group opinions and given an opportunity to re-rate each statement. The level of group consensus was set at 80%. Fifteen experts took part. The response rate was 85% in the first round, and 93% in each subsequent round. Ten statements from the literature were rated with a further 12 generated by the experts. Thirteen statements achieved consensus for agreement and seven for disagreement. The Delphi study was an effective research tool, maintaining anonymity of responses and exploring expert opinions on the Bobath concept. The experts stated that Bobath's work has been misunderstood if it is considered as the inhibition of spasticity and the facilitation of normal movement, as described in some literature. They agreed that the Bobath concept was developed by the Bobaths as a living concept, understanding that as therapists' knowledge base grows their view of treatment broadens.

Transatlantic Multispecialty Consensus on Fundamental Endovascular Skills: Results of a Delphi Consensus Study.

PubMed

Maertens, H; Aggarwal, R; Macdonald, S; Vermassen, F; Van Herzeele, I

2016-01-01

The aim of this study was to establish a consensus on Fundamental Endovascular Skills (FES) for educational purposes and development of training curricula for endovascular procedures. The term "Fundamental Endovascular Skills" is widely used; however, the current literature does not explicitly describe what skills are included in this concept. Endovascular interventions are performed by several specialties that may have opposing perspectives on these skills. A two round Delphi questionnaire approach was used. Experts from interventional cardiology, interventional radiology, and vascular surgery from the United States and Europe were invited to participate. An electronic questionnaire was generated by endovascular therapists with an appropriate educational background but who would not participate in subsequent rounds. The questionnaire consisted of 50 statements describing knowledge, technical, and behavioral skills during endovascular procedures. Experts received the questionnaires by email. They were asked to rate the importance of each skill on a Likert scale from 1 to 5. A statement was considered fundamental when more than 90% of the experts rated it 4 or 5 out of 5. Twenty-three of 53 experts invited agreed to participate: six interventional radiologists (2 USA, 4 Europe), 10 vascular surgeons (4 USA, 6 Europe), and seven interventional cardiologists (4 USA, 3 Europe). There was a 100% response rate in the first round and 87% in the second round. Results showed excellent consensus among responders (Cronbach's alpha = .95 first round; .93 second round). Ninety percent of all proposed skills were considered fundamental. The most critical skills were determined. A transatlantic multispecialty consensus was achieved about the content of "FES" among interventional radiologists, interventional cardiologists, and vascular surgeons from Europe and the United States. These results can serve as directive principles for developing endovascular training curricula. Copyright © 2015 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Association of Postoperative Readmissions With Surgical Quality Using a Delphi Consensus Process to Identify Relevant Diagnosis Codes.

PubMed

Mull, Hillary J; Graham, Laura A; Morris, Melanie S; Rosen, Amy K; Richman, Joshua S; Whittle, Jeffery; Burns, Edith; Wagner, Todd H; Copeland, Laurel A; Wahl, Tyler; Jones, Caroline; Hollis, Robert H; Itani, Kamal M F; Hawn, Mary T

2018-04-18

Postoperative readmission data are used to measure hospital performance, yet the extent to which these readmissions reflect surgical quality is unknown. To establish expert consensus on whether reasons for postoperative readmission are associated with the quality of surgery in the index admission. In a modified Delphi process, a panel of 14 experts in medical and surgical readmissions comprising physicians and nonphysicians from Veterans Affairs (VA) and private-sector institutions reviewed 30-day postoperative readmissions from fiscal years 2008 through 2014 associated with inpatient surgical procedures performed at a VA medical center between October 1, 2007, and September 30, 2014. The consensus process was conducted from January through May 2017. Reasons for readmission were grouped into categories based on International Classification of Diseases, Ninth Revision (ICD-9) diagnosis codes. Panelists were given the proportion of readmissions coded by each reason and median (interquartile range) days to readmission. They answered the question, "Does the readmission reason reflect possible surgical quality of care problems in the index admission?" on a scale of 1 (never related) to 5 (directly related) in 3 rounds of consensus building. The consensus process was completed in May 2017 and data were analyzed in June 2017. Consensus on proportion of ICD-9-coded readmission reasons that reflected quality of surgical procedure. In 3 Delphi rounds, the 14 panelists achieved consensus on 50 reasons for readmission; 12 panelists also completed group telephone calls between rounds 1 and 2. Readmissions with diagnoses of infection, sepsis, pneumonia, hemorrhage/hematoma, anemia, ostomy complications, acute renal failure, fluid/electrolyte disorders, or venous thromboembolism were considered associated with surgical quality and accounted for 25 521 of 39 664 readmissions (64% of readmissions; 7.5% of 340 858 index surgical procedures). The proportion of readmissions considered to be not associated with surgical quality varied by procedure, ranging from to 21% (613 of 2331) of readmissions after lower-extremity amputations to 47% (745 of 1598) of readmissions after cholecystectomy. One-third of postoperative readmissions are unlikely to reflect problems with surgical quality. Future studies should test whether restricting readmissions to those with specific ICD-9 codes might yield a more useful quality measure.

Validation of the process criteria for assessment of a hospital nursing service.

PubMed

Feldman, Liliane Bauer; Cunha, Isabel Cristina Kowal Olm; D'Innocenzo, Maria

2013-01-01

to validate an instrument containing process criteria for assessment of a hospital nursing service based on the National Accreditation Organization program. a descriptive, quantitative methodological study performed in stages. An instrument constructed with 69 process criteria was assessed by 49 nurses from accredited hospitals in 2009, according to a Likert scale, and validated by 16 judges through Delphi rounds in 2010. the original instrument assessed by nurses with 69 process criteria was judged by the degree of importance, and changed to 39 criteria. In the first Delphi round, the 39 criteria reached consensus among the 19 judges, with a medium reliability by Cronbach's alpha. In the second round, 40 converging criteria were validated by 16 judges, with high reliability. The criteria addressed management, costs, teaching, education, indicators, protocols, human resources, communication, among others. the 40 process criteria formed a validated instrument to assess the hospital nursing service which, when measured, can better direct interventions by nurses in reaching and strengthening outcomes.

Considerations when conducting e-Delphi research: a case study.

PubMed

Toronto, Coleen

2017-06-22

Background E-Delphi is a way to access a geographically dispersed group of experts. It is similar to other Delphi methods but conducted online. E-research methodologies, such as the e-Delphi method, have yet to undergo significant critical discussion. Aim To highlight some of the challenges nurse researchers may wish to consider when using e-Delphi in their research. Discussion This paper provides details about the author's approach to conducting an e-Delphi study in which a group of health literacy nurse experts (n=41) used an online survey platform to identify and prioritise essential health literacy competencies for registered nurses. Conclusion This paper advances methodological discourse about e-Delphi by critically assessing an e-Delphi case study. The online survey platform used in this study was advantageous for the researcher and the experts: the experts could participate at any time and place where the internet was available; the researcher could efficiently access a national group of experts, track responses and analyse data in each round. Implications for practice E-Delphi studies create opportunities for nurse researchers to conduct research nationally and internationally. Before conducting an e-Delphi study, researchers should carefully consider the design and methods for collecting data, to avoid challenges that could potentially compromise the quality of the findings. Researchers are encouraged to publish details about their approaches to e-Delphi studies, to advance the state of the science.

Refractory septic shock in children: a European Society of Paediatric and Neonatal Intensive Care definition.

PubMed

Morin, Luc; Ray, Samiran; Wilson, Clare; Remy, Solenn; Benissa, Mohamed Rida; Jansen, Nicolaas J G; Javouhey, Etienne; Peters, Mark J; Kneyber, Martin; De Luca, Daniele; Nadel, Simon; Schlapbach, Luregn Jan; Maclaren, Graeme; Tissieres, Pierre

2016-12-01

Although overall paediatric septic shock mortality is decreasing, refractory septic shock (RSS) is still associated with high mortality. A definition for RSS is urgently needed to facilitate earlier identification and treatment. We aim to establish a European society of paediatric and neonatal intensive care (ESPNIC) experts' definition of paediatric RSS. We conducted a two-round Delphi study followed by an observational multicentre retrospective study. One hundred and fourteen paediatric intensivists answered a clinical case-based, two-round Delphi survey, identifying clinical items consistent with RSS. Multivariate analysis of these items in a development single-centre cohort (70 patients, 30 % mortality) facilitated development of RSS definitions based on either a bedside or computed severity score. Both scores were subsequently tested in a validation cohort (six centres, 424 patients, 11.6 % mortality). From the Delphi process, the draft definition included evidence of myocardial dysfunction and high blood lactate levels despite high vasopressor treatment. When assessed in the development population, each item was independently associated with the need for extracorporeal life support (ECLS) or death. Resultant bedside and computed septic shock scores had high discriminative power against the need for ECLS or death, with areas under the receiver operating characteristics curve of 0.920 (95 % CI 0.89-0.94), and 0.956 (95 % CI 0.93-0.97), respectively. RSS defined by a bedside score equal to or higher than 2 and a computed score equal to or higher than 3.5 was associated with a significant increase in mortality. This ESPNIC definition of RSS accurately identifies children with the most severe form of septic shock.

Gaining consensus on family carer needs when caring for someone dying at home to develop the Carers' Alert Thermometer (CAT): a modified Delphi study.

PubMed

Knighting, Katherine; O'Brien, Mary R; Roe, Brenda; Gandy, Rob; Lloyd-Williams, Mari; Nolan, Mike; Jack, Barbara A

2016-01-01

To report a multi-phase modified Delphi study conducted with carers and professionals to identify the priority areas for inclusion in an alert screening tool for carers providing support to someone dying at home. Internationally, there is a growing emphasis on increasing choice for patients who wish to die at home which relies heavily on care provided by the unpaid family carers. Family carers can have high levels of unmet needs comprising their psychological and physical health and their ability to provide effective care and support. Development of an alert tool to identify carers' needs in everyday practice required identification and consensus of the priority areas of need for inclusion. Multi-phase modified Delphi study and instrument development. Qualitative and quantitative data collection took place between 2011-2013 with 111 carers and 93 professionals to identify carers' needs and gain consensus on the priority areas for inclusion in the alert tool. An expert panel stage and final evidence review post-Delphi were used. The Delphi panels had high levels of agreement and consensus. Ten areas of carer need across two themes of 'the current caring situation' and 'the carer's own health and well-being' were prioritized for inclusion in the alert tool. An optional end-of-life planning question was included following the final stages. The results provide evidence of carers' needs to be assessed, areas for consideration in the education of those who support carers and someone dying at home and targeting of services, while demonstrating the usefulness and adaptability of the Delphi method. © 2015 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Improving care standards for patients with spinal trauma combining a modified e-Delphi process and stakeholder interviews: a study protocol.

PubMed

Sharwood, Lisa N; Stanford, Ralph; Middleton, James W; Burns, Brian; Joseph, Anthony; Flower, Oliver; Rigby, Oran; Ball, Jonathon; Dhaliwal, Shelly

2017-01-19

Around 300 people sustain a new traumatic spinal cord injury (TSCI) in Australia each year; a relatively low incidence injury with extremely high long-term associated costs. Care standards are inconsistent nationally, lacking in consensus across important components of care such as prehospital spinal immobilisation, timing of surgery and timeliness of transfer to specialist services. This study aims to develop 'expertly defined' and agreed standards of care across the majority of disciplines involved for these patients. A modified e-Delphi process will be used to gain consensus for best practice across specific clinical early care areas for the patient with TSCI; invited participants will include clinicians across Australia with relevant and significant expertise. A rapid literature review will identify available evidence, including any current guidelines from 2005 to 2015. Level and strength of evidence identified, including areas of contention, will be used to formulate the first round survey questions and statements. Participants will undertake 2-3 online survey rounds, responding anonymously to questionnaires regarding care practices and indicating their agreement or otherwise with practice standard statements. Relevant key stakeholders, including patients, will also be interviewed face to face. Ethics approval for this study was obtained by the NSW Population & Health Services Research Ethics Committee on 14 January 2016 (HREC/12/CIPHS/74). Seeking comprehensive understanding of how the variation in early care pathways and treatment can be addressed to achieve optimal patient outcomes and economic costs; the overall aim is the agreement to a consistent approach to the triage, treatment, transport and definitive care of acute TSCI victims. The agreed practice standards of care will inform the development of a Clinical Pathway with practice change strategies for implementation. These standards will offer a benchmark for state-wide and potentially national policy. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Ethical challenges facing veterinary professionals in Ireland: results from Policy Delphi with vignette methodology

PubMed Central

Magalhães-Sant'Ana, M.; More, S. J.; Morton, D. B.; Hanlon, A.

2016-01-01

Ethics is key to the integrity of the veterinary profession. Despite its importance, there is a lack of applied research on the range of ethical challenges faced by veterinarians. A three round Policy Delphi with vignette methodology was used to record the diversity of views on ethical challenges faced by veterinary professionals in Ireland. Forty experts, comprising veterinary practitioners, inspectors and nurses, accepted to participate. In round 1, twenty vignettes describing a variety of ethically challenging veterinary scenarios were ranked in terms of ethical acceptability, reputational risk and perceived standards of practice. Round 2 aimed at characterising challenges where future policy development or professional guidance was deemed to be needed. In round 3, possible solutions to key challenges were explored. Results suggest that current rules and regulations are insufficient to ensure best veterinary practices and that a collective approach is needed to harness workable solutions for the identified ethical challenges. Challenges pertaining mostly to the food chain seem to require enforcement measures whereas softer measures that promote professional discretion were preferred to address challenges dealing with veterinary clinical services. These findings can support veterinary representative bodies, advisory committees and regulatory authorities in their decision making, policy and regulation. PMID:27613779

Ethical challenges facing veterinary professionals in Ireland: results from Policy Delphi with vignette methodology.

PubMed

Magalhães-Sant'Ana, M; More, S J; Morton, D B; Hanlon, A

2016-10-29

Ethics is key to the integrity of the veterinary profession. Despite its importance, there is a lack of applied research on the range of ethical challenges faced by veterinarians. A three round Policy Delphi with vignette methodology was used to record the diversity of views on ethical challenges faced by veterinary professionals in Ireland. Forty experts, comprising veterinary practitioners, inspectors and nurses, accepted to participate. In round 1, twenty vignettes describing a variety of ethically challenging veterinary scenarios were ranked in terms of ethical acceptability, reputational risk and perceived standards of practice. Round 2 aimed at characterising challenges where future policy development or professional guidance was deemed to be needed. In round 3, possible solutions to key challenges were explored. Results suggest that current rules and regulations are insufficient to ensure best veterinary practices and that a collective approach is needed to harness workable solutions for the identified ethical challenges. Challenges pertaining mostly to the food chain seem to require enforcement measures whereas softer measures that promote professional discretion were preferred to address challenges dealing with veterinary clinical services. These findings can support veterinary representative bodies, advisory committees and regulatory authorities in their decision making, policy and regulation. British Veterinary Association.

Sports medicine and the accident and emergency medicine specialist.

PubMed

Abernethy, L; McNally, O; MacAuley, D; O'Neill, S

2002-05-01

Sport and exercise related injuries are responsible for about 5% of the workload in the accident and emergency (A&E) department, yet training in sports medicine is not a compulsory part of the curriculum for Higher Specialist Training. To determine how A&E medicine consultants and specialist trainees view their role and skill requirements in relation to sports medicine. A modified Delphi study, consisting of two rounds of a postal questionnaire. Participants were invited to rate the importance of statements relating to the role and training of the A&E specialist in relation to sports injuries (six statements) and the need for knowledge and understanding of defined skills of importance in sports medicine (16 statements). VALUE OF RESEARCH: This provides a consensus of opinion on issues in sport and exercise medicine that have educational implications for A&E specialists, and should be considered in the curriculum for Higher Specialist Training. There is also the potential for improving the health care provision of A&E departments, to the exercising and sporting population.

Year-Round Education: Change and Choice for Schools and Teachers

ERIC Educational Resources Information Center

Haser, Shelly Gismondi; Nasser, Ilham

2005-01-01

Over the last 20 years, many districts and schools have begun to explore year-round education or a modified calendar in response to student under-achievement in low performing schools. Here, the authors detail their two-year study of Title I, year-round, or modified calendar schools that switched from a traditional to a modified schedule in order…

Development of core outcome sets for effectiveness trials of interventions to prevent and/or treat delirium (Del-COrS): study protocol.

PubMed

Rose, Louise; Agar, Meera; Burry, Lisa D; Campbell, Noll; Clarke, Mike; Lee, Jacques; Siddiqi, Najma; Page, Valerie J

2017-09-18

Delirium is a common, serious and potentially preventable condition with devastating impact on the quality of life prompting a proliferation of interventional trials. Core outcome sets aim to standardise outcome reporting by identifying outcomes perceived fundamental for measurement in trials of a specific interest area. Our aim is to develop international consensus on two core outcome sets for trials of interventions to prevent and/or treat delirium, irrespective of study population. We aim to identify additional core outcomes specific to the critically ill, acutely hospitalised patients, palliative care and older adults. We will conduct a systematic review of published and ongoing delirium trials (1980 onwards) and one-on-one interviews of patients who have experienced delirium and family members. These data will inform Delphi round 1 of a two-stage consensus process. In round 2, we will provide participants their own response, summarised group responses and those of patient/family participants for rescoring. We will randomise participants to receive feedback as proportion scoring the outcome as critical or as group mean responses. We will hold a consensus meeting using nominal group technique to finalise outcomes for inclusion. We will repeat the Delphi process and consensus meeting to select measures for each core outcome. We will recruit 240 Delphi participants giving us 80% power to detect a 1.0-1.5 point (9-point scale) difference by feedback method between rounds. We will analyse differences for subsequent scores, magnitude of opinion change, items retained and level of agreement. We are obtaining research ethics approvals according to local governance. Participation will be voluntary and data deidentified. Support from three international delirium organisations will be instrumental in dissemination and core outcome set uptake. We will disseminate through peer-reviewed open access publications and present at conferences selected to reach a wide range of knowledge users. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Educational recommendations for the conduct, content and format of EULAR musculoskeletal ultrasound Teaching the Teachers Courses.

PubMed

Iagnocco, A; Terslev, L; Backhaus, M; Balint, P; Bruyn, G A W; Damjanov, N; Filippucci, E; Hammer, H B; Jousse-Joulin, S; Kane, D; Koski, J M; Mandl, P; Möller, I; Peetrons, P; Schmidt, W; Szkudlarek, M; Vojinovic, J; Wakefield, R J; Hofer, M; D'Agostino, M A; Naredo, E

2015-01-01

To produce educational guidelines for the conduct, content and format of theoretical and practical teaching at EULAR musculoskeletal ultrasound (MSUS) Teaching the Teachers (TTT) Courses. A Delphi-based procedure with 24 recommendations covering five main areas (Duration and place of the course; Faculty members; Content of the course; Evaluation of the teaching skills; TTT competency assessment) was distributed among a group of experts involved in MSUS teaching, in addition to an advisory educational expert being present. Consensus for each recommendation was considered achieved when the percentage of agreement was >75%. 21 of 24 invited participants responded to the first Delphi questionnaire (88% response rate). All 21 participants also responded to the second round. Agreement on 19 statements was obtained after two rounds. This project has led to the development of guidelines for the conduct, content and format of teaching at the EULAR MSUS TTT Courses that are organised annually, with the aim of training future teachers of EULAR MSUS Courses, EULAR Endorsed MSUS Courses, as well as national and local MSUS Courses. The presented work gives indications on how to homogenise the teaching at the MSUS TTT Courses, thus resolving current discrepancies in the field.

Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

PubMed

Turner, S; Ollerhead, E; Cook, A

2017-10-09

In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and logistically challenging. Identifying such research priorities can be particularly challenging for complex public health problems as there is a need to consult a number of experts across disciplines and with a range of expertise. This study investigated the use of Delphi-like survey methods in identifying important research priorities relating to health inequalities and framing tractable research questions for topic areas identified. The study was conducted in two phases, both using Delphi-like survey methods. Firstly, public health professionals with an interest in health inequalities were asked to identify research priorities. Secondly academic researchers were asked to frame tractable research questions relating to the priorities identified. These research priorities identified using Delphi-like survey methods were subsequently compared to those identified using different methods. A total of 52 public health professionals and 21 academics across the United Kingdom agreed to take part. The response rates were high, from public health professionals across three survey rounds (69%, 50% and 40%) and from academics across one round (52%), indicating that participants were receptive to the method and motivated to respond. The themes identified as encompassing the most important research priorities were mental health, healthy environment and health behaviours. Within these themes, the topic areas that emerged most strongly included community interventions for prevention of mental health problems and the food and alcohol environment. Some responses received from academic researchers were (as requested) in the form of tractable research questions, whereas others contributed further potential topic areas instead. Delphi-like survey methods are practical and productive as a means of obtaining opinions from a wide number of relevant experts identifying potential priority topic areas for research; however, this method is less appropriate for framing tractable research questions.

Pharmacy executives: leadership issues and associated skills, knowledge, and abilities in the U.S. Department of Defense.

PubMed

Meadows, Andrew B; Finstuen, Kenn; Hudak, Ronald P

2003-01-01

To identify the issues or problems that current and aspiring U.S. Department of Defense (DoD) pharmacy executives will face in the future and to define the skills, knowledge, and abilities (SKAs) required to successfully address these issues. Delphi method for executive decision making. DoD. Ninety-three pharmacists serving in the military grades of lieutenant colonel/commander and colonel/captain, as well as pharmacists selected for promotion to those grades. iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants identified five major issues believed to be of greatest importance to pharmacy executives and reported specific SKAs that might be needed to successfully manage those issues. An expert panel sorted these issues into meaningful domains, then provided an appropriate title for each domain. Round 2--on a 7-point scale, respondents rated the SKA items according to their assessment of how much a future DoD pharmacy executive would need each SKA. Response rates were 44.1% and 46.2% for Delphi rounds 1 and 2, respectively. The first round generated 62 unique issues facing pharmacy executives. The expert panel reviewed and sorted the issues into eight domains and selected an appropriate title for each domain. The domains identified by the panel were human resources, pharmacy operations/business practices, information management and technology, financial resources, formulary management, drug therapy management, pharmacy benefit management, and leadership. During round 2, 73.3% of the top 15 rated SKAs came from the drug therapy management, leadership, and formulary management domains. The three highest-rated SKAs were "ability to see the big picture," "ability to build strong relations with medical staffs," and "skills in both writing and verbal communication." The issues facing future DoD pharmacy executives will require them to expand their clinical abilities as well as their ability to collaborate and communicate with other professionals.

Standardization of definitions in focal therapy of prostate cancer: report from a Delphi consensus project.

PubMed

Postema, A W; De Reijke, T M; Ukimura, O; Van den Bos, W; Azzouzi, A R; Barret, E; Baumunk, D; Blana, A; Bossi, A; Brausi, M; Coleman, J A; Crouzet, S; Dominguez-Escrig, J; Eggener, S; Ganzer, R; Ghai, S; Gill, I S; Gupta, R T; Henkel, T O; Hohenfellner, M; Jones, J S; Kahmann, F; Kastner, C; Köhrmann, K U; Kovacs, G; Miano, R; van Moorselaar, R J; Mottet, N; Osorio, L; Pieters, B R; Polascik, T J; Rastinehad, A R; Salomon, G; Sanchez-Salas, R; Schostak, M; Sentker, L; Tay, K J; Varkarakis, I M; Villers, A; Walz, J; De la Rosette, J J

2016-10-01

To reach standardized terminology in focal therapy (FT) for prostate cancer (PCa). A four-stage modified Delphi consensus project was undertaken among a panel of international experts in the field of FT for PCa. Data on terminology in FT was collected from the panel by three rounds of online questionnaires. During a face-to-face meeting on June 21, 2015, attended by 38 experts, all data from the online rounds were reviewed and recommendations for definitions were formulated. Consensus was attained on 23 of 27 topics; Targeted FT was defined as a lesion-based treatment strategy, treating all identified significant cancer foci; FT was generically defined as an anatomy-based (zonal) treatment strategy. Treatment failure due to the ablative energy inadequately destroying treated tissue is defined as ablation failure. In targeting failure the energy is not adequately applied to the tumor spatially and selection failure occurs when a patient was wrongfully selected for FT. No definition of biochemical recurrence can be recommended based on the current data. Important definitions for outcome measures are potency (minimum IIEF-5 score of 21), incontinence (new need for pads or leakage) and deterioration in urinary function (increase in IPSS >5 points). No agreement on the best quality of life tool was established, but UCLA-EPIC and EORTC-QLQ-30 were most commonly supported by the experts. A complete overview of statements is presented in the text. Focal therapy is an emerging field of PCa therapeutics. Standardization of definitions helps to create comparable research results and facilitate clear communication in clinical practice.

Major incident triage: A consensus based definition of the essential life-saving interventions during the definitive care phase of a major incident.

PubMed

Vassallo, James; Smith, Jason E; Bruijns, Stevan R; Wallis, Lee A

2016-09-01

Triage is a key principle in the effective management of major incidents. The process currently relies on algorithms assigning patients to specific triage categories; there is, however, little guidance as to what these categories represent. Previously, these algorithms were validated against injury severity scores, but it is accepted now that the need for life-saving intervention is a more important outcome. However, the definition of a life-saving intervention is unclear. The aim of this study was to define what constitutes a life-saving intervention, in order to facilitate the definition of an adult priority one patient during the definitive care phase of a major incident. We conducted a modified Delphi study, using a panel of subject matter experts drawn from the United Kingdom and Republic of South Africa with a background in Emergency Care or Major Incident Management. The study was conducted using an online survey tool, over three rounds between July and December 2013. A four point Likert scale was used to seek consensus for 50 possible interventions, with a consensus level set at 70%. 24 participants completed all three rounds of the Delphi, with 32 life-saving interventions reaching consensus. This study provides a consensus definition of what constitutes a life-saving intervention in the context of an adult, priority one patient during the definitive care phase of a major incident. The definition will contribute to further research into major incident triage, specifically in terms of validation of an adult major incident triage tool. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Safety of Appropriate Use of Over-the-Counter Proton Pump Inhibitors: An Evidence-Based Review and Delphi Consensus.

PubMed

Johnson, David A; Katz, Philip O; Armstrong, David; Cohen, Henry; Delaney, Brendan C; Howden, Colin W; Katelaris, Peter; Tutuian, Radu I; Castell, Donald O

2017-04-01

The availability of over-the-counter (OTC) proton pump inhibitors (PPIs) for the short-term (2 weeks) management of frequent heartburn (≥2 days/week) has increased markedly, yet evidence-based recommendations have not been developed. A panel of nine international experts in gastroesophageal reflux disease developed consensus statements regarding the risks and benefits of OTC PPIs using a modified Delphi process. Consensus (based on ≥80% approval) was reached through multiple rounds of remote voting and a final round of live voting. To identify relevant data, the available literature was searched and summarized. Grading of Recommendations, Assessment, Development and Evaluation (GRADE) system terminology was used to rate the quality of evidence and strength of recommendations; consensus was based on ≥2/3 agreement. After 4 rounds of review, consensus was achieved for 18 statements. Notably, the available data did not directly reflect OTC use, but instead, prescription use; therefore, extrapolations to the OTC setting were often necessary. This limitation is regrettable, but it justifies performing this exercise to provide evidence-based expert opinion on a widely used class of drugs. The panel determined that using OTC PPIs according to label instructions is unlikely to mask the symptoms of esophageal or gastric cancer or adversely impact the natural history of related precursor conditions. OTC PPIs are not expected to substantially affect micronutrient absorption or bone mineral density or cause community-acquired pneumonia, Clostridium difficile infection, or cardiovascular adverse events. However, OTC PPI use may be associated with slightly increased risks for infectious diarrhea, certain idiosyncratic reactions, and cirrhosis-related spontaneous bacterial peritonitis. The available evidence does not suggest that OTC PPI use consistent with label instructions is associated with substantial health risks. To minimize potential risks, healthcare professionals and consumers must actively participate in decision making when managing reflux-related symptoms in the self-care setting.

Identifying nurse and health visitor priorities in a PCT using the Delphi technique.

PubMed

Brooks, Nicky; Barrett, Anna

2003-08-01

A three-stage Delphi investigation was undertaken over a 4-month period in a primary care trust to identify the perceived clinical needs of nurses. Practice nurses, district nurses, health visitors and community hospital nurses all participated. In round 1, there were 28 replies from these groups of nurses, in round 2 there were 31, and in round 3 there were 25 replies. In round 1, 77 issues (excluding duplications) were identified. These were separated into three themes according to the most appropriate method for addressing the issue: education (29 issues), research (16 issues) and management (32). In round 2, the issues were redistributed in the three areas and staff were asked to choose the ten most important issues from education, research and management. Finally, in round 3 the ten issues in education, research and management were prioritized in terms of the "most pressing". The most pressing education need was recognizing accountability; the most pressing research need was caseload/dependency scoring--matching staff levels to workload, and the most pressing management need was risk management, e.g. staff safety. The results have identified locally that there is a gap between the modernization agenda and what nursing staff consider to be the issues that need addressing locally. If measures are not put in place to address these local issues, there is a danger that nurses will not take a full and active role in the modernization of the NHS.

Expert agreed standards for the selection and development of cancer support group leaders: an online reactive Delphi study.

PubMed

Pomery, Amanda; Schofield, Penelope; Xhilaga, Miranda; Gough, Karla

2018-01-01

The aim of this study was to develop pragmatic, consensus-based minimum standards for the role of a cancer support group leader. Secondly, to produce a structured interview designed to assess the knowledge, skills and attributes of the individuals who seek to undertake the role. An expert panel of 73 academics, health professionals, cancer agency workers and cancer support group leaders were invited to participate in a reactive online Delphi study involving three online questionnaire rounds. Participants determined and ranked requisite knowledge, skills and attributes (KSA) for cancer support group leaders, differentiated ideal from required KSA to establish minimum standards, and agreed on a method of rating KSA to determine suitability and readiness. Forty-five experts (62%) participated in round 1, 36 (49%) in round 2 and 23 (31%) in round 3. In round 1, experts confirmed 59 KSA identified via a systemic review and identified a further 55 KSA. In round 2, using agreement ≥75%, 52 KSA emerged as minimum standards for support group leaders. In round 3, consensus was reached on almost every aspect of the content and structure of a structured interview. Panel member comments guided refinement of wording, re-ordering of questions and improvement of probing questions. Alongside a novel structured interview, the first consensus-based minimum standards have been developed for cancer support group leaders, incorporating expert consensus and pragmatic considerations. Pilot and field testing will be used to appraise aspects of clinical utility and establish a rational scoring model for the structured interview.

Scientific framework for research on disaster and mass casualty incident in Korea: building consensus using Delphi method.

PubMed

Kim, Chu Hyun; Park, Ju Ok; Park, Chang Bae; Kim, Seong Chun; Kim, Soo Jin; Hong, Ki Jeong

2014-01-01

We aimed to determine the scientific framework for research on disaster and mass casualty incident (MCI) in Korea, especially Korean terminology, feasible definition, and epidemiologic indices. The two staged policy Delphi method was performed by instructors of National Disaster Life Support (NDLS®) with the constructed questionnaire containing items based on the literature review. The first-stage survey was conducted by 11 experts through two rounds of survey for making issue and option. The second-stage survey was conducted by 35 experts for making a generalized group based consensus. Experts were selected among instructors of National Disaster Life Support Course. Through two staged Delphi survey experts made consensus: 1) the Korean terminology "jaenan" with "disaster" and "dajung-sonsang-sago" with "MCI"; 2) the feasible definition of "disaster" as the events that have an effect on one or more municipal local government area (city-county-district) or results in ≥ 10 of death or ≥ 50 injured victims; 3) the feasible definition of MCI as the events that result in ≥ 6 casualties including death; 4) essential 31 epidemiologic indices. Experts could determine the scientific framework in Korea for research on disaster medicine, considering the distinct characteristics of Korea and current research trends.

Development of key performance indicators to evaluate centralized intake for patients with osteoarthritis and rheumatoid arthritis.

PubMed

Barber, Claire E; Patel, Jatin N; Woodhouse, Linda; Smith, Christopher; Weiss, Stephen; Homik, Joanne; LeClercq, Sharon; Mosher, Dianne; Christiansen, Tanya; Howden, Jane Squire; Wasylak, Tracy; Greenwood-Lee, James; Emrick, Andrea; Suter, Esther; Kathol, Barb; Khodyakov, Dmitry; Grant, Sean; Campbell-Scherer, Denise; Phillips, Leah; Hendricks, Jennifer; Marshall, Deborah A

2015-11-14

Centralized intake is integral to healthcare systems to support timely access to appropriate health services. The aim of this study was to develop key performance indicators (KPIs) to evaluate centralized intake systems for patients with osteoarthritis (OA) and rheumatoid arthritis (RA). Phase 1 involved stakeholder meetings including healthcare providers, managers, researchers and patients to obtain input on candidate KPIs, aligned along six quality dimensions: appropriateness, accessibility, acceptability, efficiency, effectiveness, and safety. Phase 2 involved literature reviews to ensure KPIs were based on best practices and harmonized with existing measures. Phase 3 involved a three-round, online modified Delphi panel to finalize the KPIs. The panel consisted of two rounds of rating and a round of online and in-person discussions. KPIs rated as valid and important (≥7 on a 9-point Likert scale) were included in the final set. Twenty-five KPIs identified and substantiated during Phases 1 and 2 were submitted to 27 panellists including healthcare providers, managers, researchers, and patients in Phase 3. After the in-person meeting, three KPIs were removed and six were suggested. The final set includes 9 OA KPIs, 10 RA KPIs and 9 relating to centralized intake processes for both conditions. All 28 KPIs were rated as valid and important. Arthritis stakeholders have proposed 28 KPIs that should be used in quality improvement efforts when evaluating centralized intake for OA and RA. The KPIs measure five of the six dimensions of quality and are relevant to patients, practitioners and health systems.

Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study.

PubMed

de Leeuw, Robert Adrianus; Walsh, Kieran; Westerman, Michiel; Scheele, Fedde

2018-04-26

The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. ©Robert Adrianus de Leeuw, Kieran Walsh, Michiel Westerman, Fedde Scheele. Originally published in JMIR Medical Education (http://mededu.jmir.org), 26.04.2018.

Project PriMo: sharing principles and practices of bronchodilator therapy monitoring in COPD: a consensus initiative for optimizing therapeutic appropriateness among Italian specialists.

PubMed

Cazzola, Mario; Brusasco, Vito; Centanni, Stefano; Cerveri, Isa; De Michele, Fausto; Di Maria, Giuseppe; Palange, Paolo; Pellegrino, Riccardo; Polverino, Mario; Rossi, Andrea; Papi, Alberto

2013-04-01

Even after publication of the 2011 update of GOLD report, some fundamental questions in the management of COPD are still open and this may weaken the applicability of these guidelines in everyday clinical practice. To assess the level of consensus amongst Italian respirologists on different topics related to diagnosis, monitoring and role of bronchodilator therapy in COPD, by using the Delphi technique. A Delphi study was undertaken between July and November 2011, when two questionnaires were consecutively sent to a panel of experts to be answered anonymously. After each round, the data were aggregated at group level of question topics and structured feedback was given to the panel. A first-round questionnaire was sent to 208 pulmonologists randomly selected from different Italian regions. The 132 respondents (63% of those initially selected) were from northern (53%), central (19%) and southern (28%) Italy. A second-round questionnaire was sent to all the first-round respondents, and a response was received from 110 of them (83%). The main topics that reached the pre-defined cut off for consensus (67% or more) were: a) bronchodilator therapy with long-acting bronchodilators could be beneficial in patients with airflow limitation even in the absence of symptoms, b) in patients not fully controlled with one long-acting bronchodilator, maximizing bronchodilation (i.e. adding another bronchodilator with a different mechanism of action) is the preferable option; and c) the use of inhaled corticosteroids (ICSs) as add on therapy should be considered in severe patients with frequent exacerbations. Italian specialists agree on several aspects of the diagnosis and treatment of COPD and expert opinion could support everyday decision process in the management of COPD. Copyright © 2012 Elsevier Ltd. All rights reserved.

Development and initial validation of a content taxonomy for patient records in general dentistry

PubMed Central

Acharya, Amit; Hernandez, Pedro; Thyvalikakath, Thankam; Ye, Harold; Song, Mei; Schleyer, Titus

2013-01-01

Objective Develop and validate an initial content taxonomy for patient records in general dentistry. Methods Phase 1–Obtain 95 de-identified patient records from 11 general dentists in the United States. Phase 2–Extract individual data fields (information items), both explicit (labeled) and implicit (unlabeled), from records, and organize into categories mirroring original field context. Phase 3–Refine raw list of information items by eliminating duplicates/redundancies and focusing on general dentistry. Phase 4–Validate all items regarding inclusion and importance using a two-round Delphi study with a panel of 22 general dentists active in clinical practice, education, and research. Results Analysis of 76 patient records from 9 dentists, combined with previous work, yielded a raw list of 1,509 information items. Refinement reduced this list to 1,107 items, subsequently rated by the Delphi panel. The final model contained 870 items, with 761 (88%) rated as mandatory. In Round 1, 95% (825) of the final items were accepted, in Round 2 the remaining 5% (45). Only 45 items on the initial list were rejected and 192 (or 17%) remained equivocal. Conclusion Grounded in the reality of clinical practice, our proposed content taxonomy represents a significant advance over existing guidelines and standards by providing a granular and comprehensive information representation for general dental patient records. It offers a significant foundational asset for implementing an interoperable health information technology infrastructure for general dentistry. PMID:23838618

Curriculum Mapping of the Master's Program in Pharmacy in Slovenia with the PHAR-QA Competency Framework.

PubMed

Gmeiner, Tanja; Horvat, Nejc; Kos, Mitja; Obreza, Aleš; Vovk, Tomaž; Grabnar, Iztok; Božič, Borut

2017-05-02

This article presents the results of mapping the Slovenian pharmacy curriculum to evaluate the adequacy of the recently developed and validated European Pharmacy Competences Framework (EPCF). The mapping was carried out and evaluated progressively by seven members of the teaching staff at the University of Ljubljana's Faculty of Pharmacy. Consensus was achieved by using a two-round modified Delphi technique to evaluate the coverage of competences in the current curriculum. The preliminary results of the curriculum mapping showed that all of the competences as defined by the EPCF are covered in Ljubljana's academic program. However, because most EPCF competences cover healthcare-oriented pharmacy practice, a lack of competences was observed for the drug development and production perspectives. Both of these perspectives are important because a pharmacist is (or should be) responsible for the entire process, from the development and production of medicines to pharmaceutical care in contact with patients. Nevertheless, Ljubljana's graduates are employed in both of these pharmaceutical professions in comparable proportions. The Delphi study revealed that the majority of differences in scoring arise from different perspectives on the pharmacy profession (e.g., community, hospital, industrial, etc.). Nevertheless, it can be concluded that curriculum mapping using the EPCF is very useful for evaluating and recognizing weak and strong points of the curriculum. However, the competences of the framework should address various fields of the pharmacist's profession in a more balanced way.

Curriculum Mapping of the Master’s Program in Pharmacy in Slovenia with the PHAR-QA Competency Framework

PubMed Central

Gmeiner, Tanja; Horvat, Nejc; Kos, Mitja; Obreza, Aleš; Vovk, Tomaž; Grabnar, Iztok; Božič, Borut

2017-01-01

This article presents the results of mapping the Slovenian pharmacy curriculum to evaluate the adequacy of the recently developed and validated European Pharmacy Competences Framework (EPCF). The mapping was carried out and evaluated progressively by seven members of the teaching staff at the University of Ljubljana’s Faculty of Pharmacy. Consensus was achieved by using a two-round modified Delphi technique to evaluate the coverage of competences in the current curriculum. The preliminary results of the curriculum mapping showed that all of the competences as defined by the EPCF are covered in Ljubljana’s academic program. However, because most EPCF competences cover healthcare-oriented pharmacy practice, a lack of competences was observed for the drug development and production perspectives. Both of these perspectives are important because a pharmacist is (or should be) responsible for the entire process, from the development and production of medicines to pharmaceutical care in contact with patients. Nevertheless, Ljubljana’s graduates are employed in both of these pharmaceutical professions in comparable proportions. The Delphi study revealed that the majority of differences in scoring arise from different perspectives on the pharmacy profession (e.g., community, hospital, industrial, etc.). Nevertheless, it can be concluded that curriculum mapping using the EPCF is very useful for evaluating and recognizing weak and strong points of the curriculum. However, the competences of the framework should address various fields of the pharmacist’s profession in a more balanced way. PMID:28970436

Clinical practice guidelines for the surgical management of colon cancer: a consensus statement of the Hellenic and Cypriot Colorectal Cancer Study Group by the HeSMO*

PubMed Central

Xynos, Evaghelos; Gouvas, Nikolaos; Triantopoulou, Charina; Tekkis, Paris; Vini, Louiza; Tzardi, Maria; Boukovinas, Ioannis; Androulakis, Nikolaos; Athanasiadis, Athanasios; Christodoulou, Christos; Chrysou, Evangelia; Dervenis, Christos; Emmanouilidis, Christos; Georgiou, Panagiotis; Katopodi, Ourania; Kountourakis, Panteleimon; Makatsoris, Thomas; Papakostas, Pavlos; Papamichael, Demetris; Pentheroudakis, Georgios; Pilpilidis, Ioannis; Sgouros, Joseph; Vassiliou, Vassilios; Xynogalos, Spyridon; Ziras, Nikolaos; Karachaliou, Niki; Zoras, Odysseas; Agalianos, Christos; Souglakos, John

2016-01-01

Despite considerable improvement in the management of colon cancer, there is a great deal of variation in the outcomes among European countries, and in particular among different hospital centers in Greece and Cyprus. Discrepancy in the approach strategies and lack of adherence to guidelines for the management of colon cancer may explain the situation. The aim was to elaborate a consensus on the multidisciplinary management of colon cancer, based on European guidelines (ESMO and EURECCA), and also taking into account local special characteristics of our healthcare system. Following discussion and online communication among members of an executive team, a consensus was developed. Statements entered the Delphi voting system on two rounds to achieve consensus by multidisciplinary international experts. Statements with an agreement rate of ≥80% achieved a large consensus, while those with an agreement rate of 60-80% a moderate consensus. Statements achieving an agreement of <60% after both rounds were rejected and not presented. Sixty statements on the management of colon cancer were subjected to the Delphi methodology. Voting experts were 109. The median rate of abstain per statement was 10% (range: 0-41%). In the end of the voting process, all statements achieved a consensus by more than 80% of the experts. A consensus on the management of colon cancer was developed by applying the Delphi methodology. Guidelines are proposed along with algorithms of diagnosis and treatment. The importance of centralization, care by a multidisciplinary team, and adherence to guidelines is emphasized. PMID:26752945

Phase 2 of CATALISE: a multinational and multidisciplinary Delphi consensus study of problems with language development: Terminology.

PubMed

Bishop, Dorothy V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2017-10-01

Lack of agreement about criteria and terminology for children's language problems affects access to services as well as hindering research and practice. We report the second phase of a study using an online Delphi method to address these issues. In the first phase, we focused on criteria for language disorder. Here we consider terminology. The Delphi method is an iterative process in which an initial set of statements is rated by a panel of experts, who then have the opportunity to view anonymised ratings from other panel members. On this basis they can either revise their views or make a case for their position. The statements are then revised based on panel feedback, and again rated by and commented on by the panel. In this study, feedback from a second round was used to prepare a final set of statements in narrative form. The panel included 57 individuals representing a range of professions and nationalities. We achieved at least 78% agreement for 19 of 21 statements within two rounds of ratings. These were collapsed into 12 statements for the final consensus reported here. The term 'Language Disorder' is recommended to refer to a profile of difficulties that causes functional impairment in everyday life and is associated with poor prognosis. The term, 'Developmental Language Disorder' (DLD) was endorsed for use when the language disorder was not associated with a known biomedical aetiology. It was also agreed that (a) presence of risk factors (neurobiological or environmental) does not preclude a diagnosis of DLD, (b) DLD can co-occur with other neurodevelopmental disorders (e.g. ADHD) and (c) DLD does not require a mismatch between verbal and nonverbal ability. This Delphi exercise highlights reasons for disagreements about terminology for language disorders and proposes standard definitions and nomenclature. © 2017 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

Defining a set of standardised outcome measures for newly diagnosed patients with multiple myeloma using the Delphi consensus method: the IMPORTA project.

PubMed

Blade, Joan; Calleja, Miguel Ángel; Lahuerta, Juan José; Poveda, José Luis; de Paz, Héctor David; Lizán, Luis

2018-02-22

To define a standard set of outcomes and the most appropriate instruments to measure them for managing newly diagnosed patients with multiple myeloma (MM). A literature review and five discussion groups facilitated the design of two-round Delphi questionnaire. Delphi panellists (haematologists, hospital pharmacists and patients) were identified by the scientific committee, the Spanish Program of Haematology Treatments Foundation, the Spanish Society of Hospital Pharmacies and the Spanish Community of Patients with MM. Panellist's perception about outcomes' suitability and feasibility of use was assessed on a seven-point Likert scale. Consensus was reached when at least 75% of the respondents reached agreement or disagreement. A scientific committee led the project. Fifty-one and 45 panellists participated in the first and second Delphi rounds, respectively. Consensus was reached to use overall survival, progression-free survival, minimal residual disease and treatment response to assess survival and disease control. Panellists agreed to measure health-related quality of life, pain, performance status, fatigue, psychosocial status, symptoms, self-perception on body image, sexuality and preferences/satisfaction. However, panellist did not reach consensus about the feasibility of assessing in routine practice psychosocial status, symptoms, self-perception on body image and sexuality. Consensus was reached to collect patient-reported outcomes through the European Organisation for the Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire (QLQ) Core questionnaire 30 (C30), three items from EORTC-QLQ-Multiple Myeloma (MY20) and EORTC-QLQ-Breast Cancer (BR23), pain Visual Analogue Scale, Morisky-Green and ad hoc questions about patients' preferences/satisfaction. A consensual standard set of outcomes for managing newly diagnosed patients with MM has been defined. The feasibility of its implementation in routine practice will be assessed in a future pilot study. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Acceptability and Perceived Benefits and Risks of Public and Patient Involvement in Health Care Policy: A Delphi Survey in Belgian Stakeholders.

PubMed

Cleemput, Irina; Christiaens, Wendy; Kohn, Laurence; Léonard, Christian; Daue, François; Denis, Alain

2015-06-01

In systems with public health insurance, coverage decisions should reflect social values. Deliberation among stakeholders could achieve this goal, but rarely involves patients and citizens directly. This study aimed at evaluating the acceptability, and the perceived benefits and risks, of public and patient involvement (PPI) in coverage decision making to Belgian stakeholders. A two-round Delphi survey was conducted among all stakeholder groups. The survey was constructed on the basis of interviews with 10 key stakeholders and a review of the literature on participation models. Consensus was defined as 65% or more of the respondents agreeing with a statement and less than 15% disagreeing. Eighty stakeholders participated in both rounds. They were defined as the Delphi panel. Belgian stakeholders are open toward PPI in coverage decision processes. Benefits are expected to exceed risks. The preferred model for involvement is to consult citizens or patients, within the existing decision-making structures and at specific milestones in the process. Consulting citizens and patients is a higher level of involvement than merely informing them and a lower level than letting them participate actively. Consultation involves asking nonbinding advice on (parts of) the decision problem. According to the Delphi panel, the benefits of PPI could be increasing awareness among members of the general public and patients about the challenges and costs of health care, and enriched decision processes with expertise by experience from patients. Potential risks include subjectivity, insufficient resources to participate and weigh on the process, difficulties in finding effective ways to express a collective opinion, the risk of manipulation, and lobbying or power games of other stakeholders. PPI in coverage decision-making processes is acceptable to Belgian stakeholders, be it in different ways for different types of decisions. Benefits are expected to outweigh risks. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

The main indicators for Iranian hospital ethical accreditation

PubMed Central

ENJOO, SEYED ALI; AMINI, MITRA; TABEI, SEYED ZIAADIN; MAHBUDI, ALI; KAVOSI, ZAHRA; SABER, MAHBOOBEH

2015-01-01

Introduction The application of organizational ethics in hospitals is one of the novel ways to improve medical ethics. Nowadays achieving efficient and sufficient ethical hospital indicators seems to be inevitable. In this connection, the present study aims to determine the best indicators in hospital accreditation. Methods 69 indicators in 11 fields to evaluate hospital ethics were achieved through a five-step qualitative and quantitative study including literature review, expert focus group, Likert scale survey, 3 rounded Delphi, and content validity measurement. Expert focus group meeting was conducted, employing Nominal Group Technique (NGT). After running NGT, a three rounded Delphi and parallel to Delphi and a Likert scale survey were performed to obtain objective indicators for each domain. The experts were all healthcare professionals who were also medical ethics researchers, teachers, or PhD students. Content validity measurements were computed, using the viewpoints of two different expert groups, some ethicists, and some health care professionals (n=46). Results After conducting NGT, Delphi, Likert survey, 11 main domains were listed including:  Informed consent, Medical confidentiality, Physician-patient economic relations, Ethics consultation policy in the hospital, Ethical charter of hospital, Breaking bad medical news protocol, Respect for the patients’ rights, Clinical ethics committee, Spiritual and palliative care unit programs in the hospitals, Healthcare professionals’ communication skills, and Equitable access to the healthcare. Also 71 objective indicators for these 11 domains were listed in 11 tables with 5 to 8 indicators per table. Content Validity Ratio (CVR) measurements were done and 69 indicators were highlighted. Conclusion The domains listed in this study seem to be the most important ones for evaluating hospital ethics programs and services. Healthcare organizations’ accreditation and ranking are crucial for the improvement of healthcare services. Ethics programs would also motivate hospitals to improve their services and move towards patients’ satisfaction. In this regard, more involvement of bioethicists can help healthcare organizations to develop ethics programs and ensure ethics-based practice in hospitals. PMID:26269789

A medical school's organizational readiness for curriculum change (MORC): development and validation of a questionnaire.

PubMed

Jippes, Mariëlle; Driessen, Erik W; Broers, Nick J; Majoor, Gerard D; Gijselaers, Wim H; van der Vleuten, Cees P M

2013-09-01

Because successful change implementation depends on organizational readiness for change, the authors developed and assessed the validity of a questionnaire, based on a theoretical model of organizational readiness for change, designed to measure, specifically, a medical school's organizational readiness for curriculum change (MORC). In 2012, a panel of medical education experts judged and adapted a preliminary MORC questionnaire through a modified Delphi procedure. The authors administered the resulting questionnaire to medical school faculty involved in curriculum change and tested the psychometric properties using exploratory and confirmatory factor analysis, and generalizability analysis. The mean relevance score of the Delphi panel (n = 19) reached 4.2 on a five-point Likert-type scale (1 = not relevant and 5 = highly relevant) in the second round, meeting predefined criteria for completing the Delphi procedure. Faculty (n = 991) from 131 medical schools in 56 countries completed MORC. Exploratory factor analysis yielded three underlying factors-motivation, capability, and external pressure-in 12 subscales with 53 items. The scale structure suggested by exploratory factor analysis was confirmed by confirmatory factor analysis. Cronbach alpha ranged from 0.67 to 0.92 for the subscales. Generalizability analysis showed that the MORC results of 5 to 16 faculty members can reliably evaluate a school's organizational readiness for change. MORC is a valid, reliable questionnaire for measuring organizational readiness for curriculum change in medical schools. It can identify which elements in a change process require special attention so as to increase the chance of successful implementation.

[Identification of the scope of practice for dental nurses with Delphi method].

PubMed

Li, Yu-Hong; Lu, Yue-Cen; Huang, Yao; Ruan, Hong; Wu, Zheng-Yi

2016-10-01

To identify the practice scope of dental nurses under the new situations. The draft of scope of practice for dental nurses was based on theoretical analysis, literature review and consultation of advisory panel, and the final scope of practice for dental nurses was established by using the Delphi method. Statistical analysis was implemented using coefficient of variation, Kendall W with SPSS 17.0 software package. Thirty experts were consulted twice by using the Delphi method. The effective rates of two rounds of questionnaire were 100% and 73.3%, respectively. The authority coefficient was 0.837, and the P value of expert coordination coefficients W was less than 0.05. There were totally 116 suggestions from the experts, and 96 were accepted. The scope of practice for dental nurses was finally established, including 4 primary indexes and 25 secondary indexes. The scope of practice for dental nurses under the new situations is established in China through scientific methods. It is favorable for position management of dental nurses and may promote the development of nurse specialists in dental clinic.

Development of disaster mental health guidelines through the Delphi process in Japan.

PubMed

Suzuki, Yuriko; Fukasawa, Maiko; Nakajima, Satomi; Narisawa, Tomomi; Kim, Yoshiharu

2012-07-02

The mental health community in Japan had started reviewing the country's disaster mental health guidelines before the Great East Japan Earthquake, aiming to revise them based on evidence and experience accumulated in the last decade. Given the wealth of experience and knowledge acquired in the field by many Japanese mental health professionals, we decided to develop the guidelines through systematic consensus building and selected the Delphi method. After a thorough literature review and focus group interviews, 96 items regarding disaster mental health were included in Delphi Round 1. Of 100 mental health professionals experienced in disaster response who were invited to participate, 97 agreed. The appropriateness of each statement was assessed by the participants using a Likert scale (1: extremely inappropriate, 9: very appropriate) and providing free comments in three rounds. Consensus by experts was defined as an average score of ≥7 for which ≥70% of participants assigned this score, and items reaching consensus were included in the final guidelines. Overall, of the 96 items (89 initially asked and 7 added items), 77 items were agreed on (46 items in Round 1, and 19 positive and 12 negative agreed on items in Round 2). In Round 2, three statements with which participants agreed most strongly were: 1) A protocol for emergency work structure and information flow should be prepared in normal times; 2) The mental health team should attend regular meetings on health and medicine to exchange information; and 3) Generally, it is recommended not to ask disaster survivors about psychological problems at the initial response but ask about their present worries and physical condition. Three statements with which the participants disagreed most strongly in this round were: 1) Individuals should be encouraged to provide detailed accounts of their experiences; 2) Individuals should be provided with education if they are interested in receiving it; and 3) Bad news should be withheld from distressed individuals for fear of causing more upset. Most items which achieved agreement in Round 1 were statements described in previous guidelines or publications, or statements regarding the basic attitude of human service providers. The revised guidelines were thus developed based on the collective wisdom drawn from Japanese practitioners' experience while also considering the similarities and differences from the international standards.

Nursing diagnoses (NANDA-I) in hematology-oncology: a Delphi-study.

PubMed

Speksnijder, Herma T; Mank, Arno P; van Achterberg, Theo

2011-01-01

To identify NANDA-I diagnoses that are most relevant to hematology-oncology nursing in Europe. In a two-round, electronic, quantitative Delphi study, 28 experts from nine European countries assessed the relevance of NANDA-I diagnoses and health problems. This study identified 64 relevant diagnoses and three health problems. All experts listed 11 diagnoses: "imbalanced nutrition: less than body requirements,"diarrhea,"fatigue,"risk for bleeding,"risk for infection,"impaired oral mucous membrane,"risk for impaired skin integrity,"impaired skin integrity,"hyperthermia,"nausea,"acute pain," and the health problem "pruritis." The "NANDA-I classification 2009-2011" describes, in almost all disease- and treatment-related problems, nursing diagnoses as relevant to the adult patient with hematological malignancy. These diagnoses are therefore recommended. © 2011, The Authors. International Journal of Nursing Terminologies and Classifications © 2011, NANDA International.

Consensus on the Definition of Advanced Parkinson's Disease: A Neurologists-Based Delphi Study (CEPA Study).

PubMed

Luquin, Maria-Rosario; Kulisevsky, Jaime; Martinez-Martin, Pablo; Mir, Pablo; Tolosa, Eduardo S

2017-01-01

To date, no consensus exists on the key factors for diagnosing advanced Parkinson disease (APD). To obtain consensus on the definition of APD, we performed a prospective, multicenter, Spanish nationwide, 3-round Delphi study (CEPA study). An ad hoc questionnaire was designed with 33 questions concerning the relevance of several clinical features for APD diagnosis. In the first-round, 240 neurologists of the Spanish Movement Disorders Group participated in the study. The results obtained were incorporated into the questionnaire and both, results and questionnaire, were sent out to and fulfilled by 26 experts in Movement Disorders. Review of results from the second-round led to a classification of symptoms as indicative of "definitive," "probable," and "possible" APD. This classification was confirmed by 149 previous participating neurologists in a third-round, where 92% completely or very much agreed with the classification. Definitive symptoms of APD included disability requiring help for the activities of daily living, presence of motor fluctuations with limitations to perform basic activities of daily living without help, severe dysphagia, recurrent falls, and dementia. These results will help neurologists to identify some key factors in APD diagnosis, thus allowing users to categorize the patients for a homogeneous recognition of this condition.

Study of labor-negotiation productivity concerns in the petroleum-refining industry

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, J.E.

The primary objective of this study was to identify productivity factors relative to negotiating future labor contracts with the Oil, Chemical and Atomic Workers International Union (OCAWIU). A Delphi research method was utilized to accomplish this purpose. The study utilized three rounds to obtain the stated objectives. Round one involved the use of an open instrument to solicit productivity factors that would be beneficial in future negotiations with the OCAWIU. In round two, two separate instruments were sent to the panel members who were asked to judge the value of each item on the first instrument, and to rank themore » ten most significant items on the second. The round three instruments were individualized for each panel member. The productivity items were rated by the panel members, and descriptive statistics were used to describe the combined order of listings and weights for determining the relative importance of each factor in the consensus model. The nonparametric statistics were used to examine the degree of consensus between the mean values on the first instrument with the ranked values for the second instrument. No significant differences were formed. Twenty-five productivity items were identified and prioritized as viable negotiable items with the OCAWIU.« less

Establishment of a dental license regulation authority is required in Korea: results of the Delphi technique.

PubMed

Choi, Jin-Woo; Kim, Kack-Kyun; Lee, Jihyun; Choi, Dong-Ju; Kim, Kyung-Nyun

2017-01-01

In addition to dental education, a system for the evaluation and management of dental licensing and certification is required to meet the growing societal demand for more competent dentists. In this study, the Delphi technique was used to gather opinions from a variety of professionals on the problems of and remedies for the dental license management system in Korea. Delphi surveys were conducted from April 2016 to October 2016 in South Korea. A variety of dental professionals were included and categorized into 3 groups according to their expertise as follows: the basic dentistry group, the clinical dentistry group, and the policy group. The Delphi technique was conducted in 3 rounds of e-mail surveys, each with different questions that probed with increasing depth on the dental license management system. In each successive round, the responses were categorized, scored on a Likert scale, and statistically analyzed. After categorizing the results of the first survey and ranking the results of the second survey using the Delphi technique, regulation by a licensing authority was found to be the most critical issue. This was followed by the license renewal system, continuing education, a tiered licensure system, improvement of foreign license approval, and utilization of retirees, in decreasing order of importance. The third Delphi survey showed a similar ranking, with regulation by a licensing authority being the major concern. Opinions regarding the dental license management system were provided as open-ended responses. The responses of the 3 groups showed statistically significant differences in the scores for the issue of regulation by a licensing authority. After re-grouping into the dentistry group and the policy group, the issue received a significantly higher score in the dentistry group. The quality of dental treatment should be managed to protect patients and dental professionals. For this purpose, the establishment of an independent license regulation authority along with legislative changes is required.

Consensus development of core competencies in intensive and critical care medicine training in China.

PubMed

Hu, Xiaoyun; Xi, Xiuming; Ma, Penglin; Qiu, Haibo; Yu, Kaijiang; Tang, Yaoqing; Qian, Chuanyun; Fang, Qiang; Wang, Yushan; Yu, Xiangyou; Xu, Yuan; Du, Bin

2016-10-16

The aim of this study is to develop consensus on core competencies required for postgraduate training in intensive care medicine. We used a combination of a modified Delphi method and a nominal group technique to create and modify the list of core competencies to ensure maximum consensus. Ideas were generated modified from Competency Based Training in Intensive Care Medicine in Europe collaboration (CoBaTrICE) core competencies. An online survey invited healthcare professionals, educators, and trainees to rate and comment on these competencies. The output from the online survey was edited and then reviewed by a nominal group of 13 intensive care professionals to identify each competence for importance. The resulting list was then recirculated in the nominal group for iterative rating. The online survey yielded a list of 199 competencies for nominal group reviewing. After five rounds of rating, 129 competencies entered the final set defined as core competencies. We have generated a set of core competencies using a consensus technique which can serve as an indicator for training program development.

A pushing chronic care forward in Abu Dhabi by identifying priorities and addressing barriers: a modified Delphi technique

PubMed Central

Loney, Tom; Lapão, Luis V

2018-01-01

Objective This study aimed to elucidate the top five key priorities and barriers to chronic care in the health system of Abu Dhabi, United Arab Emirates (UAE). Design A modified Delphi study was performed to reach consensus on priority areas and barriers to the development of the Chronic Care Model in the health system of Abu Dhabi. Individual wireless audience response devices (keypads) linked to a computer were used to reduce 28 priorities and 20 barriers to the top five during three iterative rounds over three consecutive days. Setting Chronic care services for patients with diabetes, cardiovascular diseases and cancer, in both private and publicly funded healthcare services in the emirate of Abu Dhabi. Participants A purposive sample of 20 health systems’ experts were recruited. They were front-line healthcare workers from the public and private sector working in the delivery of care for patients with diabetes, cardiovascular diseases and cancer. Results The ‘overall organizational leadership in chronic illness care’ was ranked as the most important priority to address (26.3%) and ‘patient compliance’ was ranked as the most important barrier (36.8%) to the development of the Chronic Care Model. Conclusions This study has identified the current priorities and barriers to improving chronic care within Abu Dhabi’s healthcare system. Our paper addresses the UAE’s 2021 Agenda of achieving a world-class healthcare system, and findings may help inform strategic changes required to achieve this mission. PMID:29866724

Development of Indicators to Assess Quality of Care for Prostate Cancer.

PubMed

Nag, Nupur; Millar, Jeremy; Davis, Ian D; Costello, Shaun; Duthie, James B; Mark, Stephen; Delprado, Warick; Smith, David; Pryor, David; Galvin, David; Sullivan, Frank; Murphy, Áine C; Roder, David; Elsaleh, Hany; Currow, David; White, Craig; Skala, Marketa; Moretti, Kim L; Walker, Tony; De Ieso, Paolo; Brooks, Andrew; Heathcote, Peter; Frydenberg, Mark; Thavaseelan, Jeffery; Evans, Sue M

2016-02-20

The development, monitoring, and reporting of indicator measures that describe standard of care provide the gold standard for assessing quality of care and patient outcomes. Although indicator measures have been reported, little evidence of their use in measuring and benchmarking performance is available. A standard set, defining numerator, denominator, and risk adjustments, will enable global benchmarking of quality of care. To develop a set of indicators to enable assessment and reporting of quality of care for men with localised prostate cancer (PCa). Candidate indicators were identified from the literature. An international panel was invited to participate in a modified Delphi process. Teleconferences were held before and after each voting round to provide instruction and to review results. Panellists were asked to rate each proposed indicator on a Likert scale of 1-9 in a two-round iterative process. Calculations required to report on the endorsed indicators were evaluated and modified to reflect the data capture of the Prostate Cancer Outcomes Registry-Australia and New Zealand (PCOR-ANZ). A total of 97 candidate indicators were identified, of which 12 were endorsed. The set includes indicators covering pre-, intra-, and post-treatment of PCa care, within the limits of the data captured by PCOR-ANZ. The 12 endorsed quality measures enable international benchmarking on the quality of care of men with localised PCa. Reporting on these indicators enhances safety and efficacy of treatment, reduces variation in care, and can improve patient outcomes. PCa has the highest incidence of all cancers in men. Early diagnosis and relatively high survival rates mean issues of quality of care and best possible health outcomes for patients are important. This paper identifies 12 important measurable quality indicators in PCa care. Copyright © 2016 European Association of Urology. Published by Elsevier B.V. All rights reserved.

ISSLS Prize Winner: Consensus on the Clinical Diagnosis of Lumbar Spinal Stenosis: Results of an International Delphi Study.

PubMed

Tomkins-Lane, Christy; Melloh, Markus; Lurie, Jon; Smuck, Matt; Battié, Michele C; Freeman, Brian; Samartzis, Dino; Hu, Richard; Barz, Thomas; Stuber, Kent; Schneider, Michael; Haig, Andrew; Schizas, Constantin; Cheung, Jason Pui Yin; Mannion, Anne F; Staub, Lukas; Comer, Christine; Macedo, Luciana; Ahn, Sang-Ho; Takahashi, Kazuhisa; Sandella, Danielle

2016-08-01

Delphi. The aim of this study was to obtain an expert consensus on which history factors are most important in the clinical diagnosis of lumbar spinal stenosis (LSS). LSS is a poorly defined clinical syndrome. Criteria for defining LSS are needed and should be informed by the experience of expert clinicians. Phase 1 (Delphi Items): 20 members of the International Taskforce on the Diagnosis and Management of LSS confirmed a list of 14 history items. An online survey was developed that permits specialists to express the logical order in which they consider the items, and the level of certainty ascertained from the questions. Phase 2 (Delphi Study) Round 1: Survey distributed to members of the International Society for the Study of the Lumbar Spine. Round 2: Meeting of 9 members of Taskforce where consensus was reached on a final list of 10 items. Round 3: Final survey was distributed internationally. Phase 3: Final Taskforce consensus meeting. A total of 279 clinicians from 29 different countries, with a mean of 19 (±SD: 12) years in practice participated. The six top items were "leg or buttock pain while walking," "flex forward to relieve symptoms," "feel relief when using a shopping cart or bicycle," "motor or sensory disturbance while walking," "normal and symmetric foot pulses," "lower extremity weakness," and "low back pain." Significant change in certainty ceased after six questions at 80% (P < .05). This is the first study to reach an international consensus on the clinical diagnosis of LSS, and suggests that within six questions clinicians are 80% certain of diagnosis. We propose a consensus-based set of "seven history items" that can act as a pragmatic criterion for defining LSS in both clinical and research settings, which in the long term may lead to more cost-effective treatment, improved health care utilization, and enhanced patient outcomes. 2.

TREatment of ATopic eczema (TREAT) Registry Taskforce: An international Delphi exercise to identify a core set of domains and domain items for national atopic eczema photo- and systemic therapy registries.

PubMed

Gerbens, L A A; Apfelbacher, C J; Irvine, A D; Barbarot, S; de Booij, R J; Boyce, A E; Deleuran, M; Eichenfield, L F; Hof, M H; Middelkamp-Hup, M A; Roberts, A; Schmitt, J; Vestergaard, C; Wall, D; Weidinger, S; Williamson, P R; Flohr, C; Spuls, P I

2018-05-15

Evidence of immunomodulatory therapies to guide clinical management for atopic eczema (AE) is scarce, despite frequent and often off-label use. Patient registries provide valuable evidence for the effects of treatments under real world conditions which can inform treatment guidelines, give the opportunity for health economic evaluation and the evaluation of quality of care, as well as pharmacogenetic and -dynamic research which cannot be adequately addressed in clinical trials. The TREatment of ATopic eczema (TREAT) Registry Taskforce aims to seek international consensus on a core set of domains and items ('what to measure') for AE research registries, using a Delphi approach. Participants from six stakeholder groups were included: doctors, nurses, non-clinical researchers, patients, industry and regulatory body representatives. The eDelphi comprised 3 sequential online rounds, requesting participants to rate the importance of each proposed domain item. Participants could add domain items to the proposed list in round 1. A final consensus meeting was held to ratify the core set. 479 participants from 36 countries accessed the eDelphi platform, of whom 86%, 79% and 74% completed rounds 1, 2, and 3 respectively. At the face-to-face consensus meeting attended by 42 participants the final core set was established containing 19 domains with 69 domain items (49 baseline and 20 follow-up items). This core set of domains and items to be captured by national AE systemic therapy registries will standardise data collection and thereby allow direct comparability across registries and facilitate data pooling between countries. Ultimately, it will provide greater insight into the effectiveness, safety and cost-effectiveness of photo- and systemic immunomodulatory therapies. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Development of a consensus taxonomy of sedentary behaviors (SIT): report of Delphi Round 1.

PubMed

Chastin, Sebastien Francois Martin; Schwarz, Ulf; Skelton, Dawn A; Skelton, Dawn Ann

2013-01-01

Over the last decade, sedentary behaviors have emerged as a distinctive behavioral paradigm with deleterious effects on health independent of physical activity. The next phase of research is to establish dose response between sedentary behaviors and health outcomes and improve understanding of context and determinants of these behaviors. Establishing a common taxonomy of these behaviors is a necessary step in this process. The Sedentary behavior International Taxonomy project was developed to establish a classification of sedentary behaviors by use of a formal consensus process. The study follows a Delphi process in three Rounds. A preparatory stage informed the development of terms of reference documents. In Round 1, experts were asked to make statements about the taxonomy; 1) its purpose and use ; 2) the domains, categories or facets that should be consider and include; 3) the structure/architecture to arrange and link these domains and facets. In Round 2 experts will be presented with a draft taxonomy emerging from Round 1 and invited to comment and propose alterations. The taxonomy will then be finalised at the outset of this stage. Results of Round 1 are reported here. There is a general consensus that a taxonomy will help advances in research by facilitating systematic and standardised: 1) investigation and analysis; 2) reporting and communication; 3) data pooling, comparison and meta-analysis; 4) development of measurement tools; 4) data descriptions, leading to higher quality in data querying and facilitate discoveries. There is also a consensus that such a taxonomy should be flexible to accommodate diverse purposes of use, and future advances in the field and yet provide a cross-disciplinary common language. A consensual taxonomy structure emerged with nine primary facets (Purpose, Environment, Posture, Social, Measurement, Associated behavior, Status, Time, Type) and the draft structure presented here for Round 2.

Towards a definition of neurodisability: a Delphi survey.

PubMed

Morris, Christopher; Janssens, Astrid; Tomlinson, Richard; Williams, Jane; Logan, Stuart

2013-12-01

The aim of this study was to develop, systematically, a consensus-based definition for 'neurodisability' that is meaningful to health professionals and parents of children with neurological conditions. A multidisciplinary group of health professionals was recruited through child development teams and professional societies in the UK; several parents of children with neurological conditions worked with the research team. Professionals participated in three rounds of a Delphi survey. Participants rated their agreement with a proposed definition in each round, and feedback was used to refine the definition. Finally, a perspective was sought from international experts. Responses to the three rounds were as follows: round 1,245 out of 290 (84.4%); round 2,242 out of 300 (80.6%); and round 3,237 out of 297 (79.7%). Agreement with the proposed definition was extremely high in every round (89.0%, 90.1%, and 93.6% respectively). The final version of the definition was widely endorsed among professionals, parents, and a small number of international colleagues. The final definition is as follows: 'Neurodisability describes a group of congenital or acquired long-term conditions that are attributed to impairment of the brain and/or neuromuscular system and create functional limitations. A specific diagnosis may not be identified. Conditions may vary over time, occur alone or in combination, and include a broad range of severity and complexity. The impact may include difficulties with movement, cognition, hearing and vision, communication, emotion, and behaviour'. An agreed definition of neurodisability will be useful for conducting research or clinical evaluations with people affected by neurological problems. © 2013 Crown copyright. Developmental Medicine and Child Neurology © 2013 Mac Keith Press. This article is published with the permission of the Controller of HMSO and the Queen's Printer for Scotland.

Legislative priorities for transportation safety in Virginia : a pilot application of a modified delphi technique : final report.

DOT National Transportation Integrated Search

1985-01-01

Using a modified version of the Delphi technique, a panel of transportation safety experts developed the following list of legislative priorities for submission to the Department of Motor Vehicles (DMV) Legislative Package for the 1986 session of the...

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research.

PubMed

Staniszewska, S; Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-08-02

Background  While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. Objective  To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. Methods  The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. Results  143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. Conclusions  GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Determining procedures for simulation-based training in radiology: a nationwide needs assessment.

PubMed

Nayahangan, Leizl Joy; Nielsen, Kristina Rue; Albrecht-Beste, Elisabeth; Bachmann Nielsen, Michael; Paltved, Charlotte; Lindorff-Larsen, Karen Gilboe; Nielsen, Bjørn Ulrik; Konge, Lars

2018-06-01

New training modalities such as simulation are widely accepted in radiology; however, development of effective simulation-based training programs is challenging. They are often unstructured and based on convenience or coincidence. The study objective was to perform a nationwide needs assessment to identify and prioritize technical procedures that should be included in a simulation-based curriculum. A needs assessment using the Delphi method was completed among 91 key leaders in radiology. Round 1 identified technical procedures that radiologists should learn. Round 2 explored frequency of procedure, number of radiologists performing the procedure, risk and/or discomfort for patients, and feasibility for simulation. Round 3 was elimination and prioritization of procedures. Response rates were 67 %, 70 % and 66 %, respectively. In Round 1, 22 technical procedures were included. Round 2 resulted in pre-prioritization of procedures. In round 3, 13 procedures were included in the final prioritized list. The three highly prioritized procedures were ultrasound-guided (US) histological biopsy and fine-needle aspiration, US-guided needle puncture and catheter drainage, and basic abdominal ultrasound. A needs assessment identified and prioritized 13 technical procedures to include in a simulation-based curriculum. The list may be used as guide for development of training programs. • Simulation-based training can supplement training on patients in radiology. • Development of simulation-based training should follow a structured approach. • The CAMES Needs Assessment Formula explores needs for simulation training. • A national Delphi study identified and prioritized procedures suitable for simulation training. • The prioritized list serves as guide for development of courses in radiology.

Challenges faced with the implementation of Web-Based Data Query Systems for population health: development of a questionnaire based on expert consensus.

PubMed

Ahuja, Manik; Aseltine, Robert; Warren, Nicholas; Reisine, Susan; Williams, Pam Holtzclaw; Cislo, Andy

2018-01-01

State health agencies (SHA) and local health agencies (LHA) face several challenges with the dissemination of local health data using Web-Based Data Query Systems (WDQS). To help guide future research, this study aimed to utilize expert consensus to identify the most relevant items that contribute to these challenges. A total of 17 researchers and public health professionals agreed to participate in a three-round Delphi process. In round 1, four topics were represented on a 42-item questionnaire using a 5-point Likert scale, along with free-text responses. Free-text responses were analyzed leading to a series of items for a second Delphi round. Participants were given an opportunity to revise results in round 3 for items that did not meet consensus in round 1 or round 2. Consensus on expert opinions was defined at interquartile range (IQR) ≤ 1. The experts reached consensus on a total of 21 (50%) of the 42 items presented in the initial questionnaire. Eleven of the 15 (73%) of the items extracted from the free-text responses met consensus. Items in consensus from this pilot study were used to develop an instrument for a broader survey across Behavioral Risk Factor Surveillance System (BRFSS) coordinators across all 50 US states. Experts confirmed that software development costs, inadequate human resources, data sharing gaps, a lack of political support, and poor data quality contribute significantly to challenges in their data implementation. The findings from this pilot study inform us of items of public health significance that will help guide future research.

Barriers Influencing Linkage to Hypertension Care in Kenya: Qualitative Analysis from the LARK Hypertension Study.

PubMed

Naanyu, Violet; Vedanthan, Rajesh; Kamano, Jemima H; Rotich, Jackson K; Lagat, Kennedy K; Kiptoo, Peninah; Kofler, Claire; Mutai, Kennedy K; Bloomfield, Gerald S; Menya, Diana; Kimaiyo, Sylvester; Fuster, Valentin; Horowitz, Carol R; Inui, Thomas S

2016-03-01

Hypertension, the leading global risk factor for mortality, is characterized by low treatment and control rates in low- and middle-income countries. Poor linkage to hypertension care contributes to poor outcomes for patients. However, specific factors influencing linkage to hypertension care are not well known. To evaluate factors influencing linkage to hypertension care in rural western Kenya. Qualitative research study using a modified Health Belief Model that incorporates the impact of emotional and environmental factors on behavior. Mabaraza (traditional community assembly) participants (n = 242) responded to an open invitation to residents in their respective communities. Focus groups, formed by purposive sampling, consisted of hypertensive individuals, at-large community members, and community health workers (n = 169). We performed content analysis of the transcripts with NVivo 10 software, using both deductive and inductive codes. We used a two-round Delphi method to rank the barriers identified in the content analysis. We selected factors using triangulation of frequency of codes and themes from the transcripts, in addition to the results of the Delphi exercise. Sociodemographic characteristics of participants were summarized using descriptive statistics. We identified 27 barriers to linkage to hypertension care, grouped into individual (cognitive and emotional) and environmental factors. Cognitive factors included the asymptomatic nature of hypertension and limited information. Emotional factors included fear of being a burden to the family and fear of being screened for stigmatized diseases such as HIV. Environmental factors were divided into physical (e.g. distance), socioeconomic (e.g. poverty), and health system factors (e.g. popularity of alternative therapies). The Delphi results were generally consistent with the findings from the content analysis. Individual and environmental factors are barriers to linkage to hypertension care in rural western Kenya. Our analysis provides new insights and methodological approaches that may be relevant to other low-resource settings worldwide.

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study.

PubMed

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-08-18

The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

A Delphi approach to reach consensus on primary care guidelines regarding youth violence prevention.

PubMed

De Vos, Edward; Spivak, Howard; Hatmaker-Flanigan, Elizabeth; Sege, Robert D

2006-10-01

Anticipatory guidance is a cornerstone of modern pediatric practice. In recognition of its importance for child well being, injury prevention counseling is a standard element of that guidance. Over the last 20 years, there has been growing recognition that intentional injury or violence is one of the leading causes of morbidity and mortality among youth. The US Surgeon General identified youth violence as a major public health issue and a top priority. Yet, only recently has the scope of injury prevention counseling been expanded to include violence. Pediatric health care providers agree that youth violence-prevention counseling should be provided, yet the number of topics available, the already lengthy list of other anticipatory guidance topics to be covered, developmental considerations, and the evidence base make the selection of an agreed-on set a considerable challenge. The purpose of this study was to systematically identify and prioritize specific counseling topics in violence prevention that could be integrated into anticipatory guidance best practice. A modified electronic Delphi process was used to gain consensus among 50 national multidisciplinary violence-prevention experts. Participants were unaware of other participants' identities. The process consisted of 4 serial rounds of inquiry beginning with a broad open-ended format for the generation of anticipatory guidance and screening topics across 5 age groups (infant, toddler, school age, adolescent, and all ages). Each subsequent round narrowed the list of topics toward the development of a manageable set of essential topics for screening and counseling about positive youth development and violence prevention. Forty-seven unique topics were identified, spanning birth to age 21 years. Topics cover 4 broad categories (building blocks): physical safety, parent centered, child centered, and community connection. Participants placed topics into their developmentally appropriate visit-based schedule and made suggestions for an appropriate topic reinforcement schedule. The resulting schedule provides topics for introduction and reinforcement at each visit. The Delphi technique proved a useful approach for accessing expert opinion, for analyzing and synthesizing results, for achieving consensus, and for setting priorities among the numerous anticipatory guidance and assessment topics relevant for raising resilient, violence-free youth.

Academic Primer Series: Key Papers About Competency-Based Medical Education

PubMed Central

Cooney, Robert; Chan, Teresa M.; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-01-01

Introduction Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Methods Based on the online discussions of the 2016–2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Results Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. Conclusion We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs. PMID:28611893

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

Multidisciplinary Consensus on the Nonadherence to Clinical Management of Inhaled Therapy in Spanish asthma patients.

PubMed

López-Viña, Antolín; Giner, Jordi; Molina, Jesús; Palicio, Javier; Plaza, Javier; Quintano, José Antonio; Quirce, Santiago; Soria, Cristina; Uréndez, Ana María; Plaza, Vicente

2017-08-01

Rates of nonadherence to asthma treatment in Spain are between 24% and 76%, which results in poor disease control and increased health care costs. The main objective of this multidisciplinary consensus was to investigate the opinions of health professionals and patients regarding adherence to inhaled therapy in Spain. The results will help to identify the causes of nonadherence and to establish strategies to detect and correct the problem. This research was conducted by using a modified Delphi method organized into 2 rounds and involving a panel of 64 physicians, 16 nurses, and 10 community pharmacists. In addition, 70 patients with asthma completed a simplified 1-round survey, based on the Delphi questionnaire. The items proposed to reach a consensus included topics such as impact and causes of nonadherence, as well as strategies to improve adherence to treatment. Expert panelists reached a consensus on ~80% of the items proposed. They agreed that the lack of control in asthma has an important economic impact. The causes of nonadherence with more agreement were the patients' beliefs about treatment and the complexity of the inhalation devices. Panelists agreed that the most important strategies to improve adherence were modification of patients' beliefs, training of professionals in the management of adherence, and personalization of interventions. Most patients only agreed with items that referred to strategies to improve adherence. Although the problems, impact, causes, and interventions regarding nonadherence to asthma treatment are known, adequate monitoring of adherence to treatment is not performed. A multidisciplinary and personalized approach is necessary to control and improve adherence. Copyright © 2017 Elsevier HS Journals, Inc. All rights reserved.

Defining consensus norms for palliative care of people with intellectual disabilities in Europe, using Delphi methods: A White Paper from the European Association of Palliative Care

PubMed Central

Tuffrey-Wijne, Irene; McLaughlin, Dorry; Curfs, Leopold; Dusart, Anne; Hoenger, Catherine; McEnhill, Linda; Read, Sue; Ryan, Karen; Satgé, Daniel; Straßer, Benjamin; Westergård, Britt-Evy; Oliver, David

2015-01-01

Background: People with intellectual disabilities often present with unique challenges that make it more difficult to meet their palliative care needs. Aim: To define consensus norms for palliative care of people with intellectual disabilities in Europe. Design: Delphi study in four rounds: (1) a taskforce of 12 experts from seven European countries drafted the norms, based on available empirical knowledge and regional/national guidelines; (2) using an online survey, 34 experts from 18 European countries evaluated the draft norms, provided feedback and distributed the survey within their professional networks. Criteria for consensus were clearly defined; (3) modifications and recommendations were made by the taskforce; and (4) the European Association for Palliative Care reviewed and approved the final version. Setting and participants: Taskforce members: identified through international networking strategies. Expert panel: a purposive sample identified through taskforce members’ networks. Results: A total of 80 experts from 15 European countries evaluated 52 items within the following 13 norms: equity of access, communication, recognising the need for palliative care, assessment of total needs, symptom management, end-of-life decision making, involving those who matter, collaboration, support for family/carers, preparing for death, bereavement support, education/training and developing/managing services. None of the items scored less than 86% agreement, making a further round unnecessary. In light of respondents’ comments, several items were modified and one item was deleted. Conclusion: This White Paper presents the first guidance for clinical practice, policy and research related to palliative care for people with intellectual disabilities based on evidence and European consensus, setting a benchmark for changes in policy and practice. PMID:26346181

ESPEN endorsed recommendations. Definition and classification of intestinal failure in adults.

PubMed

Pironi, Loris; Arends, Jann; Baxter, Janet; Bozzetti, Federico; Peláez, Rosa Burgos; Cuerda, Cristina; Forbes, Alastair; Gabe, Simon; Gillanders, Lyn; Holst, Mette; Jeppesen, Palle Bekker; Joly, Francisca; Kelly, Darlene; Klek, Stanislaw; Irtun, Øivind; Olde Damink, S W; Panisic, Marina; Rasmussen, Henrik Højgaard; Staun, Michael; Szczepanek, Kinga; Van Gossum, André; Wanten, Geert; Schneider, Stéphane Michel; Shaffer, Jon

2015-04-01

Intestinal failure (IF) is not included in the list of PubMed Mesh terms, as failure is the term describing a state of non functioning of other organs, and as such is not well recognized. No scientific society has yet devised a formal definition and classification of IF. The European Society for Clinical Nutrition and Metabolism guideline committee endorsed its "home artificial nutrition and chronic IF" and "acute IF" special interest groups to write recommendations on these issues. After a Medline Search, in December 2013, for "intestinal failure" and "review"[Publication Type], the project was developed using the Delphi round methodology. The final consensus was reached on March 2014, after 5 Delphi rounds and two live meetings. The recommendations comprise the definition of IF, a functional and a pathophysiological classification for both acute and chronic IF and a clinical classification of chronic IF. IF was defined as "the reduction of gut function below the minimum necessary for the absorption of macronutrients and/or water and electrolytes, such that intravenous supplementation is required to maintain health and/or growth". This formal definition and classification of IF, will facilitate communication and cooperation among professionals in clinical practice, organization and management, and research. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

An Instrument to Measure Maturity of Integrated Care: A First Validation Study

PubMed Central

2018-01-01

Introduction: Lessons captured from interviews with 12 European regions are represented in a new instrument, the B3-Maturity Model (B3-MM). B3-MM aims to assess maturity along 12 dimensions reflecting the various aspects that need to be managed in order to deliver integrated care. The objective of the study was to test the content validity of B3-MM as part of SCIROCCO (Scaling Integrated Care into Context), a European Union funded project. Methods: A literature review was conducted to compare B3-MM’s 12 dimensions and their measurement scales with existing measures and instruments that focus on assessing the development of integrated care. Subsequently, a three-round survey conducted through a Delphi study with international experts in the field of integrated care was performed to test the relevance of: 1) the dimensions, 2) the maturity indicators and 3) the assessment scale used in B3-MM. Results: The 11 articles included in the literature review confirmed all the dimensions described in the original version of B3-MM. The Delphi study rounds resulted in various phrasing amendments of indicators and assessment scale. Full agreement among the experts on the relevance of the 12 B3-MM dimensions, their indicators, and assessment scale was reached after the third Delphi round. Conclusion and discussion: The B3-MM dimensions, maturity indicators and assessment scale showed satisfactory content validity. While the B3-MM is a unique instrument based on existing knowledge and experiences of regions in integrated care, further testing is needed to explore other measurement properties of B3-MM. PMID:29588644

Developing End-of-Training Entrustable Professional Activities for Psychiatry: Results and Methodological Lessons.

PubMed

Young, John Q; Hasser, Caitlin; Hung, Erick K; Kusz, Martin; O'Sullivan, Patricia S; Stewart, Colin; Weiss, Andrea; Williams, Nancy

2018-07-01

To develop entrustable professional activities (EPAs) for psychiatry and to demonstrate an innovative, validity-enhancing methodology that may be relevant to other specialties. A national task force employed a three-stage process from May 2014 to February 2017 to develop EPAs for psychiatry. In stage 1, the task force used an iterative consensus-driven process to construct proposed EPAs. Each included a title, full description, and relevant competencies. In stage 2, the task force interviewed four nonpsychiatric experts in EPAs and further revised the EPAs. In stage 3, the task force performed a Delphi study of national experts in psychiatric education and assessment. All survey participants completed a brief training program on EPAs. Quantitative and qualitative analysis led to further modifications. Essentialness was measured on a five-point scale. EPAs were included if the content validity index was at least 0.8 and the lower end of the asymmetric confidence interval was not lower than 4.0. Stages 1 and 2 yielded 24 and 14 EPAs, respectively. In stage 3, 31 of the 39 invited experts participated in both rounds of the Delphi study. Round 1 reduced the proposed EPAs to 13. Ten EPAs met the inclusion criteria in Round 2. The final EPAs provide a strong foundation for competency-based assessment in psychiatry. Methodological features such as critique by nonpsychiatry experts, a national Delphi study with frame-of-reference training, and stringent inclusion criteria strengthen the content validity of the findings and may serve as a model for future efforts in other specialties.

Criteria required for an acceptable point-of-care test for UTI detection: Obtaining consensus using the Delphi technique.

PubMed

Weir, Nichola-Jane M; Pattison, Sally H; Kearney, Paddy; Stafford, Bob; Gormley, Gerard J; Crockard, Martin A; Gilpin, Deirdre F; Tunney, Michael M; Hughes, Carmel M

2018-01-01

Urinary Tract Infections (UTIs) are common bacterial infections, second only to respiratory tract infections and particularly prevalent within primary care. Conventional detection of UTIs is culture, however, return of results can take between 24 and 72 hours. The introduction of a point of care (POC) test would allow for more timely identification of UTIs, facilitating improved, targeted treatment. This study aimed to obtain consensus on the criteria required for a POC UTI test, to meet patient need within primary care. Criteria for consideration were compiled by the research team. These criteria were validated through a two-round Delphi process, utilising an expert panel of healthcare professionals from across Europe and United States of America. Using web-based questionnaires, panellists recorded their level of agreement with each criterion based on a 5-point Likert Scale, with space for comments. Using median response, interquartile range and comments provided, criteria were accepted/rejected/revised depending on pre-agreed cut-off scores. The first round questionnaire presented thirty-three criteria to the panel, of which 22 were accepted. Consensus was not achieved for the remaining 11 criteria. Following response review, one criterion was removed, while after revision, the remaining 10 criteria entered the second round. Of these, four were subsequently accepted, resulting in 26 criteria considered appropriate for a POC test to detect urinary infections. This study generated an approved set of criteria for a POC test to detect urinary infections. Criteria acceptance and comments provided by the healthcare professionals also supports the development of a multiplex point of care UTI test.

Attitudes and values expected of public health nursing students at graduation: A delphi study.

PubMed

Okura, Mika; Takizawa, Hiroko

2018-06-01

The skills and knowledge of the competencies expected of public health nursing (PHN) students at graduation have been clarified; however, the attitudes and values have not yet been studied in Japan. The objective of this study was to identify and reach a consensus among experts on the attitudes and values expected of PHN students at graduation. This survey was conducted as a two-stage Delphi study. We selected the following experts: 248 teachers in the faculty of public health nursing at a university as academic experts, and 250 public health nurses who were also experienced clinical instructors as clinical experts. The round 1 mailed survey was conducted using a questionnaire about the necessity and importance of attitudes and values, and 211 experts responded (42.4%, clinical; n = 124, academic; n = 87). In the Round 2 survey, the experts consisted of 60.2% of the round 1 participants (clinical; n = 73, academic; n = 54). Descriptive statistics were used for multiple imputation. We identified a total of 13 attitudes and values expected of PHN students, and reached ≥90% consensus for most items (except for one). Regarding the expected achievement level at graduation, there was no difference between clinical and academic experts except for one item. Consensus was clearly achieved for 13 attitudes and values expected of PHN students, as well as importance and expected achievement level at graduation. In the future, it is important to examine strategies that can effectively develop these attitudes and values through basic and continuous education. Copyright © 2018 Elsevier Ltd. All rights reserved.

A tool to support meaningful person-centred activity for clients with dementia - a Delphi study.

PubMed

Lloyd, Barbara; Stirling, Christine

2015-01-01

This paper reports on a study to validate the concept of the 'Activity Support Tool' that aimed to assist dementia service workers to identify and act upon the support needs of people with dementia living alone, in line with the person-centred ideal. The tool was part of a two-stage exploratory qualitative study, which used interview and observational data from seven people with dementia living alone. Findings highlighted that people with dementia use objects and spaces within their homes to maintain or re-enact identities from the past. Thematic results from interviews were translated into a tool, with construct validation using the Delphi technique. Eighteen expert health professionals received round one of the questionnaire and six participants completed round three. The first round directed our focus towards operationalizing the person-centred ideal of dementia care. The tool was considered by almost all advisory panel members to be a potentially valuable resource for helping to address impediments to integrated, effective and person-centred dementia care. Specific strengths identified were simplicity, person-centeredness and applicability across service settings. Issues of concern included practicability, risk management, gender stereotyping and terminology. The results support the findings of previous research into the intuitive and ethical appeal, but problematic applicability, of person-centred dementia services. Health professionals with a range of service-related expertise found the concept of person-centred care compelling, but required tangible, enduring structures to translate the ideal into practical action. The tool now requires further research to test its usefulness in practice.

Global health resource utilization associated with pacemaker complications.

PubMed

Waweru, Catherine; Steenrod, Anna; Wolff, Claudia; Eggington, Simon; Wright, David Jay; Wyrwich, Kathleen W

2017-07-01

To estimate health resource utilization (HRU) associated with the management of pacemaker complications in various healthcare systems. Electrophysiologists (EPs) from four geographical regions (Western Europe, Australia, Japan, and North America) were invited to participate. Survey questions focused on HRU in the management of three chronic pacemaker complications (i.e. pacemaker infections requiring extraction, lead fractures/insulation breaches requiring replacement, and upper extremity deep venous thrombosis [DVT]). Panelists completed a maximum of two web-based surveys (iterative rounds). Mean, median values, and interquartile ranges were calculated and used to establish consensus. Overall, 32 and 29 panelists participated in the first and second rounds of the Delphi panel, respectively. Consensus was reached on treatment and HRU associated with a typical pacemaker implantation and complications. HRU was similar across regions, except for Japan, where panelists reported the longest duration of hospital stay in all scenarios. Infections were the most resource-intensive complications and were characterized by intravenous antibiotics days of 9.6?13.5 days and 21.3?29.2 days for pocket and lead infections respectively; laboratory and diagnostic tests, and system extraction and replacement procedures. DVT, on the other hand, was the least resource intensive complication. The results of the panel represent the views of the respondents who participated and may not be generalizable outside of this panel. The surveys were limited in scope and, therefore, did not include questions on management of acute complications (e.g. hematoma, pneumothorax). The Delphi technique provided a reliable and efficient approach to estimating resource utilization associated with chronic pacemaker complications. Estimates from the Delphi panel can be used to generate costs of pacemaker complications in various regions.

Delphi based consensus study into planning for chemical incidents.

PubMed

Crawford, I W F; Mackway-Jones, K; Russell, D R; Carley, S D

2004-01-01

To achieve consensus in all phases of chemical incident planning and response. A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required.

Delphi based consensus study into planning for chemical incidents

PubMed Central

Crawford, I; Mackway-Jones, K; Russell, D; Carley, S

2004-01-01

Objective: To achieve consensus in all phases of chemical incident planning and response. Design: A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. Results: A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. Conclusions: The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required. PMID:14734369

Cancer related fatigue: implementing guidelines for optimal management.

PubMed

Pearson, Elizabeth J M; Morris, Meg E; McKinstry, Carol E

2017-07-18

Cancer-related fatigue (CRF) is a key concern for people living with cancer and can impair physical functioning and activities of daily living. Evidence-based guidelines for CRF are available, yet inconsistently implemented globally. This study aimed to identify barriers and enablers to applying a cancer fatigue guideline and to derive implementation strategies. A mixed-method study explored the feasibility of implementing the CRF guideline developed by the Canadian Association for Psychosocial Oncology (CAPO). Health professionals, managers and consumers from different practice settings participated in a modified Delphi study with two survey rounds. A reference group informed the design of the study including the surveys. The first round focused on guideline characteristics, compatibility with current practice and experience, and behaviour change. The second survey built upon and triangulated the first round. Forty-five health practitioners and managers, and 68 cancer survivors completed the surveys. More than 75% of participants endorsed the CAPO cancer related fatigue guidelines. Some respondents perceived a lack of resources for accessible and expert fatigue management services. Further barriers to guideline implementation included complexity, limited practical details for some elements, and lack of clinical tools such as assessment tools or patient education materials. Recommendations to enhance guideline applicability centred around four main themes: (1) balancing the level of detail in the CAPO guideline with ease of use, (2) defining roles of different professional disciplines in CRF management, (3) how best to integrate CRF management into policy and practice, (4) how best to ensure a consumer-focused approach to CRF management. Translating current knowledge on optimal management of CRF into clinical practice can be enhanced by the adoption of valid guidelines. This study indicates that it is feasible to adopt the CAPO guidelines. Clinical application may be further enhanced with guideline adaptation, professional education and integration with existing practices.

NETS1HD: study protocol for development of a core outcome set for use in determining the overall success of Hirschsprung's disease treatment.

PubMed

Allin, Benjamin; Bradnock, Timothy; Kenny, Simon; Walker, Gregor; Knight, Marian

2016-12-07

Use of core outcome sets in research has been proposed as a method for countering the problems caused by heterogeneity of outcome measure reporting. Heterogeneity of outcome measure reporting occurs in Hirschsprung's disease (HD) research and is limiting the development of a robust evidence base to support clinical practice. Candidate outcome measures have been identified through a systematic review. These outcome measures will form the starting point for a three-phase online Delphi process to be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel; panel 2 is a non-neonatal panel; and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1 to 9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's HD. In round 2, experts will be presented with the same list of outcome measures and graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure, taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels, which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. Results of the Delphi process will be discussed, and outcomes will be re-scored. Outcome measures where >70% of participants at the meeting scored it 7-9 and <15% scored it 1-3 will form the core outcome set. Development of a core outcome set will help to reduce heterogeneity of outcome measure reporting in HD. This will increase the quality of research taking place and ultimately improve care provided to infants with HD.

Development of key performance indicators for prehospital emergency care.

PubMed

Murphy, Adrian; Wakai, Abel; Walsh, Cathal; Cummins, Fergal; O'Sullivan, Ronan

2016-04-01

Key performance indicators (KPIs) are used to monitor and evaluate critical areas of clinical and support functions that influence patient outcome. Traditional prehospital emergency care performance monitoring has focused solely on response time metrics. The landscape of emergency care delivery in Ireland is in the process of significant national reconfiguration. The development of KPIs is therefore considered one of the key priorities in prehospital research. The aim of this study was to develop a suite of KPIs for prehospital emergency care in Ireland. A systematic literature review of prehospital care performance measurement was undertaken followed by a three-round Delphi consensus process facilitated by a broad-based multidisciplinary group of panellists. The consensus process was conducted between June 2012 and October 2013. Each candidate indicator on the Delphi survey questionnaire was rated using a 5-point Likert-type rating scale. Agreement was defined as at least 70% of responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using descriptive statistics. Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Of the 78 citations identified by the systematic review, 5 relevant publications were used to select candidate indicators for the Delphi round 1 questionnaire. Response rates in Delphi rounds 1 and 2 were 89% and 83%, respectively. Following the consensus development conference, 101 KPIs reached consensus. Based on the Donabedian framework for quality-of-care indicators, 7 of the KPIs which reached agreement were structure KPIs, 74 were process KPIs and 20 were outcome KPIs. The highest ranked indicator was a process KPI ('Direct transport of ST-elevation myocardial infarction patients to a primary percutaneous intervention (PCI)-capable facility for ECG to PCI time <90 min'). Improving the quality of prehospital care requires the development and implementation of performance measurement using scientifically valid and reliable KPIs. Employing a Delphi panel of key multidisciplinary Emergency Medical Service stakeholders, it was feasible to develop a suite of 101 KPIs for performance monitoring of prehospital emergency care in Ireland. This suite of KPIs may contribute to a framework for achieving safer, better care in the prehospital environment. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Development of a tool to support holistic generic assessment of clinical procedure skills.

PubMed

McKinley, Robert K; Strand, Janice; Gray, Tracey; Schuwirth, Lambert; Alun-Jones, Tom; Miller, Helen

2008-06-01

The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff. Results In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station. This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).

[Clinical consensus on respiratory syncytial virus (RSV) infection prophylaxis and the use of palivizumab in paediatric cardiology.].

PubMed

Medrano López, C; García-Guereta, L; Fernández Pineda, L; Malo Concepción, P; Maroto Alvaro, E; Santos de Soto, J; Lirio Casero, J; Suárez Cabrera, P; Caballero Martínez, F

2010-06-01

Following the results of the CIVIC study, the SECPCC proposes to revise its recommendations for the prevention of RSV, taking into account the new evidence, as well as the preventive experience of paediatric cardiologists. For this purpose a structured method of professional consensus has been chosen. To develop a Spanish clinical consensus on preventing infection by RSV under the auspices of the Sociedad Española de Cardiología Pediátrica y Cardiopatías Congénitas. Delphi Consensus modified in two rounds. The study was conducted in four phases: 1) constitution of a Scientific Committee for bibliographic review and submission of the recommendations for discussion, 2) constitution of an Expert Panel with 75 representatives in the speciality, 3) postal survey organised in two rounds and intermediate processing of opinions, and issuing of a report to the panellists, and 4) discussion of the results in a face-to-face meeting of the Scientific Committee. Consensus was reached on 54 of the 70 preventive recommendations analysed. With respect to the 16 remaining issues, no consensus was reached, due to differences in professional opinion and the absence of established criteria among the majority of the experts. A set of recommendations for RSV prophylaxis in cardiology was developed and updated, rated in accordance with the degree of professional consensus on which they were based. These can be considered valid until such time as new scientific information emerges that warrants a further review. Copyright 2009 Asociación Española de Pediatría. Published by Elsevier Espana. All rights reserved.

The International Confederation of Midwives: Global Standards for Midwifery Education (2010) with companion guidelines.

PubMed

Thompson, Joyce B; Fullerton, Judith T; Sawyer, Angela J

2011-08-01

a 2-year study was conducted to develop Global Standards for Midwifery Education in keeping with core documents of the International Confederation of Midwives. Elements of the standards were based on evidence available in the published and unpublished literature. Companion Guidelines to assist in implementing the standards were also developed. a modified Delphi survey process was conducted in two rounds following item validation by a panel of midwifery education experts. a global survey conducted in 88 countries. midwifery educators and clinicians associated with midwifery education located in any of the ICM member association countries. Additional participants included an Expert Midwifery Resource Group, other Key Stakeholders, midwifery regulators and policy makers. A total of 241 individuals from 46 ICM member association countries and ten non-member countries responded to one or both of the survey rounds. survey respondents expressed an opinion on whether to retain or to delete any of the proposed components of the standards. Version one had 109 proposed components and version two had 111 items for consideration. a majority consensus of .80 was required to accept an item without further deliberation. The Education Standards Task Force (expert panel) made final decisions in the four instances where this level of consensus was not reached, retaining all four items. The panel also amended the wording of selected items or added new items based on feedback received from survey respondents. The final document contains 10 Preface items, 35 glossary terms, and 37 discrete standards with 27 sub-sections. Copyright © 2011 Elsevier Ltd. All rights reserved.

Exploring emerging learning needs: a UK-wide consultation on environmental sustainability learning objectives for medical education.

PubMed

Walpole, Sarah C; Mortimer, Frances; Inman, Alice; Braithwaite, Isobel; Thompson, Trevor

2015-12-24

This study aimed to engage wide-ranging stakeholders and develop consensus learning objectives for undergraduate and postgraduate medical education. A UK-wide consultation garnered opinions of healthcare students, healthcare educators and other key stakeholders about environmental sustainability in medical education. The policy Delphi approach informed this study. Draft learning objectives were revised iteratively during three rounds of consultation: online questionnaire or telephone interview, face-to-face seminar and email consultation. Twelve draft learning objectives were developed based on review of relevant literature. In round one, 64 participants' median ratings of the learning objectives were 3.5 for relevance and 3.0 for feasibility on a Likert scale of one to four. Revisions were proposed, e.g. to highlight relevance to public health and professionalism. Thirty three participants attended round two. Conflicting opinions were explored. Added content areas included health benefits of sustainable behaviours. To enhance usability, restructuring provided three overarching learning objectives, each with subsidiary points. All participants from rounds one and two were contacted in round three, and no further edits were required. This is the first attempt to define consensus learning objectives for medical students about environmental sustainability. Allowing a wide range of stakeholders to comment on multiple iterations of the document stimulated their engagement with the issues raised and ownership of the resulting learning objectives.

Determining an Imaging Literacy Curriculum for Radiation Oncologists: An International Delphi Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Giuliani, Meredith E., E-mail: Meredith.Giuliani@rmp.uhn.on.ca; Department of Radiation Oncology, University of Toronto, Toronto, Ontario; Gillan, Caitlin

2014-03-15

Purpose: Rapid evolution of imaging technologies and their integration into radiation therapy practice demands that radiation oncology (RO) training curricula be updated. The purpose of this study was to develop an entry-to-practice image literacy competency profile. Methods and Materials: A list of 263 potential imaging competency items were assembled from international objectives of training. Expert panel eliminated redundant or irrelevant items to create a list of 97 unique potential competency items. An international 2-round Delphi process was conducted with experts in RO. In round 1, all experts scored, on a 9-point Likert scale, the degree to which they agreed anmore » item should be included in the competency profile. Items with a mean score ≥7 were included, those 4 to 6 were reviewed in round 2, and items scored <4 were excluded. In round 2, items were discussed and subsequently ranked for inclusion or exclusion in the competency profile. Items with >75% voting for inclusion were included in the final competency profile. Results: Forty-nine radiation oncologists were invited to participate in round 1, and 32 (65%) did so. Participants represented 24 centers in 6 countries. Of the 97 items ranked in round 1, 80 had a mean score ≥7, 1 item had a score <4, and 16 items with a mean score of 4 to 6 were reviewed and rescored in round 2. In round 2, 4 items had >75% of participants voting for inclusion and were included; the remaining 12 were excluded. The final list of 84 items formed the final competency profile. The 84 enabling competency items were aggregated into the following 4 thematic groups of key competencies: (1) imaging fundamentals (42 items); (2) clinical application (27 items); (3) clinical management (5 items); and (4) professional practice (10 items). Conclusions: We present an imaging literacy competency profile which could constitute the minimum training standards in radiation oncology residency programs.« less

Maastricht Delphi Consensus on Event Definitions for Classification of Recurrence in Breast Cancer Research

PubMed Central

van Roozendaal, Lori M.; Strobbe, Luc J. A.; Aebi, Stefan; Cameron, David A.; Dixon, J. Michael; Giuliano, Armando E.; Haffty, Bruce G.; Hickey, Brigid E.; Hudis, Clifford A.; Klimberg, V. Suzanne; Koczwara, Bogda; Kühn, Thorsten; Lippman, Marc E.; Lucci, Anthony; Piccart, Martine; Smith, Benjamin D.; Tjan-Heijnen, Vivianne C. G.; van de Velde, Cornelis J. H.; Van Zee, Kimberly J.; Vermorken, Jan B.; Viale, Giuseppe; Voogd, Adri C.; Wapnir, Irene L.; White, Julia R.; Smidt, Marjolein L.

2014-01-01

Background In breast cancer studies, many different endpoints are used. Definitions are often not provided or vary between studies. For instance, “local recurrence” may include different components in similar studies. This limits transparency and comparability of results. This project aimed to reach consensus on the definitions of local event, second primary breast cancer, regional and distant event for breast cancer studies. Methods The RAND-UCLA Appropriateness method (modified Delphi method) was used. A Consensus Group of international breast cancer experts was formed, including representatives of all involved clinical disciplines. Consensus was reached in two rounds of online questionnaires and one meeting. Results Twenty-four international breast cancer experts participated. Consensus was reached on 134 items in four categories. Local event is defined as any epithelial breast cancer or ductal carcinoma in situ (DCIS) in the ipsilateral breast, or skin and subcutaneous tissue on the ipsilateral thoracic wall. Second primary breast cancer is defined as epithelial breast cancer in the contralateral breast. Regional events are breast cancer in ipsilateral lymph nodes. A distant event is breast cancer in any other location. Therefore, this includes metastasis in contralateral lymph nodes and breast cancer involving the sternal bone. If feasible, tissue sampling of a first, solitary, lesion suspected for metastasis is highly recommended. Conclusion This project resulted in consensus-based event definitions for classification of recurrence in breast cancer research. Future breast cancer research projects should adopt these definitions to increase transparency. This should facilitate comparison of results and conducting reviews as well as meta-analysis. PMID:25381395

Preferred Reporting Items for Studies Mapping onto Preference-Based Outcome Measures: The MAPS Statement.

PubMed

Petrou, Stavros; Rivero-Arias, Oliver; Dakin, Helen; Longworth, Louise; Oppe, Mark; Froud, Robert; Gray, Alastair

2015-10-01

'Mapping' onto generic preference-based outcome measures is increasingly being used as a means of generating health utilities for use within health economic evaluations. Despite publication of technical guides for the conduct of mapping research, guidance for the reporting of mapping studies is currently lacking. The MAPS (MApping onto Preference-based measures reporting Standards) statement is a new checklist, which aims to promote complete and transparent reporting of mapping studies. In the absence of previously published reporting checklists or reporting guidance documents, a de novo list of reporting items was created by a working group comprising six health economists and one Delphi methodologist. A two-round, modified Delphi survey, with representatives from academia, consultancy, health technology assessment agencies and the biomedical journal editorial community, was used to identify a list of essential reporting items from this larger list. From the initial de novo list of 29 candidate items, a set of 23 essential reporting items was developed. The items are presented numerically and categorized within six sections: (1) title and abstract; (2) introduction; (3) methods; (4) results; (5) discussion; and (6) other. The MAPS statement is best applied in conjunction with the accompanying MAPS Explanation and Elaboration paper. It is anticipated that the MAPS statement will improve the clarity, transparency and completeness of the reporting of mapping studies. To facilitate dissemination and uptake, the MAPS statement is being co-published by seven health economics and quality-of-life journals, and broader endorsement is encouraged. The MAPS working group plans to assess the need for an update of the reporting checklist in 5 years' time.

A proposed minimum data set for international primary care optometry: a modified Delphi study.

PubMed

Davey, Christopher J; Slade, Sarah V; Shickle, Darren

2017-07-01

To identify a minimum list of metrics of international relevance to public health, research and service development which can be extracted from practice management systems and electronic patient records in primary optometric practice. A two stage modified Delphi technique was used. Stage 1 categorised metrics that may be recorded as being part of a primary eye examination by their importance to research using the results from a previous survey of 40 vision science and public health academics. Delphi stage 2 then gauged the opinion of a panel of seven vision science academics and achieved consensus on contentious metrics and methods of grading/classification. A consensus regarding inclusion and response categories was achieved for nearly all metrics. A recommendation was made of 53 metrics which would be appropriate in a minimum data set. This minimum data set should be easily integrated into clinical practice yet allow vital data to be collected internationally from primary care optometry. It should not be mistaken for a clinical guideline and should not add workload to the optometrist. A pilot study incorporating an additional Delphi stage prior to implementation is advisable to refine some response categories. © 2017 The Authors. Ophthalmic and Physiological Optics published by John Wiley & Sons Ltd on behalf of College of Optometrists.

Validation of the new diagnosis grouping system for pediatric emergency department visits using the International Classification of Diseases, 10th Revision.

PubMed

Lee, Jin Hee; Hong, Ki Jeong; Kim, Do Kyun; Kwak, Young Ho; Jang, Hye Young; Kim, Hahn Bom; Noh, Hyun; Park, Jungho; Song, Bongkyu; Jung, Jae Yun

2013-12-01

A clinically sensible diagnosis grouping system (DGS) is needed for describing pediatric emergency diagnoses for research, medical resource preparedness, and making national policy for pediatric emergency medical care. The Pediatric Emergency Care Applied Research Network (PECARN) developed the DGS successfully. We developed the modified PECARN DGS based on the different pediatric population of South Korea and validated the system to obtain the accurate and comparable epidemiologic data of pediatric emergent conditions of the selected population. The data source used to develop and validate the modified PECARN DGS was the National Emergency Department Information System of South Korea, which was coded by the International Classification of Diseases, 10th Revision (ICD-10) code system. To develop the modified DGS based on ICD-10 code, we matched the selected ICD-10 codes with those of the PECARN DGS by the General Equivalence Mappings (GEMs). After converting ICD-10 codes to ICD-9 codes by GEMs, we matched ICD-9 codes into PECARN DGS categories using the matrix developed by PECARN group. Lastly, we conducted the expert panel survey using Delphi method for the remaining diagnosis codes that were not matched. A total of 1879 ICD-10 codes were used in development of the modified DGS. After 1078 (57.4%) of 1879 ICD-10 codes were assigned to the modified DGS by GEM and PECARN conversion tools, investigators assigned each of the remaining 801 codes (42.6%) to DGS subgroups by 2 rounds of electronic Delphi surveys. And we assigned the remaining 29 codes (4%) into the modified DGS at the second expert consensus meeting. The modified DGS accounts for 98.7% and 95.2% of diagnoses of the 2008 and 2009 National Emergency Department Information System data set. This modified DGS also exhibited strong construct validity using the concepts of age, sex, site of care, and seasons. This also reflected the 2009 outbreak of H1N1 influenza in Korea. We developed and validated clinically feasible and sensible DGS system for describing pediatric emergent conditions in Korea. The modified PECARN DGS showed good comprehensiveness and demonstrated reliable construct validity. This modified DGS based on PECARN DGS framework may be effectively implemented for research, reporting, and resource planning in pediatric emergency system of South Korea.

A National Needs Assessment to Identify Technical Procedures in Vascular Surgery for Simulation Based Training.

PubMed

Nayahangan, L J; Konge, L; Schroeder, T V; Paltved, C; Lindorff-Larsen, K G; Nielsen, B U; Eiberg, J P

2017-04-01

Practical skills training in vascular surgery is facing challenges because of an increased number of endovascular procedures and fewer open procedures, as well as a move away from the traditional principle of "learning by doing." This change has established simulation as a cornerstone in providing trainees with the necessary skills and competences. However, the development of simulation based programs often evolves based on available resources and equipment, reflecting convenience rather than a systematic educational plan. The objective of the present study was to perform a national needs assessment to identify the technical procedures that should be integrated in a simulation based curriculum. A national needs assessment using a Delphi process was initiated by engaging 33 predefined key persons in vascular surgery. Round 1 was a brainstorming phase to identify technical procedures that vascular surgeons should learn. Round 2 was a survey that used a needs assessment formula to explore the frequency of procedures, the number of surgeons performing each procedure, risk and/or discomfort, and feasibility for simulation based training. Round 3 involved elimination and ranking of procedures. The response rate for round 1 was 70%, with 36 procedures identified. Round 2 had a 76% response rate and resulted in a preliminary prioritised list after exploring the need for simulation based training. Round 3 had an 85% response rate; 17 procedures were eliminated, resulting in a final prioritised list of 19 technical procedures. A national needs assessment using a standardised Delphi method identified a list of procedures that are highly suitable and may provide the basis for future simulation based training programs for vascular surgeons in training. Copyright © 2017 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Too Fit To Fracture: outcomes of a Delphi consensus process on physical activity and exercise recommendations for adults with osteoporosis with or without vertebral fractures.

PubMed

Giangregorio, L M; McGill, S; Wark, J D; Laprade, J; Heinonen, A; Ashe, M C; MacIntyre, N J; Cheung, A M; Shipp, K; Keller, H; Jain, R; Papaioannou, A

2015-03-01

An international consensus process resulted in exercise and physical activity recommendations for individuals with osteoporosis. Emphasis was placed on strength, balance, and postural alignment. Rather than providing generic restrictions, activity should be encouraged while considering impairments, fracture risk, activity history, and preference, and guidance on spine sparing techniques should be provided. The objectives of this study were to establish expert consensus on key questions posed by patients or health care providers regarding recommended assessment domains to inform exercise prescription, therapeutic goals of exercise, and physical activity and exercise recommendations for individuals with osteoporosis or osteoporotic vertebral fracture. The Too Fit To Fracture expert panel identified researchers and clinicians with expertise in exercise and osteoporosis and stakeholder groups. We delivered a modified online Delphi survey (two rounds) to establish consensus on assessment, exercise, and physical activities for three cases with varying risk (osteoporosis based on bone mineral density; 1 spine fracture and osteoporosis; multiple spine fractures, osteoporosis, hyperkyphosis, and pain). Duplicate content analyses of free text responses were performed. Response rates were 52% (39/75) and 69% (48/70) for each round. Key consensus points are the following: (a) Current physical activity guidelines are appropriate for individuals with osteoporosis without spine fracture, but not for those with spine fracture; (b) after spine fracture, physical activity of moderate intensity is preferred to vigorous; (c) daily balance training and endurance training for spinal extensor muscles are recommended for all; (d) providing guidance on spine-sparing techniques (e.g., hip hinge) during activities of daily living or leisure, considering impairments, fracture risk, activity history, and preference, is recommended rather than providing generic restrictions (e.g., lifting <10 lbs, no twisting), but for those with vertebral fracture, especially in the presence of pain, multiple fractures, or hyperkyphosis, the risks of many activities may outweigh the benefits-physical therapist consultation is recommended. Examples of spine-sparing techniques and exercise prescription elements are provided. Our recommendations guide health care providers on assessment, exercise prescription, and safe movement for individuals with osteoporosis.

A cognitive perspective on health systems integration: results of a Canadian Delphi study.

PubMed

Evans, Jenna M; Baker, G Ross; Berta, Whitney; Barnsley, Jan

2014-05-19

Ongoing challenges to healthcare integration point toward the need to move beyond structural and process issues. While we know what needs to be done to achieve integrated care, there is little that informs us as to how. We need to understand how diverse organizations and professionals develop shared knowledge and beliefs - that is, we need to generate knowledge about normative integration. We present a cognitive perspective on integration, based on shared mental model theory, that may enhance our understanding and ability to measure and influence normative integration. The aim of this paper is to validate and improve the Mental Models of Integrated Care (MMIC) Framework, which outlines important knowledge and beliefs whose convergence or divergence across stakeholder groups may influence inter-professional and inter-organizational relations. We used a two-stage web-based modified Delphi process to test the MMIC Framework against expert opinion using a random sample of participants from Canada's National Symposium on Integrated Care. Respondents were asked to rate the framework's clarity, comprehensiveness, usefulness, and importance using seven-point ordinal scales. Spaces for open comments were provided. Descriptive statistics were used to describe the structured responses, while open comments were coded and categorized using thematic analysis. The Kruskall-Wallis test was used to examine cross-group agreement by level of integration experience, current workplace, and current role. In the first round, 90 individuals responded (52% response rate), representing a wide range of professional roles and organization types from across the continuum of care. In the second round, 68 individuals responded (75.6% response rate). The quantitative and qualitative feedback from experts was used to revise the framework. The re-named "Integration Mindsets Framework" consists of a Strategy Mental Model and a Relationships Mental Model, comprising a total of nineteen content areas. The Integration Mindsets Framework draws the attention of researchers and practitioners to how various stakeholders think about and conceptualize integration. A cognitive approach to understanding and measuring normative integration complements dominant cultural approaches and allows for more fine-grained analyses. The framework can be used by managers and leaders to facilitate the interpretation, planning, implementation, management and evaluation of integration initiatives.

Determining Possible Professionals and Respective Roles and Responsibilities for a Model Comprehensive Elder Abuse Intervention: A Delphi Consensus Survey

PubMed Central

Du Mont, Janice; Kosa, Daisy; Macdonald, Sheila; Elliot, Shannon; Yaffe, Mark

2015-01-01

Objective We have undertaken a multi-phase, multi-method program of research to develop, implement, and evaluate a comprehensive hospital-based nurse examiner elder abuse intervention that addresses the complex functional, social, forensic, and medical needs of older women and men. In this study, we determined the importance of possible participating professionals and respective roles and responsibilities within the intervention. Methods Using a modified Delphi methodology, recommended professionals and their associated roles and responsibilities were generated from a systematic scoping review of relevant scholarly and grey literatures. These items were reviewed, new items added for review, and rated/re-rated for their importance to the intervention on a 5-point Likert scale by an expert panel during a one day in-person meeting. Items that did not achieve consensus were subsequently re-rated in an online survey. Analysis Those items that achieved a mean Likert rating of 4+ (rated important to very important), and an interquartile range<1 in the first or second round, and/or for which 80% of ratings were 4+ in the second round were retained for the model elder abuse intervention. Results Twenty-two of 31 recommended professionals and 192 of 229 recommended roles and responsibilities rated were retained for our model elder abuse intervention. Retained professionals were: public guardian and trustee (mean rating = 4.88), geriatrician (4.87), police officer (4.87), GEM (geriatric emergency management) nurse (4.80), GEM social worker (4.78), community health worker (4.76), social worker/counsellor (4.74), family physician in community (4.71), paramedic (4.65), financial worker (4.59), lawyer (4.59), pharmacist (4.59), emergency physician (4.57), geriatric psychiatrist (4.33), occupational therapist (4.29), family physician in hospital (4.28), Crown prosecutor (4.24), neuropsychologist (4.24), bioethicist (4.18), caregiver advocate (4.18), victim support worker (4.18), and respite care worker (4.12). Conclusion A large and diverse group of multidisciplinary, intersectoral collaborators was deemed necessary to address the complex needs of abused older adults, each having important roles and responsibilities to fulfill within a model comprehensive elder abuse intervention. PMID:26630030

Too Fit To Fracture: outcomes of a Delphi consensus process on physical activity and exercise recommendations for adults with osteoporosis with or without vertebral fractures

PubMed Central

McGill, S.; Wark, J. D.; Laprade, J.; Heinonen, A.; Ashe, M. C.; MacIntyre, N. J.; Cheung, A. M.; Shipp, K.; Keller, H.; Jain, R.; Papaioannou, A.

2016-01-01

Summary An international consensus process resulted in exercise and physical activity recommendations for individuals with osteoporosis. Emphasis was placed on strength, balance, and postural alignment. Rather than providing generic restrictions, activity should be encouraged while considering impairments, fracture risk, activity history, and preference, and guidance on spine sparing techniques should be provided. Introduction The objectives of this study were to establish expert consensus on key questions posed by patients or health care providers regarding recommended assessment domains to inform exercise prescription, therapeutic goals of exercise, and physical activity and exercise recommendations for individuals with osteoporosis or osteoporotic vertebral fracture. Methods The Too Fit To Fracture expert panel identified researchers and clinicians with expertise in exercise and osteoporosis and stakeholder groups. We delivered a modified online Delphi survey (two rounds) to establish consensus on assessment, exercise, and physical activities for three cases with varying risk (osteoporosis based on bone mineral density; 1 spine fracture and osteoporosis; multiple spine fractures, osteoporosis, hyperkyphosis, and pain). Duplicate content analyses of free text responses were performed. Results Response rates were 52 % (39/75) and 69 % (48/70) for each round. Key consensus points are the following: (a) Current physical activity guidelines are appropriate for individuals with osteoporosis without spine fracture, but not for those with spine fracture; (b) after spine fracture, physical activity of moderate intensity is preferred to vigorous; (c) daily balance training and endurance training for spinal extensor muscles are recommended for all; (d) providing guidance on spine-sparing techniques (e.g., hip hinge) during activities of daily living or leisure, considering impairments, fracture risk, activity history, and preference, is recommended rather than providing generic restrictions (e.g., lifting <10 lbs, no twisting), but for those with vertebral fracture, especially in the presence of pain, multiple fractures, or hyperkyphosis, the risks of many activities may outweigh the benefits—physical therapist consultation is recommended. Examples of spine-sparing techniques and exercise prescription elements are provided. Conclusions Our recommendations guide health care providers on assessment, exercise prescription, and safe movement for individuals with osteoporosis. PMID:25510579

Determining Possible Professionals and Respective Roles and Responsibilities for a Model Comprehensive Elder Abuse Intervention: A Delphi Consensus Survey.

PubMed

Du Mont, Janice; Kosa, Daisy; Macdonald, Sheila; Elliot, Shannon; Yaffe, Mark

2015-01-01

We have undertaken a multi-phase, multi-method program of research to develop, implement, and evaluate a comprehensive hospital-based nurse examiner elder abuse intervention that addresses the complex functional, social, forensic, and medical needs of older women and men. In this study, we determined the importance of possible participating professionals and respective roles and responsibilities within the intervention. Using a modified Delphi methodology, recommended professionals and their associated roles and responsibilities were generated from a systematic scoping review of relevant scholarly and grey literatures. These items were reviewed, new items added for review, and rated/re-rated for their importance to the intervention on a 5-point Likert scale by an expert panel during a one day in-person meeting. Items that did not achieve consensus were subsequently re-rated in an online survey. Those items that achieved a mean Likert rating of 4+ (rated important to very important), and an interquartile range<1 in the first or second round, and/or for which 80% of ratings were 4+ in the second round were retained for the model elder abuse intervention. Twenty-two of 31 recommended professionals and 192 of 229 recommended roles and responsibilities rated were retained for our model elder abuse intervention. Retained professionals were: public guardian and trustee (mean rating = 4.88), geriatrician (4.87), police officer (4.87), GEM (geriatric emergency management) nurse (4.80), GEM social worker (4.78), community health worker (4.76), social worker/counsellor (4.74), family physician in community (4.71), paramedic (4.65), financial worker (4.59), lawyer (4.59), pharmacist (4.59), emergency physician (4.57), geriatric psychiatrist (4.33), occupational therapist (4.29), family physician in hospital (4.28), Crown prosecutor (4.24), neuropsychologist (4.24), bioethicist (4.18), caregiver advocate (4.18), victim support worker (4.18), and respite care worker (4.12). A large and diverse group of multidisciplinary, intersectoral collaborators was deemed necessary to address the complex needs of abused older adults, each having important roles and responsibilities to fulfill within a model comprehensive elder abuse intervention.

International consensus statement regarding the use of animal models for research on anastomoses in the lower gastrointestinal tract.

PubMed

Bosmans, Joanna W A M; Moossdorff, Martine; Al-Taher, Mahdi; van Beek, Lotte; Derikx, Joep P M; Bouvy, Nicole D

2016-05-01

This project aimed to reach consensus on the most appropriate animal models and outcome measures in research on anastomoses in the lower gastrointestinal tract (GIT). The physiology of anastomotic healing remains an important research topic in gastrointestinal surgery. Recent results from experimental studies are limited with regard to comparability and clinical translation. PubMed and EMBASE were searched for experimental studies investigating anastomotic healing in the lower GIT published between January 1, 2000 and December 31, 2014 to assess currently used models. All corresponding authors were invited for a Delphi-based analysis that consisted of two online survey rounds followed by a final online recommendation survey to reach consensus on the discussed topics. Two hundred seventy-seven original articles were retrieved and 167 articles were included in the systematic review. Mice, rats, rabbits, pigs, and dogs are currently being used as animal models, with a large variety in surgical techniques and outcome measures. Forty-four corresponding authors participated in the Delphi analysis. In the first two rounds, 39/44 and 35/39 participants completed the survey. In the final meeting, 35 experts reached consensus on 76/122 items in six categories. Mouse, rat, and pig are considered appropriate animal models; rabbit and dog should be abandoned in research regarding bowel anastomoses. ARRIVE guidelines should be followed more strictly. Consensus was reached on several recommendations for the use of animal models and outcome measurements in research on anastomoses of the lower GIT. Future research should take these suggestions into account to facilitate comparison and clinical translation of results.

Leadership content important in athletic training education with implications for allied health care.

PubMed

Kutz, Matthew R; Scialli, Joan

2008-01-01

A two-phase exploratory and comparative research study using a Delphi technique and a web-based national survey was done to determine leadership content (i.e., theories, styles, or practices) important to include in athletic training education. Eighteen athletic training experts participated in the Delphi technique, followed by 161 athletic trainers completing the national survey. Consensus of experts was reached after two rounds (77% interrater agreement, alpha = 0.80 and alpha = 0.93 per respective round) and identified 31 leadership content items important to include in athletic training education. The national sample then rated importance of each leadership content area for inclusion in four types of athletic training education programs (entry-level baccalaureate, entry-level master's degree, postgraduate certifications, and doctoral degree). The respondents ranked the leadership content in order of importance according to mean (mean = 1.53 +/- 0.84 to 2.55 +/- 0.55; scale, 0-3). Twenty-two content items (63%) were rated at least "very important" (mean > or = 2.0). Exploratory factor analysis established construct validity and organized leadership content by three factors: managerial leadership and knowledge management; leadership theories; and leadership issues, trends, and policies (alpha = 0.84-0.91). Repeated-measures analysis of variance (Sidak post-hoc adjustments) established criterion-related concurrent validity, which found increasing levels of importance as education type progressed (F = 4.88, p = 0.003-32.56, p = 0.000). Adding leadership content within athletic training enhances the professionalization of students, facilitates leadership competency among students and practicing professionals enrolled in postcertification educational programs, and facilitates job placement and role.

Identification of Core Competencies for an Undergraduate Food Safety Curriculum Using a Modified Delphi Approach

ERIC Educational Resources Information Center

Johnston, Lynette M.; Wiedmann, Martin; Orta-Ramirez, Alicia; Oliver, Haley F.; Nightingale, Kendra K.; Moore, Christina M.; Stevenson, Clinton D.; Jaykus, Lee-Ann

2014-01-01

Identification of core competencies for undergraduates in food safety is critical to assure courses and curricula are appropriate in maintaining a well-qualified food safety workforce. The purpose of this study was to identify and refine core competencies relevant to postsecondary food safety education using a modified Delphi method. Twenty-nine…

The Semiconductor Industry and Emerging Technologies: A Study Using a Modified Delphi Method

ERIC Educational Resources Information Center

Jordan, Edgar A.

2010-01-01

The purpose of this qualitative descriptive study was to determine what leaders in the semiconductor industry thought the future of computing would look like and what emerging materials showed the most promise to overcome the current theoretical limit of 10 nanometers for silicon dioxide. The researcher used a modified Delphi technique in two…

Exploring Research Themes in Public Engagement within a Natural History Museum: A Modified Delphi Approach

ERIC Educational Resources Information Center

Seakins, Amy; Dillon, Justin

2013-01-01

The primacy of the research question in designing studies affords an opportunity for enhancing collaborations between researchers and "practitioners". This paper describes the use of a modified Delphi technique to co-generate research questions for a collaborative research study co-funded by a university and a natural history museum.…

Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis Standard Reporting and Evaluation Guidelines: Results of a National Institutes of Health Working Group.

PubMed

Maverakis, Emanual; Wang, Elizabeth A; Shinkai, Kanade; Mahasirimongkol, Surakameth; Margolis, David J; Avigan, Mark; Chung, Wen-Hung; Goldman, Jennifer; La Grenade, Lois; Pirmohamed, Munir; Shear, Neil H; Tassaeeyakul, Wichittra; Hoetzenecker, Wolfram; Klaewsongkram, Jettanong; Rerkpattanapipat, Ticha; Manuyakorn, Wiparat; Yasuda, Sally Usdin; Sharon, Victoria R; Sukhov, Andrea; Micheletti, Robert; Struewing, Jeff; French, Lars E; Cheng, Michelle Y

2017-06-01

Toxic epidermal necrolysis (TEN) and Stevens-Johnson Syndrome (SJS) are rare, acute, life-threatening dermatologic disorders involving the skin and mucous membranes. Research into these conditions is hampered by a lack of standardization of case reporting and data collection. To establish a standardized case report form to facilitate comparisons and maintain data quality based on an international panel of SJS/TEN experts who performed a Delphi consensus-building exercise. The elements presented for committee scrutiny were adapted from previous case report forms and from PubMed literature searches of highly cited manuscripts pertaining to SJS/TEN. The expert opinions and experience of the members of the consensus group were included in the discussion. Overall, 21 out of 29 experts who were invited to participate in the online Delphi exercise agreed to participate. Surveys at each stage were administered via an online survery software tool. For the first 2 Delphi rounds, results were analyzed using the Interpercentile Range Adjusted for Symmetry method and statements that passed consensus formulated a new case report form. For the third Delphi round, the case report form was presented to the committee, who agreed that it was "appropriate and useful" for documenting cases of SJS/TEN, making it more reliable and valuable for future research endeavors. With the consensus of international experts, a case report form for SJS/TEN has been created to help standardize the collection of patient information in future studies and the documentation of individual cases.

Determinants of Social Accountability in Iranian Nursing and Midwifery Schools: A Delphi Study.

PubMed

Salehmoghaddam, Amir Reza; Mazloom, Seyed Reza; Sharafkhani, Mohammad; Gholami, Hassan; Emami Zeydi, Amir; Khorashadizadeh, Fatemeh; Emadzadeh, Ali

2017-04-01

Revising the medical education programs to meet the needs of society has become both a necessity and an important priority due to the considerable increase of population, changing patterns of diseases, and new health priorities. While this necessity has been highlighted in Iran's Fifth Development Plan as well as its National 2025 Vision Plan, the determinants of social accountability have not been explained yet. This study aimed to develop determinants of social accountability in the Iranian Nursing and Midwifery Schools. This classic Delphi study included thirty experts in Nursing and Midwifery Education, Research and Services selected based on purposive sampling and three rounds of Delphi technique and conducted in Nursing and Midwifery School of Mashhad University of Medical Sciences. The primary data were collected using an initial structured questionnaire prepared through extensive review of literature. SPSS 11.5 software was used to analyze the data. The interquartile deviation and percentage of agreement were also used to study the consensus of opinion by experts. Finding obtained from the rounds of Delphi resulted in selecting 69 determinants out of the initial pool of 128 primary determinants of social accountability. The items were selected based on experts' consensus and categorized under three main activities of Nursing and Midwifery School, namely education, research, and service. Social accountability determinants were explained by 69 items for Schools of Nursing and Midwifery in Iran. The proposed determinants can be used by managers and authorities of Nursing and Midwifery School, policy makers, and evaluating institutions associated with them to ensure realizing social accountability goals.

Dupuytren disease: European hand surgeons, hand therapists, and physical medicine and rehabilitation physicians agree on a multidisciplinary treatment guideline: results from the HANDGUIDE study.

PubMed

Huisstede, Bionka M A; Hoogvliet, Peter; Coert, J Henk; Fridén, Jan

2013-12-01

Multidisciplinary treatment guidelines for Dupuytren disease can aid in optimizing the quality of care for patients with this disorder. Therefore, this study aimed to achieve consensus on a multidisciplinary treatment guideline for Dupuytren disease. A European Delphi consensus strategy was initiated. A systematic review reporting on the effectiveness of interventions was conducted and used as an evidence-based starting point for this study. In total, 39 experts (hand surgeons, hand therapists, and physical medicine and rehabilitation physicians) participated in the Delphi consensus strategy. Each Delphi round consisted of a questionnaire, an analysis, and a feedback report. After four Delphi rounds, consensus was achieved on the description, symptoms, and diagnosis of Dupuytren disease. No nonsurgical interventions were included in the guideline. Needle and open fasciotomy, and a limited fasciectomy and dermofasciectomy, were seen as suitable surgical techniques for Dupuytren disease. Factors relevant for choosing one of these surgical techniques were identified and divided into patient-related (age, comorbidity), disease-related (palpable cord, previous surgery in the same area, skin involvement, time of recovery, recurrences), and surgeon-related (years of experience) factors. Associations of these factors with the choice of a specific surgical technique were reported in the guideline. Postsurgical rehabilitation should always include instructions and exercise therapy; postsurgical splinting should be performed on indication. Relevant details for the use of surgical and postsurgical interventions were described. This treatment guideline is likely to promote further discussion on related clinical and scientific issues and may therefore contribute to better treatment of patients with Dupuytren disease.

Development of a standardized training course for laparoscopic procedures using Delphi methodology.

PubMed

Bethlehem, Martijn S; Kramp, Kelvin H; van Det, Marc J; ten Cate Hoedemaker, Henk O; Veeger, Nicolaas J G M; Pierie, Jean Pierre E N

2014-01-01

Content, evaluation, and certification of laparoscopic skills and procedure training lack uniformity among different hospitals in The Netherlands. Within the process of developing a new regional laparoscopic training curriculum, a uniform and transferrable curriculum was constructed for a series of laparoscopic procedures. The aim of this study was to determine regional expert consensus regarding the key steps for laparoscopic appendectomy and cholecystectomy using Delphi methodology. Lists of suggested key steps for laparoscopic appendectomy and cholecystectomy were created using surgical textbooks, available guidelines, and local practice. A total of 22 experts, working for teaching hospitals throughout the region, were asked to rate the suggested key steps for both procedures on a Likert scale from 1-5. Consensus was reached with Crohnbach's α ≥ 0.90. Of the 22 experts, 21 completed and returned the survey (95%). Data analysis already showed consensus after the first round of Delphi on the key steps for laparoscopic appendectomy (Crohnbach's α = 0.92) and laparoscopic cholecystectomy (Crohnbach's α = 0.90). After the second round, 15 proposed key steps for laparoscopic appendectomy and 30 proposed key steps for laparoscopic cholecystectomy were rated as important (≥4 by at least 80% of the expert panel). These key steps were used for the further development of the training curriculum. By using the Delphi methodology, regional consensus was reached on the key steps for laparoscopic appendectomy and cholecystectomy. These key steps are going to be used for standardized training and evaluation purposes in a new regional laparoscopic curriculum. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

[Prioritization and Consentation of Criteria for the Appraisal, Funding and Evaluation of Projects from the German Innovationsfonds: A multi-perspective Delphi study].

PubMed

Schmitt, J; Petzold, T; Nellessen-Martens, G; Pfaff, H

2015-09-01

The German Innovationsfonds provides the chance for evidence-based developments of the German healthcare system. Prioritization of recommendations for an effective, efficient, fair, transparent, and sustainable granting of funds through a transparent, evidence-driven consensus-process involving all relevant stakeholder groups. Representatives from health and research policy, payers, patient representatives, healthcare providers, and scientists were invited to nominate participants for an electronic 3 round iterative Delphi-study to prioritize the thematic focus, requirements concerning study methods, the team of applicants, evaluation, utilization of study results, and for the selection of reviewers. Criteria considered as relevant by at least 60% of the panel (consensus definition) in the first 2 Delphi rounds were rated as facultative, preferable, or obligatory criteria for project funding. Data were analyzed descriptively. ( Datenbank Versorgungsforschung Deutschland VfD_15_003561). All invited stakeholder groups except payers participated. 34 (85%) of 40 nominated representatives participated in the Delphi-study. A total of 64 criteria were consented as relevant for project review and funding concerning the thematic focus (n=28), methodological requirements (n=13), requirements for applicants (n=4), for the evaluation (n=4), utilization (n=6), and selection of peer reviewers (n=9). It is the collective responsibility of all stakeholders to spend the designated funds as efficient and sustainable as possible. The consented recommendations shall serve decision makers as a resource for the granting of funds and the evaluation of the Innovationsfonds. © Georg Thieme Verlag KG Stuttgart · New York.

Personal Learning Environments and University Teacher Roles Explored Using Delphi

ERIC Educational Resources Information Center

Shaikh, Zaffar Ahmed; Khoja, Shakeel Ahmed

2014-01-01

This paper presents the results of research using an online Delphi method, which aimed to explore university teacher roles and readiness for learner-centred pedagogy, driven by personal learning environments (PLEs). Using a modified Policy Delphi technique, a group of researchers worked with 34 international experts who are university teachers by…

Assessment of chronic post-surgical pain after knee replacement: development of a core outcome set.

PubMed

Wylde, V; MacKichan, F; Bruce, J; Gooberman-Hill, R

2015-05-01

Approximately 20% of patients experience chronic post-surgical pain (CPSP) after total knee replacement (TKR). There is scope to improve assessment of CPSP after TKR, and this study aimed to develop a core outcome set. Eighty patients and 43 clinicians were recruited into a three-round modified Delphi study. In Round 1, participants were presented with 56 pain features identified from a systematic review, structured interviews with patients and focus groups with clinicians. Participants assigned importance ratings, using a 1-9 scale, to individual pain features; those features rated as most important were retained in subsequent rounds. Consensus that a pain feature should be included in the core outcome set was defined as the feature having a rating of 7-9 by ≥70% of both panels (patients and clinicians) and 1-3 by ≤15% of both panels or rated as 7-9 by ≥90% of one panel. Round 1 was completed by 71 patients and 39 clinicians, and Round 3 by 62 patients and 33 clinicians. The final consensus was that 33 pain features were important. These were grouped into an 8-item core outcome set comprising: pain intensity, pain interference with daily living, pain and physical functioning, temporal aspects of pain, pain description, emotional aspects of pain, use of pain medication, and improvement and satisfaction with pain relief. This core outcome set serves to guide assessment of CPSP after TKR. Consistency in assessment can promote standardized reporting and facilitate comparability between studies that address a common but understudied type of CPSP. © 2014 The Authors. European Journal of Pain published by John Wiley & Sons Ltd on behalf of European Pain Federation - EFIC®.

Identifying Medication Management Smartphone App Features Suitable for Young Adults With Developmental Disabilities: Delphi Consensus Study

PubMed Central

Salgado, Teresa M; Fedrigon, Alexa; Riccio Omichinski, Donna; Meade, Michelle A

2018-01-01

Background Smartphone apps can be a tool to facilitate independent medication management among persons with developmental disabilities. At present, multiple medication management apps exist in the market, but only 1 has been specifically designed for persons with developmental disabilities. Before initiating further app development targeting this population, input from stakeholders including persons with developmental disabilities, caregivers, and professionals regarding the most preferred features should be obtained. Objective The aim of this study was to identify medication management app features that are suitable to promote independence in the medication management process by young adults with developmental disabilities using a Delphi consensus method. Methods A compilation of medication management app features was performed by searching the iTunes App Store, United States, in February 2016, using the following terms: adherence, medication, medication management, medication list, and medication reminder. After identifying features within the retrieved apps, a final list of 42 features grouped into 4 modules (medication list, medication reminder, medication administration record, and additional features) was included in a questionnaire for expert consensus rating. A total of 52 experts in developmental disabilities, including persons with developmental disabilities, caregivers, and professionals, were invited to participate in a 3-round Delphi technique. The purpose was to obtain consensus on features that are preferred and suitable to promote independence in the medication management process among persons with developmental disabilities. Consensus for the first, second, and third rounds was defined as ≥90%, ≥80%, and ≥75% agreement, respectively. Results A total of 75 responses were received over the 3 Delphi rounds—30 in the first round, 24 in the second round, and 21 in the third round. At the end of the third round, cumulative consensus was achieved for 60% (12/20) items in the medication list module, 100% (3/3) in the medication reminder module, 67% (2/3) in the medication administration record module, and 63% (10/16) in the additional features module. In addition to the medication list, medication reminder, and medication administration record features, experts selected the following top 3 most important additional features: automatic refills through pharmacies; ability to share medication information from the app with providers; and ability to share medication information from the app with family, friends, and caregivers. The top 3 least important features included a link to an official drug information source, privacy settings and password protection, and prescription refill reminders. Conclusions Although several mobile apps for medication management exist, few are specifically designed to support persons with developmental disabilities in the complex medication management process. Of the 42 different features assessed, 64% (27/42) achieved consensus for inclusion in a future medication management app. This study provides information on the features of a medication management app that are most important to persons with developmental disabilities, caregivers, and professionals. PMID:29792292

Crossing the quality chasm: the role of information technology departments.

PubMed

Weir, Charlene R; Hicken, Bret L; Rappaport, Hank Steven; Nebeker, Jonathan R

2006-01-01

Integrating information technology (IT) into medical settings is considered essential to transforming hospitals into 21st-century health care institutions. Yet the role of IT departments in maximizing the effectiveness of information systems is not well understood. This article reports a 3-round Delphi panel of Veterans Administration personnel experienced with provider order entry electronic systems. In round 1, 35 administrative, clinical, and IT personnel answered 10 open-ended questions about IT strategies and structures that best support successful transformation. In round 2, panelists rated item importance and ranked proposed strategies. In round 3, panelists received aggregate feedback and rerated the items. Four domains emerged from round 1: IT organization, IT performance monitoring, user-support activities, and core IT responsibilities (eg, computer security, training). In rounds 2 and 3, IT performance monitoring was rated the most important, closely followed by clinical support. Strategies associated with each domain are identified and discussed.

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol

PubMed Central

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-01-01

Introduction Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues—including conceptualisation, measurement and data analysis—that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. Methods and analysis This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. Ethics and dissemination An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. PMID:28188154

Management of intrathecal baclofen therapy for severe acquired brain injury: consensus and recommendations for good clinical practice.

PubMed

De Tanti, Antonio; Scarponi, Federico; Bertoni, Michele; Gasperini, Giulio; Lanzillo, Bernardo; Molteni, Franco; Posteraro, Federico; Vitale, Dino Francesco; Zanpolini, Mauro

2017-08-01

Although widespread in the treatment of generalised spasticity due to severe acquired brain injury, clinical use of intrathecal baclofen administered through an implanted catheter is not yet supported by full scientific evidence. The aim of the study is to provide recommendations for good clinical practice regarding intrathecal baclofen therapy. We used a modified RAND Delphi method to develop consensus-based medical guidelines, involving clinicians who use intrathecal baclofen therapy throughout Italy. The clinicians were asked 38 questions grouped in six areas (patient selection, contraindications for implant, tests prior to implant, method of implant and management of therapy, efficacy evaluation and goal setting, and management of complications). To establish consensus, 75% agreement was required in answers to every question. Consensus was reached on the second round of the Delphi process on 27/38 questions (71%), specifically those regarding identification of objectives, efficacy evaluation, and method of implant and management of therapy, whereas management of complications and contraindications for implant remained critical areas. Despite the limits of our method, a set of recommendations was drawn up for clinical practice in this sector. The study also revealed residual critical areas and indicated future lines of research necessary to reach evidence-based consensus.

Potential Effects of the Electronic Health Record on the Small Physician Practice: A Delphi Study.

PubMed

Sines, Chad C; Griffin, Gerald R

2017-01-01

The Health Information Technology for Economic and Clinical Health (HITECH) Act established the requirement of all medical practices to have certified electronic health records (EHRs). Some primary concerns that have been delaying implementation are issues of cost, revenue impact, and the effect on the patient encounter. Small physician practices (one to four physicians) account for 46 percent of all physicians. The purpose of this qualitative study using a modified Delphi research design was to examine the potential effect of the adoption of the EHR on revenue, unintended costs or savings, and changes in the patient encounter. Fifteen expert panelists completed the three-round survey process. The expert panelists reached a consensus that EHRs would reduce the number of patients seen per day, thereby reducing their revenue. Although the panelists limited their discussion on the effect of patient outcomes, their most dominant concern was the loss of face-to-face time with the patient. They felt that the use of an EHR would reduce the focus on the patient and potentially cause physicians to miss medical conditions. The results of this study indicate an avenue for EHR vendors to develop educational avenues to teach physicians how to optimize the EHR as well as to share success stories that demonstrate improved financial impact.

The process of collecting and evaluating evidences for the development of Guidelines for the management of rheumatoid arthritis, Japan College of Rheumatology 2014: Utilization of GRADE approach.

PubMed

Kojima, Masayo; Nakayama, Takeo; Kawahito, Yutaka; Kaneko, Yuko; Kishimoto, Mitsumasa; Hirata, Shintaro; Seto, Yohei; Endo, Hirahito; Ito, Hiromu; Kojima, Toshihisa; Nishida, Keiichiro; Matsushita, Isao; Tsutani, Kiichiro; Igarashi, Ataru; Kamatani, Naoyuki; Hasegawa, Mieko; Miyasaka, Nobuyuki; Yamanaka, Hisashi

2016-01-01

To describe the process of collecting and evaluating evidence for treating rheumatoid arthritis (RA) for developing clinical practice guidelines (CPGs) for rheumatologists in Japan. The task force comprised rheumatologists, epidemiologists, health economists, and patients. First, the critical outcomes were determined according to a three-round Delphi method, and eight topics with 88 clinical questions (CQs) were formulated. A systematic review of CQs was conducted using the Cochran Database of Systematic Reviews, MEDLINE, and Japana Centra Revvo Medicina (2003-2012). A questionnaire survey and focus group interview were performed to capture the patients' values and preferences. Data from the National Health Insurance drug price list and product information provided by pharmaceutical companies were collected to evaluate drug cost and safety. The GRADE approach was used to describe the evidence quality and determine the strength of recommendations. Recommendations were developed using a modified Delphi method by a multidisciplinary panel including patients. Eight meetings and frequent e-mail communications were conducted to draft a quality assessment of evidence and recommendations. For 88 CQs, recommendation statements were determined. Using the GRADE approach, new CPGs successfully addressed important clinical issues for treating RA patients. Timely updating of recommendations should be routinely considered.

Potential Effects of the Electronic Health Record on the Small Physician Practice: A Delphi Study

PubMed Central

Sines, Chad C.; Griffin, Gerald R.

2017-01-01

The Health Information Technology for Economic and Clinical Health (HITECH) Act established the requirement of all medical practices to have certified electronic health records (EHRs). Some primary concerns that have been delaying implementation are issues of cost, revenue impact, and the effect on the patient encounter. Small physician practices (one to four physicians) account for 46 percent of all physicians. The purpose of this qualitative study using a modified Delphi research design was to examine the potential effect of the adoption of the EHR on revenue, unintended costs or savings, and changes in the patient encounter. Fifteen expert panelists completed the three-round survey process. The expert panelists reached a consensus that EHRs would reduce the number of patients seen per day, thereby reducing their revenue. Although the panelists limited their discussion on the effect of patient outcomes, their most dominant concern was the loss of face-to-face time with the patient. They felt that the use of an EHR would reduce the focus on the patient and potentially cause physicians to miss medical conditions. The results of this study indicate an avenue for EHR vendors to develop educational avenues to teach physicians how to optimize the EHR as well as to share success stories that demonstrate improved financial impact. PMID:28566989

Identifying content for simulation-based curricula in urology: a national needs assessment.

PubMed

Nayahangan, Leizl Joy; Bølling Hansen, Rikke; Gilboe Lindorff-Larsen, Karen; Paltved, Charlotte; Nielsen, Bjørn Ulrik; Konge, Lars

2017-12-01

Simulation-based training is well recognized in the transforming field of urological surgery; however, integration into the curriculum is often unstructured. Development of simulation-based curricula should follow a stepwise approach starting with a needs assessment. This study aimed to identify technical procedures in urology that should be included in a simulation-based curriculum for residency training. A national needs assessment was performed using the Delphi method involving 56 experts with significant roles in the education of urologists. Round 1 identified technical procedures that newly qualified urologists should perform. Round 2 included a survey using an established needs assessment formula to explore: the frequency of procedures; the number of physicians who should be able to perform the procedure; the risk and/or discomfort to patients when a procedure is performed by an inexperienced physician; and the feasibility of simulation training. Round 3 involved elimination and reranking of procedures according to priority. The response rates for the three Delphi rounds were 70%, 55% and 67%, respectively. The 34 procedures identified in Round 1 were reduced to a final prioritized list of 18 technical procedures for simulation-based training. The five procedures that reached the highest prioritization were cystoscopy, transrectal ultrasound-guided biopsy of the prostate, placement of ureteral stent, insertion of urethral and suprapubic catheter, and transurethral resection of the bladder. The prioritized list of technical procedures in urology that were identified as highly suitable for simulation can be used as an aid in the planning and development of simulation-based training programs.

Pharmacist provision of primary health care: a modified Delphi validation of pharmacists' competencies.

PubMed

Kennie-Kaulbach, Natalie; Farrell, Barbara; Ward, Natalie; Johnston, Sharon; Gubbels, Ashley; Eguale, Tewodros; Dolovich, Lisa; Jorgenson, Derek; Waite, Nancy; Winslade, Nancy

2012-03-28

Pharmacists have expanded their roles and responsibilities as a result of primary health care reform. There is currently no consensus on the core competencies for pharmacists working in these evolving practices. The aim of this study was to develop and validate competencies for pharmacists' effective performance in these roles, and in so doing, document the perceived contribution of pharmacists providing collaborative primary health care services. Using a modified Delphi process including assessing perception of the frequency and criticality of performing tasks, we validated competencies important to primary health care pharmacists practising across Canada. Ten key informants contributed to competency drafting; thirty-three expert pharmacists replied to a second round survey. The final primary health care pharmacist competencies consisted of 34 elements and 153 sub-elements organized in seven CanMeds-based domains. Highest importance rankings were allocated to the domains of care provider and professional, followed by communicator and collaborator, with the lower importance rankings relatively equally distributed across the manager, advocate and scholar domains. Expert pharmacists working in primary health care estimated their most important responsibilities to be related to direct patient care. Competencies that underlie and are required for successful fulfillment of these patient care responsibilities, such as those related to communication, collaboration and professionalism were also highly ranked. These ranked competencies can be used to help pharmacists understand their potential roles in these evolving practices, to help other health care professionals learn about pharmacists' contributions to primary health care, to establish standards and performance indicators, and to prioritize supports and education to maximize effectiveness in this role.

A modified Delphi study of structures and processes related to medicines management for elderly hospitalised patients in the United Arab Emirates.

PubMed

Al Shemeili, Saeed; Klein, Susan; Strath, Alison; Fares, Saleh; Stewart, Derek

2016-10-01

The structures and processes around the management of medicines for elderly, hospitalized patients are ill defined. This study aimed to determine consensus related to strategic and operational approaches in the United Arab Emirates. A modified Delphi technique, consensus study with first round statements developed from systematic reviews related to medicines management. Normalization process theory and the theoretical domains framework were applied in the construction of statements, organized into key elements of medicines management: guidelines for medicines management, medicines reconciliation, medicines selection, prescribing and review, medicines adherence, medicines counselling, health professional training and evaluation research. Seventy per cent (summative agree and strongly agree) was set as the target for consensus. Thirty panellists were recruited, representing senior physicians working within geriatrics, hospital pharmacy and nursing directors, chief health professionals (including social workers) and policy makers within the Health Authority of Abu Dhabi and academics. A high level of consensus was obtained for most statements relating to the structures and processes of medicines management. While consensus was not achieved for targeting only those patients with medicines related issues, it was achieved for focusing on all elderly admissions. Similarly, consensus was not achieved for which professions were most suited to roles but was achieved for trained and competent staff. High levels of consensus were obtained for structures and processes of medicines management relating to elderly hospitalized patients. Trained and competent health professionals were preferred to specific professions for any tasks and that all elderly patients and not targeted patients should be the focus for medicines management. © 2016 John Wiley & Sons, Ltd.

Deriving ICD-10 Codes for Patient Safety Indicators for Large-scale Surveillance Using Administrative Hospital Data.

PubMed

Southern, Danielle A; Burnand, Bernard; Droesler, Saskia E; Flemons, Ward; Forster, Alan J; Gurevich, Yana; Harrison, James; Quan, Hude; Pincus, Harold A; Romano, Patrick S; Sundararajan, Vijaya; Kostanjsek, Nenad; Ghali, William A

2017-03-01

Existing administrative data patient safety indicators (PSIs) have been limited by uncertainty around the timing of onset of included diagnoses. We undertook de novo PSI development through a data-driven approach that drew upon "diagnosis timing" information available in some countries' administrative hospital data. Administrative database analysis and modified Delphi rating process. All hospitalized adults in Canada in 2009. We queried all hospitalizations for ICD-10-CA diagnosis codes arising during hospital stay. We then undertook a modified Delphi panel process to rate the extent to which each of the identified diagnoses has a potential link to suboptimal quality of care. We grouped the identified quality/safety-related diagnoses into relevant clinical categories. Lastly, we queried Alberta hospital discharge data to assess the frequency of the newly defined PSI events. Among 2,416,413 national hospitalizations, we found 2590 unique ICD-10-CA codes flagged as having arisen after admission. Seven panelists evaluated these in a 2-round review process, and identified a listing of 640 ICD-10-CA diagnosis codes judged to be linked to suboptimal quality of care and thus appropriate for inclusion in PSIs. These were then grouped by patient safety experts into 18 clinically relevant PSI categories. We then analyzed data on 2,381,652 Alberta hospital discharges from 2005 through 2012, and found that 134,299 (5.2%) hospitalizations had at least 1 PSI diagnosis. The resulting work creates a foundation for a new set of PSIs for routine large-scale surveillance of hospital and health system performance.

Pharmacist provision of primary health care: a modified Delphi validation of pharmacists' competencies

PubMed Central

2012-01-01

Background Pharmacists have expanded their roles and responsibilities as a result of primary health care reform. There is currently no consensus on the core competencies for pharmacists working in these evolving practices. The aim of this study was to develop and validate competencies for pharmacists' effective performance in these roles, and in so doing, document the perceived contribution of pharmacists providing collaborative primary health care services. Methods Using a modified Delphi process including assessing perception of the frequency and criticality of performing tasks, we validated competencies important to primary health care pharmacists practising across Canada. Results Ten key informants contributed to competency drafting; thirty-three expert pharmacists replied to a second round survey. The final primary health care pharmacist competencies consisted of 34 elements and 153 sub-elements organized in seven CanMeds-based domains. Highest importance rankings were allocated to the domains of care provider and professional, followed by communicator and collaborator, with the lower importance rankings relatively equally distributed across the manager, advocate and scholar domains. Conclusions Expert pharmacists working in primary health care estimated their most important responsibilities to be related to direct patient care. Competencies that underlie and are required for successful fulfillment of these patient care responsibilities, such as those related to communication, collaboration and professionalism were also highly ranked. These ranked competencies can be used to help pharmacists understand their potential roles in these evolving practices, to help other health care professionals learn about pharmacists' contributions to primary health care, to establish standards and performance indicators, and to prioritize supports and education to maximize effectiveness in this role. PMID:22455482

An international Delphi study examining health promotion and health education in nursing practice, education and policy.

PubMed

Whitehead, Dean

2008-04-01

To arrive at an expert consensus in relation to health promotion and health education constructs as they apply to nursing practice, education and policy. Nursing has often been maligned and criticized, both inside and outside of the profession, for its ability to understand and conduct effective health promotion and health education-related activities. In the absence of an expert-based consensus, nurses may find it difficult to progress beyond the current situation. In the absence of any previously published nursing-related consensus research, this study seeks to fill that knowledge-gap. A two-round Delphi technique via email correspondence. A first-round qualitative questionnaire used open-ended questions for defining health promotion and health education. This was both in general terms and as participants believed these concepts related to the clinical, theoretical (academic/educational) and the policy (political) setting in nursing. Line-by-line qualitative content and thematic analysis of the first-round data generated 13 specific categories. These categories contained 134 statement items. The second-round questionnaire comprised the identified 134 statements. Using a five-point Likert scale (ranging from 1 = strongly disagree to 5 = strongly agree) participants scored and rated their level of agreement/disagreement against the listed items. Data from the second-round was descriptively analysed according to distribution and central tendency measures. An expert consensus was reached on 65 of the original 134 statements. While some minor contradiction was demonstrated, strong consensus emerged around the issues of defining health promotion and health education and the emergence of a wider health promotion and health education role for nursing. No consensus was reached on only one of the 13 identified topic categories - that of 'nurses working with other disciplines and agencies in a health education and health promotion role.' This study provides a hitherto previously absent expert consensus on the current position of health promotion and health education, in nursing and predictions for their future course. Its findings represent an important step for nurses as they seek to become increasingly active and influential within wider health promotion and health education arenas. Relevance to clinical practice. Delphi studies do not necessarily offer indisputable fact. This study, however, with its strong consensus on the majority of original statements is a good indicator as to how nursing experts currently view health promotion and health education constructs. Expert consensus offers a useful form of measure against current and future clinical practice and helps to build a firm foundation for change. Nurses, then, are advised here to refer to the findings presented, that they remain contextually and conceptually clear, as they embark on current and future health promotion-related activities.

Consensus statement on essential patient characteristics in systemic treatment trials for metastatic colorectal cancer: Supported by the ARCAD Group.

PubMed

Goey, Kaitlyn K H; Sørbye, Halfdan; Glimelius, Bengt; Adams, Richard A; André, Thierry; Arnold, Dirk; Berlin, Jordan D; Bodoky, György; de Gramont, Aimery; Díaz-Rubio, Eduardo; Eng, Cathy; Falcone, Alfredo; Grothey, Axel; Heinemann, Volker; Hochster, Howard S; Kaplan, Richard S; Kopetz, Scott; Labianca, Roberto; Lieu, Christopher H; Meropol, Neal J; Price, Timothy J; Schilsky, Richard L; Schmoll, Hans-Joachim; Shacham-Shmueli, Einat; Shi, Qian; Sobrero, Alberto F; Souglakos, John; Van Cutsem, Eric; Zalcberg, John; van Oijen, Martijn G H; Punt, Cornelis J A; Koopman, Miriam

2018-06-21

Patient characteristics and stratification factors are key features influencing trial outcomes. However, there is substantial heterogeneity in reporting of patient characteristics and use of stratification factors in phase 3 trials investigating systemic treatment of metastatic colorectal cancer (mCRC). We aimed to develop a minimum set of essential baseline characteristics and stratification factors to include in such trials. We performed a modified, two-round Delphi survey among international experts with wide experience in the conduct and methodology of phase 3 trials of systemic treatment of mCRC. Thirty mCRC experts from 15 different countries completed both consensus rounds. A total of 14 patient characteristics were included in the recommended set: age, performance status, primary tumour location, primary tumour resection, prior chemotherapy, number of metastatic sites, liver-only disease, liver involvement, surgical resection of metastases, synchronous versus metachronous metastases, (K)RAS and BRAF mutation status, microsatellite instability/mismatch repair status and number of prior treatment lines. A total of five patient characteristics were considered the most relevant stratification factors: RAS/BRAF mutation status, performance status, primary tumour sidedness and liver-only disease. This survey provides a minimum set of essential baseline patient characteristics and stratification factors to include in phase 3 trials of systemic treatment of mCRC. Inclusion of these patient characteristics and strata in study protocols and final study reports will improve interpretation of trial results and facilitate cross-study comparisons. Copyright © 2018 Elsevier Ltd. All rights reserved.

Strategic analyses in nursing schools: attracting, educating, and graduating more nursing students: part I--strengths, weaknesses, opportunities, and threats analysis.

PubMed

Crow, Stephen M; Hartman, Sandra J; Mahesh, Sathiadev; McLendon, Christy L; Henson, Steve W; Jacques, Paul

2008-01-01

The shortage of nurses in the United States remains a persistent problem. Faced with this reality, nursing programs in colleges and universities continue to struggle to expand enrollment levels to meet the spiraling demand. This research uses familiar tools in strategic management: the strengths, weaknesses, opportunities, and threats (SWOT) analysis and stakeholder analysis as initial steps to draw more students to the profession of nursing. In a 2-round modified Delphi survey, chief administrators of schools of nursing identify the main SWOT of schools of nursing and the important internal and external stakeholders that influence nursing school success. The authors of the research suggest ways to use that knowledge to increase the enrollment level of nursing students. Part I of this research focuses on the SWOT analyses.

A Delphi study: Practitioners' perceptions of how the science curriculum is differentiated for academically gifted students at the middle school level

NASA Astrophysics Data System (ADS)

Kelley, Jean Mary

The purpose of this study was to identify, analyze, and compare the perceptions of selected district science educators and teachers of middle school science students regarding the following issues: (1) Current methods of differentiating science instruction for gifted middle school students. (2) Strengths of the current methods of differentiating science instruction for gifted middle school students. (3) Weaknesses of the current methods of differentiating science instruction for gifted middle school students. (4) The types of training/experience needed to prepare teachers to effectively differentiate science instruction for gifted middle school students. (5) The steps need to develop an effective differentiated science program at the middle school level. (6) Trends for the future development of differentiated science programs at the middle school level. The panel of educators was identified using the Delphi technique and asked to participate in the study by responding to the research questions. The responses to the first round were condensed into two lists of discrete statements, and in the second round, each group of panelists was asked to rank each statement on a Likert scale. A third round was sent to each group of panel members showing the median and interquartile ranges of the second round. Panelists could adjust their responses based on the results of the second round. The analysis of the data was computed using the computer program Statistics Package for the Social Sciences. Based on the data obtained, the following results and conclusions were determined. The coordinators and the teachers both considered training of teachers, strategies for differentiation, and future trends to be the most important considerations. The areas with the most differences were those dealing with the current methods of differentiating science instruction at the middle school level. There were several limitations identified in this study. Among them were the makeup of the sample of panelists and different definitions of the same term(s). If we are to address the needs of middle school students who are academically gifted in science, teachers and coordinators need to communicate more about expectations in the classroom and what is really happening.

Defining and identifying concepts of medication literacy: An international perspective.

PubMed

Pouliot, Annie; Vaillancourt, Régis; Stacey, Danielle; Suter, Philippe

2017-11-08

Multiple concepts to define health literacy in the context of medication use exist, such as medication literacy, pharmacotherapy literacy, pharmacy health literacy; however, no studies have looked at consensus among experts internationally. A Delphi process was used to achieve consensus on the statements about medication literacy. Experts for the Delphi were selected from a review of the literature and suggestions from an international survey conducted with members of the International Pharmaceutical Federation on medication literacy. The preliminary Delphi questionnaire was built using the statements about medication literacy found in the scientific literature. Responses and comments were analyzed using a pre-established method and communicated to the experts after each round of Delphi. Statements with an agreement of at least 80% were accepted and used to develop a definition of medication literacy. The Delphi process started with 21 experts and included 4 rounds. Overall, 30 statements regarding medication literacy were accepted and divided into 4 clusters representing: (1) type of information necessary for optimal and safe use of medication, (2) skills and abilities, (3) format of information, and (4) outcomes. These statements were used to propose 2 different definitions of medication literacy. One of the definitions was preferred by 75% of the expert panel, which provided further comments for improvements. Of the 11 experts who answered the final questionnaire, nine strongly agreed with the refined definition. Medication literacy is the degree to which individuals can obtain, comprehend, communicate, calculate and process patient-specific information about their medications to make informed medication and health decisions in order to safely and effectively use their medications, regardless of the mode by which the content is delivered (e.g. written, oral and visual). Future studies should focus on how this definition can be operationalized to support the role that pharmacists and other healthcare providers. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of a Consensus Taxonomy of Sedentary Behaviors (SIT): Report of Delphi Round 1

PubMed Central

Chastin, Sebastien Francois Martin; Schwarz, Ulf; Skelton, Dawn Ann

2013-01-01

Background Over the last decade, sedentary behaviors have emerged as a distinctive behavioral paradigm with deleterious effects on health independent of physical activity. The next phase of research is to establish dose response between sedentary behaviors and health outcomes and improve understanding of context and determinants of these behaviors. Establishing a common taxonomy of these behaviors is a necessary step in this process. Aim The Sedentary behavior International Taxonomy project was developed to establish a classification of sedentary behaviors by use of a formal consensus process. Methods The study follows a Delphi process in three Rounds. A preparatory stage informed the development of terms of reference documents. In Round 1, experts were asked to make statements about the taxonomy; 1) its purpose and use ; 2) the domains, categories or facets that should be consider and include; 3) the structure/architecture to arrange and link these domains and facets. In Round 2 experts will be presented with a draft taxonomy emerging from Round 1 and invited to comment and propose alterations. The taxonomy will then be finalised at the outset of this stage. Results Results of Round 1 are reported here. There is a general consensus that a taxonomy will help advances in research by facilitating systematic and standardised: 1) investigation and analysis; 2) reporting and communication; 3) data pooling, comparison and meta-analysis; 4) development of measurement tools; 4) data descriptions, leading to higher quality in data querying and facilitate discoveries. There is also a consensus that such a taxonomy should be flexible to accommodate diverse purposes of use, and future advances in the field and yet provide a cross-disciplinary common language. A consensual taxonomy structure emerged with nine primary facets (Purpose, Environment, Posture, Social, Measurement, Associated behavior, Status, Time, Type) and the draft structure presented here for Round 2. PMID:24312653

Management of patients with type 2 diabetes and multiple chronic conditions: A Delphi consensus of the Spanish Society of Internal Medicine.

PubMed

Ena, Javier; Gómez-Huelgas, Ricardo; Sánchez-Fuentes, Demetrio; Camafort-Babkowsk, Miguel; Formiga, Francesc; Michán-Doña, Alfredo; Casariego, Emilio

2016-01-01

To develop consensus-based recommendations for the management of chronic complex patients with type 2 diabetes mellitus using a two round Delphi technique. Experts from the Diabetes and Obesity Working Group (DOWG) of the Spanish Society of Internal Medicine (SEMI) reviewed MEDLINE, PubMed, SCOPUS and Cochrane Library databases up to September 2014 to gather information on organization and health care management, stratification of therapeutic targets and therapeutic approach for glucose control in chronic complex patients with type 2 diabetes mellitus. A list of 6 recommendations was created and rated by a panel of 75 experts from the DOWG by email (first round) and by open discussion (second round). A written document was produced and sent back to DOWG experts for clarification purposes. A high degree of consensus was achieved for all recommendations summarized as 1) there is a need to redesign and test new health care programs for chronic complex patients with type 2 diabetes mellitus; 2) therapeutic targets in patients with short life expectancy should be individualized in accordance to their personal, clinical and social characteristics; 3) patients with chronic complex conditions and type 2 diabetes mellitus should be stratified by hypoglycemia risk; 4) age and specific comorbidities should guide the objectives for glucose control; 5) the risk of hypoglycemia should be a key factor when choosing a treatment; and 6) basal insulin analogs compared to human insulin are cost-effective options. The assessment and recommendations provided herein represent our best professional judgment based on current data and clinical experience. Copyright © 2015 European Federation of Internal Medicine. Published by Elsevier B.V. All rights reserved.