The Underutilization of Information and Communication Technology-Assisted Collaborative Project-Based Learning among International Educators: A Delphi Study

ERIC Educational Resources Information Center

Kramer, Barry S.; Walker, Andrew E.; Brill, Jennifer M.

2007-01-01

This study explores the barriers associated with teachers implementing information and communication technology-assisted collaborative project-based learning (ICTCPrjBL) as a classroom teaching methodology with students. We used a Web-based Delphi method to engage experienced educators in anonymous consensus building consisting of three rounds of…

The Essential Components of Coach Training for Mental Health Professionals: A Delphi Study

ERIC Educational Resources Information Center

Moriarity, Marlene Therese

2010-01-01

Purpose. The purpose of this study was to discover how coach training experts define coaching and what they would identify to be the essential components of a coach training program for mental health professionals. Methods. A panel of nine experts, through an iterative Delphi process of responding to three rounds of questionnaires, provided…

DIET@NET: Best Practice Guidelines for dietary assessment in health research.

PubMed

Cade, Janet E; Warthon-Medina, Marisol; Albar, Salwa; Alwan, Nisreen A; Ness, Andrew; Roe, Mark; Wark, Petra A; Greathead, Katharine; Burley, Victoria J; Finglas, Paul; Johnson, Laura; Page, Polly; Roberts, Katharine; Steer, Toni; Hooson, Jozef; Greenwood, Darren C; Robinson, Sian

2017-11-15

Dietary assessment is complex, and strategies to select the most appropriate dietary assessment tool (DAT) in epidemiological research are needed. The DIETary Assessment Tool NETwork (DIET@NET) aimed to establish expert consensus on Best Practice Guidelines (BPGs) for dietary assessment using self-report. The BPGs were developed using the Delphi technique. Two Delphi rounds were conducted. A total of 131 experts were invited, and of these 65 accepted, with 48 completing Delphi round I and 51 completing Delphi round II. In all, a total of 57 experts from North America, Europe, Asia and Australia commented on the 47 suggested guidelines. Forty-three guidelines were generated, grouped into the following four stages: Stage I. Define what is to be measured in terms of dietary intake (what? who? and when?); Stage II. Investigate different types of DATs; Stage III. Evaluate existing tools to select the most appropriate DAT by evaluating published validation studies; Stage IV. Think through the implementation of the chosen DAT and consider sources of potential biases. The Delphi technique consolidated expert views on best practice in assessing dietary intake. The BPGs provide a valuable guide for health researchers to choose the most appropriate dietary assessment method for their studies. These guidelines will be accessible through the Nutritools website, www.nutritools.org .

[A model for shared decision-making with frail older patients: consensus reached using Delphi technique].

PubMed

van de Pol, M H J; Fluit, C R M G; Lagro, J; Lagro-Janssen, A L M; Olde Rikkert, M G M

2017-01-01

To develop a model for shared decision-making with frail older patients. Online Delphi forum. We used a three-round Delphi technique to reach consensus on the structure of a model for shared decision-making with older patients. The expert panel consisted of 16 patients (round 1), and 59 professionals (rounds 1-3). In round 1, the panel of experts was asked about important steps in the process of shared decision-making and the draft model was introduced. Rounds 2 and 3 were used to adapt the model and test it for 'importance' and 'feasibility'. Consensus for the dynamic shared decision-making model as a whole was achieved for both importance (91% panel agreement) and feasibility (76% panel agreement). Shared decision-making with older patients is a dynamic process. It requires a continuous supportive dialogue between health care professional and patient.

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique

PubMed Central

Barry, Emma; O'Brien, Kirsty; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-01-01

Objective There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Design Two-round modified Delphi consensus method. Setting Irish and UK general practice. Participants A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. Results 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). Conclusions The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. PMID:27601499

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique.

PubMed

Barry, Emma; O'Brien, Kirsty; Moriarty, Frank; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-09-06

There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Two-round modified Delphi consensus method. Irish and UK general practice. A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment.

PubMed

Hepworth, Lauren R; Rowe, Fiona J

2018-02-01

The aim of this study was to ascertain what items stroke survivors and stroke care professionals think are important when assessing quality of life for stroke survivors with visual impairment for inclusion in the new patient-reported outcome measure. A reactive Delphi process was used in a three-round electronic-based survey. The items presented consisted of 62 items originally sourced from a systematic review of existing vision-related quality of life instruments and stroke survivor interviews, reduced and refined following a ranking exercise and pilot with stroke survivors with visual impairment. Stakeholders (stroke survivors/clinicians) were invited to take part in the process. A consensus definition of ≥70% was decided a priori. Participants were asked to rank importance on a 9-point scale and categorize the items by relevance to types of visual impairment following stroke or not relevant. Analysis of consensus, stability, and agreement was conducted. In total, 113 participants registered for the Delphi survey of which 47 (41.6%) completed all three rounds. Response rates to the three rounds were 78/113 (69.0%), 61/76 (81.3%), and 49/64 (76.6%), respectively. The participants included orthoptists (45.4%), occupational therapists (44.3%), and stroke survivors (10.3%). Consensus was reached on 56.5% of items in the three-round process, all for inclusion. A consensus was reached for 83.8% in the categorization of items. The majority (82.6%) of consensus were for relevant to 'all visual impairment following stroke'; two items were deemed 'not relevant'. The lack of item reduction achieved by this Delphi process highlights the need for additional methods of item reduction in the development of a new PROM for visual impairment following stroke. These results will be considered alongside Rasch analysis to achieve further item reduction. However, the Delphi survey remains important as it provides clinical and patient insight into each item rather than purely relying on the psychometric data.

Developing clinical practice guidelines for Chinese herbal treatment of polycystic ovary syndrome: A mixed-methods modified Delphi study.

PubMed

Lai, Lily; Flower, Andrew; Moore, Michael; Lewith, George

2015-06-01

Preliminary evidence suggests Chinese herbal medicine (CHM) could be a viable treatment option for polycystic ovary syndrome (PCOS). Prior to conducting a clinical trial it is important to consider the characteristics of good clinical practice. This study aims to use professional consensus to establish good clinical practice guidelines for the CHM treatment of PCOS. CHM practitioners participated in a mixed-methods modified Delphi study involving three rounds of structured group communication. Round 1 involved qualitative interviews with practitioners to generate statements regarding good clinical practice. In round 2, these statements were distributed online to the same practitioners to rate their agreement using a 7-point Likert scale, where group consensus was defined as a median rating of ≥5. Statements reaching consensus were accepted for consideration onto the guideline whilst those not reaching consensus were re-distributed for consideration in round 3. Statements presented in the guidelines were graded from A (strong consensus) to D (no consensus) determined by median score and interquartile range. 11 CHM practitioners in the UK were recruited. After three Delphi rounds, 91 statement items in total had been considered, of which 89 (97.8%) reached consensus and 2 (2.2%) did not. The concluding set of guidelines consists of 85 items representing key features of CHM prescribing for PCOS. These guidelines can be viewed as an initial framework that captures fundamental principles of good clinical practice for CHM. Copyright © 2015 Elsevier Ltd. All rights reserved.

Developing a Canadian Curriculum for Simulation-Based Education in Obstetrics and Gynaecology: A Delphi Study.

PubMed

Craig, Catherine; Posner, Glenn D

2017-09-01

As obstetrics and gynaecology (Ob/Gyn) residency training programs move towards a competence-based approach to training and assessment, the development of a national standardized simulation curriculum is essential. The primary goal of this study was to define the fundamental content for the Canadian Obstetrics and Gynecology Simulation curriculum. A modified Delphi technique was used to achieve consensus in three rounds by surveying residency program directors or their local simulation educator delegates in 16 accredited Canadian Ob/Gyn residency programs. A consensus rate of 80% was agreed upon. Survey results were collected over 11 months in 2016. Response rates for the Delphi were 50% for the first round, 81% for the second round, and 94% for the third round. The first survey resulted in 84 suggested topics. These were organized into four categories: obstetrics high acuity low frequency events, obstetrics common events, gynaecology high acuity low frequency events, and gynaecology common events. Using the modified Delphi method, consensus was reached on 6 scenarios. This study identified the content for a national simulation-based curriculum for Ob/Gyn residency training programs and is the first step in the development of this curriculum. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Insufficiently studied factors related to burnout in nursing: Results from an e-Delphi study

PubMed Central

2017-01-01

Objective This study aimed to identify potentially important factors in explaining burnout in nursing that have been insufficiently studied or ignored. Methods A three-round Delphi study via e-mail correspondence was conducted, with a group of 40 European experts. The e-Delphi questionnaire consisted of 52 factors identified from a literature review. Experts rated and scored the importance of factors in the occurrence of burnout and the degree of attention given by researchers to each of the variables listed, on a six-point Likert scale. We used the agreement percentage (>80%) to measure the level of consensus between experts. Furthermore, to confirm the level of consensus, we also calculated mean scores and modes. Regardless of the degree of consensus reached by the experts, we have calculated the mean of the stability of the answers for each expert (individual's qualitative stability) and the mean of the stability percentages of the experts (qualitative group stability). Results The response rate in the three rounds was 93.02% (n = 40). Eight new factors were suggested in the first round. After modified, the e-Delphi questionnaire in the second and third rounds had 60 factors. All the factors reached the third round with a consensus level above 80% in terms of the attention that researchers gave them in their studies. Moreover, the data show a total mean qualitative group stability of 96.21%. In the third round 9 factors were classified by experts as ‘studied very little’, 17 as ‘studied little’ and 34 as 'well studied' Conclusion Findings show that not all the factors that may influence nursing burnout have received the same attention from researchers. The panel of experts has identified factors that, although important in explaining burnout, have been poorly studied or even forgotten. Our results suggest that further study into factors such as a lack of recognition of part of the tasks that nurses perform, feminine stereotype or excessive bureaucracy is needed for a better understanding of this syndrome and improve the quality of life in nurses. PMID:28388660

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.

PubMed

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

Future directions in clinical child and adolescent psychology: a Delphi survey.

PubMed

James, Rochelle L; Roberts, Michael C

2009-10-01

This study sought to identify the future directions in three domains: clinical practice, research, and training of clinical child and adolescent psychologists in the upcoming decade. Doctoral-level active members in the field were surveyed via a two-round Delphi survey (45 in round 1; 35 in round 2). Evidence-based practice received the greatest consensus by the participants and highest rank in each of the three domains. Other highly ranked clinical practice directions included prevention and early diagnosis and treatment, and clinical services for specific psychological problems. Research directions focused on biological and social factors interactions in the etiology and treatment and specific child and adolescent disorders. In the training domain, major directions included the pursuit of specialty training in child and adolescent psychology and training emphasizing the biological basis of behavior. Implications of these future directions are discussed.

Curriculum development for a national cardiotocography education program: a Delphi survey to obtain consensus on learning objectives.

PubMed

Thellesen, Line; Hedegaard, Morten; Bergholt, Thomas; Colov, Nina P; Hoegh, Stinne; Sorensen, Jette L

2015-08-01

To define learning objectives for a national cardiotocography (CTG) education program based on expert consensus. A three-round Delphi survey. One midwife and one obstetrician from each maternity unit in Denmark were appointed based on CTG teaching experience and clinical obstetric experience. Following national and international guidelines, the research group determined six topics as important when using CTG: fetal physiology, equipment, indication, interpretation, clinical management, and communication/responsibility. In the first Delphi round, participants listed one to five learning objectives within the predefined topics. Responses were analyzed by a directed approach to content analysis. Phrasing was modified in accordance with Bloom's taxonomy. In the second and third Delphi rounds, participants rated each objective on a five-point relevance scale. Consensus was predefined as objectives with a mean rating value of ≥ 3. A prioritized list of CTG learning objectives. A total of 42 midwives and obstetricians from 21 maternity units were invited to participate, of whom 26 completed all three Delphi rounds, representing 18 maternity units. The final prioritized list included 40 objectives. The highest ranked objectives emphasized CTG interpretation and clinical management. The lowest ranked objectives emphasized fetal physiology. Mean ratings of relevance ranged from 3.15 to 5.00. National consensus on CTG learning objectives was achieved using the Delphi methodology. This was an initial step in developing a valid CTG education program. A prioritized list of objectives will clarify which topics to emphasize in a CTG education program. © 2015 Nordic Federation of Societies of Obstetrics and Gynecology.

Use of a Web-based Delphi for identifying critical components of a professional science master's program in biotechnology

NASA Astrophysics Data System (ADS)

Kantz, Jeannine Wells

The primary purpose of this research was to develop a model for a professional science master's program combining biotechnology and business. The objectives were to identify stakeholder preferences for various dimensions of a professional science master's program combining biotechnology and business and to identify differences in priorities between subgroups. A secondary purpose was to examine user preferences between Web-based and traditional methods of conducting a Delphi study and the panelist's impressions of its usefulness for program development. Prior to the first round, demographic data were collected on panelists regarding their gender, age, years experience in their current field, position title and education levels. Round 1 started with eight open-ended questions designed to investigate (a) learning objectives, (b) internships, (c) thesis vs. non-thesis degrees, (d) program focus (e) possible entry level positions, (f) roles for the industry advisory board, (g) recommended hours of hands-on experience and (h) other issues of importance. The final round ended with three questions to assess the panelists' perception of the usefulness of the Delphi for program development in higher education. Twenty-four panelists started Round 1 and participation in subsequent rounds varied from 17 in Round 2 to 11 in Round 4. Education level varied and included all levels of education in science and business. Issues emerged early in the study regarding development of different program tracks and the program goals, which were clarified in subsequent rounds. Significant differences occurred between industry and academic subgroups for two tracks, six skills designated for tracks, method of evaluating the internship, and entry-level positions appropriate for new graduates. When analyzed by level of confidence (high confidence vs. low confidence), significant differences occurred for (a) the number of semesters of hands-on experience students should have upon graduation, (b) skills recommended for core curriculum, (c) skills recommended for tracks, (d) compensation level and (e) entry level positions for new graduates. Perceived usefulness of the Delphi for program development was varied with only 10 panelists responding---five in favor, three undecided, and two against.

Issues Facing Urban Agriscience Teachers: A Delphi Study

ERIC Educational Resources Information Center

Warner, Wendy J.; Washburn, Shannon G.

2009-01-01

This national study used the Delphi technique to identify the issues facing urban agriscience teachers. The first round of the study used a questionnaire with one open-ended question to generate responses from the expert panel. In the second round, respondents were asked to rate their level of agreement with 72 issues identified in round one using…

What should dental services for people with disabilities be like? Results of an Irish Delphi panel survey.

PubMed

Mac Giolla Phadraig, Caoimhin; Nunn, June; Dougall, Alison; O'Neill, Eunan; McLoughlin, Jacinta; Guerin, Suzanne

2014-01-01

This study aimed to generate prioritised goals for oral health services for people with disabilities as a first step in meeting the need for evidence based oral health services for people with disabilities in Ireland. The study used a three round modified e-Delphi method, involving dental service professionals and people with disabilities or their representatives, in Ireland. Three rounds were completed online using SurveyMonkey. Round 1 asked: "List what you think dental services for people with disabilities in Ireland should be like." Items for subsequent rounds were generated from responses to Round 1. Round 2 and Round 3 used 5 point Likert scales to rank these items by priority: from No Priority (1) to Top Priority (5). Consensus was achieved on each item where at least 80% of respondents considered an item either High or Top Priority. A consensus meeting concluded the process. Sixty-one panelists started and 48 completed the survey. The Delphi panel agreed on level of priority for 69 items and generated 16 consensus statements. These statements covered a range of topics such as access to care, availability of information and training, quality of care, dental treatment and cost. A recurrent theme relating to the appropriateness of care to individual need arose across topics suggesting a need to match service delivery according to the individual's needs, wants and expectations rather than the disability type/diagnosis based service which predominates today. This process produced a list of prioritised goals for dental services for people with disabilities. This creates a foundation for building evidence-based service models for people with disabilities in Ireland.

International Occupational Therapy Research Priorities.

PubMed

Mackenzie, Lynette; Coppola, Susan; Alvarez, Liliana; Cibule, Lolita; Maltsev, Sergey; Loh, Siew Yim; Mlambo, Tecla; Ikiugu, Moses N; Pihlar, Zdenka; Sriphetcharawut, Sarinya; Baptiste, Sue; Ledgerd, Richard

2017-04-01

Occupational therapy is a global profession represented by the World Federation of Occupational Therapists (WFOT). International research priorities are needed for strategic guidance on global occupational therapy practice. The objective of this study was to develop international research priorities to reflect global occupational therapy practice. A Delphi study using three rounds of electronic surveys, distributed to WFOT member organizations and WFOT accredited universities, was conducted. Data were analyzed after each round, and priorities were presented for rating and ranking in order of importance. Forty-six (53%) out of 87 WFOT member countries participated in the Delphi process. Eight research priorities were confirmed by the final electronic survey round. Differences were observed in rankings given by member organizations and university respondents. Despite attrition at Round 3, the final research priorities will help to focus research efforts in occupational therapy globally. Follow-up research is needed to determine how the research priorities are being adopted internationally.

What Are We Aiming For?--A Delphi Study on the Development of Civic Scientific Literacy in Sweden

ERIC Educational Resources Information Center

Chang Rundgren, Shu-Nu; Rundgren, Carl-Johan

2017-01-01

Based on the EU FP 7 project, PROFILES, this article presents our findings from a three-round Delphi study conducted in Sweden that aimed at establishing a consensus on how science education should be developed for citizens to enhance civic scientific literacy. A total of 100 stakeholders (9th graders, school teachers, scientists, and science…

Defining Malaysian Knowledge Society: Results from the Delphi Technique

NASA Astrophysics Data System (ADS)

Hamid, Norsiah Abdul; Zaman, Halimah Badioze

This paper outlines the findings of research where the central idea is to define the term Knowledge Society (KS) in Malaysian context. The research focuses on three important dimensions, namely knowledge, ICT and human capital. This study adopts a modified Delphi technique to seek the important dimensions that can contribute to the development of Malaysian's KS. The Delphi technique involved ten experts in a five-round iterative and controlled feedback procedure to obtain consensus on the important dimensions and to verify the proposed definition of KS. The finding shows that all three dimensions proposed initially scored high and moderate consensus. Round One (R1) proposed an initial definition of KS and required comments and inputs from the panel. These inputs were then used to develop items for a R2 questionnaire. In R2, 56 out of 73 items scored high consensus and in R3, 63 out of 90 items scored high. R4 was conducted to re-rate the new items, in which 8 out of 17 items scored high. Other items scored moderate consensus and no item scored low or no consensus in all rounds. The final round (R5) was employed to verify the final definition of KS. Findings and discovery of this study are significant to the definition of KS and the development of a framework in the Malaysian context.

A Delphi Study: The Characteristics of Democratic Schools

ERIC Educational Resources Information Center

Korkmaz, H. Eylem; Erden, Münire

2014-01-01

The authors aim to identify characteristics of democratic schools. The Delphi technique used in this study is based on attaining a consensus among a group of experts over 3 rounds with 22 experts from 9 countries participating in the first round. By the end of the third round, 339 items referring to democratic school characteristics were…

Development of quality indicators for physiotherapy for patients with PAOD in the Netherlands: a Delphi study.

PubMed

Gijsbers, H J H; Lauret, G J; van Hofwegen, A; van Dockum, T A; Teijink, J A W; Hendriks, H J M

2016-06-01

The aim of the study was to develop quality indicators (QIs) for physiotherapy management of patients with intermittent claudication (IC) in the Netherlands. As part of an international six-step method to develop QIs, an online survey Delphi-procedure was completed. After two Delphi-rounds a validation round was performed. Twenty-six experts were recruited to participate in this study. Twenty-four experts completed two Delphi-rounds. A third round was conducted inviting 1200 qualified and registered physiotherapists of the Dutch integrated care network 'Claudicationet' to validate a draft set of quality indicators. Out of 83 potential QIs in the Dutch physiotherapy guideline on 'Intermittent claudication', consensus among the experts selected nine indicators. All nine quality indicators were validated by 300 physiotherapists. A final set of nine indicators was derived from (1) a Dutch evidence-based physiotherapy guideline, (2) an expert Delphi procedure and (3) a validation by 300 physiotherapists. This set of indicators should be validated in clinical practice. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Medication dispensing errors in Palestinian community pharmacy practice: a formal consensus using the Delphi technique.

PubMed

Shawahna, Ramzi; Haddad, Aseel; Khawaja, Baraa; Raie, Rand; Zaneen, Sireen; Edais, Tasneem

2016-10-01

Background Medication dispensing errors (MDEs) are frequent in community pharmacy practice. A definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice were not previously approached using formal consensus techniques. Objective This study was conducted to achieve consensus on a definition of MDEs and a wide range of scenarios that should or should not be considered as MDEs in Palestinian community pharmacy practice by a panel of community pharmacists. Setting Community pharmacy practice in Palestine. Method This was a descriptive study using the Delphi technique. A panel of fifty community pharmacists was recruited from different geographical locations of the West Bank of Palestine. A three round Delphi technique was followed to achieve consensus on a proposed definition of MDEs and 83 different scenarios representing potential MDEs using a nine-point scale. Main outcome measure Agreement or disagreement of a panel of community pharmacists on a proposed definition of MDEs and a series of scenarios representing potential MDEs. Results In the first Delphi round, views of key contact community pharmacists on MDEs were explored and situations representing potential MDEs were collected. In the second Delphi round, consensus was achieved to accept the proposed definition and to include 49 (59 %) of the 83 proposed scenarios as MDEs. In the third Delphi round, consensus was achieved to include further 13 (15.7 %) scenarios as MDEs, exclude 9 (10.8 %) scenarios and the rest of 12 (14.5 %) scenarios were considered equivocal based on the opinions of the panelists. Conclusion Consensus on a definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice was achieved using a formal consensus technique. The use of consensual definitions and scenarios representing MDE situations in community pharmacy practice might minimize methodological variations and their significant effects on the number and rate of MDEs reported in different studies.

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

PubMed

Bank, Ilana; Cheng, Adam; McLeod, Peter; Bhanji, Farhan

2015-11-01

By the end of residency training, pediatric emergency medicine (PEM) residents are expected to have developed the confidence and abilities required to manage acutely ill children. Acquisition of competence requires exposure and/or supplemental formal education for critical and noncritical medical clinical presentations. Simulation can provide experiential learning and can improve trainees' knowledge, skills, and attitudes. The primary objective of this project was to identify the content for a simulation-based national curriculum for PEM training. We recruited participants for the Delphi study by contacting current PEM program directors and immediate past program directors as well as simulation experts at all of the Canadian PEM fellowship sites. We determined the appropriate core content for the Delphi study by combining the PEM core content requirements of the Royal College of Physicians and Surgeons of Canada (RCPSC) and the American Board of Pediatrics (ABP). Using the Delphi method, we achieved consensus amongst the national group of PEM and simulation experts. The participants completed a three-round Delphi (using a four-point Likert scale). Response rates for the Delphi were 85% for the first round and 77% for second and third rounds. From the initial 224 topics, 53 were eliminated (scored <2). Eighty-five topics scored between 2 and 3, and 87 scored between 3 and 4. The 48 topics, which were scored between 3.5 and 4.0, were labeled as "key curriculum topics." We have iteratively identified a consensus for the content of a national simulation-based curriculum.

1988 Delphi survey of nursing research priorities for New York State.

PubMed

Shortridge, L; Doswell, W; Evans, M E; Levin, R F; Millor, G K; Carter, E

1989-09-01

In order to inform decisions about nursing research and health care policy, the Council on Nursing Research of the New York State Nurses Association (NYSNA) conducted a Delphi survey to identify the priorities for nursing research in New York state. The Delphi technique is a method of eliciting judgements from experts for the purpose of short-term forecasting and planning. The survey was conducted by mail in three rounds during 1988. Round I required participants to identify three primary research priorities for the nursing profession. In Round II participants ranked the 37 most frequently identified categories from Round I. The highest 16 categories from Round II were ranked by participants in Round III to provide the final 10 nursing research priority categories for New York state. All members of the New York State Nurses Association holding a minimum of a master's degree in nursing were invited to participate. The response rates were: Round I, 34% (N = 872); Round II, 38% (N = 985); Round III 37% (N = 974). Of the 10 nursing research priority categories identified in the final round, 5 relate to nurses, 2 relate to nursing, and 3 relate to clients. None of the high-risk conditions or populations with whom nurses work appear in the top 10, and only 2 of these are ranked in the top 15 priority categories. These priority categories will be used by the NYSNA Council on Nursing Research to influence its future agenda and activities. They can be used by the nursing profession and others for planning, policy making, and establishing nursing research funding priorities.(ABSTRACT TRUNCATED AT 250 WORDS)

Three nested randomized controlled trials of peer-only or multiple stakeholder group feedback within Delphi surveys during core outcome and information set development.

PubMed

Brookes, Sara T; Macefield, Rhiannon C; Williamson, Paula R; McNair, Angus G; Potter, Shelley; Blencowe, Natalie S; Strong, Sean; Blazeby, Jane M

2016-08-17

Methods for developing a core outcome or information set require involvement of key stakeholders to prioritise many items and achieve agreement as to the core set. The Delphi technique requires participants to rate the importance of items in sequential questionnaires (or rounds) with feedback provided in each subsequent round such that participants are able to consider the views of others. This study examines the impact of receiving feedback from different stakeholder groups, on the subsequent rating of items and the level of agreement between stakeholders. Randomized controlled trials were nested within the development of three core sets each including a Delphi process with two rounds of questionnaires, completed by patients and health professionals. Participants rated items from 1 (not essential) to 9 (absolutely essential). For round 2, participants were randomized to receive feedback from their peer stakeholder group only (peer) or both stakeholder groups separately (multiple). Decisions as to which items to retain following each round were determined by pre-specified criteria. Whilst type of feedback did not impact on the percentage of items for which a participant subsequently changed their rating, or the magnitude of change, it did impact on items retained at the end of round 2. Each core set contained discordant items retained by one feedback group but not the other (3-22 % discordant items). Consensus between patients and professionals in items to retain was greater amongst those receiving multiple group feedback in each core set (65-82 % agreement for peer-only feedback versus 74-94 % for multiple feedback). In addition, differences in round 2 scores were smaller between stakeholder groups receiving multiple feedback than between those receiving peer group feedback only. Variability in item scores across stakeholders was reduced following any feedback but this reduction was consistently greater amongst the multiple feedback group. In the development of a core outcome or information set, providing feedback within Delphi questionnaires from all stakeholder groups separately may influence the final core set and improve consensus between the groups. Further work is needed to better understand how participants rate and re-rate items within a Delphi process. The three randomized controlled trials reported here were each nested within the development of a core information or outcome set to investigate processes in core outcome and information set development. Outcomes were not health-related and therefore trial registration was not applicable.

Defining interdisciplinary competencies for audiological rehabilitation: findings from a modified Delphi study.

PubMed

Xue, Lina; Le Bot, Gaëlle; Van Petegem, Wim; van Wieringen, Astrid

2018-02-01

The aim of this study is to derive a consensus on an interdisciplinary competency framework regarding a holistic approach for audiological rehabilitation (AR), which includes disciplines from medicine, engineering, social sciences and humanities. We employed a modified Delphi method. In the first round survey, experts were asked to rate an initial list of 28 generic interdisciplinary competencies and to propose specific knowledge areas for AR. In the second round, experts were asked to reconsider their answers in light of the group answers of the first round. An international panel of 27 experts from different disciplines in AR completed the first round. Twenty-two of them completed the second round. We developed a competency framework consisting of 21 generic interdisciplinary competencies grouped in five domains and nine specific competencies (knowledge areas) in three clusters. Suggestions for the implementation of the generic competencies in interdisciplinary programmes were identified. This study reveals insights into the interdisciplinary competencies that are unique for AR. The framework will be useful for educators in developing interdisciplinary programmes as well as for professionals in considering their lifelong training needs in AR.

Research priorities for respiratory nursing: a UK-wide Delphi study.

PubMed

Kelly, Carol Ann; Kirkcaldy, Andrew J; Pilkington, Melissa; Hodson, Matthew; Welch, Lindsay; Yorke, Janelle; Knighting, Katherine

2018-04-01

Respiratory nurses make a significant contribution to the delivery of respiratory healthcare, but there is a dearth of nurse-led, practice-focused, published research. Using a modified three-round Delphi, this study sought to identify research priorities for respiratory nursing to inform a national research strategy. Study information and the survey link were sent electronically to members of UK professional respiratory organisations. Round 1 had 78 items across 16 topics, informed by a systematic literature review. Respondents suggested additional items which were content analysed to inform Round 2. Respondents rated all items and ranked the topics in all rounds. To ensure rigour, rounds had an explicit focus with pre-determined criteria for consensus (70%). In total, 363 responses were received across Rounds 1, 2 and 3 (n=183, 95 and 85, respectively). The top five research priorities were: 1) "Patient understanding of asthma control"; 2) "The clinical and cost-effectiveness of respiratory nurse interventions"; 3) "The impact of nurse-led clinics on patient care"; 4) "Inhaler technique"; and 5) two topics jointly scored: "Prevention of exacerbations" and "Symptom management". With potential international significance, this is the first UK study to identify research priorities for respiratory nursing, providing direction for those planning or undertaking research.

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration

PubMed Central

Chan, David; Lawrence, Ben; Pavlakis, Nick; Kennecke, Hagen F.; Jackson, Christopher; Law, Calvin; Singh, Simron

2017-01-01

Purpose Neuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan. Methods A three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan. Results The Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established. Conclusion This modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field. PMID:28831446

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration.

PubMed

Segelov, Eva; Chan, David; Lawrence, Ben; Pavlakis, Nick; Kennecke, Hagen F; Jackson, Christopher; Law, Calvin; Singh, Simron

2017-08-01

Neuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan. A three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan. The Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established. This modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field.

Teacher Competencies in Health Education: Results of a Delphi Study

PubMed Central

Moynihan, Sharon; Paakkari, Leena; Välimaa, Raili; Jourdan, Didier; Mannix-McNamara, Patricia

2015-01-01

Objective The aim of this research study was to identify the core competencies for health education teachers in supporting the development of health literacy among their students. Method/Results A three round Delphi method was employed. Experts in health education were asked to identify core competencies for school health educators. Twenty six participants from the academic field were invited to participate in the study. Twenty participants completed the first round of the Delphi, while eighteen took part in round two and fifteen participated in the final round. Data were collected using an electronic questionnaire. The first round contained an open ended question in which participants were asked to name and define all the competencies they perceived were important. Thematic analysis was undertaken on these data. A list of 36 competencies was created from this round. This list was then returned to the same participants and they were asked to rate each competency on a 7 point semantic differential scale in terms of importance. The resulting data were then analysed. For the final round, participants were presented with a list of 33 competencies and were asked to rank them again, in order of importance. Conclusion Twelve core competencies emerged from the analysis and these competencies comprised of a mixture of knowledge, attitude and skills. The authors suggest that how these competencies are achieved and operationalised in the school context can be quite complex and multi-faceted. While the authors do not seek to generalise from the study they suggest that these competencies are an important input for all stakeholders, in order to question national and international teacher guidelines. In addition the competencies identified may provide a useful starting point for others to undertake deeper analysis of what it means to be an effective health educator in schools. PMID:26630180

Identifying seminal papers in the Australasian Journal on Ageing 1982-2011: a Delphi consensus approach.

PubMed

Parkinson, Lynne; Richardson, Kristy; Sims, Jane; Wells, Yvonne; Naganathan, Vasi; Brooke, Elizabeth; Lindley, Richard

2013-10-01

The aim of this study was to identify seminal Australasian Journal on Ageing papers published over 30 years through a Delphi consensus process. The main data collection was a three-round Delphi consensus study with 38 past and current members of the Australasian Journal on Ageing Editorial Board, Editorial Team and Management Committee. Three papers were agreed as top-ranking. One of the top-ranking articles was also highly cited. One article was published in the 1990 s, two in 2001. While it is difficult to judge how well the top-ranking papers represent seminal papers arising over 30 years, these papers do represent three different research strengths in Australasia, they do span three different disciplines, and they do reflect some of the diversity that characterises ageing research in Australasia over 30 years. © 2013 ACOTA.

[Modified Delphi method in the constitution of school sanitation standard].

PubMed

Yin, Xunqiang; Liang, Ying; Tan, Hongzhuan; Gong, Wenjie; Deng, Jing; Luo, Jiayou; Di, Xiaokang; Wu, Yue

2012-11-01

To constitute school sanitation standard using modified Delphi method, and to explore the feasibility and the predominance of Delphi method in the constitution of school sanitation standard. Two rounds of expert consultations were adopted in this study. The data were analyzed with SPSS15.0 to screen indices of school sanitation standard. Thirty-two experts accomplished the 2 rounds of consultations. The average length of expert service was (24.69 ±8.53) years. The authority coefficient was 0.729 ±0.172. The expert positive coefficient was 94.12% (32/34) in the first round and 100% (32/32) in the second round. The harmonious coefficients of importance, feasibility and rationality in the second round were 0.493 (P<0.05), 0.527 (P<0.01), and 0.535 (P<0.01), respectively, suggesting unanimous expert opinions. According to the second round of consultation, 38 indices were included in the framework. Theoretical analysis, literature review, investigation and so on are generally used in health standard constitution currently. Delphi method is a rapid, effective and feasible method in this field.

Multidisciplinary Delphi Development of a Scale to Evaluate Team Function in Obstetric Emergencies: The PETRA Scale.

PubMed

Balki, Mrinalini; Hoppe, David; Monks, David; Cooke, Mary Ellen; Sharples, Lynn; Windrim, Rory

2017-06-01

The objective of this study was to develop a new interdisciplinary teamwork scale, the Perinatal Emergency: Team Response Assessment (PETRA), for the management of obstetric crises, through consensus agreement of obstetric caregivers. This prospective study was performed using expert consensus, based on a Delphi method. The study investigators developed a new PETRA tool, specifically related to obstetric crisis management, based on the existing literature and discussions among themselves. The scale was distributed to a selected panel of experts in the field for the Delphi process. After each round of Delphi, every component of the scale was analyzed quantitatively by the percentage of agreement ratings and each comment reviewed by the blinded investigators. The assessment scale was then modified, with components of less than 80% agreement removed from the scale. The process was repeated on three occasions to reach a consensus and final PETRA scale. Fourteen of 24 invited experts participated in the Delphi process. The original PETRA scale included six categories and 48 items, one global scale item, and a 3-point rubric for rating. The overall percentage agreement by experts in the first, second, and third rounds was 95.0%, 93.2%, and 98.5%, respectively. The final scale after the third round of Delphi consisted of the following seven categories: shared mental model, communication, situational awareness, leadership, followership, workload management, and positive/effective behaviours and attitudes. There were 34 individual items within these categories, each with a 5-point rating rubric (1 = unacceptable to 5 = perfect). Using a structured Delphi method, we established the face and content validity of this assessment scale that focuses on important aspects of interdisciplinary teamwork in the management of obstetric crises. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

A Delphi study and ranking exercise to support commissioning services: future delivery of Thrombectomy services in England.

PubMed

Halvorsrud, Kristoffer; Flynn, Darren; Ford, Gary A; McMeekin, Peter; Bhalla, Ajay; Balami, Joyce; Craig, Dawn; White, Phil

2018-02-22

Intra-arterial thrombectomy is the gold standard treatment for large artery occlusive stroke. However, the evidence of its benefits is almost entirely based on trials delivered by experienced neurointerventionists working in established teams in neuroscience centres. Those responsible for the design and prospective reconfiguration of services need access to a comprehensive and complementary array of information on which to base their decisions. This will help to ensure the demonstrated effects from trials may be realised in practice and account for regional/local variations in resources and skill-sets. One approach to elucidate the implementation preferences and considerations of key experts is a Delphi survey. In order to support commissioning decisions, we aimed using an electronic Delphi survey to establish consensus on the options for future organisation of thrombectomy services among physicians with clinical experience in managing large artery occlusive stroke. A Delphi survey was developed with 12 options for future organisation of thrombectomy services in England. A purposive sampling strategy established an expert panel of stroke physicians from the British Association of Stroke Physicians (BASP) Clinical Standards and/or Executive Membership that deliver 24/7 intravenous thrombolysis. Options with aggregate scores falling within the lowest quartile were removed from the subsequent Delphi round. Options reaching consensus following the two Delphi rounds were then ranked in a final exercise by both the wider BASP membership and the British Society of Neuroradiologists (BSNR). Eleven stroke physicians from BASP completed the initial two Delphi rounds. Three options achieved consensus, with subsequently wider BASP (97%, n = 43) and BSNR members (86%, n = 21) assigning the highest approval rankings in the final exercise for transferring large artery occlusive stroke patients to nearest neuroscience centre for thrombectomy based on local CT/CT Angiography. The initial Delphi rounds ensured optimal reduction of options by an expert panel of stroke physicians, while subsequent ranking exercises allowed remaining options to be ranked by a wider group of experts within stroke to reach consensus. The preferred implementation option for thrombectomy is investigating suspected acute stroke patients by CT/CT Angiography and secondary transfer of large artery occlusive stroke patients to the nearest neuroscience (thrombectomy) centre.

Evaluation Criteria for Nursing Student Application of Evidence-Based Practice: A Delphi Study.

PubMed

Bostwick, Lina; Linden, Lois

2016-06-01

Core clinical evaluation criteria do not exist for measuring prelicensure baccalaureate nursing students' application of evidence-based practice (EBP) during direct care assignments. The study objective was to achieve consensus among EBP nursing experts to create clinical criteria for faculty to use in evaluating students' application of EBP principles. A three-round Delphi method was used. Experts were invited to participate in Web-based surveys. Data were analyzed using qualitative coding and categorizing. Quantitative analyses were descriptive calculations for rating and ranking. Expert consensus occurred in the Delphi rounds. The study provides a set of 10 core clinical evaluation criteria for faculty evaluating students' progression toward competency in their application of EBP. A baccalaureate program curriculum requiring the use of Bostwick's EBP Core Clinical Evaluation Criteria will provide a clear definition for understanding basic core EBP competence as expected for the assessment of student learning. [J Nurs Educ. 2016;55(5):336-341.]. Copyright 2016, SLACK Incorporated.

From equity to power: Critical Success Factors for Twinning between midwives, a Delphi study.

PubMed

Cadée, Franka; Nieuwenhuijze, Marianne J; Lagro-Janssen, Antoine L M; de Vries, Raymond

2018-02-28

To gain consensus for Critical Success Factors associated with Twinning in Midwifery. International publications identify midwifery as important for improving maternity care worldwide. Midwifery is a team effort where midwives play a key role. Yet their power to take on this role is often lacking. Twinning has garnered potential to develop power in professionals, however, its success varies because implementation is not always optimal. Critical Success Factors have demonstrated positive results in the managerial context and can be helpful to build effective Twinning relationships. We approached 56 midwife Twinning experts from 19 countries to participate in three Delphi rounds between 2016 - 2017. In round 1, experts gave input through an open ended questionnaire and this was analysed to formulate Critical Success Factors statements that were scored on a 1-7 Likert scale aiming to gain consensus in rounds 2 and 3. These statements were operationalized for practical use such as a check list in planning, monitoring and evaluation in the field. Thirty-three experts from 14 countries took part in all three Delphi rounds, producing 58 initial statements. This resulted in 25 Critical Success Factors covering issues of management, communication, commitment and values, most focus on equity. The Critical Success Factors formulated represent the necessary ingredients for successful Twinning by providing a practical implementation framework and promote further research into the effect of Twinning. Findings show that making equity explicit in Twinning may contribute towards the power of midwives to take on their identified key role. © 2018 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Research priorities for respiratory nursing: a UK-wide Delphi study

PubMed Central

Pilkington, Melissa; Hodson, Matthew; Welch, Lindsay; Yorke, Janelle

2018-01-01

Respiratory nurses make a significant contribution to the delivery of respiratory healthcare, but there is a dearth of nurse-led, practice-focused, published research. Using a modified three-round Delphi, this study sought to identify research priorities for respiratory nursing to inform a national research strategy. Study information and the survey link were sent electronically to members of UK professional respiratory organisations. Round 1 had 78 items across 16 topics, informed by a systematic literature review. Respondents suggested additional items which were content analysed to inform Round 2. Respondents rated all items and ranked the topics in all rounds. To ensure rigour, rounds had an explicit focus with pre-determined criteria for consensus (70%). In total, 363 responses were received across Rounds 1, 2 and 3 (n=183, 95 and 85, respectively). The top five research priorities were: 1) “Patient understanding of asthma control”; 2) “The clinical and cost-effectiveness of respiratory nurse interventions”; 3) “The impact of nurse-led clinics on patient care”; 4) “Inhaler technique”; and 5) two topics jointly scored: “Prevention of exacerbations” and “Symptom management”. With potential international significance, this is the first UK study to identify research priorities for respiratory nursing, providing direction for those planning or undertaking research. PMID:29692999

Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure

PubMed Central

2013-01-01

Background The quantity and quality of studies in child and adolescent physical activity and sedentary behaviour have rapidly increased, but research directions are often pursued in a reactive and uncoordinated manner. Aim To arrive at an international consensus on research priorities in the area of child and adolescent physical activity and sedentary behaviour. Methods Two independent panels, each consisting of 12 experts, undertook three rounds of a Delphi methodology. The Delphi methodology required experts to anonymously answer questions put forward by the researchers with feedback provided between each round. Results The primary outcome of the study was a ranked set of 29 research priorities that aimed to be applicable for the next 10 years. The top three ranked priorities were: developing effective and sustainable interventions to increase children’s physical activity long-term; policy and/or environmental change and their influence on children’s physical activity and sedentary behaviour; and prospective, longitudinal studies of the independent effects of physical activity and sedentary behaviour on health. Conclusions These research priorities can help to guide decisions on future research directions. PMID:24228891

Operationalising elaboration theory for simulation instruction design: a Delphi study.

PubMed

Haji, Faizal A; Khan, Rabia; Regehr, Glenn; Ng, Gary; de Ribaupierre, Sandrine; Dubrowski, Adam

2015-06-01

The aim of this study was to assess the feasibility of incorporating the Delphi process within the simplifying conditions method (SCM) described in elaboration theory (ET) to identify conditions impacting the complexity of procedural skills for novice learners. We generated an initial list of conditions impacting the complexity of lumbar puncture (LP) from key informant interviews (n = 5) and a literature review. Eighteen clinician-educators from six different medical specialties were subsequently recruited as expert panellists. Over three Delphi rounds, these panellists rated: (i) their agreement with the inclusion of the simple version of the conditions in a representative ('epitome') training scenario, and (ii) how much the inverse (complex) version increases LP complexity for a novice. Cronbach's α-values were used to assess inter-rater agreement. All panellists completed Rounds 1 and 2 of the survey and 17 completed Round 3. In Round 1, Cronbach's α-values were 0.89 and 0.94 for conditions that simplify and increase LP complexity, respectively; both values increased to 0.98 in Rounds 2 and 3. With the exception of 'high CSF (cerebral spinal fluid) pressure', panellists agreed with the inclusion of all conditions in the simplest (epitome) training scenario. Panellists rated patient movement, spinal anatomy, patient cooperativeness, body habitus, and the presence or absence of an experienced assistant as having the greatest impact on the complexity of LP. This study demonstrated the feasibility of using expert consensus to establish conditions impacting the complexity of procedural skills, and the benefits of incorporating the Delphi method into the SCM. These data can be used to develop and sequence simulation scenarios in a progressively challenging manner. If the theorised learning gains associated with ET are realised, the methods described in this study may be applied to the design of simulation training for other procedural and non-procedural skills, thereby advancing the agenda of theoretically based instruction design in health care simulation. © 2015 John Wiley & Sons Ltd.

Development of a nationwide consensus syllabus of palliative medicine for undergraduate medical education in Japan: a modified Delphi method.

PubMed

Kizawa, Yoshiyuki; Tsuneto, Satoru; Tamba, Kaichiro; Takamiya, Yusuke; Morita, Tatsuya; Bito, Seiji; Otaki, Junji

2012-07-01

There is currently no consensus syllabus of palliative medicine for undergraduate medical education in Japan, although the Cancer Control Act proposed in 2007 covers the dissemination of palliative care. To develop a nationwide consensus syllabus of palliative medicine for undergraduate medical education in Japan using a modified Delphi method. We adopted the following three-step method: (1) a workshop to produce the draft syllabus; (2) a survey-based provisional syllabus; (3) Delphi rounds and a panel meeting (modified Delphi method) to produce the working syllabus. Educators in charge of palliative medicine from 63% of the medical schools in Japan collaborated to develop a survey-based provisional syllabus before the Delphi rounds. A panel of 32 people was then formed for the modified Delphi rounds comprising 28 educators and experts in palliative medicine, one cancer survivor, one bereaved family member, and two medical students. The final consensus syllabus consists of 115 learning objectives across seven sections as follows: basic principles; disease process and comprehensive assessment; symptom management; psychosocial care; cultural, religious, and spiritual issues; ethical issues; and legal frameworks. Learning objectives were categorized as essential or desirable (essential: 66; desirable: 49). A consensus syllabus of palliative medicine for undergraduate medical education was developed using a clear and innovative methodology. The final consensus syllabus will be made available for further dissemination of palliative care education throughout the country.

Seeking an oracle: using the Delphi process to develop practice guidelines for the treatment of endometriosis with Chinese herbal medicine.

PubMed

Flower, Andrew; Lewith, George T; Little, Paul

2007-11-01

For most complementary and alternative medicine interventions, the absence of a high-quality evidence base to define good practice presents a serious problem for clinicians, educators, and researchers. The Delphi process may offer a pragmatic way to establish good practice guidelines until more rigorous forms of assessment can be undertaken. To use a modified Delphi to develop good practice guidelines for a feasibility study exploring the role of Chinese herbal medicine (CHM) in the treatment of endometriosis. To compare the outcomes from Delphi with data derived from a systematic review of the Chinese language database. An expert group was convened for a three-round Delphi that initially produced key statements relating to the CHM diagnosis and treatment of endometriosis (round 1) and then anonymously rated these on a 1-7 Likert scale (rounds 2 and 3). Statements with a median score of 5 and above were regarded as demonstrating positive group consensus. The differential diagnoses within Chinese Medicine and rating of the clinical value of individual herbs were then contrasted with comparable data from a review of Chinese language reports in the Chinese Biomedical Retrieval System (1978-2002), and China Academy of Traditional Chinese Medicine (1985-2002) databases and the Chinese TCM and magazine literature (1984-2004) databases. Consensus (good practice) guidelines for the CHM treatment of endometriosis relating to common diagnostic patterns, herb selection, dosage, and patient management were produced. The Delphi guidelines demonstrated a high degree of congruence with the information from the Chinese language databases. In the absence of rigorous evidence, Delphi offers a way to synthesize expert knowledge relating to diagnosis, patient management, and herbal selection in the treatment of endometriosis. The limitations of the expert group and the inability of Delphi to capture the subtle nuances of individualized clinical decision-making limit the usefulness of this approach.

Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi consensus approach.

PubMed

Wakai, Abel; O'Sullivan, Ronan; Staunton, Paul; Walsh, Cathal; Hickey, Fergal; Plunkett, Patrick K

2013-04-01

The objective of this study was to develop a consensus among emergency medicine (EM) specialists working in Ireland for emergency department (ED) key performance indicators (KPIs). The method employed was a three-round electronic modified-Delphi process. An online questionnaire with 54 potential KPIs was set up for round 1 of the Delphi process. The Delphi panel consisted of all registered EM specialists in Ireland. Each indicator on the questionnaire was rated using a five-point Likert-type rating scale. Agreement was defined as at least 70% of the responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using standard descriptive statistics. Data were also analysed as the mean of the Likert rating with 95% confidence intervals (95% CIs). Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Statistical analyses were carried out using SPSS version 16.0. The response rates in rounds 1, 2 and 3 were 86, 88 and 88%, respectively. Ninety-seven potential indicators reached agreement after the three rounds. In the context of the Donabedian structure-process-outcome framework of performance indicators, 41 (42%) of the agreed indicators were structure indicators, 52 (54%) were process indicators and four (4%) were outcome indicators. Overall, the top-three highest rated indicators were: presence of a dedicated ED clinical information system (4.7; 95% CI 4.6-4.9), ED compliance with minimum design standards (4.7; 95% CI 4.5-4.8) and time from ED arrival to first ECG in suspected cardiac chest pain (4.7; 95% CI 4.5-4.9). The top-three highest rated indicators specific to clinical care of children in EDs were: time to administration of antibiotics in children with suspected bacterial meningitis (4.6; 95% CI 4.5-4.8), separate area available within EDs (seeing both adults and children) to assess children (4.4; 95% CI 4.2-4.6) and time to administration of analgesia in children with forearm fractures (4.4; 95% CI 4.2-4.7). Employing a Delphi consensus process, it was possible to reach a consensus among EM specialists in Ireland on a suite of 97 KPIs for EDs.

The trials methodological research agenda: results from a priority setting exercise.

PubMed

Tudur Smith, Catrin; Hickey, Helen; Clarke, Mike; Blazeby, Jane; Williamson, Paula

2014-01-23

Research into the methods used in the design, conduct, analysis, and reporting of clinical trials is essential to ensure that effective methods are available and that clinical decisions made using results from trials are based on the best available evidence, which is reliable and robust. An on-line Delphi survey of 48 UK Clinical Research Collaboration registered Clinical Trials Units (CTUs) was undertaken. During round one, CTU Directors were asked to identify important topics that require methodological research. During round two, their opinion about the level of importance of each topic was recorded, and during round three, they were asked to review the group's average opinion and revise their previous opinion if appropriate. Direct reminders were sent to maximise the number of responses at each round. Results are summarised using descriptive methods. Forty one (85%) CTU Directors responded to at least one round of the Delphi process: 25 (52%) responded in round one, 32 (67%) responded in round two, 24 (50%) responded in round three. There were only 12 (25%) who responded to all three rounds and 18 (38%) who responded to both rounds two and three. Consensus was achieved amongst CTU Directors that the top three priorities for trials methodological research were 'Research into methods to boost recruitment in trials' (considered the highest priority), 'Methods to minimise attrition' and 'Choosing appropriate outcomes to measure'. Fifty other topics were included in the list of priorities and consensus was reached that two topics, 'Radiotherapy study designs' and 'Low carbon trials', were not priorities. This priority setting exercise has identified the research topics felt to be most important to the key stakeholder group of Directors of UKCRC registered CTUs. The use of robust methodology to identify these priorities will help ensure that this work informs the trials methodological research agenda, with a focus on topics that will have most impact and relevance.

The trials methodological research agenda: results from a priority setting exercise

PubMed Central

2014-01-01

Background Research into the methods used in the design, conduct, analysis, and reporting of clinical trials is essential to ensure that effective methods are available and that clinical decisions made using results from trials are based on the best available evidence, which is reliable and robust. Methods An on-line Delphi survey of 48 UK Clinical Research Collaboration registered Clinical Trials Units (CTUs) was undertaken. During round one, CTU Directors were asked to identify important topics that require methodological research. During round two, their opinion about the level of importance of each topic was recorded, and during round three, they were asked to review the group’s average opinion and revise their previous opinion if appropriate. Direct reminders were sent to maximise the number of responses at each round. Results are summarised using descriptive methods. Results Forty one (85%) CTU Directors responded to at least one round of the Delphi process: 25 (52%) responded in round one, 32 (67%) responded in round two, 24 (50%) responded in round three. There were only 12 (25%) who responded to all three rounds and 18 (38%) who responded to both rounds two and three. Consensus was achieved amongst CTU Directors that the top three priorities for trials methodological research were ‘Research into methods to boost recruitment in trials’ (considered the highest priority), ‘Methods to minimise attrition’ and ‘Choosing appropriate outcomes to measure’. Fifty other topics were included in the list of priorities and consensus was reached that two topics, ‘Radiotherapy study designs’ and ‘Low carbon trials’, were not priorities. Conclusions This priority setting exercise has identified the research topics felt to be most important to the key stakeholder group of Directors of UKCRC registered CTUs. The use of robust methodology to identify these priorities will help ensure that this work informs the trials methodological research agenda, with a focus on topics that will have most impact and relevance. PMID:24456928

Addressing the workplace needs of Western Australian midwives: a Delphi study.

PubMed

Hauck, Yvonne L; Bayes, Sara J; Robertson, Jeanette M

2012-05-01

To determine the workplace needs of Western Australian midwives working in public metropolitan secondary hospitals. Using a three-round Delphi approach, Round 1 incorporated focus groups and a questionnaire. Fifteen focus groups were conducted with midwives also having the option of contributing through an open-ended questionnaire. During Round 2, 38 items reflecting seven themes were prioritised with a final ranking performed in Round 3. In total, 114 midwives participated in Round 1, 72 in Round 2 and 89 in Round 3. During Round 1, workplace needs identified as being met included: working across all areas of midwifery; ability to work in areas of interest; opportunity to work with low to moderate risk women; supportive colleagues; accessible parking; hospital close to home and friendly work atmosphere. Round 2 items revealed the five top unmet needs as: adequate midwifery staff coverage; access to maintained equipment; competitive pay scales; patient safety issues and opportunities to implement midwifery models. The top ranked needs from Round 3 included: recognising the unpredictable nature of midwifery services; provision of competent medical coverage, and adequate midwifery staff coverage. Demand for maternity services is unpredictable; however, in order to maintain a sustainable maternity workforce, WA midwives' prioritised needs would suggest health management focus upon expanding the availability of midwifery models of care, fostering flexible working conditions and ensuring collaboration between maternity health professionals occurs within clinically safe staffing levels.

A core outcome set for localised prostate cancer effectiveness trials: protocol for a systematic review of the literature and stakeholder involvement through interviews and a Delphi survey.

PubMed

MacLennan, Steven; Bekema, Hendrika J; Williamson, Paula R; Campbell, Marion K; Stewart, Fiona; MacLennan, Sara J; N'Dow, James M O; Lam, Thomas B L

2015-03-04

Prostate cancer is a growing health problem worldwide. The management of localised prostate cancer is controversial. It is unclear which of several surgical, radiotherapeutic, ablative, and surveillance treatments is the most effective. All have cost, process and recovery, and morbidity implications which add to treatment decision-making complexity for patients and healthcare professionals. Evidence from randomised controlled trials (RCTs) is not optimal because of uncertainty as to what constitutes important outcomes. Another issue hampering evidence synthesis is heterogeneity of outcome definition, measurement, and reporting. This project aims to determine which outcomes are the most important to patients and healthcare professionals, and use these findings to recommend a standardised core outcome set for comparative effectiveness trials of treatments for localised prostate cancer, to optimise decision-making. The range of potentially important outcomes and measures will be identified through systematic reviews of the literature and semi-structured interviews with patients. A consultation exercise involving representatives from two key stakeholder groups (patients and healthcare professionals) will ratify the list of outcomes to be entered into a three round Delphi study. The Delphi process will refine and prioritise the list of identified outcomes. A methodological substudy (nested RCT design) will also be undertaken. Participants will be randomised after round one of the Delphi study to one of three feedback groups, based on different feedback strategies, in order to explore the potential impact of feedback strategies on participant responses. This may assist the design of a future core outcome set and Delphi studies. Following the Delphi study, a final consensus meeting attended by representatives from both stakeholder groups will determine the final recommended core outcome set. This study will inform clinical practice and future trials of interventions of localised prostate cancer by standardising a core outcome set which should be considered in comparative effectiveness studies for localised prostate cancer.

Using a web-based survey tool to undertake a Delphi study: application for nurse education research.

PubMed

Gill, Fenella J; Leslie, Gavin D; Grech, Carol; Latour, Jos M

2013-11-01

The Internet is increasingly being used as a data collection medium to access research participants. This paper reports on the experience and value of using web-survey software to conduct an eDelphi study to develop Australian critical care course graduate practice standards. The eDelphi technique used involved the iterative process of administering three rounds of surveys to a national expert panel. The survey was developed online using SurveyMonkey. Panel members responded to statements using one rating scale for round one and two scales for rounds two and three. Text boxes for panel comments were provided. For each round, the SurveyMonkey's email tool was used to distribute an individualized email invitation containing the survey web link. The distribution of panel responses, individual responses and a summary of comments were emailed to panel members. Stacked bar charts representing the distribution of responses were generated using the SurveyMonkey software. Panel response rates remained greater than 85% over all rounds. An online survey provided numerous advantages over traditional survey approaches including high quality data collection, ease and speed of survey administration, direct communication with the panel and rapid collation of feedback allowing data collection to be undertaken in 12 weeks. Only minor challenges were experienced using the technology. Ethical issues, specific to using the Internet to conduct research and external hosting of web-based software, lacked formal guidance. High response rates and an increased level of data quality were achieved in this study using web-survey software and the process was efficient and user-friendly. However, when considering online survey software, it is important to match the research design with the computer capabilities of participants and recognize that ethical review guidelines and processes have not yet kept pace with online research practices. Copyright © 2013 Elsevier Ltd. All rights reserved.

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

MOMENT--Management of Otitis Media with Effusion in Cleft Palate: protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey.

PubMed

Harman, Nicola L; Bruce, Iain A; Callery, Peter; Tierney, Stephanie; Sharif, Mohammad Owaise; O'Brien, Kevin; Williamson, Paula R

2013-03-12

Cleft palate (CP) has an incidence of approximately 1 in 700. Children with CP are also susceptible to otitis media with effusion (OME), with approximately 90% experiencing nontrivial OME. There are several approaches to the management of OME in children with CP. The Management of Otitis Media with Effusion in Children with Cleft Palate (MOMENT) study is a feasibility study that includes the development of a core outcome set for use in future trials of the management of OME in children with CP. The MOMENT study will include a systematic review of the literature to identify a list of outcomes that have previously been reported. This list of outcomes will be used in a Delphi study with cleft clinicians. The Delphi study is anticipated to include three rounds. The first round will ask clinicians to score the outcome list and to add any outcomes they think are relevant. The second round involves presentation of scores according to stakeholder group and the opportunity for participants to rescore outcomes. To ensure that the opinion of parents and children are sought, qualitative interviews will be completed with a purposive sample in parallel. In the final round of the Delphi process, participants will be shown the distribution of scores, for each outcome, for all stakeholder groups separately as well as a summary of the results concerning outcomes from the qualitative interviews with parents. A final consensus meeting will be held with all stakeholders, including parents and children, to review outcomes. A core outcome set represents the minimum that should be measured in a clinical trial for a particular condition. The MOMENT study will aim to identify a core outcome set that can be used in future trials of the management of OME, improving the consistency of research in this clinical area.

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study.

PubMed

Garvin, Lynn A; Simon, Steven R

2017-05-26

Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. The aim of this study was to develop and prioritize measures of digital patient engagement based on patients' use of the US Department of Veterans Affairs (VA)'s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. All 12 experts completed the study's three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian's three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients' use of VA's My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. ©Lynn A Garvin, Steven R Simon. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.05.2017.

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study

PubMed Central

2017-01-01

Background Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. Objective The aim of this study was to develop and prioritize measures of digital patient engagement based on patients’ use of the US Department of Veterans Affairs (VA)’s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. Methods We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. Results All 12 experts completed the study’s three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian’s three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). Conclusions This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients’ use of VA’s My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. PMID:28550008

Consensus-based cross-European recommendations for the identification, measurement and valuation of costs in health economic evaluations: a European Delphi study.

PubMed

van Lier, Lisanne I; Bosmans, Judith E; van Hout, Hein P J; Mokkink, Lidwine B; van den Hout, Wilbert B; de Wit, G Ardine; Dirksen, Carmen D; Nies, Henk L G R; Hertogh, Cees M P M; van der Roest, Henriëtte G

2017-12-19

Differences between country-specific guidelines for economic evaluations complicate the execution of international economic evaluations. The aim of this study was to develop cross-European recommendations for the identification, measurement and valuation of resource use and lost productivity in economic evaluations using a Delphi procedure. A comprehensive literature search was conducted to identify European guidelines on the execution of economic evaluations or costing studies as part of economic evaluations. Guideline recommendations were extracted by two independent reviewers and formed the basis for the first round of the Delphi study, which was conducted among European health economic experts. During three written rounds, consensus (agreement of 67% or higher) was sought on items concerning the identification, measurement and valuation of costs. Recommendations from 18 guidelines were extracted. Consensus among 26 panellists from 17 European countries was reached on 61 of 68 items. The recommendations from the Delphi study are to adopt a societal perspective, to use patient report for measuring resource use and lost productivity, to value both constructs with use of country-specific standardized/unit costs and to use country-specific discounting rates. This study provides consensus-based cross-European recommendations on how to measure and value resource use and lost productivity in economic evaluations. These recommendations are expected to support researchers, healthcare professionals, and policymakers in executing and appraising economic evaluations performed in international contexts.

Terminating Sequential Delphi Survey Data Collection

ERIC Educational Resources Information Center

Kalaian, Sema A.; Kasim, Rafa M.

2012-01-01

The Delphi survey technique is an iterative mail or electronic (e-mail or web-based) survey method used to obtain agreement or consensus among a group of experts in a specific field on a particular issue through a well-designed and systematic multiple sequential rounds of survey administrations. Each of the multiple rounds of the Delphi survey…

Assessment of mastication in healthy children and children with cerebral palsy: a validity and consistency study.

PubMed

Remijn, L; Speyer, R; Groen, B E; Holtus, P C M; van Limbeek, J; Nijhuis-van der Sanden, M W G

2013-05-01

The aim of this study was to develop the Mastication Observation and Evaluation instrument for observing and assessing the chewing ability of children eating solid and lumpy foods. This study describes the process of item definition and item selection and reports the content validity, reproducibility and consistency of the instrument. In the developmental phase, 15 experienced speech therapists assessed item relevance and descriptions over three Delphi rounds. Potential items were selected based on the results from a literature review. At the initial Delphi round, 17 potential items were included. After three Delphi rounds, 14 items that regarded as providing distinctive value in assessment of mastication (consensus >75%) were included in the Mastication Observation and Evaluation instrument. To test item reproducibility and consistency, two experts and five students evaluated video recordings of 20 children (10 children with cerebral palsy aged 29-65 months and 10 healthy children aged 11-42 months) eating bread and a biscuit. Reproducibility was estimated by means of the intraclass correlation coefficient (ICC). With the exception of one item concerning chewing duration, all items showed good to excellent intra-observer agreement (ICC students: 0.73-1.0). With the exception of chewing duration and number of swallows, inter-observer agreement was fair to excellent for all items (ICC experts: 0.68-1.0 and ICC students: 0.42-1.0). Results indicate that this tool is a feasible instrument and could be used in clinical practice after further research is completed on the reliability of the tool. © 2013 Blackwell Publishing Ltd.

A True Delphi Approach: Developing a Tailored Curriculum in Response to Local Agriscience Need

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rubenstein, Eric; Thoron, Andrew; Burleson, Sarah

2012-02-07

The Delphi approach is a structured communication technique, developed as a systematic, interactive forecasting method which relies on a panel of experts. In this specific case experts from Industry, Education and Extension fields addressed needs for educational programs in a traditional agriculturally-based community, environmentally conscious practices in order to restore environmental integrity and multi-disciplinary approach to solve sustainability problems facing the agricultural industry. The experts were divided into two main groups, (A) Secondary and (B) Post-secondary, and answered questionnaires in three rounds: • 1st Round – Participants generated a list of knowledge, skills, and competencies followed • 2nd Round –more » Panelists rated each item • 3rd Round – Panelists were given the opportunity to combine and add additional items As a result, top six items from both groups were not found similar, secondary panelists centralized around employment skills and post-secondary panelists focused on content areas. Implications include a need for content-based curriculum for post-secondary graduates, utilization of true-Delphi technique for future curriculum development research and further examination of students that complete secondary and post-secondary programs in biofuels/sustainable agriculture.« less

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research.

PubMed

Staniszewska, S; Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. One hundred forty-three participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites.

Developing Resident-Sensitive Quality Measures: A Model From Pediatric Emergency Medicine.

PubMed

Schumacher, Daniel J; Holmboe, Eric S; van der Vleuten, Cees; Busari, Jamiu O; Carraccio, Carol

2017-12-05

To begin closing the gap with respect to quality measures available for use among residents, the authors sought to identify and develop resident-sensitive quality measures (RSQMs) for use in the pediatric emergency department (PED) setting. In May 2016, the authors reviewed National Quality Measures Clearinghouse (NQMC) measures to identify resident-sensitive measures. To create additional measures focused on common, acute illnesses (acute asthma exacerbation, bronchiolitis, closed head injury [CHI]) in the PED, the authors used a nominal group technique (NGT) and Delphi process from September to December 2016. To achieve a local focus for developing these measures, all NGT and Delphi participants were from Cincinnati Children's Hospital Medical Center. Delphi participants rated measures developed through the NGT in two areas: importance of measure to quality care and likelihood that measure represents the work of a resident. The review of NQMC measures identified 28 of 183 as being potentially resident-sensitive. The NGT produced 67 measures for asthma, 46 for bronchiolitis, and 48 for CHI. These were used in the first round of the Delphi process. After two rounds, 18 measures for asthma, 21 for bronchiolitis, and 22 for CHI met automatic inclusion criteria. In round three, participants categorized the potential final measures by their top 10 and next 5. This study describes a template for identifying and developing RSQMs that may promote high-quality care delivery during and following training. Next steps should include implementing and seeking validity evidence for the locally developed measures.

Development of a clinical definition for acute respiratory distress syndrome using the Delphi technique.

PubMed

Ferguson, Niall D; Davis, Aileen M; Slutsky, Arthur S; Stewart, Thomas E

2005-06-01

The objective of this study is to describe the implementation of formal consensus techniques in the development of a clinical definition for acute respiratory distress syndrome. A Delphi consensus process was conducted using e-mail. Sixteen panelists who were both researchers and opinion leaders were systematically recruited. The Delphi technique was performed over 4 rounds on the background of an explicit definition framework. Item generation was performed in round 1, item reduction in rounds 2 and 3, and definition evaluation in round 4. Explicit consensus thresholds were used throughout. Of the 16 panelists, 11 actually participated in developing a definition that met a priori consensus rules on the third iteration. New incorporations in the Delphi definition include the use of a standardized oxygenation assessment and the documentation of either a predisposing factor or decreased thoracic compliance. The panelists rated the Delphi definition as acceptable to highly acceptable (median score, 6; range, 5-7 on a 7-point Likert scale). We conclude that it is feasible to consider using formal consensus in the development of future definitions of acute respiratory distress syndrome. Testing of sensibility, reliability, and validity are needed for this preliminary definition; these test results should be incorporated into future iterations of this definition.

Determinants of Social Accountability in Iranian Nursing and Midwifery Schools: A Delphi Study.

PubMed

Salehmoghaddam, Amir Reza; Mazloom, Seyed Reza; Sharafkhani, Mohammad; Gholami, Hassan; Emami Zeydi, Amir; Khorashadizadeh, Fatemeh; Emadzadeh, Ali

2017-04-01

Revising the medical education programs to meet the needs of society has become both a necessity and an important priority due to the considerable increase of population, changing patterns of diseases, and new health priorities. While this necessity has been highlighted in Iran's Fifth Development Plan as well as its National 2025 Vision Plan, the determinants of social accountability have not been explained yet. This study aimed to develop determinants of social accountability in the Iranian Nursing and Midwifery Schools. This classic Delphi study included thirty experts in Nursing and Midwifery Education, Research and Services selected based on purposive sampling and three rounds of Delphi technique and conducted in Nursing and Midwifery School of Mashhad University of Medical Sciences. The primary data were collected using an initial structured questionnaire prepared through extensive review of literature. SPSS 11.5 software was used to analyze the data. The interquartile deviation and percentage of agreement were also used to study the consensus of opinion by experts. Finding obtained from the rounds of Delphi resulted in selecting 69 determinants out of the initial pool of 128 primary determinants of social accountability. The items were selected based on experts' consensus and categorized under three main activities of Nursing and Midwifery School, namely education, research, and service. Social accountability determinants were explained by 69 items for Schools of Nursing and Midwifery in Iran. The proposed determinants can be used by managers and authorities of Nursing and Midwifery School, policy makers, and evaluating institutions associated with them to ensure realizing social accountability goals.

[The application of Delphi method in improving the score table for the hygienic quantifying and classification of hotels].

PubMed

Wang, Zi-yun; Liu, Yong-quan; Wang, Hong-bo; Zheng, Yang; Wu, Qi; Yang, Xia; Wu, Yong-wei; Zhao, Yi-ming

2009-04-01

By means of Delphi method and expert panel consultations, to choose suitable indicators and improve the score table for classifying the hygienic condition of hotels so that it can be widely used at nationwide. A two-round Delphi consultation was held to choose suitable indicators among 78 experts from 18 provinces, municipalities and autonomous regions. The suitable indicators were selected according to the importance recognized by experts. The average length of service in public health of the experts was (21.08 +/- 5.78) years and the average coefficient of experts' authorities C(r) was 0.89 +/- 0.07. The response rates of the two-round consultation were 98.72% (77/78) and 100.00% (77/77). The average feedback time were (8.49 +/- 4.48) d, (5.86 +/- 2.28) d, and the difference between two rounds was statistically significant (t = 4.60, P < 0.01). Kendall's coefficient were 0.26 (chi(2) = 723.63, P < 0.01), 0.32 (chi(2) = 635.65, P < 0.01) and opinions among experts became consistent. The score table for the hygienic quantifying and classification of hotels was composed of three first-class indicators (hygienic management, hygienic facilities and hygienic practices) and 36 second-class indicators. The weight coefficients of the three first-class indicators were 0.35, 0.34, 0.31. Delphi method might be used in a large-scale consultation among experts and be propitious to improve the score table for the hygienic quantifying and classification.

Building a Privacy, Ethics, and Data Access Framework for Real World Computerised Medical Record System Data: A Delphi Study. Contribution of the Primary Health Care Informatics Working Group.

PubMed

Liyanage, H; Liaw, S-T; Di Iorio, C T; Kuziemsky, C; Schreiber, R; Terry, A L; de Lusignan, S

2016-11-10

Privacy, ethics, and data access issues pose significant challenges to the timely delivery of health research. Whilst the fundamental drivers to ensure that data access is ethical and satisfies privacy requirements are similar, they are often dealt with in varying ways by different approval processes. To achieve a consensus across an international panel of health care and informatics professionals on an integrated set of privacy and ethics principles that could accelerate health data access in data-driven health research projects. A three-round consensus development process was used. In round one, we developed a baseline framework for privacy, ethics, and data access based on a review of existing literature in the health, informatics, and policy domains. This was further developed using a two-round Delphi consensus building process involving 20 experts who were members of the International Medical Informatics Association (IMIA) and European Federation of Medical Informatics (EFMI) Primary Health Care Informatics Working Groups. To achieve consensus we required an extended Delphi process. The first round involved feedback on and development of the baseline framework. This consisted of four components: (1) ethical principles, (2) ethical guidance questions, (3) privacy and data access principles, and (4) privacy and data access guidance questions. Round two developed consensus in key areas of the revised framework, allowing the building of a newly, more detailed and descriptive framework. In the final round panel experts expressed their opinions, either as agreements or disagreements, on the ethics and privacy statements of the framework finding some of the previous round disagreements to be surprising in view of established ethical principles. This study develops a framework for an integrated approach to ethics and privacy. Privacy breech risk should not be considered in isolation but instead balanced by potential ethical benefit.

[University studies plan in geriatric medicine developed using a modified Delphi technique].

PubMed

Vilches-Moraga, Arturo; Ariño-Blasco, Sergio; Verdejo-Bravo, Carlos; Mateos-Nozal, Jesús

2015-01-01

The increase in the number of frail elderly people has led to the necessity that all doctors of the future acquire sufficient knowledge on human ageing and the skills in the management of the patient of advanced age, as well as the diseases associated with ageing. Few countries offer geriatric medicine within undergraduate training. The purpose of the present project was to obtain a consensus between European geriatricians on the minimum requirements that medical students must achieve at the end of their university degree course. A modified Delphi process was used. Firstly, experts in education and geriatrics proposed a set of learning objectives based on a review of the literature. Three Delphi rounds were then performed, in which a panel of 49 experts representing 29 countries affiliated to the European Union of Medical Specialists took part. This enabled them to reach a consensus on a definitive study plan. The number of disagreements after the Delphi rounds 1 and 2 were 81 and 53, respectively. Full agreement was reached after the third round. The definitive study plan consisted of detailed objectives grouped under 10 general training objectives. A consensus has been reached between European geriatricians that sets specific training objectives for medical students. Great efforts will be required for the introduction of these requirements, given the variability there is in the quality of teaching in geriatrics. This study plan is a first step in helping to improve geriatrics teaching in faculties of medicine, and will also serve as a basis to make advances in the training in post-graduate geriatrics throughout Europe. Copyright © 2014 SEGG. Published by Elsevier Espana. All rights reserved.

Indicators for evaluating European population health: a Delphi selection process.

PubMed

Freitas, Ângela; Santana, Paula; Oliveira, Mónica D; Almendra, Ricardo; Bana E Costa, João C; Bana E Costa, Carlos A

2018-04-27

Indicators are essential instruments for monitoring and evaluating population health. The selection of a multidimensional set of indicators should not only reflect the scientific evidence on health outcomes and health determinants, but also the views of health experts and stakeholders. The aim of this study is to describe the Delphi selection process designed to promote agreement on indicators considered relevant to evaluate population health at the European regional level. Indicators were selected in a Delphi survey conducted using a web-platform designed to implement and monitor participatory processes. It involved a panel of 51 experts and 30 stakeholders from different areas of knowledge and geographies. In three consecutive rounds the panel indicated their level of agreement or disagreement with indicator's relevance for evaluating population health in Europe. Inferential statistics were applied to draw conclusions on observed level of agreement (Scott's Pi interrater reliability coefficient) and opinion change (McNemar Chi-square test). Multivariate analysis of variance was conducted to check if the field of expertise influenced the panellist responses (Wilk's Lambda test). The panel participated extensively in the study (overall response rate: 80%). Eighty indicators reached group agreement for selection in the areas of: economic and social environment (12); demographic change (5); lifestyle and health behaviours (8); physical environment (6); built environment (12); healthcare services (11) and health outcomes (26). Higher convergence of group opinion towards agreement on the relevance of indicators was seen for lifestyle and health behaviours, healthcare services, and health outcomes. The panellists' field of expertise influenced responses: statistically significant differences were found for economic and social environment (p < 0.05 in round 1 and 2), physical environment (p < 0.01 in round 1) and health outcomes (p < 0.01 in round 3). The high levels of participation observed in this study, by involving experts and stakeholders and ascertaining their views, underpinned the added value of using a transparent Web-Delphi process to promote agreement on what indicators are relevant to appraise population health.

Defining a Research Agenda for Patient-Reported Outcomes in Surgery: A Delphi Survey of Stakeholders

PubMed Central

Pezold, Michael L.; Pusic, Andrea L.; Cohen, Wess A.; Hollenberg, James P.; Butt, Zeeshan; Flum, David R.; Temple, Larissa K.

2016-01-01

Background Identifying timely and important research questions using relevant patient-reported outcomes (PROs) in surgery remains paramount in the current medical climate. The inaugural Patient-Reported Outcomes in Surgery Conference brought together stakeholders in PROs research in surgery, with the aim of creating a research agenda to help determine future directions and advance cross-disciplinary collaboration. Study Design An iterative Web-based interface was used to create a modified Delphi survey. Participation was limited to conference registrants, which included surgeons, PROs researchers, payers, and other stakeholders. In the first round, research items were generated from qualitative review of responses to open-ended prompts. In the second round, items were ranked using a 5-point Likert scale; attendees were also asked to submit any new items. In the final round, the top 30 items and newly submitted items were redistributed for final ranking using a 3-point Likert scale. The top 20 items by mean rating were selected for the research agenda. Results In round one, participants submitted 459 items, which were reduced to 53 distinct items within seven themes of PROs research. A research agenda was formulated after two successive rounds of ranking. The research agenda identified three themes important for future PROs research in surgery: (1) PROs in the decision-making process, (2) integrating PROs into the EHR and, (3) measuring quality in surgery with PROs. Conclusions The PROS Conference research agenda was created using a modified Delphi survey of stakeholders that will help researchers, surgeons, and funders identify crucial areas of future PROs research in surgery. PMID:27437666

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people

PubMed Central

Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Background Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Methods Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Results Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Conclusion Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond. PMID:29155870

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people.

PubMed

Stewart, Derek; Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond.

Delphi based consensus study into planning for chemical incidents.

PubMed

Crawford, I W F; Mackway-Jones, K; Russell, D R; Carley, S D

2004-01-01

To achieve consensus in all phases of chemical incident planning and response. A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required.

Delphi based consensus study into planning for chemical incidents

PubMed Central

Crawford, I; Mackway-Jones, K; Russell, D; Carley, S

2004-01-01

Objective: To achieve consensus in all phases of chemical incident planning and response. Design: A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. Results: A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. Conclusions: The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required. PMID:14734369

Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

PubMed

Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

2014-06-25

The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our study. Based upon this consultation process, a guideline will be developed on instrument selection for outcomes to be included in a COS.

Construct Validation of Content Standards for Teaching

ERIC Educational Resources Information Center

van der Schaaf, Marieke F.; Stokking, Karel M.

2011-01-01

Current international demands to strengthen the teaching profession have led to an increased development and use of professional content standards. The study aims to provide insight in the construct validity of content standards by researching experts' underlying assumptions and preferences when participating in a delphi method. In three rounds 21…

A Delphi study on research priorities for trauma nursing.

PubMed

Bayley, E W; Richmond, T; Noroian, E L; Allen, L R

1994-05-01

To identify and prioritize research questions of importance to trauma patient care and of interest to trauma nurses. A three-round Delphi technique was used to solicit, identify, and prioritize problems for trauma nursing research. In round 1, experienced trauma nurses (N = 208) generated 513 problems, which were analyzed, categorized, and collapsed into 111 items for subsequent rounds. Round 2 participants rated each research question on a 1 to 7 scale on two criteria: impact on patient welfare and value for practicing nurses. Group median scores provided by 166 round 2 respondents and respondents' individual round 2 scores were indicated on the round 3 questionnaire. Subjects rated the questions again on the same criteria and indicated whether nurses, independently or in collaboration with other health professionals, should assume responsibility for that research. Median and mean scores and rank order were determined for each item. Respondents who completed all three rounds (n = 137) had a mean of 8.3 years of trauma experience. Nine research questions ranked within the top 20 on both criteria. The two research questions that ranked highest on both criteria were: What are the most effective nursing interventions in the prevention of pulmonary and circulatory complications in trauma patients? and What are the most effective methods for preventing aspiration in trauma patients during the postoperative phase? The third-ranked question regarding patient welfare was: What psychological and lifestyle changes result from traumatic injury? Regarding value for practicing nurses, What are the most effective educational methods to prepare and maintain proficiency in trauma care providers? ranked third. These research priorities provide impetus and direction for nursing and collaborative investigation in trauma care.

What do we mean by "socialization to the model"? A Delphi study.

PubMed

Roos, Jo; Wearden, Alison

2009-05-01

The term "socialization to the model" is frequently used in the Cognitive Behavioural Therapy (CBT) literature, but it is unclear exactly what constitutes socialization to the model and there is a paucity of research in this area. This study aimed to develop a working definition of "socialization to the model". A three-round electronic Delphi technique was used to generate data and to achieve a consensus agreement amongst a panel of experts (N = 9) in response to two questions pertaining to what constitutes "socialization to the model". All elements generated in response to the primary question at the first round were retained throughout and scored an IQR of

Obstacles to comprehensive dental care in patients with sustained limitations of their decision-making abilities: findings from a Delphi study.

PubMed

Blaizot, Alessandra; Catteau, Céline; Delfosse, Caroline; Hamel, Olivier; Trentesaux, Thomas

2018-06-01

The objective of this study was to explore the therapeutic limitations experienced by a panel of special-care dentists in France when treating patients with sustained limitations of their decision-making abilities. We used a Delphi technique conducted in three rounds from 01 June 2014 to 30 September 2015. A first questionnaire comprising open-ended questions was addressed to 72 panellists. A content analysis of the returned questionnaires served to draft a second questionnaire comprising closed-ended questions; this was sent to the 28 panellists who responded in the first round. A third questionnaire was sent to the 20 panellists who responded in the second round to give them an opportunity to reconsider their response in the context of the second-round response group. Sixteen panellists answered the last round. A large majority agreed on the importance of providing comprehensive care, but they encountered obstacles at two time points: (i) when proposing the care; and (ii) when setting it up. The panel put forward recommendations in two main areas: (i) the training of those involved in oral health decisions; and (ii) dental care management and organization of the care system. The study provided a foundation for building future orientations in health care for patients with limited decision-making abilities. © 2018 Eur J Oral Sci.

Effective self-management strategies for bipolar disorder: A community-engaged Delphi Consensus Consultation study.

PubMed

Michalak, Erin E; Suto, Melinda J; Barnes, Steven J; Hou, Sharon; Lapsley, Sara; Scott, Mike W; Murray, Greg; Austin, Jehannine; Elliott, Nusha Balram; Berk, Lesley; Crest Bd

2016-12-01

Self-management represents an important complement to psychosocial treatments for bipolar disorder (BD), but research is limited. Specifically, little is known about self-management approaches for elevated mood states; this study investigated self-management strategies for: (1) maintaining balance in mood, and (2) stopping progression into hypomania/mania. To identify the common components of BD self-management, Delphi Consensus Consultation methods were combined with a Community-Based Participatory Research (CBPR) approach across five study phases: (1) Qualitative dataset content analysis; (2) Academic/grey literature reviews; (3) Content analysis; (4) Two Delphi rounds (rating strategies on a 5-point Likert scale, Very Unhelpful-Very Helpful), and; (5) Quantitative analysis and interpretation. Participants were people with BD and healthcare providers. Phases 1 and 2 identified 262 and 3940 candidate strategies, respectively; 3709 were discarded as duplicates/unintelligible. The remaining 493 were assessed via Delphi methods in Phase 4: 101 people with BD and 52 healthcare providers participated in Round 1; 83 of the BD panel (82%) and 43 of the healthcare provider panel (83%) participated in Round 2-exploratory factor analysis (EFA) was conducted on Round 2 results. EFA was underpowered and sample was not ethnically diverse, limiting generalizability. High concordance was observed in ratings of strategy effectiveness between the two panels. Future research could usefully investigate the provisional discovery here of underlying factors which link individual strategies. For example, 'maintaining hope' underpinned strategies for maintaining balance, and 'decreasing use of stimulants' underpinned strategies to interrupt hypo/manic ascent. There is merit in combining CBPR and Delphi methods. Copyright © 2016 Elsevier B.V. All rights reserved.

The development of a consensus-based nutritional pathway for infants with CHD before surgery using a modified Delphi process.

PubMed

Marino, Luise V; Johnson, Mark J; Hall, Nigel J; Davies, Natalie J; Kidd, Catherine S; Daniels, M Lowri; Robinson, Julia E; Richens, Trevor; Bharucha, Tara; Darlington, Anne-Sophie E

2018-04-29

IntroductionDespite improvements in the medical and surgical management of infants with CHD, growth failure before surgery in many infants continues to be a significant concern. A nutritional pathway was developed, the aim of which was to provide a structured approach to nutritional care for infants with CHD awaiting surgery.Materials and methodsThe modified Delphi process was development of a nutritional pathway; initial stakeholder meeting to finalise draft guidelines and develop questions; round 1 anonymous online survey; round 2 online survey; regional cardiac conference and pathway revision; and final expert meeting and pathway finalisation. Paediatric Dietitians from all 11 of the paediatric cardiology surgical centres in the United Kingdom contributed to the guideline development. In all, 33% of participants had 9 or more years of experience working with infants with CHD. By the end of rounds 1 and 2, 76 and 96% of participants, respectively, were in agreement with the statements. Three statements where consensus was not achieved by the end of round 2 were discussed and agreed at the final expert group meeting. Nutrition guidelines were developed for infants with CHD awaiting surgery, using a modified Delphi process, incorporating the best available evidence and expert opinion with regard to nutritional support in this group.

Return to play after hamstring injuries in football (soccer): a worldwide Delphi procedure regarding definition, medical criteria and decision-making.

PubMed

van der Horst, Nick; Backx, Fjg; Goedhart, Edwin A; Huisstede, Bionka Ma

2017-11-01

There are three major questions about return to play (RTP) after hamstring injuries: How should RTP be defined? Which medical criteria should support the RTP decision? And who should make the RTP decision? The study aimed to provide a clear RTP definition and medical criteria for RTP and to clarify RTP consultation and responsibilities after hamstring injury. The study used the Delphi procedure. The results of a systematic review were used as a starting point for the Delphi procedure. Fifty-eight experts in the field of hamstring injury management selected by 28 FIFA Medical Centres of Excellence worldwide participated. Each Delphi round consisted of a questionnaire, an analysis and an anonymised feedback report. After four Delphi rounds, with more than 83% response for each round, consensus was achieved that RTP should be defined as 'the moment a player has received criteria-based medical clearance and is mentally ready for full availability for match selection and/or full training'. The experts reached consensus on the following criteria to support the RTP decision: medical staff clearance, absence of pain on palpation, absence of pain during strength and flexibility testing, absence of pain during/after functional testing, similar hamstring flexibility, performance on field testing, and psychological readiness. It was also agreed that RTP decisions should be based on shared decision-making, primarily via consultation with the athlete, sports physician, physiotherapist, fitness trainer and team coach. The consensus regarding aspects of RTP should provide clarity and facilitate the assessment of when RTP is appropriate after hamstring injury, so as to avoid or reduce the risk of injury recurrence because of a premature RTP. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Core outcome domains for clinical trials in non-specific low back pain.

PubMed

Chiarotto, Alessandro; Deyo, Richard A; Terwee, Caroline B; Boers, Maarten; Buchbinder, Rachelle; Corbin, Terry P; Costa, Leonardo O P; Foster, Nadine E; Grotle, Margreth; Koes, Bart W; Kovacs, Francisco M; Lin, Chung-Wei Christine; Maher, Chris G; Pearson, Adam M; Peul, Wilco C; Schoene, Mark L; Turk, Dennis C; van Tulder, Maurits W; Ostelo, Raymond W

2015-06-01

Inconsistent reporting of outcomes in clinical trials of patients with non-specific low back pain (NSLBP) hinders comparison of findings and the reliability of systematic reviews. A core outcome set (COS) can address this issue as it defines a minimum set of outcomes that should be reported in all clinical trials. In 1998, Deyo et al. recommended a standardized set of outcomes for LBP clinical research. The aim of this study was to update these recommendations by determining which outcome domains should be included in a COS for clinical trials in NSLBP. An International Steering Committee established the methodology to develop this COS. The OMERACT Filter 2.0 framework was used to draw a list of potential core domains that were presented in a Delphi study. Researchers, care providers and patients were invited to participate in three Delphi rounds and were asked to judge which domains were core. A priori criteria for consensus were established before each round and were analysed together with arguments provided by panellists on importance, overlap, aggregation and/or addition of potential core domains. The Steering Committee discussed the final results and made final decisions. A set of 280 experts was invited to participate in the Delphi; response rates in the three rounds were 52, 50 and 45%. Of 41 potential core domains presented in the first round, 13 had sufficient support to be presented for rating in the third round. Overall consensus was reached for the inclusion of three domains in this COS: 'physical functioning', 'pain intensity' and 'health-related quality of life'. Consensus on 'physical functioning' and 'pain intensity' was consistent across all stakeholders, 'health-related quality of life' was not supported by the patients, and all the other domains were not supported by two or more groups of stakeholders. Weighting all possible argumentations, the Steering Committee decided to include in the COS the three domains that reached overall consensus and the domain 'number of deaths'. The following outcome domains were included in this updated COS: 'physical functioning', 'pain intensity', 'health-related quality of life' and 'number of deaths'. The next step for the development of this COS will be to determine which measurement instruments best measure these domains.

Benchmarks for effective primary care-based nursing services for adults with depression: a Delphi study.

PubMed

McIlrath, Carole; Keeney, Sinead; McKenna, Hugh; McLaughlin, Derek

2010-02-01

This paper is a report of a study conducted to identify and gain consensus on appropriate benchmarks for effective primary care-based nursing services for adults with depression. Worldwide evidence suggests that between 5% and 16% of the population have a diagnosis of depression. Most of their care and treatment takes place in primary care. In recent years, primary care nurses, including community mental health nurses, have become more involved in the identification and management of patients with depression; however, there are no appropriate benchmarks to guide, develop and support their practice. In 2006, a three-round electronic Delphi survey was completed by a United Kingdom multi-professional expert panel (n = 67). Round 1 generated 1216 statements relating to structures (such as training and protocols), processes (such as access and screening) and outcomes (such as patient satisfaction and treatments). Content analysis was used to collapse statements into 140 benchmarks. Seventy-three benchmarks achieved consensus during subsequent rounds. Of these, 45 (61%) were related to structures, 18 (25%) to processes and 10 (14%) to outcomes. Multi-professional primary care staff have similar views about the appropriate benchmarks for care of adults with depression. These benchmarks could serve as a foundation for depression improvement initiatives in primary care and ongoing research into depression management by nurses.

The competencies of Registered Nurses working in care homes: a modified Delphi study.

PubMed

Stanyon, Miriam Ruth; Goldberg, Sarah Elizabeth; Astle, Anita; Griffiths, Amanda; Gordon, Adam Lee

2017-07-01

registered Nurses (RNs) working in UK care homes receive most of their training in acute hospitals. At present the role of care home nursing is underdeveloped and it is seen as a low status career. We describe here research to define core competencies for RNs working in UK care homes. a two-stage process was adopted. A systematic literature review and focus groups with stakeholders provided an initial list of competencies. The competency list was modified over three rounds of a Delphi process with a multi-disciplinary expert panel of 28 members. twenty-two competencies entered the consensus process, all competencies were amended and six split. Thirty-one competencies were scored in round two, eight were agreed as essential, one competency was split into two. Twenty-four competencies were submitted for scoring in round three. In total, 22 competencies were agreed as essential for RNs working in care homes. A further 10 competencies did not reach consensus. the output of this study is an expert-consensus list of competencies for RNs working in care homes. This would be a firm basis on which to build a curriculum for this staff group. © The Author 2017. Published by Oxford University Press on behalf of the British Geriatrics Society.All rights reserved. For permissions, please email: journals.permissions@oup.com

Expert agreed standards for the selection and development of cancer support group leaders: an online reactive Delphi study.

PubMed

Pomery, Amanda; Schofield, Penelope; Xhilaga, Miranda; Gough, Karla

2018-01-01

The aim of this study was to develop pragmatic, consensus-based minimum standards for the role of a cancer support group leader. Secondly, to produce a structured interview designed to assess the knowledge, skills and attributes of the individuals who seek to undertake the role. An expert panel of 73 academics, health professionals, cancer agency workers and cancer support group leaders were invited to participate in a reactive online Delphi study involving three online questionnaire rounds. Participants determined and ranked requisite knowledge, skills and attributes (KSA) for cancer support group leaders, differentiated ideal from required KSA to establish minimum standards, and agreed on a method of rating KSA to determine suitability and readiness. Forty-five experts (62%) participated in round 1, 36 (49%) in round 2 and 23 (31%) in round 3. In round 1, experts confirmed 59 KSA identified via a systemic review and identified a further 55 KSA. In round 2, using agreement ≥75%, 52 KSA emerged as minimum standards for support group leaders. In round 3, consensus was reached on almost every aspect of the content and structure of a structured interview. Panel member comments guided refinement of wording, re-ordering of questions and improvement of probing questions. Alongside a novel structured interview, the first consensus-based minimum standards have been developed for cancer support group leaders, incorporating expert consensus and pragmatic considerations. Pilot and field testing will be used to appraise aspects of clinical utility and establish a rational scoring model for the structured interview.

Core neurological examination items for neurology clerks: A modified Delphi study with a grass-roots approach

PubMed Central

Liu, Chi-Hung; Hsu, Li-Ling; Hsiao, Cheng-Ting; Hsieh, Suh-Ing; Chang, Chun-Wei; Huang, Elaine Shinwei; Chang, Yeu-Jhy

2018-01-01

Background With the evolution of treatments for neurological diseases, the contents of core neurological examinations (NEs) for medical students may need to be modified. We aimed to establish a consensus on the core NE items for neurology clerks and compare viewpoints between different groups of panelists. Methods First, a pilot group proposed the core contents of NEs for neurology clerks. The proposed core NE items were then subject to a modified web-based Delphi process using the online software “SurveyMonkey”. A total of 30 panelists from different backgrounds (tutors or learners, neurologists or non-neurologists, community hospitals or medical centers, and different academic positions) participated in the modified Delphi process. Each panelist was asked to agree or disagree on the inclusion of each item using a 9-point Likert scale and was encouraged to provide feedback. We also compared viewpoints between different groups of panelists using the Mann-Whitney U test. Results Eighty-three items were used for the first round of the Delphi process. Of them, 18 without consensus of being a core NE item for the neurology clerks in the first round and another 14 items suggested by the panelists were further discussed in the second round. Finally, 75 items with different grades were included in the recommended NE items for neurology clerks. Conclusions Our findings provide a reference regarding the core NE items for milestone development for neurology clerkships. We hope that prioritizing the NE items in this order can help medical students to learn NE more efficiently. PMID:29771997

Nutrition in primary health care: using a Delphi process to design new interdisciplinary services.

PubMed

Brauer, Paula; Dietrich, Linda; Davidson, Bridget

2006-01-01

A modified Delphi process was used to identify key features of interdisciplinary nutrition services, including provider roles and responsibilities for Ontario Family Health Networks (FHNs), a family physician-based type of primary care. Twenty-three representatives from interested professional organizations, including three FHN demonstration sites, completed a modified Delphi process. Participants reviewed evidence from a systematic literature review, a patient survey, a costing analysis, and key informant interview results before undertaking the Delphi process. Statements describing various options for services were developed at an in-person meeting, which was followed by two rounds of e-mail questionnaires. Teleconference discussions were held between rounds. An interdisciplinary model with differing and complementary roles for health care providers emerged from the process. Additional key features addressing screening for nutrition problems, health promotion and disease prevention, team collaboration, planning and evaluation, administrative support, access to care, and medical directives/delegated acts were identified. Under the proposed model, the registered dietitian is the team member responsible for managing all aspects of nutrition services, from needs assessment to program delivery, as well as for supporting all providers' nutrition services. The proposed interdisciplinary nutrition services model merits evaluation of cost, effectiveness, applicability, and sustainability in team-based primary care service settings.

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

Identifying nurse and health visitor priorities in a PCT using the Delphi technique.

PubMed

Brooks, Nicky; Barrett, Anna

2003-08-01

A three-stage Delphi investigation was undertaken over a 4-month period in a primary care trust to identify the perceived clinical needs of nurses. Practice nurses, district nurses, health visitors and community hospital nurses all participated. In round 1, there were 28 replies from these groups of nurses, in round 2 there were 31, and in round 3 there were 25 replies. In round 1, 77 issues (excluding duplications) were identified. These were separated into three themes according to the most appropriate method for addressing the issue: education (29 issues), research (16 issues) and management (32). In round 2, the issues were redistributed in the three areas and staff were asked to choose the ten most important issues from education, research and management. Finally, in round 3 the ten issues in education, research and management were prioritized in terms of the "most pressing". The most pressing education need was recognizing accountability; the most pressing research need was caseload/dependency scoring--matching staff levels to workload, and the most pressing management need was risk management, e.g. staff safety. The results have identified locally that there is a gap between the modernization agenda and what nursing staff consider to be the issues that need addressing locally. If measures are not put in place to address these local issues, there is a danger that nurses will not take a full and active role in the modernization of the NHS.

Engineering's Grand Challenges: Priorities and Integration Recommendations for Technology Education Curriculum Development

ERIC Educational Resources Information Center

Buelin, Jennifer; Clark, Aaron C.; Ernst, Jeremy V.

2016-01-01

In this study, the 14 Grand Challenges for Engineering in the 21st Century identified by the National Academy of Engineering were examined by a panel of experts in an effort to identify prospective curricular integration opportunities in the field of technology and engineering education. The study utilized a three-round modified Delphi methodology…

NETS1HD: study protocol for development of a core outcome set for use in determining the overall success of Hirschsprung's disease treatment.

PubMed

Allin, Benjamin; Bradnock, Timothy; Kenny, Simon; Walker, Gregor; Knight, Marian

2016-12-07

Use of core outcome sets in research has been proposed as a method for countering the problems caused by heterogeneity of outcome measure reporting. Heterogeneity of outcome measure reporting occurs in Hirschsprung's disease (HD) research and is limiting the development of a robust evidence base to support clinical practice. Candidate outcome measures have been identified through a systematic review. These outcome measures will form the starting point for a three-phase online Delphi process to be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel; panel 2 is a non-neonatal panel; and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1 to 9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's HD. In round 2, experts will be presented with the same list of outcome measures and graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure, taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels, which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. Results of the Delphi process will be discussed, and outcomes will be re-scored. Outcome measures where >70% of participants at the meeting scored it 7-9 and <15% scored it 1-3 will form the core outcome set. Development of a core outcome set will help to reduce heterogeneity of outcome measure reporting in HD. This will increase the quality of research taking place and ultimately improve care provided to infants with HD.

Diagnosis and Management of Iliac Artery Endofibrosis: Results of a Delphi Consensus Study.

PubMed

2016-07-01

Iliac endofibrosis is a rare condition that may result in a reduction of blood flow to the lower extremity in young, otherwise healthy individuals. The data to inform everyday clinical management are weak and therefore a Delphi consensus methodology was used to explore areas of consensus and disagreement concerning the diagnosis and management of patients with suspected iliac endofibrosis. A three-round Delphi questionnaire approach was used among vascular surgeons, sports physicians, sports scientists, radiologists, and clinical vascular scientists with experience of treating this condition to explore diagnosis and clinical management issues for patients with suspected iliac artery endofibrosis. Analysis is based on 18 responses to round 2 and 14 responses to round 3, with agreement reported when 70% of respondents were in agreement. Initially there was agreement on the typical symptoms at presentation and the need for an exercise test in the diagnosis. Round 3 clarified that duplex ultrasound was a useful tool in the diagnosis of endofibrosis. There was consensus on the most appropriate type of surgery (endarterectomy and vein patch) and that endovascular interventions were inadvisable. The final round helped to inform aspects of the natural history and post-operative surveillance. Progression of the disease was likely with continued exercise but cessation may prevent progression. Surveillance after surgery is generally recommended yearly with at least a clinical assessment. There is broad agreement about the presenting symptoms and the investigations required to confirm (or exclude) the diagnosis of iliac endofibrosis. There was consensus on the surgical approach to repair. Disagreement existed about the specific diagnostic criteria that should be applied during non-invasive testing and about post-operative care and resumption of exercise. Copyright © 2016 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Information needs of patients with whiplash associated disorders: A Delphi study of patient beliefs.

PubMed

Sterling, Joanna; Maujean, Annick; Sterling, Michele

2018-02-01

Whiplash associated disorders (WAD) result in significant personal and economic costs. Patient education and reassurance are recommended treatments for acute WAD but the information needs of patients have not been investigated. To determine what information whiplash-injured patients believe is important to help recovery in the acute stage of injury. A Delphi design survey series with three rounds. Thirty-three participants who had sustained a whiplash injury within the last three years were invited to participate. Participants were asked to provide five statements, in response to an open-ended question, regarding what they believed was the most important information to provide to patients following a whiplash injury. Nineteen patients responded and 85 statements were collected and reviewed independently by two of the authors to remove duplicates. The importance of the remaining items was rated by the participants in the second survey round. Items rated by >50% of participants as important were included in the third survey round. To be deemed key information, >80% of participants had to rate an item as important in this final round. Eighteen items met the criteria for key information. These points addressed four areas: assessment and treatment, recovery and symptoms, patient attitudes during treatment and relationships with health practitioners. The key information points endorsed by patients in this study may provide useful information to constitute a basis for reassurance and education provided to patients with WAD. The results also suggest that improved relationships between patients with whiplash and health practitioners is required. Copyright © 2017 Elsevier Ltd. All rights reserved.

Towards a definition of neurodisability: a Delphi survey.

PubMed

Morris, Christopher; Janssens, Astrid; Tomlinson, Richard; Williams, Jane; Logan, Stuart

2013-12-01

The aim of this study was to develop, systematically, a consensus-based definition for 'neurodisability' that is meaningful to health professionals and parents of children with neurological conditions. A multidisciplinary group of health professionals was recruited through child development teams and professional societies in the UK; several parents of children with neurological conditions worked with the research team. Professionals participated in three rounds of a Delphi survey. Participants rated their agreement with a proposed definition in each round, and feedback was used to refine the definition. Finally, a perspective was sought from international experts. Responses to the three rounds were as follows: round 1,245 out of 290 (84.4%); round 2,242 out of 300 (80.6%); and round 3,237 out of 297 (79.7%). Agreement with the proposed definition was extremely high in every round (89.0%, 90.1%, and 93.6% respectively). The final version of the definition was widely endorsed among professionals, parents, and a small number of international colleagues. The final definition is as follows: 'Neurodisability describes a group of congenital or acquired long-term conditions that are attributed to impairment of the brain and/or neuromuscular system and create functional limitations. A specific diagnosis may not be identified. Conditions may vary over time, occur alone or in combination, and include a broad range of severity and complexity. The impact may include difficulties with movement, cognition, hearing and vision, communication, emotion, and behaviour'. An agreed definition of neurodisability will be useful for conducting research or clinical evaluations with people affected by neurological problems. © 2013 Crown copyright. Developmental Medicine and Child Neurology © 2013 Mac Keith Press. This article is published with the permission of the Controller of HMSO and the Queen's Printer for Scotland.

Identification of Workplace Skills and Competencies Essential for Marketing Occupations.

ERIC Educational Resources Information Center

Ruhland, Sheila K.

A study examined the types of academic skills and workplace competencies that will be needed by persons employed in marketing occupations in the future. Three rounds of a Delphi questionnaire were mailed to 23 persons who were recommended by secondary and postsecondary marketing teachers in Missouri as having expertise in marketing occupations. In…

European undergraduate curriculum in geriatric medicine developed using an international modified Delphi technique

PubMed Central

Masud, Tahir; Blundell, Adrian; Gordon, Adam Lee; Mulpeter, Ken; Roller, Regina; Singler, Katrin; Goeldlin, Adrian; Stuck, Andreas

2014-01-01

Introduction: the rise in the number of older, frail adults necessitates that future doctors are adequately trained in the skills of geriatric medicine. Few countries have dedicated curricula in geriatric medicine at the undergraduate level. The aim of this project was to develop a consensus among geriatricians on a curriculum with the minimal requirements that a medical student should achieve by the end of medical school. Methods: a modified Delphi process was used. First, educational experts and geriatricians proposed a set of learning objectives based on a literature review. Second, three Delphi rounds involving a panel with 49 experts representing 29 countries affiliated to the European Union of Medical Specialists (UEMS) was used to gain consensus for a final curriculum. Results: the number of disagreements following Delphi Rounds 1 and 2 were 81 and 53, respectively. Complete agreement was reached following the third round. The final curriculum consisted of detailed objectives grouped under 10 overarching learning outcomes. Discussion: a consensus on the minimum requirements of geriatric learning objectives for medical students has been agreed by European geriatricians. Major efforts will be needed to implement these requirements, given the large variation in the quality of geriatric teaching in medical schools. This curriculum is a first step to help improve teaching of geriatrics in medical schools, and will also serve as a basis for advancing postgraduate training in geriatrics across Europe. PMID:24603283

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

Validation of a clinical leadership qualities framework for managers in aged care: a Delphi study.

PubMed

Jeon, Yun-Hee; Conway, Jane; Chenoweth, Lynn; Weise, Janelle; Thomas, Tamsin Ht; Williams, Anna

2015-04-01

To establish validity of a clinical leadership framework for aged care middle managers (The Aged care Clinical Leadership Qualities Framework). Middle managers in aged care have responsibility not only for organisational governance also and operational management but also quality service delivery. There is a need to better define clinical leadership abilities in aged care middle managers, in order to optimise their positional authority to lead others to achieve quality outcomes. A Delphi method. Sixty-nine experts in aged care were recruited, representing rural, remote and metropolitan community and residential aged care settings. Panellists were asked to rate the proposed framework in terms of the relevance and importance of each leadership quality using four-point Likert scales, and to provide comments. Three rounds of consultation were conducted. The number and corresponding percentage of the relevance and importance rating for each quality was calculated for each consultation round, as well as mean scores. Consensus was determined to be reached when a percentage score reached 70% or greater. Twenty-three panellists completed all three rounds of consultation. Following the three rounds of consultation, the acceptability and face validity of the framework was confirmed. The study confirmed the framework as useful in identifying leadership requirements for middle managers in Australian aged care settings. The framework is the first validated framework of clinical leadership attributes for middle managers in aged care and offers an initial step forward in clarifying the aged care middle manager role. The framework provides clarity in the breadth of role expectations for the middle managers and can be used to inform an aged care specific leadership program development, individuals' and organisations' performance and development processes; and policy and guidelines about the types of activities required of middle managers in aged care. © 2014 John Wiley & Sons Ltd.

Developing a tool for nurses to assess risk of infection in pediatric oncology patients in China: a modified Delphi study.

PubMed

Zhou, Yufeng; Cui, Yan; Wang, Hong; Wang, Fang; Lu, Chao; Shen, Yan

2016-09-01

Infections are identified as the most common preventable cause of death in pediatric oncology patients. Assessing and stratifying risk of infections are essential to prevent infection in these patients. To date, no tool can fulfill this demand in China. This study aimed to develop a nursing work-based and Chinese-specific tool for pediatric nurses to assess risk of infection in oncology patients. This research was a modified Delphi study. Based on a literature review, a 37-item questionnaire rating on a 0-5 scale was developed. Twenty-four experts from 8 hospitals in 6 provinces of China were consulted for three rounds. Consensus for each item in the first round was defined as: the rating mean was>3 and the coefficient of variation (CV) was<0.5. Consensus for each item in the second round was defined as CV<0.3. Consensus among experts was defined as: P value of Kendall's coefficient of concordance ( W )<0.05. After three rounds of consultation, a two-part tool was developed: the Immune Status Scale (ISS) and the Checklist of Risk Factors of Infection (CRFI). There were 5 items in the ISS and 14 in the CRFI. Based on the ISS score, nurses could stratify children into the low-risk and high-risk groups. For high-risk children, nurses should screen risk factors of infection every day by the CRFI, and twice weekly for low-risk children. Further study is needed to verify this tool's efficacy. © 2016 the Journal of Biomedical Research. All rights reserved.

Quality indicators for in-hospital geriatric co-management programmes: a systematic literature review and international Delphi study

PubMed Central

Van Grootven, Bastiaan; McNicoll, Lynn; Mendelson, Daniel A; Friedman, Susan M; Fagard, Katleen; Milisen, Koen; Flamaing, Johan; Deschodt, Mieke

2018-01-01

Objective To find consensus on appropriate and feasible structure, process and outcome indicators for the evaluation of in-hospital geriatric co-management programmes. Design An international two-round Delphi study based on a systematic literature review (searching databases, reference lists, prospective citations and trial registers). Setting Western Europe and the USA. Participants Thirty-three people with at least 2 years of clinical experience in geriatric co-management were recruited. Twenty-eight experts (16 from the USA and 12 from Europe) participated in both Delphi rounds (85% response rate). Measures Participants rated the indicators on a nine-point scale for their (1) appropriateness and (2) feasibility to use the indicator for the evaluation of geriatric co-management programmes. Indicators were considered appropriate and feasible based on a median score of seven or higher. Consensus was based on the level of agreement using the RAND/UCLA Appropriateness Method. Results In the first round containing 37 indicators, there was consensus on 14 indicators. In the second round containing 44 indicators, there was consensus on 31 indicators (structure=8, process=7, outcome=16). Experts indicated that co-management should start within 24 hours of hospital admission using defined criteria for selecting appropriate patients. Programmes should focus on the prevention and management of geriatric syndromes and complications. Key areas for comprehensive geriatric assessment included cognition/delirium, functionality/mobility, falls, pain, medication and pressure ulcers. Key outcomes for evaluating the programme included length of stay, time to surgery and the incidence of complications. Conclusion The indicators can be used to assess the performance of geriatric co-management programmes and identify areas for improvement. Furthermore, the indicators can be used to monitor the implementation and effect of these programmes. PMID:29549210

Identifying Psychological Contract Breaches to Guide Improvements in Faculty Recruitment, Retention, and Development

PubMed Central

Desselle, Shane P.; Draugalis, JoLaine R.; Spies, Alan R.; Davis, Tamra S.; Bolino, Mark

2012-01-01

Objective. To identify pharmacy faculty members’ perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. Methods. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Results. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. Conclusion. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development. PMID:22919084

Identifying psychological contract breaches to guide improvements in faculty recruitment, retention, and development.

PubMed

Peirce, Gretchen L; Desselle, Shane P; Draugalis, JoLaine R; Spies, Alan R; Davis, Tamra S; Bolino, Mark

2012-08-10

To identify pharmacy faculty members' perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development.

An Instrument to Measure Maturity of Integrated Care: A First Validation Study

PubMed Central

2018-01-01

Introduction: Lessons captured from interviews with 12 European regions are represented in a new instrument, the B3-Maturity Model (B3-MM). B3-MM aims to assess maturity along 12 dimensions reflecting the various aspects that need to be managed in order to deliver integrated care. The objective of the study was to test the content validity of B3-MM as part of SCIROCCO (Scaling Integrated Care into Context), a European Union funded project. Methods: A literature review was conducted to compare B3-MM’s 12 dimensions and their measurement scales with existing measures and instruments that focus on assessing the development of integrated care. Subsequently, a three-round survey conducted through a Delphi study with international experts in the field of integrated care was performed to test the relevance of: 1) the dimensions, 2) the maturity indicators and 3) the assessment scale used in B3-MM. Results: The 11 articles included in the literature review confirmed all the dimensions described in the original version of B3-MM. The Delphi study rounds resulted in various phrasing amendments of indicators and assessment scale. Full agreement among the experts on the relevance of the 12 B3-MM dimensions, their indicators, and assessment scale was reached after the third Delphi round. Conclusion and discussion: The B3-MM dimensions, maturity indicators and assessment scale showed satisfactory content validity. While the B3-MM is a unique instrument based on existing knowledge and experiences of regions in integrated care, further testing is needed to explore other measurement properties of B3-MM. PMID:29588644

Challenges faced with the implementation of Web-Based Data Query Systems for population health: development of a questionnaire based on expert consensus.

PubMed

Ahuja, Manik; Aseltine, Robert; Warren, Nicholas; Reisine, Susan; Williams, Pam Holtzclaw; Cislo, Andy

2018-01-01

State health agencies (SHA) and local health agencies (LHA) face several challenges with the dissemination of local health data using Web-Based Data Query Systems (WDQS). To help guide future research, this study aimed to utilize expert consensus to identify the most relevant items that contribute to these challenges. A total of 17 researchers and public health professionals agreed to participate in a three-round Delphi process. In round 1, four topics were represented on a 42-item questionnaire using a 5-point Likert scale, along with free-text responses. Free-text responses were analyzed leading to a series of items for a second Delphi round. Participants were given an opportunity to revise results in round 3 for items that did not meet consensus in round 1 or round 2. Consensus on expert opinions was defined at interquartile range (IQR) ≤ 1. The experts reached consensus on a total of 21 (50%) of the 42 items presented in the initial questionnaire. Eleven of the 15 (73%) of the items extracted from the free-text responses met consensus. Items in consensus from this pilot study were used to develop an instrument for a broader survey across Behavioral Risk Factor Surveillance System (BRFSS) coordinators across all 50 US states. Experts confirmed that software development costs, inadequate human resources, data sharing gaps, a lack of political support, and poor data quality contribute significantly to challenges in their data implementation. The findings from this pilot study inform us of items of public health significance that will help guide future research.

Development and pilot testing of an informed consent video for patients with limb trauma prior to debridement surgery using a modified Delphi technique.

PubMed

Lin, Yen-Ko; Chen, Chao-Wen; Lee, Wei-Che; Lin, Tsung-Ying; Kuo, Liang-Chi; Lin, Chia-Ju; Shi, Leiyu; Tien, Yin-Chun; Cheng, Yuan-Chia

2017-11-29

Ensuring adequate informed consent for surgery in a trauma setting is challenging. We developed and pilot tested an educational video containing information regarding the informed consent process for surgery in trauma patients and a knowledge measure instrument and evaluated whether the audiovisual presentation improved the patients' knowledge regarding their procedure and aftercare and their satisfaction with the informed consent process. A modified Delphi technique in which a panel of experts participated in successive rounds of shared scoring of items to forecast outcomes was applied to reach a consensus among the experts. The resulting consensus was used to develop the video content and questions for measuring the understanding of the informed consent for debridement surgery in limb trauma patients. The expert panel included experienced patients. The participants in this pilot study were enrolled as a convenience sample of adult trauma patients scheduled to receive surgery. The modified Delphi technique comprised three rounds over a 4-month period. The items given higher scores by the experts in several categories were chosen for the subsequent rounds until consensus was reached. The experts reached a consensus on each item after the three-round process. The final knowledge measure comprising 10 questions was developed and validated. Thirty eligible trauma patients presenting to the Emergency Department (ED) were approached and completed the questionnaires in this pilot study. The participants exhibited significantly higher mean knowledge and satisfaction scores after watching the educational video than before watching the video. Our process is promising for developing procedure-specific informed consent and audiovisual aids in medical and surgical specialties. The educational video was developed using a scientific method that integrated the opinions of different stakeholders, particularly patients. This video is a useful tool for improving the knowledge and satisfaction of trauma patients in the ED. The modified Delphi technique is an effective method for collecting experts' opinions and reaching a consensus on the content of educational materials for informed consent. Institutions should prioritize patient-centered health care and develop a structured informed consent process to improve the quality of care. The ClinicalTrials.gov Identifier is NCT01338480 . The date of registration was April 18, 2011 (retrospectively registered).

Linking NHS data for pediatric pharmacovigilance: Results of a Delphi survey.

PubMed

Hopf, Y M; Francis, J; Helms, P J; Haughney, J; Bond, C

2016-01-01

Adverse drug events are a major cause of patient safety incidents. Current systems of pharmacovigilance under-report adverse drug reactions (ADRs), especially in children, leading to delays in their identification. This is of particular concern, as children especially have an increased vulnerability to ADRs. The objective was to seek consensus among healthcare professionals (HCPs) about barriers and facilitators to the linkage of routinely collected health data for pediatric pharmacovigilance in Scotland. A Delphi survey was conducted with a random sample of HCPs including nurses, pharmacists and doctors, working in primary or secondary care, in Scotland. Participants were identified from sampling frames of the target professionals such as an NHS workforce list for general practitioners and recruited by postal invitation. A total of 819 HCPs were invited to take part. Those agreeing to participate were given the option of completing the questionnaires online or as hard copy. Reminders were sent twice at a fortnightly interval. Questions content included description of professional role as well as testing for the willingness to support the proposed project and was informed by the Theoretical Domains Framework of Behavior Change (TDF) and earlier qualitative work. Three Delphi rounds were administered, including a first round for item generation. 121 of those invited agreed to take part (15%). The first round of the Delphi study included 21 open questions and generated over a 1000 individual statements from 61 participants that returned the questionnaires (50.4%). These were rationalized to 149 items for the second round in which participants rated their views on the importance (or not) of each item on a 9-point Likert scale (strongly disagree - strongly agree). After the third round, there was consensus on items that focused on professional standards, and practical requirements, overall there was support for data linkage and a multi-professional approach. It would be acceptable to stakeholders to introduce a data linkage system for pharmacovigilance as long as identified concerns are addressed. Concerns included adherence to current professional, legal and ethical standards, as well resolving practical issues. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Health Professionals' Perceptions of Sexual Assault Management: A Delphi Study

ERIC Educational Resources Information Center

Jancey, Jonine; Meuleners, Lynn; Phillips, Maureen

2011-01-01

Objective: To explore health professionals' perceptions of sexual assault management practices and identify issues related to these practices across Western Australia (WA). Design: A two-round electronic Delphi study was undertaken with health professionals (medical doctors, registered nurses, social workers and managers). Setting: Healthcare…

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.

PubMed

Birko, Stanislav; Dove, Edward S; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts' variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions. PMID:26270647

Suicide first aid guidelines for Sri Lanka: a Delphi consensus study.

PubMed

De Silva, Saranga A; Colucci, Erminia; Mendis, Jayan; Kelly, Claire M; Jorm, Anthony F; Minas, Harry

2016-01-01

Sri Lanka has one of the highest suicide rates in the world. Gatekeeper programs aimed at specific target groups could be a promising suicide prevention strategy in the country. The aim of this study was to develop guidelines that help members of the public to provide first aid to persons in Sri Lanka who are at risk of suicide. The Delphi method was used to elicit consensus on potential helping statements to include in the guidelines. These statements describe information members of the public should have and actions they can take to help a person who is experiencing suicidal thoughts. An expert panel, comprised of mental health and suicide experts in Sri Lanka, rated each statement. The panellists were encouraged to suggest any additional action that was not included in the original questionnaire and, in particular, to include items that were culturally appropriate or gender specific. Responses to open-ended questions were used to generate new items. These items were included in the subsequent Delphi rounds. Three Delphi rounds were carried out. Statements were accepted for inclusion in the guidelines if they were endorsed (rated as essential or important) by at least 80 % of the panel. Statements endorsed by 70-79 % of the panel were re-rated in the following round. Statements with less than 70 % endorsement, or re-rated items that did not receive 80 % or higher endorsement were rejected. The output from the Delphi process was a set of endorsed statements. In the first round questionnaire 473 statements were presented to the panel and 58 new items were generated from responses to the open-ended questions. Of the total 531 statements presented, 304 were endorsed. These statements were used to develop the suicide first aid guidelines for Sri Lanka. By engaging Sri Lankans who are experts in the field of mental health or suicide this research developed culturally appropriate guidelines for providing mental health first aid to a person at risk of suicide in Sri Lanka. The guidelines may serve as a basis for developing training for members of the public to provide mental health first aid to persons at risk of suicide as part of Sri Lanka's suicide prevention strategy.

Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology.

PubMed

Eubank, Breda H; Mohtadi, Nicholas G; Lafave, Mark R; Wiley, J Preston; Bois, Aaron J; Boorman, Richard S; Sheps, David M

2016-05-20

Patients presenting to the healthcare system with rotator cuff pathology do not always receive high quality care. High quality care occurs when a patient receives care that is accessible, appropriate, acceptable, effective, efficient, and safe. The aim of this study was twofold: 1) to develop a clinical pathway algorithm that sets forth a stepwise process for making decisions about the diagnosis and treatment of rotator cuff pathology presenting to primary, secondary, and tertiary healthcare settings; and 2) to establish clinical practice guidelines for the diagnosis and treatment of rotator cuff pathology to inform decision-making processes within the algorithm. A three-step modified Delphi method was used to establish consensus. Fourteen experts representing athletic therapy, physiotherapy, sport medicine, and orthopaedic surgery were invited to participate as the expert panel. In round 1, 123 best practice statements were distributed to the panel. Panel members were asked to mark "agree" or "disagree" beside each statement, and provide comments. The same voting method was again used for round 2. Round 3 consisted of a final face-to-face meeting. In round 1, statements were grouped and reduced to 44 statements that met consensus. In round 2, five statements reached consensus. In round 3, ten statements reached consensus. Consensus was reached for 59 statements representing five domains: screening, diagnosis, physical examination, investigations, and treatment. The final face-to-face meeting was also used to develop clinical pathway algorithms (i.e., clinical care pathways) for three types of rotator cuff pathology: acute, chronic, and acute-on-chronic. This consensus guideline will help to standardize care, provide guidance on the diagnosis and treatment of rotator cuff pathology, and assist in clinical decision-making for all healthcare professionals.

A Delphi Consensus of the Crucial Steps in Gastric Bypass and Sleeve Gastrectomy Procedures in the Netherlands.

PubMed

Kaijser, Mirjam A; van Ramshorst, Gabrielle H; Emous, Marloes; Veeger, Nic J G M; van Wagensveld, Bart A; Pierie, Jean-Pierre E N

2018-04-09

Bariatric procedures are technically complex and skill demanding. In order to standardize the procedures for research and training, a Delphi analysis was performed to reach consensus on the practice of the laparoscopic gastric bypass and sleeve gastrectomy in the Netherlands. After a pre-round identifying all possible steps from literature and expert opinion within our study group, questionnaires were send to 68 registered Dutch bariatric surgeons, with 73 steps for bypass surgery and 51 steps for sleeve gastrectomy. Statistical analysis was performed to identify steps with and without consensus. This process was repeated to reach consensus of all necessary steps. Thirty-eight participants (56%) responded in the first round and 32 participants (47%) in the second round. After the first Delphi round, 19 steps for gastric bypass (26%) and 14 for sleeve gastrectomy (27%) gained full consensus. After the second round, an additional amount of 10 and 12 sub-steps was confirmed as key steps, respectively. Thirteen steps in the gastric bypass and seven in the gastric sleeve were deemed advisable. Our expert panel showed a high level of consensus expressed in a Cronbach's alpha of 0.82 for the gastric bypass and 0.87 for the sleeve gastrectomy. The Delphi consensus defined 29 steps for gastric bypass and 26 for sleeve gastrectomy as being crucial for correct performance of these procedures to the standards of our expert panel. These results offer a clear framework for the technical execution of these procedures.

Developing End-of-Training Entrustable Professional Activities for Psychiatry: Results and Methodological Lessons.

PubMed

Young, John Q; Hasser, Caitlin; Hung, Erick K; Kusz, Martin; O'Sullivan, Patricia S; Stewart, Colin; Weiss, Andrea; Williams, Nancy

2018-07-01

To develop entrustable professional activities (EPAs) for psychiatry and to demonstrate an innovative, validity-enhancing methodology that may be relevant to other specialties. A national task force employed a three-stage process from May 2014 to February 2017 to develop EPAs for psychiatry. In stage 1, the task force used an iterative consensus-driven process to construct proposed EPAs. Each included a title, full description, and relevant competencies. In stage 2, the task force interviewed four nonpsychiatric experts in EPAs and further revised the EPAs. In stage 3, the task force performed a Delphi study of national experts in psychiatric education and assessment. All survey participants completed a brief training program on EPAs. Quantitative and qualitative analysis led to further modifications. Essentialness was measured on a five-point scale. EPAs were included if the content validity index was at least 0.8 and the lower end of the asymmetric confidence interval was not lower than 4.0. Stages 1 and 2 yielded 24 and 14 EPAs, respectively. In stage 3, 31 of the 39 invited experts participated in both rounds of the Delphi study. Round 1 reduced the proposed EPAs to 13. Ten EPAs met the inclusion criteria in Round 2. The final EPAs provide a strong foundation for competency-based assessment in psychiatry. Methodological features such as critique by nonpsychiatry experts, a national Delphi study with frame-of-reference training, and stringent inclusion criteria strengthen the content validity of the findings and may serve as a model for future efforts in other specialties.

Consensus on the criteria needed for creating a rare-disease patient registry. A Delphi study.

PubMed

Cavero-Carbonell, Clara; Gras-Colomer, Elena; Guaita-Calatrava, Rosana; López-Briones, Carmen; Amorós, Rubén; Abaitua, Ignacio; Posada, Manuel; Zurriaga, Oscar

2016-06-01

Patient registries (PRs) are important tools for public-health surveillance and rare-disease research. The purpose of this study is to identify the most important criteria for the creation of a rare-disease PR that could be used by public-health authorities to develop health policies. A consensus-development Delphi study was used, with participants selected for their expertize in rare diseases and registries. Participants were asked to complete a questionnaire on the most important criteria for creating PRs. Three rounds were performed. Agreement was reached on half the questions in the first round and on 89% of questions in the final round, with a total expert participation rate of around 60% by the final stage. This study made it possible to reach a broader consensus starting from experts' initial assessment of the features that should be considered for the creation of a rare-disease PR. The consensus method used made it possible to define the characteristics of a PR based on expert opinion within a rare-disease framework. This study may serve as a guide for helping other researchers plan and build a rare-disease PR. © The Author 2015. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A Delphi study on environmental factors that impact work and social life participation of individuals with multiple sclerosis in Austria and Switzerland.

PubMed

Prodinger, Birgit; Weise, Andrea P; Shaw, Lynn; Stamm, Tanja A

2010-01-01

This study aimed to gain knowledge about environmental factors (EFs) that impact work and social life participation of people with multiple sclerosis (MS) in Austria and Switzerland to extend the knowledge of participation and to identify key areas for measuring participation. A three-round Delphi study was conducted defining patients as experts. In the 1st round, qualitative data was gathered through questionnaires, analyzed with content analysis, and factors were assigned to EFs as classified in the ICF. In the 2nd and 3rd round, experts judged EFs according to its relevance to obtain consensus (cut-off 75%). Categories were ranked on a scale from mostly important to important. One hundred and twelve Austrian and 109 Swiss experts were recruited. The content analysis revealed 768 EFs. The study resulted in a list of 176 consensus factors for Austria and 177 Switzerland. Five categories revealed to be highly important, 12 moderately important, 6 fairly important, and 10 important. This study indicates that participation in work or social life is influenced by physical, social, attitudinal, and policy factors. Consensus factors afford insights into areas for consideration in the development of participation outcome measurements and support a comprehensive and inclusive rehabilitation approach.

Characteristics of a global classification system for perinatal deaths: a Delphi consensus study.

PubMed

Wojcieszek, Aleena M; Reinebrant, Hanna E; Leisher, Susannah Hopkins; Allanson, Emma; Coory, Michael; Erwich, Jan Jaap; Frøen, J Frederik; Gardosi, Jason; Gordijn, Sanne; Gulmezoglu, Metin; Heazell, Alexander E P; Korteweg, Fleurisca J; McClure, Elizabeth; Pattinson, Robert; Silver, Robert M; Smith, Gordon; Teoh, Zheyi; Tunçalp, Özge; Flenady, Vicki

2016-08-15

Despite the global burden of perinatal deaths, there is currently no single, globally-acceptable classification system for perinatal deaths. Instead, multiple, disparate systems are in use world-wide. This inconsistency hinders accurate estimates of causes of death and impedes effective prevention strategies. The World Health Organisation (WHO) is developing a globally-acceptable classification approach for perinatal deaths. To inform this work, we sought to establish a consensus on the important characteristics of such a system. A group of international experts in the classification of perinatal deaths were identified and invited to join an expert panel to develop a list of important characteristics of a quality global classification system for perinatal death. A Delphi consensus methodology was used to reach agreement. Three rounds of consultation were undertaken using a purpose built on-line survey. Round one sought suggested characteristics for subsequent scoring and selection in rounds two and three. The panel of experts agreed on a total of 17 important characteristics for a globally-acceptable perinatal death classification system. Of these, 10 relate to the structural design of the system and 7 relate to the functional aspects and use of the system. This study serves as formative work towards the development of a globally-acceptable approach for the classification of the causes of perinatal deaths. The list of functional and structural characteristics identified should be taken into consideration when designing and developing such a system.

A Delphi Study of Agriculture Teacher Perceptions of Problems in Student Retention.

ERIC Educational Resources Information Center

Dyer, James E.; Breja, Lisa M.; Ball, Anna L.

2003-01-01

A four-round Delphi study of secondary agriculture teachers (17, 17, 22, and 21 responses) identified and rated student retention problems. Consensus was reached on these items: scheduling difficulties, lack of counselor support, image, increased graduation requirements, college entrance requirements, competition from other activities, block…

Return to play criteria after hamstring muscle injury in professional football: a Delphi consensus study.

PubMed

Zambaldi, Mattia; Beasley, Ian; Rushton, Alison

2017-08-01

Hamstring muscle injury (HMI) is the most common injury in professional football and has a high re-injury rate. Despite this, there are no validated criteria to support return to play (RTP) decisions. To use the Delphi method to reach expert consensus on RTP criteria after HMI in professional football. All professional football clubs in England (n=92) were invited to participate in a 3-round Delphi study. Round 1 requested a list of criteria used for RTP decisions after HMI. Responses were independently collated by 2 researchers under univocal definitions of RTP criteria. In round 2 participants rated their agreement for each RTP criterion on a 1-5 Likert Scale. In round 3 participants re-rated the criteria that had reached consensus in round 2. Descriptive statistics and Kendall's coefficient of concordance enabled interpretation of consensus. Participation rate was limited at 21.7% (n=20), while retention rate was high throughout the 3 rounds (90.0%, 85.0%, 90.0%). Round 1 identified 108 entries with varying definitions that were collated into a list of 14 RTP criteria. Rounds 2 and 3 identified 13 and 12 criteria reaching consensus, respectively. Five domains of RTP assessment were identified: functional performance, strength, flexibility, pain and player's confidence. The highest-rated criteria were in the functional performance domain, with particular importance given to sprint ability. This study defined a list of consensually agreed RTP criteria for HMI in professional football. Further work is now required to determine the validity of the identified criteria. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development of an antibiotic spectrum score based on veterans affairs culture and susceptibility data for the purpose of measuring antibiotic de-escalation: a modified Delphi approach.

PubMed

Madaras-Kelly, Karl; Jones, Makoto; Remington, Richard; Hill, Nicole; Huttner, Benedikt; Samore, Matthew

2014-09-01

Development of a numerical score to measure the microbial spectrum of antibiotic regimens (spectrum score) and method to identify antibiotic de-escalation events based on application of the score. Web-based modified Delphi method. Physician and pharmacist antimicrobial stewards practicing in the United States recruited through infectious diseases-focused listservs. Three Delphi rounds investigated: organisms and antibiotics to include in the spectrum score, operationalization of rules for the score, and de-escalation measurement. A 4-point ordinal scale was used to score antibiotic susceptibility for organism-antibiotic domain pairs. Antibiotic regimen scores, which represented combined activity of antibiotics in a regimen across all organism domains, were used to compare antibiotic spectrum administered early (day 2) and later (day 4) in therapy. Changes in spectrum score were calculated and compared with Delphi participants' judgments on de-escalation with 20 antibiotic regimen vignettes and with non-Delphi steward judgments on de-escalation of 300 pneumonia regimen vignettes. Method sensitivity and specificity to predict expert de-escalation status were calculated. Twenty-four participants completed all Delphi rounds. Expert support for concepts utilized in metric development was identified. For vignettes presented in the Delphi, the sign of change in score correctly classified de-escalation in all vignettes except those involving substitution of oral antibiotics. The sensitivity and specificity of the method to identify de-escalation events as judged by non-Delphi stewards were 86.3% and 96.0%, respectively. Identification of de-escalation events based on an algorithm that measures microbial spectrum of antibiotic regimens generally agreed with steward judgments of de-escalation status.

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study.

PubMed

Blackwood, Bronagh; Ringrow, Suzanne; Clarke, Mike; Marshall, John; Rose, Louise; Williamson, Paula; McAuley, Danny

2015-08-20

Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children. We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes. The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

Determining procedures for simulation-based training in radiology: a nationwide needs assessment.

PubMed

Nayahangan, Leizl Joy; Nielsen, Kristina Rue; Albrecht-Beste, Elisabeth; Bachmann Nielsen, Michael; Paltved, Charlotte; Lindorff-Larsen, Karen Gilboe; Nielsen, Bjørn Ulrik; Konge, Lars

2018-06-01

New training modalities such as simulation are widely accepted in radiology; however, development of effective simulation-based training programs is challenging. They are often unstructured and based on convenience or coincidence. The study objective was to perform a nationwide needs assessment to identify and prioritize technical procedures that should be included in a simulation-based curriculum. A needs assessment using the Delphi method was completed among 91 key leaders in radiology. Round 1 identified technical procedures that radiologists should learn. Round 2 explored frequency of procedure, number of radiologists performing the procedure, risk and/or discomfort for patients, and feasibility for simulation. Round 3 was elimination and prioritization of procedures. Response rates were 67 %, 70 % and 66 %, respectively. In Round 1, 22 technical procedures were included. Round 2 resulted in pre-prioritization of procedures. In round 3, 13 procedures were included in the final prioritized list. The three highly prioritized procedures were ultrasound-guided (US) histological biopsy and fine-needle aspiration, US-guided needle puncture and catheter drainage, and basic abdominal ultrasound. A needs assessment identified and prioritized 13 technical procedures to include in a simulation-based curriculum. The list may be used as guide for development of training programs. • Simulation-based training can supplement training on patients in radiology. • Development of simulation-based training should follow a structured approach. • The CAMES Needs Assessment Formula explores needs for simulation training. • A national Delphi study identified and prioritized procedures suitable for simulation training. • The prioritized list serves as guide for development of courses in radiology.

An electronic delphi study to establish pediatric intensive care nursing research priorities in twenty European countries*.

PubMed

Tume, Lyvonne N; van den Hoogen, Agnes; Wielenga, Joke M; Latour, Jos M

2014-06-01

To identify and to establish research priorities for pediatric intensive care nursing science across Europe. A modified three-round electronic Delphi technique was applied. Questionnaires were translated into seven different languages. European PICUs. The participants included pediatric intensive care clinical nurses, managers, educators, and researchers. In round 1, the qualitative responses were analyzed by content analysis and a list of research statements and domains was generated. In rounds 2 and 3, the statements were ranked on a scale of one to six (not important to most important). Mean scores and SDs were calculated for rounds 2 and 3. None. Round 1 started with 90 participants, with round 3 completed by 64 (71%). The seven highest ranking statements (≥ 5.0 mean score) were related to end-of-life care, decision making around forgoing and sustaining treatment, prevention of pain, education and competencies for pediatric intensive care nurses, reducing healthcare-associated infections, identifying appropriate nurse staffing levels, and implementing evidence into nursing practice. Nine research domains were prioritized, and these were as follows: 1) clinical nursing care practices, 2) pain and sedation, 3) quality and safety, 4) respiratory and mechanical ventilation, 5) child- and family-centered care, 6) ethics, 7) professional issues in nursing, 8) hemodynamcis and resuscitation, and 9) trauma and neurocritical care. The results of this study inform the European Society of Pediatric and Neonatal Intensive Care's nursing research agenda in the future. The results allow nurse researchers within Europe to encourage collaborative initiatives for nursing research.

Rehabilitation Counselor Competencies When Working With Hispanic/Latino Immigrant Injured Workers: A Delphi Study

ERIC Educational Resources Information Center

Santos Román, Leslie M.; Estrada-Hernández, Noel

2017-01-01

Purpose: To explore and identify attitudes, knowledge, and skills rehabilitation practitioners in the private sector need when working with Hispanic/Latino immigrant injured workers. Methods: This study employed a 3-round Delphi study to obtain a consensus of 8 rehabilitation practitioners who had experience and expertise working with…

Physical Restraints: Consensus of a Research Definition Using a Modified Delphi Technique.

PubMed

Bleijlevens, Michel H C; Wagner, Laura M; Capezuti, Elizabeth; Hamers, Jan P H

2016-11-01

To develop an internationally accepted research definition of physical restraint. Comprehensive literature search followed by a web-based, three-round, modified Delphi technique comprising reviews and feedback. Clinical care settings. An international group of 48 experts consisting of researchers and clinicians from 14 countries who have made sustained contribution to research and clinical application in the field of physical restraint in clinical care. Data were collected using an online survey program and one in-person meeting. Results of the online survey and the in-person meeting were used for distribution in subsequent rounds until consensus on a definition was reached. Consensus was defined as 90% of the participating experts agreeing with the proposed definition of physical restraint. Thirty-four different definitions were identified during the literature search and served as a starting point for the modified Delphi technique. After three rounds, 45 (95.7%) of 47 remaining experts agreed with the newly proposed definition: "Physical restraint is defined as any action or procedure that prevents a person's free body movement to a position of choice and/or normal access to his/her body by the use of any method, attached or adjacent to a person's body that he/she cannot control or remove easily." A multidisciplinary, internationally representative panel of experts reached consensus on a research definition for physical restraints in older persons. This is a necessary step toward improved comparisons of the prevalence of physical restraint use across studies and countries. This definition can further guide research interventions aimed at reducing use of physical restraints. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Controversy between anesthesiologists and obstetricians on the labour ward: the Delphi method is used as a consensus-building technique.

PubMed

Nguyen-Lu, Nhathien; Downey, Kristi; Carvalho, Jose C A

2015-03-01

Obstetricians and anesthesiologists may interpret medical evidence differently, which could potentially generate conflict and compromise patient care. We sought to identify the most important controversial topics involving obstetricians and anesthesiologists on the labour ward that had the potential to affect patient outcome. We conducted a consensus-building study based on the Delphi technique. A panel of experts comprised of obstetric anesthesiologists and obstetricians responded to a series of four parallel sequential questionnaires interspersed with feedback. The first round consisted of an open questionnaire: Which topics in patient management would rouse a difference of opinion between anesthesiologists and obstetricians that may interfere with patient outcome, and why? The second round sought agreement on the topics, and the third round sought to rank the topics, and their underlying reasons, that scored at least 60% agreement. The final round allowed each discipline insight into the controversies gathered by the other discipline. Ten anesthesiologists and ten obstetricians participated in the study. Anesthesiologists identified twice as many controversial topics as the obstetricians (six vs three, respectively). The obstetricians agreed with all topics identified by the anesthesiologists, but agreed with only five of the 18 (28%) reasons to support them. Anesthesiologists agreed with all topics raised by the obstetricians, but agreed with only three of the six (50%) reasons to support them. Both the obstetricians and the anesthesiologists identified several controversial topics that may influence clinical practice on the labour ward. This information could serve as the basis to develop educational programs and strategies to improve communication between the two disciplines.

Technical College Instructors' Perceptions of the Impact of Online Readiness and of Student Support Services on Student Success in Online Courses

ERIC Educational Resources Information Center

Dowd, Nathan

2012-01-01

The purpose of this study is to determine how Wisconsin Technical College (WTCS) administrators and online instructors perceive the impact of online learner readiness and student support services to be on student success in online courses. The study used a modified three-round Delphi technique to determine to collect data. The results indicated…

Development of disaster mental health guidelines through the Delphi process in Japan.

PubMed

Suzuki, Yuriko; Fukasawa, Maiko; Nakajima, Satomi; Narisawa, Tomomi; Kim, Yoshiharu

2012-07-02

The mental health community in Japan had started reviewing the country's disaster mental health guidelines before the Great East Japan Earthquake, aiming to revise them based on evidence and experience accumulated in the last decade. Given the wealth of experience and knowledge acquired in the field by many Japanese mental health professionals, we decided to develop the guidelines through systematic consensus building and selected the Delphi method. After a thorough literature review and focus group interviews, 96 items regarding disaster mental health were included in Delphi Round 1. Of 100 mental health professionals experienced in disaster response who were invited to participate, 97 agreed. The appropriateness of each statement was assessed by the participants using a Likert scale (1: extremely inappropriate, 9: very appropriate) and providing free comments in three rounds. Consensus by experts was defined as an average score of ≥7 for which ≥70% of participants assigned this score, and items reaching consensus were included in the final guidelines. Overall, of the 96 items (89 initially asked and 7 added items), 77 items were agreed on (46 items in Round 1, and 19 positive and 12 negative agreed on items in Round 2). In Round 2, three statements with which participants agreed most strongly were: 1) A protocol for emergency work structure and information flow should be prepared in normal times; 2) The mental health team should attend regular meetings on health and medicine to exchange information; and 3) Generally, it is recommended not to ask disaster survivors about psychological problems at the initial response but ask about their present worries and physical condition. Three statements with which the participants disagreed most strongly in this round were: 1) Individuals should be encouraged to provide detailed accounts of their experiences; 2) Individuals should be provided with education if they are interested in receiving it; and 3) Bad news should be withheld from distressed individuals for fear of causing more upset. Most items which achieved agreement in Round 1 were statements described in previous guidelines or publications, or statements regarding the basic attitude of human service providers. The revised guidelines were thus developed based on the collective wisdom drawn from Japanese practitioners' experience while also considering the similarities and differences from the international standards.

USING THE DELPHI TECHNIQUE TO DEVELOP EFFECTIVENESS INDICATORS FOR SOCIAL MARKETING COMMUNICATION TO REDUCE HEALTH-RISK BEHAVIORS AMONG YOUTH.

PubMed

Vantamay, Nottakrit

2015-09-01

This study aimed to develop effectiveness indicators for social marketing communication to reduce health-risk behaviors among Thai youth by using the Delphi technique. The Delphi technique is a research approach used to gain consensus through a series of two or more rounds of questionnaire surveys where information and results are fed back to panel members between each round and it has been extensively used to generate many indicators relevant to health behaviors. The Delphi technique was conducted in 3 rounds by consulting a panel of 15 experts in the field of social marketing communication for public health campaigns in Thailand. We found forty-nine effectiveness indicators in eight core components reached consensus. These components were: 1) attitude about health-risk behavior reduction, 2) subjective norms, 3) perceived behavioral control, 4) intention to reduce health-risk behaviors, 5) practices for reducing health-risk behaviors, 6) knowledge about the dangers and impact of health-risk behaviors, 7) campaign brand equity, and 8) communication networks. These effectiveness indicators could be applied by health promotion organizations for evaluating the effectiveness of social marketing communication to effectively reduce health-risk behaviors among youth.

Identifying Ethical Issues in Mental Health Research with Minors Adolescents: Results of a Delphi Study

PubMed Central

Hiriscau, Elisabeta Ioana; Stingelin-Giles, Nicola; Wasserman, Danuta; Reiter-Theil, Stella

2016-01-01

Research with minors, especially for preventive purposes, e.g., suicide prevention, investigating risk or self-destructive behaviors such as deviance, drug abuse, or suicidal behavior, is ethically sensitive. We present a Delphi study exploring the ethical implications of the needs formulated by researchers in an international pre-conference who would benefit from ethics support and guidance in conducting Mental Health Research with minors. The resulting List of Ethical Issues (LEI) was submitted to a 2-rounds Delphi process via the Internet, including 34 multidisciplinary experts. In the first round, the experts reviewed the LEI and completed a questionnaire. Results from this round were analyzed and grouped in nine categories comprising 40 items. In the second round, the experts had to agree/disagree with the needs expressed in the LEI leading to a final list of 25 ethical issues considered relevant for Mental Health Research with minors such as: confidentiality of the sensitive data, competence for consenting alone and risk of harm and stigma related to the methodology used in research. It was shown that studies like SEYLE (Saving and Empowering Young Lives in Europe) trigger among researchers wishes to obtain specific recommendations helping to comply with standards for good practice in conducting research with minors. PMID:27187425

Identifying Ethical Issues in Mental Health Research with Minors Adolescents: Results of a Delphi Study.

PubMed

Hiriscau, Elisabeta Ioana; Stingelin-Giles, Nicola; Wasserman, Danuta; Reiter-Theil, Stella

2016-05-11

Research with minors, especially for preventive purposes, e.g., suicide prevention, investigating risk or self-destructive behaviors such as deviance, drug abuse, or suicidal behavior, is ethically sensitive. We present a Delphi study exploring the ethical implications of the needs formulated by researchers in an international pre-conference who would benefit from ethics support and guidance in conducting Mental Health Research with minors. The resulting List of Ethical Issues (LEI) was submitted to a 2-rounds Delphi process via the Internet, including 34 multidisciplinary experts. In the first round, the experts reviewed the LEI and completed a questionnaire. Results from this round were analyzed and grouped in nine categories comprising 40 items. In the second round, the experts had to agree/disagree with the needs expressed in the LEI leading to a final list of 25 ethical issues considered relevant for Mental Health Research with minors such as: confidentiality of the sensitive data, competence for consenting alone and risk of harm and stigma related to the methodology used in research. It was shown that studies like SEYLE (Saving and Empowering Young Lives in Europe) trigger among researchers wishes to obtain specific recommendations helping to comply with standards for good practice in conducting research with minors.

Identification of competencies for patient education in physiotherapy using a Delphi approach.

PubMed

Forbes, Roma; Mandrusiak, Allison; Smith, Michelle; Russell, Trevor

2018-06-01

Patient education is a critical part of physiotherapy practice however an empirically derived set of competencies for its use does not exist. This study aimed to generate a set of competencies for patient education in physiotherapy using a consensus approach. A Delphi study with two rounds using a panel of expert physiotherapists within Australia was undertaken. In the first round, the panel of 12 specialist physiotherapists identified competencies required for patient education in the physiotherapy setting. Framework analysis was applied to develop a set of competencies that were assessed in the second round where ≥80% agreement of importance from the panel indicated consensus. Response rates of specialist physiotherapists agreeing to participate were 67% for the first round and 100% for the second round. Analysis following the first round produced 25 competencies. The second round resulted in agreement on a final set of 22 competencies. This study developed a concise list of competencies for patient education with a high level of expert agreement. By identifying the key competencies in this area, there is potential to benchmark patient education training and assessment of physiotherapists for improved educational and professional outcomes. Copyright © 2017 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Current and Emerging Ethical Issues in Counseling: A Delphi Study of Expert Opinions

ERIC Educational Resources Information Center

Herlihy, Barbara; Dufrene, Roxane L.

2011-01-01

A Delphi study was conducted to ascertain the opinions of panel experts regarding the most important current and emerging ethical issues facing the counseling profession. Expert opinions on ethical issues in counselor preparation also were sought. Eighteen panelists responded to 3 rounds of data collection interspersed with feedback. Themes that…

Development of a School Nursing Research Agenda in Florida: A Delphi Study

ERIC Educational Resources Information Center

Gordon, Shirley C.; Barry, Charlotte D.

2006-01-01

Research is important to the image, visibility, and viability of school nursing. Each state school nursing association should evaluate member commitment to school nursing research based on their unique set of financial, educational, and organizational resources. A 3-round Delphi study was conducted in which Florida school nurses identified…

Pharmacy executives: leadership issues and associated skills, knowledge, and abilities in the U.S. Department of Defense.

PubMed

Meadows, Andrew B; Finstuen, Kenn; Hudak, Ronald P

2003-01-01

To identify the issues or problems that current and aspiring U.S. Department of Defense (DoD) pharmacy executives will face in the future and to define the skills, knowledge, and abilities (SKAs) required to successfully address these issues. Delphi method for executive decision making. DoD. Ninety-three pharmacists serving in the military grades of lieutenant colonel/commander and colonel/captain, as well as pharmacists selected for promotion to those grades. iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants identified five major issues believed to be of greatest importance to pharmacy executives and reported specific SKAs that might be needed to successfully manage those issues. An expert panel sorted these issues into meaningful domains, then provided an appropriate title for each domain. Round 2--on a 7-point scale, respondents rated the SKA items according to their assessment of how much a future DoD pharmacy executive would need each SKA. Response rates were 44.1% and 46.2% for Delphi rounds 1 and 2, respectively. The first round generated 62 unique issues facing pharmacy executives. The expert panel reviewed and sorted the issues into eight domains and selected an appropriate title for each domain. The domains identified by the panel were human resources, pharmacy operations/business practices, information management and technology, financial resources, formulary management, drug therapy management, pharmacy benefit management, and leadership. During round 2, 73.3% of the top 15 rated SKAs came from the drug therapy management, leadership, and formulary management domains. The three highest-rated SKAs were "ability to see the big picture," "ability to build strong relations with medical staffs," and "skills in both writing and verbal communication." The issues facing future DoD pharmacy executives will require them to expand their clinical abilities as well as their ability to collaborate and communicate with other professionals.

Identifying the features of an exercise addiction: A Delphi study

PubMed Central

Macfarlane, Lucy; Owens, Glynn; Cruz, Borja del Pozo

2016-01-01

Objectives There remains limited consensus regarding the definition and conceptual basis of exercise addiction. An understanding of the factors motivating maintenance of addictive exercise behavior is important for appropriately targeting intervention. The aims of this study were twofold: first, to establish consensus on features of an exercise addiction using Delphi methodology and second, to identify whether these features are congruous with a conceptual model of exercise addiction adapted from the Work Craving Model. Methods A three-round Delphi process explored the views of participants regarding the features of an exercise addiction. The participants were selected from sport and exercise relevant domains, including physicians, physiotherapists, coaches, trainers, and athletes. Suggestions meeting consensus were considered with regard to the proposed conceptual model. Results and discussion Sixty-three items reached consensus. There was concordance of opinion that exercising excessively is an addiction, and therefore it was appropriate to consider the suggestions in light of the addiction-based conceptual model. Statements reaching consensus were consistent with all three components of the model: learned (negative perfectionism), behavioral (obsessive–compulsive drive), and hedonic (self-worth compensation and reduction of negative affect and withdrawal). Conclusions Delphi methodology allowed consensus to be reached regarding the features of an exercise addiction, and these features were consistent with our hypothesized conceptual model of exercise addiction. This study is the first to have applied Delphi methodology to the exercise addiction field, and therefore introduces a novel approach to exercise addiction research that can be used as a template to stimulate future examination using this technique. PMID:27554504

Essential Concepts of Nanoscale Science and Technology for High School Students Based on a Delphi Study by the Expert Community

NASA Astrophysics Data System (ADS)

Sakhnini, Sohair; Blonder, Ron

2015-07-01

Nanoscale science and technology (NST) is an important new field in modern science. In the current study, we seek to answer the question: 'What are the essential concepts of NST that should be taught in high school'? A 3-round Delphi study methodology was applied based on 2 communities of experts in nanotechnology research and science education. Eight essential concepts in NST were identified. Each concept is accompanied by its explanation, definition, importance and includes subcategories that compose it. Three concepts emerged in the Delphi study, which were not identified before: functionality, classification of nanomaterials, and the making of nanotechnology. Differences between the concepts suggested by the 2 communities of experts were found. The results of this study serve as a tool to examine different nanotechnology programs that were reported thus far and to make recommendations for designing a NST program for high school students that includes the essential concepts.

Developing a guideline for clinical trial protocol content: Delphi consensus survey

PubMed Central

2012-01-01

Background Recent evidence has highlighted deficiencies in clinical trial protocols, having implications for many groups. Existing guidelines for randomized clinical trial (RCT) protocol content vary substantially and most do not describe systematic methodology for their development. As one of three prespecified steps for the systematic development of a guideline for trial protocol content, the objective of this study was to conduct a three-round Delphi consensus survey to develop and refine minimum content for RCT protocols. Methods Panellists were identified using a multistep iterative approach, met prespecified minimum criteria and represented key stakeholders who develop or use clinical trial protocols. They were asked to rate concepts for importance in a minimum set of items for RCT protocols. The main outcome measures were degree of importance (scale of 1 to 10; higher scores indicating higher importance) and level of consensus for items. Results were presented as medians, interquartile ranges, counts and percentages. Results Ninety-six expert panellists participated in the Delphi consensus survey including trial investigators, methodologists, research ethics board members, funders, industry, regulators and journal editors. Response rates were between 88 and 93% per round. Overall, panellists rated 63 of 88 concepts of high importance (of which 50 had a 25th percentile rating of 8 or greater), 13 of moderate importance (median 6 or 7) and 12 of low importance (median less than or equal to 5) for minimum trial protocol content. General and item-specific comments and subgroup results provided valuable insight for further discussions. Conclusions This Delphi process achieved consensus from a large panel of experts from diverse stakeholder groups on essential content for RCT protocols. It also highlights areas of divergence. These results, complemented by other empirical research and consensus meetings, are helping guide the development of a guideline for protocol content. PMID:23006145

A consensus definition of running-related injury in recreational runners: a modified Delphi approach.

PubMed

Yamato, Tiê Parma; Saragiotto, Bruno Tirotti; Lopes, Alexandre Dias

2015-05-01

Delphi study. To reach a consensus definition of running-related injury in recreational runners through a modified Delphi approach. Many studies have suggested the need for a standardized definition of running-related injury to provide uniformity to injury surveillance in running. We invited 112 researchers from running-related injury studies identified in a previous systematic review to classify words and terms frequently used in definitions of running-related injury in an online form during 3 rounds of study. In the last round, participants were asked to approve or disapprove the consensus definition. We considered an agreement level of at least 75% to be a consensus. Thirty-eight participants agreed to participate in the study. The response rates were 94.7% (n = 36) for the first round, 83.3% (n = 30) for the second round, and 86.7% (n = 26) for the third round. A consensus definition of running-related injury was reached, with 80% of participants approving the following: "Running-related (training or competition) musculoskeletal pain in the lower limbs that causes a restriction on or stoppage of running (distance, speed, duration, or training) for at least 7 days or 3 consecutive scheduled training sessions, or that requires the runner to consult a physician or other health professional." The proposed standardized definition of running-related injury could assist in standardizing the definitions used in sport science research and facilitate between-study comparisons. Future studies testing the validity of the proposed consensus definition, as well as its accurate translation to other languages, are also needed.

Single-Parent Nontraditional Students: Faculty Support within the Classroom Environment

ERIC Educational Resources Information Center

Allen-Drewry, Lisa M.

2017-01-01

Purpose: The purpose of this Delphi study was to explore single-parent nontraditional student experiences within nontraditional university classroom environments and to determine methods for providing better support within the classroom setting. Methodology: The Delphi technique was conducted through 3 survey rounds to explore ways professors and…

Developing consensus-based policy solutions for medicines adherence for Europe: a delphi study

PubMed Central

2012-01-01

Background Non-adherence to prescribed medication is a pervasive problem that can incur serious effects on patients’ health outcomes and well-being, and the availability of resources in healthcare systems. This study aimed to develop practical consensus-based policy solutions to address medicines non-adherence for Europe. Methods A four-round Delphi study was conducted. The Delphi Expert Panel comprised 50 participants from 14 countries and was representative of: patient/carers organisations; healthcare providers and professionals; commissioners and policy makers; academics; and industry representatives. Participants engaged in the study remotely, anonymously and electronically. Participants were invited to respond to open questions about the causes, consequences and solutions to medicines non-adherence. Subsequent rounds refined responses, and sought ratings of the relative importance, and operational and political feasibility of each potential solution to medicines non-adherence. Feedback of individual and group responses was provided to participants after each round. Members of the Delphi Expert Panel and members of the research group participated in a consensus meeting upon completion of the Delphi study to discuss and further refine the proposed policy solutions. Results 43 separate policy solutions to medication non-adherence were agreed by the Panel. 25 policy solutions were prioritised based on composite scores for importance, and operational and political feasibility. Prioritised policy solutions focused on interventions for patients, training for healthcare professionals, and actions to support partnership between patients and healthcare professionals. Few solutions concerned actions by governments, healthcare commissioners, or interventions at the system level. Conclusions Consensus about practical actions necessary to address non-adherence to medicines has been developed for Europe. These actions are also applicable to other regions. Prioritised policy solutions for medicines non-adherence offer a benefit to policymakers and healthcare providers seeking to address this multifaceted, complex problem. PMID:23176439

Reaching Consensus on Essential Biomedical Science Learning Objectives in a Dental Curriculum.

PubMed

Best, Leandra; Walton, Joanne N; Walker, Judith; von Bergmann, HsingChi

2016-04-01

This article describes how the University of British Columbia Faculty of Dentistry reached consensus on essential basic biomedical science objectives for DMD students and applied the information to the renewal of its DMD curriculum. The Delphi Method was used to build consensus among dental faculty members and students regarding the relevance of over 1,500 existing biomedical science objectives. Volunteer panels of at least three faculty members (a basic scientist, a general dentist, and a dental specialist) and a fourth-year dental student were formed for each of 13 biomedical courses in the first two years of the program. Panel members worked independently and anonymously, rating each course objective as "need to know," "nice to know," "irrelevant," or "don't know." Panel members were advised after each round which objectives had not yet achieved a 75% consensus and were asked to reconsider their ratings. After a maximum of three rounds to reach consensus, a second group of faculty experts reviewed and refined the results to establish the biomedical science objectives for the renewed curriculum. There was consensus on 46% of the learning objectives after round one, 80% after round two, and 95% after round three. The second expert group addressed any remaining objectives as part of its review process. Only 47% of previous biomedical science course objectives were judged to be essential or "need to know" for the general dentist. The consensus reached by participants in the Delphi Method panels and a second group of faculty experts led to a streamlined, better integrated DMD curriculum to prepare graduates for future practice.

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research

PubMed Central

Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

Background While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. Objective To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. Methods The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. Results 143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. Conclusions GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites. PMID:28768629

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Developing tools for identifying employer and employee satisfaction of nursing new graduates in China.

PubMed

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study.

Identifying Core Mobile Learning Faculty Competencies Based Integrated Approach: A Delphi Study

ERIC Educational Resources Information Center

Elbarbary, Rafik Said

2015-01-01

This study is based on the integrated approach as a concept framework to identify, categorize, and rank a key component of mobile learning core competencies for Egyptian faculty members in higher education. The field investigation framework used four rounds Delphi technique to determine the importance rate of each component of core competencies…

Characteristics of Viable and Sustainable Workers for the Year 2015.

ERIC Educational Resources Information Center

Dean, Brenda Pennington; West, Russell

A two-round Delphi study was conducted to identify the characteristics of viable and sustainable employees in northeastern Tennessee in 2015. The Delphi panel selected for the study consisted of 25 experts who represented a cross-section of the businesses and communities in the 10-county area of northeastern Tennessee served by Walters State…

Guidelines for Reporting Case Studies on Extracorporeal Treatments in Poisonings: Methodology

PubMed Central

Lavergne, Valéry; Ouellet, Georges; Bouchard, Josée; Galvao, Tais; Kielstein, Jan T; Roberts, Darren M; Kanji, Salmaan; Mowry, James B; Calello, Diane P; Hoffman, Robert S; Gosselin, Sophie; Nolin, Thomas D; Goldfarb, David S; Burdmann, Emmanuel A; Dargan, Paul I; Decker, Brian Scott; Hoegberg, Lotte C; Maclaren, Robert; Megarbane, Bruno; Sowinski, Kevin M; Yates, Christopher; Mactier, Robert; Wiegand, Timothy; Ghannoum, Marc

2014-01-01

A literature review performed by the EXtracorporeal TReatments In Poisoning (EXTRIP) workgroup highlighted deficiencies in the existing literature, especially the reporting of case studies. Although general reporting guidelines exist for case studies, there are none in the specific field of extracorporeal treatments in toxicology. Our goal was to construct and propose a checklist that systematically outlines the minimum essential items to be reported in a case study of poisoned patients undergoing extracorporeal treatments. Through a modified two-round Delphi technique, panelists (mostly chosen from the EXTRIP workgroup) were asked to vote on the pertinence of a set of items to identify those considered minimally essential for reporting complete and accurate case reports. Furthermore, independent raters validated the clarity of each selected items between each round of voting. All case reports containing data on extracorporeal treatments in poisoning published in Medline in 2011 were reviewed during the external validation rounds. Twenty-one panelists (20 from the EXTRIP workgroup and an invited expert on pharmacology reporting guidelines) participated in the modified Delphi technique. This group included journal editors and experts in nephrology, clinical toxicology, critical care medicine, emergency medicine, and clinical pharmacology. Three independent raters participated in the validation rounds. Panelists voted on a total of 144 items in the first round and 137 items in the second round, with response rates of 96.3% and 98.3%, respectively. Twenty case reports were evaluated at each validation round and the independent raters' response rate was 99.6% and 98.8% per validation round. The final checklist consists of 114 items considered essential for case study reporting. This methodology of alternate voting and external validation rounds was useful in developing the first reporting guideline for case studies in the field of extracorporeal treatments in poisoning. We believe that this guideline will improve the completeness and transparency of published case reports and that the systematic aggregation of information from case reports may provide early signals of effectiveness and/or harm, thereby improving healthcare decision-making. PMID:24890576

Personalising care of adults with asthma from Asia: a modified e-Dephi consensus study to inform management tailored to attitude and control profiles.

PubMed

Chisholm, Alison; Price, David B; Pinnock, Hilary; Lee, Tan Tze; Roa, Camilo; Cho, Sang-Heon; David-Wang, Aileen; Wong, Gary; van der Molen, Thys; Ryan, Dermot; Castillo-Carandang, Nina; Yong, Yee Vern

2017-01-05

REALISE Asia-an online questionnaire-based study of Asian asthma patients-identified five patient clusters defined in terms of their control status and attitude towards their asthma (categorised as: 'Well-adjusted and at least partly controlled'; 'In denial about symptoms'; 'Tolerating with poor control'; 'Adrift and poorly controlled'; 'Worried with multiple symptoms'). We developed consensus recommendations for tailoring management of these attitudinal-control clusters. An expert panel undertook a three-round electronic Delphi (e-Delphi): Round 1: panellists received descriptions of the attitudinal-control clusters and provided free text recommendations for their assessment and management. Round 2: panellists prioritised Round 1 recommendations and met (or joined a teleconference) to consolidate the recommendations. Round 3: panellists voted and prioritised the remaining recommendations. Consensus was defined as Round 3 recommendations endorsed by >50% of panellists. Highest priority recommendations were those receiving the highest score. The multidisciplinary panellists (9 clinicians, 1 pharmacist and 1 health social scientist; 7 from Asia) identified consensus recommendations for all clusters. Recommended pharmacological (e.g., step-up/down; self-management; simplified regimen) and non-pharmacological approaches (e.g., trigger management, education, social support; inhaler technique) varied substantially according to each cluster's attitude to asthma and associated psychosocial drivers of behaviour. The attitudinal-control clusters defined by REALISE Asia resonated with the international panel. Consensus was reached on appropriate tailored management approaches for all clusters. Summarised and incorporated into a structured management pathway, these recommendations could facilitate personalised care. Generalisability of these patient clusters should be assessed in other socio-economic, cultural and literacy groups and nationalities in Asia.

A consensus exercise identifying priorities for research into clinical effectiveness among children's orthopaedic surgeons in the United Kingdom.

PubMed

Perry, D C; Wright, J G; Cooke, S; Roposch, A; Gaston, M S; Nicolaou, N; Theologis, T

2018-05-01

Aims High-quality clinical research in children's orthopaedic surgery has lagged behind other surgical subspecialties. This study used a consensus-based approach to identify research priorities for clinical trials in children's orthopaedics. Methods A modified Delphi technique was used, which involved an initial scoping survey, a two-round Delphi process and an expert panel formed of members of the British Society of Children's Orthopaedic Surgery. The survey was conducted amongst orthopaedic surgeons treating children in the United Kingdom and Ireland. Results A total of 86 clinicians contributed to both rounds of the Delphi process, scoring priorities from one (low priority) to five (high priority). Elective topics were ranked higher than those relating to trauma, with the top ten elective research questions scoring higher than the top question for trauma. Ten elective, and five trauma research priorities were identified, with the three highest ranked questions relating to the treatment of slipped capital femoral epiphysis (mean score 4.6/ 5), Perthes' disease (4.5) and bone infection (4.5). Conclusion This consensus-based research agenda will guide surgeons, academics and funders to improve the evidence in children's orthopaedic surgery and encourage the development of multicentre clinical trials. Cite this article: Bone Joint J 2018;100-B:680-4.

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

Defining the role of a forensic hospital registered nurse using the Delphi method.

PubMed

Newman, Claire; Patterson, Karen; Eason, Michelle; Short, Ben

2016-11-01

A Delphi survey was undertaken to refine the position description of a registered nurse working in a forensic hospital, in New South Wales, Australia. Prior to commencing operation in 2008, position descriptions were developed from a review of legislation, as well as policies and procedures used by existing forensic mental health services in Australia. With an established workforce and an evolving model of care, a review of the initial registered nurse position description was required. An online Delphi survey was undertaken. Eight executive (88.9%) and 12 (58.3%) senior nursing staff participated in the first survey round. A total of four survey rounds were completed. At the final round, there was consensus (70%) that the revised position description was either very or somewhat suitable. There were a total of nine statements, from 31 originally produced in round 1, that did not reach consensus. The Delphi survey enabled a process for refining the Forensic Hospital registered nurse position description. Methods that facilitate executive and senior nursing staff consensus in the development and review of position descriptions should be considered in nursing management. © 2016 John Wiley & Sons Ltd.

A Delphi study to develop practical diagnostic guidelines for visual stress (pattern-related visual stress).

PubMed

Evans, Bruce J W; Allen, Peter M; Wilkins, Arnold J

Visual stress (VS) is characterised by symptoms of visual perceptual distortions and eyestrain when viewing text, symptoms that are alleviated by individually prescribed coloured filters. A recent review supports the existence of VS and its treatment, but noted that controversy remains, in part due to inconsistencies in the diagnosis of the condition. The present paper reviews the diagnostic criteria for VS in the literature and reports a Delphi analysis of the criteria currently used in clinical practice. Twenty-six eyecare practitioners were invited to participate in a Delphi study. They were selected because they were frequent prescribers of precision tinted lenses. In the first round they were sent a list of the indicators for which there is literature to suggest a relevance in the diagnosis of VS. The practitioners were invited to rank the indicators and add any additional criteria they use in diagnosis. In the second round a revised list was circulated, including items added from the responses in the first round. The respondents included optometrists, orthoptists and opticians. In the first round the response rate was 85%. Ninety-one percent of those who participated in the first round also responded in the second round. Strong indicators in the second round included the symptom of words moving when reading, voluntary use of an overlay for a prolonged period, improved performance of ≥15% with an overlay on the Wilkins Rate of Reading test, and an abnormally high score on the Pattern Glare Test. The strongest diagnostic criteria are combined in a diagnostic tool. This is proposed as a guide for clinical practice and further research. Copyright © 2016 Spanish General Council of Optometry. Published by Elsevier España, S.L.U. All rights reserved.

Determinants of adolescents' ineffective and improved coping with cyberbullying: a Delphi study.

PubMed

Jacobs, Niels C L; Dehue, Francine; Völlink, Trijntje; Lechner, Lilian

2014-06-01

The study's aim was to obtain an overview of all relevant variables involved in ineffective coping behavior and improvement in coping behavior as it pertains to cyberbullying among adolescents, in order to systematically develop a theory- and evidence-based intervention. This was done by means of a three round online Delphi study. First, 20 key experts listed possible relevant determinants. Next, 70 experts scored these determinants on their relevance and finally, experts rerated relevance of each determinant based on group median scores. The experts agreed that 115 items are relevant for ineffective (62) or improvement in (53) coping behavior. New found determinants were the extent to which one can adjust behavior upon feedback, impulsivity, self-confidence, communication style, personality, decision-making skills, conflict resolution skills, previous participation in personal resilience training, social relationships, rumors and self-disclosure. We conclude that the Delphi technique is useful in discovering new and relevant determinants of behavior. Copyright © 2014 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Development of a consensus taxonomy of sedentary behaviors (SIT): report of Delphi Round 1.

PubMed

Chastin, Sebastien Francois Martin; Schwarz, Ulf; Skelton, Dawn A; Skelton, Dawn Ann

2013-01-01

Over the last decade, sedentary behaviors have emerged as a distinctive behavioral paradigm with deleterious effects on health independent of physical activity. The next phase of research is to establish dose response between sedentary behaviors and health outcomes and improve understanding of context and determinants of these behaviors. Establishing a common taxonomy of these behaviors is a necessary step in this process. The Sedentary behavior International Taxonomy project was developed to establish a classification of sedentary behaviors by use of a formal consensus process. The study follows a Delphi process in three Rounds. A preparatory stage informed the development of terms of reference documents. In Round 1, experts were asked to make statements about the taxonomy; 1) its purpose and use ; 2) the domains, categories or facets that should be consider and include; 3) the structure/architecture to arrange and link these domains and facets. In Round 2 experts will be presented with a draft taxonomy emerging from Round 1 and invited to comment and propose alterations. The taxonomy will then be finalised at the outset of this stage. Results of Round 1 are reported here. There is a general consensus that a taxonomy will help advances in research by facilitating systematic and standardised: 1) investigation and analysis; 2) reporting and communication; 3) data pooling, comparison and meta-analysis; 4) development of measurement tools; 4) data descriptions, leading to higher quality in data querying and facilitate discoveries. There is also a consensus that such a taxonomy should be flexible to accommodate diverse purposes of use, and future advances in the field and yet provide a cross-disciplinary common language. A consensual taxonomy structure emerged with nine primary facets (Purpose, Environment, Posture, Social, Measurement, Associated behavior, Status, Time, Type) and the draft structure presented here for Round 2.

Quality indicators for in-hospital geriatric co-management programmes: a systematic literature review and international Delphi study.

PubMed

Van Grootven, Bastiaan; McNicoll, Lynn; Mendelson, Daniel A; Friedman, Susan M; Fagard, Katleen; Milisen, Koen; Flamaing, Johan; Deschodt, Mieke

2018-03-16

To find consensus on appropriate and feasible structure, process and outcome indicators for the evaluation of in-hospital geriatric co-management programmes. An international two-round Delphi study based on a systematic literature review (searching databases, reference lists, prospective citations and trial registers). Western Europe and the USA. Thirty-three people with at least 2 years of clinical experience in geriatric co-management were recruited. Twenty-eight experts (16 from the USA and 12 from Europe) participated in both Delphi rounds (85% response rate). Participants rated the indicators on a nine-point scale for their (1) appropriateness and (2) feasibility to use the indicator for the evaluation of geriatric co-management programmes. Indicators were considered appropriate and feasible based on a median score of seven or higher. Consensus was based on the level of agreement using the RAND/UCLA Appropriateness Method. In the first round containing 37 indicators, there was consensus on 14 indicators. In the second round containing 44 indicators, there was consensus on 31 indicators (structure=8, process=7, outcome=16). Experts indicated that co-management should start within 24 hours of hospital admission using defined criteria for selecting appropriate patients. Programmes should focus on the prevention and management of geriatric syndromes and complications. Key areas for comprehensive geriatric assessment included cognition/delirium, functionality/mobility, falls, pain, medication and pressure ulcers. Key outcomes for evaluating the programme included length of stay, time to surgery and the incidence of complications. The indicators can be used to assess the performance of geriatric co-management programmes and identify areas for improvement. Furthermore, the indicators can be used to monitor the implementation and effect of these programmes. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study

PubMed Central

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-01-01

Objectives To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. Methods A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. Results In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Conclusions Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. PMID:24670554

Assessing Consensus Between UK Renal Clinicians on Listing for Kidney Transplantation: A Modified Delphi Study.

PubMed

Tonkin-Crine, Sarah; Pruthi, Rishi; Taylor, Dominic M; Leydon, Geraldine M; Calestani, Melania; Oniscu, Gabriel C; Bradley, J Andrew; Tomson, Charles R; Bradley, Clare; Dudley, Christopher; Watson, Christopher J E; Draper, Heather; Johnson, Rachel J; Metcalfe, Wendy; Fogarty, Damian G; Ravanan, Rommel; Roderick, Paul

2018-05-01

It is well recognized that there is significant variation between centers in access to kidney transplantation. In the absence of high-grade evidence, it is unclear whether variation is due to patient case mix, other center factors, or individual clinician decisions. This study sought consensus between UK clinicians on factors that should influence access to kidney transplantation. As part of the Access to Transplantation and Transplant Outcome Measures project, consultant nephrologists and transplant surgeons in 71 centers were invited to participate in a Delphi study involving 2 rounds. During rounds 1 and 2, participants rated their agreement to 29 statements covering 8 topics regarding kidney transplantation. A stakeholder meeting was used to discuss statements of interest after the 2 rounds. In total, 122 nephrologists and 16 transplant surgeons from 45 units participated in rounds 1 and 2. After 2 rounds, 12 of 29 statements reached consensus. Fifty people participated in the stakeholder meeting. After the stakeholder meeting, a further 4 statements reached agreement. Of the 8 topics covered, consensus was reached in 6: use of a transplant protocol, patient age, body mass index, patient compliance with treatment, cardiac workup, and use of multidisciplinary meetings. Consensus was not reached on screening for malignancy and use of peripheral Doppler studies. The Delphi process identified factors upon which clinicians agreed and areas where consensus could not be achieved. The findings should inform national guidelines to support decision making in the absence of high quality evidence and to guide areas that warrant future research.

Assessing Consensus Between UK Renal Clinicians on Listing for Kidney Transplantation: A Modified Delphi Study

PubMed Central

Tonkin-Crine, Sarah; Pruthi, Rishi; Taylor, Dominic M.; Leydon, Geraldine M.; Calestani, Melania; Oniscu, Gabriel C.; Bradley, J. Andrew; Tomson, Charles R.; Bradley, Clare; Dudley, Christopher; Watson, Christopher J.E.; Draper, Heather; Johnson, Rachel J.; Metcalfe, Wendy; Fogarty, Damian G.; Ravanan, Rommel; Roderick, Paul

2018-01-01

Background It is well recognized that there is significant variation between centers in access to kidney transplantation. In the absence of high-grade evidence, it is unclear whether variation is due to patient case mix, other center factors, or individual clinician decisions. This study sought consensus between UK clinicians on factors that should influence access to kidney transplantation. Methods As part of the Access to Transplantation and Transplant Outcome Measures project, consultant nephrologists and transplant surgeons in 71 centers were invited to participate in a Delphi study involving 2 rounds. During rounds 1 and 2, participants rated their agreement to 29 statements covering 8 topics regarding kidney transplantation. A stakeholder meeting was used to discuss statements of interest after the 2 rounds. Results In total, 122 nephrologists and 16 transplant surgeons from 45 units participated in rounds 1 and 2. After 2 rounds, 12 of 29 statements reached consensus. Fifty people participated in the stakeholder meeting. After the stakeholder meeting, a further 4 statements reached agreement. Of the 8 topics covered, consensus was reached in 6: use of a transplant protocol, patient age, body mass index, patient compliance with treatment, cardiac workup, and use of multidisciplinary meetings. Consensus was not reached on screening for malignancy and use of peripheral Doppler studies. Conclusions The Delphi process identified factors upon which clinicians agreed and areas where consensus could not be achieved. The findings should inform national guidelines to support decision making in the absence of high quality evidence and to guide areas that warrant future research. PMID:29796414

Structured reporting for fibrosing lung disease: a model shared by radiologist and pulmonologist.

PubMed

Sverzellati, Nicola; Odone, Anna; Silva, Mario; Polverosi, Roberta; Florio, Carlo; Cardinale, Luciano; Cortese, Giancarlo; Addonisio, Giancarlo; Zompatori, Maurizio; Dalpiaz, Giorgia; Piciucchi, Sara; Larici, Anna Rita

2018-04-01

To apply the Delphi exercise with iterative involvement of radiologists and pulmonologists with the aim of defining a structured reporting template for high-resolution computed tomography (HRCT) of patients with fibrosing lung disease (FLD). The writing committee selected the HRCT criteria-the Delphi items-for rating from both radiology panelists (RP) and pulmonology panelists (PP). The Delphi items were first rated by RPs as "essential", "optional", or "not relevant". The items rated "essential" by < 80% of the RP were selected for the PP rating. The format of reporting was rated by both RP and PP. A total of 42 RPs and 12 PPs participated to the survey. In both Delphi round 1 and 2, 10/27 (37.7%) items were rated "essential" by more than 80% of RP. The remaining 17/27 (63.3%) items were rated by the PP in round 3, with 2/17 items (11.7%) rated "essential" by the PP. PP proposed additional items for conclusion domain, which were rated by RPs in the fourth round. Poor consensus was observed for the format of reporting. This study provides a template for structured report of FLD that features essential items as agreed by expert thoracic radiologists and pulmonologists.

Consensus in controversy: The modified Delphi method applied to Gynecologic Oncology practice.

PubMed

Cohn, David E; Havrilesky, Laura J; Osann, Kathryn; Lipscomb, Joseph; Hsieh, Susie; Walker, Joan L; Wright, Alexi A; Alvarez, Ronald D; Karlan, Beth Y; Bristow, Robert E; DiSilvestro, Paul A; Wakabayashi, Mark T; Morgan, Robert; Mukamel, Dana B; Wenzel, Lari

2015-09-01

To determine the degree of consensus regarding the probabilities of outcomes associated with IP/IV and IV chemotherapy. A survey was administered to an expert panel using the Delphi method. Ten ovarian cancer experts were asked to estimate outcomes for patients receiving IP/IV or IV chemotherapy. The clinical estimates were: 1) probability of completing six cycles of chemotherapy, 2) probability of surviving five years, 3) median survival, and 4) probability of ER/hospital visits during treatment. Estimates for two patients, one with a low comorbidity index (patient 1) and the other with a moderate index (patient 2), were included. The survey was administered in three rounds, and panelists could revise their subsequent responses based on review of the anonymous opinions of their peers. The ranges were smaller for IV compared with IP/IV therapy. Ranges decreased with each round. Consensus converged around outcomes related to IP/IV chemotherapy for: 1) completion of 6 cycles of therapy (type 1 patient, 62%, type 2 patient, 43%); 2) percentage of patients surviving 5 years (type 1 patient, 66%, type 2 patient, 47%); and 3) median survival (type 1 patient, 83 months, type 2 patient, 58 months). The group required three rounds to achieve consensus on the probabilities of ER/hospital visits (type 1 patient, 24%, type 2 patient, 35%). Initial estimates of survival and adverse events associated with IP/IV chemotherapy differ among experts. The Delphi process works to build consensus and may be a pragmatic tool to inform patients of their expected outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study.

PubMed

Mascherek, Anna C; Schwappach, David L B

2016-08-05

Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study

PubMed Central

Mascherek, Anna C

2016-01-01

Objective Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. Design As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Results Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Conclusions Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. PMID:27496233

Clinical Experiences for Agricultural Teacher Education Programs in North Carolina, South Carolina, and Virginia.

ERIC Educational Resources Information Center

Dobbins, Thomas R.; Camp, William G.

2003-01-01

In a three-round Delphi, secondary agriculture teachers and administrators, field staff and agriculture teacher educators (n=31, 33, 29) compiled a list of 102 tasks for early field experiences and student teaching experiences in agricultural education. The list is comprehensive enough for the three states where it was developed and flexible…

Surviving critical illness: what is next? An expert consensus statement on physical rehabilitation after hospital discharge.

PubMed

Major, M E; Kwakman, R; Kho, M E; Connolly, B; McWilliams, D; Denehy, L; Hanekom, S; Patman, S; Gosselink, R; Jones, C; Nollet, F; Needham, D M; Engelbert, R H H; van der Schaaf, M

2016-10-29

The study objective was to obtain consensus on physical therapy (PT) in the rehabilitation of critical illness survivors after hospital discharge. Research questions were: what are PT goals, what are recommended measurement tools, and what constitutes an optimal PT intervention for survivors of critical illness? A Delphi consensus study was conducted. Panelists were included based on relevant fields of expertise, years of clinical experience, and publication record. A literature review determined five themes, forming the basis for Delphi round one, which was aimed at generating ideas. Statements were drafted and ranked on a 5-point Likert scale in two additional rounds with the objective to reach consensus. Results were expressed as median and semi-interquartile range, with the consensus threshold set at ≤0.5. Ten internationally established researchers and clinicians participated in this Delphi panel, with a response rate of 80 %, 100 %, and 100 % across three rounds. Consensus was reached on 88.5 % of the statements, resulting in a framework for PT after hospital discharge. Essential handover information should include information on 15 parameters. A core set of outcomes should test exercise capacity, skeletal muscle strength, function in activities of daily living, mobility, quality of life, and pain. PT interventions should include functional exercises, circuit and endurance training, strengthening exercises for limb and respiratory muscles, education on recovery, and a nutritional component. Screening tools to identify impairments in other health domains and referral to specialists are proposed. A consensus-based framework for optimal PT after hospital discharge is proposed. Future research should focus on feasibility testing of this framework, developing risk stratification tools and validating core outcome measures for ICU survivors.

Ethical challenges facing veterinary professionals in Ireland: results from Policy Delphi with vignette methodology

PubMed Central

Magalhães-Sant'Ana, M.; More, S. J.; Morton, D. B.; Hanlon, A.

2016-01-01

Ethics is key to the integrity of the veterinary profession. Despite its importance, there is a lack of applied research on the range of ethical challenges faced by veterinarians. A three round Policy Delphi with vignette methodology was used to record the diversity of views on ethical challenges faced by veterinary professionals in Ireland. Forty experts, comprising veterinary practitioners, inspectors and nurses, accepted to participate. In round 1, twenty vignettes describing a variety of ethically challenging veterinary scenarios were ranked in terms of ethical acceptability, reputational risk and perceived standards of practice. Round 2 aimed at characterising challenges where future policy development or professional guidance was deemed to be needed. In round 3, possible solutions to key challenges were explored. Results suggest that current rules and regulations are insufficient to ensure best veterinary practices and that a collective approach is needed to harness workable solutions for the identified ethical challenges. Challenges pertaining mostly to the food chain seem to require enforcement measures whereas softer measures that promote professional discretion were preferred to address challenges dealing with veterinary clinical services. These findings can support veterinary representative bodies, advisory committees and regulatory authorities in their decision making, policy and regulation. PMID:27613779

Ethical challenges facing veterinary professionals in Ireland: results from Policy Delphi with vignette methodology.

PubMed

Magalhães-Sant'Ana, M; More, S J; Morton, D B; Hanlon, A

2016-10-29

Ethics is key to the integrity of the veterinary profession. Despite its importance, there is a lack of applied research on the range of ethical challenges faced by veterinarians. A three round Policy Delphi with vignette methodology was used to record the diversity of views on ethical challenges faced by veterinary professionals in Ireland. Forty experts, comprising veterinary practitioners, inspectors and nurses, accepted to participate. In round 1, twenty vignettes describing a variety of ethically challenging veterinary scenarios were ranked in terms of ethical acceptability, reputational risk and perceived standards of practice. Round 2 aimed at characterising challenges where future policy development or professional guidance was deemed to be needed. In round 3, possible solutions to key challenges were explored. Results suggest that current rules and regulations are insufficient to ensure best veterinary practices and that a collective approach is needed to harness workable solutions for the identified ethical challenges. Challenges pertaining mostly to the food chain seem to require enforcement measures whereas softer measures that promote professional discretion were preferred to address challenges dealing with veterinary clinical services. These findings can support veterinary representative bodies, advisory committees and regulatory authorities in their decision making, policy and regulation. British Veterinary Association.

Barriers and facilitators to providing undergraduate physiotherapy clinical education in the primary care setting: a three-round Delphi study.

PubMed

McMahon, S; Cusack, T; O'Donoghue, G

2014-03-01

With the global shift in health care from secondary to primary care, employment opportunities for newly qualified physiotherapists are likely to be in the primary care setting. However, to date, undergraduate physiotherapy clinical education has been centred around secondary care, focusing on acute services in large teaching hospitals. For contemporary physiotherapists to become effective first-contact primary care providers, they need to be exposed to the primary care environment during their undergraduate education. To explore the concept and identify perceived barriers and facilitators to providing physiotherapy undergraduate clinical placements in the primary healthcare setting A three-round Delphi survey was used. Participants were asked to answer open-ended questions with regard to: (i) student preparation for and (ii) provision of primary care placements (Round 1). Content analysis was employed to identify key themes. These themes generated statements for Round 2. In Round 2, participants were asked to rate their level of agreement/disagreement with the generated statements. In Round 3, a final rating process was conducted. Level of consensus was established as ≥70% agreement, with an interquartile range of ≤1. One hundred and ninety-eight primary care physiotherapy staff. Barriers identified included shortage of resources (e.g. staff) and a lack of tradition; in other words, students are not traditionally educated in the primary care setting. Response rates were 60% (120/198), 70% (84/120) and 76% (64/84) for Rounds 1, 2 and 3, respectively. All seven key facilitators identified reached consensus. They included additional support for staff taking students and motivated students. This study revealed that there is support for the provision of physiotherapy clinical education in the primary care setting. Through careful consideration with clear planning and collaboration with all stakeholders, it may be possible to convert the main barriers identified into facilitators to ensure that there will be an adequately prepared physiotherapy work force in the future. Copyright © 2013 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

The U. S. transportation sector in the year 2030: results of a two-part Delphi survey.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Morrison, G.; Stephens, T.S.; Univ. of California at Davis)

2011-10-11

A two-part Delphi Survey was given to transportation experts attending the Asilomar Conference on Transportation and Energy in August, 2011. The survey asked respondents about trends in the US transportation sector in 2030. Topics included: alternative vehicles, high speed rail construction, rail freight transportation, average vehicle miles traveled, truck versus passenger car shares, vehicle fuel economy, and biofuels in different modes. The survey consisted of two rounds -- both asked the same set of seven questions. In the first round, respondents were given a short introductory paragraph about the topic and asked to use their own judgment in their responses.more » In the second round, the respondents were asked the same questions, but were also given results from the first round as guidance. The survey was sponsored by Argonne National Lab (ANL), the National Renewable Energy Lab (NREL), and implemented by University of California at Davis, Institute of Transportation Studies. The survey was part of the larger Transportation Energy Futures (TEF) project run by the Department of Energy, Office of Energy Efficiency and Renewable Energy. Of the 206 invitation letters sent, 94 answered all questions in the first round (105 answered at least one question), and 23 of those answered all questions in the second round. 10 of the 23 second round responses were at a discussion section at Asilomar, while the remaining were online. Means and standard deviations of responses from Round One and Two are given in Table 1 below. One main purpose of Delphi surveys is to reduce the variance in opinions through successive rounds of questioning. As shown in Table 1, the standard deviations of 25 of the 30 individual sub-questions decreased between Round One and Round Two, but the decrease was slight in most cases.« less

Ethics and Agricultural Education: Determining Needs.

ERIC Educational Resources Information Center

Foster, Billye

2000-01-01

In a three-round Delphi (n=197, 109, 75), secondary teachers (61.5% in agriculture) identified important ethical issues regarding land and water use: conversion of agricultural land for urban development, water rights control, and public land used for agriculture. Nearly all addressed ethical issues in class. (SK)

Development of clinical pharmacy key performance indicators for hospital pharmacists using a modified Delphi approach.

PubMed

Fernandes, Olavo; Gorman, Sean K; Slavik, Richard S; Semchuk, William M; Shalansky, Steve; Bussières, Jean-François; Doucette, Douglas; Bannerman, Heather; Lo, Jennifer; Shukla, Simone; Chan, Winnie W Y; Benninger, Natalie; MacKinnon, Neil J; Bell, Chaim M; Slobodan, Jeremy; Lyder, Catherine; Zed, Peter J; Toombs, Kent

2015-06-01

Key performance indicators (KPIs) are quantifiable measures of quality. There are no published, systematically derived clinical pharmacy KPIs (cpKPIs). A group of hospital pharmacists aimed to develop national cpKPIs to advance clinical pharmacy practice and improve patient care. A cpKPI working group established a cpKPI definition, 8 evidence-derived cpKPI critical activity areas, 26 candidate cpKPIs, and 11 cpKPI ideal attributes in addition to 1 overall consensus criterion. Twenty-six clinical pharmacists and hospital pharmacy leaders participated in an internet-based 3-round modified Delphi survey. Panelists rated 26 candidate cpKPIs using 11 cpKPI ideal attributes and 1 overall consensus criterion on a 9-point Likert scale. A meeting was facilitated between rounds 2 and 3 to debate the merits and wording of candidate cpKPIs. Consensus was reached if 75% or more of panelists assigned a score of 7 to 9 on the consensus criterion during the third Delphi round. All panelists completed the 3 Delphi rounds, and 25/26 (96%) attended the meeting. Eight candidate cpKPIs met the consensus definition: (1) performing admission medication reconciliation (including best-possible medication history), (2) participating in interprofessional patient care rounds, (3) completing pharmaceutical care plans, (4) resolving drug therapy problems, (5) providing in-person disease and medication education to patients, (6) providing discharge patient medication education, (7) performing discharge medication reconciliation, and (8) providing bundled, proactive direct patient care activities. A Delphi panel of hospital pharmacists was successful in determining 8 consensus cpKPIs. Measurement and assessment of these cpKPIs will serve to advance clinical pharmacy practice and improve patient care. © The Author(s) 2015.

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

Independence and shared decision making: the role of smart home technology in empowering older adults.

PubMed

Demiris, George

2009-01-01

This study aims to explore the concepts of independence and shared decision making in the context of smart home technologies for older adults. We conducted a Delphi study with three rounds involving smart home designers, and researchers as well as community dwelling older adults. While there were differences in the way different stakeholders define these concepts, the study findings provide clear implications for the design, implementation and evaluation of smart home applications.

The Delphi Technique in Identifying Learning Objectives for the Development of Science, Technology and Society Modules for Palestinian Ninth Grade Science Curriculum

NASA Astrophysics Data System (ADS)

Abualrob, Marwan M. A.; Gnanamalar Sarojini Daniel, Esther

2013-10-01

This article outlines how learning objectives based upon science, technology and society (STS) elements for Palestinian ninth grade science textbooks were identified, which was part of a bigger study to establish an STS foundation in the ninth grade science curriculum in Palestine. First, an initial list of STS elements was determined. Second, using this list, ninth grade science textbooks and curriculum document contents were analyzed. Third, based on this content analysis, a possible list of 71 learning objectives for the integration of STS elements was prepared. This list of learning objectives was refined by using a two-round Delphi technique. The Delphi study was used to rate and to determine the consensus regarding which items (i.e. learning objectives for STS in the ninth grade science textbooks in Palestine) are to be accepted for inclusion. The results revealed that of the initial 71 objectives in round one, 59 objectives within round two had a mean score of 5.683 or higher, which indicated that the learning objectives could be included in the development of STS modules for ninth grade science in Palestine.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas

PubMed Central

Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-01-01

Introduction The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. Methods and analysis We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. Ethics and dissemination We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. PMID:28780546

Practitioner consensus on the determinants of capacity building practice in high-income countries.

PubMed

Swanepoel, Elizabeth; Fox, Ann; Hughes, Roger

2015-07-01

To assess and develop consensus among experienced public health nutrition practitioners from high-income countries regarding conceptualisation of capacity building in practice, and to test the content validity of a previously published conceptual framework for capacity building in public health nutrition practice. A Delphi study involving three iterations of email-delivered questionnaires testing a range of capacity determinants derived from the literature. Consensus was set at >50% of panellists ranking items as 'very important' on a five-point Likert scale across three survey rounds. Public health nutrition practice in Australia, the UK, Canada and the USA. Public health nutrition practitioners and academics. Result A total of thirty expert panellists (68% of an initial panel of forty-four participants) completed all three rounds of Delphi questionnaires. Consensus identified determinants of capacity building in practice including partnerships, resourcing, community development, leadership, workforce development, intelligence and quality of project management. The findings from the study suggest there is broad agreement among public health nutritionists from high-income countries about how they conceptualise capacity building in public health nutrition practice. This agreement suggests considerable content validity for a capacity building conceptual framework proposed by Baillie et al. (Public Health Nutr 12, 1031-1038). More research is needed to apply the conceptual framework to the implementation and evaluation of strategies that enhance the practice of capacity building approaches by public health nutrition professionals.

Designing a Standardized Laparoscopy Curriculum for Gynecology Residents: A Delphi Approach

PubMed Central

Shore, Eliane M.; Lefebvre, Guylaine G.; Husslein, Heinrich; Bjerrum, Flemming; Sorensen, Jette Led; Grantcharov, Teodor P.

2015-01-01

Background Evidence suggests that simulation leads to improved operative skill, shorter operating room time, and better patient outcomes. Currently, no standardized laparoscopy curriculum exists for gynecology residents. Objective To design a structured laparoscopy curriculum for gynecology residents using Delphi consensus methodology. Methods This study began with Delphi methodology to determine expert consensus on the components of a gynecology laparoscopic skills curriculum. We generated a list of cognitive content, technical skills, and nontechnical skills for training in laparoscopic surgery, and asked 39 experts in gynecologic education to rate the items on a Likert scale (1–5) for inclusion in the curriculum. Consensus was predefined as Cronbach α of ≥ 0.80. We then conducted another Delphi survey with 9 experienced users of laparoscopic virtual reality simulators to delineate relevant curricular tasks. Finally, a cross-sectional design defined benchmark scores for all identified tasks, with 10 experienced gynecologic surgeons performing the identified tasks at basic, intermediate, and advanced levels. Results Consensus (Cronbach α = 0.85) was achieved in the first round of the curriculum Delphi, and after 2 rounds (Cronbach α = 0.80) in the virtual reality curriculum Delphi. Consensus was reached for cognitive, technical, and nontechnical skills as well as for 6 virtual reality tasks. Median time and economy of movement scores defined benchmarks for all tasks. Conclusions This study used Delphi consensus to develop a comprehensive curriculum for teaching gynecologic laparoscopy. The curriculum conforms to current educational standards of proficiency-based training, and is suggested as a standard in residency programs. PMID:26221434

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses 1

PubMed Central

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; de Domenico, Edvane Birelo Lopes

2016-01-01

Abstract Objective: to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. Method: methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. Results: the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. Conclusion: the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. PMID:27305184

Exploring emerging learning needs: a UK-wide consultation on environmental sustainability learning objectives for medical education.

PubMed

Walpole, Sarah C; Mortimer, Frances; Inman, Alice; Braithwaite, Isobel; Thompson, Trevor

2015-12-24

This study aimed to engage wide-ranging stakeholders and develop consensus learning objectives for undergraduate and postgraduate medical education. A UK-wide consultation garnered opinions of healthcare students, healthcare educators and other key stakeholders about environmental sustainability in medical education. The policy Delphi approach informed this study. Draft learning objectives were revised iteratively during three rounds of consultation: online questionnaire or telephone interview, face-to-face seminar and email consultation. Twelve draft learning objectives were developed based on review of relevant literature. In round one, 64 participants' median ratings of the learning objectives were 3.5 for relevance and 3.0 for feasibility on a Likert scale of one to four. Revisions were proposed, e.g. to highlight relevance to public health and professionalism. Thirty three participants attended round two. Conflicting opinions were explored. Added content areas included health benefits of sustainable behaviours. To enhance usability, restructuring provided three overarching learning objectives, each with subsidiary points. All participants from rounds one and two were contacted in round three, and no further edits were required. This is the first attempt to define consensus learning objectives for medical students about environmental sustainability. Allowing a wide range of stakeholders to comment on multiple iterations of the document stimulated their engagement with the issues raised and ownership of the resulting learning objectives.

Identifying content for simulation-based curricula in urology: a national needs assessment.

PubMed

Nayahangan, Leizl Joy; Bølling Hansen, Rikke; Gilboe Lindorff-Larsen, Karen; Paltved, Charlotte; Nielsen, Bjørn Ulrik; Konge, Lars

2017-12-01

Simulation-based training is well recognized in the transforming field of urological surgery; however, integration into the curriculum is often unstructured. Development of simulation-based curricula should follow a stepwise approach starting with a needs assessment. This study aimed to identify technical procedures in urology that should be included in a simulation-based curriculum for residency training. A national needs assessment was performed using the Delphi method involving 56 experts with significant roles in the education of urologists. Round 1 identified technical procedures that newly qualified urologists should perform. Round 2 included a survey using an established needs assessment formula to explore: the frequency of procedures; the number of physicians who should be able to perform the procedure; the risk and/or discomfort to patients when a procedure is performed by an inexperienced physician; and the feasibility of simulation training. Round 3 involved elimination and reranking of procedures according to priority. The response rates for the three Delphi rounds were 70%, 55% and 67%, respectively. The 34 procedures identified in Round 1 were reduced to a final prioritized list of 18 technical procedures for simulation-based training. The five procedures that reached the highest prioritization were cystoscopy, transrectal ultrasound-guided biopsy of the prostate, placement of ureteral stent, insertion of urethral and suprapubic catheter, and transurethral resection of the bladder. The prioritized list of technical procedures in urology that were identified as highly suitable for simulation can be used as an aid in the planning and development of simulation-based training programs.

Essential Concepts of Nanoscale Science and Technology for High School Students Based on a Delphi Study by the Expert Community

ERIC Educational Resources Information Center

Sakhnini, Sohair; Blonder, Ron

2015-01-01

Nanoscale science and technology (NST) is an important new field in modern science. In the current study, we seek to answer the question: "What are the essential concepts of NST that should be taught in high school"? A 3-round Delphi study methodology was applied based on 2 communities of experts in nanotechnology research and science…

Establishing a Taxonometric Structure for the Study of Biotechnology in Secondary School Technology Education.

ERIC Educational Resources Information Center

Wells, John G.

1994-01-01

A Delphi panel of 19 experts identified 8 main knowledge areas of biotechnology: bioprocessing, foundations, genetic engineering, agriculture, biochemistry, medicine, environment, and bioethics. Round 2 elicited 84 subdivisions and round 3 adjusted the ratings. The resulting classification suggests a different context and focus for technology…

Development of guidelines to assist organisations to support employees returning to work after an episode of anxiety, depression or a related disorder: a Delphi consensus study with Australian professionals and consumers

PubMed Central

2012-01-01

Background Mental disorders are a significant cause of disability and loss of workplace productivity. The scientific evidence for how organisations should best support those returning to work after common mental disorders is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods A systematic review of websites, books and journal articles was conducted to develop a 387 item survey containing strategies that organisations might use to support those returning to work after common mental disorders. Three panels of Australian experts (66 health professionals, 30 employers and 80 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results The participation rate across all three rounds was 60.2% (57.6% health professionals, 76.7% employers, 56.3% consumers). 308 strategies were endorsed as essential or important by at least 80% of all three panels. The endorsed strategies provided information on policy and procedures, the roles of supervisors, employees and colleagues in managing absence and return to work, and provision of mental health information and training. Conclusions The guidelines outline strategies for organisations supporting those returning to work after common mental disorders. It is hoped that they may be used to inform policy and practice in a variety of workplaces. PMID:22943604

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study.

PubMed

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-09-01

To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Latin American Consensus for Pediatric Cardiopulmonary Resuscitation 2017: Latin American Pediatric Critical Care Society Pediatric Cardiopulmonary Resuscitation Committee.

PubMed

López-Herce, Jesús; Almonte, Enma; Alvarado, Manuel; Bogado, Norma Beatriz; Cyunel, Mariana; Escalante, Raffo; Finardi, Christiane; Guzmán, Gustavo; Jaramillo-Bustamante, Juan C; Madrid, Claudia C; Matamoros, Martha; Moya, Luis Augusto; Obando, Grania; Reboredo, Gaspar; López, Lissette R; Scheu, Christian; Valenzuela, Alejandro; Yerovi, Rocío; Yock-Corrales, Adriana

2018-03-01

To develop a Latin American Consensus about Pediatric Cardiopulmonary Resuscitation. To clarify, reinforce, and adapt some specific recommendations for pediatric patients and to stimulate the implementation of these recommendations in clinical practice. Expert consensus recommendations with Delphi methodology. Latin American countries. Experts in pediatric cardiopulmonary resuscitation from 19 Latin American countries. Delphi methodology for expert consensus. The goal was to reach consensus with all the participating experts for every recommendation. An agreement of at least 80% of the participating experts had to exist in order to deliver a recommendation. Two Delphi voting rounds were sent out electronically. The experts were asked to score between 1 and 9 their level of agreement for each recommendation. The score was then classified into three groups: strong agreement (score 7-9), moderate agreement (score 4-6), and disagreement (score 1-3). Nineteen experts from 19 countries participated in both voting rounds and in the whole process of drafting the recommendations. Sixteen recommendations about organization of cardiopulmonary resuscitation, prevention, basic resuscitation, advanced resuscitation, and postresuscitation measures were approved. Ten of them had a consensus of 100%. Four of them were agreed by all the participants except one (94.7% consensus). One recommendation was agreed by all except two experts (89.4%), and finally, one was agreed by all except three experts (84.2%). All the recommendations reached a level of agreement. This consensus adapts 16 international recommendations to Latin America in order to improve the practice of cardiopulmonary resuscitation in children. Studies should be conducted to analyze the effectiveness of the implementation of these recommendations.

Guideline for Reporting Interventions on Spinal Manipulative Therapy: Consensus on Interventions Reporting Criteria List for Spinal Manipulative Therapy (CIRCLe SMT).

PubMed

Groeneweg, Ruud; Rubinstein, Sidney M; Oostendorp, Rob A B; Ostelo, Raymond W J G; van Tulder, Maurits W

2017-02-01

The aim of the Consensus on Interventions Reporting Criteria List for Spinal Manipulative Therapy (CIRCLe SMT) study was to develop a criteria list for reporting spinal manipulative therapy (SMT). A Delphi procedure was conducted from September 2011 to April 2013 and consisted of international experts in the field of SMT. The authors formed a steering committee and invited participants, selected initial items, structured the comments of the participants after each Delphi round, and formulated the feedback. To ensure content validity, a large number of international experts from different SMT-related disciplines were invited to participate. A workshop was organized following the consensus phase, and it was used to discuss and refine the wording of the items. In total, 123 experts from 18 countries participated. These experts included clinicians (70%), researchers (93%), and academics working in the area of SMT (27%), as well as journal editors (14%). (Note: The total is more than 100% because most participants reported 2 jobs.) Three Delphi rounds were necessary to reach a consensus. The criteria list comprised 24 items under 5 domains, including (1) rationale of the therapy, (2) description of the intervention, (3) SMT techniques, (4) additional intervention/techniques, and (5) quantitative data. A valid criteria list was constructed with the aim of promoting consistency in reporting SMT intervention in scientific publications. Copyright © 2016. Published by Elsevier Inc.

Considerations when conducting e-Delphi research: a case study.

PubMed

Toronto, Coleen

2017-06-22

Background E-Delphi is a way to access a geographically dispersed group of experts. It is similar to other Delphi methods but conducted online. E-research methodologies, such as the e-Delphi method, have yet to undergo significant critical discussion. Aim To highlight some of the challenges nurse researchers may wish to consider when using e-Delphi in their research. Discussion This paper provides details about the author's approach to conducting an e-Delphi study in which a group of health literacy nurse experts (n=41) used an online survey platform to identify and prioritise essential health literacy competencies for registered nurses. Conclusion This paper advances methodological discourse about e-Delphi by critically assessing an e-Delphi case study. The online survey platform used in this study was advantageous for the researcher and the experts: the experts could participate at any time and place where the internet was available; the researcher could efficiently access a national group of experts, track responses and analyse data in each round. Implications for practice E-Delphi studies create opportunities for nurse researchers to conduct research nationally and internationally. Before conducting an e-Delphi study, researchers should carefully consider the design and methods for collecting data, to avoid challenges that could potentially compromise the quality of the findings. Researchers are encouraged to publish details about their approaches to e-Delphi studies, to advance the state of the science.

Issues and Needs in Rural Early Childhood Special Education Services in Florida: A Delphi Study.

ERIC Educational Resources Information Center

Weiss, Keith E.; Correa, Vivian I.

A Delphi Technique was used to examine the problems of early childhood special education programs in rural Florida. Two rounds of questionnaires were completed by a panel of early childhood special education administrators and teachers from 14 of Florida's 27 rural counties. In response to the questionnaires, the panel developed 51 problem-related…

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

Application of the Delphi technique in healthcare maintenance.

PubMed

Njuangang, Stanley; Liyanage, Champika; Akintoye, Akintola

2017-10-09

Purpose The purpose of this paper is to examine the research design, issues and considerations in the application of the Delphi technique to identify, refine and rate the critical success factors and performance measures in maintenance-associated infections. Design/methodology/approach In-depth literature review through the application of open and axial coding were applied to formulate the interview and research questions. These were used to conduct an exploratory case study of two healthcare maintenance managers, randomly selected from two National Health Service Foundation Trusts in England. The results of exploratory case study provided the rationale for the application of the Delphi technique in this research. The different processes in the application of the Delphi technique in healthcare research are examined thoroughly. Findings This research demonstrates the need to apply and integrate different research methods to enhance the validity of the Delphi technique. The rationale for the application of the Delphi technique in this research is because some healthcare maintenance managers lack knowledge about basic infection control (IC) principles to make hospitals safe for patient care. The result of first round of the Delphi exercise is a useful contribution in its own rights. It identified a number of salient issues and differences in the opinions of the Delphi participants, noticeably between healthcare maintenance managers and members of the infection control team. It also resulted in useful suggestions and comments to improve the quality and presentation of the second- and third-round Delphi instruments. Practical implications This research provides a research methodology that can be adopted by researchers investigating new and emerging issues in the healthcare sector. As this research demonstrates, the Delphi technique is relevant in soliciting expert knowledge and opinion to identify performance measures to control maintenance-associated infections in hospitals. The methodology provided here could be applied by other researchers elsewhere to probe, investigate and generate rich information about new and emerging healthcare research topics. Originality/value The authors demonstrate how different research methods can be integrated to enhance the validity of the Delphi technique. For example, the results of an exploratory case study provided the rationale for the application of the Delphi technique investigating the key performance measures in maintenance-associated infections. The different processes involved in the application of the Delphi technique are also carefully explored and discussed in depth.

Measuring organisational readiness for patient engagement (MORE): an international online Delphi consensus study.

PubMed

Oostendorp, Linda J M; Durand, Marie-Anne; Lloyd, Amy; Elwyn, Glyn

2015-02-14

Widespread implementation of patient engagement by organisations and clinical teams is not a reality yet. The aim of this study is to develop a measure of organisational readiness for patient engagement designed to monitor and facilitate a healthcare organisation's willingness and ability to effectively implement patient engagement in healthcare. The development of the MORE (Measuring Organisational Readiness for patient Engagement) scale was guided by Weiner's theory of organisational readiness for change. Weiner postulates that an organisation's readiness is determined by both the willingness and ability to implement the change (i.e. in this context: patient engagement). A first version of the scale was developed based on a literature search and evaluation of pre-existing tools. We invited multi-disciplinary stakeholders to participate in a two-round online Delphi survey. Respondents were asked to rate the importance of each proposed item, and to comment on the proposed domains and items. Second round participants received feedback from the first round and were asked to re-rate the importance of the revised, new and unchanged items, and to provide comments. The first version of the scale contained 51 items divided into three domains: (1) Respondents' characteristics; (2) the organisation's willingness to implement patient engagement; and (3) the organisation's ability to implement patient engagement. 131 respondents from 16 countries (health care managers, policy makers, clinicians, patients and patient representatives, researchers, and other stakeholders) completed the first survey, and 72 of them also completed the second survey. During the Delphi process, 34 items were reworded, 8 new items were added, 5 items were removed, and 18 were combined. The scale's instructions were revised. The final version of MORE totalled 38 items; 5 on stakeholders, 13 on an organisation's willingness to implement, and 20 on an organisation's ability to implement patient engagement in healthcare. The Delphi technique was successfully used to refine the scale's instructions, domains and items, using input from a broad range of international stakeholders, hoping that MORE can be applied in a variety of healthcare contexts worldwide. Further assessment is needed to determine the psychometric properties of the scale.

Study of labor-negotiation productivity concerns in the petroleum-refining industry

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, J.E.

The primary objective of this study was to identify productivity factors relative to negotiating future labor contracts with the Oil, Chemical and Atomic Workers International Union (OCAWIU). A Delphi research method was utilized to accomplish this purpose. The study utilized three rounds to obtain the stated objectives. Round one involved the use of an open instrument to solicit productivity factors that would be beneficial in future negotiations with the OCAWIU. In round two, two separate instruments were sent to the panel members who were asked to judge the value of each item on the first instrument, and to rank themore » ten most significant items on the second. The round three instruments were individualized for each panel member. The productivity items were rated by the panel members, and descriptive statistics were used to describe the combined order of listings and weights for determining the relative importance of each factor in the consensus model. The nonparametric statistics were used to examine the degree of consensus between the mean values on the first instrument with the ranked values for the second instrument. No significant differences were formed. Twenty-five productivity items were identified and prioritized as viable negotiable items with the OCAWIU.« less

Nursing diagnoses (NANDA-I) in hematology-oncology: a Delphi-study.

PubMed

Speksnijder, Herma T; Mank, Arno P; van Achterberg, Theo

2011-01-01

To identify NANDA-I diagnoses that are most relevant to hematology-oncology nursing in Europe. In a two-round, electronic, quantitative Delphi study, 28 experts from nine European countries assessed the relevance of NANDA-I diagnoses and health problems. This study identified 64 relevant diagnoses and three health problems. All experts listed 11 diagnoses: "imbalanced nutrition: less than body requirements,"diarrhea,"fatigue,"risk for bleeding,"risk for infection,"impaired oral mucous membrane,"risk for impaired skin integrity,"impaired skin integrity,"hyperthermia,"nausea,"acute pain," and the health problem "pruritis." The "NANDA-I classification 2009-2011" describes, in almost all disease- and treatment-related problems, nursing diagnoses as relevant to the adult patient with hematological malignancy. These diagnoses are therefore recommended. © 2011, The Authors. International Journal of Nursing Terminologies and Classifications © 2011, NANDA International.

Development of a core outcome set for use in determining the overall success of gastroschisis treatment.

PubMed

Allin, Benjamin; Ross, Andrew; Marven, Sean; J Hall, Nigel; Knight, Marian

2016-07-27

Gastroschisis research is limited in quality by the presence of significant heterogeneity in outcome measure reporting (PloS One 10(1):e0116908, 2015). Using core outcome sets in research is one proposed method for addressing this problem (Trials 13:103, 2012; Clin Rheumatol 33(9):1313-1322, 2014; Health Serv Res Policy 17(1):1-2, 2012). Ultimately, standardising outcome measure reporting will improve research quality and translate into improvements in patient care. Candidate outcome measures have been identified through systematic reviews. These outcome measures will form the starting point for an online, three-phase Delphi process that will be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel, panel 2 is a non-neonatal panel and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1-9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's gastroschisis treatment. In round 2, experts will be presented with the same list of outcome measures and with graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. The results of the Delphi process will be discussed, and outcomes re-scored. Outcome measures where > 70 % of the participants at the meeting scored them as 7-9 and < 15 % scored them as 1-3 will form the core outcome set. Development of a core outcome set will help to reduce the heterogeneity of the outcome measure reporting in gastroschisis. This will increase the quality of research taking place and ultimately improve care provided to infants with gastroschisis.

Important challenges for coordination and inter-municipal cooperation in health care services: a Delphi study

PubMed Central

2013-01-01

Background Demographical changes have stimulated a coordination reform in the Norwegian health care sector, creating new working practices and extending coordination within and between primary and hospital care, increasing the need for inter-municipal cooperation (IMC). This study aimed to identify challenges to coordination and IMC in the Norwegian health care sector as a basis for further theorizing and managerial advice in this growing area of research and practice. Methods A Delphi study of consensus development was used. Experts in coordination and IMC in health care services were selected by the healthcare manager or the councillor in their respective municipalities. In the first round, an expert panel received open-ended questions addressing possible challenges, and their answers were categorized and consolidated as the basis for further validation in the second round. The expert panel members were then asked to point out important statements in the third round, before the most important statements ranked by a majority of the members were rated again in the fourth round, including the option to explain the ratings. The same procedure was used in round five, with the exception that the expert panel members could view the consolidated results of their previous rankings as the basis for a new and final rating. The statements reaching consensus in round five were abstracted and themed. Results Nineteen experts consented to participate. Nine experts (47%) completed all of the five rounds. Eight statements concerning coordination reached consensus, resulting in four themes covering these challenges: different culture, uneven balance of power, lack of the possibility to communicate electronically, and demanding tasks in relation to resources. Three statements regarding challenges to IMC reached consensus, resulting in following themes: coopetition, complex leadership, and resistance to change. Conclusions This study identified several important challenges for coordination and it supports previous research. IMC in health care services deals with challenges other than coordination, and these must be addressed specifically. Our study contributes to extended knowledge of theoretical and practical implications in the field of coordination and IMC in health care sector. PMID:24171839

Identifying the relevant features of the National Digital Cadastral Database (NDCDB) for spatial analysis by using the Delphi Technique

NASA Astrophysics Data System (ADS)

Halim, N. Z. A.; Sulaiman, S. A.; Talib, K.; Ng, E. G.

2018-02-01

This paper explains the process carried out in identifying the relevant features of the National Digital Cadastral Database (NDCDB) for spatial analysis. The research was initially a part of a larger research exercise to identify the significance of NDCDB from the legal, technical, role and land-based analysis perspectives. The research methodology of applying the Delphi technique is substantially discussed in this paper. A heterogeneous panel of 14 experts was created to determine the importance of NDCDB from the technical relevance standpoint. Three statements describing the relevant features of NDCDB for spatial analysis were established after three rounds of consensus building. It highlighted the NDCDB’s characteristics such as its spatial accuracy, functions, and criteria as a facilitating tool for spatial analysis. By recognising the relevant features of NDCDB for spatial analysis in this study, practical application of NDCDB for various analysis and purpose can be widely implemented.

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research.

PubMed

Staniszewska, S; Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-08-02

Background  While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. Objective  To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. Methods  The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. Results  143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. Conclusions  GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Experience of Delphi technique in the process of establishing consensus on core competencies.

PubMed

Raghav, Pankaja Ravi; Kumar, Dewesh; Bhardwaj, Pankaj

2016-01-01

The Department of Community Medicine and Family Medicine (CMFM) has been started as a new model for imparting the components of family medicine and delivering health-care services at primary and secondary levels in all six newly established All India Institute of Medical Sciences (AIIMS), but there is no competency-based curriculum for it. The paper aims to share the experience of Delphi method in the process of developing consensus on core competencies of the new model of CMFM in AIIMS for undergraduate medical students in India. The study adopted different approaches and methods, but Delphi was the most critical method used in this research. In Delphi, the experts were contacted by e-mail and their feedback on the same was analyzed. Two rounds of Delphi were conducted in which 150 participants were contacted in Delphi-I but only 46 responded. In Delphi-II, 26 participants responded whose responses were finally considered for analysis. Three of the core competencies namely clinician, primary-care physician, and professionalism were agreed by all the participants, and the least agreement was observed in the competencies of epidemiologist and medical teacher. The experts having more experience were less consistent as responses were changed from agree to disagree in more than 15% of participants and 6% changed from disagree to agree. Within the given constraints, the final list of competencies and skills for the discipline of CMFM compiled after the Delphi process will provide a useful insight into the development of competency-based curriculum of the subject.

Consulting the oracle: ten lessons from using the Delphi technique in nursing research.

PubMed

Keeney, Sinead; Hasson, Felicity; McKenna, Hugh

2006-01-01

The aim of this paper was to provide insight into the Delphi technique by outlining our personal experiences during its use over a 10-year period in a variety of applications. As a means of achieving consensus on an issue, the Delphi research method has become widely used in healthcare research generally and nursing research in particular. The literature on this technique is expanding, mainly addressing what it is and how it should be used. However, there is still much confusion and uncertainty surrounding it, particularly about issues such as modifications, consensus, anonymity, definition of experts, how 'experts' are selected and how non-respondents are pursued. This issues that arise when planning and carrying out a Delphi study include the definition of consensus; the issue of anonymity vs. quasi-anonymity for participants; how to estimate the time needed to collect the data, analyse each 'round', feed back results to participants, and gain their responses to this feedback; how to define and select the 'experts' who will be asked to participate; how to enhance response rates; and how many 'rounds' to conduct. Many challenges and questions are raised when using the Delphi technique, but there is no doubt that it is an important method for achieving consensus on issues where none previously existed. Researchers need to adapt the method to suit their particular study.

Research priorities in medical education at Shiraz University of Medical Sciences:categories and subcategories in the Iranian context

PubMed Central

NABEIEI, PARISA; AMINI, MITRA; GHANAVATI, SHIRIN; MARHAMATI, SAADAT

2016-01-01

Introduction Research in education is a globally significant issue without a long history. Due to the importance of the issue in Health System Development programs, this study intended to determine research priorities in medical education, considering their details and functions. By determining barriers existing in research in education progress, it is tried to make research priorities more functional by recommending acceptable strategies. Methods This is a qualitative-descriptive study in two descriptive phases. The goal of these phases was to determine research priorities subcategories in medical education by Nominal Group Technique (NGT) and two rounds of Delphi method. Through the first phase, subcategories of research priorities were determined, using Nominal Group Technique under medical education experts’ supervision. Through two rounds of Delphi, a questionnaire was constructed based on the subcategories. Eventually, research priorities were determined based on their highest score (scores more than 7 out of 10). Results In the first phase (NGT), 35 priorities in 5 major fields of medical education were presented. In the second phase, priorities were scored, using Delphi method. Medical Ethics and professionalism gained the highest scores (7.63±1.26) and educational evaluation the lowest (7.28±1.52). In this stage, 7 items were omitted but 2 of them were added again after experts’ revision in the third round of Delphi. Conclusion According to the results of the present study and based on previous studies, it really seems that the fields of “Learning and Teaching Approaches” and “Medical Ethics and Professionalism” were more important. Because of financial and resource limitations in our country and the importance of research priorities, it is recommended to frequently study “research priorities determination program” at universities. PMID:26793723

Development of a competency framework for optometrists with a specialist interest in glaucoma.

PubMed

Myint, J; Edgar, D F; Kotecha, A; Crabb, D P; Lawrenson, J G

2010-09-01

To develop a competency framework, using a modified Delphi methodology, for optometrists with a specialist interest in glaucoma, which would provide a basis for training and accreditation. A modified iterative Delphi technique was used using a 16-member panel consisting almost exclusively of sub-specialist optometrists and ophthalmologists. The first round involved scoring the relevance of a draft series of competencies using a 9-point Likert scale with a free-text option to modify any competency or suggest additional competencies. The revised framework was subjected to a second round of scoring and free-text comment. The Delphi process was followed by a face-to-face structured workshop to debate and agree the final framework. The version of the framework agreed at the workshop was sent out for a 4-month period of external stakeholder validation. There was a 100% response to round 1 and an 94% response to round 2. All panel members attended the workshop. The final version of the competency framework was validated by a subsequent stakeholder consultation and contained 19 competencies for the diagnosis of glaucoma and 7 further competencies for monitoring and treatment. Application of a consensus methodology consisting of a modified Delphi technique allowed the development of a competency framework for glaucoma specialisation by optometrists. This will help to shape the development of a speciality curriculum and potentially could be adapted for other healthcare professionals.

Developing an industry-oriented safety curriculum using the Delphi technique.

PubMed

Chen, Der-Fa; Wu, Tsung-Chih; Chen, Chi-Hsiang; Chang, Shu-Hsuan; Yao, Kai-Chao; Liao, Chin-Wen

2016-09-01

In this study, we examined the development of industry-oriented safety degree curricula at a college level. Based on a review of literature on the practices and study of the development of safety curricula, we classified occupational safety and health curricula into the following three domains: safety engineering, health engineering, and safety and health management. We invited 44 safety professionals to complete a four-round survey that was designed using a modified Delphi technique. We used Chi-square statistics to test the panel experts' consensus on the significance of the items in the three domains and employed descriptive statistics to rank the participants' rating of each item. The results showed that the top three items for each of the three domains were Risk Assessment, Dangerous Machinery and Equipment, and Fire and Explosion Prevention for safety engineering; Ergonomics, Industrial Toxicology, and Health Risk Assessment for health engineering; and Industrial Safety and Health Regulations, Accident Investigation and Analysis, and Emergency Response for safety and health management. Only graduates from safety programmes who possess practical industry-oriented abilities can satisfy industry demands and provide value to the existence of college safety programmes.

A hospital-based child protection programme evaluation instrument: a modified Delphi study.

PubMed

Wilson, Denise; Koziol-McLain, Jane; Garrett, Nick; Sharma, Pritika

2010-08-01

Refine instrument for auditing hospital-based child abuse and neglect violence intervention programmes prior to field-testing. A modified Delphi study to identify and rate items and domains indicative of an effective and quality child abuse and neglect intervention programme. Experts participated in four Delphi rounds: two surveys, a one-day workshop and the opportunity to comment on the penultimate instrument. New Zealand. Twenty-four experts in the field of care and protection of children. Items with panel agreement >or=85% and mean importance rating >or=4.0 (scale from 1 (not important) to 5 (very important)). There was high-level consensus on items across Rounds 1 and 2 (89% and 85%, respectively). In Round 3 an additional domain (safety and security) was agreed upon and cultural issues, alert systems for children at risk, and collaboration among primary care, community, non-government and government agencies were discussed. The final instrument included nine domains ('policies and procedures', 'safety and security', 'collaboration', 'cultural environment', 'training of providers', 'intervention services', 'documentation' 'evaluation' and 'physical environment') and 64 items. The refined instrument represents the hallmarks of an ideal child abuse and neglect programme given current knowledge and experience. The instrument enables rigorous evaluations of hospital-based child abuse and neglect intervention programmes for quality improvement and benchmarking with other programmes.

Development of guidelines for giving community presentations about eating disorders: a Delphi study.

PubMed

Doley, Joanna Rachel; Hart, Laura Merilyn; Stukas, Arthur Anthony; Morgan, Amy Joanna; Rowlands, Danielle Lisa; Paxton, Susan Jessica

2017-01-01

Concerns exist around how to talk about eating disorders (EDs) due to evidence that suggests discussing ED symptoms and behaviours may cause or worsen symptoms in vulnerable people. Using expert consensus, we developed a set of guidelines for giving safe community presentations about EDs. Participants with professional ED expertise, and people with lived experience of an ED, were recruited for a Delphi study. N  = 26 panel members rated 367 statements for both a) inclusion in guidelines, and b) their potential to be helpful (increase knowledge, reduce stigma) or harmful (increase stigma, cause/worsen ED symptoms). After each round of the study, statements were classified as endorsed, re-rate, or not endorsed. 208 statements were endorsed by the panel over three rounds. 13 statements were strongly endorsed in the first round, with both people with lived experience and professionals agreeing it is important for presentations to include information on etiology of EDs and to promote help-seeking. Several statements had a high level of disagreement between those with lived experience and professionals, including the idea that presentations should suggest dieting is likely to result in weight gain. The experts were able to develop consensus on a wide range of issues. Panel members, particularly people with lived experience, were sensitive to aspects of presentations that may be harmful to an audience. The guidelines fill an important gap in the literature and provide guidance to those educating the public about EDs; they should, however, be further evaluated to test their efficacy.

The use of advanced web-based survey design in Delphi research.

PubMed

Helms, Christopher; Gardner, Anne; McInnes, Elizabeth

2017-12-01

A discussion of the application of metadata, paradata and embedded data in web-based survey research, using two completed Delphi surveys as examples. Metadata, paradata and embedded data use in web-based Delphi surveys has not been described in the literature. The rapid evolution and widespread use of online survey methods imply that paper-based Delphi methods will likely become obsolete. Commercially available web-based survey tools offer a convenient and affordable means of conducting Delphi research. Researchers and ethics committees may be unaware of the benefits and risks of using metadata in web-based surveys. Discussion paper. Two web-based, three-round Delphi surveys were conducted sequentially between August 2014 - January 2015 and April - May 2016. Their aims were to validate the Australian nurse practitioner metaspecialties and their respective clinical practice standards. Our discussion paper is supported by researcher experience and data obtained from conducting both web-based Delphi surveys. Researchers and ethics committees should consider the benefits and risks of metadata use in web-based survey methods. Web-based Delphi research using paradata and embedded data may introduce efficiencies that improve individual participant survey experiences and reduce attrition across iterations. Use of embedded data allows the efficient conduct of multiple simultaneous Delphi surveys across a shorter timeframe than traditional survey methods. The use of metadata, paradata and embedded data appears to improve response rates, identify bias and give possible explanation for apparent outlier responses, providing an efficient method of conducting web-based Delphi surveys. © 2017 John Wiley & Sons Ltd.

Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature.

PubMed

Moreira, Danilo Gomes; Costello, Joseph T; Brito, Ciro J; Adamczyk, Jakub G; Ammer, Kurt; Bach, Aaron J E; Costa, Carlos M A; Eglin, Clare; Fernandes, Alex A; Fernández-Cuevas, Ismael; Ferreira, José J A; Formenti, Damiano; Fournet, Damien; Havenith, George; Howell, Kevin; Jung, Anna; Kenny, Glen P; Kolosovas-Machuca, Eleazar S; Maley, Matthew J; Merla, Arcangelo; Pascoe, David D; Priego Quesada, Jose I; Schwartz, Robert G; Seixas, Adérito R D; Selfe, James; Vainer, Boris G; Sillero-Quintana, Manuel

2017-10-01

The importance of using infrared thermography (IRT) to assess skin temperature (t sk ) is increasing in clinical settings. Recently, its use has been increasing in sports and exercise medicine; however, no consensus guideline exists to address the methods for collecting data in such situations. The aim of this study was to develop a checklist for the collection of t sk using IRT in sports and exercise medicine. We carried out a Delphi study to set a checklist based on consensus agreement from leading experts in the field. Panelists (n = 24) representing the areas of sport science (n = 8; 33%), physiology (n = 7; 29%), physiotherapy (n = 3; 13%) and medicine (n = 6; 25%), from 13 different countries completed the Delphi process. An initial list of 16 points was proposed which was rated and commented on by panelists in three rounds of anonymous surveys following a standard Delphi procedure. The panel reached consensus on 15 items which encompassed the participants' demographic information, camera/room or environment setup and recording/analysis of t sk using IRT. The results of the Delphi produced the checklist entitled "Thermographic Imaging in Sports and Exercise Medicine (TISEM)" which is a proposal to standardize the collection and analysis of t sk data using IRT. It is intended that the TISEM can also be applied to evaluate bias in thermographic studies and to guide practitioners in the use of this technique. Copyright © 2017 Elsevier Ltd. All rights reserved.

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists

PubMed Central

2017-01-01

Purpose This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. Methods A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects’ responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Results Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Conclusion Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience. PMID:28900069

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists.

PubMed

Hwang, Yoon-Sook; Kang, Hyun-Sook; Kim, Soo-Hwa; Moon, Hee-Jung; Lee, Sun-Mi; Jung, Jae-Yeon; Hwang, Su-Jeong; Ha, Jung-Eun

2017-01-01

This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects' responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience.

Transatlantic Multispecialty Consensus on Fundamental Endovascular Skills: Results of a Delphi Consensus Study.

PubMed

Maertens, H; Aggarwal, R; Macdonald, S; Vermassen, F; Van Herzeele, I

2016-01-01

The aim of this study was to establish a consensus on Fundamental Endovascular Skills (FES) for educational purposes and development of training curricula for endovascular procedures. The term "Fundamental Endovascular Skills" is widely used; however, the current literature does not explicitly describe what skills are included in this concept. Endovascular interventions are performed by several specialties that may have opposing perspectives on these skills. A two round Delphi questionnaire approach was used. Experts from interventional cardiology, interventional radiology, and vascular surgery from the United States and Europe were invited to participate. An electronic questionnaire was generated by endovascular therapists with an appropriate educational background but who would not participate in subsequent rounds. The questionnaire consisted of 50 statements describing knowledge, technical, and behavioral skills during endovascular procedures. Experts received the questionnaires by email. They were asked to rate the importance of each skill on a Likert scale from 1 to 5. A statement was considered fundamental when more than 90% of the experts rated it 4 or 5 out of 5. Twenty-three of 53 experts invited agreed to participate: six interventional radiologists (2 USA, 4 Europe), 10 vascular surgeons (4 USA, 6 Europe), and seven interventional cardiologists (4 USA, 3 Europe). There was a 100% response rate in the first round and 87% in the second round. Results showed excellent consensus among responders (Cronbach's alpha = .95 first round; .93 second round). Ninety percent of all proposed skills were considered fundamental. The most critical skills were determined. A transatlantic multispecialty consensus was achieved about the content of "FES" among interventional radiologists, interventional cardiologists, and vascular surgeons from Europe and the United States. These results can serve as directive principles for developing endovascular training curricula. Copyright © 2015 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Defining the Bobath concept using the Delphi technique.

PubMed

Raine, Sue

2006-03-01

The Bobath concept, based on the work of Berta and Karel Bobath, offers therapists working in the field of neurological rehabilitation a framework for their clinical interventions. It is the most commonly used approach in the UK. Although they recognize that over the last half-century the concept has undergone considerable developments, proponents of the Bobath concept have been criticized for not publishing these changes. The aim of the present study was to use the Delphi technique to enable experts in the field to define the current Bobath concept. A four-round Delphi study design was used. The sample included all members of the British Bobath Tutor's Association, who are considered experts in the field. Initial statements were identified from the literature, with respondents generating additional statements during the study. The level of agreement was determined using a five-point Likert scale. The respondents were then provided with feedback on group opinions and given an opportunity to re-rate each statement. The level of group consensus was set at 80%. Fifteen experts took part. The response rate was 85% in the first round, and 93% in each subsequent round. Ten statements from the literature were rated with a further 12 generated by the experts. Thirteen statements achieved consensus for agreement and seven for disagreement. The Delphi study was an effective research tool, maintaining anonymity of responses and exploring expert opinions on the Bobath concept. The experts stated that Bobath's work has been misunderstood if it is considered as the inhibition of spasticity and the facilitation of normal movement, as described in some literature. They agreed that the Bobath concept was developed by the Bobaths as a living concept, understanding that as therapists' knowledge base grows their view of treatment broadens.

Development of key performance indicators for prehospital emergency care.

PubMed

Murphy, Adrian; Wakai, Abel; Walsh, Cathal; Cummins, Fergal; O'Sullivan, Ronan

2016-04-01

Key performance indicators (KPIs) are used to monitor and evaluate critical areas of clinical and support functions that influence patient outcome. Traditional prehospital emergency care performance monitoring has focused solely on response time metrics. The landscape of emergency care delivery in Ireland is in the process of significant national reconfiguration. The development of KPIs is therefore considered one of the key priorities in prehospital research. The aim of this study was to develop a suite of KPIs for prehospital emergency care in Ireland. A systematic literature review of prehospital care performance measurement was undertaken followed by a three-round Delphi consensus process facilitated by a broad-based multidisciplinary group of panellists. The consensus process was conducted between June 2012 and October 2013. Each candidate indicator on the Delphi survey questionnaire was rated using a 5-point Likert-type rating scale. Agreement was defined as at least 70% of responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using descriptive statistics. Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Of the 78 citations identified by the systematic review, 5 relevant publications were used to select candidate indicators for the Delphi round 1 questionnaire. Response rates in Delphi rounds 1 and 2 were 89% and 83%, respectively. Following the consensus development conference, 101 KPIs reached consensus. Based on the Donabedian framework for quality-of-care indicators, 7 of the KPIs which reached agreement were structure KPIs, 74 were process KPIs and 20 were outcome KPIs. The highest ranked indicator was a process KPI ('Direct transport of ST-elevation myocardial infarction patients to a primary percutaneous intervention (PCI)-capable facility for ECG to PCI time <90 min'). Improving the quality of prehospital care requires the development and implementation of performance measurement using scientifically valid and reliable KPIs. Employing a Delphi panel of key multidisciplinary Emergency Medical Service stakeholders, it was feasible to develop a suite of 101 KPIs for performance monitoring of prehospital emergency care in Ireland. This suite of KPIs may contribute to a framework for achieving safer, better care in the prehospital environment. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

TREatment of ATopic eczema (TREAT) Registry Taskforce: protocol for an international Delphi exercise to identify a core set of domains and domain items for national atopic eczema registries.

PubMed

Gerbens, Louise A A; Boyce, Aaron E; Wall, Dmitri; Barbarot, Sebastien; de Booij, Richard J; Deleuran, Mette; Middelkamp-Hup, Maritza A; Roberts, Amanda; Vestergaard, Christian; Weidinger, Stephan; Apfelbacher, Christian J; Irvine, Alan D; Schmitt, Jochen; Williamson, Paula R; Spuls, Phyllis I; Flohr, Carsten

2017-02-27

Patients with moderate-to-severe atopic eczema (AE) often require photo- or systemic immunomodulatory therapies to induce disease remission and maintain long-term control. The current evidence to guide clinical management is small, despite the frequent and often off-label use of these treatments. Registries of patients on photo- and systemic immunomodulatory therapies could fill this gap, and the collection of a core set concerning these therapies in AE will allow direct comparisons across registries as well as data sharing and pooling. Using an eDelphi approach, the international TREatment of ATopic eczema (TREAT) Registry Taskforce aims to seek consensus between key stakeholders internationally on a core set of domains and domain items for AE patient registries with a research focus that collect data of children and adults on photo- and systemic immunomodulatory therapies. Participants from six stakeholder groups will be invited: doctors, nurses, non-clinical researchers, patients, as well as industry and regulatory body representatives. The eDelphi will comprise three sequential online rounds, requesting participants to rate the importance of each proposed domain and domain items. Participants will be able to add domains and domain items to the proposed list in round 1. A final consensus meeting will be held with representatives of each stakeholder group. Identifying a uniform core set of domains and domain items to be captured by AE patient registries will increase the utility of individual registries, and provide greater insight into the effectiveness, safety and cost-effectiveness of photo- and systemic immunomodulatory therapies to guide clinical management across dermatology centres and country borders. Not applicable. This eDelphi study was registered in the Core Outcome Measures for Effectiveness Trials (COMET) database.

An examination of the research priorities for a hospice service in New Zealand: A Delphi study.

PubMed

de Vries, Kay; Walton, Jo; Nelson, Katherine; Knox, Rhondda

2016-06-01

Palliative care research is relatively diverse and prioritizing research in this field is dependent on multiple factors such as complex ethical decisions in designing and conducting the research; access to participants who may be deemed "vulnerable" and an increasingly medically focused approach to care. The aim of this study was to inform organizational decision-making and policy development regarding future research priorities for a hospice service in New Zealand. A modified three-round Delphi technique was employed. Participants were drawn from one dedicated specialist palliative care service that delivers care in the community, day-care, hospice inpatient, aged residential care, and acute hospital palliative care service. A purposive sample included palliative care staff (n = 10, 18, 9, for rounds 1-3, respectively) volunteers (n = 10, 12, 11); and patients and family carers (n = 6, 8, for rounds 1 and 2). Patients and family carers were not involved in the third round. At final ranking of six research themes encompassing 23 research topics were identified by staff and volunteers. These were: symptom management; aged care; education; community; patient and family; and bereavement support and young people. Patients and family carers agreed on four themes, made up of 10 research topics. These were: decision-making, bereavement and loss, symptom management; and recognition of need and response of service. The study generated a rich set of research themes and specific research topics. The perspectives of staff and volunteers are significantly different from those of patients and family members, in spite of the recognition by all concerned that palliative care services work within a philosophy of patient-centered care. Open discussion of ideas has the potential to engage both staff and patients and carers in quality improvement initiatives, and to reinforce the value of research for patient care.

Development of a Consensus Taxonomy of Sedentary Behaviors (SIT): Report of Delphi Round 1

PubMed Central

Chastin, Sebastien Francois Martin; Schwarz, Ulf; Skelton, Dawn Ann

2013-01-01

Background Over the last decade, sedentary behaviors have emerged as a distinctive behavioral paradigm with deleterious effects on health independent of physical activity. The next phase of research is to establish dose response between sedentary behaviors and health outcomes and improve understanding of context and determinants of these behaviors. Establishing a common taxonomy of these behaviors is a necessary step in this process. Aim The Sedentary behavior International Taxonomy project was developed to establish a classification of sedentary behaviors by use of a formal consensus process. Methods The study follows a Delphi process in three Rounds. A preparatory stage informed the development of terms of reference documents. In Round 1, experts were asked to make statements about the taxonomy; 1) its purpose and use ; 2) the domains, categories or facets that should be consider and include; 3) the structure/architecture to arrange and link these domains and facets. In Round 2 experts will be presented with a draft taxonomy emerging from Round 1 and invited to comment and propose alterations. The taxonomy will then be finalised at the outset of this stage. Results Results of Round 1 are reported here. There is a general consensus that a taxonomy will help advances in research by facilitating systematic and standardised: 1) investigation and analysis; 2) reporting and communication; 3) data pooling, comparison and meta-analysis; 4) development of measurement tools; 4) data descriptions, leading to higher quality in data querying and facilitate discoveries. There is also a consensus that such a taxonomy should be flexible to accommodate diverse purposes of use, and future advances in the field and yet provide a cross-disciplinary common language. A consensual taxonomy structure emerged with nine primary facets (Purpose, Environment, Posture, Social, Measurement, Associated behavior, Status, Time, Type) and the draft structure presented here for Round 2. PMID:24312653

Chartered Society of Physiotherapy's identification of national research priorities for physiotherapy using a modified Delphi technique.

PubMed

Rankin, Gabrielle; Rushton, Alison; Olver, Pat; Moore, Ann

2012-09-01

To define research priorities to strategically inform the evidence base for physiotherapy practice. A modified Delphi method using SurveyMonkey software identified priorities for physiotherapy research through national consensus. An iterative process of three rounds provided feedback. Round 1 requested five priorities using pre-defined prioritisation criteria. Content analysis identified research themes and topics. Round 2 requested rating of the importance of the research topics using a 1-5 Likert scale. Round 3 requested a further process of rating. Quantitative and qualitative data informed decision-making. Level of consensus was established as mean rating ≥ 3.5, coefficient of variation ≤ 30%, and ≥ 55% agreement. Consensus across participants was evaluated using Kendall's W. Four expert panels (n=40-61) encompassing a range of stakeholders and reflecting four core areas of physiotherapy practice were established by steering groups (n=204 participants overall). Response rates of 53-78% across three rounds were good. The identification of 24/185 topics for musculoskeletal, 43/174 for neurology, 30/120 for cardiorespiratory and medical rehabilitation, and 30/113 for mental and physical health and wellbeing as priorities demonstrated discrimination of the process. Consensus between participants was good for most topics. Measurement validity of the research topics was good. The involvement of multiple stakeholders as participants ensured the current context of the intended use of the priorities. From a process of national consensus involving key stakeholders, including service users, physiotherapy research topics have been identified and prioritised. Setting priorities provides a vision of how research can contribute to the developing research base in physiotherapy to maximise focus. Copyright © 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Determining the Criteria and Their Weights for Medical Schools' Ranking: A National Consensus.

PubMed

Mojtahedzadeh, Rita; Mohammadi, Aeen; Kohan, Noushin; Gharib, Mitra; Zolfaghari, Mitra

2016-06-01

Delphi as a consensus development technique enables anonymous, systematic refinement of expert opinion with the aim of arriving at a combined or consensual position. In this study, we determined the criteria and their weights for Iranian Medical Schools' ranking through a Delphi process. An expert committee devised 13 proposed criteria with 32 indicators with their weights, which were arranged hierarchically in the form of a tree diagram. We used the Delphi technique to reach a consensus on these criteria and weights among the deans of 38 public Iranian medical schools. For this purpose, we devised and sent a questionnaire to schools and asked them to suggest or correct the criteria and their weights. We repeated this process in two rounds till all the schools reached an acceptable consensus on them. All schools reached a consensus on the set of 13 criteria and 30 indicators and their weights in three main contexts of education, research and facilities, and equipment which were used for Medical Schools' ranking. Using Delphi technique for devising the criteria and their weights in evaluation processes such as ranking makes their results more acceptable among universities.

National Delphi study to determine competencies for nursing leadership in public health.

PubMed

Misener, T R; Alexander, J W; Blaha, A J; Clarke, P N; Cover, C M; Felton, G M; Fuller, S G; Herman, J; Rodes, M M; Sharp, H F

1997-01-01

To identify competencies needed by nurse leaders in public health programs. Five-round national Delphi. Convenience sample of members of major public health nursing associations and nurse and non-nurse public health leaders in the USA. Mailed survey in 1994-1995 using a modified snowball technique based on a modification of the Pew Foundation health professions' competencies for Round 1. Four additional rounds produced consensus. Initially, 62 competencies were identified. Factor analysis resulted in four factors: political competencies, business acumen, program leadership, and management capabilities; 57 competencies were clustered in the four groupings and accounted for 91.4% of the variance. Graduate schools in nursing and public health must prepare students with broad-based competencies from a variety of disciplines. Findings of this national survey provide a database for curriculum development and evaluation of programs to prepare nurse leaders for roles in public health-based delivery systems.

Expert surgical consensus for prenatal counseling using the Delphi method.

PubMed

Berman, Loren; Jackson, Jordan; Miller, Kristen; Kowalski, Rebecca; Kolm, Paul; Luks, Francois I

2017-11-28

Pediatric surgeons frequently offer prenatal consultation for congenital pulmonary airway malformation (CPAM) and congenital diaphragmatic hernia (CDH); however, there is no evidence-based consensus to guide prenatal decision making and counseling for these conditions. Eliciting feedback from experts is integral to defining best practice regarding prenatal counseling and intervention. A Delphi consensus process was undertaken using a panel of pediatric surgeons identified as experts in fetal therapy to address current limitations. Areas of discrepancy in the literature on CPAM and CDH were identified and used to generate a list of content and intervention questions. Experts were invited to participate in an online Delphi survey. Items that did not reach first-round consensus were broken down into additional questions, and consensus was achieved in the second round. Fifty-four surgeons (69%) responded to at least one of the two survey rounds. During round one, consensus was reached on 54 of 89 survey questions (61%), and 45 new questions were developed. During round two, consensus was reached on 53 of 60 survey questions (88%). We determined expert consensus to establish guidelines regarding perinatal management of CPAM and CDH. Our results can help educate pediatric surgeons participating in perinatal care of these patients. V. Copyright © 2017 Elsevier Inc. All rights reserved.

A cross-validation Delphi method approach to the diagnosis and treatment of personality disorders in older adults.

PubMed

Rosowsky, Erlene; Young, Alexander S; Malloy, Mary C; van Alphen, S P J; Ellison, James M

2018-03-01

The Delphi method is a consensus-building technique using expert opinion to formulate a shared framework for understanding a topic with limited empirical support. This cross-validation study replicates one completed in the Netherlands and Belgium, and explores US experts' views on the diagnosis and treatment of older adults with personality disorders (PD). Twenty-one geriatric PD experts participated in a Delphi survey addressing diagnosis and treatment of older adults with PD. The European survey was translated and administered electronically. First-round consensus was reached for 16 out of 18 items relevant to diagnosis and specific mental health programs for personality disorders in older adults. Experts agreed on the usefulness of establishing criteria for specific types of treatments. The majority of psychologists did not initially agree on the usefulness of pharmacotherapy. Expert consensus was reached following two subsequent rounds after clarification addressing medication use. Study results suggest consensus among regarding psychosocial treatments. Limited acceptance amongst US psychologists about the suitability of pharmacotherapy for late-life PDs contrasted with the views expressed by experts surveyed in Netherlands and Belgium studies.

Measuring elimination of podoconiosis, endemicity classifications, case definition and targets: an international Delphi exercise.

PubMed

Deribe, Kebede; Wanji, Samuel; Shafi, Oumer; Muheki Tukahebwa, Edridah; Umulisa, Irenee; Davey, Gail

2015-09-01

Podoconiosis is one of the major causes of lymphoedema in the tropics. Nonetheless, currently there are no endemicity classifications or elimination targets to monitor the effects of interventions. This study aimed at establishing case definitions and indicators that can be used to assess endemicity, elimination and clinical outcomes of podoconiosis. This paper describes the result of a Delphi technique used among 28 experts. A questionnaire outlining possible case definitions, endemicity classifications, elimination targets and clinical outcomes was developed. The questionnaire was distributed to experts working on podoconiosis and other neglected tropical diseases in two rounds. The experts rated the importance of case definitions, endemic classifications, elimination targets and the clinical outcome measures. Median and mode were used to describe the central tendency of expert responses. The coefficient of variation was used to describe the dispersals of expert responses. Consensus on definitions and indicators for assessing endemicity, elimination and clinical outcomes of podoconiosis directed at policy makers and health workers was achieved following the two rounds of Delphi approach among the experts. Based on the two Delphi rounds we discuss potential indicators and endemicity classification of this disabling disease, and the ongoing challenges to its elimination in countries with the highest prevalence. Consensus will help to increase effectiveness of podoconiosis elimination efforts and ensure comparability of outcome data. © The Author 2015. Published by Oxford University Press on behalf of Royal Society of Tropical Medicine and Hygiene.

How to use the nominal group and Delphi techniques.

PubMed

McMillan, Sara S; King, Michelle; Tully, Mary P

2016-06-01

Introduction The Nominal Group Technique (NGT) and Delphi Technique are consensus methods used in research that is directed at problem-solving, idea-generation, or determining priorities. While consensus methods are commonly used in health services literature, few studies in pharmacy practice use these methods. This paper provides an overview of the NGT and Delphi technique, including the steps involved and the types of research questions best suited to each method, with examples from the pharmacy literature. Methodology The NGT entails face-to-face discussion in small groups, and provides a prompt result for researchers. The classic NGT involves four key stages: silent generation, round robin, clarification and voting (ranking). Variations have occurred in relation to generating ideas, and how 'consensus' is obtained from participants. The Delphi technique uses a multistage self-completed questionnaire with individual feedback, to determine consensus from a larger group of 'experts.' Questionnaires have been mailed, or more recently, e-mailed to participants. When to use The NGT has been used to explore consumer and stakeholder views, while the Delphi technique is commonly used to develop guidelines with health professionals. Method choice is influenced by various factors, including the research question, the perception of consensus required, and associated practicalities such as time and geography. Limitations The NGT requires participants to personally attend a meeting. This may prove difficult to organise and geography may limit attendance. The Delphi technique can take weeks or months to conclude, especially if multiple rounds are required, and may be complex for lay people to complete.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas.

PubMed

Hoekstra, Dyon; Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-08-04

The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Standards for midwife practitioners of external cephalic version: A Delphi study.

PubMed

Walker, Shawn; Perilakalathil, Prasanth; Moore, Jenny; Gibbs, Claire L; Reavell, Karen; Crozier, Kenda

2015-05-01

expansion of advanced and specialist midwifery practitioner roles across professional boundaries requires an evidence-based framework to evaluate achievement and maintenance of competency. In order to develop the role of Breech Specialist Midwife to include the autonomous performance of external cephalic version within one hospital, guidance was required on standards of training and skill development, particularly in the use of ultrasound. a three-round Delphi survey was used to determine consensus among an expert panel, including highly experienced obstetric and midwife practitioners, as well as sonographers. The first round used mostly open-ended questions to gather data, from which statements were formed and returned to the panel for evaluation in subsequent rounds. standards for achieving and maintaining competence to perform ECV, and in the use of basic third trimester ultrasound as part of this practice, should be the same for midwives and doctors. The maintenance of proficiency requires regular practice. midwives can appropriately expand their sphere of practice to include ECV and basic third trimester ultrasound, according to internal guidelines, following the completion of a competency-based training programme roughly equivalent to those used to guide obstetric training. Ideally, ECV services should be offered in organised clinics where individual practitioners in either profession are able to perform approximately 30 or more ECVs per year in order to maintain an appropriate level of skill. Copyright © 2015 Elsevier Ltd. All rights reserved.

Components of cognitive competence predictive of occupational competence in persons with dementia: a Delphi study.

PubMed

Zur, Briana M; Rudman, Debbie Laliberte; Johnson, Andrew M; Roy, Eric A; Wells, Jennie L

2013-04-01

Within the area of dementia care, occupational therapists are asked to predict occupational competence in everyday living and often do so by assessing cognitive competence. Considering the cognitive changes that occur with dementia over time, the construct of cognitive competence is a key consideration. Still, a gap exists in the literature examining the relationship between cognitive competence and occupational competence. This study developed a consensus among participating Canadian occupational therapists regarding the components of cognitive competence they considered essential to predict occupational competence in people with dementia. A three-round Delphi study was completed with English- and French-speaking occupational therapists (n = 127; 116; 125) experienced in dementia care. Ten cognitive components were identified as essential to predict occupational competence in individuals with dementia. The 10 identified components provide direction for assessment practices and education in dementia care and for development of measurement tools.

The main indicators for Iranian hospital ethical accreditation

PubMed Central

ENJOO, SEYED ALI; AMINI, MITRA; TABEI, SEYED ZIAADIN; MAHBUDI, ALI; KAVOSI, ZAHRA; SABER, MAHBOOBEH

2015-01-01

Introduction The application of organizational ethics in hospitals is one of the novel ways to improve medical ethics. Nowadays achieving efficient and sufficient ethical hospital indicators seems to be inevitable. In this connection, the present study aims to determine the best indicators in hospital accreditation. Methods 69 indicators in 11 fields to evaluate hospital ethics were achieved through a five-step qualitative and quantitative study including literature review, expert focus group, Likert scale survey, 3 rounded Delphi, and content validity measurement. Expert focus group meeting was conducted, employing Nominal Group Technique (NGT). After running NGT, a three rounded Delphi and parallel to Delphi and a Likert scale survey were performed to obtain objective indicators for each domain. The experts were all healthcare professionals who were also medical ethics researchers, teachers, or PhD students. Content validity measurements were computed, using the viewpoints of two different expert groups, some ethicists, and some health care professionals (n=46). Results After conducting NGT, Delphi, Likert survey, 11 main domains were listed including:  Informed consent, Medical confidentiality, Physician-patient economic relations, Ethics consultation policy in the hospital, Ethical charter of hospital, Breaking bad medical news protocol, Respect for the patients’ rights, Clinical ethics committee, Spiritual and palliative care unit programs in the hospitals, Healthcare professionals’ communication skills, and Equitable access to the healthcare. Also 71 objective indicators for these 11 domains were listed in 11 tables with 5 to 8 indicators per table. Content Validity Ratio (CVR) measurements were done and 69 indicators were highlighted. Conclusion The domains listed in this study seem to be the most important ones for evaluating hospital ethics programs and services. Healthcare organizations’ accreditation and ranking are crucial for the improvement of healthcare services. Ethics programs would also motivate hospitals to improve their services and move towards patients’ satisfaction. In this regard, more involvement of bioethicists can help healthcare organizations to develop ethics programs and ensure ethics-based practice in hospitals. PMID:26269789

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

Mental Health First Aid guidelines for helping a suicidal person: a Delphi consensus study in the Philippines

PubMed Central

2010-01-01

Background This study aimed to develop guidelines for how a member of the Filipino public should provide mental health first aid to a person who is suicidal. Methods The guidelines were produced by developing a questionnaire containing possible first aid actions and asking an expert panel of 34 Filipino mental health clinicians to rate whether each action should be included in the guidelines. The content of the questionnaire was based on a systematic search of the relevant evidence and claims made by authors of consumer and carer guides and websites. The panel members were asked to complete the questionnaire by web survey. Three rounds of the rating were carried and, at the end of each round, items that reached the consensus criterion were selected for inclusion in the guidelines. During the first round, panel members were also asked to suggest any additional actions that were not covered in the original questionnaire (to include items that are relevant to local cultural circumstances, values, and social norms). Responses to these open-ended questions were used to generate new items. Results The output from the Delphi process was a set of agreed upon action statements. The Delphi process started with 138 statements, 48 new items were written based on suggestions from panel members and, of these 186 items, 102 met the consensus criterion. These statements were used to develop the guidelines appended to this paper. The guidelines are currently being translated into local languages. Conclusions There are a number of actions that are considered to be useful for members of the public when they encounter someone who is experiencing suicidal thoughts or engaging in suicidal behaviour. Although the guidelines are designed for members of the public, they may also be helpful to non-mental health professionals working in health and welfare settings. PMID:21167076

Mental Health First Aid guidelines for helping a suicidal person: a Delphi consensus study in Japan

PubMed Central

2011-01-01

Background This study aimed to develop guidelines for how a member of the Japanese public should provide mental health first aid to a person who is suicidal. Methods The guidelines were produced by developing a questionnaire containing possible first aid actions and asking an expert panel of 32 Japanese mental health professionals to rate whether each action should be included in the guidelines. The content of the questionnaire was based on a systematic search of the relevant evidence and claims made by authors of consumer and carer guides and websites. The panel members were asked to complete the questionnaire by web survey. Three rounds of the rating were carried and, at the end of each round, items that reached the consensus criterion were selected for inclusion in the guidelines. During the first round, panel members were also asked to suggest any additional actions that were not covered in the original questionnaire (to include items that are relevant to local cultural circumstances, values, and social norms). Responses to these open-ended questions were used to generate new items. Results The output from the Delphi process was a set of agreed upon action statements. The Delphi process started with 138 statements, 38 new items were written based on suggestions from panel members and, of these 176 items, 56 met the consensus criterion. These statements were used to develop the guidelines appended to this article. Conclusions There are a number of actions that are considered to be useful for members of the Japanese public when they encounter someone who is experiencing suicidal thoughts or engaging in suicidal behaviour. Although the guidelines are designed for members of the public, they may also be helpful to health professionals working in health and welfare settings who do not have clinical mental health training. PMID:21592409

Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies.

PubMed

Diamond, Ivan R; Grant, Robert C; Feldman, Brian M; Pencharz, Paul B; Ling, Simon C; Moore, Aideen M; Wales, Paul W

2014-04-01

To investigate how consensus is operationalized in Delphi studies and to explore the role of consensus in determining the results of these studies. Systematic review of a random sample of 100 English language Delphi studies, from two large multidisciplinary databases [ISI Web of Science (Thompson Reuters, New York, NY) and Scopus (Elsevier, Amsterdam, NL)], published between 2000 and 2009. About 98 of the Delphi studies purported to assess consensus, although a definition for consensus was only provided in 72 of the studies (64 a priori). The most common definition for consensus was percent agreement (25 studies), with 75% being the median threshold to define consensus. Although the authors concluded in 86 of the studies that consensus was achieved, consensus was only specified a priori (with a threshold value) in 42 of these studies. Achievement of consensus was related to the decision to stop the Delphi study in only 23 studies, with 70 studies terminating after a specified number of rounds. Although consensus generally is felt to be of primary importance to the Delphi process, definitions of consensus vary widely and are poorly reported. Improved criteria for reporting of methods of Delphi studies are required. Copyright © 2014 Elsevier Inc. All rights reserved.

Acne severity grading: determining essential clinical components and features using a Delphi consensus.

PubMed

Tan, Jerry; Wolfe, Barat; Weiss, Jonathan; Stein-Gold, Linda; Bikowski, Joseph; Del Rosso, James; Webster, Guy F; Lucky, Anne; Thiboutot, Diane; Wilkin, Jonathan; Leyden, James; Chren, Mary-Margaret

2012-08-01

There are multiple global scales for acne severity grading but no singular standard. Our objective was to determine the essential clinical components (content items) and features (property-related items) for an acne global grading scale for use in research and clinical practice using an iterative method, the Delphi process. Ten acne experts were invited to participate in a Web-based Delphi survey comprising 3 iterative rounds of questions. In round 1, the experts identified the following clinical components (primary acne lesions, number of lesions, extent, regional involvement, secondary lesions, and patient experiences) and features (clinimetric properties, ease of use, categorization of severity based on photographs or text, and acceptance by all stakeholders). In round 2, consensus for inclusion in the scale was established for primary lesions, number, sites, and extent; as well as clinimetric properties and ease of use. In round 3, consensus for inclusion was further established for categorization and acceptance. Patient experiences were excluded and no consensus was achieved for secondary lesions. The Delphi panel consisted solely of the United States (U.S.)-based acne experts. Using an established method for achieving consensus, experts in acne vulgaris concluded that an ideal acne global grading scale would comprise the essential clinical components of primary acne lesions, their quantity, extent, and facial and extrafacial sites of involvement; with features of clinimetric properties, categorization, efficiency, and acceptance. Copyright © 2011 American Academy of Dermatology, Inc. Published by Mosby, Inc. All rights reserved.

Community Engagement in the CTSA Program: Stakeholder Responses from a National Delphi Process

PubMed Central

Seifer, Sarena D.; Stupak, Matthew; Martinez, Linda Sprague

2014-01-01

Abstract In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community‐Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. PMID:24841362

Community engagement in the CTSA program: stakeholder responses from a national Delphi process.

PubMed

Freeman, Elmer; Seifer, Sarena D; Stupak, Matthew; Martinez, Linda Sprague

2014-06-01

In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community-Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. © 2014 Wiley Periodicals, Inc.

Establishing nursing-sensitive quality indicators for the operating room: A cross-sectional Delphi survey conducted in China.

PubMed

Wu, Qi; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-01-01

Nursing-sensitive quality indicators comprise principles, procedures, and assessments to quantify the level of nursing quality in hospital departments. Although studies have demonstrated that quality indicators are essential for monitoring nursing practice in the operating room (OR), nursing quality in China is highly subjective and localised OR nursing-sensitive quality indicators are lacking. This study aimed to establish scientific, objective and comprehensive nursing-sensitive quality indicators for the OR to evaluate and monitor OR nursing care quality in China. Literature search for relevant evidence-based studies was performed using Cochrane, Medline, PubMed, Embase, and other databases, followed by literature review and group discussion by the expert panel. Two successive rounds of Delphi surveys were conducted using questionnaires completed by the expert panel to reach consensus and define nursing-sensitive quality indicators for the OR. Two rounds of Delphi surveys each had 100% questionnaire retrieval rate, with Kendall W coordination coefficients ranging from 0.096 to 0.263 (P<0.001). In round 1 of expert evaluation of 26 indicators, Kendall's W was 0.263 for importance, 0.126 for rationality, and 0.125 for feasibility of data collection (all P<0.001). After round 2, 23 items were established as OR nursing-sensitive quality indicators, including rates of work time wastage, surgery start-time delay, OR turnover time between surgeries, same-day surgery cancellation, and number of monthly surgeries in each OR; checking surgical patients, surgery site marking, allergy history, and antibiotics use 60min before incision; and also assessing expected surgical time, sterilisation indicator results, availability of surgical instruments and materials, and instrument count. Scientific, practical, and reliable OR nursing-sensitive quality indicators can be established based on evidence-based studies and expert consensus using the Delphi method. The quality indicators developed in this study may provide an objective and quantitative reference for evaluating nursing quality in Chinese ORs. Copyright © 2016 Australian College of Critical Care Nurses Ltd. Published by Elsevier Ltd. All rights reserved.

Developing a research agenda for the American Society of Colon and Rectal Surgeons: results of a delphi approach.

PubMed

Burt, Caroline G; Cima, Robert R; Koltun, Walter A; Littlejohn, Charles E; Ricciardi, Rocco; Temple, Larissa K; Rothenberger, David A; Baxter, Nancy N

2009-05-01

By use of a systematic approach, the aim of this project was to survey a group of colorectal specialists and reach a consensus on the research questions of highest importance in terms of clinical care. A modified Delphi process was performed. In Round 1 research questions were solicited from members of The American Society of Colon and Rectal Surgeons. A review group categorized the results, combined similar questions, and presented them to The American Society of Colon and Rectal Surgeons membership in Round 2 for prioritizing according to importance. In Round 3 the 50 questions with the highest scores in Round 2 were reranked by The American Society of Colon and Rectal Surgeons membership to produce the 20 highest-priority research questions. A total of 203 respondents in Round 1 submitted 746 questions. The review team reduced these to 105 individual questions encompassing 21 topics in colorectal surgical practice. In Rounds 2 and 3, 399 and 360 respondents, respectively, prioritized the questions presented. The final 20 items included 14 questions related to colorectal cancer, and 6 were on benign disease topics. The research agenda produced by this study reflects the clinical issues of greatest importance to colorectal surgeons. The results are of potential benefit to researchers, funding organizations, medical journals, and ultimately, patients.

Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

PubMed

Turner, S; Ollerhead, E; Cook, A

2017-10-09

In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and logistically challenging. Identifying such research priorities can be particularly challenging for complex public health problems as there is a need to consult a number of experts across disciplines and with a range of expertise. This study investigated the use of Delphi-like survey methods in identifying important research priorities relating to health inequalities and framing tractable research questions for topic areas identified. The study was conducted in two phases, both using Delphi-like survey methods. Firstly, public health professionals with an interest in health inequalities were asked to identify research priorities. Secondly academic researchers were asked to frame tractable research questions relating to the priorities identified. These research priorities identified using Delphi-like survey methods were subsequently compared to those identified using different methods. A total of 52 public health professionals and 21 academics across the United Kingdom agreed to take part. The response rates were high, from public health professionals across three survey rounds (69%, 50% and 40%) and from academics across one round (52%), indicating that participants were receptive to the method and motivated to respond. The themes identified as encompassing the most important research priorities were mental health, healthy environment and health behaviours. Within these themes, the topic areas that emerged most strongly included community interventions for prevention of mental health problems and the food and alcohol environment. Some responses received from academic researchers were (as requested) in the form of tractable research questions, whereas others contributed further potential topic areas instead. Delphi-like survey methods are practical and productive as a means of obtaining opinions from a wide number of relevant experts identifying potential priority topic areas for research; however, this method is less appropriate for framing tractable research questions.

Consensus on the Definition of Advanced Parkinson's Disease: A Neurologists-Based Delphi Study (CEPA Study).

PubMed

Luquin, Maria-Rosario; Kulisevsky, Jaime; Martinez-Martin, Pablo; Mir, Pablo; Tolosa, Eduardo S

2017-01-01

To date, no consensus exists on the key factors for diagnosing advanced Parkinson disease (APD). To obtain consensus on the definition of APD, we performed a prospective, multicenter, Spanish nationwide, 3-round Delphi study (CEPA study). An ad hoc questionnaire was designed with 33 questions concerning the relevance of several clinical features for APD diagnosis. In the first-round, 240 neurologists of the Spanish Movement Disorders Group participated in the study. The results obtained were incorporated into the questionnaire and both, results and questionnaire, were sent out to and fulfilled by 26 experts in Movement Disorders. Review of results from the second-round led to a classification of symptoms as indicative of "definitive," "probable," and "possible" APD. This classification was confirmed by 149 previous participating neurologists in a third-round, where 92% completely or very much agreed with the classification. Definitive symptoms of APD included disability requiring help for the activities of daily living, presence of motor fluctuations with limitations to perform basic activities of daily living without help, severe dysphagia, recurrent falls, and dementia. These results will help neurologists to identify some key factors in APD diagnosis, thus allowing users to categorize the patients for a homogeneous recognition of this condition.

Planning the content of a brief educational course in maxillofacial emergencies for staff in accident and emergency departments: a modified Delphi study.

PubMed

Elledge, Ross O C; McAleer, Sean

2015-02-01

It is well known that staff in accident and emergency (A&E) departments lack the knowledge and confidence needed to deal with maxillofacial emergencies, and that it is related to limited education at undergraduate and postgraduate levels. We therefore aimed to design a syllabus for a short course to educate staff about the most common emergencies. To find out which learning outcomes should be included and to reach a consensus, we did a 3-stage modified Delphi study of the opinions of members of the British Association of Oral and Maxillofacial Surgeons (BAOMS). Of a possible 890 members, 188 responded (21%) in the second round and 105 in the third (12%). Eighteen (37%) of the 49 proposed learning outcomes were rated very important and all of them were retained in the syllabus after the third round. Thirty (61%) items were retained with a consensus of 51% or above in the final round. The Delphi technique is a useful addition to the armamentarium of those involved in education, and has been used effectively in syllabus design. We achieved good consensus on the items to be included and the syllabus will be piloted locally. Copyright © 2014 The British Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Expert validation of a teamwork assessment rubric: A modified Delphi study.

PubMed

Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

2016-01-01

Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with confidence in the university setting. Copyright © 2015 Elsevier Ltd. All rights reserved.

A tool to support meaningful person-centred activity for clients with dementia - a Delphi study.

PubMed

Lloyd, Barbara; Stirling, Christine

2015-01-01

This paper reports on a study to validate the concept of the 'Activity Support Tool' that aimed to assist dementia service workers to identify and act upon the support needs of people with dementia living alone, in line with the person-centred ideal. The tool was part of a two-stage exploratory qualitative study, which used interview and observational data from seven people with dementia living alone. Findings highlighted that people with dementia use objects and spaces within their homes to maintain or re-enact identities from the past. Thematic results from interviews were translated into a tool, with construct validation using the Delphi technique. Eighteen expert health professionals received round one of the questionnaire and six participants completed round three. The first round directed our focus towards operationalizing the person-centred ideal of dementia care. The tool was considered by almost all advisory panel members to be a potentially valuable resource for helping to address impediments to integrated, effective and person-centred dementia care. Specific strengths identified were simplicity, person-centeredness and applicability across service settings. Issues of concern included practicability, risk management, gender stereotyping and terminology. The results support the findings of previous research into the intuitive and ethical appeal, but problematic applicability, of person-centred dementia services. Health professionals with a range of service-related expertise found the concept of person-centred care compelling, but required tangible, enduring structures to translate the ideal into practical action. The tool now requires further research to test its usefulness in practice.

Defining the activities of publicness for Korea's public community hospitals using the Delphi method.

PubMed

Lee, Kunsei; Kim, Hyun Joo; You, Myoungsoon; Lee, Jin-Seok; Eun, Sang Jun; Jeong, Hyoseon; Ahn, Hye Mi; Lee, Jin Yong

2017-03-01

This study aims to identify which activities of a public community hospital (PHC) should be included in their definition of publicness and tries to achieve a consensus among experts using the Delphi method. We conduct 2 rounds of the Delphi process with 17 panel members using a developed draft of tentative activities for publicness including 5 main categories covering 27 items. The questions remain the same in both rounds and the applicability of each of the 27 items to publicness is measured on a 9-point scale. If the participants believe government funding is needed, we ask how much they think the government should support each item on a 0% to 100% scale. After conducting 2 rounds of the Delphi process, 22 out of the 27 items reached a consensus as activities defining the publicness of the PHCs. Among the 5 major categories, in category C, activities preventing market failure, all 10 items were considered activities of publicness. Nine of these were evaluated as items that should be compensated at 100% of total financial loss by the Korean government. Throughout results, we were able to define the activities of the PCH that encompassed its publicness and confirm that there are "good deficits" in the context of the PCHs. Thus, some PCH deficits are unavoidable and not wasted as these monies support a necessary role and function in providing public health. The Korean government should therefore consider taking actions such as exempting such "good deficits" or providing additional financial aid to reimburse the PHCs for "good deficits."

Subjective and clinical assessment criteria suggestive for five clinical patterns discernible in nonspecific neck pain patients. A Delphi-survey of clinical experts.

PubMed

Dewitte, Vincent; Peersman, Wim; Danneels, Lieven; Bouche, Katie; Roets, Arne; Cagnie, Barbara

2016-12-01

Nonspecific neck pain patients form a heterogeneous group with different musculoskeletal impairments. Classifying nonspecific neck pain patients into subgroups based on clinical characteristics might lead to more comprehensive diagnoses and can guide effective management. To establish consensus among a group of experts regarding the clinical criteria suggestive of a clinical dominance of 'articular', 'myofascial', 'neural', 'central' and 'sensorimotor control' dysfunction patterns distinguishable in patients with nonspecific neck pain. Delphi study. A focus group with 10 academic experts was organized to elaborate on the different dysfunction patterns discernible in neck pain patients. Consecutively, a 3-round online Delphi-survey was designed to obtain consensual symptoms and physical examination findings for the 5 distinct dysfunction patterns resulting from the focus group. A total of 21 musculoskeletal physical therapists from Belgium and the Netherlands experienced in assessing and treating neck pain patients completed the 3-round Delphi-survey. Respectively, 33 (response rate, 100.0%), 27 (81.8%) and 21 (63.6%) respondents replied to rounds 1, 2 and 3. Eighteen 'articular', 16 'myofascial', 20 'neural', 18 'central' and 10 'sensorimotor control' clinical indicators reached a predefined ≥80% consensus level. These indicators suggestive of a clinical dominance of 'articular', 'myofascial', 'neural', 'central', and 'sensorimotor control' dysfunction patterns may help clinicians to assess and diagnose patients with nonspecific neck pain. Future validity testing is needed to determine how these criteria may help to improve the outcome of physical therapy interventions in nonspecific neck pain patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

Critical care nursing interventions and the time required for their completion in Intensive Care Units: A Delphi study.

PubMed

Palomar-Aumatell, Xavier; Subirana-Casacuberta, Mireia; Mila-Villarroel, Raimon

2017-12-01

To determine which interventions within the Nursing Interventions Classification are most often applied in intensive care units and to validate the time required for each. A three-stage e-Delphi was conducted; 21 panelists were recruited, seven manager nurses and 14 clinical nurses with higher degrees and more than five years experience in intensive care nursing. The first round explored the most common interventions applied. Additionally, panelists were asked to propose others. In the second round, participants reflected on the interventions where no consensus was reached as well as to estimate the time required for each intervention. In the third, panelists were queried about the time required for the interventions for which consensus regarding the time was not reached. A total of 183 interventions were included; 50% of the "Physiological: Complex" domain. The list included 52 (90%) of the 58 "core interventions for critical care nursing" identified in the Nursing Interventions Classification. The time required for 89.1% of the interventions was the same as in the Nursing Interventions Classification seminal work recommendations. Results provide a clear picture of nursing activity in general intensive care units, allows to tailor the Nursing Intervetions Classification in Catalonia context and to confirm findings of previous studies. Copyright © 2017 Elsevier Ltd. All rights reserved.

Optimising perioperative care for hip and knee arthroplasty in South Africa: a Delphi consensus study.

PubMed

Plenge, U; Nortje, M B; Marais, L C; Jordaan, J D; Parker, R; van der Westhuizen, N; van der Merwe, J F; Marais, J; September, W V; Davies, G L; Pretorius, T; Solomon, C; Ryan, P; Torborg, A M; Farina, Z; Smit, R; Cairns, C; Shanahan, H; Sombili, S; Mazibuko, A; Hobbs, H R; Porrill, O S; Timothy, N E; Siebritz, R E; van der Westhuizen, C; Troskie, A J; Blake, C A; Gray, L A; Munting, T W; Steinhaus, H K S; Rowe, P; van der Walt, J G; Isaacs Noordien, R; Theron, A; Biccard, B M

2018-05-09

A structured approach to perioperative patient management based on an enhanced recovery pathway protocol facilitates early recovery and reduces morbidity in high income countries. However, in low- and middle-income countries (LMICs), the feasibility of implementing enhanced recovery pathways and its influence on patient outcomes is scarcely investigated. To inform similar practice in LMICs for total hip and knee arthroplasty, it is necessary to identify potential factors for inclusion in such a programme, appropriate for LMICs. Applying a Delphi method, 33 stakeholders (13 arthroplasty surgeons, 12 anaesthetists and 8 physiotherapists) from 10 state hospitals representing 4 South African provinces identified and prioritised i) risk factors associated with poor outcomes, ii) perioperative interventions to improve outcomes and iii) patient and clinical outcomes necessary to benchmark practice for patients scheduled for primary elective unilateral total hip and knee arthroplasty. Thirty of the thirty-three stakeholders completed the 3 months Delphi study. The first round yielded i) 36 suggestions to preoperative risk factors, ii) 14 (preoperative), 18 (intraoperative) and 23 (postoperative) suggestions to best practices for perioperative interventions to improve outcomes and iii) 25 suggestions to important postsurgical outcomes. These items were prioritised by the group in the consecutive rounds and consensus was reached for the top ten priorities for each category. The consensus derived risk factors, perioperative interventions and important outcomes will inform the development of a structured, perioperative multidisciplinary enhanced patient care protocol for total hip and knee arthroplasty. It is anticipated that this study will provide the construct necessary for developing pragmatic enhanced care pathways aimed at improving patient outcomes after arthroplasty in LMICs.

European neonatal intensive care nursing research priorities: an e-Delphi study.

PubMed

Wielenga, Joke M; Tume, Lyvonne N; Latour, Jos M; van den Hoogen, Agnes

2015-01-01

This study aimed to identify and prioritise neonatal intensive care nursing research topics across Europe using an e-Delphi technique. An e-Delphi technique with three questionnaire rounds was performed. Qualitative responses of round one were analysed by content analysis and research statements were generated to be ranged on importance on a scale of 1-6 (not important to most important). Neonatal intensive care units (NICUs) in 17 European countries. NICU clinical nurses, managers, educators and researchers (n=75). None. A list of 43 research statements in eight domains. The six highest ranking statements (≥5.0 mean score) were related to prevention and reduction of pain (mean 5.49; SD 1.07), medication errors (mean 5.20; SD 1.13), end-of-life care (mean 5.05; SD 1.18), needs of parents and family (mean 5.04; SD 1.23), implementing evidence into nursing practice (mean 5.02; SD 1.03), and pain assessment (mean 5.02; SD 1.11). The research domains were prioritised and ranked: (1) pain and stress; (2) family centred care; (3) clinical nursing care practices; (4) quality and safety; (5) ethics; (6) respiratory and ventilation; (7) infection and inflammation; and (8) professional issues in neonatal intensive care nursing. The results of this study might support developing a nursing research strategy for the nursing section of the European Society of Paediatric and Neonatal Intensive Care. In addition, this may promote more European researcher collaboratives for neonatal nursing research. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Japanese Clinical Guidelines for Endoscopic Treatment of Pancreatolithiasis.

PubMed

Inui, Kazuo; Igarashi, Yoshinori; Irisawa, Atsushi; Ohara, Hirotaka; Tazuma, Susumu; Hirooka, Yoshiki; Fujita, Naotaka; Miyakawa, Hiroyuki; Sata, Naohiro; Shimosegawa, Tooru; Tanaka, Masao; Shiratori, Keiko; Sugiyama, Masanori; Takeyama, Yoshifumi

2015-10-01

In addition to surgery, procedures for patients with pancreatolithiasis are developing; therefore, establishing practical guidelines for the management of pancreatolithiasis is required. Three committees (the professional committee for asking clinical questions (CQs) and statements by Japanese endoscopists, the expert panel committee for rating statements by the modified Delphi method, and the evaluating committee by moderators) were organized. Eight endoscopists and a surgeon for pancreatolithiasis made the CQs and statements from a total of 694 reports of published literature by PubMed search (from 1983 to 2012). The expert panelists individually rated these clinical statements using a modified Delphi approach, in which a clinical statement receiving a median score greater than 7 on a 9-point scale from the panel was regarded as valid. The professional committee made 3, 7, and 10 CQs and statements for the concept and pathogenesis, diagnosis, and treatment, respectively. The expert panelists regarded them as valid after a 2-round modified Delphi approach. After evaluation by the moderators, the Japanese clinical guidelines for pancreatolithiasis were established. Further discussions and studies for international guidelines are needed.

Development of a core outcome set for effectiveness trials aimed at optimising prescribing in older adults in care homes.

PubMed

Millar, Anna N; Daffu-O'Reilly, Amrit; Hughes, Carmel M; Alldred, David P; Barton, Garry; Bond, Christine M; Desborough, James A; Myint, Phyo K; Holland, Richard; Poland, Fiona M; Wright, David

2017-04-12

Prescribing medicines for older adults in care homes is known to be sub-optimal. Whilst trials testing interventions to optimise prescribing in this setting have been published, heterogeneity in outcome reporting has hindered comparison of interventions, thus limiting evidence synthesis. The aim of this study was to develop a core outcome set (COS), a list of outcomes which should be measured and reported, as a minimum, for all effectiveness trials involving optimising prescribing in care homes. The COS was developed as part of the Care Homes Independent Pharmacist Prescribing Study (CHIPPS). A long-list of outcomes was identified through a review of published literature and stakeholder input. Outcomes were reviewed and refined prior to entering a two-round online Delphi exercise and then distributed via a web link to the CHIPPS Management Team, a multidisciplinary team including pharmacists, doctors and Patient Public Involvement representatives (amongst others), who comprised the Delphi panel. The Delphi panellists (n = 19) rated the importance of outcomes on a 9-point Likert scale from 1 (not important) to 9 (critically important). Consensus for an outcome being included in the COS was defined as ≥70% participants scoring 7-9 and <15% scoring 1-3. Exclusion was defined as ≥70% scoring 1-3 and <15% 7-9. Individual and group scores were fed back to participants alongside the second questionnaire round, which included outcomes for which no consensus had been achieved. A long-list of 63 potential outcomes was identified. Refinement of this long-list of outcomes resulted in 29 outcomes, which were included in the Delphi questionnaire (round 1). Following both rounds of the Delphi exercise, 13 outcomes (organised into seven overarching domains: medication appropriateness, adverse drug events, prescribing errors, falls, quality of life, all-cause mortality and admissions to hospital (and associated costs)) met the criteria for inclusion in the final COS. We have developed a COS for effectiveness trials aimed at optimising prescribing in older adults in care homes using robust methodology. Widespread adoption of this COS will facilitate evidence synthesis between trials. Future work should focus on evaluating appropriate tools for these key outcomes to further reduce heterogeneity in outcome measurement in this context.

Psychosocial care for persons affected by emergencies and major incidents: a Delphi study to determine the needs of professional first responders for education, training and support.

PubMed

Drury, John; Kemp, Verity; Newman, Jonathan; Novelli, David; Doyle, Christopher; Walter, Darren; Williams, Richard

2013-10-01

The role of ambulance clinicians in providing psychosocial care in major incidents and emergencies is recognised in recent Department of Health guidance. The study described in this paper identified NHS professional first responders' needs for education about survivors' psychosocial responses, training in psychosocial skills, and continuing support. Ambulance staff participated in an online Delphi questionnaire, comprising 74 items (Round 1) on 7-point Likert scales. Second-round and third-round participants each received feedback based on the previous round, and responded to modified versions of the original items and to new items for clarification. One hundred and two participants took part in Round 1; 47 statements (64%) achieved consensus. In Round 2, 72 people from Round 1 participated; 15 out of 39 statements (38%) achieved consensus. In Round 3, 49 people from Round 2 participated; 15 out of 27 statements (59%) achieved consensus. Overall, there was consensus in the following areas: 'psychosocial needs of patients' (consensus in 34/37 items); 'possible sources of stress in your work' (8/9); 'impacts of distress in your work' (7/10); 'meeting your own emotional needs' (4/5); 'support within your organisation' (2/5); 'needs for training in psychosocial skills for patients' (15/15); 'my needs for psychosocial training and support' (5/6). Ambulance clinicians recognise their own education needs and the importance of their being offered psychosocial training and support. The authors recommend that, in order to meet patients' psychosocial needs effectively, ambulance clinicians are provided with education and training in a number of skills and their own psychosocial support should be enhanced.

Development of quality indicators for low-risk labor care provided by midwives using a RAND-modified Delphi method.

PubMed

Ueda, Kayo; Ohtera, Shosuke; Kaso, Misato; Nakayama, Takeo

2017-09-22

In childbirth, most deliveries are low-risk, defined as spontaneous labor at full term without special high-risk facts or complications, especially in high-resource countries where maternal and perinatal mortality rates are very low. Indeed, the majority of mothers and infants have no serious conditions during labor. However, the quality of care provided is not assured, and performance may vary by birthing facility and provider. The overuse of technology in childbirth in some parts of the world is almost certainly based on assumptions like, "something can go wrong at any minute." There is a need to assess the quality of care provided for mothers and infants in low-risk labor. We aimed to develop specific quality indicators for low-risk labor care provided primarily by midwives in Japan. We used a RAND-modified Delphi method, which integrates evidence review with expert consensus development. The procedure comprises five steps: (1) literature review, including clinical practice guidelines, to extract and develop quality indicator candidates; (2) formation of a multidisciplinary panel; (3) independent panel ratings (Round 1); (4) panel meeting and independent panel ratings (Round 2); and (5) independent panel ratings (Round 3). The three independent panel ratings (Rounds 1-3) were held between July and December 2012. The assembled multidisciplinary panel comprised eight clinicians (two pediatricians, three obstetricians, and three midwives) and three mothers who were nonclinicians. Evidentiary review extracted 166 key recommendations from 32 clinical practice guidelines, and 31 existing quality indicators were added. After excluding duplicate recommendations and quality indicators, the panel discussed 25 candidate indicators. Of these, 18 were adopted, one was modified, six were not adopted, and four were added during the meeting, respectively. We established 23 quality indicators for low-risk labor care provided by midwives in labor units in Japan.

Determination of Problematic ICD-9-CM Subcategories for Further Study of Coding Performance: Delphi Method

PubMed Central

Zeng, Xiaoming; Bell, Paul D

2011-01-01

In this study, we report on a qualitative method known as the Delphi method, used in the first part of a research study for improving the accuracy and reliability of ICD-9-CM coding. A panel of independent coding experts interacted methodically to determine that the three criteria to identify a problematic ICD-9-CM subcategory for further study were cost, volume, and level of coding confusion caused. The Medicare Provider Analysis and Review (MEDPAR) 2007 fiscal year data set as well as suggestions from the experts were used to identify coding subcategories based on cost and volume data. Next, the panelists performed two rounds of independent ranking before identifying Excisional Debridement as the subcategory that causes the most confusion among coders. As a result, they recommended it for further study aimed at improving coding accuracy and variation. This framework can be adopted at different levels for similar studies in need of a schema for determining problematic subcategories of code sets. PMID:21796264

TCM Pattern Questionnaire for Lateral Elbow Pain: Development of an Instrument via a Delphi Process

PubMed Central

Bian, Zhao-Xiang

2016-01-01

Individualized acupuncture treatment has been practiced for pain therapy. This study used acupuncture treatment for lateral elbow pain (LEP) as an example to study the diagnostic practice of individualized acupuncture treatment. A provisional version of LEP pattern questionnaire was developed based on a recent systematic review on TCM pattern diagnosis for LEP. A Delphi panel of 33 clinical experts from seven different countries was formed, and the Delphi survey was conducted in Chinese and English language for two rounds. Consensus was achieved from all 26 panelists who responded to the second round on 243 items of the instrument, which included a 72-question-long questionnaire. The mean level of expert consensus on the items of the final questionnaire was 85%. Consensus was found on four TCM patterns that could underlie LEP, namely, the wind-cold-dampness pattern, the qi stagnation and blood stasis pattern, the dual deficiency of qi and blood pattern, and the retained dampness-heat pattern. A list of signs and symptoms indicating one of the four TCM patterns and a list of preferred treatment modalities for each pattern were also generated. Our instrument shows considerable content validity. Further validity and reliability studies are under way. PMID:27525024

ISSLS Prize Winner: Consensus on the Clinical Diagnosis of Lumbar Spinal Stenosis: Results of an International Delphi Study.

PubMed

Tomkins-Lane, Christy; Melloh, Markus; Lurie, Jon; Smuck, Matt; Battié, Michele C; Freeman, Brian; Samartzis, Dino; Hu, Richard; Barz, Thomas; Stuber, Kent; Schneider, Michael; Haig, Andrew; Schizas, Constantin; Cheung, Jason Pui Yin; Mannion, Anne F; Staub, Lukas; Comer, Christine; Macedo, Luciana; Ahn, Sang-Ho; Takahashi, Kazuhisa; Sandella, Danielle

2016-08-01

Delphi. The aim of this study was to obtain an expert consensus on which history factors are most important in the clinical diagnosis of lumbar spinal stenosis (LSS). LSS is a poorly defined clinical syndrome. Criteria for defining LSS are needed and should be informed by the experience of expert clinicians. Phase 1 (Delphi Items): 20 members of the International Taskforce on the Diagnosis and Management of LSS confirmed a list of 14 history items. An online survey was developed that permits specialists to express the logical order in which they consider the items, and the level of certainty ascertained from the questions. Phase 2 (Delphi Study) Round 1: Survey distributed to members of the International Society for the Study of the Lumbar Spine. Round 2: Meeting of 9 members of Taskforce where consensus was reached on a final list of 10 items. Round 3: Final survey was distributed internationally. Phase 3: Final Taskforce consensus meeting. A total of 279 clinicians from 29 different countries, with a mean of 19 (±SD: 12) years in practice participated. The six top items were "leg or buttock pain while walking," "flex forward to relieve symptoms," "feel relief when using a shopping cart or bicycle," "motor or sensory disturbance while walking," "normal and symmetric foot pulses," "lower extremity weakness," and "low back pain." Significant change in certainty ceased after six questions at 80% (P < .05). This is the first study to reach an international consensus on the clinical diagnosis of LSS, and suggests that within six questions clinicians are 80% certain of diagnosis. We propose a consensus-based set of "seven history items" that can act as a pragmatic criterion for defining LSS in both clinical and research settings, which in the long term may lead to more cost-effective treatment, improved health care utilization, and enhanced patient outcomes. 2.

Validation of the process criteria for assessment of a hospital nursing service.

PubMed

Feldman, Liliane Bauer; Cunha, Isabel Cristina Kowal Olm; D'Innocenzo, Maria

2013-01-01

to validate an instrument containing process criteria for assessment of a hospital nursing service based on the National Accreditation Organization program. a descriptive, quantitative methodological study performed in stages. An instrument constructed with 69 process criteria was assessed by 49 nurses from accredited hospitals in 2009, according to a Likert scale, and validated by 16 judges through Delphi rounds in 2010. the original instrument assessed by nurses with 69 process criteria was judged by the degree of importance, and changed to 39 criteria. In the first Delphi round, the 39 criteria reached consensus among the 19 judges, with a medium reliability by Cronbach's alpha. In the second round, 40 converging criteria were validated by 16 judges, with high reliability. The criteria addressed management, costs, teaching, education, indicators, protocols, human resources, communication, among others. the 40 process criteria formed a validated instrument to assess the hospital nursing service which, when measured, can better direct interventions by nurses in reaching and strengthening outcomes.

Defining the Key Competencies in Radiation Protection for Endovascular Procedures: A Multispecialty Delphi Consensus Study.

PubMed

Doyen, Bart; Maurel, Blandine; Cole, Jonathan; Maertens, Heidi; Mastracci, Tara; Van Herzeele, Isabelle

2018-02-01

Radiation protection training courses currently focus on broad knowledge topics which may not always be relevant in daily practice. The goal of this study was to determine the key competencies in radiation protection that every endovascular team member should possess and apply routinely, through multispecialty clinical content expert consensus. Consensus was obtained through a two round modified Delphi methodology. The expert panel consisted of European vascular surgeons, interventional radiologists, and interventional cardiologists/angiologists experienced in endovascular procedures. An initial list of statements, covering knowledge skills, technical skills and attitudes was created, based on a literature search. Additional statements could be suggested by the experts in the first Delphi round. Each of the statements had to be rated on a 5- point Likert scale. A statement was considered to be a key competency when the internal consistency was greater than alpha = 0.80 and at least 80% of the experts agreed (rating 4/5) or strongly agreed (rating 5/5) with the statement. Questionnaires were emailed to panel members using the Surveymonkey service. Forty-one of 65 (63.1%) invited experts agreed to participate in the study. The response rates were 36 out of 41 (87.8%): overall 38 out of 41(92.6%) in the first round and 36 out of 38 (94.7%) in the second round. The 71 primary statements were supplemented with nine items suggested by the panel. The results showed excellent consensus among responders (Cronbach's alpha = 0.937 first round; 0.958 s round). Experts achieved a consensus that 30 of 33 knowledge skills (90.9%), 23 of 27 technical skills (82.1%), and 15 of 20 attitudes (75.0%) should be considered as key competencies. A multispecialty European endovascular expert panel reached consensus about the key competencies in radiation protection. These results may serve to create practical and relevant radiation protection training courses in the future, enhancing radiation safety for both patients and the entire endovascular team. Copyright © 2017 European Society for Vascular Surgery. All rights reserved.

Finding common ground in implementation: towards a theory of gradual commonality.

PubMed

Ter Haar, Marian; Aarts, Noelle; Verhoeven, Piet

2016-03-01

This article reports on an empirical study that aimed to design a practice-based theory about collaboration on the local implementation of a nationally developed health-promoting intervention. The study's objective is to better understand the dynamic process of complex collaboration. The research is based on a Delphi study among some 100 individuals in local and regional networks, in which various professionals work together to implement the BeweegKuur, which translates as 'course of exercise'. The BeweegKuur is a combined lifestyle intervention aimed at promoting sufficient physical exercise and a healthy diet among people in the Netherlands who are overweight and at risk of diabetes. The Delphi study in three rounds systematically and interactively constructs a common perspective on implementation, reflecting stakeholders' ideas about the collaboration and providing an insight into how these ideas are influenced by the context of the implementation. The statistical and qualitative analyses of the responses to the feedback in the Delphi study form the basis for this practice-based theory on complex collaboration, called the theory of gradual commonality. During interaction, consensus gradually emerges about co-creation as a collaboration strategy. Co-creation leaves room for various ways of achieving the ambitions of the BeweegKuur. This article discusses the importance of this practice-based theory and the value of the Delphi research strategy for promoting health. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Using the modified Delphi method to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy.

PubMed

Zang, Lei; Fan, Ning; Hai, Yong; Lu, S B; Su, Q J; Yang, J C; Du, Peng; Gao, Y J

2015-06-01

Although cervical radiculopathy is very common, there is no standard treatment for this condition, with little high-level evidence available to guide the treatment choice. Thus, this study aimed to review the current data on the management of cervical radiculopathy; and, further, to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy using the Delphi method. First, a systematic review of the previously established treatment guidelines and of articles related to cervical radiculopathy was conducted to establish a protocol for the clinical consensus of the treatment for cervical radiculopathy. Second, from February 2012 to June 2014, we performed a modified Delphi survey in which the current professional opinions from 30 experienced experts, representing almost all of the Chinese provinces, were gathered. Three rounds were performed, and consensus was defined as ≥70% agreement. Consensus of the treatments for cervical radiculopathy was reached on seven aspects, including the proportion of patients requiring only non-surgical therapies; the effectiveness of neck immobilization, physiotherapy, pharmacologic treatment; surgical indications; contraindications; surgery. The modified Delphi study conducted herein reached a consensus concerning several treatment issues for cervical radiculopathy. In the absence of high-level evidence, at present, these expert opinion findings will help guide health care providers to define the appropriate treatment in their regions. Items with no consensus provide excellent areas for future research.

A modified Delphi method toward multidisciplinary consensus on functional convalescence recommendations after abdominal surgery.

PubMed

van Vliet, Daphne C R; van der Meij, Eva; Bouwsma, Esther V A; Vonk Noordegraaf, Antonie; van den Heuvel, Baukje; Meijerink, Wilhelmus J H J; van Baal, W Marchien; Huirne, Judith A F; Anema, Johannes R

2016-12-01

Evidence-based information on the resumption of daily activities following uncomplicated abdominal surgery is scarce and not yet standardized in medical guidelines. As a consequence, convalescence recommendations are generally not provided after surgery, leading to patients' insecurity, needlessly delayed recovery and prolonged sick leave. The aim of this study was to generate consensus-based multidisciplinary convalescence recommendations, including advice on return to work, applicable for both patients and physicians. Using a modified Delphi method among a multidisciplinary panel of 13 experts consisting of surgeons, occupational physicians and general practitioners, detailed recommendations were developed for graded resumption of 34 activities after uncomplicated laparoscopic cholecystectomy, laparoscopic and open appendectomy, laparoscopic and open colectomy and laparoscopic and open inguinal hernia repair. A sample of occupational physicians, general practitioners and surgeons assessed the recommendations on feasibility in daily practice. The response of this group of care providers was discussed with the experts in the final Delphi questionnaire round. Out of initially 56 activities, the expert panel selected 34 relevant activities for which convalescence recommendations were developed. After four Delphi rounds, consensus was reached for all of the 34 activities for all the surgical procedures. A sample of occupational physicians, general practitioners and surgeons regarded the recommendations as feasible in daily practice. Multidisciplinary convalescence recommendations regarding uncomplicated laparoscopic cholecystectomy, appendectomy (laparoscopic, open), colectomy (laparoscopic, open) and inguinal hernia repair (laparoscopic, open) were developed by a modified Delphi procedure. Further research is required to evaluate whether these recommendations are realistic and effective in daily practice.

Major incident triage: A consensus based definition of the essential life-saving interventions during the definitive care phase of a major incident.

PubMed

Vassallo, James; Smith, Jason E; Bruijns, Stevan R; Wallis, Lee A

2016-09-01

Triage is a key principle in the effective management of major incidents. The process currently relies on algorithms assigning patients to specific triage categories; there is, however, little guidance as to what these categories represent. Previously, these algorithms were validated against injury severity scores, but it is accepted now that the need for life-saving intervention is a more important outcome. However, the definition of a life-saving intervention is unclear. The aim of this study was to define what constitutes a life-saving intervention, in order to facilitate the definition of an adult priority one patient during the definitive care phase of a major incident. We conducted a modified Delphi study, using a panel of subject matter experts drawn from the United Kingdom and Republic of South Africa with a background in Emergency Care or Major Incident Management. The study was conducted using an online survey tool, over three rounds between July and December 2013. A four point Likert scale was used to seek consensus for 50 possible interventions, with a consensus level set at 70%. 24 participants completed all three rounds of the Delphi, with 32 life-saving interventions reaching consensus. This study provides a consensus definition of what constitutes a life-saving intervention in the context of an adult, priority one patient during the definitive care phase of a major incident. The definition will contribute to further research into major incident triage, specifically in terms of validation of an adult major incident triage tool. Copyright © 2016 Elsevier Ltd. All rights reserved.

Criteria required for an acceptable point-of-care test for UTI detection: Obtaining consensus using the Delphi technique.

PubMed

Weir, Nichola-Jane M; Pattison, Sally H; Kearney, Paddy; Stafford, Bob; Gormley, Gerard J; Crockard, Martin A; Gilpin, Deirdre F; Tunney, Michael M; Hughes, Carmel M

2018-01-01

Urinary Tract Infections (UTIs) are common bacterial infections, second only to respiratory tract infections and particularly prevalent within primary care. Conventional detection of UTIs is culture, however, return of results can take between 24 and 72 hours. The introduction of a point of care (POC) test would allow for more timely identification of UTIs, facilitating improved, targeted treatment. This study aimed to obtain consensus on the criteria required for a POC UTI test, to meet patient need within primary care. Criteria for consideration were compiled by the research team. These criteria were validated through a two-round Delphi process, utilising an expert panel of healthcare professionals from across Europe and United States of America. Using web-based questionnaires, panellists recorded their level of agreement with each criterion based on a 5-point Likert Scale, with space for comments. Using median response, interquartile range and comments provided, criteria were accepted/rejected/revised depending on pre-agreed cut-off scores. The first round questionnaire presented thirty-three criteria to the panel, of which 22 were accepted. Consensus was not achieved for the remaining 11 criteria. Following response review, one criterion was removed, while after revision, the remaining 10 criteria entered the second round. Of these, four were subsequently accepted, resulting in 26 criteria considered appropriate for a POC test to detect urinary infections. This study generated an approved set of criteria for a POC test to detect urinary infections. Criteria acceptance and comments provided by the healthcare professionals also supports the development of a multiplex point of care UTI test.

Supporting the Evaluation and Implementation of Musculoskeletal Models of Care: A Globally Informed Framework for Judging Readiness and Success.

PubMed

Briggs, Andrew M; Jordan, Joanne E; Jennings, Matthew; Speerin, Robyn; Bragge, Peter; Chua, Jason; Woolf, Anthony D; Slater, Helen

2017-04-01

To develop a globally informed framework to evaluate readiness for implementation and success after implementation of musculoskeletal models of care (MOCs). Three phases were undertaken: 1) a qualitative study with 27 Australian subject matter experts (SMEs) to develop a draft framework; 2) an eDelphi study with an international panel of 93 SMEs across 30 nations to evaluate face validity, and refine and establish consensus on the framework components; and 3) translation of the framework into a user-focused resource and evaluation of its acceptability with the eDelphi panel. A comprehensive evaluation framework was developed for judging the readiness and success of musculoskeletal MOCs. The framework consists of 9 domains, with each domain containing a number of themes underpinned by detailed elements. In the first Delphi round, scores of "partly agree" or "completely agree" with the draft framework ranged 96.7%-100%. In the second round, "essential" scores ranged 58.6%-98.9%, resulting in 14 of 34 themes being classified as essential. SMEs strongly agreed or agreed that the final framework was useful (98.8%), usable (95.1%), credible (100%) and appealing (93.9%). Overall, 96.3% strongly supported or supported the final structure of the framework as it was presented, while 100%, 96.3%, and 100% strongly supported or supported the content within the readiness, initiating implementation, and success streams, respectively. An empirically derived framework to evaluate the readiness and success of musculoskeletal MOCs was strongly supported by an international panel of SMEs. The framework provides an important internationally applicable benchmark for the development, implementation, and evaluation of musculoskeletal MOCs. © 2016, American College of Rheumatology.

Achieving Consensus for the Design and Delivery of an Online Intervention to Support Midwives in Work-Related Psychological Distress: Results From a Delphi Study.

PubMed

Pezaro, Sally; Clyne, Wendy

2016-07-12

Some midwives are known to experience both professional and organizational sources of psychological distress, which can manifest as a result of the emotionally demanding midwifery work, and the traumatic work environments they endure. An online intervention may be one option midwives may engage with in pursuit of effective support. However, the priorities for the development of an online intervention to effectively support midwives in work-related psychological distress have yet to be explored. The aim of this study was to explore priorities in the development of an online intervention to support midwives in work-related psychological distress. A two-round online Delphi study was conducted. This study invited both qualitative and quantitative data from experts recruited via a scoping literature search and social media channels. In total, 185 experts were invited to participate in this Delphi study. Of all participants invited to contribute, 35.7% (66/185) completed Round 1 and of those who participated in this first round, 67% (44/66) continued to complete Round 2. Out of 39 questions posed over two rounds, 18 statements (46%) achieved consensus, 21 (54%) did not. Participants were given the opportunity to write any additional comments as free text. In total, 1604 free text responses were collected and categorized into 2446 separate statements of opinion, creating a total of 442 themes. Overall, participants agreed that in order to effectively support midwives in work-related psychological distress, online interventions should make confidentiality and anonymity a high priority, along with 24-hour mobile access, effective moderation, an online discussion forum, and additional legal, educational, and therapeutic components. It was also agreed that midwives should be offered a simple user assessment to identify those people deemed to be at risk of either causing harm to others or experiencing harm themselves, and direct them to appropriate support. This study has identified priorities for the development of online interventions to effectively support midwives in work-related psychological distress. The impact of any future intervention of this type will be optimized by utilizing these findings in the development process.

Achieving Consensus for the Design and Delivery of an Online Intervention to Support Midwives in Work-Related Psychological Distress: Results From a Delphi Study

PubMed Central

Clyne, Wendy

2016-01-01

Background Some midwives are known to experience both professional and organizational sources of psychological distress, which can manifest as a result of the emotionally demanding midwifery work, and the traumatic work environments they endure. An online intervention may be one option midwives may engage with in pursuit of effective support. However, the priorities for the development of an online intervention to effectively support midwives in work-related psychological distress have yet to be explored. Objective The aim of this study was to explore priorities in the development of an online intervention to support midwives in work-related psychological distress. Methods A two-round online Delphi study was conducted. This study invited both qualitative and quantitative data from experts recruited via a scoping literature search and social media channels. Results In total, 185 experts were invited to participate in this Delphi study. Of all participants invited to contribute, 35.7% (66/185) completed Round 1 and of those who participated in this first round, 67% (44/66) continued to complete Round 2. Out of 39 questions posed over two rounds, 18 statements (46%) achieved consensus, 21 (54%) did not. Participants were given the opportunity to write any additional comments as free text. In total, 1604 free text responses were collected and categorized into 2446 separate statements of opinion, creating a total of 442 themes. Overall, participants agreed that in order to effectively support midwives in work-related psychological distress, online interventions should make confidentiality and anonymity a high priority, along with 24-hour mobile access, effective moderation, an online discussion forum, and additional legal, educational, and therapeutic components. It was also agreed that midwives should be offered a simple user assessment to identify those people deemed to be at risk of either causing harm to others or experiencing harm themselves, and direct them to appropriate support. Conclusions This study has identified priorities for the development of online interventions to effectively support midwives in work-related psychological distress. The impact of any future intervention of this type will be optimized by utilizing these findings in the development process. PMID:27405386

Emergency medicine in the developing world: a Delphi study.

PubMed

Hodkinson, Peter W; Wallis, Lee A

2010-07-01

Emergency medicine (EM) as a specialty has developed rapidly in the western world, but remains largely immature in developing nations. There is an urgent need for emergency services, but no clear guidelines are available on the priorities for establishing EM in the developing world. This study seeks to establish consensus on key areas of EM development in developing world settings, with respect to scope of EM, staffing needs, training requirements, and research priorities. A three-round Delphi study was conducted via e-mail. A panel was convened of 50 EM specialists or equivalent, with experience in or interest in EM in the developing world. In the first round, panelists provided free-text statements on scope, staffing, training, and research priorities for EM in the developing world. A five-point Likert scale was used to rate agreement with the statements in Rounds 2 and 3. Consensus statements are presented as a series of synopsis statements for each of the four major themes. A total of 168 of 208 statements (81%) had reached consensus at the end of the study. Key areas in which consensus was reached included EM being a specialist-driven service, with substantial role for nonphysicians. International training courses should be adapted to local needs. EM research in developing countries should be clinically driven and focus on local issues of importance. The scope and function of EM and relationships with other specialties are defined. Unambiguous principles are laid out for the development of the specialty in developing world environments. The next step required in this process is translation into practical guidelines for the development of EM in developing world settings where they may be used to drive policy, protocols, and research. 2010 by the Society for Academic Emergency Medicine

Integrating Palliative Care Into Comprehensive Cancer Centers: Consensus-Based Development of Best Practice Recommendations

PubMed Central

Stiel, Stephanie; Simon, Steffen T.; Schmitz, Andrea; van Oorschot, Birgitt; Stachura, Peter; Ostgathe, Christoph

2016-01-01

Background. International associations admit that specialized palliative care (SPC) is an obvious component of excellent cancer care. Nevertheless, gaps in integration at the international level have been identified. Recommendations for integrating SPC in clinical care, research, and education are needed, which are subject of the present study. Materials and Methods. A Delphi study, with three written Delphi rounds, including a face-to-face-meeting with a multiprofessional expert panel (n = 52) working in SPC in 15 German Comprehensive Cancer Centers (CCCs) funded by the German Cancer Aid was initiated. Initial recommendations are built on evidence-based literature. Consensus was defined in advance with ≥80% agreement based on the question of whether each recommendation was unambiguously formulated, relevant, and realizable for a CCC. Results. A total of 38 experts (73.1%) from 15 CCCs performed all three Delphi rounds. Consensus was achieved for 29 of 30 recommendations. High agreement related to having an organizationally and spatially independent palliative care unit (≥6 beds), a mobile multiprofessional SPC team, and cooperation with community-based SPC. Until round 3, an ongoing discussion was registered on hospice volunteers, a chair of palliative care, education in SPC among staff in emergency departments, and integration of SPC in decision-making processes such as tumor boards or consultation hours. Integration of SPC in decision-making processes was not consented by a low-rated feasibility (76.3%) due to staff shortage. Conclusion. Recommendations should be considered when developing standards for cancer center of excellence in Germany. Definition and implementation of indicators of integration of SPC in CCCs and evaluation of its effectiveness are current and future challenges. Implications for Practice: General and specialized palliative care (SPC) is an integral part of comprehensive cancer care. However, significant diversity concerning the design of SPC in the German Comprehensive Cancer Center (CCC) Network led to the establishment of consensual best practice recommendations for integration of SPC into the clinical structures, processes, research, and education throughout the CCC network. The recommendations contribute to a greater awareness relating to the strategic direction and development of SPC in CCCs. The access to information about SPC and access to offers regarding SPC shall be facilitated by implementing the recommendations in the course of treatment of patients with cancer. PMID:27440065

Adaptation of a difficult-to-manage asthma programme for implementation in the Dutch context: a modified e-Delphi.

PubMed

Honkoop, Persijn J; Pinnock, Hilary; Kievits-Smeets, Regien M M; Sterk, Peter J; Dekhuijzen, P N Richard; In 't Veen, Johannes C C M

2017-02-09

Patients with difficult-to-manage asthma represent a heterogeneous subgroup of asthma patients who require extensive assessment and tailored management. The International Primary Care Respiratory Group approach emphasises the importance of differentiating patients with asthma that is difficult to manage from those with severe disease. Local adaptation of this approach, however, is required to ensure an appropriate strategy for implementation in the Dutch context. We used a modified three-round e-Delphi approach to assess the opinion of all relevant stakeholders (general practitioners, pulmonologists, practice nurses, pulmonary nurses and people with asthma). In the first round, the participants were asked to provide potentially relevant items for a difficult-to-manage asthma programme, which resulted in 67 items. In the second round, we asked participants to rate the relevance of specific items on a seven-point Likert scale, and 46 items were selected as relevant. In the third round, the selected items were categorised and items were ranked within the categories according to relevance. Finally, we created the alphabet acronym for the categories 'the A-I of difficult-to-manage asthma' to resonate with an established Dutch 'A-E acronym for determining asthma control'. This should facilitate implementation of this programme within the existing structure of educational material on asthma and chronic obstructive pulmonary disease (COPD) in primary care, with potential for improving management of difficult-to-manage asthma. Other countries could use a similar approach to create a locally adapted version of such a programme.

A Delphi survey on diagnosis and management of stress velopharyngeal insufficiency in wind musicians.

PubMed

Evans, Alison; Driscoll, Tim; Ackermann, Bronwen

2014-10-01

The aim of this study was to identify current trends in clinical assessment and management of stress velopharyngeal insufficiency (VPI) in wind musicians. This was an online two-round Delphi survey of health practitioners familiar with assessing and treating musicians with stress VPI. Fourteen specialists (seven otolaryngologists and seven speech-language pathologists) from four countries participated in the Delphi survey. From the first round questionnaire, 32 items were identified as being causes, assessment tools, diagnostic indicators, and treatment methods for stress VPI. The second round questionnaire revealed that prolonged exposure to high intra-oral pressures was important in determining the cause of stress VPI. The most important assessment tools for stress VPI were case history and nasendoscopy. The most important indicator for stress VPI was self-reported symptoms. There was no clear agreement identified on the management methods for stress VPI for musicians. However, the trend followed by most of the survey participants was a combination of conservative management approaches (including rest or watch and wait, speech-language pathology intervention, velopharyngeal muscle training, and changes to the instrument or reed), and then, if symptoms persist, to use injection pharyngoplasty or pharyngeal flap. This survey demonstrates that no standard management protocol currently exists for musicians diagnosed with stress VPI, but provides current trends in the assessment and management which can be used in future guidelines for health professionals who treat wind musicians.

Defining a set of standardised outcome measures for newly diagnosed patients with multiple myeloma using the Delphi consensus method: the IMPORTA project.

PubMed

Blade, Joan; Calleja, Miguel Ángel; Lahuerta, Juan José; Poveda, José Luis; de Paz, Héctor David; Lizán, Luis

2018-02-22

To define a standard set of outcomes and the most appropriate instruments to measure them for managing newly diagnosed patients with multiple myeloma (MM). A literature review and five discussion groups facilitated the design of two-round Delphi questionnaire. Delphi panellists (haematologists, hospital pharmacists and patients) were identified by the scientific committee, the Spanish Program of Haematology Treatments Foundation, the Spanish Society of Hospital Pharmacies and the Spanish Community of Patients with MM. Panellist's perception about outcomes' suitability and feasibility of use was assessed on a seven-point Likert scale. Consensus was reached when at least 75% of the respondents reached agreement or disagreement. A scientific committee led the project. Fifty-one and 45 panellists participated in the first and second Delphi rounds, respectively. Consensus was reached to use overall survival, progression-free survival, minimal residual disease and treatment response to assess survival and disease control. Panellists agreed to measure health-related quality of life, pain, performance status, fatigue, psychosocial status, symptoms, self-perception on body image, sexuality and preferences/satisfaction. However, panellist did not reach consensus about the feasibility of assessing in routine practice psychosocial status, symptoms, self-perception on body image and sexuality. Consensus was reached to collect patient-reported outcomes through the European Organisation for the Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire (QLQ) Core questionnaire 30 (C30), three items from EORTC-QLQ-Multiple Myeloma (MY20) and EORTC-QLQ-Breast Cancer (BR23), pain Visual Analogue Scale, Morisky-Green and ad hoc questions about patients' preferences/satisfaction. A consensual standard set of outcomes for managing newly diagnosed patients with MM has been defined. The feasibility of its implementation in routine practice will be assessed in a future pilot study. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

PIM-Check: development of an international prescription-screening checklist designed by a Delphi method for internal medicine patients.

PubMed

Desnoyer, Aude; Blanc, Anne-Laure; Pourcher, Valérie; Besson, Marie; Fonzo-Christe, Caroline; Desmeules, Jules; Perrier, Arnaud; Bonnabry, Pascal; Samer, Caroline; Guignard, Bertrand

2017-07-31

Potentially inappropriate medication (PIM) occurs frequently and is a well-known risk factor for adverse drug events, but its incidence is underestimated in internal medicine. The objective of this study was to develop an electronic prescription-screening checklist to assist residents and young healthcare professionals in PIM detection. Five-step study involving selection of medical domains, literature review and 17 semistructured interviews, a two-round Delphi survey, a forward/back-translation process and an electronic tool development. 22 University and general hospitals from Canada, Belgium, France and Switzerland. 40 physicians and 25 clinical pharmacists were involved in the study.Agreement with the checklist statements and their usefulness for healthcare professional training were evaluated using two 6-point Likert scales (ranging from 0 to 5). Agreement and usefulness ratings were defined as: >65% of the experts giving the statement a rating of 4 or 5, during the first Delphi-round and >75% during the second. 166 statements were generated during the first two steps. Mean agreement and usefulness ratings were 4.32/5 (95% CI 4.28 to 4.36) and 4.11/5 (4.07 to 4.15), respectively, during the first Delphi-round and 4.53/5 (4.51 to 4.56) and 4.36/5 (4.33 to 4.39) during the second (p<0.001). The final checklist includes 160 statements in 17 medical domains and 56 pathologies. An algorithm of approximately 31 000 lines was developed including comorbidities and medications variables to create the electronic tool. PIM-Check is the first electronic prescription-screening checklist designed to detect PIM in internal medicine. It is intended to help young healthcare professionals in their clinical practice to detect PIM, to reduce medication errors and to improve patient safety. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

PIM-Check: development of an international prescription-screening checklist designed by a Delphi method for internal medicine patients

PubMed Central

Desnoyer, Aude; Blanc, Anne-Laure; Pourcher, Valérie; Besson, Marie; Fonzo-Christe, Caroline; Desmeules, Jules; Perrier, Arnaud; Bonnabry, Pascal; Samer, Caroline; Guignard, Bertrand

2017-01-01

Objectives Potentially inappropriate medication (PIM) occurs frequently and is a well-known risk factor for adverse drug events, but its incidence is underestimated in internal medicine. The objective of this study was to develop an electronic prescription-screening checklist to assist residents and young healthcare professionals in PIM detection. Design Five-step study involving selection of medical domains, literature review and 17 semistructured interviews, a two-round Delphi survey, a forward/back-translation process and an electronic tool development. Setting 22 University and general hospitals from Canada, Belgium, France and Switzerland. Participants 40 physicians and 25 clinical pharmacists were involved in the study. Agreement with the checklist statements and their usefulness for healthcare professional training were evaluated using two 6-point Likert scales (ranging from 0 to 5). Primary and secondary outcome measures Agreement and usefulness ratings were defined as: >65% of the experts giving the statement a rating of 4 or 5, during the first Delphi-round and >75% during the second. Results 166 statements were generated during the first two steps. Mean agreement and usefulness ratings were 4.32/5 (95% CI 4.28 to 4.36) and 4.11/5 (4.07 to 4.15), respectively, during the first Delphi-round and 4.53/5 (4.51 to 4.56) and 4.36/5 (4.33 to 4.39) during the second (p<0.001). The final checklist includes 160 statements in 17 medical domains and 56 pathologies. An algorithm of approximately 31 000 lines was developed including comorbidities and medications variables to create the electronic tool. Conclusion PIM-Check is the first electronic prescription-screening checklist designed to detect PIM in internal medicine. It is intended to help young healthcare professionals in their clinical practice to detect PIM, to reduce medication errors and to improve patient safety. PMID:28760793

[Prioritization and Consentation of Criteria for the Appraisal, Funding and Evaluation of Projects from the German Innovationsfonds: A multi-perspective Delphi study].

PubMed

Schmitt, J; Petzold, T; Nellessen-Martens, G; Pfaff, H

2015-09-01

The German Innovationsfonds provides the chance for evidence-based developments of the German healthcare system. Prioritization of recommendations for an effective, efficient, fair, transparent, and sustainable granting of funds through a transparent, evidence-driven consensus-process involving all relevant stakeholder groups. Representatives from health and research policy, payers, patient representatives, healthcare providers, and scientists were invited to nominate participants for an electronic 3 round iterative Delphi-study to prioritize the thematic focus, requirements concerning study methods, the team of applicants, evaluation, utilization of study results, and for the selection of reviewers. Criteria considered as relevant by at least 60% of the panel (consensus definition) in the first 2 Delphi rounds were rated as facultative, preferable, or obligatory criteria for project funding. Data were analyzed descriptively. ( Datenbank Versorgungsforschung Deutschland VfD_15_003561). All invited stakeholder groups except payers participated. 34 (85%) of 40 nominated representatives participated in the Delphi-study. A total of 64 criteria were consented as relevant for project review and funding concerning the thematic focus (n=28), methodological requirements (n=13), requirements for applicants (n=4), for the evaluation (n=4), utilization (n=6), and selection of peer reviewers (n=9). It is the collective responsibility of all stakeholders to spend the designated funds as efficient and sustainable as possible. The consented recommendations shall serve decision makers as a resource for the granting of funds and the evaluation of the Innovationsfonds. © Georg Thieme Verlag KG Stuttgart · New York.

International consensus on the most useful physical examination tests used by physiotherapists for patients with headache: A Delphi study.

PubMed

Luedtke, K; Boissonnault, W; Caspersen, N; Castien, R; Chaibi, A; Falla, D; Fernández-de-Las-Peñas, C; Hall, T; Hirsvang, J R; Horre, T; Hurley, D; Jull, G; Krøll, L S; Madsen, B K; Mallwitz, J; Miller, C; Schäfer, B; Schöttker-Königer, T; Starke, W; von Piekartz, H; Watson, D; Westerhuis, P; May, A

2016-06-01

A wide range of physical tests have been published for use in the assessment of musculoskeletal dysfunction in patients with headache. Which tests are used depends on a physiotherapist's clinical and scientific background as there is little guidance on the most clinically useful tests. To identify which physical examination tests international experts in physiotherapy consider the most clinically useful for the assessment of patients with headache. Delphi survey with pre-specified procedures based on a systematic search of the literature for physical examination tests proposed for the assessment of musculoskeletal dysfunction in patients with headache. Seventeen experts completed all three rounds of the survey. Fifteen tests were included in round one with eleven additional tests suggested by the experts. Finally eleven physical examination tests were considered clinically useful: manual joint palpation, the cranio-cervical flexion test, the cervical flexion-rotation test, active range of cervical movement, head forward position, trigger point palpation, muscle tests of the shoulder girdle, passive physiological intervertebral movements, reproduction and resolution of headache symptoms, screening of the thoracic spine, and combined movement tests. Eleven tests are suggested as a minimum standard for the physical examination of musculoskeletal dysfunctions in patients with headache. Copyright © 2016 Elsevier Ltd. All rights reserved.

Setting a health policy research agenda for controlling cancer burden in Korea.

PubMed

Jang, Sung-In; Cho, Kyoung-Hee; Kim, Sun Jung; Lee, Kwang-Sig; Park, Eun-Cheol

2015-04-01

The aim of study was to provide suggestions for prioritizing research in effort to reduce cancer burden in Korea based on a comprehensive analysis of cancer burden and Delphi consensus among cancer experts. Twenty research plans covering 10 topics were selected based on an assessment of the literature, and e-mail surveys were analyzed using a two-round modified Delphi method. Thirty-four out of 79 experts were selected from four organizations to participate in round one, and 21 experts among them had completed round two. Each item had two questions; one regarding the agreement of the topic as a priority item to reduce cancer burden, and the other about the importance of the item on a nine-point scale. A consensus was defined to be an average lower coefficient of variation with less than 30% in importance. Seven plans that satisfied the three criteria were selected as priority research plans for reducing cancer burden. These plans are "research into advanced clinical guidelines for thyroid cancer given the current issue with over-diagnosis," "research into smoking management plans through price and non-price cigarette policy initiatives," "research into ways to measure the quality of cancer care," "research on policy development to expand hospice care," "research into the spread and management of Helicobacter pylori," "research on palliative care in a clinical setting," and "research into alternative mammography methods to increase the accuracy of breast cancer screenings." The seven plans identified in this study should be prioritized to reduce the burden of cancer in Korea. We suggest that policy makers and administrators study and invest significant effort in these plans.

When, why and how foot orthoses (FOs) should be prescribed for children with flexible pes planus: a Delphi survey of podiatrists

PubMed Central

Uden, Hayley; Kumar, Saravana; Banwell, Helen A.

2018-01-01

Background Flexible pes planus (flat feet) in children is a common reason parents and caregivers seek health professionals consult and a frequent reason podiatrists prescribe foot orthoses. Yet no universal agreement exists on the diagnosis of this condition, or when and how foot orthoses should be prescribed. The aim of this study was to garner consensus and agreement among podiatrists on the use of FOs for paediatric flexible pes planus. Methods A three round Delphi consensus survey was undertaken with 15 podiatry experts from Australia, New Zealand and the United Kingdom. Round One gathered consensus on the diagnosis and intervention into paediatric pes planus with specific questions on types of FOs and prescription variables used. Round Two and Three were based on answers from Round One and gathered agreement (rationale for choices) on a five point Likert scale. 70% of respondents had to agree to a statement for it to be accepted as consensus or agreement. Results Consensus and agreement was achieved for 83 statements directing the diagnosis of pes planus (using FPI-6 and/or rearfoot measures), common signs and symptoms (e.g., pain, fatigue, abnormal gait and other functional concerns) that direct when to intervene into paediatric flexible pes planus. Prefabricated orthoses were the preferred intervention where adequate control is gained with their use. When customised orthoses are prescribed, a vertical [heel] cast pour (71.4%) and minimal arch fill (76.9%) are the prescription variables of choice, plus or minus additional variables (i.e., medial heel (Kirby) skive, the use of a University of California Biomechanical Laboratory device or a medial flange) dependent on level of disorder and plane of excessive motion. Conclusions This study identified consensus and agreement on a series of diagnosis methods and interventions for the paediatric flexible pes planus. A clinical protocol was developed from the resultant consensus statements which provides clinicians with a series of evidenced-informed statements to better guide them on when, how and why FOs are used specific to this population. PMID:29682429

Elder-friendly emergency services in Brazil: necessary conditions for care.

PubMed

Santos, Mariana Timmers Dos; Lima, Maria Alice Dias da Silva; Zucatti, Paula Buchs

2016-01-01

To identify and analyze the aspects necessary to provide an elder-friendly emergency service (ES) from the perspective of nurses. This is a descriptive, quantitative study using the Delphi technique in three rounds. Nurses with professional experience in the ES and/or researchers with publications and/or conducting research in the study area were selected. The first round of the Delphi panel had 72 participants, the second 49, and the third 44. An online questionnaire was used based on a review of the scientific literature with questions organized into the central dimensions of elder-friendly hospitals. A five-point Likert scale was used for each question and a 70% consensus level was established. There were 38 aspects identified as necessary for elderly care that were organized into central dimensions. The study's results are consistent with the findings in scientific literature and suggest indicators for quality of care and training for an elder-friendly ES. Identificar e analisar aspectos necessários para um atendimento amigo do idoso nos serviços de emergência (SE), na perspectiva de enfermeiros. Estudo descritivo, quantitativo, com utilização da Técnica Delphi, em três rodadas. Foram selecionados enfermeiros com experiência profissional em SE e/ou pesquisadores com publicações e/ou desenvolvendo pesquisas na área de estudo. A primeira rodada do painel Delphi contou com 72 participantes, a segunda com 49 e a terceira com 44. Foi utilizado questionário on-line, baseado na revisão da literatura científica, com questões organizadas em dimensões centrais de hospitais amigos do idoso. Foi utilizada uma escala de Likert de 5 pontos para cada questão e estabelecido nível de consenso de 70%. Foram identificados 38 aspectos necessários para o atendimento ao idoso, organizados em dimensões centrais. Os resultados do estudo são consistentes com os achados na literatura científica e sugerem indicadores para qualidade do cuidado e para formação de SE amigos do idoso.

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Standards for UNiversal reporting of patient Decision Aid Evaluation studies: the development of SUNDAE Checklist.

PubMed

Sepucha, Karen R; Abhyankar, Purva; Hoffman, Aubri S; Bekker, Hilary L; LeBlanc, Annie; Levin, Carrie A; Ropka, Mary; Shaffer, Victoria A; Sheridan, Stacey L; Stacey, Dawn; Stalmeier, Peep; Vo, Ha; Wills, Celia E; Thomson, Richard

2018-05-01

Patient decision aids (PDAs) are evidence-based tools designed to help patients make specific and deliberated choices among healthcare options. The International Patient Decision Aid Standards (IPDAS) Collaboration review papers and Cochrane systematic review of PDAs have found significant gaps in the reporting of evaluations of PDAs, including poor or limited reporting of PDA content, development methods and delivery. This study sought to develop and reach consensus on reporting guidelines to improve the quality of publications evaluating PDAs. An international workgroup, consisting of members from IPDAS Collaboration, followed established methods to develop reporting guidelines for PDA evaluation studies. This paper describes the results from three completed phases: (1) planning, (2) drafting and (3) consensus, which included a modified, two-stage, online international Delphi process. The work was conducted over 2 years with bimonthly conference calls and three in-person meetings. The workgroup used input from these phases to produce a final set of recommended items in the form of a checklist. The SUNDAE Checklist (Standards for UNiversal reporting of patient Decision Aid Evaluations) includes 26 items recommended for studies reporting evaluations of PDAs. In the two-stage Delphi process, 117/143 (82%) experts from 14 countries completed round 1 and 96/117 (82%) completed round 2. Respondents reached a high level of consensus on the importance of the items and indicated strong willingness to use the items when reporting PDA studies. The SUNDAE Checklist will help ensure that reports of PDA evaluation studies are understandable, transparent and of high quality. A separate Explanation and Elaboration publication provides additional details to support use of the checklist. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Using a Delphi process to define priorities for prison health research in Canada

PubMed Central

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-01

Objectives A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. Setting We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. Participants We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators’ professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Primary and secondary outcome measures Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. Results In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Conclusions Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. PMID:26769790

Development of core outcome sets for effectiveness trials of interventions to prevent and/or treat delirium (Del-COrS): study protocol.

PubMed

Rose, Louise; Agar, Meera; Burry, Lisa D; Campbell, Noll; Clarke, Mike; Lee, Jacques; Siddiqi, Najma; Page, Valerie J

2017-09-18

Delirium is a common, serious and potentially preventable condition with devastating impact on the quality of life prompting a proliferation of interventional trials. Core outcome sets aim to standardise outcome reporting by identifying outcomes perceived fundamental for measurement in trials of a specific interest area. Our aim is to develop international consensus on two core outcome sets for trials of interventions to prevent and/or treat delirium, irrespective of study population. We aim to identify additional core outcomes specific to the critically ill, acutely hospitalised patients, palliative care and older adults. We will conduct a systematic review of published and ongoing delirium trials (1980 onwards) and one-on-one interviews of patients who have experienced delirium and family members. These data will inform Delphi round 1 of a two-stage consensus process. In round 2, we will provide participants their own response, summarised group responses and those of patient/family participants for rescoring. We will randomise participants to receive feedback as proportion scoring the outcome as critical or as group mean responses. We will hold a consensus meeting using nominal group technique to finalise outcomes for inclusion. We will repeat the Delphi process and consensus meeting to select measures for each core outcome. We will recruit 240 Delphi participants giving us 80% power to detect a 1.0-1.5 point (9-point scale) difference by feedback method between rounds. We will analyse differences for subsequent scores, magnitude of opinion change, items retained and level of agreement. We are obtaining research ethics approvals according to local governance. Participation will be voluntary and data deidentified. Support from three international delirium organisations will be instrumental in dissemination and core outcome set uptake. We will disseminate through peer-reviewed open access publications and present at conferences selected to reach a wide range of knowledge users. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Judgment skills, a missing component in health literacy: development of a tool for asthma patients in the Italian-speaking region of Switzerland.

PubMed

Moreno Londoño, Ana Maria; Schulz, Peter J

2014-04-01

Health literacy has been recognized as an important factor influencing health behaviors and health outcomes. However, its definition is still evolving, and the tools available for its measurement are limited in scope. Based on the conceptualization of health literacy within the Health Empowerment Model, the present study developed and validated a tool to assess patient's health knowledge use, within the context of asthma self-management. A review of scientific literature on asthma self-management, and several interviews with pulmonologists and asthma patients were conducted. From these, 19 scenarios with 4 response options each were drafted and assembled in a scenario-based questionnaire. Furthermore, a three round Delphi procedure was carried out, to validate the tool with the participation of 12 specialists in lung diseases. The face and content validity of the tool were achieved by face-to-face interviews with 2 pulmonologists and 5 patients. Consensus among the specialists on the adequacy of the response options was achieved after the three round Delphi procedure. The final tool has a 0.97 intra-class correlation coefficient (ICC), indicating a strong level of agreement among experts on the ratings of the response options. The ICC for single scenarios, range from 0.92 to 0.99. The newly developed tool provides a final score representing patient's health knowledge use, based on the specialist's consensus. This tool contributes to enriching the measurement of a more advanced health literacy dimension.

Providing mental health first aid in the workplace: a Delphi consensus study.

PubMed

Bovopoulos, Nataly; Jorm, Anthony F; Bond, Kathy S; LaMontagne, Anthony D; Reavley, Nicola J; Kelly, Claire M; Kitchener, Betty A; Martin, Angela

2016-08-02

Mental health problems are common in the workplace, but workers affected by such problems are not always well supported by managers and co-workers. Guidelines exist for the public on how to provide mental health first aid, but not specifically on how to tailor one's approach if the person of concern is a co-worker or employee. A Delphi consensus study was carried out to develop guidelines on additional considerations required when offering mental health first aid in a workplace context. A systematic search of websites, books and journal articles was conducted to develop a questionnaire with 246 items containing actions that someone may use to offer mental health first aid to a co-worker or employee. Three panels of experts from English-speaking countries were recruited (23 consumers, 26 managers and 38 workplace mental health professionals), who independently rated the items over three rounds for inclusion in the guidelines. The retention rate of the expert panellists across the three rounds was 61.7 %. Of the 246 items, 201 items were agreed to be important or very important by at least 80 % of panellists. These 201 endorsed items included actions on how to approach and offer support to a co-worker, and additional considerations where the person assisting is a supervisor or manager, or is assisting in crisis situations such as acute distress. The guidelines outline strategies for a worker to use when they are concerned about the mental health of a co-worker or employee. They will be used to inform future tailoring of Mental Health First Aid training when it is delivered in workplace settings and could influence organisational policies and procedures.

Research priorities in Italian diabetes nursing care: findings from a Delphi study.

PubMed

Palese, A; Gentilini, S; Lo Grasso, G; Branca, M T; Chiandetti, R; Mansutti, I

2015-01-01

Defining a set of research priorities for diabetes nursing care in the Italian context. A two-step study design based on a modified Delphi technique was undertaken in 2013. In the first stage of research, five systematic reviews of literature were performed. Among them 865 recommendations in diabetes nursing care emerged, and 217 (25.1%) were categorized at level IV or lower, thus based on a lack of knowledge and therefore a potential research area. Homogeneous recommendations among the 217 emerged and were categorized by two researchers independently: 96 final recommendations were identified and transformed into items embodied into a questionnaire. A Likert scale ranging from 1 (very low) to 5 (very high) was used to collect the consensus regarding priority. For that purpose a sample of 200 nurses was randomly considered. Potential participants were invited to cooperate via email through a letter reporting aims and methods. In the first round 85 nurses participated; in the third and final round, only 13 nurses took part. Participants have identified 14 research priorities categorized into three main areas: 1) education strategies' effectiveness (n=7); 2) models of care delivery and advanced nursing education effectiveness (n=4); and 3) in specific clinical issues (n=3). More research on patient education and on models of care delivery and advanced nursing education should be included in any future Italian agenda.

Core Domains for Clinical Research in Acute Respiratory Failure Survivors: An International Modified Delphi Consensus Study.

PubMed

Turnbull, Alison E; Sepulveda, Kristin A; Dinglas, Victor D; Chessare, Caroline M; Bingham, Clifton O; Needham, Dale M

2017-06-01

To identify the "core domains" (i.e., patient outcomes, health-related conditions, or aspects of health) that relevant stakeholders agree are essential to assess in all clinical research studies evaluating the outcomes of acute respiratory failure survivors after hospital discharge. A two-round consensus process, using a modified Delphi methodology, with participants from 16 countries, including patient and caregiver representatives. Prior to voting, participants were asked to review 1) results from surveys of clinical researchers, acute respiratory failure survivors, and caregivers that rated the importance of 19 preliminary outcome domains and 2) results from a qualitative study of acute respiratory failure survivors' outcomes after hospital discharge, as related to the 19 preliminary outcome domains. Participants also were asked to suggest any additional potential domains for evaluation in the first Delphi survey. Web-based surveys of participants representing four stakeholder groups relevant to clinical research evaluating postdischarge outcomes of acute respiratory failure survivors: clinical researchers, clinicians, patients and caregivers, and U.S. federal research funding organizations. None. None. Survey response rates were 97% and 99% in round 1 and round 2, respectively. There were seven domains that met the a priori consensus criteria to be designated as core domains: physical function, cognition, mental health, survival, pulmonary function, pain, and muscle and/or nerve function. This study generated a consensus-based list of core domains that should be assessed in all clinical research studies evaluating acute respiratory failure survivors after hospital discharge. Identifying appropriate measurement instruments to assess these core domains is an important next step toward developing a set of core outcome measures for this field of research.

Therapist competencies necessary for the delivery of compassion-focused therapy: A Delphi study.

PubMed

Liddell, Alice E; Allan, Steven; Goss, Ken

2017-06-01

Compassion-focused therapy (CFT) has shown promising results for a range of clinical presentations. This study explored the therapeutic competencies required to deliver CFT and organized these into a coherent framework. The Delphi method was used to explore and refine competencies for delivering CFT in three rounds of data collection. The first round involved interviews with 12 experts in CFT. Data were analysed using template analysis to generate a draft competency framework. The main competencies were used to create a survey for rounds two and three involving CFT experts and practitioners. Data collected from the surveys were used to refine the competencies. The CFT competency framework (CFT-CF) that was produced comprised 25 main competencies within six key areas of competence. The areas were as follows: competencies in creating safeness, meta-skills, non-phase-specific skills, phase-specific skills, knowledge and understanding and use of supervision. The main competencies included several subcompetencies specifying knowledge, skills and attributes needed to demonstrate the main competence. Overall, there was consensus on 14 competencies and 20 competencies exceeded an 80% agreement level. Some of the CFT competencies overlapped with existing therapies, whilst others were specific to CFT. The CFT-CF provides useful guidance for clinicians, supervisors and training programmes. Further research could develop the CFT-CF into a therapist rating scale in order to measure the outcome of training and to assess treatment fidelity in clinical trials. The compassion-focused therapy competency framework (CFT-CF) identifies therapeutic competencies that overlap with existing treatments as well as those specific to compassion-focused therapy (CFT). The CFT-CF builds guidance for the competencies required to deliver CFT in a range of clinical settings. The CFT-CF provides guidance for those training CFT therapists. The CFT-CF could be used as a basis to develop a therapist rating scale. © 2016 The British Psychological Society.

Modified Policy-Delphi study for exploring obesity prevention priorities

PubMed Central

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-01-01

Introduction Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of ‘intrusiveness’ has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. Methods and analysis The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethics and dissemination Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. PMID:27601495

Modified Policy-Delphi study for exploring obesity prevention priorities.

PubMed

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-09-06

Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of 'intrusiveness' has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Administration and leadership competencies: establishment of a national consensus for emergency medicine.

PubMed

Thoma, Brent; Poitras, Julien; Penciner, Rick; Sherbino, Jonathan; Holroyd, Brian R; Woods, Robert A

2015-03-01

The Royal College of Physicians and Surgeons of Canada requires emergency medicine (EM) residency programs to meet training objectives relating to administration and leadership. The purpose of this study was to establish a national consensus on the competencies for inclusion in an EM administration and leadership curriculum. A modified Delphi process involving two iterative rounds of an electronic survey was used to achieve consensus on competencies for inclusion in an EM administration and leadership curriculum. An initial list of competencies was compiled using peer-reviewed and grey literature. The participants included 14 EM residency program directors and 43 leadership and administration experts from across Canada who were recruited using a snowball technique. The proposed competencies were organized using the CanMEDS Physician Competency Framework and presented in English or French. Consensus was defined a priori as >70% agreement. Nearly all (13 of 14) of the institutions with an FRCPC EM program had at least one participant complete both surveys. Thirty-five of 57 (61%) participants completed round 1, and 30 (53%) participants completed both rounds. Participants suggested an additional 16 competencies in round 1. The results of round 1 informed the decisions in round 2. Fifty-nine of 109 (54.1%) competencies achieved consensus for inclusion. Based on a national modified Delphi process, we describe 59 competencies for inclusion in an EM administration and leadership curriculum that was arranged by CanMEDS Role. EM educators may consider these competencies when designing local curricula.

Delphi survey to identify topics to be addressed at the initial follow-up consultation after oesophageal cancer surgery.

PubMed

Jacobs, M; Henselmans, I; Macefield, R C; Blencowe, N S; Smets, E M A; de Haes, J C J M; Sprangers, M A G; Blazeby, J M; van Berge Henegouwen, M I

2014-12-01

There is no consensus among patients and healthcare professionals (HCPs) on the topics that need to be addressed after oesophageal cancer surgery. The aim of this study was to identify these topics, using a two-round Delphi survey. In round 1, patients and HCPs (surgeons, dieticians, nurses) were invited to rate the importance of 49 topics. The proportion of panellists that considered a topic to be of low, moderate or high importance was then calculated for each of these two groups. Based on these proportions and the i.q.r., topics were categorized as: 'consensus to be included', 'consensus to be excluded' and 'no consensus'. Only topics in the first category were included in the second round. In round 2, panellists were provided with individual and group feedback. To be included in the final list, topics had to meet criteria for consensus and stability. There were 108 patients and 77 HCPs in the round 2 analyses. In general, patients and HCPs considered the same topics important. The final list included 23 topics and revealed that it was most important to address: cancer removed/lymph nodes, the new oesophagus, eating and drinking, surgery, alarming new complaints and the recovery period. The study provides surgeons with a list of topics selected by patients and HCPs that may be addressed systematically at the initial follow-up consultation after oesophageal cancer surgery. © 2014 BJS Society Ltd. Published by John Wiley & Sons Ltd.

Patients’ and Clinicians’ Views of the Psychological Components of Tinnitus Treatment That Could Inform Audiologists’ Usual Care: A Delphi Survey

PubMed Central

Taylor, John; Hall, Deborah A.; Walker, Dawn-Marie; McMurran, Mary; Casey, Amanda; Stockdale, David; Featherstone, Debbie; Hoare, Derek J.

2018-01-01

Objectives: The aim of this study was to determine which components of psychological therapies are most important and appropriate to inform audiologists’ usual care for people with tinnitus. Design: A 39-member panel of patients, audiologists, hearing therapists, and psychologists completed a three-round Delphi survey to reach consensus on essential components of audiologist-delivered psychologically informed care for tinnitus. Results: Consensus (≥80% agreement) was reached on including 76 of 160 components. No components reached consensus for exclusion. The components reaching consensus were predominantly common therapeutic skills such as Socratic questioning and active listening, rather than specific techniques, for example, graded exposure therapy or cognitive restructuring. Consensus on educational components to include largely concerned psychological models of tinnitus rather than neurophysiological information. Conclusions: The results of this Delphi survey provide a tool to develop audiologists’ usual tinnitus care using components that both patients and clinicians agree are important and appropriate to be delivered by an audiologist for adults with tinnitus-related distress. Research is now necessary to test the added effects of these components when delivered by audiologists. PMID:28930785

A checklist to assess the quality of reports on spa therapy and balneotherapy trials was developed using the Delphi consensus method: the SPAC checklist.

PubMed

Kamioka, Hiroharu; Kawamura, Yoichi; Tsutani, Kiichiro; Maeda, Masaharu; Hayasaka, Shinya; Okuizum, Hiroyasu; Okada, Shinpei; Honda, Takuya; Iijima, Yuichi

2013-08-01

The purpose of this study was to develop a checklist of items that describes and measures the quality of reports of interventional trials assessing spa therapy. The Delphi consensus method was used to select the number of items in the checklist. A total of eight individuals participated, including an epidemiologist, a clinical research methodologist, clinical researchers, a medical journalist, and a health fitness programmer. Participants ranked on a 9-point Likert scale whether an item should be included in the checklist. Three rounds of the Delphi method were conducted to achieve consensus. The final checklist contained 19 items, with items related to title, place of implementation (specificity of spa), care provider influence, and additional measures to minimize the potential bias from withdrawals, loss to follow-up, and low treatment adherence. This checklist is simple and quick to complete, and should help clinicians and researchers critically appraise the medical and healthcare literature, reviewers assess the quality of reports included in systematic reviews, and researchers plan interventional trials of spa therapy. Copyright © 2013 Elsevier Ltd. All rights reserved.

Development of the Korean framework for senior-friendly hospitals: a Delphi study.

PubMed

Kim, Yoon-Sook; Han, Seol-Heui; Hwang, Jeong-Hae; Park, Jae-Min; Lee, Jongmin; Choi, Jaekyung; Moon, Yeonsil; Kim, Hee Joung; Shin, Grace Jung Eun; Lee, Ji-Sun; Choi, Ye Ji; Uhm, Kyeong Eun; Kim, In Ae; Nam, Ji-Won

2017-08-04

Aging is an inevitable part of life. One can maintain well-being and wellness even after discharge and/or transition if his or her functional decline is minimized, sudden decline is prevented, and functioning is promoted during hospitalization. Caring appropriately for elderly patients requires the systematic application of Senior-Friendly Hospital principles to all operating systems, including medical centres' organization and environment, as well as patient treatment processes. The Senior-Friendly Hospital framework is valid and important for patient safety and quality improvement. This study aimed to make recommendations regarding the development of the Korean Framework for Senior-Friendly Hospitals for older patients' care management, patient safety interventions, and health promotion, via a Delphi survey. Two rounds of Delphi surveying were conducted with 15 participants who had at least 3 years' experience in accreditation surveying and medical accreditation standards, survey methods, and accreditation investigator education. In each round, we calculated statistics describing each standard's validity and feasibility. The Korean Framework for Senior-Friendly Hospitals included 4 Chapters, 11 categories, and 67 standards through consensus of the Senior-Friendly Hospitals task force and experts' peer review. After the two rounds of Delphi surveying, validity evaluation led to no changes in standards of the Senior-Friendly Hospitals; however, the number of standards showing adequate validity decreased from 67 to 58. Regarding feasibility, no changes were necessary in the standards; however, the number of categories showing adequate feasibility decreased from 11 to 8 and from 67 to 30, respectively. The excluded categories were 3.2, 4.2, and 4.3 (service, transportation, and signage and identification). The highest feasibility values were given to standards 2.1.1, 4.1.4, and 4.1.6. The highest feasibility score was given to standard 2.4.2. The Korean Framework for Senior-Friendly Hospitals needs to include 4 Chapters, 8 categories, and 30 standards. The Accreditation Program for Healthcare Organizations should include Senior-Friendly Hospitals -relevant standards considering Korea's medical environment.

Procedure competencies and job functions of the urologic advanced practice nurse.

PubMed

Kleier, Jo Ann

2009-01-01

A 2-round modified Delphi study recruited a panel urologic advanced practice nurse experts to identify the procedure competencies and job functions unique to the role of the advanced practice nurse specializing in the care of urology patients.

Characteristics of student preparedness for clinical learning: clinical educator perspectives using the Delphi approach

PubMed Central

2012-01-01

Background During clinical placements, clinical educators facilitate student learning. Previous research has defined the skills, attitudes and practices that pertain to an ideal clinical educator. However, less attention has been paid to the role of student readiness in terms of foundational knowledge and attitudes at the commencement of practice education. Therefore, the aim of this study was to ascertain clinical educators’ views on the characteristics that they perceive demonstrate that a student is well prepared for clinical learning. Methods A two round on-line Delphi study was conducted. The first questionnaire was emailed to a total of 636 expert clinical educators from the disciplines of occupational therapy, physiotherapy and speech pathology. Expert clinical educators were asked to describe the key characteristics that indicate a student is prepared for a clinical placement and ready to learn. Open-ended responses received from the first round were subject to a thematic analysis and resulted in six themes with 62 characteristics. In the second round, participants were asked to rate each characteristic on a 7 point Likert Scale. Results A total of 258 (40.56%) responded to the first round of the Delphi survey while 161 clinical educators completed the second (62.40% retention rate). Consensus was reached on 57 characteristics (six themes) using a cut off of greater than 70% positive respondents and an interquartile deviation IQD of equal or less than 1. Conclusions This study identified 57 characteristics (six themes) perceived by clinical educators as indicators of a student who is prepared and ready for clinical learning. A list of characteristics relating to behaviours has been compiled and could be provided to students to aid their preparation for clinical learning and to universities to incorporate within curricula. In addition, the list provides a platform for discussions by professional bodies about the role of placement education. PMID:23145840

Core Outcome Domains for early phase clinical trials of sound-, psychology-, and pharmacology-based interventions to manage chronic subjective tinnitus in adults: the COMIT'ID study protocol for using a Delphi process and face-to-face meetings to establish consensus.

PubMed

Fackrell, Kathryn; Smith, Harriet; Colley, Veronica; Thacker, Brian; Horobin, Adele; Haider, Haúla F; Londero, Alain; Mazurek, Birgit; Hall, Deborah A

2017-08-23

The reporting of outcomes in clinical trials of subjective tinnitus indicates that many different tinnitus-related complaints are of interest to investigators, from perceptual attributes of the sound (e.g. loudness) to psychosocial impacts (e.g. quality of life). Even when considering one type of intervention strategy for subjective tinnitus, there is no agreement about what is critically important for deciding whether a treatment is effective. The main purpose of this observational study is, therefore to, develop Core Outcome Domain Sets for the three different intervention strategies (sound, psychological, and pharmacological) for adults with chronic subjective tinnitus that should be measured and reported in every clinical trial of these interventions. Secondary objectives are to identify the strengths and limitations of our study design for recruiting and reducing attrition of participants, and to explore uptake of the core outcomes. The 'Core Outcome Measures in Tinnitus: International Delphi' (COMIT'ID) study will use a mixed-methods approach that incorporates input from health care users at the pre-Delphi stage, a modified three-round Delphi survey and final consensus meetings (one for each intervention). The meetings will generate recommendations by stakeholder representatives on agreed Core Outcome Domain Sets specific to each intervention. A subsequent step will establish a common cross-cutting Core Outcome Domain Set by identifying the common outcome domains included in all three intervention-specific Core Outcome Domain Sets. To address the secondary objectives, we will gather feedback from participants about their experience of taking part in the Delphi process. We aspire to conduct an observational cohort study to evaluate uptake of the core outcomes in published studies at 7 years following Core Outcome Set publication. The COMIT'ID study aims to develop a Core Outcome Domain Set that is agreed as critically important for deciding whether a treatment for subjective tinnitus is effective. Such a recommendation would help to standardise future clinical trials worldwide and so we will determine if participation increases use of the Core Outcome Set in the long term. This project has been registered (November 2014) in the database of the Core Outcome Measures in Effectiveness Trials (COMET) initiative.

Criteria required for an acceptable point-of-care test for UTI detection: Obtaining consensus using the Delphi technique

PubMed Central

Kearney, Paddy; Stafford, Bob; Gormley, Gerard J.; Crockard, Martin A.; Gilpin, Deirdre F.

2018-01-01

Background Urinary Tract Infections (UTIs) are common bacterial infections, second only to respiratory tract infections and particularly prevalent within primary care. Conventional detection of UTIs is culture, however, return of results can take between 24 and 72 hours. The introduction of a point of care (POC) test would allow for more timely identification of UTIs, facilitating improved, targeted treatment. This study aimed to obtain consensus on the criteria required for a POC UTI test, to meet patient need within primary care. Methods Criteria for consideration were compiled by the research team. These criteria were validated through a two-round Delphi process, utilising an expert panel of healthcare professionals from across Europe and United States of America. Using web-based questionnaires, panellists recorded their level of agreement with each criterion based on a 5-point Likert Scale, with space for comments. Using median response, interquartile range and comments provided, criteria were accepted/rejected/revised depending on pre-agreed cut-off scores. Results The first round questionnaire presented thirty-three criteria to the panel, of which 22 were accepted. Consensus was not achieved for the remaining 11 criteria. Following response review, one criterion was removed, while after revision, the remaining 10 criteria entered the second round. Of these, four were subsequently accepted, resulting in 26 criteria considered appropriate for a POC test to detect urinary infections. Conclusion This study generated an approved set of criteria for a POC test to detect urinary infections. Criteria acceptance and comments provided by the healthcare professionals also supports the development of a multiplex point of care UTI test. PMID:29879161

Attribution of mental illness to work: a Delphi study.

PubMed

Wong, M G P; Poole, C J M; Agius, R

2015-07-01

Clinicians may be asked whether mental ill-health has been caused by work but there is no guidance on how this judgement should be made. To seek a consensus on the factors that should be considered and how they should be sought when attributing mental ill-health to work. A three-round Delphi study involving expert academics, occupational physicians, psychiatrists and psychologists. We deemed consensus had been reached when 66% or more of the experts were in agreement. Of 54 invited experts, 35 (65%) took part in the first round, 30 of these 35 (86%) in the second and 29 of these 30 (97%) in the final round. Consensus was reached for 11 workplace stressors: high job strain; effort-reward imbalance; major trauma; interpersonal conflict; inadequate support; role ambiguity; person-job mismatch; organizational injustice; organizational culture; work scheduling and threats to job security. Seven personal factors were identified as being important: previous mental illness; personality traits of neuroticism; adverse life events or social circumstances; resilience; a family history of mental illness and secondary gain. The worker, manager and co-workers were thought to be the most useful sources of workplace information. Consensus was reached for a definition of occupational mental illness but not for a threshold of work-relatedness. The attribution of mental ill-health to work is complex and involves the consideration of both workplace stressors and personal factors of vulnerability. Clinical consultation with an occupational physician who is familiar with the workplace is central to the process. © The Author 2015. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Dupuytren disease: European hand surgeons, hand therapists, and physical medicine and rehabilitation physicians agree on a multidisciplinary treatment guideline: results from the HANDGUIDE study.

PubMed

Huisstede, Bionka M A; Hoogvliet, Peter; Coert, J Henk; Fridén, Jan

2013-12-01

Multidisciplinary treatment guidelines for Dupuytren disease can aid in optimizing the quality of care for patients with this disorder. Therefore, this study aimed to achieve consensus on a multidisciplinary treatment guideline for Dupuytren disease. A European Delphi consensus strategy was initiated. A systematic review reporting on the effectiveness of interventions was conducted and used as an evidence-based starting point for this study. In total, 39 experts (hand surgeons, hand therapists, and physical medicine and rehabilitation physicians) participated in the Delphi consensus strategy. Each Delphi round consisted of a questionnaire, an analysis, and a feedback report. After four Delphi rounds, consensus was achieved on the description, symptoms, and diagnosis of Dupuytren disease. No nonsurgical interventions were included in the guideline. Needle and open fasciotomy, and a limited fasciectomy and dermofasciectomy, were seen as suitable surgical techniques for Dupuytren disease. Factors relevant for choosing one of these surgical techniques were identified and divided into patient-related (age, comorbidity), disease-related (palpable cord, previous surgery in the same area, skin involvement, time of recovery, recurrences), and surgeon-related (years of experience) factors. Associations of these factors with the choice of a specific surgical technique were reported in the guideline. Postsurgical rehabilitation should always include instructions and exercise therapy; postsurgical splinting should be performed on indication. Relevant details for the use of surgical and postsurgical interventions were described. This treatment guideline is likely to promote further discussion on related clinical and scientific issues and may therefore contribute to better treatment of patients with Dupuytren disease.

Which Dimensions of Patient-Centeredness Matter? - Results of a Web-Based Expert Delphi Survey.

PubMed

Zill, Jördis M; Scholl, Isabelle; Härter, Martin; Dirmaier, Jörg

2015-01-01

Present models and definitions of patient-centeredness revealed a lack of conceptual clarity. Based on a prior systematic literature review, we developed an integrative model with 15 dimensions of patient-centeredness. The aims of this study were to 1) validate, and 2) prioritize these dimensions. A two-round web-based Delphi study was conducted. 297 international experts were invited to participate. In round one they were asked to 1) give an individual rating on a nine-point-scale on relevance and clarity of the dimensions, 2) add missing dimensions, and 3) prioritize the dimensions. In round two, experts received feedback about the results of round one and were asked to reflect and re-rate their own results. The cut-off for the validation of a dimension was a median < 7 on one of the criteria. 105 experts participated in round one and 71 in round two. In round one, one new dimension was suggested and included for discussion in round two. In round two, this dimension did not reach sufficient ratings to be included in the model. Eleven dimensions reached a median ≥ 7 on both criteria (relevance and clarity). Four dimensions had a median < 7 on one or both criteria. The five dimensions rated as most important were: patient as a unique person, patient involvement in care, patient information, clinician-patient communication and patient empowerment. 11 out of the 15 dimensions have been validated through experts' ratings. Further research on the four dimensions that received insufficient ratings is recommended. The priority order of the dimensions can help researchers and clinicians to focus on the most important dimensions of patient-centeredness. Overall, the model provides a useful framework that can be used in the development of measures, interventions, and medical education curricula, as well as the adoption of a new perspective in health policy.

Which Dimensions of Patient-Centeredness Matter? - Results of a Web-Based Expert Delphi Survey

PubMed Central

Zill, Jördis M.; Scholl, Isabelle; Härter, Martin; Dirmaier, Jörg

2015-01-01

Background Present models and definitions of patient-centeredness revealed a lack of conceptual clarity. Based on a prior systematic literature review, we developed an integrative model with 15 dimensions of patient-centeredness. The aims of this study were to 1) validate, and 2) prioritize these dimensions. Method A two-round web-based Delphi study was conducted. 297 international experts were invited to participate. In round one they were asked to 1) give an individual rating on a nine-point-scale on relevance and clarity of the dimensions, 2) add missing dimensions, and 3) prioritize the dimensions. In round two, experts received feedback about the results of round one and were asked to reflect and re-rate their own results. The cut-off for the validation of a dimension was a median < 7 on one of the criteria. Results 105 experts participated in round one and 71 in round two. In round one, one new dimension was suggested and included for discussion in round two. In round two, this dimension did not reach sufficient ratings to be included in the model. Eleven dimensions reached a median ≥ 7 on both criteria (relevance and clarity). Four dimensions had a median < 7 on one or both criteria. The five dimensions rated as most important were: patient as a unique person, patient involvement in care, patient information, clinician-patient communication and patient empowerment. Discussion 11 out of the 15 dimensions have been validated through experts’ ratings. Further research on the four dimensions that received insufficient ratings is recommended. The priority order of the dimensions can help researchers and clinicians to focus on the most important dimensions of patient-centeredness. Overall, the model provides a useful framework that can be used in the development of measures, interventions, and medical education curricula, as well as the adoption of a new perspective in health policy. PMID:26539990

Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

PubMed

Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

2016-07-01

To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

Clinical stakeholders’ opinions on the use of selective decontamination of the digestive tract in critically ill patients in intensive care units: an international Delphi study

PubMed Central

2013-01-01

Introduction Selective decontamination of the digestive tract (SDD) is a prophylactic antibiotic regimen that is not widely used in practice. We aimed to describe the opinions of key ‘stakeholders’ about the validity of the existing evidence base, likely consequences of implementation, relative importance of their opinions in influencing overall practice, likely barriers to implementation and perceptions of the requirement for further research to inform the decision about whether to embark on a further large randomised controlled trial. Methods This was a Delphi study informed by comprehensive framework of possible determinants of health professionals’ behaviour to study Critical Care practice in four countries. There were four key stakeholder participant groups including ICU physicians, pharmacists, clinical leads, and clinical microbiologists/ infectious disease physicians. Round one comprised participant interviews and Rounds two and three were online questionnaires using Delphi method. Results In this study, 141 participants were recruited of whom 82% were retained. Participants rated themselves as knowledgeable about SDD. Antibiotic resistance was identified as the most important issue. SDD was seen as a low clinical priority but few participants reported strong opposition. There was moderate agreement that research to date has not adequately addressed concerns about antibiotic resistance and lacks generalizability. Participants indicated equipoise with regard to benefits and harms of SDD, and indicated strong support for a further randomised trial. Conclusions Clinicians have clinical equipoise about the effectiveness of SDD. Future research requires longer follow up to assess antibiotic resistance as well as greater validity/generalizability to provide definitive answers on the effectiveness of decontamination and effects on antibiotic resistance. SDD was regarded as not being a high clinical priority, which may limit future trial participation. These results have identified that further large randomised controlled trial of SDD in critical care is both warranted and appropriate. PMID:24207137

Improving Patient Safety in Public Hospitals: Developing Standard Measures to Track Medical Errors and Process Breakdowns.

PubMed

Ackerman, Sara L; Gourley, Gato; Le, Gem; Williams, Pamela; Yazdany, Jinoos; Sarkar, Urmimala

2018-03-14

The aim of the study was to develop standards for tracking patient safety gaps in ambulatory care in safety net health systems. Leaders from five California safety net health systems were invited to participate in a modified Delphi process sponsored by the Safety Promotion Action Research and Knowledge Network (SPARKNet) and the California Safety Net Institute in 2016. During each of the three Delphi rounds, the feasibility and validity of 13 proposed patient safety measures were discussed and prioritized. Surveys and transcripts from the meetings were analyzed to understand the decision-making process. The Delphi process included eight panelists. Consensus was reached to adopt 9 of 13 proposed measures. All 9 measures were unanimously considered valid, but concern was expressed about the feasibility of implementing several of the measures. Although safety net health systems face high barriers to standardized measurement, our study demonstrates that consensus can be reached on acceptable and feasible methods for tracking patient safety gaps in safety net health systems. If accompanied by the active participation key stakeholder groups, including patients, clinicians, staff, data system professionals, and health system leaders, the consensus measures reported here represent one step toward improving ambulatory patient safety in safety net health systems.

Adaptation of a difficult-to-manage asthma programme for implementation in the Dutch context: a modified e-Delphi

PubMed Central

Honkoop, Persijn J; Pinnock, Hilary; Kievits-Smeets, Regien M M; Sterk, Peter J; Dekhuijzen, P N Richard; in ’t Veen, Johannes C C M

2017-01-01

Patients with difficult-to-manage asthma represent a heterogeneous subgroup of asthma patients who require extensive assessment and tailored management. The International Primary Care Respiratory Group approach emphasises the importance of differentiating patients with asthma that is difficult to manage from those with severe disease. Local adaptation of this approach, however, is required to ensure an appropriate strategy for implementation in the Dutch context. We used a modified three-round e-Delphi approach to assess the opinion of all relevant stakeholders (general practitioners, pulmonologists, practice nurses, pulmonary nurses and people with asthma). In the first round, the participants were asked to provide potentially relevant items for a difficult-to-manage asthma programme, which resulted in 67 items. In the second round, we asked participants to rate the relevance of specific items on a seven-point Likert scale, and 46 items were selected as relevant. In the third round, the selected items were categorised and items were ranked within the categories according to relevance. Finally, we created the alphabet acronym for the categories ‘the A–I of difficult-to-manage asthma’ to resonate with an established Dutch ‘A–E acronym for determining asthma control’. This should facilitate implementation of this programme within the existing structure of educational material on asthma and chronic obstructive pulmonary disease (COPD) in primary care, with potential for improving management of difficult-to-manage asthma. Other countries could use a similar approach to create a locally adapted version of such a programme. PMID:28184039

What should be included in the assessment of laypersons' paediatric basic life support skills? Results from a Delphi consensus study.

PubMed

Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim; Bohnstedt, Cathrine; Sønderskov, Claus; Østergaard, Doris; Tolsgaard, Martin Grønnebæk

2018-01-18

Assessment of laypersons' Paediatric Basic Life Support (PBLS) skills is important to ensure acquisition of effective PBLS competencies. However limited evidence exists on which PBLS skills are essential for laypersons. The same challenges exist with respect to the assessment of foreign body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts suggested items to assess laypersons' PBLS and FBAOM skills. In the second round, the suggested items received comments from and were rated by 26 experts (93%) on a 5-point scale (1 = not relevant to 5 = essential). Revised items were anonymously presented in a third round for comments and 23 (82%) experts completed a re-rating. Items with a score above 3 by more than 80% of the experts in the third round were included in an assessment instrument. In the first round, 19 and 15 items were identified to assess PBLS and FBAOM skills, respectively. The ratings and comments from the last two rounds resulted in nine and eight essential assessment items for PBLS and FBAOM skills, respectively. The PBLS items included: "Responsiveness"," Call for help", "Open airway"," Check breathing", "Rescue breaths", "Compressions", "Ventilations", "Time factor" and "Use of AED". The FBAOM items included: "Identify different stages of foreign body airway obstruction", "Identify consciousness", "Call for help", "Back blows", "Chest thrusts/abdominal thrusts according to age", "Identify loss of consciousness and change to CPR", "Assessment of breathing" and "Ventilation". For assessment of laypersons some PBLS and FBAOM skills described in guidelines are more important than others. Four out of nine of PBLS skills focus on airway and breathing skills, supporting the major importance of these skills for laypersons' resuscitation attempts. International consensus on how to assess laypersons' paediatric basic life support and foreign body airway obstruction management skills was established. The assessment of these skills may help to determine when laypersons have acquired competencies. Not relevant.

[Construction of a physiological aging scale for healthy people based on a modified Delphi method].

PubMed

Long, Yao; Zhou, Xuan; Deng, Pengfei; Liao, Xiong; Wu, Lei; Zhou, Jianming; Huang, Helang

2016-04-01

To build a physiological aging scale for healthy people.
 We collected age-related physiologic items through literature screening and expert interview. Two rounds of Delphi were implemented. The importance, feasibility and the degree of authority for the physiological index system were graded. Using analytic hierarchy process, we determined the weight of dimensions and items.
 Using Delphy mothod, 17 physiological and other professional experts offered the results as follow: coefficient of expert authorities Cr was 0.86±0.03, coordination coefficients for the first and second round were 0.264(χ2=229.691, P<0.001) and 0.293(χ2=228.474，P<0.001), respectively. The consistency was good. The aging scale for healthy people included 3 dimensions, namely physical form, feeling movement and functional status. Each dimension had 8 items. The weight coefficients for the 3 dimensions were 0.54, 0.16, and 0.30, respectively. The Cronbach's α coefficient of the scale was 0.893, the reliability was 0.796, and the variance of the common factor was 58.17%.
 The improved Delphi method or physiological aging scale is satisfied, which can provide reference for the evaluation of aging.

POPI (Pediatrics: Omission of Prescriptions and Inappropriate Prescriptions): Development of a Tool to Identify Inappropriate Prescribing

PubMed Central

Prot-Labarthe, Sonia; Weil, Thomas; Angoulvant, François; Boulkedid, Rym; Alberti, Corinne; Bourdon, Olivier

2014-01-01

Introduction Rational prescribing for children is an issue for all countries and has been inadequately studied. Inappropriate prescriptions, including drug omissions, are one of the main causes of medication errors in this population. Our aim is to develop a screening tool to identify omissions and inappropriate prescriptions in pediatrics based on French and international guidelines. Methods A selection of diseases was included in the tool using data from social security and hospital statistics. A literature review was done to obtain criteria which could be included in the tool called POPI. A 2-round-Delphi consensus technique was used to establish the content validity of POPI; panelists were asked to rate their level of agreement with each proposition on a 9-point Likert scale and add suggestions if necessary. Results 108 explicit criteria (80 inappropriate prescriptions and 28 omissions) were obtained and submitted to a 16-member expert panel (8 pharmacists, 8 pediatricians hospital-based −50%- or working in community −50%-). Criteria were categorized according to the main physiological systems (gastroenterology, respiratory infections, pain, neurology, dermatology and miscellaneous). Each criterion was accompanied by a concise explanation as to why the practice is potentially inappropriate in pediatrics (including references). Two round of Delphi process were completed via an online questionnaire. 104 out of the 108 criteria submitted to experts were selected after 2 Delphi rounds (79 inappropriate prescriptions and 25 omissions). Discussion Conclusion POPI is the first screening-tool develop to detect inappropriate prescriptions and omissions in pediatrics based on explicit criteria. Inter-user reliability study is necessary before using the tool, and prospective study to assess the effectiveness of POPI is also necessary. PMID:24978045

The Future of Organized Camping.

ERIC Educational Resources Information Center

Henderson, Karla A.; And Others

A research study on the future of organized camping investigated future factors which may affect leadership of camping programs in Wisconsin and throughout the country. Objectives were to: identify 50 experts on organized camping who would participate in a 3-round Delphi study on the future of camping; generate consensus among the experts…

Global research priorities for interpersonal violence prevention: a modified Delphi study.

PubMed

Mikton, Christopher R; Tanaka, Masako; Tomlinson, Mark; Streiner, David L; Tonmyr, Lil; Lee, Bandy X; Fisher, Jane; Hegadoren, Kathy; Pim, Joam Evans; Wang, Shr-Jie Sharlenna; MacMillan, Harriet L

2017-01-01

To establish global research priorities for interpersonal violence prevention using a systematic approach. Research priorities were identified in a three-round process involving two surveys. In round 1, 95 global experts in violence prevention proposed research questions to be ranked in round 2. Questions were collated and organized according to the four-step public health approach to violence prevention. In round 2, 280 international experts ranked the importance of research in the four steps, and the various substeps, of the public health approach. In round 3, 131 international experts ranked the importance of detailed research questions on the public health step awarded the highest priority in round 2. In round 2, "developing, implementing and evaluating interventions" was the step of the public health approach awarded the highest priority for four of the six types of violence considered (i.e. child maltreatment, intimate partner violence, armed violence and sexual violence) but not for youth violence or elder abuse. In contrast, "scaling up interventions and evaluating their cost-effectiveness" was ranked lowest for all types of violence. In round 3, research into "developing, implementing and evaluating interventions" that addressed parenting or laws to regulate the use of firearms was awarded the highest priority. The key limitations of the study were response and attrition rates among survey respondents. However, these rates were in line with similar priority-setting exercises. These findings suggest it is premature to scale up violence prevention interventions. Developing and evaluating smaller-scale interventions should be the funding priority.

Global research priorities for interpersonal violence prevention: a modified Delphi study

PubMed Central

Tanaka, Masako; Tomlinson, Mark; Streiner, David L; Tonmyr, Lil; Lee, Bandy X; Fisher, Jane; Hegadoren, Kathy; Pim, Joam Evans; Wang, Shr-Jie Sharlenna; MacMillan, Harriet L

2017-01-01

Abstract Objective To establish global research priorities for interpersonal violence prevention using a systematic approach. Methods Research priorities were identified in a three-round process involving two surveys. In round 1, 95 global experts in violence prevention proposed research questions to be ranked in round 2. Questions were collated and organized according to the four-step public health approach to violence prevention. In round 2, 280 international experts ranked the importance of research in the four steps, and the various substeps, of the public health approach. In round 3, 131 international experts ranked the importance of detailed research questions on the public health step awarded the highest priority in round 2. Findings In round 2, “developing, implementing and evaluating interventions” was the step of the public health approach awarded the highest priority for four of the six types of violence considered (i.e. child maltreatment, intimate partner violence, armed violence and sexual violence) but not for youth violence or elder abuse. In contrast, “scaling up interventions and evaluating their cost–effectiveness” was ranked lowest for all types of violence. In round 3, research into “developing, implementing and evaluating interventions” that addressed parenting or laws to regulate the use of firearms was awarded the highest priority. The key limitations of the study were response and attrition rates among survey respondents. However, these rates were in line with similar priority-setting exercises. Conclusion These findings suggest it is premature to scale up violence prevention interventions. Developing and evaluating smaller-scale interventions should be the funding priority. PMID:28053363

Nurses' Empowerment Scale for ICU patients' families: an instrument development study.

PubMed

Li, Hong; Liu, Ya-Lan; Qiu, Li; Chen, Qiao-Ling; Wu, Jing-Bing; Chen, Li-Li; Li, Na

2016-09-01

Family members provide essential support for ICU patients, contributing to their mental and physical recovery. Empowering ICU patients' families may help them overcome inadequacies and meet their own and patients' acknowledged needs. Nursing should understand and address patients' families' empowerment status. To develop a tool, the Nurses' Empowerment Scale for Intensive Care Unit (ICU) Patients' Families (NESIPF), to help ICU nursing staff assess the empowerment status of patients' families. Four-phase instrument development study. A 19-item instrument was initially generated based on literature review and interviews with family members of ICU patients. The Delphi research method was applied to gain expert opinion and consensus via rounds of questionnaires. A panel of 27 experts experienced in critical care medicine, nursing and psychology participated in two Delphi rounds and their input helped formulate an 18-item pretest instrument. Families of 20 patients were recruited to examine instrument readability. After a 2-week interval, another 20 patients' families were recruited to examine test-retest reliability. Two hundred questionnaires were then administered and analysed to examine the instrument's construct validity, criterion-related validity and internal consistency. Expert authority coefficients of two Delphi rounds reached 0·89 and 0·91. Kendall' W coefficients of 0·113 (P < 0·001) in round 1 and 0·220 (P < 0·001) in round 2 indicated slight to fair agreement among experts. Content validity index (CVI) reached 1·0 for 12 items; the CVI for item 13 was <0·7 so it was excluded. Cronbach's α coefficient was 0·92, indicating acceptable internal consistency reliability. The coefficient of internal consistency of each dimension was 0·717-0·921. The Pearson correlation coefficient >0·9 (P < 0·05) showed an acceptable test-retest reliability. The instrument has acceptable reliability and validity and can assess the empowerment status of families of critically ill patients. Knowledge of families' empowerment status may help to address their psychological needs and their ability to provide family support. © 2014 British Association of Critical Care Nurses.

Development of an active behavioural physiotherapy intervention (ABPI) for acute whiplash-associated disorder (WAD) II management: a modified Delphi study.

PubMed

Wiangkham, Taweewat; Duda, Joan; Haque, M Sayeed; Rushton, Alison

2016-09-14

To develop an active behavioural physiotherapy intervention (ABPI) for managing acute whiplash-associated disorder (WAD) II using a modified Delphi method to develop consensus for the basic features of the ABPI. Modified Delphi study. Our systematic review and meta-analysis evaluating conservative management for acute WADII found that a combined ABPI may be a useful intervention to prevent patients progressing to chronicity. No previous research has considered a combined behavioural approach and active physiotherapy in the management of acute WADII patients. The ABPI was therefore developed using a rigorous consensus method using international research and local clinical whiplash experts. Descriptive statistics were used to assess consensus in each round. Online international survey. A purposive sample of 97 potential participants (aiming to recruit n=30) consisting of international research whiplash experts, UK private physiotherapists and UK postgraduate musculoskeletal physiotherapy students were invited to participate via electronic mail with an attached participant information sheet and consent form. 36 individuals signed and returned the consent form. In round 1, 32/36 participants (response rate=89%, mean age±SD=36.03±13.22 years) across 8 countries (Australia, Finland, Greece, India, Netherlands, Norway, Sweden and UK) contributed to round 1 questionnaire. Response rates were 78% and 75% for rounds 2 and 3, respectively. Following round 3, 12 underlying principles (eg, return to normal function as soon as possible, pain management, encouragement of self-management, reduce fear avoidance and anxiety) achieved consensus. The treatment components reaching consensus included behavioural (eg, education, reassurance, self-management) and physiotherapy components (eg, exercises for stability and mobility). No passive intervention achieved consensus. Experts suggested and agreed the underlying principles and treatment components of the ABPI for the management of acute WADII. The ABPI was underpinned by social cognitive theory focusing on self-efficacy enhancement prior to conducting a phase II trial. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Towards an International Classification for Patient Safety: a Delphi survey.

PubMed

Thomson, Richard; Lewalle, Pierre; Sherman, Heather; Hibbert, Peter; Runciman, William; Castro, Gerard

2009-02-01

Interpretation and comparison of patient safety information have been compromised by the lack of a common understanding of the concepts involved. The World Alliance set out to develop an International Classification for Patient Safety (ICPS) to address this, and to test the relevance and acceptability of the draft ICPS and progressively refine it prior to field testing. Two-stage Delphi survey. Quantitative and qualitative analyses informed the review of the ICPS. International web-based survey of expert opinion. Experts in the fields of patient safety, health policy, reporting systems, safety and quality control, classification theory and development, health informatics, consumer advocacy, law and medicine; 253 responded to the first round survey, 30% of whom responded to the second round. In the first round, 14% felt that the conceptual framework was missing at least one class, although it was apparent that most respondents were actually referring to concepts they felt should be included within the classes rather than the classes themselves. There was a need for clarification of several components of the classification, particularly its purpose, structure and depth. After revision and feedback, round 2 results were more positive, but further significant changes were made to the conceptual framework and to the major classes in response to concerns about terminology and relationships between classes. The Delphi approach proved invaluable, as both a consensus-building exercise and consultation process, in engaging stakeholders to support completion of the final draft version of the ICPS. Further refinement will occur.

Towards an International Classification for Patient Safety: a Delphi survey

PubMed Central

Thomson, Richard; Lewalle, Pierre; Sherman, Heather; Hibbert, Peter; Runciman, William; Castro, Gerard

2009-01-01

Objective Interpretation and comparison of patient safety information have been compromised by the lack of a common understanding of the concepts involved. The World Alliance set out to develop an International Classification for Patient Safety (ICPS) to address this, and to test the relevance and acceptability of the draft ICPS and progressively refine it prior to field testing. Design Two-stage Delphi survey. Quantitative and qualitative analyses informed the review of the ICPS. Setting International web-based survey of expert opinion. Participants Experts in the fields of patient safety, health policy, reporting systems, safety and quality control, classification theory and development, health informatics, consumer advocacy, law and medicine; 253 responded to the first round survey, 30% of whom responded to the second round. Results In the first round, 14% felt that the conceptual framework was missing at least one class, although it was apparent that most respondents were actually referring to concepts they felt should be included within the classes rather than the classes themselves. There was a need for clarification of several components of the classification, particularly its purpose, structure and depth. After revision and feedback, round 2 results were more positive, but further significant changes were made to the conceptual framework and to the major classes in response to concerns about terminology and relationships between classes. Conclusions The Delphi approach proved invaluable, as both a consensus-building exercise and consultation process, in engaging stakeholders to support completion of the final draft version of the ICPS. Further refinement will occur. PMID:19147596

HIV and Alcohol Research Priorities of City, State, and Federal Policymakers: Results of a Delphi Study

PubMed Central

Li, Lingfeng; Braithwaite, Ronald Scott

2015-01-01

We identified the research areas related to HIV and alcohol consumption that were of highest priority to city, state, and federal policymakers. From June to July 2014, we conducted a 3-round Delphi study to elicit from experts a list of alcohol- and HIV-related clinical trial research questions that were important to fund and rank order the list to identify questions of highest priority. Translating evidence into practice must be improved because some questions that have been extensively studied with results published in peer-reviewed journals were identified by the panel as areas needing additional research. PMID:26180968

HIV and Alcohol Research Priorities of City, State, and Federal Policymakers: Results of a Delphi Study.

PubMed

Uyei, Jennifer; Li, Lingfeng; Braithwaite, Ronald Scott

2015-09-01

We identified the research areas related to HIV and alcohol consumption that were of highest priority to city, state, and federal policymakers. From June to July 2014, we conducted a 3-round Delphi study to elicit from experts a list of alcohol- and HIV-related clinical trial research questions that were important to fund and rank order the list to identify questions of highest priority. Translating evidence into practice must be improved because some questions that have been extensively studied with results published in peer-reviewed journals were identified by the panel as areas needing additional research.

Development of clinical practice guidelines for supportive care in childhood cancer--prioritization of topics using a Delphi approach.

PubMed

Loeffen, E A H; Mulder, R L; Kremer, L C M; Michiels, E M C; Abbink, F C H; Ball, L M; Segers, H; Mavinkurve-Groothuis, A M C; Smit, F J; Vonk, I J M; Vd Wetering, M D; Tissing, W J E

2015-07-01

Currently, very few guidelines for supportive care for children with cancer exist. In the Netherlands, nationwide guidelines are over 10 years old and mostly based on expert opinion. Consequently, there is growing support and need for clinical practice guidelines (CPGs), which ought to be developed with a well-defined methodology and include a systematic search of literature, evidence summaries, and a transparent description of the decision process for the final recommendations. Development of CPGs is time consuming; therefore, it is important to prioritize topics for which there is the greatest clinical demand. This study aims to prioritize childhood cancer supportive care topics for development of CPGs. A Delphi survey consisting of two rounds was conducted to prioritize relevant childhood cancer supportive care topics for the development of CPGs. A group of experts comprising 15 pediatric oncologists, 15 pediatric oncology nurses, and 15 general pediatricians involved in care for childhood cancer patients were invited to participate. All relevant supportive care topics in childhood cancer were rated. In both rounds, 36 panellists (82%) responded. Agreement between panellists was very good, with an intraclass correlation coefficient of 0.918 (95% confidence interval (CI) = 0.849-0.966, p < 0.001) in round 2. The ten topics with the highest score in the final round were infection, sepsis, febrile neutropenia, pain, nausea/vomiting, restrictions in daily life and activities, palliative care, procedural sedation, terminal care, and oral mucositis. We successfully used a Delphi survey to prioritize childhood cancer supportive care topics for the development of CPGs. This is a first step towards uniform and evidence-based Dutch guidelines in supportive care in childhood cancer. Even though performed nationally, we believe that this study can also be regarded as an example starting point for international development of CPGs in the field of supportive care in cancer or any other field for that matter.

International identification of research priorities for postgraduate theses in musculoskeletal physiotherapy using a modified Delphi technique.

PubMed

Rushton, Alison; Moore, Ann

2010-04-01

Research priorities are established to identify gaps and maximise opportunities in developing an evidence base. Numerous postgraduate research theses are undertaken each year within the specialist area of musculoskeletal physiotherapy, and although some are published, greater potential for influence exists. This paper identifies international research priorities for postgraduate theses developed using a consensual Delphi process. A purposive sample included course tutors and expert clinicians nominated by Member Organisations of the International Federation of Orthopaedic Manipulative Physical Therapists (N=91). Round 1 requested >10 priorities for theses, and content analysis identified research themes. Round 2 requested participants rank the importance of each theme on a 1-5 scale, and round 3 requested ranking the importance and feasibility of the research question areas within each agreed theme. Descriptive analysis and use of Kendall's coefficient of concordance enabled interpretation of consensus. The response rate of 68% was good, identifying 23 research themes in round 1. Round 2 identified 14 research themes as important. Participant rating of the importance and feasibility of research question areas in round 3 supported 43 agreed priorities demonstrating good measurement validity. Establishing priorities provides a vision of how postgraduate theses can contribute to the developing evidence base and offer a focus for international collaboration. Copyright 2009 Elsevier Ltd. All rights reserved.

The transculturality of 'gut feelings'. Results from a French Delphi consensus survey.

PubMed

Le Reste, Jean-Yves; Coppens, Magali; Barais, Marie; Nabbe, Patrice; Le Floch, Bernard; Chiron, Benoît; Dinant, Geert Jan; Berkhout, Christophe; Stolper, Erik; Barraine, Pierre

2013-12-01

General Practitioners (GPs) sometimes base their clinical decisions on 'gut feelings.' Research into the significance of this phenomenon with focus groups and a Delphi consensus procedure in the Netherlands provided a concept of 'gut feelings:' a sense of alarm, a sense of reassurance and several determinants. The transculturality of 'gut feelings' has been examined briefly until now as the issue is complex. To determine whether a consensus on 'gut feelings' in general practice in France could be obtained. Using a similar Delphi consensus procedure and the same six initial statements as in the Netherlands, and compare the French results with the seven final Dutch consensual statements. Qualitative research, including a Delphi consensus procedure after a forward-backward translation (FBT) of the initial Dutch statements of 'gut feelings.' A heterogeneous sample of 34 French expert GPs participated. FBT of the final French statements was undertaken for a content comparison with the Dutch. After three Delphi rounds, French GPs reached agreement on nine statements. Many similarities have been found between the Dutch and the French defining statements, with reservations concerning the 'sense of reassurance,' which French GPs seemed to feel more cautious about. 'Gut feelings' are a well-defined concept in France too. The Dutch and the French consensual statements seem very close. The transculturality of the concept is confirmed, which is a new indicator that 'gut feelings' are a self-contained concept.

Prevention and control of major non-communicable diseases in China from 1990 to 2009: results of a two-round Delphi survey.

PubMed

Lv, Jun; Liu, Miao; Jiang, Yu; Li, Li-Ming

2013-02-12

The aim of this study was to learn about the progress of the prevention and control of major non-communicable diseases (NCDs) in China from 1990 to 2009 and to determine what prevention and control gaps remain based on the opinions of a group of panellists. Sixty-four panellists, who are members of the Subcommittee of the Non-Communicable Diseases, the Expert Committee on Disease Control and Prevention established by China's Ministry of Health in 2010, were invited to participate in an email-based, two-round Delphi survey. In each round, a structured questionnaire was given to participants, who were asked to rate the importance and practical implementation of items relevant to the prevention and control of NCDs over two periods, 1990-1999 and 2000-2009, on a 10-point scale. Of the 64 panellists invited, 20 (31.3%) completed the first-round survey, and, of those, 14 (70.0%) completed the second-round survey. Of the 237 common variables in the two survey rounds, there were 161 (67.9%) and 209 (88.2%) with an interquartile range ≤2 in the first round and second round, respectively. These results indicated a better expert consensus in the second round. There were 92 items in total in the second round of the questionnaire, 88 (95.7%) of which had median importance rating scores of equal to or greater than 7.00. The median scores for the practical implementation items during 2000-2009 were greater than those for the 1990-1999 period. The results indicate improved implementation in the recent decade. China has made progress in the prevention and control of NCDs during the 21st century. However, these intuitive rating results indicate that there are still large action gaps in the fight against epidemic NCDs in China.

Evaluating the construct of triage acuity against a set of reference vignettes developed via modified Delphi method.

PubMed

Twomey, Michèle; Wallis, Lee A; Myers, Jonathan E

2014-07-01

To evaluate the construct of triage acuity as measured by the South African Triage Scale (SATS) against a set of reference vignettes. A modified Delphi method was used to develop a set of reference vignettes. Delphi participants completed a 2-round consensus-building process, and independently assigned triage acuity ratings to 100 written vignettes unaware of the ratings given by others. Triage acuity ratings were summarised for all vignettes, and only those that reached 80% consensus during round 2 were included in the reference set. Triage ratings for the reference vignettes given by two independent experts using the SATS were compared with the ratings given by the international Delphi panel. Measures of sensitivity, specificity, associated percentages for over-triage/under-triage were used to evaluate the construct of triage acuity (as measured by the SATS) by examining the association between the ratings by the two experts and the international panel. On completion of the Delphi process, 42 of the 100 vignettes reached 80% consensus on their acuity rating and made up the reference set. On average, over all acuity levels, sensitivity was 74% (CI 64% to 82%), specificity 92% (CI 87% to 94%), under-triage occurred 14% (CI 8% to 23%) and over-triage 12% (CI 8% to 23%) of the time. The results of this study provide an alternative to evaluating triage scales against the construct of acuity as measured with the SATS. This method of using 80% consensus vignettes may, however, systematically bias the validity estimate towards better performance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Determining an Imaging Literacy Curriculum for Radiation Oncologists: An International Delphi Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Giuliani, Meredith E., E-mail: Meredith.Giuliani@rmp.uhn.on.ca; Department of Radiation Oncology, University of Toronto, Toronto, Ontario; Gillan, Caitlin

2014-03-15

Purpose: Rapid evolution of imaging technologies and their integration into radiation therapy practice demands that radiation oncology (RO) training curricula be updated. The purpose of this study was to develop an entry-to-practice image literacy competency profile. Methods and Materials: A list of 263 potential imaging competency items were assembled from international objectives of training. Expert panel eliminated redundant or irrelevant items to create a list of 97 unique potential competency items. An international 2-round Delphi process was conducted with experts in RO. In round 1, all experts scored, on a 9-point Likert scale, the degree to which they agreed anmore » item should be included in the competency profile. Items with a mean score ≥7 were included, those 4 to 6 were reviewed in round 2, and items scored <4 were excluded. In round 2, items were discussed and subsequently ranked for inclusion or exclusion in the competency profile. Items with >75% voting for inclusion were included in the final competency profile. Results: Forty-nine radiation oncologists were invited to participate in round 1, and 32 (65%) did so. Participants represented 24 centers in 6 countries. Of the 97 items ranked in round 1, 80 had a mean score ≥7, 1 item had a score <4, and 16 items with a mean score of 4 to 6 were reviewed and rescored in round 2. In round 2, 4 items had >75% of participants voting for inclusion and were included; the remaining 12 were excluded. The final list of 84 items formed the final competency profile. The 84 enabling competency items were aggregated into the following 4 thematic groups of key competencies: (1) imaging fundamentals (42 items); (2) clinical application (27 items); (3) clinical management (5 items); and (4) professional practice (10 items). Conclusions: We present an imaging literacy competency profile which could constitute the minimum training standards in radiation oncology residency programs.« less

Research priorities in nursing--a Delphi study among Swedish nurses.

PubMed

Bäck-Pettersson, Siv; Hermansson, Evelyn; Sernert, Ninni; Björkelund, Cecilia

2008-08-01

The main aim was to illuminate essential areas for future patient-related nursing research. The secondary aim was to stimulate nurses to explore important research areas based on clinical practice. Priority-setting is regarded as one of the main strategies to ensure excellence in nursing science, to direct nursing research and develop healthcare practice accordingly as well as strengthening the nursing profession's research commitment. A three-round Delphi survey was conducted. A panel of 118 clinicians, in various nursing, teaching and administrative positions participated. Ninety-five panel members completed all three rounds (81%). The majority were female, aged 25-67 (mean 49) years, with an average of 23 (range 1-40) years in nursing, working in hospitals (42%), primary healthcare centres, community care (44%) and administration/education (14%). Sixty-six per cent had graduate diplomas and 34% had an academic education, ranging from bachelors' to doctoral degrees. Three hundred and eighty nursing research areas were identified, evaluated and ranked using content analysis and descriptive statistics. The participants' prioritized research aimed at preserving humanistic values and developing cross-organisational collaboration in the healthcare system. Nursing research aimed at preserving human dignity in geriatric care, respectful transfers, continuity of care and exploring the characteristics of a caring encounter were ranked high relative to the patient welfare, to the healthcare organisation and to the nursing profession. Nurses prioritize research that will improve clinical practice, assure patients' wellbeing and a caring environment. Nurses can reach consensus on the objectives of patient-related nursing research despite differences in age, workplace, educational period and level of academic degree. Relevance to clinical practice. When prioritizing important areas for patient-related nursing research, informed nursing practitioners' commitment initiates knowledge development within clinical practice from a nursing science perspective as well as expanding cross-professional and cross-organisational collaboration.

Developing standards for the development of glaucoma virtual clinics using a modified Delphi approach.

PubMed

Kotecha, Aachal; Longstaff, Simon; Azuara-Blanco, Augusto; Kirwan, James F; Morgan, James Edwards; Spencer, Anne Fiona; Foster, Paul J

2018-04-01

To obtain consensus opinion for the development of a standards framework for the development and implementation of virtual clinics for glaucoma monitoring in the UK using a modified Delphi methodology. A modified Delphi technique was used that involved sampling members of the UK Glaucoma and Eire Society (UKEGS). The first round scored the strength of agreement to a series of standards statements using a 9-point Likert scale. The revised standards were subjected to a second round of scoring and free-text comment. The final standards were discussed and agreed by an expert panel consisting of seven glaucoma subspecialists from across the UK. A version of the standards was submitted to external stakeholders for a 3-month consultation. There was a 44% response rate of UKEGS members to rounds 1 and 2, consisting largely of consultant ophthalmologists with a specialist interest in glaucoma. The final version of the standards document was validated by stakeholder consultation and contains four sections pertaining to the patient groups, testing methods, staffing requirements and governance structure of NHS secondary care glaucoma virtual clinic models. Use of a modified Delphi approach has provided consensus agreement for the standards required for the development of virtual clinics to monitor glaucoma in the UK. It is anticipated that this document will be useful as a guide for those implementing this model of service delivery. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Establishment of a dental license regulation authority is required in Korea: results of the Delphi technique.

PubMed

Choi, Jin-Woo; Kim, Kack-Kyun; Lee, Jihyun; Choi, Dong-Ju; Kim, Kyung-Nyun

2017-01-01

In addition to dental education, a system for the evaluation and management of dental licensing and certification is required to meet the growing societal demand for more competent dentists. In this study, the Delphi technique was used to gather opinions from a variety of professionals on the problems of and remedies for the dental license management system in Korea. Delphi surveys were conducted from April 2016 to October 2016 in South Korea. A variety of dental professionals were included and categorized into 3 groups according to their expertise as follows: the basic dentistry group, the clinical dentistry group, and the policy group. The Delphi technique was conducted in 3 rounds of e-mail surveys, each with different questions that probed with increasing depth on the dental license management system. In each successive round, the responses were categorized, scored on a Likert scale, and statistically analyzed. After categorizing the results of the first survey and ranking the results of the second survey using the Delphi technique, regulation by a licensing authority was found to be the most critical issue. This was followed by the license renewal system, continuing education, a tiered licensure system, improvement of foreign license approval, and utilization of retirees, in decreasing order of importance. The third Delphi survey showed a similar ranking, with regulation by a licensing authority being the major concern. Opinions regarding the dental license management system were provided as open-ended responses. The responses of the 3 groups showed statistically significant differences in the scores for the issue of regulation by a licensing authority. After re-grouping into the dentistry group and the policy group, the issue received a significantly higher score in the dentistry group. The quality of dental treatment should be managed to protect patients and dental professionals. For this purpose, the establishment of an independent license regulation authority along with legislative changes is required.

Current opinion and consensus statement regarding the diagnosis, prognosis, and treatment of patients with essential thrombocythemia: a survey of the Spanish Group of Ph-negative Myeloproliferative Neoplasms (GEMFIN) using the Delphi method.

PubMed

Besses, C; Hernández-Boluda, J C; Pérez Encinas, M; Raya, J M; Hernández-Rivas, J M; Jiménez Velasco, A; Martínez Lopez, J; Vicente, V; Burgaleta, C

2016-04-01

The current consensus on the diagnosis, prognosis, and treatment of essential thrombocythemia (ET) is based on experts' recommendations. However, several aspects of the diagnosis of, prognosis of, and therapy for ET are still controversial. The Delphi method was employed with an expert panel of members of the Spanish Group of Ph-negative Myeloproliferative Neoplasms in order to identify the degree of agreement on the diagnosis, prognosis, and treatment of ET. Nine leading experts selected a total of 41 clinical hematologists with well-known expertise in ET. An electronic questionnaire was used to collect the questions rated in a four-step scale. The questions were grouped into four blocks: diagnosis, risk stratification, goals of therapy, and treatment strategy. After the first round consisting of 80 questions, a second round including 14 additional questions focused on the recommendations advocated by experts of the European LeukemiaNet in 2011 was analyzed. The median and mean values for the first and second rounds were calculated. A summary of the conclusions considered as the most representative of each block of questions is presented. The Delphi method is a powerful instrument to address the current approaches and controversies surrounding ET.

The Canadian Assessment of Physical Literacy: Development of a Model of Children's Capacity for a Healthy, Active Lifestyle Through a Delphi Process.

PubMed

Francis, Claire E; Longmuir, Patricia E; Boyer, Charles; Andersen, Lars Bo; Barnes, Joel D; Boiarskaia, Elena; Cairney, John; Faigenbaum, Avery D; Faulkner, Guy; Hands, Beth P; Hay, John A; Janssen, Ian; Katzmarzyk, Peter T; Kemper, Han C; Knudson, Duane; Lloyd, Meghann; McKenzie, Thomas L; Olds, Tim S; Sacheck, Jennifer M; Shephard, Roy J; Zhu, Weimo; Tremblay, Mark S

2016-02-01

The Canadian Assessment of Physical Literacy (CAPL) was conceptualized as a tool to monitor children's physical literacy. The original model (fitness, activity behavior, knowledge, motor skill) required revision and relative weights for calculating/interpreting scores were required. Nineteen childhood physical activity/fitness experts completed a 3-round Delphi process. Round 1 was open-ended questions. Subsequent rounds rated statements using a 5-point Likert scale. Recommendations were sought regarding protocol inclusion, relative importance within composite scores and score interpretation. Delphi participant consensus was achieved for 64% (47/73) of statement topics, including a revised conceptual model, specific assessment protocols, the importance of longitudinal tracking, and the relative importance of individual protocols and composite scores. Divergent opinions remained regarding the inclusion of sleep time, assessment/ scoring of the obstacle course assessment of motor skill, and the need for an overall physical literacy classification. The revised CAPL model (overlapping domains of physical competence, motivation, and knowledge, encompassed by daily behavior) is appropriate for monitoring the physical literacy of children aged 8 to 12 years. Objectively measured domains (daily behavior, physical competence) have higher relative importance. The interpretation of CAPL results should be reevaluated as more data become available.

Key performance indicators to benchmark hospital information systems - a delphi study.

PubMed

Hübner-Bloder, G; Ammenwerth, E

2009-01-01

To identify the key performance indicators for hospital information systems (HIS) that can be used for HIS benchmarking. A Delphi survey with one qualitative and two quantitative rounds. Forty-four HIS experts from health care IT practice and academia participated in all three rounds. Seventy-seven performance indicators were identified and organized into eight categories: technical quality, software quality, architecture and interface quality, IT vendor quality, IT support and IT department quality, workflow support quality, IT outcome quality, and IT costs. The highest ranked indicators are related to clinical workflow support and user satisfaction. Isolated technical indicators or cost indicators were not seen as useful. The experts favored an interdisciplinary group of all the stakeholders, led by hospital management, to conduct the HIS benchmarking. They proposed benchmarking activities both in regular (annual) intervals as well as at defined events (for example after IT introduction). Most of the experts stated that in their institutions no HIS benchmarking activities are being performed at the moment. In the context of IT governance, IT benchmarking is gaining importance in the healthcare area. The found indicators reflect the view of health care IT professionals and researchers. Research is needed to further validate and operationalize key performance indicators, to provide an IT benchmarking framework, and to provide open repositories for a comparison of the HIS benchmarks of different hospitals.

Algorithms for monitoring warfarin use: Results from Delphi Method.

PubMed

Kano, Eunice Kazue; Borges, Jessica Bassani; Scomparini, Erika Burim; Curi, Ana Paula; Ribeiro, Eliane

2017-10-01

Warfarin stands as the most prescribed oral anticoagulant. New oral anticoagulants have been approved recently; however, their use is limited and the reversibility techniques of the anticoagulation effect are little known. Thus, our study's purpose was to develop algorithms for therapeutic monitoring of patients taking warfarin based on the opinion of physicians who prescribe this medicine in their clinical practice. The development of the algorithm was performed in two stages, namely: (i) literature review and (ii) algorithm evaluation by physicians using a Delphi Method. Based on the articles analyzed, two algorithms were developed: "Recommendations for the use of warfarin in anticoagulation therapy" and "Recommendations for the use of warfarin in anticoagulation therapy: dose adjustment and bleeding control." Later, these algorithms were analyzed by 19 medical doctors that responded to the invitation and agreed to participate in the study. Of these, 16 responded to the first round, 11 to the second and eight to the third round. A 70% consensus or higher was reached for most issues and at least 50% for six questions. We were able to develop algorithms to monitor the use of warfarin by physicians using a Delphi Method. The proposed method is inexpensive and involves the participation of specialists, and it has proved adequate for the intended purpose. Further studies are needed to validate these algorithms, enabling them to be used in clinical practice.

The setting of standards for agricultural nitrogen emissions: a case study of the Delphi technique.

PubMed

Angus, A J; Hodge, I D; McNally, S; Sutton, M A

2003-12-01

The Delphi technique is a means of aggregating the judgement of a panel of experts in order to improve the quality of decision-making. This paper provides a case study of the technique by undertaking a three-round Delphi study to determine a package of best available techniques to reduce nitrogen emissions from a poultry unit under the Integrated Pollution Prevention and Control Directive (IPPC). Forms of nitrogen addressed included ammonia (NH3), nitrous oxide (N2O) nitrogen oxides (NOx), dusts and nitrate (NO3-), with the study providing a means to prioritise the pollution concerns on different spatial scales. The priority pollutant issues were the contribution of NH3 to eutrophication, the global cooling effect of NH4+ aerosol, the role of NH4+ as a vector for atmospheric transport of NOx and SO2, the contribution of N2O to global warming, and NO3- leaching. Reduced nitrogen (NHx) was rated as a priority on all scales, while N2O and NO3- were rated as priorities only on global and local scales, respectively. The study indicated the need for abatement techniques at each stage of poultry rearing and waste management, with particular attention to reduce NH3 emissions, reflecting the priority pollutant concerns. Measures identified by the panel include maintenance of dry litter, low emission removal of litter from housing and storage of litter under cover. Once the litter has left the farm, this should either be used as a biofuel for electricity generation or rapidly incorporated into agricultural soils. The amounts and timing of manure application should be tuned to crop needs. Uncertainties in the Delphi technique limit its suitability as a stand-alone decision making tool. However, the Delphi technique proved useful in identifying priority pollutant issues, areas of agreement, disagreement and where information is lacking. This demonstrates its use when dealing with the complex issues of prioritising pollution issues and abatement approaches.

Identifying Medication Management Smartphone App Features Suitable for Young Adults With Developmental Disabilities: Delphi Consensus Study

PubMed Central

Salgado, Teresa M; Fedrigon, Alexa; Riccio Omichinski, Donna; Meade, Michelle A

2018-01-01

Background Smartphone apps can be a tool to facilitate independent medication management among persons with developmental disabilities. At present, multiple medication management apps exist in the market, but only 1 has been specifically designed for persons with developmental disabilities. Before initiating further app development targeting this population, input from stakeholders including persons with developmental disabilities, caregivers, and professionals regarding the most preferred features should be obtained. Objective The aim of this study was to identify medication management app features that are suitable to promote independence in the medication management process by young adults with developmental disabilities using a Delphi consensus method. Methods A compilation of medication management app features was performed by searching the iTunes App Store, United States, in February 2016, using the following terms: adherence, medication, medication management, medication list, and medication reminder. After identifying features within the retrieved apps, a final list of 42 features grouped into 4 modules (medication list, medication reminder, medication administration record, and additional features) was included in a questionnaire for expert consensus rating. A total of 52 experts in developmental disabilities, including persons with developmental disabilities, caregivers, and professionals, were invited to participate in a 3-round Delphi technique. The purpose was to obtain consensus on features that are preferred and suitable to promote independence in the medication management process among persons with developmental disabilities. Consensus for the first, second, and third rounds was defined as ≥90%, ≥80%, and ≥75% agreement, respectively. Results A total of 75 responses were received over the 3 Delphi rounds—30 in the first round, 24 in the second round, and 21 in the third round. At the end of the third round, cumulative consensus was achieved for 60% (12/20) items in the medication list module, 100% (3/3) in the medication reminder module, 67% (2/3) in the medication administration record module, and 63% (10/16) in the additional features module. In addition to the medication list, medication reminder, and medication administration record features, experts selected the following top 3 most important additional features: automatic refills through pharmacies; ability to share medication information from the app with providers; and ability to share medication information from the app with family, friends, and caregivers. The top 3 least important features included a link to an official drug information source, privacy settings and password protection, and prescription refill reminders. Conclusions Although several mobile apps for medication management exist, few are specifically designed to support persons with developmental disabilities in the complex medication management process. Of the 42 different features assessed, 64% (27/42) achieved consensus for inclusion in a future medication management app. This study provides information on the features of a medication management app that are most important to persons with developmental disabilities, caregivers, and professionals. PMID:29792292

Core outcome sets for prevention and treatment of postpartum haemorrhage: an international Delphi consensus study.

PubMed

Meher, Shireen; Cuthbert, Anna; Kirkham, Jamie J; Williamson, Paula; Abalos, Edgardo; Aflaifel, Nasreen; Bhutta, Zulfiqar A; Bishop, Alina; Blum, Jennifer; Collins, Peter; Devane, Declan; Ducloy-Bouthors, Anne-Sophie; Fawole, Bukola; Gülmezoglu, A Metin; Gutteridge, Kathryn; Gyte, Gill; Homer, Caroline S E; Mallaiah, Shuba; Smith, Jeffrey M; Weeks, Andrew D; Alfirevic, Zarko

2018-06-19

To develop core outcome sets (COS) for studies evaluating interventions for (1) prevention and (2) treatment of PPH, and recommendations on how to report the COS. A two-round Delphi survey and face-to-face meeting. Health care professionals and women's representatives. Outcomes were identified from systematic reviews of PPH studies and stakeholder consultation. Participants scored each outcome in the Delphi on a Likert scale between 1 (not important) and 9 (critically important). Results were discussed at the face-to-face meeting to agree the final COS. Consensus at the meeting was defined as ≥ 70% of participants scoring the outcome as critically important (7-9). Lectures, discussion and voting were used to agree how to report COS outcomes. outcomes from systematic reviews and consultations. Both Delphi rounds were completed by 152/205 (74%) participants for prevention and 143/197 (73%) for treatment. For prevention of PPH, nine core outcomes were selected: blood loss, shock, maternal death, use of additional uterotonics, blood transfusion, transfer for higher level of care, women's sense of wellbeing, acceptability and satisfaction with the intervention, breastfeeding and adverse effects. For treatment of PPH, 12 core outcomes were selected: blood loss, shock, coagulopathy, hysterectomy, organ dysfunction, maternal death, blood transfusion, use of additional haemostatic intervention, transfer for higher level of care, women's sense of wellbeing, acceptability and satisfaction with the intervention, breastfeeding and adverse effects. Recommendations were developed on how to report these outcomes where possible. These COS will help standardise outcome reporting in PPH trials. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Clinical Parameters and Tools for Home-Based Assessment of Parkinson's Disease: Results from a Delphi study.

PubMed

Ferreira, Joaquim J; Santos, Ana T; Domingos, Josefa; Matthews, Helen; Isaacs, Tom; Duffen, Joy; Al-Jawad, Ahmed; Larsen, Frank; Artur Serrano, J; Weber, Peter; Thoms, Andrea; Sollinger, Stefan; Graessner, Holm; Maetzler, Walter

2015-01-01

Parkinson's disease (PD) is a neurodegenerative disorder with fluctuating symptoms. To aid the development of a system to evaluate people with PD (PwP) at home (SENSE-PARK system) there was a need to define parameters and tools to be applied in the assessment of 6 domains: gait, bradykinesia/hypokinesia, tremor, sleep, balance and cognition. To identify relevant parameters and assessment tools of the 6 domains, from the perspective of PwP, caregivers and movement disorders specialists. A 2-round Delphi study was conducted to select a core of parameters and assessment tools to be applied. This process included PwP, caregivers and movement disorders specialists. Two hundred and thirty-three PwP, caregivers and physicians completed the first round questionnaire, and 50 the second. Results allowed the identification of parameters and assessment tools to be added to the SENSE-PARK system. The most consensual parameters were: Falls and Near Falls; Capability to Perform Activities of Daily Living; Interference with Activities of Daily Living; Capability to Process Tasks; and Capability to Recall and Retrieve Information. The most cited assessment strategies included Walkers; the Evaluation of Performance Doing Fine Motor Movements; Capability to Eat; Assessment of Sleep Quality; Identification of Circumstances and Triggers for Loose of Balance and Memory Assessment. An agreed set of measuring parameters, tests, tools and devices was achieved to be part of a system to evaluate PwP at home. A pattern of different perspectives was identified for each stakeholder.

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors

PubMed Central

Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

Background The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Methods Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. Findings All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. Conclusions This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention. PMID:26726801

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors.

PubMed

Balaguer, Albert; Monforte-Royo, Cristina; Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention.

Using a Delphi process to define priorities for prison health research in Canada.

PubMed

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-14

A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators' professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Developing Canadian oncology education goals and objectives for medical students: a national modified Delphi study.

PubMed

Tam, Vincent C; Ingledew, Paris-Ann; Berry, Scott; Verma, Sunil; Giuliani, Meredith E

2016-01-01

Studies have shown that there is a deficiency in focused oncology teaching during medical school in Canada. This study aimed to develop oncology education goals and objectives for medical students through consensus of oncology educators from across Canada. In 2014 we created a comprehensive list of oncology education objectives using existing resources. Experts in oncology education and undergraduate medical education from all 17 Canadian medical schools were invited to participate in a 3-round modified Delphi process. In round 1, the participants scored the objectives on a 9-point Likert scale according to the degree to which they agreed an objective should be taught to medical students. Objectives with a mean score of 7.0 or greater were retained, those with a mean score of 1.0-3.9 were excluded, and those with a mean score of 4.0-6.9 were discussed at a round 2 Web meeting. In round 3, the participants voted on inclusion and exclusion of the round 2 objectives. Thirty-four (92%) of the 37 invited oncology educators, representing 14 medical schools, participated in the study. They included oncologists, family physicians, members of undergraduate medical education curriculum committees and a psychologist. Of the 214 objectives reviewed in round 1, 146 received a mean score of 7.0 or greater, and 68 were scored 4.0-6.9; no objective received a mean score below 4.0. Nine new objectives were suggested. The main themes of participants' comments were to minimize the number of objectives and to aim objectives at the knowledge level required for family physicians. In round 2, the participants were able to combine 28 of the objectives with other existing objectives. In round 3, 7 of the 49 objectives received consensus of at least 75% for inclusion. The final Canadian Oncology Goals and Objectives for Medical Students contained 10 goals and 153 objectives. Through a systematic process, we created a comprehensive, consensus-based set of oncology goals and objectives to facilitate the design of undergraduate medical education curricula and improve oncology education for medical students.

Mapping the Demand for Serious Games in Postgraduate Medical Education Using the Entrustable Professional Activities Framework.

PubMed

Graafland, Maurits; Ten Cate, Olle; van Seventer, Jan-Pieter; Schraagen, Jan Maarten C; Schijven, Marlies P

2015-10-01

Serious games are potentially powerful tools for residency training and increasingly attract attention from medical educators. At present, serious games have little evidence-based relations with competency-based medical education, which may impede their incorporation into residency training programs. The aim of this study was to identify highly valued entrustable professional activities (EPAs) to support designers in the development of new, serious games built on a valid needs-assessment. All 149 licensed medical specialists from seven specialties in one academic hospital participated in seven different Delphi expert panels. They filled out a two-round Delphi survey, aimed at identifying the most valuable EPAs in their respective curricula. Specialists were asked to name the most highly valued EPA in their area in the first Delphi round. In the second round, the generated responses were presented and ranked according to priority by the medical specialists. Sixty-two EPAs were identified as valuable training subjects throughout five specialties. Eleven EPAs--"management of trauma patient," "chest tube placement," "laparoscopic cholecystectomy," "assessment of vital signs," "airway management," "induction of general anesthesia," "assessment of suicidal patient," "psychiatric assessment," "gastroscopy," "colonoscopy," and "resuscitation of emergency patients"--were consistently given a high score. The future medical specialist is an active learner, comfortable with digital techniques and learning strategies such as serious gaming. In order to maximize the impact and acceptance of new serious games, it is vital to select the most relevant training subjects. Although some serious games have already targeted top-priority EPAs, plenty of opportunities remain.

Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi.

PubMed

Pinnock, Hilary; Epiphaniou, Eleni; Sheikh, Aziz; Griffiths, Chris; Eldridge, Sandra; Craig, Peter; Taylor, Stephanie J C

2015-03-30

Dissemination and implementation of health care interventions are currently hampered by the variable quality of reporting of implementation research. Reporting of other study types has been improved by the introduction of reporting standards (e.g. CONSORT). We are therefore developing guidelines for reporting implementation studies (StaRI). Using established methodology for developing health research reporting guidelines, we systematically reviewed the literature to generate items for a checklist of reporting standards. We then recruited an international, multidisciplinary panel for an e-Delphi consensus-building exercise which comprised an initial open round to revise/suggest a list of potential items for scoring in the subsequent two scoring rounds (scale 1 to 9). Consensus was defined a priori as 80% agreement with the priority scores of 7, 8, or 9. We identified eight papers from the literature review from which we derived 36 potential items. We recruited 23 experts to the e-Delphi panel. Open round comments resulted in revisions, and 47 items went forward to the scoring rounds. Thirty-five items achieved consensus: 19 achieved 100% agreement. Prioritised items addressed the need to: provide an evidence-based justification for implementation; describe the setting, professional/service requirements, eligible population and intervention in detail; measure process and clinical outcomes at population level (using routine data); report impact on health care resources; describe local adaptations to the implementation strategy and describe barriers/facilitators. Over-arching themes from the free-text comments included balancing the need for detailed descriptions of interventions with publishing constraints, addressing the dual aims of reporting on the process of implementation and effectiveness of the intervention and monitoring fidelity to an intervention whilst encouraging adaptation to suit diverse local contexts. We have identified priority items for reporting implementation studies and key issues for further discussion. An international, multidisciplinary workshop, where participants will debate the issues raised, clarify specific items and develop StaRI standards that fit within the suite of EQUATOR reporting guidelines, is planned. The protocol is registered with Equator: http://www.equator-network.org/library/reporting-guidelines-under-development/#17 .

Controversies on the management of clinical situations with low therapeutic effectiveness in oncology.

PubMed

Expósito, José; Bretón, Juan José; Domínguez, Carmen; Pons, Joana

2010-07-01

Clinical scenarios associated with low therapeutic effectiveness (LTE) are especially complex and highly relevant in oncology. The objective was to test a methodological framework for creating consensual clinical recommendations for routine practice. The study was in three phases from Mars 2006 to January 2008: 1) Definition of LTE situations; 2) Preparation by 10 experts of a panel of LTE situations in cancers of breast, lung, head and neck, colon and rectum and brain; and 3) Development of a consensus on each situation and its optimal treatment by gathering agreement and disagreements (two-round Delphi method) from 68 practicing oncologists in Andalusian Community. Three major and three minor criteria were established for an LTE situation, defined when at least one major or two minor criteria were met. The expert group proposed 48 possible LTE clinical scenarios for breast (n = 7), lung (10), brain (11), head and neck (11) and colorectal cancers (9). Sixty-eight oncologists agreed to participate in the study; the response rate was 79% (from 34 medical and 17 radiation oncologists) In the first round (definition), maximum agreement was obtained with the LTE definition of 10 of the 48 scenarios; in the second round (treatment options), maximum agreement was obtained on the treatment of 3 of these 10 scenarios. Oncologists reached low levels of agreement on the definition of an LTE situation and on its treatment recommendations. This study proposes an approach to the improvement of cancer management in situations of high uncertainty.

Defining and identifying concepts of medication literacy: An international perspective.

PubMed

Pouliot, Annie; Vaillancourt, Régis; Stacey, Danielle; Suter, Philippe

2017-11-08

Multiple concepts to define health literacy in the context of medication use exist, such as medication literacy, pharmacotherapy literacy, pharmacy health literacy; however, no studies have looked at consensus among experts internationally. A Delphi process was used to achieve consensus on the statements about medication literacy. Experts for the Delphi were selected from a review of the literature and suggestions from an international survey conducted with members of the International Pharmaceutical Federation on medication literacy. The preliminary Delphi questionnaire was built using the statements about medication literacy found in the scientific literature. Responses and comments were analyzed using a pre-established method and communicated to the experts after each round of Delphi. Statements with an agreement of at least 80% were accepted and used to develop a definition of medication literacy. The Delphi process started with 21 experts and included 4 rounds. Overall, 30 statements regarding medication literacy were accepted and divided into 4 clusters representing: (1) type of information necessary for optimal and safe use of medication, (2) skills and abilities, (3) format of information, and (4) outcomes. These statements were used to propose 2 different definitions of medication literacy. One of the definitions was preferred by 75% of the expert panel, which provided further comments for improvements. Of the 11 experts who answered the final questionnaire, nine strongly agreed with the refined definition. Medication literacy is the degree to which individuals can obtain, comprehend, communicate, calculate and process patient-specific information about their medications to make informed medication and health decisions in order to safely and effectively use their medications, regardless of the mode by which the content is delivered (e.g. written, oral and visual). Future studies should focus on how this definition can be operationalized to support the role that pharmacists and other healthcare providers. Copyright © 2017 Elsevier Inc. All rights reserved.

Specialty Training's Organizational Readiness for curriculum Change (STORC): development of a questionnaire in a Delphi study.

PubMed

Bank, Lindsay; Jippes, Mariëlle; van Luijk, Scheltus; den Rooyen, Corry; Scherpbier, Albert; Scheele, Fedde

2015-08-05

In postgraduate medical education (PGME), programs have been restructured according to competency-based frameworks. The scale and implications of these adjustments justify a comprehensive implementation plan. Organizational Readiness for Change (ORC) is seen as a critical precursor for a successful implementation of change initiatives. Though, ORC in health care settings is mostly assessed in small scale settings and in relation to new policies and practices rather than educational change. Therefore our aim with this work was to develop an instrument to asses Specialty Training's Organizational Readiness for curriculum Change (STORC). A Delphi procedure was conducted to examine the applicability of a preliminary questionnaire in PGME, which was based on existing instruments designed for business and health care organizations. The 41 panellists (19 trainees and 22 supervisors from 6 specialties) from four different countries who were confronted with an apparent curriculum change, or would be in the near future, were asked to rate the relevance of a 89-item web-based questionnaire with regard to changes in specialty training on a 5-point Likert scale. Furthermore, they were invited to make qualitative comments on the items. In two rounds the 89-item preliminary questionnaire was reduced to 44 items. Items were either removed, kept, adapted or added based on individual item scores and qualitative comments. In the absence of a gold standard, this Delphi procedure was considered complete when the overall questionnaire rating exceeded 4.0 (scale 0-5). The overall item score reached 4.1 in the second round, meeting our criteria for completion of this Delphi procedure. This Delphi study describes the initial validating step in the development of an instrument to asses Specialty Training's Organisational Readiness for curriculum Change (STORC). Since ORC is measured on various subscales and presented as such, its strength lies in analysing these subscales. The latter makes it possible for educational leaders to identify and anticipate on hurdles in the implementation process and subsequently optimize efforts for successful curriculum change.

Management of Helicobacter pylori infection in Latin America: A Delphi technique-based consensus

PubMed Central

Rollan, Antonio; Arab, Juan Pablo; Camargo, M Constanza; Candia, Roberto; Harris, Paul; Ferreccio, Catterina; Rabkin, Charles S; Gana, Juan Cristóbal; Cortés, Pablo; Herrero, Rolando; Durán, Luisa; García, Apolinaria; Toledo, Claudio; Espino, Alberto; Lustig, Nicole; Sarfatis, Alberto; Figueroa, Catalina; Torres, Javier; Riquelme, Arnoldo

2014-01-01

AIM: To optimize diagnosis and treatment guidelines for this geographic region, a panel of gastroenterologists, epidemiologists, and basic scientists carried out a structured evaluation of available literature. METHODS: Relevant questions were distributed among the experts, who generated draft statements for consideration by the entire panel. A modified three-round Delphi technique method was used to reach consensus. Critical input was also obtained from representatives of the concerned medical community. The quality of the evidence and level of recommendation supporting each statement was graded according to United States Preventive Services Task Force criteria. RESULTS: A group of ten experts was established. The survey included 15 open-ended questions that were distributed among the experts, who assessed the articles associated with each question. The levels of agreement achieved by the panel were 50% in the first round, 73.3% in the second round and 100% in the third round. Main consensus recommendations included: (1) when available, urea breath and stool antigen test (HpSA) should be used for non-invasive diagnosis; (2) detect and eradicate Helicobacter pylori (H. pylori) in all gastroscopy patients to decrease risk of peptic ulcer disease, prevent o retard progression in patients with preneoplastic lesions, and to prevent recurrence in patients treated for gastric cancer; (3) further investigate implementation issues and health outcomes of H. pylori eradication for primary prevention of gastric cancer in high-risk populations; (4) prescribe standard 14-d triple therapy or sequential therapy for first-line treatment; (5) routinely assess eradication success post-treatment in clinical settings; and (6) select second- and third-line therapies according to antibiotic susceptibility testing. CONCLUSION: These achievable steps toward better region-specific management can be expected to improve clinical health outcomes. PMID:25152601

Gait and Lower Limb Observation of Paediatrics (GALLOP): development of a consensus based paediatric podiatry and physiotherapy standardised recording proforma.

PubMed

Cranage, Simone; Banwell, Helen; Williams, Cylie M

2016-01-01

Paediatric gait and lower limb assessments are frequently undertaken in podiatry and physiotherapy clinical practice and this is a growing area of expertise within Australia. No concise paediatric standardised recording proforma exists to assist clinicians in clinical practice. The aim of this study was to develop a gait and lower limb standardised recording proforma guided by the literature and consensus, for assessment of the paediatric foot and lower limb in children aged 0-18 years. Expert Australian podiatrists and physiotherapists were invited to participate in a three round Delphi survey panel using the online Qualtrics(©) survey platform. The first round of the survey consisted of open-ended questions on paediatric gait and lower limb assessment developed from existing templates and a literature search of standardised lower limb assessment methods. Rounds two and three consisted of statements developed from the first round responses. Questions and statements were included in the final proforma if 70 % or more of the participants indicated consensus or agreement with the assessment method and if there was support within the literature for paediatric age-specific normative data with acceptable reliability of outcome measures. There were 17 of the 21 (81 %) participants who completed three rounds of the survey. Consensus was achieved for 41 statements in Round one, 54 statements achieved agreement in two subsequent rounds. Participants agreed on 95 statements relating to birth history, developmental history, hip measurement, rotation of the lower limb, ankle range of motion, foot posture, balance and gait. Assessments with acceptable validity and reliability were included within the final Gait and Lower Limb Observation of Paediatrics (GALLOP) proforma. The GALLOP proforma is a consensus based, systematic and standardised way to collect information and outcome measures in paediatric lower limb assessment. This standardised recording proforma will assist professions to collect information in a standardised format based on best evidence assessment methods whilst aiding consistency in communication between health professionals.

Standardised method for reporting exercise programmes: protocol for a modified Delphi study.

PubMed

Slade, Susan C; Dionne, Clermont E; Underwood, Martin; Buchbinder, Rachelle

2014-12-30

Exercise is integral to health across the lifespan and important for people with chronic health conditions. A systematic review of exercise trials for chronic conditions reported suboptimal descriptions of the evaluated interventions and concluded that this hinders interpretation and replication. The aim of this project is to develop a standardised method for reporting essential exercise programme details being evaluated in clinical trials. A modified Delphi technique will be used to gain consensus among international exercise experts. We will use three sequential rounds of anonymous online questionnaires to refine a standardised checklist. A draft checklist of potentially relevant items was developed based on the results of a systematic review of exercise systematic reviews. An international panel of experts was identified by exercise systematic review authorship, established international profile in exercise research and practice and by peer referral. In round 1, the international panel of experts will be asked to rate the importance of each draft item and provide additional suggestions for revisions or new items. Consensus will be considered reached if at least 70% of the panel strongly agree/disagree that an item should be included or excluded. Where agreement is not reached or there are suggestions for altered or new items, these will be taken to round 2 together with an aggregated summary of round 1 responses. Following the second round, a ranking of item importance will be made to rationalise the number of items. The final template will be distributed to panel members for approval. Ethics approval was received from The Cabrini Institute Ethics Committee, Melbourne, Australia (HREC 02-07-04-14). We plan to use a stepwise process to develop and refine a standardised and internationally agreed template for explicit reporting of exercise programmes. The template will be generalisable across all types of exercise interventions. The findings will be disseminated through peer-reviewed publications and conference presentations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Metadata-driven Delphi rating on the Internet.

PubMed

Deshpande, Aniruddha M; Shiffman, Richard N; Nadkarni, Prakash M

2005-01-01

Paper-based data collection and analysis for consensus development is inefficient and error-prone. Computerized techniques that could improve efficiency, however, have been criticized as costly, inconvenient and difficult to use. We designed and implemented a metadata-driven Web-based Delphi rating and analysis tool, employing the flexible entity-attribute-value schema to create generic, reusable software. The software can be applied to various domains by altering the metadata; the programming code remains intact. This approach greatly reduces the marginal cost of re-using the software. We implemented our software to prepare for the Conference on Guidelines Standardization. Twenty-three invited experts completed the first round of the Delphi rating on the Web. For each participant, the software generated individualized reports that described the median rating and the disagreement index (calculated from the Interpercentile Range Adjusted for Symmetry) as defined by the RAND/UCLA Appropriateness Method. We evaluated the software with a satisfaction survey using a five-level Likert scale. The panelists felt that Web data entry was convenient (median 4, interquartile range [IQR] 4.0-5.0), acceptable (median 4.5, IQR 4.0-5.0) and easily accessible (median 5, IQR 4.0-5.0). We conclude that Web-based Delphi rating for consensus development is a convenient and acceptable alternative to the traditional paper-based method.

Modified international e-Delphi survey to define healthcare professional competencies for working with teenagers and young adults with cancer

PubMed Central

Taylor, Rachel M; Feltbower, Richard G; Aslam, Natasha; Raine, Rosalind; Whelan, Jeremy S; Gibson, Faith

2016-01-01

Objectives To provide international consensus on the competencies required by healthcare professionals in order to provide specialist care for teenagers and young adults (TYA) with cancer. Design Modified e-Delphi survey. Setting International, multicentre study. Participants Experts were defined as professionals having worked in TYA cancer care for more than 12 months. They were identified through publications and professional organisations. Methods Round 1, developed from a previous qualitative study, included 87 closed-ended questions with responses on a nine-point Likert scale and further open-ended responses to identify other skills, knowledge and attitudes. Round 2 contained only items with no consensus in round 1 and suggestions of additional items of competency. Consensus was defined as a median score ranging from 7 to 9 and strength of agreement using mean absolute deviation of the median. Results A total of 179 registered to be members of the expert panel; valid responses were available from 158 (88%) in round 1 and 136/158 (86%) in round 2. The majority of participants were nurses (35%) or doctors (39%) from Europe (55%) or North America (35%). All 87 items in round 1 reached consensus with an additional 15 items identified for round 2, which also reached consensus. The strength of agreement was mostly high for statements. The areas of competence rated most important were agreed to be: ‘Identify the impact of disease on young people's life’ (skill), ‘Know about side effects of treatment and how this might be different to those experienced by children or older adults’ (knowledge), ‘Honesty’ (attitude) and ‘Listen to young people's concerns’ (aspect of communication). Conclusions Given the high degree of consensus, this list of competencies should influence education curriculum, professional development and inform workforce planning. Variation in strength of agreement for some competencies between professional groups should be explored further in pursuit of effective multidisciplinary team working. PMID:27142859

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study

PubMed Central

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-01

Objectives To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Setting Hospitals and community health centres in Taiwan. Method A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. Participants 15 Chinese healthcare practitioners with more than 6 months’ experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Results Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. Conclusions The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. PMID:28093428

Expert consensus on facilitators and barriers to return-to-work following surgery for non-traumatic upper extremity conditions: a Delphi study.

PubMed

Peters, S E; Johnston, V; Ross, M; Coppieters, M W

2017-02-01

This Delphi study aimed to reach consensus on important facilitators and barriers for return-to-work following surgery for non-traumatic upper extremity conditions. In Round 1, experts ( n = 42) listed 134 factors, which were appraised in Rounds 2 and 3. Consensus (⩾85% agreement) was achieved for 13 facilitators (high motivation to return-to-work; high self-efficacy for return-to-work and recovery; availability of modified/alternative duties; flexible return-to-work arrangements; positive coping skills; limited heavy work exertion; supportive return-to-work policies; supportive supervisor/management; no catastrophic thinking; no fear avoidance to return-to-work; no fear avoidance to pain/activity; return to meaningful work duties; high job satisfaction) and six barriers (mood disorder diagnosis; pain/symptoms at more than one musculoskeletal site; heavy upper extremity exertions at work; lack of flexible return-to-work arrangements; lack of support from supervisor/management; high level of pain catastrophizing). Future prognostic studies are required to validate these biopsychosocial factors to further improve return-to-work outcomes. V.

Expert Consensus for Discharge Referral Decisions Using Online Delphi

PubMed Central

Bowles, Kathy H.; Holmes, John H.; Naylor, Mary D.; Liberatore, Matthew; Nydick, Robert

2003-01-01

This paper describes the results of using a modified Delphi approach designed to achieve consensus from eight discharge planning experts regarding the decision to refer hospitalized older adults for post-discharge follow-up. Experts reviewed 150 cases using an online website designed to facilitate their interaction and efforts to reach agreement on the need for a referral for post-discharge care and the appropriate site for such care. In contrast to an average of eight weeks to complete just 50 cases using the traditional mail method, the first online Delphi round for 150 cases were completed in six weeks. Data provided by experts suggest that online Delphi is a time efficient and acceptable methodology for reaching group consensus. Other benefits include instant access to Delphi decision results, live knowledge of the time requirements and progress of each expert, and cost savings in postage, paper, copying, and storage of paper documents. This online Delphi methodology is highly recommended. PMID:14728143

International, Expert-Based, Consensus Statement Regarding the Management of Acute Diverticulitis.

PubMed

O'Leary, D Peter; Lynch, Noel; Clancy, Cillian; Winter, Desmond C; Myers, Eddie

2015-09-01

This Delphi study provides consensus related to many aspects of acute diverticulitis and identifies other areas in need of research. To generate an international, expert-based, consensus statement to address controversies in the management of acute diverticulitis. This study was conducted using the Delphi technique from April 3 through October 21, 2014. A survey website was used and a panel of acute diverticulitis experts was formed via the snowball method. The top 5 acute diverticulitis experts in 5 international geographic regions were identified based on their number of publications related to acute diverticulitis. The Delphi study used 3 rounds of questions, after which the consensus statement was collated. A consensus statement related to the management of acute diverticulitis. Twenty items were selected for inclusion in the consensus statement following 3 rounds of questioning. A clear definition of uncomplicated and complicated diverticulitis is provided. In uncomplicated diverticulitis, consensus was reached regarding appropriate laboratory and radiological evaluation of patients as well as nonsurgical, surgical, and follow-up strategies. A number of important topics, including antibiotic treatment, failed to reach consensus. In addition, consensus was reached regarding many nonsurgical and surgical treatment strategies in complicated diverticulitis. Controversy continues internationally regarding the management of acute diverticulitis. This study demonstrates that there is more nonconsensus among experts than consensus regarding most issues, even in the same region. It also provides insight into the status quo regarding the treatment of acute diverticulitis and provides important direction for future research.

Competency model for dentists in China: Results of a Delphi study

PubMed Central

Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

Objective With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Methods Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Results Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. Conclusion In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China. PMID:29566048

The development of ethical guidelines for nurses' collegiality using the Delphi method.

PubMed

Kangasniemi, Mari; Arala, Katariina; Becker, Eve; Suutarla, Anna; Haapa, Toni; Korhonen, Anne

2017-08-01

Nurses' collegiality is topical because patient care is complicated, requiring shared knowledge and working methods. Nurses' collaboration has been supported by a number of different working models, but there has been less focus on ethics. This study aimed to develop nurses' collegiality guidelines using the Delphi method. Two online panels of Finnish experts, with 35 and 40 members, used the four-step Delphi method in December 2013 and January 2014. They reformulated the items of nurses' collegiality identified by the literature and rated based on validity and importance. Content analysis and descriptive statistical methods were used to analyze the data, and the nurses' collegiality guidelines were formulated. Ethical considerations: Organizational approval was received, and an informed consent was obtained from all participants. Information about the voluntary nature of participation was provided. During the first Delphi panel round, a number of items were reformulated and added, resulting in 32 reformulated items. As a result of the second round, 8 of the 32 items scored an agreement rate of more than 75%, with the most rated item being collegiality means that professionals respect each other. The item with second highest rating was collegiality has a common objective: what is best for patients, followed by the third highest which was professional ethics is the basis of collegiality. Nurses' collegiality and its content are well recognized in clinical practice but seldom studied. Collegiality can be supported by guidelines, and nurses working in clinical practice, together with teachers and managers, have shared responsibilities to support and develop it. More research in different nursing environments is needed to improve understanding of the content and practice of nursing collegiality.

Competency model for dentists in China: Results of a Delphi study.

PubMed

Geng, Yunxia; Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China.

Informatics Competencies for Nursing and Healthcare Leaders

PubMed Central

Westra, Bonnie L.; Delaney, Connie W.

2008-01-01

Historically, educational preparation did not address informatics competencies; thus managers, administrators, or executives may not be prepared to use or lead change in the use of health information technologies. A number of resources for informatics competencies exist, however, a comprehensive list addressing the unique knowledge and skills required in the role of a manager or administrator was not found. The purpose of this study was to develop informatics competencies for nursing leaders. A synthesis of the literature and a Delphi approach using three rounds of surveys with an expert panel resulted in identification of informatics competencies for nursing leaders that address computer skills, informatics knowledge, and informatics skills. PMID:18998803

Identifying research priorities for patient safety in mental health: an international expert Delphi study

PubMed Central

Murray, Kevin; Thibaut, Bethan; Ramtale, Sonny Christian; Adam, Sheila; Darzi, Ara; Archer, Stephanie

2018-01-01

Objective Physical healthcare has dominated the patient safety field; research in mental healthcare is not as extensive but findings from physical healthcare cannot be applied to mental healthcare because it delivers specialised care that faces unique challenges. Therefore, a clearer focus and recognition of patient safety in mental health as a distinct research area is still needed. The study aim is to identify future research priorities in the field of patient safety in mental health. Design Semistructured interviews were conducted with the experts to ascertain their views on research priorities in patient safety in mental health. A three-round online Delphi study was used to ascertain consensus on 117 research priority statements. Setting and participants Academic and service user experts from the USA, UK, Switzerland, Netherlands, Ireland, Denmark, Finland, Germany, Sweden, Australia, New Zealand and Singapore were included. Main outcome measures Agreement in research priorities on a five-point scale. Results Seventy-nine statements achieved consensus (>70%). Three out of the top six research priorities were patient driven; experts agreed that understanding the patient perspective on safety planning, on self-harm and on medication was important. Conclusions This is the first international Delphi study to identify research priorities in safety in the mental field as determined by expert academic and service user perspectives. A reasonable consensus was obtained from international perspectives on future research priorities in patient safety in mental health; however, the patient perspective on their mental healthcare is a priority. The research agenda for patient safety in mental health identified here should be informed by patient safety science more broadly and used to further establish this area as a priority in its own right. The safety of mental health patients must have parity with that of physical health patients to achieve this. PMID:29502096

Using a Delphi process to establish consensus on emergency medicine clerkship competencies.

PubMed

Penciner, Rick; Langhan, Trevor; Lee, Richard; McEwen, Jill; Woods, Robert A; Bandiera, Glen

2011-01-01

Currently, there is no consensus on the core competencies required for emergency medicine (EM) clerkships in Canada. Existing EM curricula have been developed through informal consensus or local efforts. The Delphi process has been used extensively as a means for establishing consensus. The purpose of this project was to define core competencies for EM clerkships in Canada, to validate a Delphi process in the context of national curriculum development, and to demonstrate the adoption of the CanMEDS physician competency paradigm in the undergraduate medical education realm. Using a modified Delphi process, we developed a consensus amongst a panel of expert emergency physicians from across Canada utilizing the CanMEDS 2005 Physician Competency Framework. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). This study demonstrated that a modified Delphi process can result in a strong consensus around a realistic number of core competencies for EM clerkships. We propose that such a method could be used by other medical specialties and health professions to develop rotation-specific core competencies.

Development of a Quality and Safety Competency Curriculum for Radiation Oncology Residency: An International Delphi Study.

PubMed

Adleman, Jenna; Gillan, Caitlin; Caissie, Amanda; Davis, Carol-Anne; Liszewski, Brian; McNiven, Andrea; Giuliani, Meredith

2017-06-01

To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through web conference discussion and reranked in Round 2. An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of a Quality and Safety Competency Curriculum for Radiation Oncology Residency: An International Delphi Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Adleman, Jenna; Gillan, Caitlin; Radiation Medicine Program, Princess Margaret Cancer Centre, Toronto, Ontario

Purpose: To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. Methods and Materials: A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through webmore » conference discussion and reranked in Round 2. Results: An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. Conclusions: This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs.« less

A National Needs Assessment to Identify Technical Procedures in Vascular Surgery for Simulation Based Training.

PubMed

Nayahangan, L J; Konge, L; Schroeder, T V; Paltved, C; Lindorff-Larsen, K G; Nielsen, B U; Eiberg, J P

2017-04-01

Practical skills training in vascular surgery is facing challenges because of an increased number of endovascular procedures and fewer open procedures, as well as a move away from the traditional principle of "learning by doing." This change has established simulation as a cornerstone in providing trainees with the necessary skills and competences. However, the development of simulation based programs often evolves based on available resources and equipment, reflecting convenience rather than a systematic educational plan. The objective of the present study was to perform a national needs assessment to identify the technical procedures that should be integrated in a simulation based curriculum. A national needs assessment using a Delphi process was initiated by engaging 33 predefined key persons in vascular surgery. Round 1 was a brainstorming phase to identify technical procedures that vascular surgeons should learn. Round 2 was a survey that used a needs assessment formula to explore the frequency of procedures, the number of surgeons performing each procedure, risk and/or discomfort, and feasibility for simulation based training. Round 3 involved elimination and ranking of procedures. The response rate for round 1 was 70%, with 36 procedures identified. Round 2 had a 76% response rate and resulted in a preliminary prioritised list after exploring the need for simulation based training. Round 3 had an 85% response rate; 17 procedures were eliminated, resulting in a final prioritised list of 19 technical procedures. A national needs assessment using a standardised Delphi method identified a list of procedures that are highly suitable and may provide the basis for future simulation based training programs for vascular surgeons in training. Copyright © 2017 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Development of a patient-reported outcome measure of recovery after abdominal surgery: a hypothesized conceptual framework.

PubMed

Alam, Roshni; Figueiredo, Sabrina M; Balvardi, Saba; Nauche, Bénédicte; Landry, Tara; Lee, Lawrence; Mayo, Nancy E; Feldman, Liane S; Fiore, Julio F

2018-05-17

We initiated a research program to develop a novel patient-reported outcome measure (PROM) to assess postoperative recovery from the perspective of abdominal surgery patients. In light of FDA recommendations, the first stage of our program aimed to, based on previous literature and expert input, develop a hypothesized conceptual framework portraying the health domains that are potentially relevant to the process of recovery after abdominal surgery. This study was conducted in three phases: (1) systematic review to identify PROMs with measurement properties appraised in the context of recovery after abdominal surgery, (2) content analysis to categorize the health domains covered by the PROMs according to the ICF, and (3) two-round Delphi study to gain expert input regarding which of these health domains are relevant to the process of recovery. Participants were experts in perioperative care identified through two major surgical societies (35 invited). The systematic review identified 19 PROMs covering 66 ICF domains. 23 experts (66%) participated in the Delphi process. After Round 2, experts agreed that 22 health domains (8 body functions, 14 activities and participation) are potentially relevant to the process of recovery after abdominal surgery. These domains were organized into a diagram, representing our hypothesized conceptual framework. This hypothesized conceptual framework is an important first step in our research program and will be further refined based on in-depth qualitative interviews with patients. The sound methodological approach used to derive this framework may be valuable for studies aimed to develop PROMs according to FDA standards.

Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis Standard Reporting and Evaluation Guidelines: Results of a National Institutes of Health Working Group.

PubMed

Maverakis, Emanual; Wang, Elizabeth A; Shinkai, Kanade; Mahasirimongkol, Surakameth; Margolis, David J; Avigan, Mark; Chung, Wen-Hung; Goldman, Jennifer; La Grenade, Lois; Pirmohamed, Munir; Shear, Neil H; Tassaeeyakul, Wichittra; Hoetzenecker, Wolfram; Klaewsongkram, Jettanong; Rerkpattanapipat, Ticha; Manuyakorn, Wiparat; Yasuda, Sally Usdin; Sharon, Victoria R; Sukhov, Andrea; Micheletti, Robert; Struewing, Jeff; French, Lars E; Cheng, Michelle Y

2017-06-01

Toxic epidermal necrolysis (TEN) and Stevens-Johnson Syndrome (SJS) are rare, acute, life-threatening dermatologic disorders involving the skin and mucous membranes. Research into these conditions is hampered by a lack of standardization of case reporting and data collection. To establish a standardized case report form to facilitate comparisons and maintain data quality based on an international panel of SJS/TEN experts who performed a Delphi consensus-building exercise. The elements presented for committee scrutiny were adapted from previous case report forms and from PubMed literature searches of highly cited manuscripts pertaining to SJS/TEN. The expert opinions and experience of the members of the consensus group were included in the discussion. Overall, 21 out of 29 experts who were invited to participate in the online Delphi exercise agreed to participate. Surveys at each stage were administered via an online survery software tool. For the first 2 Delphi rounds, results were analyzed using the Interpercentile Range Adjusted for Symmetry method and statements that passed consensus formulated a new case report form. For the third Delphi round, the case report form was presented to the committee, who agreed that it was "appropriate and useful" for documenting cases of SJS/TEN, making it more reliable and valuable for future research endeavors. With the consensus of international experts, a case report form for SJS/TEN has been created to help standardize the collection of patient information in future studies and the documentation of individual cases.

Development of a standardized training course for laparoscopic procedures using Delphi methodology.

PubMed

Bethlehem, Martijn S; Kramp, Kelvin H; van Det, Marc J; ten Cate Hoedemaker, Henk O; Veeger, Nicolaas J G M; Pierie, Jean Pierre E N

2014-01-01

Content, evaluation, and certification of laparoscopic skills and procedure training lack uniformity among different hospitals in The Netherlands. Within the process of developing a new regional laparoscopic training curriculum, a uniform and transferrable curriculum was constructed for a series of laparoscopic procedures. The aim of this study was to determine regional expert consensus regarding the key steps for laparoscopic appendectomy and cholecystectomy using Delphi methodology. Lists of suggested key steps for laparoscopic appendectomy and cholecystectomy were created using surgical textbooks, available guidelines, and local practice. A total of 22 experts, working for teaching hospitals throughout the region, were asked to rate the suggested key steps for both procedures on a Likert scale from 1-5. Consensus was reached with Crohnbach's α ≥ 0.90. Of the 22 experts, 21 completed and returned the survey (95%). Data analysis already showed consensus after the first round of Delphi on the key steps for laparoscopic appendectomy (Crohnbach's α = 0.92) and laparoscopic cholecystectomy (Crohnbach's α = 0.90). After the second round, 15 proposed key steps for laparoscopic appendectomy and 30 proposed key steps for laparoscopic cholecystectomy were rated as important (≥4 by at least 80% of the expert panel). These key steps were used for the further development of the training curriculum. By using the Delphi methodology, regional consensus was reached on the key steps for laparoscopic appendectomy and cholecystectomy. These key steps are going to be used for standardized training and evaluation purposes in a new regional laparoscopic curriculum. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study

PubMed Central

Walsh, Kieran; Westerman, Michiel; Scheele, Fedde

2018-01-01

Background The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. Objective We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. Methods We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. Results In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. Conclusions This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. PMID:29699970

Creation and Delphi-method refinement of pediatric disaster triage simulations.

PubMed

Cicero, Mark X; Brown, Linda; Overly, Frank; Yarzebski, Jorge; Meckler, Garth; Fuchs, Susan; Tomassoni, Anthony; Aghababian, Richard; Chung, Sarita; Garrett, Andrew; Fagbuyi, Daniel; Adelgais, Kathleen; Goldman, Ran; Parker, James; Auerbach, Marc; Riera, Antonio; Cone, David; Baum, Carl R

2014-01-01

There is a need for rigorously designed pediatric disaster triage (PDT) training simulations for paramedics. First, we sought to design three multiple patient incidents for EMS provider training simulations. Our second objective was to determine the appropriate interventions and triage level for each victim in each of the simulations and develop evaluation instruments for each simulation. The final objective was to ensure that each simulation and evaluation tool was free of bias toward any specific PDT strategy. We created mixed-methods disaster simulation scenarios with pediatric victims: a school shooting, a school bus crash, and a multiple-victim house fire. Standardized patients, high-fidelity manikins, and low-fidelity manikins were used to portray the victims. Each simulation had similar acuity of injuries and 10 victims. Examples include children with special health-care needs, gunshot wounds, and smoke inhalation. Checklist-based evaluation tools and behaviorally anchored global assessments of function were created for each simulation. Eight physicians and paramedics from areas with differing PDT strategies were recruited as Subject Matter Experts (SMEs) for a modified Delphi iterative critique of the simulations and evaluation tools. The modified Delphi was managed with an online survey tool. The SMEs provided an expected triage category for each patient. The target for modified Delphi consensus was ≥85%. Using Likert scales and free text, the SMEs assessed the validity of the simulations, including instances of bias toward a specific PDT strategy, clarity of learning objectives, and the correlation of the evaluation tools to the learning objectives and scenarios. After two rounds of the modified Delphi, consensus for expected triage level was >85% for 28 of 30 victims, with the remaining two achieving >85% consensus after three Delphi iterations. To achieve consensus, we amended 11 instances of bias toward a specific PDT strategy and corrected 10 instances of noncorrelation between evaluations and simulation. The modified Delphi process, used to derive novel PDT simulation and evaluation tools, yielded a high degree of consensus among the SMEs, and eliminated biases toward specific PDT strategies in the evaluations. The simulations and evaluation tools may now be tested for reliability and validity as part of a prehospital PDT curriculum.

Core Items for a Standardized Resource Use Measure: Expert Delphi Consensus Survey.

PubMed

Thorn, Joanna C; Brookes, Sara T; Ridyard, Colin; Riley, Ruth; Hughes, Dyfrig A; Wordsworth, Sarah; Noble, Sian M; Thornton, Gail; Hollingworth, William

2018-06-01

Resource use measurement by patient recall is characterized by inconsistent methods and a lack of validation. A validated standardized resource use measure could increase data quality, improve comparability between studies, and reduce research burden. To identify a minimum set of core resource use items that should be included in a standardized adult instrument for UK health economic evaluation from a provider perspective. Health economists with experience of UK-based economic evaluations were recruited to participate in an electronic Delphi survey. Respondents were asked to rate 60 resource use items (e.g., medication names) on a scale of 1 to 9 according to the importance of the item in a generic context. Items considered less important according to predefined consensus criteria were dropped and a second survey was developed. In the second round, respondents received the median score and their own score from round 1 for each item alongside summarized comments and were asked to rerate items. A final project team meeting was held to determine the recommended core set. Forty-five participants completed round 1. Twenty-six items were considered less important and were dropped, 34 items were retained for the second round, and no new items were added. Forty-two respondents (93.3%) completed round 2, and greater consensus was observed. After the final meeting, 10 core items were selected, with further items identified as suitable for "bolt-on" questionnaire modules. The consensus on 10 items considered important in a generic context suggests that a standardized instrument for core resource use items is feasible. Copyright © 2018. Published by Elsevier Inc.

Development of criteria for evaluating clinical response in thyroid eye disease using a modified Delphi technique.

PubMed

Douglas, Raymond S; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A; Cahill, Kenneth; Dolman, Peter J; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J; Khanna, Dinesh

2009-09-01

To identify components of a provisional clinical response index for thyroid eye disease using a modified Delphi technique. The International Thyroid Eye Disease Society conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in thyroid eye disease. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty-four respondents participated in the Delphi 1 survey, providing 220 unique items. Ninety-two members (100% of the respondents from Delphi 1 plus 8 new participants) responded in Delphi 2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi 3 (67 criteria were excluded because of redundancy). Criteria with a mean greater than 6 (1 = least appropriate to 9 = most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for thyroid eye disease. These measures will be iteratively refined for use in multicenter clinical trials.

Development of criteria for evaluating clinical response in thyroid eye disease (CRI-TED) using a modified Delphi technique

PubMed Central

Douglas, Raymond S.; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A.; Cahill, Kenneth; Dolman, Peter J.; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J.; Khanna, Dinesh

2014-01-01

To identify components of a provisional clinical response index for thyroid eye disease (CRI-TED) using a modified Delphi technique. The International Thyroid Eye Disease Society (ITEDS) conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in TED. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty four respondents participated in the Delphi-1 survey, providing 220 unique items. Ninety- two members (100% of the respondents from Delphi 1 plus eight new participants) responded in Delphi-2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi-3 (67 criteria were excluded due to redundancy). Criteria with a mean greater than 6 (1 least appropriate to 9 most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for TED. These measures will be iteratively refined for use in multicenter clinical trials. PMID:19752424

Evaluation Criteria for Interactive E-Books for Open and Distance Learning

ERIC Educational Resources Information Center

Bozkurt, Aras; Bozkaya, Mujgan

2015-01-01

The aim of this mixed method study is to identify evaluation criteria for interactive e-books. To find answers for the research questions of the study, both quantitative and qualitative data were collected through a four-round Delphi study with a panel consisting of 30 experts. After that, a total of 20 interactive e-books were examined with…

Organization for Direction and Coordination of Occupational Education. Final Report.

ERIC Educational Resources Information Center

Sheldon, M. Stephen; And Others

A study was conducted to identify the minimum mangagement essentials necessary for the effective administration of occupational education (OE) programs in community colleges and to make recommendations to implement the findings. A four-round Delphi process with 179 experts participating was used. Forty-nine items were identified as being essential…

Identifying Shared Values for School-Affiliated Student Organizations

PubMed Central

Bush, Antonio A.; Buhlinger, Kaitlyn M.

2017-01-01

Objective. To identify shared values for student organizations. Methods. A three-round Delphi approach was utilized to identify and prioritize shared values among student organization leadership. In round 1, student leaders selected 15 values from a list of 36 organizational values and were given an opportunity to include up to five suggestions not incorporated within the original list. Student leaders narrowed the 15 values to 12 in round 2. The top 12 priorities were ranked in round 3 and participants were invited to write a brief statement regarding their perspectives of the results. Results. Twelve shared values were identified and ranked: professional development, improving leadership of your members, advancing the role of pharmacy, planning quality events, networking, improving the academic experience for peers, community service, learning from pharmacy shadowing/speakers, social outlet, recruitment/gaining student membership, attracting students to events, and gaining national/local attention or awards. Conclusion. This study contributes to the small but growing body of literature concerning student organizations in pharmacy education and provides a foundation by which this work could be advanced. Given the importance of student organizations in promoting student development, identifying strategies for supporting and facilitating the effectiveness of these groups is critical for optimizing student outcomes and institutional effectiveness. PMID:29302089

Using a Delphi consensus process to develop an acupuncture treatment protocol by consensus for women undergoing Assisted Reproductive Technology (ART) treatment

PubMed Central

2012-01-01

Background Assisted reproductive technologies (ART) are increasingly utilised for resolving difficulties conceiving. These technologies are expensive to both the public purse and the individual consumers. Acupuncture is widely used as an adjunct to ART with indications that it may assist reducing the time to conception and increasing live birth rates. Heterogeneity is high between treatment protocols. The aim of this study was to examine what fertility acupuncturists consider key components of best practice acupuncture during an ART cycle, and to establish an acupuncture protocol by consensus. Methods Fifteen international acupuncturists with extensive experience treating women during ART interventions participated in 3 rounds of Delphi questionnaires. The first round focused on identifying the parameters of acupuncture treatment as adjunct to ART, the second round evaluated statements derived from the earlier round, and the third evaluated specific parameters for a proposed trial protocol. Consensus was defined as greater than 80% agreement. Results Significant agreement was achieved on the parameters of best practice acupuncture, including an acupuncture protocol suitable for future research. Study participants confirmed the importance of needling aspects relating to the dose of acupuncture, the therapeutic relationship, tailoring treatment to the individual, and the role of co-interventions. From two rounds of the Delphi a consensus was achieved on seven treatment parameters for the design of the acupuncture treatment to be used in a clinical trial of acupuncture as an adjunct to ART. The treatment protocol includes the use of the traditional Chinese medicine acupuncture, use of manual acupuncture, a first treatment administered between day 6–8 of the stimulated ART cycle which is individualised to the participant, two treatments will be administered on the day of embryo transfer, and will include points SP8, SP10, LR3, ST29, CV4, and post transfer include: GV20, KD3, ST36, SP6, and PC6. Auricular points Shenmen and Zigong will be used. Practitioner intent or yi will be addressed in the treatment protocol. Conclusions Despite a lack of homogeneity in the research and clinical literature on ART and acupuncture, a consensus amongst experts on key components of a best practice treatment protocol was possible. Such consensus offers guidance for further research. PMID:22769059

Study to validate the outcome goal, competencies and educational objectives for use in intensive care orientation programs.

PubMed

Boyle, M; Butcher, R; Kenney, C

1998-03-01

Intensive care orientation programs have become an accepted component of intensive care education. To date, however, there have been no Australian-based standards defining the appropriate level of competence to be attained upon completion of orientation. The aim of this study was to validate a set of aims, competencies and educational objectives that could form the basis of intensive care orientation and which would ensure an outcome standard of safe and effective practice. An initial document containing a statement of the desired outcome goal, six competency statements and 182 educational objectives was developed through a review of the orientation programs developed by the investigators. The Delphi technique was used to gain consensus among 13 nurses recognised for their expertise in intensive care education. The expert group rated the acceptability of each of the study items and provided suggestions for objectives to be included. An approval rating of 80 per cent was required to retain each of the study items, with the document refined through three Delphi rounds. The final document contains a validated statement of outcome goal, competencies and educational objectives for intensive care orientation programs.

Quality Metrics in Neonatal and Pediatric Critical Care Transport: A National Delphi Project.

PubMed

Schwartz, Hamilton P; Bigham, Michael T; Schoettker, Pamela J; Meyer, Keith; Trautman, Michael S; Insoft, Robert M

2015-10-01

The transport of neonatal and pediatric patients to tertiary care facilities for specialized care demands monitoring the quality of care delivered during transport and its impact on patient outcomes. In 2011, pediatric transport teams in Ohio met to identify quality indicators permitting comparisons among programs. However, no set of national consensus quality metrics exists for benchmarking transport teams. The aim of this project was to achieve national consensus on appropriate neonatal and pediatric transport quality metrics. Modified Delphi technique. The first round of consensus determination was via electronic mail survey, followed by rounds of consensus determination in-person at the American Academy of Pediatrics Section on Transport Medicine's 2012 Quality Metrics Summit. All attendees of the American Academy of Pediatrics Section on Transport Medicine Quality Metrics Summit, conducted on October 21-23, 2012, in New Orleans, LA, were eligible to participate. Candidate quality metrics were identified through literature review and those metrics currently tracked by participating programs. Participants were asked in a series of rounds to identify "very important" quality metrics for transport. It was determined a priori that consensus on a metric's importance was achieved when at least 70% of respondents were in agreement. This is consistent with other Delphi studies. Eighty-two candidate metrics were considered initially. Ultimately, 12 metrics achieved consensus as "very important" to transport. These include metrics related to airway management, team mobilization time, patient and crew injuries, and adverse patient care events. Definitions were assigned to the 12 metrics to facilitate uniform data tracking among programs. The authors succeeded in achieving consensus among a diverse group of national transport experts on 12 core neonatal and pediatric transport quality metrics. We propose that transport teams across the country use these metrics to benchmark and guide their quality improvement activities.

Module for Interns in Medical Ethics: A Developmental Diegesis.

PubMed

Mahajan, Rajiv; Goyal, Parmod Kumar; Sidhu, Tanvir Kaur; Kaur, Upinder; Kaur, Sandeep; Gupta, Vitull

2017-12-01

Media report is rife with incidences of doctor-patients' conflict, and this partly is due to communication gap and unethical practices being adopted by the doctors. Our regular curriculum fails to impart any training in ethical issues in patient care. Imparting training to students in these soft-skills is the need of the hour. To develop a module for interns in medical ethics (MIME) in patient care, validate it and pilot run the module for standardization. After conducting faculty development workshop in curriculum designing and three rounds of Delphi with alumni, a module in medical ethics was developed and peer validated. The questionnaire for pilot run, questionnaire for future use of module delivery and pre- and post-test were also peer validated. The module was delivered to 17 interns as pilot run in the form of 4 days' workshop. After pilot run, the module was standardized to 10 broad topics and 3 days' workshop. The questionnaire for future delivery of module in regular routine was also validated during pilot run. Twenty-five faculty members participated in 1 day faculty development workshop and 59 alumni completed three rounds of Delphi. After peer review by five experts, a module of 11 broad areas was developed and was pilot run on 17 interns. Based on the feedback from pilot run, a standardized, validated 18 h teaching MIME in patient care was developed. Pilot study proves that curriculum innovation in the form of medical ethics training to interns; when as undergraduate students, they actively participate in patient care under supervision will go a long way in inculcating soft skills like ethics, compassion and communication in them.

Diagnostic utility of FDG-PET in the differential diagnosis between different forms of primary progressive aphasia.

PubMed

Bouwman, Femke; Orini, Stefania; Gandolfo, Federica; Altomare, Daniele; Festari, Cristina; Agosta, Federica; Arbizu, Javier; Drzezga, Alexander; Nestor, Peter; Nobili, Flavio; Walker, Zuzana; Morbelli, Silvia; Boccardi, Marina

2018-05-09

A joint effort of the European Association of Nuclear Medicine (EANM) and the European Academy of Neurology (EAN) aims at clinical guidance for the use of FDG-PET in neurodegenerative diseases. This paper addresses the diagnostic utility of FDG-PET over clinical/neuropsychological assessment in the differentiation of the three forms of primary progressive aphasia (PPA). Seven panelists were appointed by the EANM and EAN and a literature search was performed by using harmonized PICO (Population, Intervention, Comparison, Outcome) question keywords. The studies were screened for eligibility, and data extracted to assess their methodological quality. Critical outcomes were accuracy indices in differentiating different PPA clinical forms. Subsequently Delphi rounds were held with the extracted data and quality assessment to reach a consensus based on both literature and expert opinion. Critical outcomes for this PICO were available in four of the examined papers. The level of formal evidence supporting clinical utility of FDG-PET in differentiating among PPA variants was considered as poor. However, the consensual recommendation was defined on Delphi round I, with six out of seven panelists supporting clinical use. Quantitative evidence demonstrating utility or lack thereof is still missing. Panelists decided consistently to provide interim support for clinical use based on the fact that a typical atrophy or metabolic pattern is needed for PPA according to the diagnostic criteria, and the synaptic failure detected by FDG-PET is an earlier phenomenon than atrophy. Also, a normal FDG-PET points to a non-neurodegenerative cause.

Teaching Competencies for Community Preceptors.

PubMed

Brink, Darin; Simpson, Deb; Crouse, Byron; Morzinski, Jeffrey; Bower, Douglas; Westra, Ruth

2018-05-01

Although community physicians provide one-fourth of the outpatient training received in medical school, usually there is no formal training of the preceptor. Currently there is no agreed-upon list of teaching competencies for community physician-preceptors. Using a modified Delphi process, the authors aimed to identify core teaching competencies for community preceptors for use in training and evaluation. A medical educator and three faculty members with expertise in faculty development created a list of teaching competencies organized in five domains. These competencies were finalized through a multiround modified Delphi technique with key stakeholder groups including (1) nonphysician medical educators, (2) academic physicians involved in faculty development, (3) community physicians who regularly precept medical students, (4) family medicine residents, (5) third-year medical students in a 9-month-long longitudinal clerkship. Proposed competencies were retained if 70% of the participants ranked it as "very or extremely important." In the first round, 24 competencies were evaluated by 40 physician preceptors participating in a rural faculty development conference. These were refined, and four additional competencies were added by the cohort. Subsequent rounds utilized a survey approach with broader audiences resulting in a final list of 21 competencies in five domains. Five competency domains with 21 teaching competencies can now be used to guide community preceptors' training and evaluation.

Toward an essential ethic for teaching science in the new millennium

NASA Astrophysics Data System (ADS)

Hays, Irene De La Bretonne

The purpose of this study was to identify and explore values and views that might underlie an essential ethic for teaching science in the new millennium. With such an ethic, teachers may be better able to prepare young people to form and fully participate in communities that restore and sustain Earth. Reviewed in the literature for this study were changing philosophies and theories from early indigenous cultures to the present on the nature of nature, the value of nature, and the human relationship with nature. These philosophies and theories were found to influence values that today underlie the work scientists do and the ways young people are educated in science. In the study, two groups of participants--Nature Writers and scientists--revealed the essence and meaning of their relationship with nature. A two-stage, modified Delphi method was used for collecting data. Stage One comprised the first "round" of the Delphi and involved content analysis of writings by a select group of U.S. Nature Writers from the early 1800s to the present. In Stage Two, comprising three rounds of the modified Delphi, perspectives of Nature Writers were imbedded in questionnaires and presented for response to a select group of scientists connected with research and education at National Laboratories across the country. Finally, results from each participant group were brought together in a recursive process, one with the other, to determine findings. Strong Earth-care values, including receptivity, responsibility, interdependence, respect, cooperation, love, and care, were found to be held in common by the Nature Writers and scientists in this study and could form the foundation for an essential ethic for teaching science. The strongest dissonance between Nature Writers and scientists was evident in emotional and spiritual domains--despite that many scientists revealed emotional and spiritual elements in stories told of their experiences with nature. Contrary to what might have been expected from scientists based on theories of science and practices of science education represented in the literature, few scientists revealed negative, utilitarian, or dominionistic affiliations with nature. In contrast, no Nature Writers revealed such affiliations.

Strategies to promote better research on oral health in Africa: A Delphi consensus study

PubMed Central

Kanoute, Aïda; Faye, Daouda; Bourgeois, Denis

2014-01-01

Background: Research on oral health contributes to improved health outcomes; it is an indispensable tool in health policy. But how to fill the gaps in research oral health and to strengthen its capacity is the question. The main objective of the present study is to identify the current status of oral health research and potential strategies, thereby strengthening the research infrastructure and capacity. Delphi consultation, in the perspective of assisting decision-makers to identify strategies to promote better research on oral health in Africa, was initiated. Design and Methods: The panels of 30 experts were asked to complete the questionnaire with 42 items into four groups by web survey. Each indicator statement was considered to be in consensus if the expert's opinion rating was of “A or B” for more than 75% in a scale of seven categories. Quantitative analysis was made from the answers of Delphi round. Results: There was a strong consensus about three items concerning the role of oral health research, the development of research policy for oral health going through an effective governance of research institutes, migration of researchers and fund raising. Conclusion: This study shows strong many dispersal opinions by experts, but highlights the need for to improve the effectiveness of oral health research capacity strengthening activities. Africa's researchers, policy makers and partners will have to give special attention to ensuring that knowledge generated from oral health research is acted on to improve health for all. PMID:24808689

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology.

PubMed

King, Andrew; Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-10-25

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development.

Components of a Measure to Describe Organizational Culture in Academic Pharmacy.

PubMed

Desselle, Shane; Rosenthal, Meagen; Holmes, Erin R; Andrews, Brienna; Lui, Julia; Raja, Leela

2017-12-01

Objective. To develop a measure of organizational culture in academic pharmacy and identify characteristics of an academic pharmacy program that would be impactful for internal (eg, students, employees) and external (eg, preceptors, practitioners) clients of the program. Methods. A three-round Delphi procedure of 24 panelists from pharmacy schools in the U.S. and Canada generated items based on the Organizational Culture Profile (OCP), which were then evaluated and refined for inclusion in subsequent rounds. Items were assessed for appropriateness and impact. Results. The panel produced 35 items across six domains that measured organizational culture in academic pharmacy: competitiveness, performance orientation, social responsibility, innovation, emphasis on collegial support, and stability. Conclusion. The items generated require testing for validation and reliability in a large sample to finalize this measure of organizational culture.

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method.

PubMed

Yeh, James S; Van Hoof, Thomas J; Fischer, Michael A

2016-02-01

Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process.

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method

PubMed Central

Yeh, James S.; Van Hoof, Thomas J.; Fischer, Michael A.

2016-01-01

Background Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. Objective To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. Methods This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. Results The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Conclusion Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process. PMID:27066195

Paediatric traumatic cardiac arrest: a Delphi study to establish consensus on definition and management.

PubMed

Rickard, Annette C; Vassallo, James; Nutbeam, Tim; Lyttle, Mark D; Maconochie, Ian K; Enki, Doyo G; Smith, Jason E

2018-04-28

Paediatric traumatic cardiac arrest (TCA) is associated with low survival and poor outcomes. The mechanisms that underlie TCA are different from medical cardiac arrest; the approach to treatment of TCA may therefore also need to differ to optimise outcomes. The aim of this study was to explore the opinion of subject matter experts regarding the diagnosis and treatment of paediatric TCA, and to reach consensus on how best to manage this group of patients. An online Delphi study was conducted over three rounds, with the aim of achieving consensus (defined as 70% agreement) on statements related to the diagnosis and management of paediatric TCA. Participants were invited from paediatric and adult emergency medicine, paediatric anaesthetics, paediatric ICU and paediatric surgery, as well as Paediatric Major Trauma Centre leads and representatives from the Resuscitation Council UK. Statements were informed by literature reviews and were based on elements of APLS resuscitation algorithms as well as some concepts used in the management of adult TCA; they ranged from confirmation of cardiac arrest to the indications for thoracotomy. 73 experts completed all three rounds between June and November 2016. Consensus was reached on 14 statements regarding the diagnosis and management of paediatric TCA; oxygenation and ventilatory support, along with rapid volume replacement with warmed blood, improve survival. The duration of cardiac arrest and the lack of a response to intervention, along with cardiac standstill on ultrasound, help to guide the decision to terminate resuscitation. This study has given a consensus-based framework to guide protocol development in the management of paediatric TCA, though further work is required in other key areas including its acceptability to clinicians. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Defining a Leader Role curriculum for radiation oncology: A global Delphi consensus study.

PubMed

Turner, Sandra; Seel, Matthew; Trotter, Theresa; Giuliani, Meredith; Benstead, Kim; Eriksen, Jesper G; Poortmans, Philip; Verfaillie, Christine; Westerveld, Henrike; Cross, Shamira; Chan, Ming-Ka; Shaw, Timothy

2017-05-01

The need for radiation oncologists and other radiation oncology (RO) professionals to lead quality improvement activities and contribute to shaping the future of our specialty is self-evident. Leadership knowledge, skills and behaviours, like other competencies, can be learned (Blumenthal et al., 2012). The objective of this study was to define a globally applicable competency set specific to radiation oncology for the CanMEDS Leader Role (Frank et al., 2015). A modified Delphi consensus process delivering two rounds of on-line surveys was used. Participants included trainees, radiation/clinical oncologists and other RO team members (radiation therapists, physicists, and nurses), professional educators and patients. 72 of 95 (76%) invitees from nine countries completed the Round 1 (R1) survey. Of the 72 respondents to RI, 70 completed Round 2 (R2) (97%). In R1, 35 items were deemed for 'inclusion' and 21 for 'exclusion', leaving 41 'undetermined'. After review of items, informed by participant comments, 14 competencies from the 'inclusion' group went into the final curriculum; 12 from the 'undetermined' group went to R2. In R2, 6 items reached consensus for inclusion. This process resulted in 20 RO Leader Role competencies with apparent global applicability. This is the first step towards developing learning, teaching and assessment tools for this important area of training. Copyright © 2017 Elsevier B.V. All rights reserved.

Community actions against alcohol drinking in Slovenia--a Delphi study.

PubMed

Susic, Tonka Poplas; Svab, Igor; Kolsek, Marko

2006-07-27

To define the national strategy and public actions to reduce alcohol related harm, based on societal consensus. Alcohol abuse is an avoidable behaviour that can threaten health. In Slovenia, only a few public campaigns against drinking alcohol are under way. It is important to establish which community measures are acceptable to society in Slovenia in order to reduce alcohol-related risks. A Delphi study with 45 professionals from different disciplines was conducted. Participants offered many suggestions to improve the current situation. After three rounds of questionnaires, 86 participant statements were accepted as a consensus. Actions such as: state monopolies, alcohol taxation, legislative restrictions on availability and purchase of alcohol, age-related restriction on sales, drink-driving laws, school-based alcohol education and media information campaigns are most likely to be achieved by consensus. The main target populations for implementation of alcohol-related educational programs are children, young people and employees. As a result of the study, a number of community actions against drinking alcohol that could be acceptable for society can now be suggested. They vary across different target populations, change agents (individuals, organizations and institutions) and methods of implementation.

Global health resource utilization associated with pacemaker complications.

PubMed

Waweru, Catherine; Steenrod, Anna; Wolff, Claudia; Eggington, Simon; Wright, David Jay; Wyrwich, Kathleen W

2017-07-01

To estimate health resource utilization (HRU) associated with the management of pacemaker complications in various healthcare systems. Electrophysiologists (EPs) from four geographical regions (Western Europe, Australia, Japan, and North America) were invited to participate. Survey questions focused on HRU in the management of three chronic pacemaker complications (i.e. pacemaker infections requiring extraction, lead fractures/insulation breaches requiring replacement, and upper extremity deep venous thrombosis [DVT]). Panelists completed a maximum of two web-based surveys (iterative rounds). Mean, median values, and interquartile ranges were calculated and used to establish consensus. Overall, 32 and 29 panelists participated in the first and second rounds of the Delphi panel, respectively. Consensus was reached on treatment and HRU associated with a typical pacemaker implantation and complications. HRU was similar across regions, except for Japan, where panelists reported the longest duration of hospital stay in all scenarios. Infections were the most resource-intensive complications and were characterized by intravenous antibiotics days of 9.6?13.5 days and 21.3?29.2 days for pocket and lead infections respectively; laboratory and diagnostic tests, and system extraction and replacement procedures. DVT, on the other hand, was the least resource intensive complication. The results of the panel represent the views of the respondents who participated and may not be generalizable outside of this panel. The surveys were limited in scope and, therefore, did not include questions on management of acute complications (e.g. hematoma, pneumothorax). The Delphi technique provided a reliable and efficient approach to estimating resource utilization associated with chronic pacemaker complications. Estimates from the Delphi panel can be used to generate costs of pacemaker complications in various regions.

[Episodic breathlessness: translation and consenting of the international definition using the Delphi method].

PubMed

Simon, S T; Weingärtner, V; Voltz, R; Bausewein, C

2014-10-01

Similar to pain, refractory breathlessness can occur episodically. Episodic Breathlessness is a distressing symptom in patients with advanced life-limiting disease. The lack of a universal definition impedes symptom understanding in clinical practice and effective management, respectively. The aim of the study was to formally consent a German translation of the English definition and terminology of episodic breathlessness. A web-based Delphi survey was conducted with German breathlessness experts (breathlessness working group of Germany's National Guideline (S3) for Palliative Care). Drafts of German-language definitions und terminology were assessed using structured questionnaires by binary rating or rankings, respectively. Optional comments were analysed by content analysis. Consensus was defined by ≥ 70% agreement among participants. In two resulting Delphi-rounds 8/16 (50%) und 11/16 (69%) experts, 30-59 years of age, 50%/55% female, participated. After the second round, consensus was reached for the symptom's description "Atemnotattacke" (73%) and a German-language definition (90%). The terms "vorhersehbar" vs. "unvorhersehbar" were directly consented for the categorization (88%). The formally consented German definition and terminology of episodic breathlessness enable clearer symptom understanding and provide a precise basis for education and research on the symptom and its management also in Germany. Effective management options are warranted to improve quality of life of suffering patients and their relatives. © Georg Thieme Verlag KG Stuttgart · New York.

Reaching consensus on the physiotherapeutic management of patients following upper abdominal surgery: a pragmatic approach to interpret equivocal evidence.

PubMed

Hanekom, Susan D; Brooks, Dina; Denehy, Linda; Fagevik-Olsén, Monika; Hardcastle, Timothy C; Manie, Shamila; Louw, Quinette

2012-02-06

Postoperative pulmonary complications remain the most significant cause of morbidity following open upper abdominal surgery despite advances in perioperative care. However, due to the poor quality primary research uncertainty surrounding the value of prophylactic physiotherapy intervention in the management of patients following abdominal surgery persists. The Delphi process has been proposed as a pragmatic methodology to guide clinical practice when evidence is equivocal. The objective was to develop a clinical management algorithm for the post operative management of abdominal surgery patients. Eleven draft algorithm statements extracted from the extant literature by the primary research team were verified and rated by scientist clinicians (n=5) in an electronic three round Delphi process. Algorithm statements which reached a priori defined consensus-semi-interquartile range (SIQR)<0.5-were collated into the algorithm. The five panelists allocated to the abdominal surgery Delphi panel were from Australia, Canada, Sweden, and South Africa. The 11 draft algorithm statements were edited and 5 additional statements were formulated. The panel reached consensus on the rating of all statements. Four statements were rated essential. An expert Delphi panel interpreted the equivocal evidence for the physiotherapeutic management of patients following upper abdominal surgery. Through a process of consensus a clinical management algorithm was formulated. This algorithm can now be used by clinicians to guide clinical practice in this population.

Guidelines to encourage the adoption and meaningful use of health information technologies in the South African healthcare landscape.

PubMed

Mostert-Phipps, Nicky; Pottas, Dalenca; Korpela, Mikko

2013-01-01

There are various benefits associated with the adoption and meaningful use of health information technologies (HITs) in the healthcare sector. Despite these benefits, the South African healthcare sector has been slow to adopt HITs such as electronic record systems. The purpose of this research project was to formulate guidelines to encourage the adoption and meaningful use of HITs in the South African healthcare landscape. A three-round Delphi study was conducted to identify factors that should be addressed to encourage the adoption and meaningful use of HITs in the South African healthcare landscape. The Delphi panel included 21 participants that were considered to be suitably knowledgeable regarding the area under consideration. Consensus was reached on 42 factors that were rated as having a direct to significant impact on the adoption and meaningful use of HITs in the South African context. These factors were further analysed to formulate 20 guidelines that indicate that there are a wide range of factors that would have to be addressed involving a multitude of stakeholders.

Fitting contraceptive diaphragms: can laywomen provide quality training for doctors?

PubMed

Pickard, S; Baraitser, P; Herns, M; Massil, H

2001-07-01

To test the feasibility of training laywomen as professional patients to teach doctors to fit the contraceptive diaphragm. Semi-structured interviews with instructing doctors and questionnaires to DFFP trainees. These documented current teaching practice and the acceptability of professional patients. The Delphi technique was used to establish a curriculum for the professional patients' training programme. The results show that there is currently a lack of standardisation in teaching methods and content with respect to diaphragm fitting. All instructing doctors and DFFP trainees involved had experienced difficulties in recruiting women for training, and the majority would be happy to work with professional patients. After three rounds of the Delphi procedure, consensus was reached and a curriculum developed. Five women were recruited on to a training programme, and four successfully completed it. Lack of standardisation and difficulty recruiting patients are current problems when training doctors to fit diaphragms. Our study shows that the use of professional patients would be acceptable to both DFFP trainees and instructing doctors, and that it is possible to recruit and train women for this purpose.

Nature-based care opportunities and barriers in oncology contexts: a modified international e-Delphi survey.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-10-16

To develop recommendations regarding opportunities and barriers for nature-based care in oncology contexts using a structured knowledge generation process involving relevant healthcare and design experts. Four-round modified electronic Delphi study. Oncology patients' nature-based recommendations, uncovered in preceding qualitative investigation, were included in the first round for the expert participants' consideration. Key items (opportunities and barriers) were developed using data aggregation and synthesis, followed by item prioritisation and 10-point Likert scale ranking (1=not important, 10=very important). Descriptive statistics were calculated to assess items of highest importance representing expert recommendations. Online Delphi process constituting an electronic international survey. A purposive sample of 200 potential panellists (recruitment target n=40) comprising healthcare practitioners, managers, designers, architects and researchers were invited to participate; experts were identified via research networks, snowballing and systematic literature review. 38 experts across seven countries (Australia, USA, UK, New Zealand, Canada, Denmark and Sweden) returned questionnaire 1, which determined consent and acceptance for participation. Initial response rate was 19%, and subsequent response rates were 84%, 82% and 84% for rounds 2, 3 and 4, respectively. The Delphi panel developed recommendations consisting of 10 opportunities and 10 barriers. The following opportunities were rated to be of highest importance: window views from clinical areas onto nature; outdoor settings, gardens and courtyards with easy and effortless access; and nature-based physical exercise adapted to patient requirements. Highest-rated barriers for nature-based oncology care included lack of knowledge and awareness about benefits of nature engagement and inaccessibility, not considering access requirements for the very sick and frail. Experts suggested and agreed on a set of recommendations, which represent critical considerations for the safe adoption of nature-based oncology opportunities. These findings fill a gap in understanding about helpful nature-based oncology care and may translate into oncology design and innovation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development of quality indicators to evaluate antibiotic treatment of patients with community-acquired pneumonia in Indonesia.

PubMed

Farida, Helmia; Rondags, Angelique; Gasem, M Hussein; Leong, Katharina; Adityana, A; van den Broek, Peterhans J; Keuter, Monique; Natsch, Stephanie

2015-04-01

To develop an instrument for evaluating the quality of antibiotic management of patients with community-acquired pneumonia (CAP) applicable in a middle-income developing country. A previous study and Indonesian guidelines were reviewed to derive potential quality of care indicators (QIs). An expert panel performed a two-round Delphi consensus procedure on the QI's relevance to patient recovery, reduction of antimicrobial resistance and cost containment. Applicability in practice, including reliability, feasibility and opportunity for improvement, was determined in a data set of 128 patients hospitalised with CAP in Semarang, Indonesia. Fifteen QIs were selected by the consensus procedure. Five QIs did not pass feasibility criteria, because of inappropriate documentation, inefficient laboratory services or patient factors. Three QIs provided minor opportunity for improvement. Two QIs contradicted each other; one of these was considered not valid and excluded. A final set of six QIs was defined for use in the Indonesian setting. Using the Delphi method, we defined a list of QIs for assessing the quality of care, in particular antibiotic treatment, for CAP in Indonesia. For further improvement, a modified Delphi method that includes discussion, a sound medical documentation system, improvement of microbiology laboratory services, and multi-center applicability tests are needed to develop a valid and applicable QI list for the Indonesian setting. © 2014 John Wiley & Sons Ltd.

The Future of Clinical Education: Using Futuristic Scenarios to Explore Allied Health Deans' Perspectives on Clinical Education.

PubMed

Romig, Barbara D; Tucker, Ann W; Hewitt, Anne M; O'Sullivan Maillet, Julie

2017-01-01

There is limited information and consensus on the future of clinical education. The Delphi technique was selected to identify agreement among Association of Schools of Allied Health Professions' (ASAHP) allied health deans on the future (2018-2023) of allied health (AH) clinical education. Sixty-one AH deans, 54.9% (61 of 111) of the ASAHP membership, expressed opinions about clinical education through a three-round Delphi study. In conjunction with a conceptual model, four futuristic scenarios were used to encourage deans' feedback on the key factors impacting the future of clinical education. The responses to the four scenarios showed ways the external environment influences which activities the deans recommend. The results presented, by individual scenario and in totality, provide relevant and timely information on the importance and transformation of AH clinical education and its future. Futuristic scenarios, in combination with the Delphi technique, generated information where little exists specific to AH deans' perspectives on AH clinical education. The results offer deans opportunities for future strategic improvements. The use of the futuristic scenarios was suitable for guiding deans' responses and reaching agreement on the future of AH clinical education. These contributions reflect the imminent conditions and healthcare environment identified in the various scenarios and provide additional insight on key factors impacting the future for AH clinical education.

Identifying factors for optimal development of health-related websites: a delphi study among experts and potential future users.

PubMed

Schneider, Francine; van Osch, Liesbeth; de Vries, Hein

2012-02-14

The Internet has become a popular medium for offering tailored and targeted health promotion programs to the general public. However, suboptimal levels of program use in the target population limit the public health impact of these programs. Optimizing program development is considered as one of the main processes to increase usage rates. To distinguish factors potentially related to optimal development of health-related websites by involving both experts and potential users. By considering and incorporating the opinions of experts and potential users in the development process, involvement in the program is expected to increase, consequently resulting in increased appreciation, lower levels of attrition, and higher levels of sustained use. We conducted a systematic three-round Delphi study through the Internet. Both national and international experts (from the fields of health promotion, health psychology, e-communication, and technical Web design) and potential users were invited via email to participate. During this study an extensive list of factors potentially related to optimal development of health-related websites was identified, by focusing on factors related to layout, general and risk information provision, questionnaire use, additional services, and ease of use. Furthermore, we assessed the extent to which experts and potential users agreed on the importance of these factors. Differences as well as similarities among experts and potentials users were deduced. In total, 20 of 62 contacted experts participated in the first round (32% response rate); 60 of 200 contacted experts (30% response rate) and 210 potential users (95% response rate) completed the second-round questionnaire, and 32 of 60 contacted experts completed the third round (53% response rate). Results revealed important factors consented upon by experts and potential users (eg, ease of use, clear structure, and detailed health information provision), as well as differences regarding important factors consented upon by experts (eg, visual aids, self-monitoring tool, and iterative health feedback) or by potential users only (eg, bread crumb navigation and prevention of receiving spam). This study is an important first step in determining the agreed-upon factors that should be taken into account when developing online health promotion programs. The public health impact of these programs will be improved by optimizing the development process in line with these factors.

Identifying criteria for the assessment of pharmacy students' communication skills with patients.

PubMed

Mackellar, Adele; Ashcroft, Darren M; Bell, Dawn; James, Delyth Higman; Marriott, John

2007-06-15

To identify criteria by which patients can assess the communication skills of pharmacy students. Potential assessment criteria were generated from 2 main sources: a literature review and a focus group discussion. A modified two-round Delphi survey was subsequently conducted with 35 professionals who were actively involved in teaching and assessing communication skills of pharmacy students to determine the importance and reliability of each criterion. Consensus ratings identified 7 criteria that were important measures of pharmacy students' communication skills and could be reliably assessed by patients. A modified two-round Delphi consultation survey successfully identified criteria that can be used by patients to assess the communication skills of pharmacy undergraduates. Future work will examine the feasibility of using patients as assessors of communication skills of pharmacy students, preregistration pharmacists, and qualified pharmacists.

Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study.

PubMed

de Leeuw, Robert Adrianus; Walsh, Kieran; Westerman, Michiel; Scheele, Fedde

2018-04-26

The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. ©Robert Adrianus de Leeuw, Kieran Walsh, Michiel Westerman, Fedde Scheele. Originally published in JMIR Medical Education (http://mededu.jmir.org), 26.04.2018.

Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel

PubMed Central

Boulkedid, Rym; Sibony, Olivier; Goffinet, François; Fauconnier, Arnaud; Branger, Bernard; Alberti, Corinne

2013-01-01

Objective Measuring the quality of inpatient obstetrical care using quality indicators is becoming increasingly important for both patients and healthcare providers. However, there is no consensus about which measures are optimal. We describe a modified Delphi method to identify a set of indicators for continuously monitoring the quality of maternity care by healthcare professionals. Methodology and Main Findings An international French-speaking multidisciplinary panel comprising 22 obstetricians-gynaecologists, 12 midwives, and 1 paediatrician assessed potential indicators extracted from a medical literature search, using a two-round Delphi procedure followed by a physical meeting. Each panellist rated each indicator based on validity and feasibility. In the first round, 35 panellists from 5 countries and 20 maternity units evaluated 26 indicators including 15 related to the management of the overall population of pregnant women, 3 to the management of women followed from the first trimester of pregnancy, 2 to the management of low-risk pregnant women, and 6 to the management of neonates. 25 quality indicators were kept for next step. In the second round, 27 (27/35: 77%) panellists selected 17 indicators; the remaining 8 indicators were discussed during a physical meeting. The final set comprised 18 indicators. Conclusion A multidisciplinary panel selected indicators that reflect the quality of obstetrical care. This set of indicators could be used to assess and monitor obstetrical care, with the goal of improving the quality of care in maternity units. PMID:23577143

[Competency requirements for executives in healthcare and social services organizations: Results of a Delphi study].

PubMed

Pielach, Martin; Schubert, Hans-Joachim

2018-02-07

Leadership in social services and healthcare organizations is marked by high levels of complexity and contradiction, which cannot be fully explained by politically, economically, and socially induced changes. Rather, it is the particularities of service provision in healthcare and social services that confront executives with specific demands. This study aimed to capture and prioritize required leadership competencies in healthcare and social services organizations. A three-step Delphi study was conducted with executives and managerial staff, who are job holders and thus experts on their occupation. For the first step, an explorative qualitative approach was chosen to record general opinion without prior assumptions. The following two steps weighted and selected the competency requirements in step one using rating- and ranking procedures. Results of the Delphi inquiry imply high relevance of social and personal competencies. Approximately 66 % of the competencies assessed in round three were social and personal competencies. 12 out of the 15 highest rated competencies in Delphi step three can be assigned to these two competency categories. In contrast, the importance of professional as well as methodical competencies was rated as less important. Only two methodical competencies and one professional competency were rated as very important by the panel. Nevertheless, the importance of executive professional and methodical competencies in healthcare and social services organizations is emphasized by high ratings of the competencies "Sector-specific expertise" and "Analytical skills". The methodical competency "Analytical skills" was identified by the Delphi respondents as the most important competency requirement. Social and personal requirements are of primary importance for leadership in healthcare and social services organizations. These results mostly correspond to leadership requirements posited in the literature on leadership skills. Emphasis should be on the specific relevance of professionalism, which can be traced back to the high proportion of professional activities in everyday working practices, the self-conception of executive staff based on professional qualifications and profession as well as the organizational form as expert organization. Healthcare and social services organizations are expert organizations with a strong emphasis on professional expertise. Professional knowledge is the most important means of production of expert organizations and imperative to leadership in healthcare and social services organization, given the high integration of executives into the professional system. Despite the dominance of social and personal competency requirements, the most important competency requirement is "Analytical skills", which can be described as the basis of every action. Copyright © 2018. Published by Elsevier GmbH.

Phase 2 of CATALISE: a multinational and multidisciplinary Delphi consensus study of problems with language development: Terminology.

PubMed

Bishop, Dorothy V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2017-10-01

Lack of agreement about criteria and terminology for children's language problems affects access to services as well as hindering research and practice. We report the second phase of a study using an online Delphi method to address these issues. In the first phase, we focused on criteria for language disorder. Here we consider terminology. The Delphi method is an iterative process in which an initial set of statements is rated by a panel of experts, who then have the opportunity to view anonymised ratings from other panel members. On this basis they can either revise their views or make a case for their position. The statements are then revised based on panel feedback, and again rated by and commented on by the panel. In this study, feedback from a second round was used to prepare a final set of statements in narrative form. The panel included 57 individuals representing a range of professions and nationalities. We achieved at least 78% agreement for 19 of 21 statements within two rounds of ratings. These were collapsed into 12 statements for the final consensus reported here. The term 'Language Disorder' is recommended to refer to a profile of difficulties that causes functional impairment in everyday life and is associated with poor prognosis. The term, 'Developmental Language Disorder' (DLD) was endorsed for use when the language disorder was not associated with a known biomedical aetiology. It was also agreed that (a) presence of risk factors (neurobiological or environmental) does not preclude a diagnosis of DLD, (b) DLD can co-occur with other neurodevelopmental disorders (e.g. ADHD) and (c) DLD does not require a mismatch between verbal and nonverbal ability. This Delphi exercise highlights reasons for disagreements about terminology for language disorders and proposes standard definitions and nomenclature. © 2017 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

Determinants of innovation within health care organizations: literature review and Delphi study.

PubMed

Fleuren, Margot; Wiefferink, Karin; Paulussen, Theo

2004-04-01

When introducing innovations to health care, it is important to gain insight into determinants that may facilitate or impede the introduction, in order to design an appropriate strategy for introducing the innovation. To obtain an overview of determinants of innovations in health care organizations, we carried out a literature review and a Delphi study. The Delphi study was intended to achieve consensus among a group of implementation experts on determinants identified from the literature review. We searched 11 databases for articles published between 1990 and 2000. The keywords varied according to the specific database. We also searched for free text. Forty-four implementation experts (implementation researchers, programme managers, and implementation consultants/advisors) participated in the Delphi study. The following studies were selected: (i) studies describing innovation processes, and determinants thereof, in health care organizations; (ii) studies where the aim of the innovations was to change the behaviour of health professionals; (iii) studies where the health care organizations provided direct patient care; and (iv) studies where only empirical studies were included. Two researchers independently selected the abstracts and analysed the articles. The determinants were divided into four categories: characteristics of the environment, characteristics of the organization, characteristics of the user (health professional), and characteristics of the innovation. When analysing the determinants, a distinction was made between systematically designed and non-systematically designed studies. In a systematic study, a determinant analysis was performed and the innovation strategy was adapted to these determinants. Furthermore, the determinants were associated with the degree of implementation, and both users and non-users of the innovation were asked about possible determinants. In the Delphi study, consensus was defined as agreement among 75% of the experts on both the influence of a determinant and the direction towards which that influence tended (i.e. facilitating, impeding, or neutral). From the initial 2239 abstracts, 57 studies were retrieved and 49 determinants were identified that affected (impeded or facilitated) the innovation process. The experts identified one other determinant. Seventeen studies had a more-or-less systematic design; the others did not. After three rounds, consensus was reached on the influence of 49 out of 50 determinants. The results of the literature review matched those found in the Delphi study, and 50 potentially relevant determinants of innovation processes were identified. Many of the innovation studies had several methodological flaws, such as not adjusting innovation strategies to relevant determinants of the innovation process, or that data on determinants were gathered only from non-users. Furthermore, the degree of implementation was evaluated in several ways, which made comparison difficult.

Developing a clinical pathway for the identification and management of anxiety and depression in adult cancer patients: an online Delphi consensus process.

PubMed

Shaw, Joanne M; Price, Melanie A; Clayton, Josephine M; Grimison, Peter; Shaw, Tim; Rankin, Nicole; Butow, Phyllis N

2016-01-01

People with cancer and their families experience high levels of psychological morbidity. However, many cancer services do not routinely screen patients for anxiety and depression, and there are no standardized clinical referral pathways. This study aimed to establish consensus on elements of a draft clinical pathway tailored to the Australian context. A two-round Delphi study was conducted to gain consensus among Australian oncology and psycho-oncology clinicians about the validity of 39 items that form the basis of a clinical pathway that includes screening, assessment, referral and stepped care management of anxiety and depression in the context of cancer. The expert panel comprised 87 multidisciplinary clinician members of the Australian Psycho-oncology Co-operative Research Group (PoCoG). Respondents rated their level of agreement with each statement on a 5-point Likert scale. Consensus was defined as >80% of respondents scoring within 2 points on the Likert scale. Consensus was reached for 21 of 39 items, and a further 15 items approached consensus except for specific contextual factors, after two Delphi rounds. Formal screening for anxiety and depression, a stepped care model of management and recommendations for inclusion of length of treatment and time to review were endorsed. Consensus was not reached on items related to roles and responsibilities, particularly those not applicable across cancer settings. This study identified a core set of evidence- and consensus-based principles considered essential to a stepped care model of care incorporating identification, referral and management of anxiety and depression in adult cancer patients.

A process for developing standards to promote quality in general practice.

PubMed

Khoury, Julie; Krejany, Catherine J; Versteeg, Roald W; Lodewyckx, Michaela A; Pike, Simone R; Civil, Michael S; Jiwa, Moyez

2018-06-02

Since 1991, the Royal Australian College of General Practitioners' (RACGP) Standards for General Practices (the Standards) have provided a framework for quality care, risk management and best practice in the operation of Australian general practices. The Standards are also linked to incentives for general practice remuneration. These Standards were revised in 2017. The objective of this study is to describe the process undertaken to develop the fifth edition Standards published in 2017 to inform future standards development both nationally and internationally. A modified Delphi process was deployed to develop the fifth edition Standards. Development was directed by the RACGP and led by an expert panel of GPs and representatives of stakeholder groups who were assisted and facilitated by a team from RACGP. Each draft was released for stakeholder feedback and tested twice before the final version was submitted for approval by the RACGP board. Four rounds of consultation and two rounds of piloting were carried out over 32 months. The Standards were redrafted after each round. One hundred and fifty-two individuals and 225 stakeholder groups participated in the development of the Standards. Twenty-three new indicators were recommended and grouped into three sections in a new modular structure that was different from the previous edition. The Standards represent the consensus view of national stakeholders on the indicators of quality and safety in Australian general practice and primary care.

Validation of the tool assessment of clinical education (AssCE): A study using Delphi method and clinical experts.

PubMed

Löfmark, Anna; Mårtensson, Gunilla

2017-03-01

The aim of the present study was to establish the validity of the tool Assessment of Clinical Education (AssCE). The tool is widely used in Sweden and some Nordic countries for assessing nursing students' performance in clinical education. It is important that the tools in use be subjected to regular audit and critical reviews. The validation process, performed in two stages, was concluded with a high level of congruence. In the first stage, Delphi technique was used to elaborate the AssCE tool using a group of 35 clinical nurse lecturers. After three rounds, we reached consensus. In the second stage, a group of 46 clinical nurse lecturers representing 12 universities in Sweden and Norway audited the revised version of the AssCE in relation to learning outcomes from the last clinical course at their respective institutions. Validation of the revised AssCE was established with high congruence between the factors in the AssCE and examined learning outcomes. The revised AssCE tool seems to meet its objective to be a validated assessment tool for use in clinical nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Future of Clinical Education: Opportunities and Challenges from Allied Health Deans' Perspective.

PubMed

Romig, Barbara D; Tucker, Ann W; Hewitt, Anne M; O'Sullivan Maillet, Julie

2017-01-01

There is limited information and consensus on the future of clinical education and the key factors impacting allied health (AH) clinical training. AH deans identified both opportunities and challenges impacting clinical education based on a proposed educational model. From July 2013 to March 2014, 61 deans whose institutions were 2013 members of the Association of Schools of Allied Health Professions (ASAHP) participated in a three-round Delphi survey. Agreement on the relative importance of and the ability to impact the key factors was analyzed. Impact was evaluated for three groups: individual, collective, and both individual and collective deans. AH deans' responses were summarized and refined; individual items were accepted or rerated until agreement was achieved or study conclusion. Based on the deans' ratings of importance and impact, 159 key factors within 13 clinical education categories emerged as important for the future of clinical education. Agreement was achieved on 107 opportunities and 52 challenges. The Delphi technique generated new information where little existed specific to AH deans' perspectives on AH clinical education. This research supports the Key Factors Impacting Allied Health Clinical Education conceptual model proposed earlier and provides a foundation for AH deans to evaluate opportunities and challenges impacting AH clinical education and to design action plans based on this research.

Components of a Measure to Describe Organizational Culture in Academic Pharmacy

PubMed Central

Rosenthal, Meagen; Holmes, Erin R.; Andrews, Brienna; Lui, Julia; Raja, Leela

2017-01-01

Objective. To develop a measure of organizational culture in academic pharmacy and identify characteristics of an academic pharmacy program that would be impactful for internal (eg, students, employees) and external (eg, preceptors, practitioners) clients of the program. Methods. A three-round Delphi procedure of 24 panelists from pharmacy schools in the U.S. and Canada generated items based on the Organizational Culture Profile (OCP), which were then evaluated and refined for inclusion in subsequent rounds. Items were assessed for appropriateness and impact. Results. The panel produced 35 items across six domains that measured organizational culture in academic pharmacy: competitiveness, performance orientation, social responsibility, innovation, emphasis on collegial support, and stability. Conclusion. The items generated require testing for validation and reliability in a large sample to finalize this measure of organizational culture. PMID:29367768

From control to causation: Validating a 'complex systems model' of running-related injury development and prevention.

PubMed

Hulme, A; Salmon, P M; Nielsen, R O; Read, G J M; Finch, C F

2017-11-01

There is a need for an ecological and complex systems approach for better understanding the development and prevention of running-related injury (RRI). In a previous article, we proposed a prototype model of the Australian recreational distance running system which was based on the Systems Theoretic Accident Mapping and Processes (STAMP) method. That model included the influence of political, organisational, managerial, and sociocultural determinants alongside individual-level factors in relation to RRI development. The purpose of this study was to validate that prototype model by drawing on the expertise of both systems thinking and distance running experts. This study used a modified Delphi technique involving a series of online surveys (December 2016- March 2017). The initial survey was divided into four sections containing a total of seven questions pertaining to different features associated with the prototype model. Consensus in opinion about the validity of the prototype model was reached when the number of experts who agreed or disagreed with survey statement was ≥75% of the total number of respondents. A total of two Delphi rounds was needed to validate the prototype model. Out of a total of 51 experts who were initially contacted, 50.9% (n = 26) completed the first round of the Delphi, and 92.3% (n = 24) of those in the first round participated in the second. Most of the 24 full participants considered themselves to be a running expert (66.7%), and approximately a third indicated their expertise as a systems thinker (33.3%). After the second round, 91.7% of the experts agreed that the prototype model was a valid description of the Australian distance running system. This is the first study to formally examine the development and prevention of RRI from an ecological and complex systems perspective. The validated model of the Australian distance running system facilitates theoretical advancement in terms of identifying practical system-wide opportunities for the implementation of sustainable RRI prevention interventions. This 'big picture' perspective represents the first step required when thinking about the range of contributory causal factors that affect other system elements, as well as runners' behaviours in relation to RRI risk. Copyright © 2017 Elsevier Ltd. All rights reserved.

Development of an Index of Engagement in HIV Care: An Adapted Internet-Based Delphi Process

PubMed Central

Koester, Kimberly A; Wood, Troy; Neilands, Torsten B; Pomeranz, Jamie L; Christopoulos, Katerina A

2017-01-01

Background Improving engagement in medical care among persons living with human immunodeficiency virus (HIV) is critical to optimizing clinical outcomes and reducing onward transmission of HIV. However, a clear conceptualization of what it means to be engaged in HIV care is lacking, and thus efforts to measure and enhance engagement in care are limited. Objective This paper describes the use of a modified online Delphi process of consensus building to solicit input from a range of HIV and non-HIV researchers and providers, and to integrate that input with focus group data conducted with HIV-infected patients. The overarching goal was to generate items for a patient-centered measure of engagement in HIV care for use in future research and clinical practice. Methods We recruited 66 expert panelists from around the United States. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. Results We recruited 66 expert panelists from around the United States and 64 (97%) were retained for four rounds of data collection. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. The process resulted in an expansion to 120 topics that were subsequently reduced to 13 candidate items for the planned assessment measure. Conclusions The process was an efficient method of soliciting input from geographically separated and busy experts across a range of disciplines and professional roles with the aim of arriving at a coherent definition of engagement in HIV care and a manageable set of survey items to assess it. Next steps are to validate the utility of the new measure in predicting retention in care, adherence to treatment, and clinical outcomes among patients living with HIV. PMID:29208589

TREatment of ATopic eczema (TREAT) Registry Taskforce: An international Delphi exercise to identify a core set of domains and domain items for national atopic eczema photo- and systemic therapy registries.

PubMed

Gerbens, L A A; Apfelbacher, C J; Irvine, A D; Barbarot, S; de Booij, R J; Boyce, A E; Deleuran, M; Eichenfield, L F; Hof, M H; Middelkamp-Hup, M A; Roberts, A; Schmitt, J; Vestergaard, C; Wall, D; Weidinger, S; Williamson, P R; Flohr, C; Spuls, P I

2018-05-15

Evidence of immunomodulatory therapies to guide clinical management for atopic eczema (AE) is scarce, despite frequent and often off-label use. Patient registries provide valuable evidence for the effects of treatments under real world conditions which can inform treatment guidelines, give the opportunity for health economic evaluation and the evaluation of quality of care, as well as pharmacogenetic and -dynamic research which cannot be adequately addressed in clinical trials. The TREatment of ATopic eczema (TREAT) Registry Taskforce aims to seek international consensus on a core set of domains and items ('what to measure') for AE research registries, using a Delphi approach. Participants from six stakeholder groups were included: doctors, nurses, non-clinical researchers, patients, industry and regulatory body representatives. The eDelphi comprised 3 sequential online rounds, requesting participants to rate the importance of each proposed domain item. Participants could add domain items to the proposed list in round 1. A final consensus meeting was held to ratify the core set. 479 participants from 36 countries accessed the eDelphi platform, of whom 86%, 79% and 74% completed rounds 1, 2, and 3 respectively. At the face-to-face consensus meeting attended by 42 participants the final core set was established containing 19 domains with 69 domain items (49 baseline and 20 follow-up items). This core set of domains and items to be captured by national AE systemic therapy registries will standardise data collection and thereby allow direct comparability across registries and facilitate data pooling between countries. Ultimately, it will provide greater insight into the effectiveness, safety and cost-effectiveness of photo- and systemic immunomodulatory therapies. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

An international survey and modified Delphi process revealed editors’ perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals

PubMed Central

Galipeau, James; Cobey, Kelly D.; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants’ list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 “highly rated” competency-related statements and another 86 “included” items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future. PMID:28979768

An international survey and modified Delphi process revealed editors' perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals.

PubMed

Galipeau, James; Cobey, Kelly D; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants' list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 "highly rated" competency-related statements and another 86 "included" items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future.

Development of a Chinese medicine assessment measure: an interdisciplinary approach using the delphi method.

PubMed

Schnyer, Rosa N; Conboy, Lisa A; Jacobson, Eric; McKnight, Patrick; Goddard, Thomas; Moscatelli, Francesca; Legedza, Anna T R; Kerr, Catherine; Kaptchuk, Ted J; Wayne, Peter M

2005-12-01

The diagnostic framework and clinical reasoning process in Chinese medicine emphasizes the contextual and qualitative nature of a patient's illness. Chinese medicine assessment data may help interpret clinical outcomes. As part of a study aimed at assessing the validity and improving the inter-rater reliability of the Chinese diagnostic process, a structured assessment instrument was developed for use in clinical trials of acupuncture and other Chinese medical therapies. To foster collaboration and maximize resources and information, an interdisciplinary advisory team was assembled. Under the guidance of two group process facilitators, and in order to establish whether the assessment instrument was consistent with accepted Chinese medicine diagnostic categories (face validity) and included the full range of each concept's meaning (content validity), a panel of Traditional Chinese Medicine (TCM) expert clinicians was convened and their responses were organized using the Delphi process, an iterative, anonymous, idea-generating and consensus-building process. An aggregate rating measure was obtained by taking the mean of mean ratings for each question across all 10 experts. Over three rounds, the overall rating increased from 7.4 (SD = 1.3) in Round 1 to 9.1 (SD = 0.5) in Round 3. The level of agreement among clinicians was measured by a decrease in SD. The final instrument TEAMSI-TCM (Traditional East Asian Medicine Structured Interview, TCM version) uses the pattern differentiation model characteristic of TCM. This modular, dynamic version was specifically designed to assess women, with a focus on gynecologic conditions; with modifications it can be adapted for use with other populations and conditions. TEAMSI-TCM is a prescriptive instrument that guides clinicians to use the proper indicators, combine them in a systematic manner, and generate conclusions. In conjunction with treatment manualization and training it may serve to increase inter-rater reliability and inter-trial reproducibility in Chinese medicine clinical trials. Testing of the validity and reliability of this instrument currently is underway.

What Is Standard Care for People with Learning Disabilities and Behaviour That Challenges and What Does It Cost?

ERIC Educational Resources Information Center

Iemmi, Valentina; Knapp, Martin; Gore, Nick; Cooper, Vivien; Brown, Freddy Jackson; Reid, Caroline; Saville, Maria

2016-01-01

Background: We describe current care arrangements in England for children, young people and adults with learning disabilities and behaviour that challenges, and estimate their comparative costs. Materials and Methods: A two-round Delphi exercise was performed in March and April 2014, followed by a costing exercise. Results: The study finds a mixed…

Development of guidelines for tertiary education institutions to assist them in supporting students with a mental illness: a Delphi consensus study with Australian professionals and consumers.

PubMed

Reavley, Nicola J; Ross, Anna M; Killackey, Eoin; Jorm, Anthony F

2013-01-01

Background. The age at which most young people are in tertiary education is also the age of peak onset for mental illness. Because mental health problems can have adverse effects on students' academic performance and welfare, institutions require guidance how they can best provide support. However, the scientific evidence for how best to do this is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods. A systematic review of websites, books and journal articles was conducted to develop a 172 item survey containing strategies that institutions might use to support students with a mental illness. Two panels of Australian experts (74 professionals and 35 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results. The overall response rate across three rounds was 83% (80% consumers, 85% professionals). 155 strategies were endorsed as essential or important by at least 80% of panel members. The endorsed strategies provided information on policy, measures to promote support services, service provision, accessibility of support services, relationships between services, other types of support and issues associated with reasonable adjustments. They also provided guidance on the procedures the institutions should have for making staff aware of issues associated with mental illness, mental illness training, support for staff and communicating with a student with a mental illness. They also covered student rights and responsibilities, the procedures the institutions should have for making students aware of issues associated with mental illness, dealing with mental health crises, funding and research and evaluation. Conclusions. The guidelines provide guidance for tertiary institutions to assist them in supporting students with a mental illness. It is hoped that they may be used to inform policy and practice in tertiary institutions.

Development of guidelines for tertiary education institutions to assist them in supporting students with a mental illness: a Delphi consensus study with Australian professionals and consumers

PubMed Central

Ross, Anna M.; Killackey, Eoin; Jorm, Anthony F.

2013-01-01

Background. The age at which most young people are in tertiary education is also the age of peak onset for mental illness. Because mental health problems can have adverse effects on students’ academic performance and welfare, institutions require guidance how they can best provide support. However, the scientific evidence for how best to do this is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods. A systematic review of websites, books and journal articles was conducted to develop a 172 item survey containing strategies that institutions might use to support students with a mental illness. Two panels of Australian experts (74 professionals and 35 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results. The overall response rate across three rounds was 83% (80% consumers, 85% professionals). 155 strategies were endorsed as essential or important by at least 80% of panel members. The endorsed strategies provided information on policy, measures to promote support services, service provision, accessibility of support services, relationships between services, other types of support and issues associated with reasonable adjustments. They also provided guidance on the procedures the institutions should have for making staff aware of issues associated with mental illness, mental illness training, support for staff and communicating with a student with a mental illness. They also covered student rights and responsibilities, the procedures the institutions should have for making students aware of issues associated with mental illness, dealing with mental health crises, funding and research and evaluation. Conclusions. The guidelines provide guidance for tertiary institutions to assist them in supporting students with a mental illness. It is hoped that they may be used to inform policy and practice in tertiary institutions. PMID:23638380

Establishing cross-discipline consensus on contraception, pregnancy and breast feeding-related educational messages and clinical practices to support women with rheumatoid arthritis: an Australian Delphi study

PubMed Central

Jordan, Joanne E; Ackerman, Ilana N; Van Doornum, Sharon

2016-01-01

Objective Recognising the need for a best-practice and consistent approach in providing care to women with rheumatoid arthritis (RA) in relation to (1) general health, (2) contraception, (3) conception and pregnancy, (4) breast feeding and (5) early parenting, we sought to achieve cross-discipline, clinical consensus on key messages and clinical practice behaviours in these 5 areas. Design 3-round eDelphi study. In round 1, panellists provided free-text responses to open-ended questions about care for women with RA across the 5 areas. Subsequently, panellists refined and scored the synthesised responses, presented as metathemes, themes and detailed elements. Where ≥5% of panellists did not support a theme in a given round, it was removed. Setting Panel of practicing Australian rheumatologists (n=22), obstetricians/obstetric medicine physicians (n=9) and pharmacists (n=5). Results 34 (94.4%) panellists participated in all 3 rounds. The panel supported 18 themes across the 5 areas (support/strongly support: 88.2–100%) underpinned by 5 metathemes. Metathemes focused on coordination in information delivery, the mode and timing of information delivery, evidence underpinning information, engagement of the right health professionals at the right time and a non-judgemental approach to infant feeding. Themes included practices for primary prevention of chronic disease and their sequelae, the importance of contraception and planning pregnancy and breast feeding, close monitoring of medications, supporting mental well-being, managing disease activity and providing practical support for early parenting. Conclusions A cross-disciplinary clinical panel highly supported key information and clinical practices in the care for women with RA across the continuum of contraception to early parenting within a whole-person, chronic disease management approach. PMID:27633637

Expectations of clinical teachers and faculty regarding development of the CanMEDS-Family Medicine competencies: Laval developmental benchmarks scale for family medicine residency training.

PubMed

Lacasse, Miriam; Théorêt, Johanne; Tessier, Sylvie; Arsenault, Louise

2014-01-01

The CanMEDS-Family Medicine (CanMEDS-FM) framework defines the expected terminal enabling competencies (EC) for family medicine (FM) residency training in Canada. However, benchmarks throughout the 2-year program are not yet defined. This study aimed to identify expected time frames for achievement of the CanMEDS-FM competencies during FM residency training and create a developmental benchmarks scale for family medicine residency training. This 2011-2012 study followed a Delphi methodology. Selected faculty and clinical teachers identified, via questionnaire, the expected time of EC achievement from beginning of residency to one year in practice (0, 6, 12, […] 36 months). The 15-85th percentile intervals became the expected competency achievement interval. Content validity of the obtained benchmarks was assessed through a second Delphi round. The 1st and 2nd rounds were completed by 33 and 27 respondents, respectively. A developmental benchmarks scale was designed after the 1st round to illustrate expectations regarding achievement of each EC. The 2nd round (content validation) led to minor adjustments (1.9±2.7 months) of intervals for 44 of the 92 competencies, the others remaining unchanged. The Laval Developmental Benchmarks Scale for Family Medicine clarifies expectations regarding achievement of competencies throughout FM training. In a competency-based education system this now allows identification and management of outlying residents, both those excelling and needing remediation. Further research should focus on assessment of the scale reliability after pilot implementation in family medicine clinical teaching units at Laval University, and corroborate the established timeline in other sites.

Establishing Priorities for Oncology Nursing Research: Nurse and Patient Collaboration.

PubMed

Cox, Anna; Arber, Anne; Gallagher, Ann; MacKenzie, Mairead; Ream, Emma

2017-03-01

To obtain consensus on priorities for oncology nursing research in the United Kingdom.
. A three-round online Delphi survey.
. Oncology nurses were invited via the United Kingdom Oncology Nursing Society (UKONS) database. Patient participation was invited through patient organizations.
. 50 oncology nurses and 18 patients.
. Eligible and consenting individuals reported five priorities for oncology nursing research (round 1), rated their level of agreement with them (round 2), and restated and revised their responses in light of the group's responses (round 3). Consensus was defined as 80% agreement.
. Research priorities for oncology nursing as reported by oncology nurses and patients. 
. Consensus was reached on 50 of 107 research priorities. These priorities reflected the entire cancer pathway, from diagnosis to palliative care. Highest agreement was reached within and across groups on the need for research relating to prevention, screening, early diagnosis, and psychological care across the cancer trajectory. Little consensus was reached regarding symptoms and side effects. Some evident divergence existed. Oncology nurses and patients do not necessarily prioritize the same research areas. Prevention, screening, and early diagnosis are of the highest priority for future research among oncology nurses and patients. 
. Patients usually play little part in priority setting for research. This study provided the opportunity for meaningful patient and nurse involvement in setting a research agenda for oncology nursing that is relevant and beneficial to oncology nurses and patients.

Content Validity of a Psychotherapeutic Intervention Model in Nursing: A Modified e-Delphi Study.

PubMed

Sampaio, Francisco Miguel Correia; Sequeira, Carlos; Lluch Canut, Teresa

2017-04-01

To estimate the content validity of a psychotherapeutic intervention model in nursing. Mental health nurses encounter great extrinsic difficulties when it comes to providing psychotherapeutic interventions due to the fact that they are not allowed to perform such practice in some countries. In this light, the pursuit of a psychotherapeutic intervention model in nursing seems germane to guide the professionals' psychotherapeutic practice, contributing hereof to increase mental health nurses' professional autonomy. Modified e-Delphi. Data were collected from October 2015 to January 2016 by means of three rounds of online questionnaires. The initial questionnaire was structured into five sections: general structure of the model, patients' exclusion criteria, assessment framework, nursing diagnoses, and nursing psychotherapeutic interventions. From the 42 experts invited, at least twenty (20) participated in each round. The experts achieved consensus with regard to the conclusion that nursing psychotherapeutic interventions should always seek to address a nursing diagnosis. These defined furthermore that a psychotherapeutic intervention model in nursing should be exercised by means of 3 to 12 sessions using Nursing Interventions Classification (NIC) as a resource. Finally, experts deemed that the model should follow the principles of integrative psychotherapy, so that techniques from different schools of psychotherapy could therefore be used in conjunction to promote the resolution of a nursing diagnosis. Achieving consensus about the structure of a psychotherapeutic intervention model in nursing is imperative to guide nurses in the provision of nursing psychotherapeutic interventions and to enable an effective evaluation of the health gains associated with its implementation. Copyright © 2016 Elsevier Inc. All rights reserved.

Leadership content important in athletic training education with implications for allied health care.

PubMed

Kutz, Matthew R; Scialli, Joan

2008-01-01

A two-phase exploratory and comparative research study using a Delphi technique and a web-based national survey was done to determine leadership content (i.e., theories, styles, or practices) important to include in athletic training education. Eighteen athletic training experts participated in the Delphi technique, followed by 161 athletic trainers completing the national survey. Consensus of experts was reached after two rounds (77% interrater agreement, alpha = 0.80 and alpha = 0.93 per respective round) and identified 31 leadership content items important to include in athletic training education. The national sample then rated importance of each leadership content area for inclusion in four types of athletic training education programs (entry-level baccalaureate, entry-level master's degree, postgraduate certifications, and doctoral degree). The respondents ranked the leadership content in order of importance according to mean (mean = 1.53 +/- 0.84 to 2.55 +/- 0.55; scale, 0-3). Twenty-two content items (63%) were rated at least "very important" (mean > or = 2.0). Exploratory factor analysis established construct validity and organized leadership content by three factors: managerial leadership and knowledge management; leadership theories; and leadership issues, trends, and policies (alpha = 0.84-0.91). Repeated-measures analysis of variance (Sidak post-hoc adjustments) established criterion-related concurrent validity, which found increasing levels of importance as education type progressed (F = 4.88, p = 0.003-32.56, p = 0.000). Adding leadership content within athletic training enhances the professionalization of students, facilitates leadership competency among students and practicing professionals enrolled in postcertification educational programs, and facilitates job placement and role.

Use of a Computer-Mediated Delphi Process to Validate a Mass Casualty Conceptual Model

PubMed Central

CULLEY, JOAN M.

2012-01-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters. PMID:21076283

Use of a computer-mediated Delphi process to validate a mass casualty conceptual model.

PubMed

Culley, Joan M

2011-05-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology

PubMed Central

Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-01-01

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development. PMID:29282445

Bridging the gap between content and context: establishing expert consensus on the content of an exercise training program to prevent lower-limb injuries.

PubMed

Donaldson, Alex; Cook, Jill; Gabbe, Belinda; Lloyd, David G; Young, Warren; Finch, Caroline F

2015-05-01

To achieve expert consensus on the content of an exercise training program (known as FootyFirst) to prevent lower-limb injuries. Three-round online Delphi consultation process. Community Australian Football (AF). Members of the Australian Football Leagues' Medical Officers (n = 94), physiotherapists (n = 50), and Sports Science (n = 19) Associations were invited to participate through e-mail. Five people with more general expertise in sports-related lower-limb injury prevention were also invited to participate. The primary outcome measure was the level of agreement on the appropriateness of the proposed exercises and progressions for inclusion in FootyFirst. Consensus was reached when ≥75% of experts who responded to each item agreed and strongly agreed, or disagreed and strongly disagreed, that an exercise or its progressions were appropriate to include in FootyFirst. Fifty-five experts participated in at least 1 Delphi round. In round 1, consensus was achieved that the proposed warm-up (run through and dynamic stretches) and the exercises and progressions for hamstring strength and for balance, landing, and changing direction were appropriate to include in FootyFirst. There was also consensus in round 1 that progressions for hip/core strength should be included in FootyFirst. Consensus was reached in round 2 that the revised groin strength and hip strength exercises should be included in FootyFirst. Consensus was reached for the progression of the groin strength exercises in round 3. The formal consensus development process has resulted in an evidence-informed, researcher-developed, exercise-based sports injury prevention program that is expert endorsed and specific to the context of AF. Lower-limb injuries are common in running, kicking, and contact sports like AF. These injuries are often costly to treat, and many have high rates of recurrence, making them challenging to treat clinically. Reducing these injuries is a high priority for players, teams, and medical staff. Exercise programs provide a method for primary prevention of lower-limb injuries, but they have to be evidence based, have currency with sports practitioners/clinicians, and utility for the context in which they are to be used. However, the comprehensive methods and clinical engagement processes used to develop injury prevention exercise programs have not previously been described in detail. This study describes the results of engaging clinicians and sport scientists in the development of a lower-limb sports injury prevention program for community AF, enabling the development of a program that is both evidence informed and considerate of expert clinical opinion.

Development of quality indicators for transition from pediatric to adult care in sickle cell disease: A modified Delphi survey of adult providers.

PubMed

Sobota, Amy E; Shah, Nishita; Mack, Jennifer W

2017-06-01

Transition from pediatric to adult care is a vulnerable time for young adults with sickle cell disease (SCD); however, improvements in transition are limited by a lack of quality indicators. The purpose of this study was to establish quality indicators for transition in SCD and to determine the optimal timing between the final pediatric visit and the first adult provider visit. We conducted a modified Delphi survey to reach a consensus on which quality indicators are most important for a successful transition. Our expert panel consisted of members of the Sickle Cell Adult Provider Network. In the first round, the participants ranked a list of quality indicators by importance. In the second round, the participants chose their "top 5" quality indicators in terms of importance and also ranked them on feasibility. The response rates for the two rounds were 68 and 96%, respectively. Nine quality indicators were chosen as "top 5" by a majority of respondents, including communication between pediatric and adult providers, timing of first adult visit, patient self-efficacy, quality of life, and trust with their adult provider. Based on the comments from round 1, respondents were also asked for the optimal timing between leaving pediatric care and entering adult care. Most recommended a first adult visit within 2 months of the final pediatric visit. By using these quality indicators chosen by the majority of respondents, we can better develop and evaluate transition programs for young adults with SCD and improve health outcomes for these vulnerable patients. © 2016 Wiley Periodicals, Inc.

An international Delphi study examining health promotion and health education in nursing practice, education and policy.

PubMed

Whitehead, Dean

2008-04-01

To arrive at an expert consensus in relation to health promotion and health education constructs as they apply to nursing practice, education and policy. Nursing has often been maligned and criticized, both inside and outside of the profession, for its ability to understand and conduct effective health promotion and health education-related activities. In the absence of an expert-based consensus, nurses may find it difficult to progress beyond the current situation. In the absence of any previously published nursing-related consensus research, this study seeks to fill that knowledge-gap. A two-round Delphi technique via email correspondence. A first-round qualitative questionnaire used open-ended questions for defining health promotion and health education. This was both in general terms and as participants believed these concepts related to the clinical, theoretical (academic/educational) and the policy (political) setting in nursing. Line-by-line qualitative content and thematic analysis of the first-round data generated 13 specific categories. These categories contained 134 statement items. The second-round questionnaire comprised the identified 134 statements. Using a five-point Likert scale (ranging from 1 = strongly disagree to 5 = strongly agree) participants scored and rated their level of agreement/disagreement against the listed items. Data from the second-round was descriptively analysed according to distribution and central tendency measures. An expert consensus was reached on 65 of the original 134 statements. While some minor contradiction was demonstrated, strong consensus emerged around the issues of defining health promotion and health education and the emergence of a wider health promotion and health education role for nursing. No consensus was reached on only one of the 13 identified topic categories - that of 'nurses working with other disciplines and agencies in a health education and health promotion role.' This study provides a hitherto previously absent expert consensus on the current position of health promotion and health education, in nursing and predictions for their future course. Its findings represent an important step for nurses as they seek to become increasingly active and influential within wider health promotion and health education arenas. Relevance to clinical practice. Delphi studies do not necessarily offer indisputable fact. This study, however, with its strong consensus on the majority of original statements is a good indicator as to how nursing experts currently view health promotion and health education constructs. Expert consensus offers a useful form of measure against current and future clinical practice and helps to build a firm foundation for change. Nurses, then, are advised here to refer to the findings presented, that they remain contextually and conceptually clear, as they embark on current and future health promotion-related activities.

A Delphi-Based Framework for systems architecting of in-orbit exploration infrastructure for human exploration beyond Low Earth Orbit

NASA Astrophysics Data System (ADS)

Aliakbargolkar, Alessandro; Crawley, Edward F.

2014-01-01

The current debate in the U.S. Human Spaceflight Program focuses on the development of the next generation of man-rated heavy lift launch vehicles. While launch vehicle systems are of critical importance for future exploration, a comprehensive analysis of the entire exploration infrastructure is required to avoid costly pitfalls at early stages of the design process. This paper addresses this need by presenting a Delphi-Based Systems Architecting Framework for integrated architectural analysis of future in-orbit infrastructure for human space exploration beyond Low Earth Orbit. The paper is structured in two parts. The first part consists of an expert elicitation study to identify objectives for the in-space transportation infrastructure. The study was conducted between November 2011 and January 2012 with 15 senior experts involved in human spaceflight in the United States and Europe. The elicitation study included the formation of three expert panels representing exploration, science, and policy stakeholders engaged in a 3-round Delphi study. The rationale behind the Delphi approach, as imported from social science research, is discussed. Finally, a novel version of the Delphi method is presented and applied to technical decision-making and systems architecting in the context of human space exploration. The second part of the paper describes a tradespace exploration study of in-orbit infrastructure coupled with a requirements definition exercise informed by expert elicitation. The uncertainties associated with technical requirements and stakeholder goals are explicitly considered in the analysis. The outcome of the expert elicitation process portrays an integrated view of perceived stakeholder needs within the human spaceflight community. Needs are subsequently converted into requirements and coupled to the system architectures of interest to analyze the correlation between exploration, science, and policy goals. Pareto analysis is used to identify architectures of interest for further consideration by decision-makers. The paper closes with a summary of insights and develops a strategy for evolutionary development of the exploration infrastructure of the incoming decades. The most important result produced by this analysis is the identification of a critical irreducible ambiguity undermining value delivery for the in-space transportation infrastructure of the next three decades: destination choice. Consensus on destination is far from being reached by the community at large, with particular reference to exploration and policy stakeholders. The realization of this ambiguity is a call for NASA to promote an open forum on this topic, and to develop a strong case for policy makers to incentivize investments in the human spaceflight industry in the next decades.

Consensus-based training and assessment model for general surgery.

PubMed

Szasz, P; Louridas, M; de Montbrun, S; Harris, K A; Grantcharov, T P

2016-05-01

Surgical education is becoming competency-based with the implementation of in-training milestones. Training guidelines should reflect these changes and determine the specific procedures for such milestone assessments. This study aimed to develop a consensus view regarding operative procedures and tasks considered appropriate for junior and senior trainees, and the procedures that can be used as technical milestone assessments for trainee progression in general surgery. A Delphi process was followed where questionnaires were distributed to all 17 Canadian general surgery programme directors. Items were ranked on a 5-point Likert scale, with consensus defined as Cronbach's α of at least 0·70. Items rated 4 or above on the 5-point Likert scale by 80 per cent of the programme directors were included in the models. Two Delphi rounds were completed, with 14 programme directors taking part in round one and 11 in round two. The overall consensus was high (Cronbach's α = 0·98). The training model included 101 unique procedures and tasks, 24 specific to junior trainees, 68 specific to senior trainees, and nine appropriate to all. The assessment model included four procedures. A system of operative procedures and tasks for junior- and senior-level trainees has been developed along with an assessment model for trainee progression. These can be used as milestones in competency-based assessments. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Guiding Principles for Student Leadership Development in the Doctor of Pharmacy Program to Assist Administrators and Faculty Members in Implementing or Refining Curricula

PubMed Central

Boyle, Cynthia J.; Janke, Kristin K.

2013-01-01

Objective. To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Results. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Conclusions. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought. PMID:24371345

Guiding principles for student leadership development in the doctor of pharmacy program to assist administrators and faculty members in implementing or refining curricula.

PubMed

Traynor, Andrew P; Boyle, Cynthia J; Janke, Kristin K

2013-12-16

To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought.

Developing standards for an integrated approach to workplace facilitation for interprofessional teams in health and social care contexts: a Delphi study.

PubMed

Martin, Anne; Manley, Kim

2018-01-01

Integration of health and social care forms part of health and social care policy in many countries worldwide in response to changing health and social care needs. The World Health Organization's appeal for systems to manage the global epidemiologic transition advocates for provision of care that crosses boundaries between primary, community, hospital, and social care. However, the focus on structural and process changes has not yielded the full benefit of expected advances in care delivery. Facilitating practice in the workplace is a widely recognised cornerstone for developments in the delivery of health and social care as collaborative and inclusive relationships enable frontline staff to develop effective workplace cultures that influence whether transformational change is achieved and maintained. Workplace facilitation embraces a number of different purposes which may not independently lead to better quality of care or improved patient outcomes. Holistic workplace facilitation of learning, development, and improvement supports the integration remit across health and social care systems and avoids duplication of effort and waste of valuable resources. To date, no standards to guide the quality and effectiveness of integrated facilitation have been published. This study aimed to identify key elements constitute standards for an integrated approach to facilitating work-based learning, development, improvement, inquiry, knowledge translation, and innovation in health and social care contexts using a three rounds Delphi survey of facilitation experts from 10 countries. Consensus about priority elements was determined in the final round, following an iteration process that involved modifications to validate content. The findings helped to identify key qualities and skills facilitators need to support interprofessional teams to flourish and optimise performance. Further research could evaluate the impact of skilled integrated facilitation on health and social care outcomes and the well-being of frontline interprofessional teams.

Development of key indicators of hospital resilience: a modified Delphi study.

PubMed

Zhong, Shuang; Clark, Michele; Hou, Xiang-Yu; Zang, Yuli; FitzGerald, Gerard

2015-04-01

Hospital resilience is an emerging concept, which can be defined as 'a hospital's ability to resist, absorb, and respond to the shock of disasters while maintaining its critical health care functions, and then recover to its original state or adapt to a new one'. Our aim was to develop a comprehensive framework of key indicators of hospital resilience. A panel of 33 Chinese experts was invited to participate in a three-round, modified Delphi study to develop a set of potential measures previously derived from a literature review. In the first round, these potential measures were modified to cover the comprehensive domains of hospital resilience. The importance of proposed measures was scored by experts on a five-point Likert scale. Subsequently, the experts reconsidered their voting in light of the previous aggregated results. Agreement on measures was defined as at least 70% of the responders agreeing or strongly agreeing to the inclusion of a measure. A large proportion of preliminary measures (89.5%) were identified as having good potential for assessing hospital resilience. These measures were categorized into eight domains, 17 subdomains, and 43 indicators. The highest rated indicators (mean score) were: equipment for on-site rescue (4.7), plan initiation (4.6), equipment for referral of patients with complex care needs (4.5), the plan execution (4.4), medication management strategies (4.4), emergency medical treatment conditions (4.4), disaster committee (4.4), stock types and quantities for essential medications (4.4), surge capacity of emergency beds (4.4), and mass-casualty triage protocols (4.4). This framework identifies a comprehensive set of indicators of hospital resilience. It can be used for hospital assessment, as well as informing priority practices to address future disasters better. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Designing a proficiency-based, content validated virtual reality curriculum for laparoscopic colorectal surgery: a Delphi approach.

PubMed

Palter, Vanessa N; Graafland, Maurits; Schijven, Marlies P; Grantcharov, Teodor P

2012-03-01

Although task training on virtual reality (VR) simulators has been shown to transfer to the operating room, to date no VR curricula have been described for advanced laparoscopic procedures. The purpose of this study was to develop a proficiency-based VR technical skills curriculum for laparoscopic colorectal surgery. The Delphi method was used to determine expert consensus on which VR tasks (on the LapSim simulator) are relevant to teaching laparoscopic colorectal surgery. To accomplish this task, 19 international experts rated all the LapSim tasks on a Likert scale (1-5) with respect to the degree to which they thought that a particular task should be included in a final technical skills curriculum. Results of the survey were sent back to participants until consensus (Cronbach's α >0.8) was reached. A cross-sectional design was utilized to define the benchmark scores for the identified tasks. Nine expert surgeons completed all identified tasks on the "easy," "medium," and "hard" settings of the simulator. In the first round of the survey, Cronbach's α was 0.715; after the second round, consensus was reached at 0.865. Consensus was reached for 7 basic tasks and 1 advanced suturing task. Median expert time and economy of movement scores were defined as benchmarks for all curricular tasks. This study used Delphi consensus methodology to create a curriculum for an advanced laparoscopic procedure that is reflective of current clinical practice on an international level and conforms to current educational standards of proficiency-based training. Copyright © 2012 Mosby, Inc. All rights reserved.

Identifying opportunities for nature engagement in cancer care practice and design: protocol for four-round modified electronic Delphi.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-03-08

Opportunities to engage with nature have shown relevance in experiences of health and recovery of patients with cancer and are attracting interest in cancer care practice and design. Such healthcare innovations can widen the horizon of possible supportive care solutions but require deliberate and rigorous investigation to ensure responsible action is taken and wastage avoided. This protocol outlines a study designed to solicit knowledge from relevant experts drawn from a range of healthcare practitioners, management representatives, designers and researchers to explore levels of opinion consensus for determining opportunities for, and barriers to, providing helpful nature engagement in cancer care settings. A 4-round modified electronic Delphi methodology will be used to conduct a structured, iterative feedback process for querying and synthesising expert opinion. Round 1 administers an open-ended questionnaire to a panel of selected, relevant experts who will consider the own recommendations of patients with cancer for nature engagement (drawn from a preceding investigation) before contributing salient issues (items) with relevance to the topic. Round 2 circulates anonymised summaries of responses back to the experts who verify and, if they wish, reconsider their own responses. Rounds 3 and 4 determine and rank experts' top 10 items using a 10-point Likert-type scale. Descriptive statistics (median and mean scores) will be calculated to indicate the items' relative importance. Levels of consensus will be explored with consensus defined as 75% agreement. Ethics approval for this study was obtained from the Institution's Human Research Ethics Committee (blinded for review). It is anticipated that the results will be published in peer-reviewed journals and presented in a variety of forums. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Strategy development for the implementation of telenursing in Korea.

PubMed

Yun, Eun Kyoung; Park, Hyeoun-Ae

2007-01-01

This study aimed to evaluate the feasibility of telenursing, to analyze the issues that should be considered for the development of telenursing in the future, and to provide efficient strategies for the implementation of telenursing in Korea. The authors used the Delphi survey method and a strengths, weaknesses, opportunities, and threats analysis. A total of 30 experts and specialists in the field of nursing informatics and telemedicine contributed to a three-round Delphi survey. The results of the study suggest that telenursing can potentially be implemented in Korea. However, to implement telenursing in Korea, it is necessary to identify telenursing specialties, to construct an infrastructure within which telenursing can function, to develop a business model, and to integrate strategies with government plans to develop the e-health industry. The issues that emerged as important requirements for the successful introduction of telenursing were classified as systematic, economic, societal, or technical. Issues such as driving force, target market, and expense sharing were examined in detail from both ideal and realistic points of view. The results of this study will enable health professionals to appreciate the feasibility of implementing telenursing in Korea. In addition, the study suggests that telenursing could be used efficiently in a variety of environments as a practical strategy to improve healthcare in Korea.

Using a Delphi Technique to Seek Consensus Regarding Definitions, Descriptions and Classification of Terms Related to Implicit and Explicit Forms of Motor Learning

PubMed Central

Kleynen, Melanie; Braun, Susy M.; Bleijlevens, Michel H.; Lexis, Monique A.; Rasquin, Sascha M.; Halfens, Jos; Wilson, Mark R.; Beurskens, Anna J.; Masters, Rich S. W.

2014-01-01

Background Motor learning is central to domains such as sports and rehabilitation; however, often terminologies are insufficiently uniform to allow effective sharing of experience or translation of knowledge. A study using a Delphi technique was conducted to ascertain level of agreement between experts from different motor learning domains (i.e., therapists, coaches, researchers) with respect to definitions and descriptions of a fundamental conceptual distinction within motor learning, namely implicit and explicit motor learning. Methods A Delphi technique was embedded in multiple rounds of a survey designed to collect and aggregate informed opinions of 49 international respondents with expertise related to motor learning. The survey was administered via an online survey program and accompanied by feedback after each round. Consensus was considered to be reached if ≥70% of the experts agreed on a topic. Results Consensus was reached with respect to definitions of implicit and explicit motor learning, and seven common primary intervention strategies were identified in the context of implicit and explicit motor learning. Consensus was not reached with respect to whether the strategies promote implicit or explicit forms of learning. Discussion The definitions and descriptions agreed upon may aid translation and transfer of knowledge between domains in the field of motor learning. Empirical and clinical research is required to confirm the accuracy of the definitions and to explore the feasibility of the strategies that were identified in research, everyday practice and education. PMID:24968228

Attitudes and values expected of public health nursing students at graduation: A delphi study.

PubMed

Okura, Mika; Takizawa, Hiroko

2018-06-01

The skills and knowledge of the competencies expected of public health nursing (PHN) students at graduation have been clarified; however, the attitudes and values have not yet been studied in Japan. The objective of this study was to identify and reach a consensus among experts on the attitudes and values expected of PHN students at graduation. This survey was conducted as a two-stage Delphi study. We selected the following experts: 248 teachers in the faculty of public health nursing at a university as academic experts, and 250 public health nurses who were also experienced clinical instructors as clinical experts. The round 1 mailed survey was conducted using a questionnaire about the necessity and importance of attitudes and values, and 211 experts responded (42.4%, clinical; n = 124, academic; n = 87). In the Round 2 survey, the experts consisted of 60.2% of the round 1 participants (clinical; n = 73, academic; n = 54). Descriptive statistics were used for multiple imputation. We identified a total of 13 attitudes and values expected of PHN students, and reached ≥90% consensus for most items (except for one). Regarding the expected achievement level at graduation, there was no difference between clinical and academic experts except for one item. Consensus was clearly achieved for 13 attitudes and values expected of PHN students, as well as importance and expected achievement level at graduation. In the future, it is important to examine strategies that can effectively develop these attitudes and values through basic and continuous education. Copyright © 2018 Elsevier Ltd. All rights reserved.

An exploration of factors related to dissemination of and exposure to internet-delivered behavior change interventions aimed at adults: a Delphi study approach.

PubMed

Brouwer, Wendy; Oenema, Anke; Crutzen, Rik; de Nooijer, Jascha; de Vries, Nanne K; Brug, Johannes

2008-04-16

The Internet is an attractive medium for delivering individualized, computer-tailored behavior change interventions to large numbers of people. However, the actual numbers of people reached seem to fall behind the high expectations. Insight into factors that determine use of and exposure to these Internet interventions is important to be able to increase the reach and improve exposure. The aim was to identify potentially important factors that determine whether adults visit an Internet-delivered behavior change intervention, extend their visit, and revisit the intervention. A systematic, three-round Delphi study was conducted among national and international experts from Internet intervention research and practice, e-marketing/e-commerce, Web design, and technical website development. In the first round, 30 experts completed a structured, open-ended online questionnaire assessing factors that were, in their opinion, important for a first visit, an extended visit, a revisit and for effective promotion strategies. Based on the responses in this first questionnaire, a closed-ended online questionnaire was developed for use in the second round. A total of 233 experts were invited to complete this questionnaire. Median and interquartile deviation (IQD) scores were computed to calculate agreement and consensus on the importance of the factors. The factors for which no consensus was obtained (IQD > 1) were included in the third-round questionnaire. Factors with a median score of six or higher and with an IQD

An Exploration of Factors Related to Dissemination of and Exposure to Internet-Delivered Behavior Change Interventions Aimed at Adults: A Delphi Study Approach

PubMed Central

Oenema, Anke; Crutzen, Rik; de Nooijer, Jascha; de Vries, Nanne K; Brug, Johannes

2008-01-01

Background The Internet is an attractive medium for delivering individualized, computer-tailored behavior change interventions to large numbers of people. However, the actual numbers of people reached seem to fall behind the high expectations. Insight into factors that determine use of and exposure to these Internet interventions is important to be able to increase the reach and improve exposure. Objective The aim was to identify potentially important factors that determine whether adults visit an Internet-delivered behavior change intervention, extend their visit, and revisit the intervention. Methods A systematic, three-round Delphi study was conducted among national and international experts from Internet intervention research and practice, e-marketing/e-commerce, Web design, and technical website development. In the first round, 30 experts completed a structured, open-ended online questionnaire assessing factors that were, in their opinion, important for a first visit, an extended visit, a revisit and for effective promotion strategies. Based on the responses in this first questionnaire, a closed-ended online questionnaire was developed for use in the second round. A total of 233 experts were invited to complete this questionnaire. Median and interquartile deviation (IQD) scores were computed to calculate agreement and consensus on the importance of the factors. The factors for which no consensus was obtained (IQD > 1) were included in the third-round questionnaire. Factors with a median score of six or higher and with an IQD ≤ 1 were considered to be important. Results Of the 62 experts invited for the first round, 30 completed the questionnaire (48% response rate); 93/233 experts completed the second-round questionnaire (40% response rate), and 59/88 completed the third round (67% response rate). Being motivated to visit an Internet intervention and perceiving the intervention as personally relevant appeared to be important factors related to a first visit. The provision of tailored feedback, relevant and reliable information, and an easy navigation structure were related to an extended visit. Provision of regular new content and the possibility to monitor personal progress toward behavior change were identified as important factors to encourage a revisit. Primarily traditional promotion strategies, like word-of-mouth by family and friends, a publicity campaign with simultaneous use of various mass media, and recommendation by health professionals, were indicated as effective ways to encourage adults to visit an Internet intervention. Conclusions This systematic study identified important factors related to the dissemination of and exposure to Internet interventions aimed at adults. In order to improve optimal use of and exposure to Internet interventions, potential users may need to be motivated to visit such an intervention and the information provided needs to be personally relevant. Furthermore, several (technical) aspects of the intervention itself need to be taken into account when developing Internet interventions. PMID:18417443

Perspectives of academic faculty and clinical instructors on entry-level DPT preparation for pediatric physical therapist practice.

PubMed

Kenyon, Lisa K; Dole, Robin L; Kelly, Stephanie P

2013-12-01

To prepare students for pediatric practice, the professional (entry-level) curriculum must reflect the essential knowledge, skills, and abilities (KSA) required for pediatric physical therapist practice. The aim of this study was to develop consensus concerning the pediatric-specific KSA that should be expected of doctor of physical therapy (DPT) students at various points in the curriculum: prior to a pediatric clinical education experience, after a pediatric clinical education experience, and at the end of a DPT program. The study was conducted using the Delphi method. Purposive and snowball sampling were used to recruit pediatric academic faculty and pediatric clinical instructors. Three Web-based survey rounds were used to achieve consensus, defined as agreement among ≥70% of informants. The first round identified pediatric-specific KSA that were essential for DPT students to demonstrate at the identified points in the curriculum. In the second round, informants indicated their level of agreement with each item identified in the first round. Items that achieved consensus were included in the third round, in which informants rated the level of proficiency that DPT students should demonstrate related to pediatric-specific KSA. Consensus revealed the informants' perspectives concerning pediatric-specific KSA that a DPT student should be able to demonstrate at the identified curricular points. Consensus was reached on items in the curricular categories of basic science and foundations for practice; common pediatric diagnoses/pathologies, examination, interventions/plan of care/documentation; and general skills and abilities. Limitations included the small sample size and the potential for informants to feel uncomfortable prioritizing KSA. This study is an initial step toward identifying pediatric-specific KSA that should be demonstrated by DPT students.

Assessment of chronic post-surgical pain after knee replacement: development of a core outcome set.

PubMed

Wylde, V; MacKichan, F; Bruce, J; Gooberman-Hill, R

2015-05-01

Approximately 20% of patients experience chronic post-surgical pain (CPSP) after total knee replacement (TKR). There is scope to improve assessment of CPSP after TKR, and this study aimed to develop a core outcome set. Eighty patients and 43 clinicians were recruited into a three-round modified Delphi study. In Round 1, participants were presented with 56 pain features identified from a systematic review, structured interviews with patients and focus groups with clinicians. Participants assigned importance ratings, using a 1-9 scale, to individual pain features; those features rated as most important were retained in subsequent rounds. Consensus that a pain feature should be included in the core outcome set was defined as the feature having a rating of 7-9 by ≥70% of both panels (patients and clinicians) and 1-3 by ≤15% of both panels or rated as 7-9 by ≥90% of one panel. Round 1 was completed by 71 patients and 39 clinicians, and Round 3 by 62 patients and 33 clinicians. The final consensus was that 33 pain features were important. These were grouped into an 8-item core outcome set comprising: pain intensity, pain interference with daily living, pain and physical functioning, temporal aspects of pain, pain description, emotional aspects of pain, use of pain medication, and improvement and satisfaction with pain relief. This core outcome set serves to guide assessment of CPSP after TKR. Consistency in assessment can promote standardized reporting and facilitate comparability between studies that address a common but understudied type of CPSP. © 2014 The Authors. European Journal of Pain published by John Wiley & Sons Ltd on behalf of European Pain Federation - EFIC®.

Programme Reporting Standards (PRS) for improving the reporting of sexual, reproductive, maternal, newborn, child and adolescent health programmes.

PubMed

Kågesten, Anna E; Tunçalp, Özge; Portela, Anayda; Ali, Moazzam; Tran, Nhan; Gülmezoglu, A Metin

2017-08-03

Information about design, implementation, monitoring and evaluation is central to understand the impact of programmes within the field of sexual, reproductive, maternal, newborn, child and adolescent health (SRMNCAH). Existing reporting guidelines do not orient on reporting of contextual and implementation issues in sufficient detail. We therefore developed Programme Reporting Standards (PRS) to be used by SRMNCAH programme implementers and researchers. Building on the first step of the PRS development (a systematic review to identify reporting items), we conducted a three-round online Delphi consensus survey with experts. Consensus was defined a-priori as 80% agreement of items as essential. This was followed by a technical consultation with a group of experts to refine the items, definitions and their structuring. The revised PRS was piloted to assess its relevance to current SRMNCAH programme reports and identify key issues regarding the use of the PRS. Of the 81 participants invited to the Delphi survey, 20 responded to all three rounds. In the final round, 27 items received consensus as essential; three items were ranked as "borderline" essential; 20 items as supplementary. The items were subsequently revised, followed by a technical consultation with 29 experts to further review and refine the PRS. The feedback resulted in substantial changes to the structure and content of the PRS into 24 items across five domains: Programme overview; Programme components and implementation; Monitoring of Implementation; Evaluation and Results; and Synthesis. This version was used in a piloting exercise, where questions regarding how much information to report and how to comment on the quality of the information reported were addressed. All items were kept in the PRS following the pilot although minor changes were made to the flow and description of items. The PRS 1.0 is the result of a structured, collaborative process, including methods to incorporate input from SRMNCAH stakeholders. The World Health Organization will develop a document that explains the items in greater detail, and will also apply the PRS to on-going initiatives. We welcome continuous input from the field, while it is being used, to improve its relevance and usefulness.

Development of a scale for the evaluation of patients’ rights prerequisites at educational hospitals in Iran: a study using the Delphi technique

PubMed Central

Aazami, Sanaz; Mozafari, Mosayeb

2015-01-01

The patients’ rights status is one of the essential elements in defining norms related to the concept of clinical governance system. In addition, the patients’ rights status is an important index for quality of care offered in the health care system. However, the lack of a coherent instrument makes it difficult to evaluate patients’ rights status in hospitals and clinics. The aim of this study was to develop an instrument for the evaluation of patients’ rights prerequisites at educational hospitals in Iran. This study was conducted using the modified Delphi technique. In this study, 36 experts in the fields of law, medicine, and professional ethics were participated. The panel of experts participated in 3 rounds. First, experts were asked to judge some pre-identified items, and then, excluded items were judged again in the second round. At the end of the third round, all of the agreed items were included in the final list to form an evaluative scale on practice of patients’ rights. Experts were asked to judge a total 171 items in 3 rounds. Around 31% (n = 53) of items obtained the panel’s approval to be included in the final version of the scale. The experts’ opinions were collected using face-to-face interviews and electronic email during a 6-month period of data collection from October 2013 to February 2014. This study developed a 53-item scale for evaluation of patients’ rights prerequisites in educational hospitals in Iran. This scale was developed in 7 areas of commitments including university education, research, supervision, process management, physical structure, organizational policy, and human resources management. This study developed an evaluative scale to assess the practice of patients’ rights in educational hospitals. The items in the final version of this scale were obtained from a consensus of experts and the instrument can be used to evaluate the context and prerequisites for practice of patients’ rights in Iranian educational hospitals. PMID:27354900

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study.

PubMed

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-16

To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Hospitals and community health centres in Taiwan. A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. 15 Chinese healthcare practitioners with more than 6 months' experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Healthcare Quality Indicators for Physiotherapy Management in Hip and Knee Osteoarthritis and Rheumatoid Arthritis: A Delphi Study.

PubMed

Peter, W F; Hurkmans, E J; van der Wees, P J; Hendriks, E J M; van Bodegom-Vos, L; Vliet Vlieland, T P M

2016-12-01

The aim of the present study was to develop healthcare quality indicators (HCQIs) for the physiotherapy (PT) management of patients with hip or knee osteoarthritis (HKOA) or rheumatoid arthritis (RA) in the Netherlands. Two multidisciplinary expert panels, including patients, were instituted. A draft HCQI set was derived from recommendations included in two existing Dutch PT guidelines for HKOA and RA. The panels suggested additional topics, after which a Delphi procedure was performed. All propositions were scored for their potential to represent good-quality PT care (score range 0-9). Based on predefined rules, the Delphi panel HCQIs were discussed and selected. Lastly, every indicator was rephrased, resulting in its output consisting of a numerator and denominator, to facilitate comparisons within and among practices. After two Delphi rounds, two final sets of 17 HCQI - one for HKOA and one for RA - were composed, both containing 16 process indicators (regarding initial assessment, treatment and evaluation) and one outcome indicator. Two sets of HCQIs for PT management in HKOA and RA were developed for measuring the quality of PT care in daily clinical practice. Each indicator was formulated in a measurable way. Future research should focus on the feasibility of both indicator sets for daily clinical practice. Copyright © 2016 John Wiley & Sons, Ltd.

Paratonia: a Delphi procedure for consensus definition.

PubMed

Hobbelen, Johannes S M; Koopmans, Raymond T C M; Verhey, Frans R J; Van Peppen, Roland P S; de Bie, Rob A

2006-01-01

Paratonia is a motor problem that develops during the course of dementia. Definitions of paratonia used in the literature differ considerably, which has clinical implications and may lead to an undesirable heterogeneity in study populations. For this reason, we initiated a Delphi procedure with known experts in the field to establish an operational consensus definition of paratonia. The Delphi procedure involved an anonymous and multistage approach presented as a questionnaire, with each stage building on the results of the previous one in order to reach consensus on the definition of paratonia. Eight of 17 experts agreed to participate in the study. After 4 rounds, the participants reached consensus on the following definition: paratonia is a form of hypertonia with an involuntary variable resistance during passive movement. The nature of paratonia may change with progression of dementia (eg, from active assistance (aka Mitgehen) to active resistance). The degree of resistance depends on the speed of movement (eg, slow > low resistance, fast > high resistance). The degree of paratonia is proportional to the amount of force applied and increases with progression of dementia. The resistance to passive movement is in any direction and there is no clasp-knife phenomenon. The Delphi procedure resulted in a comprehensive, operational definition of paratonia. Future research should focus on the reliability and validity of this definition.

Development of the Austrian Nursing Minimum Data Set (NMDS-AT): the third Delphi Round, a quantitative online survey.

PubMed

Ranegger, Renate; Hackl, Werner O; Ammenwerth, Elske

2015-01-01

A Nursing Minimum Data Set (NMDS) aims at systematically describing nursing care in terms of patient problems, nursing activities, and patient outcomes. In an earlier Delphi study, 56 data elements were proposed to be included in an Austrian Nursing Minimum Data Set (NMDS-AT). To identify the most important data elements of this list, and to identify appropriate coding systems. Online Delphi-based survey with 88 experts. 43 data elements were rated as relevant for an NMDS-AT (strong agreement of more than half of the experts): nine data elements concerning the institution, patient demographics, and medical condition; 18 data elements concerning patient problems by using nursing diagnosis; seven data elements concerning nursing outcomes, and nine data elements concerning nursing interventions. As classification systems, national classification systems were proposed besides ICNP, NNN, and nursing-sensitive indicators. The resulting proposal for an NMDS-AT will now be tested with routine data.

Identifying research priorities for patient safety in mental health: an international expert Delphi study.

PubMed

Dewa, Lindsay H; Murray, Kevin; Thibaut, Bethan; Ramtale, Sonny Christian; Adam, Sheila; Darzi, Ara; Archer, Stephanie

2018-03-03

Physical healthcare has dominated the patient safety field; research in mental healthcare is not as extensive but findings from physical healthcare cannot be applied to mental healthcare because it delivers specialised care that faces unique challenges. Therefore, a clearer focus and recognition of patient safety in mental health as a distinct research area is still needed. The study aim is to identify future research priorities in the field of patient safety in mental health. Semistructured interviews were conducted with the experts to ascertain their views on research priorities in patient safety in mental health. A three-round online Delphi study was used to ascertain consensus on 117 research priority statements. Academic and service user experts from the USA, UK, Switzerland, Netherlands, Ireland, Denmark, Finland, Germany, Sweden, Australia, New Zealand and Singapore were included. Agreement in research priorities on a five-point scale. Seventy-nine statements achieved consensus (>70%). Three out of the top six research priorities were patient driven; experts agreed that understanding the patient perspective on safety planning, on self-harm and on medication was important. This is the first international Delphi study to identify research priorities in safety in the mental field as determined by expert academic and service user perspectives. A reasonable consensus was obtained from international perspectives on future research priorities in patient safety in mental health; however, the patient perspective on their mental healthcare is a priority. The research agenda for patient safety in mental health identified here should be informed by patient safety science more broadly and used to further establish this area as a priority in its own right. The safety of mental health patients must have parity with that of physical health patients to achieve this. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Futurescapes: evidence expectations in the USA for comparative effectiveness research for drugs in 2020.

PubMed

Messner, Donna A; Mohr, Penny; Towse, Adrian

2015-08-01

Explore key factors influencing future expectations for the production of evidence from comparative effectiveness research for drugs in the USA in 2020 and construct three plausible future scenarios. Semistructured key informant interviews and three rounds of modified Delphi with systematic scenario-building methods. Most influential key factors were: health delivery system integration; electronic health record development; exploitation of very large databases and mixed data sources; and proactive patient engagement in research. The scenario deemed most likely entailed uneven development of large integrated health systems with pockets of increased provider risk for patient care, enhanced data collection systems, changing incentives to do comparative effectiveness research and new opportunities for evidence generation partnerships.

COS-STAR: a reporting guideline for studies developing core outcome sets (protocol).

PubMed

Kirkham, Jamie J; Gorst, Sarah; Altman, Douglas G; Blazeby, Jane; Clarke, Mike; Devane, Declan; Gargon, Elizabeth; Williamson, Paula R

2015-08-22

Core outcome sets can increase the efficiency and value of research and, as a result, there are an increasing number of studies looking to develop core outcome sets (COS). However, the credibility of a COS depends on both the use of sound methodology in its development and clear and transparent reporting of the processes adopted. To date there is no reporting guideline for reporting COS studies. The aim of this programme of research is to develop a reporting guideline for studies developing COS and to highlight some of the important methodological considerations in the process. The study will include a reporting guideline item generation stage which will then be used in a Delphi study. The Delphi study is anticipated to include two rounds. The first round will ask stakeholders to score the items listed and to add any new items they think are relevant. In the second round of the process, participants will be shown the distribution of scores for all stakeholder groups separately and asked to re-score. A final consensus meeting will be held with an expert panel and stakeholder representatives to review the guideline item list. Following the consensus meeting, a reporting guideline will be drafted and review and testing will be undertaken until the guideline is finalised. The final outcome will be the COS-STAR (Core Outcome Set-STAndards for Reporting) guideline for studies developing COS and a supporting explanatory document. To assess the credibility and usefulness of a COS, readers of a COS development report need complete, clear and transparent information on its methodology and proposed core set of outcomes. The COS-STAR guideline will potentially benefit all stakeholders in COS development: COS developers, COS users, e.g. trialists and systematic reviewers, journal editors, policy-makers and patient groups.

Ingredientes Farmacéuticos Activos Potencialmente Inapropiados en Adultos Mayores: Lista IFAsPIAM: Panel de Consenso Argentino.

PubMed

Marzi, Marta M; Pires, Miryam S; Quaglia, Nora B

2018-04-18

To perform a list agreed by Argentinean experts and adapted to the local context containing potentially inappropriate (PI) medications in old people (OP) usingthe Delphi consensus technique optimized for this subject. A preliminary list of potentially inappropriate medications (PIM) was drawn up based on foreign PIM lists and a selective search in the scientific literature. The iterative Delphi process was used to submit the active pharmaceutical ingredients (APIs) of the preliminary PIM list to the panel of Argentinean experts. The analysis of theanswers to determine the arrival to the consensus was carried out applying three criteria specially defined for this purpose. After two Delphi rounds, it was not reached agreement about 12 APIs. The List of explicit criteria for PIAPIs for use in OP (IFAsPIAM List) was finally constituted by 128 APIs corresponding to 9 groups of the ATC classification system to which they were organized. In addition to each API, information justifying the unfavorable benefit/risk profile and therapeutic alternatives or recommendations/precautions was recorded. The group with the most PI APIs was N (NervousSystem) (60; 47%) followed by groups C (Cardiovascular) and M (Musculoskeletal). This study presents the first Latin American list of PIM in OP developed using an expert consensus technique. The IFAs PIAM List would contribute to the rational use of drugs in elderly population, constituting a valuable tool in Argentinean public health. Copyright © 2018. Published by Elsevier Inc.

Airborne multicamera system for geo-spatial applications

NASA Astrophysics Data System (ADS)

Bachnak, Rafic; Kulkarni, Rahul R.; Lyle, Stacey; Steidley, Carl W.

2003-08-01

Airborne remote sensing has many applications that include vegetation detection, oceanography, marine biology, geographical information systems, and environmental coastal science analysis. Remotely sensed images, for example, can be used to study the aftermath of episodic events such as the hurricanes and floods that occur year round in the coastal bend area of Corpus Christi. This paper describes an Airborne Multi-Spectral Imaging System that uses digital cameras to provide high resolution at very high rates. The software is based on Delphi 5.0 and IC Imaging Control's ActiveX controls. Both time and the GPS coordinates are recorded. Three successful test flights have been conducted so far. The paper present flight test results and discusses the issues being addressed to fully develop the system.

Potential Effects of the Electronic Health Record on the Small Physician Practice: A Delphi Study.

PubMed

Sines, Chad C; Griffin, Gerald R

2017-01-01

The Health Information Technology for Economic and Clinical Health (HITECH) Act established the requirement of all medical practices to have certified electronic health records (EHRs). Some primary concerns that have been delaying implementation are issues of cost, revenue impact, and the effect on the patient encounter. Small physician practices (one to four physicians) account for 46 percent of all physicians. The purpose of this qualitative study using a modified Delphi research design was to examine the potential effect of the adoption of the EHR on revenue, unintended costs or savings, and changes in the patient encounter. Fifteen expert panelists completed the three-round survey process. The expert panelists reached a consensus that EHRs would reduce the number of patients seen per day, thereby reducing their revenue. Although the panelists limited their discussion on the effect of patient outcomes, their most dominant concern was the loss of face-to-face time with the patient. They felt that the use of an EHR would reduce the focus on the patient and potentially cause physicians to miss medical conditions. The results of this study indicate an avenue for EHR vendors to develop educational avenues to teach physicians how to optimize the EHR as well as to share success stories that demonstrate improved financial impact.

Potential Effects of the Electronic Health Record on the Small Physician Practice: A Delphi Study

PubMed Central

Sines, Chad C.; Griffin, Gerald R.

2017-01-01

The Health Information Technology for Economic and Clinical Health (HITECH) Act established the requirement of all medical practices to have certified electronic health records (EHRs). Some primary concerns that have been delaying implementation are issues of cost, revenue impact, and the effect on the patient encounter. Small physician practices (one to four physicians) account for 46 percent of all physicians. The purpose of this qualitative study using a modified Delphi research design was to examine the potential effect of the adoption of the EHR on revenue, unintended costs or savings, and changes in the patient encounter. Fifteen expert panelists completed the three-round survey process. The expert panelists reached a consensus that EHRs would reduce the number of patients seen per day, thereby reducing their revenue. Although the panelists limited their discussion on the effect of patient outcomes, their most dominant concern was the loss of face-to-face time with the patient. They felt that the use of an EHR would reduce the focus on the patient and potentially cause physicians to miss medical conditions. The results of this study indicate an avenue for EHR vendors to develop educational avenues to teach physicians how to optimize the EHR as well as to share success stories that demonstrate improved financial impact. PMID:28566989

Competency-based tool for evaluation of community-based training in undergraduate medical education in India - a Delphi approach.

PubMed

Shewade, Hemant Deepak; Jeyashree, Kathiresan; Kalaiselvi, Selvaraj; Palanivel, Chinnakali; Panigrahi, Krishna Chandra

2017-01-01

A community-based training (CBT) program, where teaching and training are carried out in the community outside of the teaching hospital, is a vital part of undergraduate medical education. Worldwide, there is a shift to competency-based training, and CBT is no exception. We attempted to develop a tool that uses a competency-based approach for assessment of CBT. Based on a review on competencies, we prepared a preliminary list of major domains with items under each domain. We used the Delphi technique to arrive at a consensus on this assessment tool. The Delphi panel consisted of eight purposively selected experts from the field of community medicine. The panel rated each item for its relevance, sensitivity, specificity, and understandability on a scale of 0-4. Median ratings were calculated at the end of each round and shared with the panel. Consensus was predefined as when 70% of the experts gave a rating of 3 or above for an item under relevance, sensitivity, and specificity. If an item failed to achieve consensus after being rated in 2 consecutive rounds, it was excluded. Anonymity of responses was maintained. The panel arrived at a consensus at the end of 3 rounds. The final version of the self-assessment tool consisted of 7 domains and 74 items. The domains (number of items) were Public health - epidemiology and research methodology (13), Public health - biostatistics (6), Public health administration at primary health center level (17), Family medicine (24), Cultural competencies (3), Community development and advocacy (2), and Generic competence (9). Each item was given a maximum score of 5 and minimum score of 1. This is the first study worldwide to develop a tool for competency-based evaluation of CBT in undergraduate medical education. The competencies identified in the 74-item questionnaire may provide the base for development of authentic curricula for CBT.

Development of community based curriculum on ophthalmology for under graduate medical course in Bangladesh.

PubMed

Khan, A K; Hussain, A Z M I

2012-08-01

The curriculum represents the expression of educational ideas in practice. Ophthalmic education is the corner stone to improve eye care globally. Curriculum needs continuous modification varying in different geographic locations. Though 90% of common conditions are either preventable or curable but emphasis on the common conditions is inadequate. This is a stepwise descriptive study aiming to develop a community based ophthalmology curriculum for undergraduate medical course in Bangladesh conducted during March 2007 to February 2008 at UniSA School of Public Health and Life Sciences, University of South Asia, Banani, Dhaka. Delphi technique, a modified qualitative method was used to accumulate data and reaching a consensus opinion for developing the curriculum. Study approach includes two iterative rounds and finally a workshop. Iteration of round-I was "What are the eye diseases with overall knowledge of their management one MBBS physician should acquire"; followed by a list of eye diseases and topics for expert opinion. The response was collated. Iteration round-II was "How much a MBBS student should have percentage of knowledge, attitude and skills on each topic while being taught". The response was collated and presented to panel of expert ophthalmologists for discussion and validation. In the round-I Delphi, 400 (62%) out to total 641 ophthalmologist were randomly selected dividing in categories (62% in each) of Professor-22, Associate Professor-12, Assistant Professor-26, Consultant-27, ophthalmologists working in NGO-56 and ophthalmologists in private sector-257. Sixty (15%) responded with opinion. In the round-II, 200 (31%) including 60 of round-I, selected randomly but proportionately as before. Forty five (22.5%) responded with opinion. Result collated. The results and opinion of respondents were presented at a workshop attended by 24 (80%), out of 30 invited expert ophthalmic specialists for discussion, criticism, opinion, addition, modification and finally for validation. On the basis of the opinion of the respondents, reviewing literature, analyzing the ocular disease pattern in Bangladesh and also analyzing the present ophthalmology curriculum, a community and need based ophthalmology curriculum for undergraduate medical course in Bangladesh was developed. This research would help developing community and need based ophthalmology curriculum for undergraduate medical course in Bangladesh.

Aspects relevant for functioning in patients with ankylosing spondylitis according to the health professionals: a Delphi study with the ICF as reference.

PubMed

Boonen, Annelies; van Berkel, Monique; Kirchberger, Inge; Cieza, Alarcos; Stucki, Gerald; van der Heijde, Désirée

2009-08-01

In AS there is no agreed definition of which aspects are important when describing functioning. This limits the possibility to classify, evaluate and investigate the consequences of the disease. This study aimed to achieve consensus among health professionals on which aspects of functioning are typical and relevant for AS patients using the International Classification of Functioning, Disability and Health (ICF) as reference. An international Delphi study through e-mail was performed among different health professions. Answers to open questions on areas relevant for functioning in the first round were linked to ICF categories and analysed in the two following two rounds for the degree of consensus. Of the 267 experts invited, 126 agreed to participate and 74 participated in all rounds; 28 were rheumatologists, 6 rheumatology nurses, 24 physiotherapists, 2 occupational therapists, 4 psychologists, 8 rehabilitation physicians and 2 social workers. More than 80% agreement was reached on 141 ICF categories, of which 30 (21%) were part of Body functions; 27 (19%) of Body structures; 56 (40%) of Activities and Participation; and 28 (20%) of Environmental factors. In addition, two Personal factors-illness knowledge and coping-were agreed upon. 141 ICF categories and two personal factors represent the reference of functioning in AS from the perspective of health professional. The largest number of categories concerned restrictions in activities. Also, the impact of AS on participation in life situations and the role of environmental factors were underscored. This broadens the view on functioning in AS and has implications for future research into functioning.

Use of the Delphi process in paediatric cataract management.

PubMed

Serafino, Massimiliano; Trivedi, Rupal H; Levin, Alex V; Wilson, M Edward; Nucci, Paolo; Lambert, Scott R; Nischal, Ken K; Plager, David A; Bremond-Gignac, Dominique; Kekunnaya, Ramesh; Nishina, Sachiko; Tehrani, Nasrin N; Ventura, Marcelo C

2016-05-01

To identify areas of consensus and disagreement in the management of paediatric cataract using a modified Delphi approach among individuals recognised for publishing in this field. A modified Delphi method. International paediatric cataract experts with a publishing record in paediatric cataract management. The process consisted of three rounds of anonymous electronic questionnaires followed by a face-to-face meeting, followed by a fourth anonymous electronic questionnaire. The executive committee created questions to be used for the electronic questionnaires. Questions were designed to have unit-based, multiple choice or true-false answers. The questionnaire included issues related to the preoperative, intraoperative and postoperative management of paediatric cataract. Consensus based on 85% of panellists being in agreement for electronic questionnaires or 80% for the face-to-face meeting, and near consensus based on 70%. Sixteen of 22 invited paediatric cataract surgeons agreed to participate. We arrived at consensus or near consensus for 85/108 (78.7%) questions and non-consensus for the remaining 23 (21.3%) questions. Those questions where consensus was not reached highlight areas of either poor evidence or contradicting evidence, and may help investigators identify possible research questions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Evidence-based algorithm for diagnosis and assessment in psoriatic arthritis: results by Italian DElphi in psoriatic Arthritis (IDEA).

PubMed

Lapadula, G; Marchesoni, A; Salaffi, F; Ramonda, R; Salvarani, C; Punzi, L; Costa, L; Caso, F; Simone, D; Baiocchi, G; Scioscia, C; Di Carlo, M; Scarpa, R; Ferraccioli, G

2016-12-16

Psoriatic arthritis (PsA) is a chronic inflammatory disease involving skin, peripheral joints, entheses, and axial skeleton. The disease is frequently associated with extrarticular manifestations (EAMs) and comorbidities. In order to create a protocol for PsA diagnosis and global assessment of patients with an algorithm based on anamnestic, clinical, laboratory and imaging procedures, we established a DElphi study on a national scale, named Italian DElphi in psoriatic Arthritis (IDEA). After a literature search, a Delphi poll, involving 52 rheumatologists, was performed. On the basis of the literature search, 202 potential items were identified. The steering committee planned at least two Delphi rounds. In the first Delphi round, the experts judged each of the 202 items using a score ranging from 1 to 9 based on its increasing clinical relevance. The questions posed to experts were How relevant is this procedure/observation/sign/symptom for assessment of a psoriatic arthritis patient? Proposals of additional items, not included in the questionnaire, were also encouraged. The results of the poll were discussed by the Steering Committee, which evaluated the necessity for removing selected procedures or adding additional ones, according to criteria of clinical appropriateness and sustainability. A total of 43 recommended diagnosis and assessment procedures, recognized as items, were derived by combination of the Delphi survey and two National Expert Meetings, and grouped in different areas. Favourable opinion was reached in 100% of cases for several aspects covering the following areas: medical (familial and personal) history, physical evaluation, imaging tool, second level laboratory tests, disease activity measurement and extrarticular manifestations. After performing PsA diagnosis, identification of specific disease activity scores and clinimetric approaches were suggested for assessing the different clinical subsets. Further, results showed the need for investigation on the presence of several EAMs and risk factors. In the context of any area, a rank was assigned for each item by Expert Committee members, in order to create the logical sequence of the algorithm. The final list of recommended diagnosis and assessment procedures, by the Delphi survey and the two National Expert Meetings, was also reported as an algorithm. This study shows results obtained by the combination of a DElphi survey of a group of Italian rheumatologists and two National Expert Meetings, created with the aim of establishing a clinical procedure and algorithm for the diagnosis and the assessment of PsA patients. In order to find accurate and practical diagnostic and assessment items in clinical practice, we have focused our attention on evaluating the different PsA domains. Hence, we conceived the IDEA algorithm in order to address PsA diagnosis and assessment in the context of daily clinical practice. The IDEA algorithm might eventually lead to a multidimensional approach and could represent a useful and practical tool for addressing diagnosis and for assessing the disease appropriately. However, the elaborated algorithm needs to be further investigated in daily practice, for evidencing and proving its eventual efficacy in detecting and staging PsA and its heterogeneous spectrum appropriately.

A pushing chronic care forward in Abu Dhabi by identifying priorities and addressing barriers: a modified Delphi technique

PubMed Central

Loney, Tom; Lapão, Luis V

2018-01-01

Objective This study aimed to elucidate the top five key priorities and barriers to chronic care in the health system of Abu Dhabi, United Arab Emirates (UAE). Design A modified Delphi study was performed to reach consensus on priority areas and barriers to the development of the Chronic Care Model in the health system of Abu Dhabi. Individual wireless audience response devices (keypads) linked to a computer were used to reduce 28 priorities and 20 barriers to the top five during three iterative rounds over three consecutive days. Setting Chronic care services for patients with diabetes, cardiovascular diseases and cancer, in both private and publicly funded healthcare services in the emirate of Abu Dhabi. Participants A purposive sample of 20 health systems’ experts were recruited. They were front-line healthcare workers from the public and private sector working in the delivery of care for patients with diabetes, cardiovascular diseases and cancer. Results The ‘overall organizational leadership in chronic illness care’ was ranked as the most important priority to address (26.3%) and ‘patient compliance’ was ranked as the most important barrier (36.8%) to the development of the Chronic Care Model. Conclusions This study has identified the current priorities and barriers to improving chronic care within Abu Dhabi’s healthcare system. Our paper addresses the UAE’s 2021 Agenda of achieving a world-class healthcare system, and findings may help inform strategic changes required to achieve this mission. PMID:29866724

A Delphi study: Practitioners' perceptions of how the science curriculum is differentiated for academically gifted students at the middle school level

NASA Astrophysics Data System (ADS)

Kelley, Jean Mary

The purpose of this study was to identify, analyze, and compare the perceptions of selected district science educators and teachers of middle school science students regarding the following issues: (1) Current methods of differentiating science instruction for gifted middle school students. (2) Strengths of the current methods of differentiating science instruction for gifted middle school students. (3) Weaknesses of the current methods of differentiating science instruction for gifted middle school students. (4) The types of training/experience needed to prepare teachers to effectively differentiate science instruction for gifted middle school students. (5) The steps need to develop an effective differentiated science program at the middle school level. (6) Trends for the future development of differentiated science programs at the middle school level. The panel of educators was identified using the Delphi technique and asked to participate in the study by responding to the research questions. The responses to the first round were condensed into two lists of discrete statements, and in the second round, each group of panelists was asked to rank each statement on a Likert scale. A third round was sent to each group of panel members showing the median and interquartile ranges of the second round. Panelists could adjust their responses based on the results of the second round. The analysis of the data was computed using the computer program Statistics Package for the Social Sciences. Based on the data obtained, the following results and conclusions were determined. The coordinators and the teachers both considered training of teachers, strategies for differentiation, and future trends to be the most important considerations. The areas with the most differences were those dealing with the current methods of differentiating science instruction at the middle school level. There were several limitations identified in this study. Among them were the makeup of the sample of panelists and different definitions of the same term(s). If we are to address the needs of middle school students who are academically gifted in science, teachers and coordinators need to communicate more about expectations in the classroom and what is really happening.

Key factors for the bicycle use of visually impaired people: a Delphi study.

PubMed

Jelijs, Bart; Heutink, Joost; de Waard, Dick; Brookhuis, Karel A; Melis-Dankers, Bart J M

2018-06-12

This study aims to identify the most important factors that influence the independent bicycle use of visually impaired people in the Netherlands. Both visually impaired people and professionals participated in a two-round online Delphi study (n = 42). In Round 1 the participants identified the factors which they ranked by relevance in Round 2. The participants prioritised environmental factors related to the traffic situation, the characteristics of the infrastructure, and weather and light conditions (Kendall's W = 0.66). They indicated that the most influencing personal factors are related to personality, traffic experience, and personal background (W = 0.58). Glaucoma was ranked as the most relevant ophthalmic condition (W = 0.74), while glare was regarded as the most important factor with respect to the visual functions (W = 0.78). The factors provided by this study can be used to optimise the independent cycling mobility of visually impaired people. More research is needed to investigate, both, how and to what extent the mentioned factors influence the cycling behaviour. Implications for rehabilitation The results of this study can be used to set priorities during the rehabilitation and training of visually impaired people who wish to cycle independently. Visually impaired cyclists may compensate for the consequences of their visual impairments by taking alternative routes that suit their individual abilities and limitations. Since gaining and maintaining self-confidence is important for independent cycling with a visual impairment, practitioners such as mobility trainers should not only focus on cycling-related skills and abilities, but also aim to improve the self-confidence of visually impaired people who wish to cycle.

Preventing HIV transmission in Chinese internal migrants: a behavioral approach.

PubMed

Liu, Xiaona; Erasmus, Vicki; Sun, Xinying; Cai, Rui; Shi, Yuhui; Richardus, Jan Hendrik

2014-01-01

This study is a step towards a behavioral intervention to prevent HIV transmission among Chinese internal migrants. To explore important and changeable determinants of condom use and inspect effective and feasible methods to increase condom use for the target population, we conducted a three-round web-based Delphi study among a panel of 62 experts between October 2012 and March 2013. The panelists were purposely selected using a stepwise procedure to represent topic-related areas of expertise. The response rate per round ranges from 21% to 81%. The panelists identified 19 possible determinants of condom use and reported 16 intervention methods they considered successful. They agreed that attitude towards condom use was the most important and changeable determinant, while applying behavioral theory, increasing sexual education and condom access, performing worksite health promotion, detecting risk factors, and working closely with relevant organizations and the government were effective and feasible methods to increase condom use among internal migrants in China. In conclusion, results of this study highlight the importance of attitude in changing condom use and underscore the need to apply behavior theory and integrate multiple educational approaches for developing behavioral HIV prevention interventions targeting internal migrants in China.

Crossing the quality chasm: the role of information technology departments.

PubMed

Weir, Charlene R; Hicken, Bret L; Rappaport, Hank Steven; Nebeker, Jonathan R

2006-01-01

Integrating information technology (IT) into medical settings is considered essential to transforming hospitals into 21st-century health care institutions. Yet the role of IT departments in maximizing the effectiveness of information systems is not well understood. This article reports a 3-round Delphi panel of Veterans Administration personnel experienced with provider order entry electronic systems. In round 1, 35 administrative, clinical, and IT personnel answered 10 open-ended questions about IT strategies and structures that best support successful transformation. In round 2, panelists rated item importance and ranked proposed strategies. In round 3, panelists received aggregate feedback and rerated the items. Four domains emerged from round 1: IT organization, IT performance monitoring, user-support activities, and core IT responsibilities (eg, computer security, training). In rounds 2 and 3, IT performance monitoring was rated the most important, closely followed by clinical support. Strategies associated with each domain are identified and discussed.

A Delphi study among internal medicine clinicians to determine which therapeutic information is essential to record in a medical record.

PubMed

van Unen, Robert J; Tichelaar, Jelle; Nanayakkara, Prabath W B; van Agtmael, Michiel A; Richir, Milan C; de Vries, Theo P G M

2015-12-01

Several studies have demonstrated that using a template for recording general and diagnostic information in the medical record (MR) improves the completeness of MR documentation, communication between doctors, and performance of doctors. However, little is known about how therapeutic information should be structured in the MR. The aim of this study was to investigate which specific therapeutic information registrars and consultants in internal medicine consider essential to record in the MR. Therefore, we carried out a 2-round Internet Delphi study. Fifty-nine items were assessed on a 5-point scale; an item was considered important if ≥ 80% of the respondents awarded it a score of 4 or 5. In total, 26 registrars and 30 consultants in internal medicine completed both rounds of the study. Overall, they considered it essential to include information about 11 items in the MR. Subgroup analyses revealed that the registrars considered 8 additional items essential, whereas the consultants considered 1 additional item essential to record. Study findings can be used as a starting point to develop a structured section of the MR for therapeutic information for both paper and electronic MRs. This section should contain at least 11 items considered essential by registrars and clinical consultants in internal medicine. © 2015, The American College of Clinical Pharmacology.

Determination of clinically relevant content for a musculoskeletal anatomy curriculum for physical medicine and rehabilitation residents.

PubMed

Lisk, Kristina; Flannery, John F; Loh, Eldon Y; Richardson, Denyse; Agur, Anne M R; Woods, Nicole N

2014-01-01

To address the need for more clinical anatomy training in residency education, many postgraduate programs have implemented structured anatomy courses into their curriculum. Consensus often does not exist on specific content and level of detail of the content that should be included in such curricula. This article describes the use of the Delphi method to identify clinically relevant content to incorporate in a musculoskeletal anatomy curriculum for Physical Medicine and Rehabilitation (PM&R) residents. A two round modified Delphi involving PM&R experts was used to establish the curricular content. The anatomical structures and clinical conditions presented to the expert group were compiled using multiple sources: clinical musculoskeletal anatomy cases from the PM&R residency program at the University of Toronto; consultation with PM&R experts; and textbooks. In each round, experts rated the importance of each curricular item to PM&R residency education using a five-point Likert scale. Internal consistency (Cronbach's alpha) was used to determine consensus at the end of each round and agreement scores were used as an outcome measure to determine the content to include in the curriculum. The overall internal consistency in both rounds was 0.99. A total of 37 physiatrists from across Canada participated and the overall response rate over two rounds was 97%. The initial curricular list consisted of 361 items. After the second iteration, the list was reduced by 44%. By using a national consensus method we were able to objectively determine the relevant anatomical structures and clinical musculoskeletal conditions important in daily PM&R practice. © 2013 American Association of Anatomists.

Definition of Specific Functions and Procedural Skills Required by Cuban Specialists in Intensive Care and Emergency Medicine.

PubMed

Véliz, Pedro L; Berra, Esperanza M; Jorna, Ana R

2015-07-01

INTRODUCTION Medical specialties' core curricula should take into account functions to be carried out, positions to be filled and populations to be served. The functions in the professional profile for specialty training of Cuban intensive care and emergency medicine specialists do not include all the activities that they actually perform in professional practice. OBJECTIVE Define the specific functions and procedural skills required of Cuban specialists in intensive care and emergency medicine. METHODS The study was conducted from April 2011 to September 2013. A three-stage methodological strategy was designed using qualitative techniques. By purposive maximum variation sampling, 82 professionals were selected. Documentary analysis and key informant criteria were used in the first stage. Two expert groups were formed in the second stage: one used various group techniques (focus group, oral and written brainstorming) and the second used a three-round Delphi method. In the final stage, a third group of experts was questioned in semistructured in-depth interviews, and a two-round Delphi method was employed to assess priorities. RESULTS Ultimately, 78 specific functions were defined: 47 (60.3%) patient care, 16 (20.5%) managerial, 6 (7.7%) teaching, and 9 (11.5%) research. Thirty-one procedural skills were identified. The specific functions and procedural skills defined relate to the profession's requirements in clinical care of the critically ill, management of patient services, teaching and research at the specialist's different occupational levels. CONCLUSIONS The specific functions and procedural skills required of intensive care and emergency medicine specialists were precisely identified by a scientific method. This product is key to improving the quality of teaching, research, administration and patient care in this specialty in Cuba. The specific functions and procedural skills identified are theoretical, practical, methodological and social contributions to inform future curricular reform and to help intensive care specialists enhance their performance in comprehensive patient care. KEYWORDS Intensive care, urgent care, emergency medicine, continuing medical education, curriculum, diagnostic techniques and procedures, medical residency, Cuba.

Core Health Outcomes In Childhood Epilepsy (CHOICE): protocol for the selection of a core outcome set.

PubMed

Morris, Christopher; Dunkley, Colin; Gibbon, Frances M; Currier, Janet; Roberts, Deborah; Rogers, Morwenna; Crudgington, Holly; Bray, Lucy; Carter, Bernie; Hughes, Dyfrig; Tudur Smith, Catrin; Williamson, Paula R; Gringras, Paul; Pal, Deb K

2017-11-28

There is increasing recognition that establishing a core set of outcomes to be evaluated and reported in trials of interventions for particular conditions will improve the usefulness of health research. There is no established core outcome set for childhood epilepsy. The aim of this work is to select a core outcome set to be used in evaluative research of interventions for children with rolandic epilepsy, as an exemplar of common childhood epilepsy syndromes. First we will identify what outcomes should be measured; then we will decide how to measure those outcomes. We will engage relevant UK charities and health professional societies as partners, and convene advisory panels for young people with epilepsy and parents of children with epilepsy. We will identify candidate outcomes from a search for trials of interventions for childhood epilepsy, statutory guidance and consultation with our advisory panels. Families, charities and health, education and neuropsychology professionals will be invited to participate in a Delphi survey following recommended practices in the development of core outcome sets. Participants will be able to recommend additional outcome domains. Over three rounds of Delphi survey participants will rate the importance of candidate outcome domains and state the rationale for their decisions. Over the three rounds we will seek consensus across and between families and health professionals on the more important outcomes. A face-to-face meeting will be convened to ratify the core outcome set. We will then review and recommend ways to measure the shortlisted outcomes using clinical assessment and/or patient-reported outcome measures. Our methodology is a proportionate and pragmatic approach to expediently produce a core outcome set for evaluative research of interventions aiming to improve the health of children with epilepsy. A number of decisions have to be made when designing a study to develop a core outcome set including defining the scope, choosing which stakeholders to engage, most effective ways to elicit their views, especially children and a potential role for qualitative research.

Project PriMo: sharing principles and practices of bronchodilator therapy monitoring in COPD: a consensus initiative for optimizing therapeutic appropriateness among Italian specialists.

PubMed

Cazzola, Mario; Brusasco, Vito; Centanni, Stefano; Cerveri, Isa; De Michele, Fausto; Di Maria, Giuseppe; Palange, Paolo; Pellegrino, Riccardo; Polverino, Mario; Rossi, Andrea; Papi, Alberto

2013-04-01

Even after publication of the 2011 update of GOLD report, some fundamental questions in the management of COPD are still open and this may weaken the applicability of these guidelines in everyday clinical practice. To assess the level of consensus amongst Italian respirologists on different topics related to diagnosis, monitoring and role of bronchodilator therapy in COPD, by using the Delphi technique. A Delphi study was undertaken between July and November 2011, when two questionnaires were consecutively sent to a panel of experts to be answered anonymously. After each round, the data were aggregated at group level of question topics and structured feedback was given to the panel. A first-round questionnaire was sent to 208 pulmonologists randomly selected from different Italian regions. The 132 respondents (63% of those initially selected) were from northern (53%), central (19%) and southern (28%) Italy. A second-round questionnaire was sent to all the first-round respondents, and a response was received from 110 of them (83%). The main topics that reached the pre-defined cut off for consensus (67% or more) were: a) bronchodilator therapy with long-acting bronchodilators could be beneficial in patients with airflow limitation even in the absence of symptoms, b) in patients not fully controlled with one long-acting bronchodilator, maximizing bronchodilation (i.e. adding another bronchodilator with a different mechanism of action) is the preferable option; and c) the use of inhaled corticosteroids (ICSs) as add on therapy should be considered in severe patients with frequent exacerbations. Italian specialists agree on several aspects of the diagnosis and treatment of COPD and expert opinion could support everyday decision process in the management of COPD. Copyright © 2012 Elsevier Ltd. All rights reserved.

Acceptability and Perceived Benefits and Risks of Public and Patient Involvement in Health Care Policy: A Delphi Survey in Belgian Stakeholders.

PubMed

Cleemput, Irina; Christiaens, Wendy; Kohn, Laurence; Léonard, Christian; Daue, François; Denis, Alain

2015-06-01

In systems with public health insurance, coverage decisions should reflect social values. Deliberation among stakeholders could achieve this goal, but rarely involves patients and citizens directly. This study aimed at evaluating the acceptability, and the perceived benefits and risks, of public and patient involvement (PPI) in coverage decision making to Belgian stakeholders. A two-round Delphi survey was conducted among all stakeholder groups. The survey was constructed on the basis of interviews with 10 key stakeholders and a review of the literature on participation models. Consensus was defined as 65% or more of the respondents agreeing with a statement and less than 15% disagreeing. Eighty stakeholders participated in both rounds. They were defined as the Delphi panel. Belgian stakeholders are open toward PPI in coverage decision processes. Benefits are expected to exceed risks. The preferred model for involvement is to consult citizens or patients, within the existing decision-making structures and at specific milestones in the process. Consulting citizens and patients is a higher level of involvement than merely informing them and a lower level than letting them participate actively. Consultation involves asking nonbinding advice on (parts of) the decision problem. According to the Delphi panel, the benefits of PPI could be increasing awareness among members of the general public and patients about the challenges and costs of health care, and enriched decision processes with expertise by experience from patients. Potential risks include subjectivity, insufficient resources to participate and weigh on the process, difficulties in finding effective ways to express a collective opinion, the risk of manipulation, and lobbying or power games of other stakeholders. PPI in coverage decision-making processes is acceptable to Belgian stakeholders, be it in different ways for different types of decisions. Benefits are expected to outweigh risks. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Cultural adaptation to Brazilian Portuguese of the Face, Legs, Activity, Cry, Consolability revised (FLACCr) scale of pain assessment.

PubMed

Bussotti, Edna Aparecida; Guinsburg, Ruth; Pedreira, Mavilde da Luz Gonçalves

2015-01-01

to perform the translation into Brazilian Portuguese and cultural adaptation of the Face, Legs, Activity, Cry, Consolability revised (FLACCr) scale, with children under 18 years old, affected by cerebral palsy, presenting or not cognitive impairment and unable to report their pain. methodological development study of translation into Portuguese and cultural adaptation of the FLACCr. After approval by the ethics committee, the process aimed at translation and back-translation, evaluation of translation and back-translation using the Delphi technique and assessment of cultural equivalence. The process included the five categories of the scale and the four application instructions, considering levels of agreement equal to or greater than 80%. it was necessary three rounds of the Delphi technique to achieve consensus among experts. The agreement achieved for the five categories was: Face 95.5%, Legs 90%, Activity 94.4%, Cry 94.4% and Consolability 99.4%. The four instructions achieved the following consensus levels: 1st 99.1%, 2nd 99.2%, 3rd 99.1% and 4th 98.3%. the method enabled the translation and cultural adaptation of the FLACCr. This is a study able to expand the knowledge of Brazilian professionals on pain assessment in children with CP.

Refractory septic shock in children: a European Society of Paediatric and Neonatal Intensive Care definition.

PubMed

Morin, Luc; Ray, Samiran; Wilson, Clare; Remy, Solenn; Benissa, Mohamed Rida; Jansen, Nicolaas J G; Javouhey, Etienne; Peters, Mark J; Kneyber, Martin; De Luca, Daniele; Nadel, Simon; Schlapbach, Luregn Jan; Maclaren, Graeme; Tissieres, Pierre

2016-12-01

Although overall paediatric septic shock mortality is decreasing, refractory septic shock (RSS) is still associated with high mortality. A definition for RSS is urgently needed to facilitate earlier identification and treatment. We aim to establish a European society of paediatric and neonatal intensive care (ESPNIC) experts' definition of paediatric RSS. We conducted a two-round Delphi study followed by an observational multicentre retrospective study. One hundred and fourteen paediatric intensivists answered a clinical case-based, two-round Delphi survey, identifying clinical items consistent with RSS. Multivariate analysis of these items in a development single-centre cohort (70 patients, 30 % mortality) facilitated development of RSS definitions based on either a bedside or computed severity score. Both scores were subsequently tested in a validation cohort (six centres, 424 patients, 11.6 % mortality). From the Delphi process, the draft definition included evidence of myocardial dysfunction and high blood lactate levels despite high vasopressor treatment. When assessed in the development population, each item was independently associated with the need for extracorporeal life support (ECLS) or death. Resultant bedside and computed septic shock scores had high discriminative power against the need for ECLS or death, with areas under the receiver operating characteristics curve of 0.920 (95 % CI 0.89-0.94), and 0.956 (95 % CI 0.93-0.97), respectively. RSS defined by a bedside score equal to or higher than 2 and a computed score equal to or higher than 3.5 was associated with a significant increase in mortality. This ESPNIC definition of RSS accurately identifies children with the most severe form of septic shock.

Pharmacy executive leadership issues and associated skills, knowledge, and abilities.

PubMed

Meadows, Andrew B; Maine, Lucinda L; Keyes, Elizabeth K; Pearson, Kathy; Finstuen, Kenn

2005-01-01

To identify challenges that current and future pharmacy executives are facing or will face in the future and to define what skills, knowledge, and abilities (SKAs) are required to successfully negotiate these challenges. Delphi method for executive decision making. Civilian pharmacy profession. 110 pharmacists who graduated from the GlaxoSmithKline Executive Management Program for Pharmacy Leaders. Two iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants were asked to identify five major issues they believed to be of greatest importance to pharmacy leaders in the next 5-10 years and name specific SKAs that might be needed by future leaders to successfully deal with those issues. An expert panel reviewed the issues, classified issues into specific domains, and titled each domain. Round 2-participants rated the SKAs on a 7-point scale according to their individual assessment of importance in each domain. For Delphi rounds 1 and 2, response rates were 21.8% and 18.2%, respectively. More than 100 total issue statements were identified. The expert panel sorted the issues into five domains: management and development of the pharmacy workforce, pharmacy finance, total quality management of work-flow systems, influences on the practice of pharmacy, and professional pharmacy leadership. Five of the top 15 SKAs-and all four highest ranked items--came from the professional pharmacy leadership domain, including ability to see the big picture, ability to demonstrate the value of pharmacy services, ability to lead and manage in an ethical manner, and skills for influencing an organization's senior leadership. Through successful integration of communication skills, critical thinking, and problem solving techniques, future public-sector pharmacy executives will be better equipped to effectively position their organizations and the profession for the challenges that lie ahead.

Framework of behavioral indicators for outcome evaluation of TB health promotion: a Delphi study of TB suspects and Tb patients

PubMed Central

2014-01-01

Background Health promotion for prevention and control of Tuberculosis (TB) is implemented worldwide because of its importance, but few reports have evaluated its impact on behavior due to a lack of standard outcome indicators. The objective of this study was to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. Methods A two-round modified Delphi method involving sixteen TB control experts was used to establish a framework of behavioral indicators for outcome evaluation of TB health promotion targeted at TB suspects and patients. Results Sixteen of seventeen invited experts in TB control (authority score of 0.91 on a 1.0 scale) participated in round 1 survey. All sixteen experts also participated in a second round survey. After two rounds of surveys and several iterations among the experts, there was consensus on a framework of indicators for measuring outcomes of TB health promotion for TB suspects and patients. For TB suspects, the experts reached consensus on 2 domains (“Healthcare seeking behavior” and “Transmission prevention”), 3 subdomains (“Seeking care after onset of TB symptoms”, “Pathways of seeking care” and “Interpersonal contact etiquette”), and 8 indicators (including among others, “Length of patient delay”). For TB patients, consensus was reached on 3 domains (“Adherence to treatment”, “Healthy lifestyle” and “Transmission prevention”), 8 subdomains (including among others, “Adherence to their medication”), and 14 indicators (including “Percentage of patients who adhered to their medication”). Operational definitions and data sources were provided for each indicator. Conclusions The findings of this study provide the basis for debate among international experts on a framework for achieving global consensus on outcome indicators for TB health promotion interventions targeted at TB patients and suspects. Such consensus will help to increase effectiveness of TB health promotion, while ensuring international comparability of outcome data. PMID:24884569

Framework of behavioral indicators for outcome evaluation of TB health promotion: a Delphi study of TB suspects and Tb patients.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Zhang, Yanqi; Wang, Qingya; Zhang, Shun; Cao, Jia

2014-05-16

Health promotion for prevention and control of Tuberculosis (TB) is implemented worldwide because of its importance, but few reports have evaluated its impact on behavior due to a lack of standard outcome indicators. The objective of this study was to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. A two-round modified Delphi method involving sixteen TB control experts was used to establish a framework of behavioral indicators for outcome evaluation of TB health promotion targeted at TB suspects and patients. Sixteen of seventeen invited experts in TB control (authority score of 0.91 on a 1.0 scale) participated in round 1 survey. All sixteen experts also participated in a second round survey. After two rounds of surveys and several iterations among the experts, there was consensus on a framework of indicators for measuring outcomes of TB health promotion for TB suspects and patients. For TB suspects, the experts reached consensus on 2 domains ("Healthcare seeking behavior" and "Transmission prevention"), 3 subdomains ("Seeking care after onset of TB symptoms", "Pathways of seeking care" and "Interpersonal contact etiquette"), and 8 indicators (including among others, "Length of patient delay"). For TB patients, consensus was reached on 3 domains ("Adherence to treatment", "Healthy lifestyle" and "Transmission prevention"), 8 subdomains (including among others, "Adherence to their medication"), and 14 indicators (including "Percentage of patients who adhered to their medication"). Operational definitions and data sources were provided for each indicator. The findings of this study provide the basis for debate among international experts on a framework for achieving global consensus on outcome indicators for TB health promotion interventions targeted at TB patients and suspects. Such consensus will help to increase effectiveness of TB health promotion, while ensuring international comparability of outcome data.

International perspective on common core competencies for occupational physicians: a modified Delphi study.

PubMed

Lalloo, Drushca; Demou, Evangelia; Kiran, Sibel; Cloeren, Marianne; Mendes, René; Macdonald, Ewan B

2016-07-01

The competencies required of occupational physicians (OPs) have been the subject of peer-reviewed research in Europe and individual countries around the world. In the European Union (EU), there has been development of guidance on training and common competencies, but little research has extended beyond this. The aim of this study was to obtain consensus on and identify the common core competencies required of OPs around the world. A modified Delphi study was carried out among representative organisations and networks of OPs in a range of countries around the world. It was conducted in 2 rounds using a questionnaire based on the specialist training syllabus of a number of countries, expert panel reviews and conference discussions. Responses were received from 51 countries around the world, with the majority from Europe (60%; 59%) and North and South America (24%; 32%) in rounds 1 and 2, respectively. General principles of assessment and management of occupational hazards to health and good clinical care were jointly considered most important in ranking when compared with the other topic areas. Assessment of disability and fitness for work, communication skills and legal and ethical issues completed the top five. In both rounds, research methods and teaching and educational supervision were considered least important. This study has established the current priorities among OPs across 51 countries of the common competencies required for occupational health (OH) practice. These findings can serve as a platform for the development of common core competencies/qualifications within specific geographical regions or internationally. This is particularly pertinent with globalisation of commerce and free movement within the EU. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Radiological clinical trials: Proposal of a problem-finding questionnaire to improve study success.

PubMed

Valdora, Francesca; Bignotti, Bianca; Calabrese, Massimo; Houssami, Nehmat; Tagliafico, Alberto

2016-12-26

To develop a survey to help define the main problems in radiological clinical trials. Since 2006, we have managed seven different radiological clinical trials recruiting patients in academic and non-academic centres. We developed a preliminary questionnaire using a four-round Delphi approach to identify problems occurring in radiological clinical trials run at our centre. We investigated the recruitment experience, involvement of all multi-disciplinary team members and main obstacles to completing the projects. A final round of Delphi processes elucidated solutions to the identified problems. Among 19/20 (95%) respondents, 10 (53%) were young physicians (under 35 years old), and the respondents included non-faculty members, fellows, residents, and undergraduate students. Ninety-four percent (18/19) of respondents showed interest in conducting clinical trials. On a scale of 1 to 10, the problems with higher/worse scores (8-9) were related to technical or communication problems. The most frequent problems across all studies were technical problems related to clinical trial equipment, insufficient willingness to participate, obstacles to understanding the design of electronic-case report form and extra work. The developed questionnaire identified the main recurring problems in radiological clinical trials as perceived by end-users and helped define possible solutions that are mostly related to having dedicated clinical trial research staff.

Competencies of specialised wound care nurses: a European Delphi study.

PubMed

Eskes, Anne M; Maaskant, Jolanda M; Holloway, Samantha; van Dijk, Nynke; Alves, Paulo; Legemate, Dink A; Ubbink, Dirk T; Vermeulen, Hester

2014-12-01

Health care professionals responsible for patients with complex wounds need a particular level of expertise and education to ensure optimum wound care. However, uniform education for those working as wound care nurses is lacking. We aimed to reach consensus among experts from six European countries as to the competencies for specialised wound care nurses that meet international professional expectations and educational systems. Wound care experts including doctors, wound care nurses, lecturers, managers and head nurses were invited to contribute to an e-Delphi study. They completed online questionnaires based on the Canadian Medical Education Directives for Specialists framework. Suggested competencies were rated on a 9-point Likert scale. Consensus was defined as an agreement of at least 75% for each competence. Response rates ranged from 62% (round 1) to 86% (rounds 2 and 3). The experts reached consensus on 77 (80%) competences. Most competencies chosen belonged to the domain 'scholar' (n = 19), whereas few addressed those associated with being a 'health advocate' (n = 7). Competencies related to professional knowledge and expertise, ethical integrity and patient commitment were considered most important. This consensus on core competencies for specialised wound care nurses may help achieve a more uniform definition and education for specialised wound care nurses. © 2013 The Authors. International Wound Journal © 2013 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

Development and initial validation of a content taxonomy for patient records in general dentistry

PubMed Central

Acharya, Amit; Hernandez, Pedro; Thyvalikakath, Thankam; Ye, Harold; Song, Mei; Schleyer, Titus

2013-01-01

Objective Develop and validate an initial content taxonomy for patient records in general dentistry. Methods Phase 1–Obtain 95 de-identified patient records from 11 general dentists in the United States. Phase 2–Extract individual data fields (information items), both explicit (labeled) and implicit (unlabeled), from records, and organize into categories mirroring original field context. Phase 3–Refine raw list of information items by eliminating duplicates/redundancies and focusing on general dentistry. Phase 4–Validate all items regarding inclusion and importance using a two-round Delphi study with a panel of 22 general dentists active in clinical practice, education, and research. Results Analysis of 76 patient records from 9 dentists, combined with previous work, yielded a raw list of 1,509 information items. Refinement reduced this list to 1,107 items, subsequently rated by the Delphi panel. The final model contained 870 items, with 761 (88%) rated as mandatory. In Round 1, 95% (825) of the final items were accepted, in Round 2 the remaining 5% (45). Only 45 items on the initial list were rejected and 192 (or 17%) remained equivocal. Conclusion Grounded in the reality of clinical practice, our proposed content taxonomy represents a significant advance over existing guidelines and standards by providing a granular and comprehensive information representation for general dental patient records. It offers a significant foundational asset for implementing an interoperable health information technology infrastructure for general dentistry. PMID:23838618

Building consensus on key priorities for rural health care in South Africa using the Delphi technique.

PubMed

Versteeg, Marije; du Toit, Lilo; Couper, Ian

2013-01-24

South Africa is currently undergoing major health system restructuring in an attempt to improve health outcomes and reduce inequities in access. Such inequities exist between private and public health care and within the public health system itself. Experience shows that rural health care can be disadvantaged in policy formulation despite good intentions. The objective of this study was to identify the major challenges and priority interventions for rural health care provision in South Africa thereby contributing to pro-rural health policy dialogue. The Delphi technique was used to develop consensus on a list of statements that was generated through interviews and literature review. A panel of rural health practitioners and other stakeholders was asked to indicate their level of agreement with these statements and to rank the top challenges in and interventions required for rural health care. Response rates ranged from 83% in the first round (n=44) to 64% in the final round (n=34). The top five priorities were aligned to three of the WHO health system building blocks: human resources for health (HRH), governance, and finance. Specifically, the panel identified a need to focus on recruitment and support of rural health professionals, the employment of managers with sufficient and appropriate skills, a rural-friendly national HRH plan, and equitable funding formulae. Specific policies and strategies are required to address the greatest rural health care challenges and to ensure improved access to quality health care in rural South Africa. In addition, a change in organisational climate and a concerted effort to make a career in rural health appealing to health care workers and adequate funding for rural health care provision are essential.

Building consensus on key priorities for rural health care in South Africa using the Delphi technique

PubMed Central

Versteeg, Marije; du Toit, Lilo; Couper, Ian

2013-01-01

Background South Africa is currently undergoing major health system restructuring in an attempt to improve health outcomes and reduce inequities in access. Such inequities exist between private and public health care and within the public health system itself. Experience shows that rural health care can be disadvantaged in policy formulation despite good intentions. The objective of this study was to identify the major challenges and priority interventions for rural health care provision in South Africa thereby contributing to pro-rural health policy dialogue. Methods The Delphi technique was used to develop consensus on a list of statements that was generated through interviews and literature review. A panel of rural health practitioners and other stakeholders was asked to indicate their level of agreement with these statements and to rank the top challenges in and interventions required for rural health care. Results Response rates ranged from 83% in the first round (n=44) to 64% in the final round (n=34). The top five priorities were aligned to three of the WHO health system building blocks: human resources for health (HRH), governance, and finance. Specifically, the panel identified a need to focus on recruitment and support of rural health professionals, the employment of managers with sufficient and appropriate skills, a rural-friendly national HRH plan, and equitable funding formulae. Conclusion Specific policies and strategies are required to address the greatest rural health care challenges and to ensure improved access to quality health care in rural South Africa. In addition, a change in organisational climate and a concerted effort to make a career in rural health appealing to health care workers and adequate funding for rural health care provision are essential. PMID:23364081

Clinical practice guidelines for the surgical management of colon cancer: a consensus statement of the Hellenic and Cypriot Colorectal Cancer Study Group by the HeSMO*

PubMed Central

Xynos, Evaghelos; Gouvas, Nikolaos; Triantopoulou, Charina; Tekkis, Paris; Vini, Louiza; Tzardi, Maria; Boukovinas, Ioannis; Androulakis, Nikolaos; Athanasiadis, Athanasios; Christodoulou, Christos; Chrysou, Evangelia; Dervenis, Christos; Emmanouilidis, Christos; Georgiou, Panagiotis; Katopodi, Ourania; Kountourakis, Panteleimon; Makatsoris, Thomas; Papakostas, Pavlos; Papamichael, Demetris; Pentheroudakis, Georgios; Pilpilidis, Ioannis; Sgouros, Joseph; Vassiliou, Vassilios; Xynogalos, Spyridon; Ziras, Nikolaos; Karachaliou, Niki; Zoras, Odysseas; Agalianos, Christos; Souglakos, John

2016-01-01

Despite considerable improvement in the management of colon cancer, there is a great deal of variation in the outcomes among European countries, and in particular among different hospital centers in Greece and Cyprus. Discrepancy in the approach strategies and lack of adherence to guidelines for the management of colon cancer may explain the situation. The aim was to elaborate a consensus on the multidisciplinary management of colon cancer, based on European guidelines (ESMO and EURECCA), and also taking into account local special characteristics of our healthcare system. Following discussion and online communication among members of an executive team, a consensus was developed. Statements entered the Delphi voting system on two rounds to achieve consensus by multidisciplinary international experts. Statements with an agreement rate of ≥80% achieved a large consensus, while those with an agreement rate of 60-80% a moderate consensus. Statements achieving an agreement of <60% after both rounds were rejected and not presented. Sixty statements on the management of colon cancer were subjected to the Delphi methodology. Voting experts were 109. The median rate of abstain per statement was 10% (range: 0-41%). In the end of the voting process, all statements achieved a consensus by more than 80% of the experts. A consensus on the management of colon cancer was developed by applying the Delphi methodology. Guidelines are proposed along with algorithms of diagnosis and treatment. The importance of centralization, care by a multidisciplinary team, and adherence to guidelines is emphasized. PMID:26752945

Designing a model of patient tracking system for natural disaster in Iran

PubMed Central

Tavakoli, Nahid; Yarmohammadian, Mohammad H.; Safdari, Reza; Keyvanara, Mahmoud

2017-01-01

CONTEXT: Disaster patient tracking consists of identifying and registering patients, recording data on their medical conditions, settings priorities for evacuation of scene, locating the patients from scene to health care centers and then till completion of treatment and discharge. AIM: The aim of this study was to design a model of patient tracking system for natural disaster in Iran. MATERIALS AND METHODS: This applied study was conducted in two steps in 2016. First, data on disaster patient tracking systems used in selected countries were collected from library-printed and electronic references and then compared. Next, a preliminary model of disaster patient tracking system was provided using these systems and validated by Delphi technique and focus group. The data of the first step were analyzed by content analysis and those of the second step by descriptive statistics. RESULTS: Analysis of the comments of key information persons in three Delphi rounds, consisting of national experts, yielded three themes, i.e., content, function, and technology, ten subthemes, and 127 components, with consensus rate of over 75%, to provide a disaster patient tracking system for Iran. CONCLUSION: In Iran, there is no comprehensive process to manage the data on disaster patients. Offering a patient tracking system can be considered a humanitarian and effective measure to promote the process of identifying, caring for, evacuating, and transferring patients as well as documenting and following up their medical and location conditions from scene till completion of the treatment. PMID:28852666

Engaging communication experts in a Delphi process to identify patient behaviors that could enhance communication in medical encounters

PubMed Central

2010-01-01

Background The communication literature currently focuses primarily on improving physicians' verbal and non-verbal behaviors during the medical interview. The Four Habits Model is a teaching and research framework for physician communication that is based on evidence linking specific communication behaviors with processes and outcomes of care. The Model conceptualizes basic communication tasks as "Habits" and describes the sequence of physician communication behaviors during the clinical encounter associated with improved outcomes. Using the Four Habits Model as a starting point, we asked communication experts to identify the verbal communication behaviors of patients that are important in outpatient encounters. Methods We conducted a 4-round Delphi process with 17 international experts in communication research, medical education, and health care delivery. All rounds were conducted via the internet. In round 1, experts reviewed a list of proposed patient verbal communication behaviors within the Four Habits Model framework. The proposed patient verbal communication behaviors were identified based on a review of the communication literature. The experts could: approve the proposed list; add new behaviors; or modify behaviors. In rounds 2, 3, and 4, they rated each behavior for its fit (agree or disagree) with a particular habit. After each round, we calculated the percent agreement for each behavior and provided these data in the next round. Behaviors receiving more than 70% of experts' votes (either agree or disagree) were considered as achieving consensus. Results Of the 14 originally-proposed patient verbal communication behaviors, the experts modified all but 2, and they added 20 behaviors to the Model in round 1. In round 2, they were presented with 59 behaviors and 14 options to remove specific behaviors for rating. After 3 rounds of rating, the experts retained 22 behaviors. This set included behaviors such as asking questions, expressing preferences, and summarizing information. Conclusion The process identified communication tasks and verbal communication behaviors for patients similar to those outlined for physicians in the Four Habits Model. This represents an important step in building a single model that can be applied to teaching patients and physicians the communication skills associated with improved satisfaction and positive outcomes of care. PMID:20403173

Characterizing Treatable Causes of Small-Fiber Polyneuropathy in Gulf War Veterans

DTIC Science & Technology

2017-10-01

this study Global experts participated in additional rounds of a Delphi process to determine the most reliable markers for SFPN ( Case Definition). We...We supplemented the pertinent information on SFPN and added a link to this study as a recruitment tool. The public portion of the website may be...propose as part of the Case Definition. The database currently contains data on 3,495 subjects consisting of 3,087 patients and 408 healthy controls

An opportunity in difficulty: Japan-Korea-Taiwan expert Delphi consensus on surgical difficulty during laparoscopic cholecystectomy.

PubMed

Iwashita, Yukio; Hibi, Taizo; Ohyama, Tetsuji; Honda, Goro; Yoshida, Masahiro; Miura, Fumihiko; Takada, Tadahiro; Han, Ho-Seong; Hwang, Tsann-Long; Shinya, Satoshi; Suzuki, Kenji; Umezawa, Akiko; Yoon, Yoo-Seok; Choi, In-Seok; Huang, Wayne Shih-Wei; Chen, Kuo-Hsin; Watanabe, Manabu; Abe, Yuta; Misawa, Takeyuki; Nagakawa, Yuichi; Yoon, Dong-Sup; Jang, Jin-Young; Yu, Hee Chul; Ahn, Keun Soo; Kim, Song Cheol; Song, In Sang; Kim, Ji Hoon; Yun, Sung Su; Choi, Seong Ho; Jan, Yi-Yin; Shan, Yan-Shen; Ker, Chen-Guo; Chan, De-Chuan; Wu, Cheng-Chung; Lee, King-Teh; Toyota, Naoyuki; Higuchi, Ryota; Nakamura, Yoshiharu; Mizuguchi, Yoshiaki; Takeda, Yutaka; Ito, Masahiro; Norimizu, Shinji; Yamada, Shigetoshi; Matsumura, Naoki; Shindoh, Junichi; Sunagawa, Hiroki; Gocho, Takeshi; Hasegawa, Hiroshi; Rikiyama, Toshiki; Sata, Naohiro; Kano, Nobuyasu; Kitano, Seigo; Tokumura, Hiromi; Yamashita, Yuichi; Watanabe, Goro; Nakagawa, Kunitoshi; Kimura, Taizo; Yamakawa, Tatsuo; Wakabayashi, Go; Mori, Rintaro; Endo, Itaru; Miyazaki, Masaru; Yamamoto, Masakazu

2017-04-01

We previously identified 25 intraoperative findings during laparoscopic cholecystectomy (LC) as potential indicators of surgical difficulty per nominal group technique. This study aimed to build a consensus among expert LC surgeons on the impact of each item on surgical difficulty. Surgeons from Japan, Korea, and Taiwan (n = 554) participated in a Delphi process and graded the 25 items on a seven-stage scale (range, 0-6). Consensus was defined as (1) the interquartile range (IQR) of overall responses ≤2 and (2) ≥66% of the responses concentrated within a median ± 1 after stratification by workplace and LC experience level. Response rates for the first and the second-round Delphi were 92.6% and 90.3%, respectively. Final consensus was reached for all the 25 items. 'Diffuse scarring in the Calot's triangle area' in the 'Factors related to inflammation of the gallbladder' category had the strongest impact on surgical difficulty (median, 5; IQR, 1). Surgeons agreed that the surgical difficulty increases as more fibrotic change and scarring develop. The median point for each item was set as the difficulty score. A Delphi consensus was reached among expert LC surgeons on the impact of intraoperative findings on surgical difficulty. © 2017 Japanese Society of Hepato-Biliary-Pancreatic Surgery.

Development of Australian clinical practice outcome standards for graduates of critical care nurse education.

PubMed

Gill, Fenella J; Leslie, Gavin D; Grech, Carol; Boldy, Duncan; Latour, Jos M

2015-02-01

To develop critical care nurse education practice standards. Critical care specialist education for registered nurses in Australia is provided at graduate level. Considerable variation exists across courses with no framework to guide practice outcomes or evidence supporting the level of qualification. An eDelphi technique involved the iterative process of a national expert panel responding to three survey rounds. For the first round, 84 statements, organised within six domains, were developed from earlier phases of the study that included a literature review, analysis of critical care courses and input from health consumers. The panel, which represented the perspectives of four stakeholder groups, responded to two rating scales: level of importance and level of practice. Of 105 experts who agreed to participate, 92 (88%) completed survey round I; 85 (92%) round II; and 73 (86%) round III. Of the 98 statements, 75 were rated as having a high level of importance - median 7 (IQR 6-7); 14 were rated as having a moderate level of importance - median 6 (IQR 5-7); and nine were rated as having a low level of importance - median 4 (IQR 4-6)-6 (IQR 4-6). The majority of the panel rated graduate level of practice as 'demonstrates independently' or 'teaches or supervises others' for 80 statements. For 18 statements, there was no category selected by 50% or more of the panel. The process resulted in the development of 98 practice standards, categorised into three levels, indicating a practice outcome level by the practitioner who can independently provide nursing care for a variety of critically ill patients in most contexts, using a patient- and family-focused approach. The graduate practice outcomes provide a critical care qualification definition for nursing workforce standards and can be used by course providers to achieve consistent practice outcomes. © 2014 John Wiley & Sons Ltd.

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study

PubMed Central

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-01-01

Background The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. Objective This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. Design A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Results Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. Discussion and conclusions This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. PMID:27540101