Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi consensus approach.

PubMed

Wakai, Abel; O'Sullivan, Ronan; Staunton, Paul; Walsh, Cathal; Hickey, Fergal; Plunkett, Patrick K

2013-04-01

The objective of this study was to develop a consensus among emergency medicine (EM) specialists working in Ireland for emergency department (ED) key performance indicators (KPIs). The method employed was a three-round electronic modified-Delphi process. An online questionnaire with 54 potential KPIs was set up for round 1 of the Delphi process. The Delphi panel consisted of all registered EM specialists in Ireland. Each indicator on the questionnaire was rated using a five-point Likert-type rating scale. Agreement was defined as at least 70% of the responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using standard descriptive statistics. Data were also analysed as the mean of the Likert rating with 95% confidence intervals (95% CIs). Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Statistical analyses were carried out using SPSS version 16.0. The response rates in rounds 1, 2 and 3 were 86, 88 and 88%, respectively. Ninety-seven potential indicators reached agreement after the three rounds. In the context of the Donabedian structure-process-outcome framework of performance indicators, 41 (42%) of the agreed indicators were structure indicators, 52 (54%) were process indicators and four (4%) were outcome indicators. Overall, the top-three highest rated indicators were: presence of a dedicated ED clinical information system (4.7; 95% CI 4.6-4.9), ED compliance with minimum design standards (4.7; 95% CI 4.5-4.8) and time from ED arrival to first ECG in suspected cardiac chest pain (4.7; 95% CI 4.5-4.9). The top-three highest rated indicators specific to clinical care of children in EDs were: time to administration of antibiotics in children with suspected bacterial meningitis (4.6; 95% CI 4.5-4.8), separate area available within EDs (seeing both adults and children) to assess children (4.4; 95% CI 4.2-4.6) and time to administration of analgesia in children with forearm fractures (4.4; 95% CI 4.2-4.7). Employing a Delphi consensus process, it was possible to reach a consensus among EM specialists in Ireland on a suite of 97 KPIs for EDs.

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study

PubMed Central

2017-01-01

Background Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. Objective The aim of this study was to develop and prioritize measures of digital patient engagement based on patients’ use of the US Department of Veterans Affairs (VA)’s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. Methods We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. Results All 12 experts completed the study’s three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian’s three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). Conclusions This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients’ use of VA’s My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. PMID:28550008

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study.

PubMed

Garvin, Lynn A; Simon, Steven R

2017-05-26

Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. The aim of this study was to develop and prioritize measures of digital patient engagement based on patients' use of the US Department of Veterans Affairs (VA)'s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. All 12 experts completed the study's three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian's three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients' use of VA's My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. ©Lynn A Garvin, Steven R Simon. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.05.2017.

Defining a Research Agenda for Patient-Reported Outcomes in Surgery: A Delphi Survey of Stakeholders

PubMed Central

Pezold, Michael L.; Pusic, Andrea L.; Cohen, Wess A.; Hollenberg, James P.; Butt, Zeeshan; Flum, David R.; Temple, Larissa K.

2016-01-01

Background Identifying timely and important research questions using relevant patient-reported outcomes (PROs) in surgery remains paramount in the current medical climate. The inaugural Patient-Reported Outcomes in Surgery Conference brought together stakeholders in PROs research in surgery, with the aim of creating a research agenda to help determine future directions and advance cross-disciplinary collaboration. Study Design An iterative Web-based interface was used to create a modified Delphi survey. Participation was limited to conference registrants, which included surgeons, PROs researchers, payers, and other stakeholders. In the first round, research items were generated from qualitative review of responses to open-ended prompts. In the second round, items were ranked using a 5-point Likert scale; attendees were also asked to submit any new items. In the final round, the top 30 items and newly submitted items were redistributed for final ranking using a 3-point Likert scale. The top 20 items by mean rating were selected for the research agenda. Results In round one, participants submitted 459 items, which were reduced to 53 distinct items within seven themes of PROs research. A research agenda was formulated after two successive rounds of ranking. The research agenda identified three themes important for future PROs research in surgery: (1) PROs in the decision-making process, (2) integrating PROs into the EHR and, (3) measuring quality in surgery with PROs. Conclusions The PROS Conference research agenda was created using a modified Delphi survey of stakeholders that will help researchers, surgeons, and funders identify crucial areas of future PROs research in surgery. PMID:27437666

Development of an antibiotic spectrum score based on veterans affairs culture and susceptibility data for the purpose of measuring antibiotic de-escalation: a modified Delphi approach.

PubMed

Madaras-Kelly, Karl; Jones, Makoto; Remington, Richard; Hill, Nicole; Huttner, Benedikt; Samore, Matthew

2014-09-01

Development of a numerical score to measure the microbial spectrum of antibiotic regimens (spectrum score) and method to identify antibiotic de-escalation events based on application of the score. Web-based modified Delphi method. Physician and pharmacist antimicrobial stewards practicing in the United States recruited through infectious diseases-focused listservs. Three Delphi rounds investigated: organisms and antibiotics to include in the spectrum score, operationalization of rules for the score, and de-escalation measurement. A 4-point ordinal scale was used to score antibiotic susceptibility for organism-antibiotic domain pairs. Antibiotic regimen scores, which represented combined activity of antibiotics in a regimen across all organism domains, were used to compare antibiotic spectrum administered early (day 2) and later (day 4) in therapy. Changes in spectrum score were calculated and compared with Delphi participants' judgments on de-escalation with 20 antibiotic regimen vignettes and with non-Delphi steward judgments on de-escalation of 300 pneumonia regimen vignettes. Method sensitivity and specificity to predict expert de-escalation status were calculated. Twenty-four participants completed all Delphi rounds. Expert support for concepts utilized in metric development was identified. For vignettes presented in the Delphi, the sign of change in score correctly classified de-escalation in all vignettes except those involving substitution of oral antibiotics. The sensitivity and specificity of the method to identify de-escalation events as judged by non-Delphi stewards were 86.3% and 96.0%, respectively. Identification of de-escalation events based on an algorithm that measures microbial spectrum of antibiotic regimens generally agreed with steward judgments of de-escalation status.

Development and pilot testing of an informed consent video for patients with limb trauma prior to debridement surgery using a modified Delphi technique.

PubMed

Lin, Yen-Ko; Chen, Chao-Wen; Lee, Wei-Che; Lin, Tsung-Ying; Kuo, Liang-Chi; Lin, Chia-Ju; Shi, Leiyu; Tien, Yin-Chun; Cheng, Yuan-Chia

2017-11-29

Ensuring adequate informed consent for surgery in a trauma setting is challenging. We developed and pilot tested an educational video containing information regarding the informed consent process for surgery in trauma patients and a knowledge measure instrument and evaluated whether the audiovisual presentation improved the patients' knowledge regarding their procedure and aftercare and their satisfaction with the informed consent process. A modified Delphi technique in which a panel of experts participated in successive rounds of shared scoring of items to forecast outcomes was applied to reach a consensus among the experts. The resulting consensus was used to develop the video content and questions for measuring the understanding of the informed consent for debridement surgery in limb trauma patients. The expert panel included experienced patients. The participants in this pilot study were enrolled as a convenience sample of adult trauma patients scheduled to receive surgery. The modified Delphi technique comprised three rounds over a 4-month period. The items given higher scores by the experts in several categories were chosen for the subsequent rounds until consensus was reached. The experts reached a consensus on each item after the three-round process. The final knowledge measure comprising 10 questions was developed and validated. Thirty eligible trauma patients presenting to the Emergency Department (ED) were approached and completed the questionnaires in this pilot study. The participants exhibited significantly higher mean knowledge and satisfaction scores after watching the educational video than before watching the video. Our process is promising for developing procedure-specific informed consent and audiovisual aids in medical and surgical specialties. The educational video was developed using a scientific method that integrated the opinions of different stakeholders, particularly patients. This video is a useful tool for improving the knowledge and satisfaction of trauma patients in the ED. The modified Delphi technique is an effective method for collecting experts' opinions and reaching a consensus on the content of educational materials for informed consent. Institutions should prioritize patient-centered health care and develop a structured informed consent process to improve the quality of care. The ClinicalTrials.gov Identifier is NCT01338480 . The date of registration was April 18, 2011 (retrospectively registered).

Physical Restraints: Consensus of a Research Definition Using a Modified Delphi Technique.

PubMed

Bleijlevens, Michel H C; Wagner, Laura M; Capezuti, Elizabeth; Hamers, Jan P H

2016-11-01

To develop an internationally accepted research definition of physical restraint. Comprehensive literature search followed by a web-based, three-round, modified Delphi technique comprising reviews and feedback. Clinical care settings. An international group of 48 experts consisting of researchers and clinicians from 14 countries who have made sustained contribution to research and clinical application in the field of physical restraint in clinical care. Data were collected using an online survey program and one in-person meeting. Results of the online survey and the in-person meeting were used for distribution in subsequent rounds until consensus on a definition was reached. Consensus was defined as 90% of the participating experts agreeing with the proposed definition of physical restraint. Thirty-four different definitions were identified during the literature search and served as a starting point for the modified Delphi technique. After three rounds, 45 (95.7%) of 47 remaining experts agreed with the newly proposed definition: "Physical restraint is defined as any action or procedure that prevents a person's free body movement to a position of choice and/or normal access to his/her body by the use of any method, attached or adjacent to a person's body that he/she cannot control or remove easily." A multidisciplinary, internationally representative panel of experts reached consensus on a research definition for physical restraints in older persons. This is a necessary step toward improved comparisons of the prevalence of physical restraint use across studies and countries. This definition can further guide research interventions aimed at reducing use of physical restraints. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Defining Malaysian Knowledge Society: Results from the Delphi Technique

NASA Astrophysics Data System (ADS)

Hamid, Norsiah Abdul; Zaman, Halimah Badioze

This paper outlines the findings of research where the central idea is to define the term Knowledge Society (KS) in Malaysian context. The research focuses on three important dimensions, namely knowledge, ICT and human capital. This study adopts a modified Delphi technique to seek the important dimensions that can contribute to the development of Malaysian's KS. The Delphi technique involved ten experts in a five-round iterative and controlled feedback procedure to obtain consensus on the important dimensions and to verify the proposed definition of KS. The finding shows that all three dimensions proposed initially scored high and moderate consensus. Round One (R1) proposed an initial definition of KS and required comments and inputs from the panel. These inputs were then used to develop items for a R2 questionnaire. In R2, 56 out of 73 items scored high consensus and in R3, 63 out of 90 items scored high. R4 was conducted to re-rate the new items, in which 8 out of 17 items scored high. Other items scored moderate consensus and no item scored low or no consensus in all rounds. The final round (R5) was employed to verify the final definition of KS. Findings and discovery of this study are significant to the definition of KS and the development of a framework in the Malaysian context.

What should dental services for people with disabilities be like? Results of an Irish Delphi panel survey.

PubMed

Mac Giolla Phadraig, Caoimhin; Nunn, June; Dougall, Alison; O'Neill, Eunan; McLoughlin, Jacinta; Guerin, Suzanne

2014-01-01

This study aimed to generate prioritised goals for oral health services for people with disabilities as a first step in meeting the need for evidence based oral health services for people with disabilities in Ireland. The study used a three round modified e-Delphi method, involving dental service professionals and people with disabilities or their representatives, in Ireland. Three rounds were completed online using SurveyMonkey. Round 1 asked: "List what you think dental services for people with disabilities in Ireland should be like." Items for subsequent rounds were generated from responses to Round 1. Round 2 and Round 3 used 5 point Likert scales to rank these items by priority: from No Priority (1) to Top Priority (5). Consensus was achieved on each item where at least 80% of respondents considered an item either High or Top Priority. A consensus meeting concluded the process. Sixty-one panelists started and 48 completed the survey. The Delphi panel agreed on level of priority for 69 items and generated 16 consensus statements. These statements covered a range of topics such as access to care, availability of information and training, quality of care, dental treatment and cost. A recurrent theme relating to the appropriateness of care to individual need arose across topics suggesting a need to match service delivery according to the individual's needs, wants and expectations rather than the disability type/diagnosis based service which predominates today. This process produced a list of prioritised goals for dental services for people with disabilities. This creates a foundation for building evidence-based service models for people with disabilities in Ireland.

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study.

PubMed

Mascherek, Anna C; Schwappach, David L B

2016-08-05

Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study

PubMed Central

Mascherek, Anna C

2016-01-01

Objective Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. Design As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Results Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Conclusions Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. PMID:27496233

The competencies of Registered Nurses working in care homes: a modified Delphi study.

PubMed

Stanyon, Miriam Ruth; Goldberg, Sarah Elizabeth; Astle, Anita; Griffiths, Amanda; Gordon, Adam Lee

2017-07-01

registered Nurses (RNs) working in UK care homes receive most of their training in acute hospitals. At present the role of care home nursing is underdeveloped and it is seen as a low status career. We describe here research to define core competencies for RNs working in UK care homes. a two-stage process was adopted. A systematic literature review and focus groups with stakeholders provided an initial list of competencies. The competency list was modified over three rounds of a Delphi process with a multi-disciplinary expert panel of 28 members. twenty-two competencies entered the consensus process, all competencies were amended and six split. Thirty-one competencies were scored in round two, eight were agreed as essential, one competency was split into two. Twenty-four competencies were submitted for scoring in round three. In total, 22 competencies were agreed as essential for RNs working in care homes. A further 10 competencies did not reach consensus. the output of this study is an expert-consensus list of competencies for RNs working in care homes. This would be a firm basis on which to build a curriculum for this staff group. © The Author 2017. Published by Oxford University Press on behalf of the British Geriatrics Society.All rights reserved. For permissions, please email: journals.permissions@oup.com

Research priorities for respiratory nursing: a UK-wide Delphi study.

PubMed

Kelly, Carol Ann; Kirkcaldy, Andrew J; Pilkington, Melissa; Hodson, Matthew; Welch, Lindsay; Yorke, Janelle; Knighting, Katherine

2018-04-01

Respiratory nurses make a significant contribution to the delivery of respiratory healthcare, but there is a dearth of nurse-led, practice-focused, published research. Using a modified three-round Delphi, this study sought to identify research priorities for respiratory nursing to inform a national research strategy. Study information and the survey link were sent electronically to members of UK professional respiratory organisations. Round 1 had 78 items across 16 topics, informed by a systematic literature review. Respondents suggested additional items which were content analysed to inform Round 2. Respondents rated all items and ranked the topics in all rounds. To ensure rigour, rounds had an explicit focus with pre-determined criteria for consensus (70%). In total, 363 responses were received across Rounds 1, 2 and 3 (n=183, 95 and 85, respectively). The top five research priorities were: 1) "Patient understanding of asthma control"; 2) "The clinical and cost-effectiveness of respiratory nurse interventions"; 3) "The impact of nurse-led clinics on patient care"; 4) "Inhaler technique"; and 5) two topics jointly scored: "Prevention of exacerbations" and "Symptom management". With potential international significance, this is the first UK study to identify research priorities for respiratory nursing, providing direction for those planning or undertaking research.

Development of clinical pharmacy key performance indicators for hospital pharmacists using a modified Delphi approach.

PubMed

Fernandes, Olavo; Gorman, Sean K; Slavik, Richard S; Semchuk, William M; Shalansky, Steve; Bussières, Jean-François; Doucette, Douglas; Bannerman, Heather; Lo, Jennifer; Shukla, Simone; Chan, Winnie W Y; Benninger, Natalie; MacKinnon, Neil J; Bell, Chaim M; Slobodan, Jeremy; Lyder, Catherine; Zed, Peter J; Toombs, Kent

2015-06-01

Key performance indicators (KPIs) are quantifiable measures of quality. There are no published, systematically derived clinical pharmacy KPIs (cpKPIs). A group of hospital pharmacists aimed to develop national cpKPIs to advance clinical pharmacy practice and improve patient care. A cpKPI working group established a cpKPI definition, 8 evidence-derived cpKPI critical activity areas, 26 candidate cpKPIs, and 11 cpKPI ideal attributes in addition to 1 overall consensus criterion. Twenty-six clinical pharmacists and hospital pharmacy leaders participated in an internet-based 3-round modified Delphi survey. Panelists rated 26 candidate cpKPIs using 11 cpKPI ideal attributes and 1 overall consensus criterion on a 9-point Likert scale. A meeting was facilitated between rounds 2 and 3 to debate the merits and wording of candidate cpKPIs. Consensus was reached if 75% or more of panelists assigned a score of 7 to 9 on the consensus criterion during the third Delphi round. All panelists completed the 3 Delphi rounds, and 25/26 (96%) attended the meeting. Eight candidate cpKPIs met the consensus definition: (1) performing admission medication reconciliation (including best-possible medication history), (2) participating in interprofessional patient care rounds, (3) completing pharmaceutical care plans, (4) resolving drug therapy problems, (5) providing in-person disease and medication education to patients, (6) providing discharge patient medication education, (7) performing discharge medication reconciliation, and (8) providing bundled, proactive direct patient care activities. A Delphi panel of hospital pharmacists was successful in determining 8 consensus cpKPIs. Measurement and assessment of these cpKPIs will serve to advance clinical pharmacy practice and improve patient care. © The Author(s) 2015.

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.

PubMed

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

Engineering's Grand Challenges: Priorities and Integration Recommendations for Technology Education Curriculum Development

ERIC Educational Resources Information Center

Buelin, Jennifer; Clark, Aaron C.; Ernst, Jeremy V.

2016-01-01

In this study, the 14 Grand Challenges for Engineering in the 21st Century identified by the National Academy of Engineering were examined by a panel of experts in an effort to identify prospective curricular integration opportunities in the field of technology and engineering education. The study utilized a three-round modified Delphi methodology…

[University studies plan in geriatric medicine developed using a modified Delphi technique].

PubMed

Vilches-Moraga, Arturo; Ariño-Blasco, Sergio; Verdejo-Bravo, Carlos; Mateos-Nozal, Jesús

2015-01-01

The increase in the number of frail elderly people has led to the necessity that all doctors of the future acquire sufficient knowledge on human ageing and the skills in the management of the patient of advanced age, as well as the diseases associated with ageing. Few countries offer geriatric medicine within undergraduate training. The purpose of the present project was to obtain a consensus between European geriatricians on the minimum requirements that medical students must achieve at the end of their university degree course. A modified Delphi process was used. Firstly, experts in education and geriatrics proposed a set of learning objectives based on a review of the literature. Three Delphi rounds were then performed, in which a panel of 49 experts representing 29 countries affiliated to the European Union of Medical Specialists took part. This enabled them to reach a consensus on a definitive study plan. The number of disagreements after the Delphi rounds 1 and 2 were 81 and 53, respectively. Full agreement was reached after the third round. The definitive study plan consisted of detailed objectives grouped under 10 general training objectives. A consensus has been reached between European geriatricians that sets specific training objectives for medical students. Great efforts will be required for the introduction of these requirements, given the variability there is in the quality of teaching in geriatrics. This study plan is a first step in helping to improve geriatrics teaching in faculties of medicine, and will also serve as a basis to make advances in the training in post-graduate geriatrics throughout Europe. Copyright © 2014 SEGG. Published by Elsevier Espana. All rights reserved.

Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology.

PubMed

Eubank, Breda H; Mohtadi, Nicholas G; Lafave, Mark R; Wiley, J Preston; Bois, Aaron J; Boorman, Richard S; Sheps, David M

2016-05-20

Patients presenting to the healthcare system with rotator cuff pathology do not always receive high quality care. High quality care occurs when a patient receives care that is accessible, appropriate, acceptable, effective, efficient, and safe. The aim of this study was twofold: 1) to develop a clinical pathway algorithm that sets forth a stepwise process for making decisions about the diagnosis and treatment of rotator cuff pathology presenting to primary, secondary, and tertiary healthcare settings; and 2) to establish clinical practice guidelines for the diagnosis and treatment of rotator cuff pathology to inform decision-making processes within the algorithm. A three-step modified Delphi method was used to establish consensus. Fourteen experts representing athletic therapy, physiotherapy, sport medicine, and orthopaedic surgery were invited to participate as the expert panel. In round 1, 123 best practice statements were distributed to the panel. Panel members were asked to mark "agree" or "disagree" beside each statement, and provide comments. The same voting method was again used for round 2. Round 3 consisted of a final face-to-face meeting. In round 1, statements were grouped and reduced to 44 statements that met consensus. In round 2, five statements reached consensus. In round 3, ten statements reached consensus. Consensus was reached for 59 statements representing five domains: screening, diagnosis, physical examination, investigations, and treatment. The final face-to-face meeting was also used to develop clinical pathway algorithms (i.e., clinical care pathways) for three types of rotator cuff pathology: acute, chronic, and acute-on-chronic. This consensus guideline will help to standardize care, provide guidance on the diagnosis and treatment of rotator cuff pathology, and assist in clinical decision-making for all healthcare professionals.

Seeking an oracle: using the Delphi process to develop practice guidelines for the treatment of endometriosis with Chinese herbal medicine.

PubMed

Flower, Andrew; Lewith, George T; Little, Paul

2007-11-01

For most complementary and alternative medicine interventions, the absence of a high-quality evidence base to define good practice presents a serious problem for clinicians, educators, and researchers. The Delphi process may offer a pragmatic way to establish good practice guidelines until more rigorous forms of assessment can be undertaken. To use a modified Delphi to develop good practice guidelines for a feasibility study exploring the role of Chinese herbal medicine (CHM) in the treatment of endometriosis. To compare the outcomes from Delphi with data derived from a systematic review of the Chinese language database. An expert group was convened for a three-round Delphi that initially produced key statements relating to the CHM diagnosis and treatment of endometriosis (round 1) and then anonymously rated these on a 1-7 Likert scale (rounds 2 and 3). Statements with a median score of 5 and above were regarded as demonstrating positive group consensus. The differential diagnoses within Chinese Medicine and rating of the clinical value of individual herbs were then contrasted with comparable data from a review of Chinese language reports in the Chinese Biomedical Retrieval System (1978-2002), and China Academy of Traditional Chinese Medicine (1985-2002) databases and the Chinese TCM and magazine literature (1984-2004) databases. Consensus (good practice) guidelines for the CHM treatment of endometriosis relating to common diagnostic patterns, herb selection, dosage, and patient management were produced. The Delphi guidelines demonstrated a high degree of congruence with the information from the Chinese language databases. In the absence of rigorous evidence, Delphi offers a way to synthesize expert knowledge relating to diagnosis, patient management, and herbal selection in the treatment of endometriosis. The limitations of the expert group and the inability of Delphi to capture the subtle nuances of individualized clinical decision-making limit the usefulness of this approach.

Development of quality indicators for low-risk labor care provided by midwives using a RAND-modified Delphi method.

PubMed

Ueda, Kayo; Ohtera, Shosuke; Kaso, Misato; Nakayama, Takeo

2017-09-22

In childbirth, most deliveries are low-risk, defined as spontaneous labor at full term without special high-risk facts or complications, especially in high-resource countries where maternal and perinatal mortality rates are very low. Indeed, the majority of mothers and infants have no serious conditions during labor. However, the quality of care provided is not assured, and performance may vary by birthing facility and provider. The overuse of technology in childbirth in some parts of the world is almost certainly based on assumptions like, "something can go wrong at any minute." There is a need to assess the quality of care provided for mothers and infants in low-risk labor. We aimed to develop specific quality indicators for low-risk labor care provided primarily by midwives in Japan. We used a RAND-modified Delphi method, which integrates evidence review with expert consensus development. The procedure comprises five steps: (1) literature review, including clinical practice guidelines, to extract and develop quality indicator candidates; (2) formation of a multidisciplinary panel; (3) independent panel ratings (Round 1); (4) panel meeting and independent panel ratings (Round 2); and (5) independent panel ratings (Round 3). The three independent panel ratings (Rounds 1-3) were held between July and December 2012. The assembled multidisciplinary panel comprised eight clinicians (two pediatricians, three obstetricians, and three midwives) and three mothers who were nonclinicians. Evidentiary review extracted 166 key recommendations from 32 clinical practice guidelines, and 31 existing quality indicators were added. After excluding duplicate recommendations and quality indicators, the panel discussed 25 candidate indicators. Of these, 18 were adopted, one was modified, six were not adopted, and four were added during the meeting, respectively. We established 23 quality indicators for low-risk labor care provided by midwives in labor units in Japan.

Developing standards for the development of glaucoma virtual clinics using a modified Delphi approach.

PubMed

Kotecha, Aachal; Longstaff, Simon; Azuara-Blanco, Augusto; Kirwan, James F; Morgan, James Edwards; Spencer, Anne Fiona; Foster, Paul J

2018-04-01

To obtain consensus opinion for the development of a standards framework for the development and implementation of virtual clinics for glaucoma monitoring in the UK using a modified Delphi methodology. A modified Delphi technique was used that involved sampling members of the UK Glaucoma and Eire Society (UKEGS). The first round scored the strength of agreement to a series of standards statements using a 9-point Likert scale. The revised standards were subjected to a second round of scoring and free-text comment. The final standards were discussed and agreed by an expert panel consisting of seven glaucoma subspecialists from across the UK. A version of the standards was submitted to external stakeholders for a 3-month consultation. There was a 44% response rate of UKEGS members to rounds 1 and 2, consisting largely of consultant ophthalmologists with a specialist interest in glaucoma. The final version of the standards document was validated by stakeholder consultation and contains four sections pertaining to the patient groups, testing methods, staffing requirements and governance structure of NHS secondary care glaucoma virtual clinic models. Use of a modified Delphi approach has provided consensus agreement for the standards required for the development of virtual clinics to monitor glaucoma in the UK. It is anticipated that this document will be useful as a guide for those implementing this model of service delivery. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Insufficiently studied factors related to burnout in nursing: Results from an e-Delphi study

PubMed Central

2017-01-01

Objective This study aimed to identify potentially important factors in explaining burnout in nursing that have been insufficiently studied or ignored. Methods A three-round Delphi study via e-mail correspondence was conducted, with a group of 40 European experts. The e-Delphi questionnaire consisted of 52 factors identified from a literature review. Experts rated and scored the importance of factors in the occurrence of burnout and the degree of attention given by researchers to each of the variables listed, on a six-point Likert scale. We used the agreement percentage (>80%) to measure the level of consensus between experts. Furthermore, to confirm the level of consensus, we also calculated mean scores and modes. Regardless of the degree of consensus reached by the experts, we have calculated the mean of the stability of the answers for each expert (individual's qualitative stability) and the mean of the stability percentages of the experts (qualitative group stability). Results The response rate in the three rounds was 93.02% (n = 40). Eight new factors were suggested in the first round. After modified, the e-Delphi questionnaire in the second and third rounds had 60 factors. All the factors reached the third round with a consensus level above 80% in terms of the attention that researchers gave them in their studies. Moreover, the data show a total mean qualitative group stability of 96.21%. In the third round 9 factors were classified by experts as ‘studied very little’, 17 as ‘studied little’ and 34 as 'well studied' Conclusion Findings show that not all the factors that may influence nursing burnout have received the same attention from researchers. The panel of experts has identified factors that, although important in explaining burnout, have been poorly studied or even forgotten. Our results suggest that further study into factors such as a lack of recognition of part of the tasks that nurses perform, feminine stereotype or excessive bureaucracy is needed for a better understanding of this syndrome and improve the quality of life in nurses. PMID:28388660

Research priorities for respiratory nursing: a UK-wide Delphi study

PubMed Central

Pilkington, Melissa; Hodson, Matthew; Welch, Lindsay; Yorke, Janelle

2018-01-01

Respiratory nurses make a significant contribution to the delivery of respiratory healthcare, but there is a dearth of nurse-led, practice-focused, published research. Using a modified three-round Delphi, this study sought to identify research priorities for respiratory nursing to inform a national research strategy. Study information and the survey link were sent electronically to members of UK professional respiratory organisations. Round 1 had 78 items across 16 topics, informed by a systematic literature review. Respondents suggested additional items which were content analysed to inform Round 2. Respondents rated all items and ranked the topics in all rounds. To ensure rigour, rounds had an explicit focus with pre-determined criteria for consensus (70%). In total, 363 responses were received across Rounds 1, 2 and 3 (n=183, 95 and 85, respectively). The top five research priorities were: 1) “Patient understanding of asthma control”; 2) “The clinical and cost-effectiveness of respiratory nurse interventions”; 3) “The impact of nurse-led clinics on patient care”; 4) “Inhaler technique”; and 5) two topics jointly scored: “Prevention of exacerbations” and “Symptom management”. With potential international significance, this is the first UK study to identify research priorities for respiratory nursing, providing direction for those planning or undertaking research. PMID:29692999

Chartered Society of Physiotherapy's identification of national research priorities for physiotherapy using a modified Delphi technique.

PubMed

Rankin, Gabrielle; Rushton, Alison; Olver, Pat; Moore, Ann

2012-09-01

To define research priorities to strategically inform the evidence base for physiotherapy practice. A modified Delphi method using SurveyMonkey software identified priorities for physiotherapy research through national consensus. An iterative process of three rounds provided feedback. Round 1 requested five priorities using pre-defined prioritisation criteria. Content analysis identified research themes and topics. Round 2 requested rating of the importance of the research topics using a 1-5 Likert scale. Round 3 requested a further process of rating. Quantitative and qualitative data informed decision-making. Level of consensus was established as mean rating ≥ 3.5, coefficient of variation ≤ 30%, and ≥ 55% agreement. Consensus across participants was evaluated using Kendall's W. Four expert panels (n=40-61) encompassing a range of stakeholders and reflecting four core areas of physiotherapy practice were established by steering groups (n=204 participants overall). Response rates of 53-78% across three rounds were good. The identification of 24/185 topics for musculoskeletal, 43/174 for neurology, 30/120 for cardiorespiratory and medical rehabilitation, and 30/113 for mental and physical health and wellbeing as priorities demonstrated discrimination of the process. Consensus between participants was good for most topics. Measurement validity of the research topics was good. The involvement of multiple stakeholders as participants ensured the current context of the intended use of the priorities. From a process of national consensus involving key stakeholders, including service users, physiotherapy research topics have been identified and prioritised. Setting priorities provides a vision of how research can contribute to the developing research base in physiotherapy to maximise focus. Copyright © 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Japanese Clinical Guidelines for Endoscopic Treatment of Pancreatolithiasis.

PubMed

Inui, Kazuo; Igarashi, Yoshinori; Irisawa, Atsushi; Ohara, Hirotaka; Tazuma, Susumu; Hirooka, Yoshiki; Fujita, Naotaka; Miyakawa, Hiroyuki; Sata, Naohiro; Shimosegawa, Tooru; Tanaka, Masao; Shiratori, Keiko; Sugiyama, Masanori; Takeyama, Yoshifumi

2015-10-01

In addition to surgery, procedures for patients with pancreatolithiasis are developing; therefore, establishing practical guidelines for the management of pancreatolithiasis is required. Three committees (the professional committee for asking clinical questions (CQs) and statements by Japanese endoscopists, the expert panel committee for rating statements by the modified Delphi method, and the evaluating committee by moderators) were organized. Eight endoscopists and a surgeon for pancreatolithiasis made the CQs and statements from a total of 694 reports of published literature by PubMed search (from 1983 to 2012). The expert panelists individually rated these clinical statements using a modified Delphi approach, in which a clinical statement receiving a median score greater than 7 on a 9-point scale from the panel was regarded as valid. The professional committee made 3, 7, and 10 CQs and statements for the concept and pathogenesis, diagnosis, and treatment, respectively. The expert panelists regarded them as valid after a 2-round modified Delphi approach. After evaluation by the moderators, the Japanese clinical guidelines for pancreatolithiasis were established. Further discussions and studies for international guidelines are needed.

Developing a tool for nurses to assess risk of infection in pediatric oncology patients in China: a modified Delphi study.

PubMed

Zhou, Yufeng; Cui, Yan; Wang, Hong; Wang, Fang; Lu, Chao; Shen, Yan

2016-09-01

Infections are identified as the most common preventable cause of death in pediatric oncology patients. Assessing and stratifying risk of infections are essential to prevent infection in these patients. To date, no tool can fulfill this demand in China. This study aimed to develop a nursing work-based and Chinese-specific tool for pediatric nurses to assess risk of infection in oncology patients. This research was a modified Delphi study. Based on a literature review, a 37-item questionnaire rating on a 0-5 scale was developed. Twenty-four experts from 8 hospitals in 6 provinces of China were consulted for three rounds. Consensus for each item in the first round was defined as: the rating mean was>3 and the coefficient of variation (CV) was<0.5. Consensus for each item in the second round was defined as CV<0.3. Consensus among experts was defined as: P value of Kendall's coefficient of concordance ( W )<0.05. After three rounds of consultation, a two-part tool was developed: the Immune Status Scale (ISS) and the Checklist of Risk Factors of Infection (CRFI). There were 5 items in the ISS and 14 in the CRFI. Based on the ISS score, nurses could stratify children into the low-risk and high-risk groups. For high-risk children, nurses should screen risk factors of infection every day by the CRFI, and twice weekly for low-risk children. Further study is needed to verify this tool's efficacy. © 2016 the Journal of Biomedical Research. All rights reserved.

Multidisciplinary Delphi Development of a Scale to Evaluate Team Function in Obstetric Emergencies: The PETRA Scale.

PubMed

Balki, Mrinalini; Hoppe, David; Monks, David; Cooke, Mary Ellen; Sharples, Lynn; Windrim, Rory

2017-06-01

The objective of this study was to develop a new interdisciplinary teamwork scale, the Perinatal Emergency: Team Response Assessment (PETRA), for the management of obstetric crises, through consensus agreement of obstetric caregivers. This prospective study was performed using expert consensus, based on a Delphi method. The study investigators developed a new PETRA tool, specifically related to obstetric crisis management, based on the existing literature and discussions among themselves. The scale was distributed to a selected panel of experts in the field for the Delphi process. After each round of Delphi, every component of the scale was analyzed quantitatively by the percentage of agreement ratings and each comment reviewed by the blinded investigators. The assessment scale was then modified, with components of less than 80% agreement removed from the scale. The process was repeated on three occasions to reach a consensus and final PETRA scale. Fourteen of 24 invited experts participated in the Delphi process. The original PETRA scale included six categories and 48 items, one global scale item, and a 3-point rubric for rating. The overall percentage agreement by experts in the first, second, and third rounds was 95.0%, 93.2%, and 98.5%, respectively. The final scale after the third round of Delphi consisted of the following seven categories: shared mental model, communication, situational awareness, leadership, followership, workload management, and positive/effective behaviours and attitudes. There were 34 individual items within these categories, each with a 5-point rating rubric (1 = unacceptable to 5 = perfect). Using a structured Delphi method, we established the face and content validity of this assessment scale that focuses on important aspects of interdisciplinary teamwork in the management of obstetric crises. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Technical College Instructors' Perceptions of the Impact of Online Readiness and of Student Support Services on Student Success in Online Courses

ERIC Educational Resources Information Center

Dowd, Nathan

2012-01-01

The purpose of this study is to determine how Wisconsin Technical College (WTCS) administrators and online instructors perceive the impact of online learner readiness and student support services to be on student success in online courses. The study used a modified three-round Delphi technique to determine to collect data. The results indicated…

Creation and Delphi-method refinement of pediatric disaster triage simulations.

PubMed

Cicero, Mark X; Brown, Linda; Overly, Frank; Yarzebski, Jorge; Meckler, Garth; Fuchs, Susan; Tomassoni, Anthony; Aghababian, Richard; Chung, Sarita; Garrett, Andrew; Fagbuyi, Daniel; Adelgais, Kathleen; Goldman, Ran; Parker, James; Auerbach, Marc; Riera, Antonio; Cone, David; Baum, Carl R

2014-01-01

There is a need for rigorously designed pediatric disaster triage (PDT) training simulations for paramedics. First, we sought to design three multiple patient incidents for EMS provider training simulations. Our second objective was to determine the appropriate interventions and triage level for each victim in each of the simulations and develop evaluation instruments for each simulation. The final objective was to ensure that each simulation and evaluation tool was free of bias toward any specific PDT strategy. We created mixed-methods disaster simulation scenarios with pediatric victims: a school shooting, a school bus crash, and a multiple-victim house fire. Standardized patients, high-fidelity manikins, and low-fidelity manikins were used to portray the victims. Each simulation had similar acuity of injuries and 10 victims. Examples include children with special health-care needs, gunshot wounds, and smoke inhalation. Checklist-based evaluation tools and behaviorally anchored global assessments of function were created for each simulation. Eight physicians and paramedics from areas with differing PDT strategies were recruited as Subject Matter Experts (SMEs) for a modified Delphi iterative critique of the simulations and evaluation tools. The modified Delphi was managed with an online survey tool. The SMEs provided an expected triage category for each patient. The target for modified Delphi consensus was ≥85%. Using Likert scales and free text, the SMEs assessed the validity of the simulations, including instances of bias toward a specific PDT strategy, clarity of learning objectives, and the correlation of the evaluation tools to the learning objectives and scenarios. After two rounds of the modified Delphi, consensus for expected triage level was >85% for 28 of 30 victims, with the remaining two achieving >85% consensus after three Delphi iterations. To achieve consensus, we amended 11 instances of bias toward a specific PDT strategy and corrected 10 instances of noncorrelation between evaluations and simulation. The modified Delphi process, used to derive novel PDT simulation and evaluation tools, yielded a high degree of consensus among the SMEs, and eliminated biases toward specific PDT strategies in the evaluations. The simulations and evaluation tools may now be tested for reliability and validity as part of a prehospital PDT curriculum.

Assessment of Competence in EVAR Procedures: A Novel Rating Scale Developed by the Delphi Technique.

PubMed

Strøm, M; Lönn, L; Bech, B; Schroeder, T V; Konge, L

2017-07-01

To develop a procedure specific global rating scale for assessment of operator competence in endovascular aortic repair (EVAR). A Delphi approach was used to achieve expert consensus. A panel of 32 international experts (median 300 EVAR procedures, range 200-3000) from vascular surgery (n = 21) and radiology (n = 11) was established. The first Delphi round was based on a review of endovascular skills assessment papers, stent graft instructions for use, and structured interviews. It led to a primary pool of 83 items that were formulated as global rating scale items with tentative anchors. Iterative Delphi rounds were executed. The panellists rated the importance of each item on a 5 point Likert scale. Consensus was defined as 80% of the panel rating an item 4 or 5 in the primary round and 90% in subsequent rounds. Consensus on the final assessment tool was defined as Cronbach's alpha > .8 after a minimum of three rounds. Thirty-two of 35 invited experts participated. Three rounds of surveys were completed with a completion rate of 100% in the first two rounds and 91% in round three. The 83 primary assessment items were supplemented with five items suggested by the panel and reduced to seven pivotal assessment items that reached consensus, Cronbach's alpha = 0.82. The seven item rating scale covers key elements of competence in EVAR stent placement and deployment. Each item has well defined grades with explicit anchors at unacceptable, acceptable, and superior performance on a 5 point Likert scale. The Delphi methodology allowed for international consensus on a new procedure specific global rating scale for assessment of competence in EVAR. The resulting scale, EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), represents key elements in the procedure. EVARATE constitutes an assessment tool for providing structured feedback to endovascular operators in training. Copyright © 2017 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Adaptation of a difficult-to-manage asthma programme for implementation in the Dutch context: a modified e-Delphi.

PubMed

Honkoop, Persijn J; Pinnock, Hilary; Kievits-Smeets, Regien M M; Sterk, Peter J; Dekhuijzen, P N Richard; In 't Veen, Johannes C C M

2017-02-09

Patients with difficult-to-manage asthma represent a heterogeneous subgroup of asthma patients who require extensive assessment and tailored management. The International Primary Care Respiratory Group approach emphasises the importance of differentiating patients with asthma that is difficult to manage from those with severe disease. Local adaptation of this approach, however, is required to ensure an appropriate strategy for implementation in the Dutch context. We used a modified three-round e-Delphi approach to assess the opinion of all relevant stakeholders (general practitioners, pulmonologists, practice nurses, pulmonary nurses and people with asthma). In the first round, the participants were asked to provide potentially relevant items for a difficult-to-manage asthma programme, which resulted in 67 items. In the second round, we asked participants to rate the relevance of specific items on a seven-point Likert scale, and 46 items were selected as relevant. In the third round, the selected items were categorised and items were ranked within the categories according to relevance. Finally, we created the alphabet acronym for the categories 'the A-I of difficult-to-manage asthma' to resonate with an established Dutch 'A-E acronym for determining asthma control'. This should facilitate implementation of this programme within the existing structure of educational material on asthma and chronic obstructive pulmonary disease (COPD) in primary care, with potential for improving management of difficult-to-manage asthma. Other countries could use a similar approach to create a locally adapted version of such a programme.

A modified Delphi method toward multidisciplinary consensus on functional convalescence recommendations after abdominal surgery.

PubMed

van Vliet, Daphne C R; van der Meij, Eva; Bouwsma, Esther V A; Vonk Noordegraaf, Antonie; van den Heuvel, Baukje; Meijerink, Wilhelmus J H J; van Baal, W Marchien; Huirne, Judith A F; Anema, Johannes R

2016-12-01

Evidence-based information on the resumption of daily activities following uncomplicated abdominal surgery is scarce and not yet standardized in medical guidelines. As a consequence, convalescence recommendations are generally not provided after surgery, leading to patients' insecurity, needlessly delayed recovery and prolonged sick leave. The aim of this study was to generate consensus-based multidisciplinary convalescence recommendations, including advice on return to work, applicable for both patients and physicians. Using a modified Delphi method among a multidisciplinary panel of 13 experts consisting of surgeons, occupational physicians and general practitioners, detailed recommendations were developed for graded resumption of 34 activities after uncomplicated laparoscopic cholecystectomy, laparoscopic and open appendectomy, laparoscopic and open colectomy and laparoscopic and open inguinal hernia repair. A sample of occupational physicians, general practitioners and surgeons assessed the recommendations on feasibility in daily practice. The response of this group of care providers was discussed with the experts in the final Delphi questionnaire round. Out of initially 56 activities, the expert panel selected 34 relevant activities for which convalescence recommendations were developed. After four Delphi rounds, consensus was reached for all of the 34 activities for all the surgical procedures. A sample of occupational physicians, general practitioners and surgeons regarded the recommendations as feasible in daily practice. Multidisciplinary convalescence recommendations regarding uncomplicated laparoscopic cholecystectomy, appendectomy (laparoscopic, open), colectomy (laparoscopic, open) and inguinal hernia repair (laparoscopic, open) were developed by a modified Delphi procedure. Further research is required to evaluate whether these recommendations are realistic and effective in daily practice.

What Is Next for Functional Requirements for Bibliographic Records? A Delphi Study

ERIC Educational Resources Information Center

Zhang, Yin; Salaba, Athena

2009-01-01

This article reports on a Delphi study conducted to determine key issues and challenges facing Functional Requirements for Bibliographic Records (FRBR) research and practice. The Delphi panel consisted of thirty-three experts in the field who participated in a three-round issue-raising and consensus-building process via a Web-based survey…

Development of post-disaster psychosocial evaluation and intervention for children: Results of a South Korean delphi panel survey

PubMed Central

Lee, Mi-Sun; Hwang, Jun-Won; Lee, Cheol-Soon; Kim, Ji-Youn; Lee, Ju-Hyun; Kim, Eunji; Chang, Hyoung Yoon; Bae, SeungMin; Park, Jang-Ho

2018-01-01

Objective This study aimed to administer a Delphi panel survey and provide evidence for the development of a psychological intervention protocol for use after disasters in South Korea. Method A three-round Delphi survey was conducted. In all rounds, respondents answered open- or closed-ended questions regarding their views on i) the concept of disaster, ii) evaluation, iii) intervention, and iv) considerations in a disaster. Data from Round 1 were subjected to content analysis. In Round 2, items with content validity ratios (CVRs) greater than 0.49 were included, and in Round 3, items with a CVR≥0.38 were accepted. Results The response rates for the Delphi survey were high: 83% (n = 15, Round 1), 80% (n = 16, Round 2), and 86% (n = 24, Round 3). The data collected during this survey showed a need for a support system for children; for preventive strategies, including disaster readiness plans; for the protection of children's safety; and for the development of post-disaster psychosocial care. Conclusions The panel experts reached a consensus regarding the steps they considered critical in post-disaster evaluation and intervention. The findings suggest a unified model for advancing the development of the Korean version of an intervention protocol for children and adolescents exposed to traumatic events. PMID:29596483

Consensus in controversy: The modified Delphi method applied to Gynecologic Oncology practice.

PubMed

Cohn, David E; Havrilesky, Laura J; Osann, Kathryn; Lipscomb, Joseph; Hsieh, Susie; Walker, Joan L; Wright, Alexi A; Alvarez, Ronald D; Karlan, Beth Y; Bristow, Robert E; DiSilvestro, Paul A; Wakabayashi, Mark T; Morgan, Robert; Mukamel, Dana B; Wenzel, Lari

2015-09-01

To determine the degree of consensus regarding the probabilities of outcomes associated with IP/IV and IV chemotherapy. A survey was administered to an expert panel using the Delphi method. Ten ovarian cancer experts were asked to estimate outcomes for patients receiving IP/IV or IV chemotherapy. The clinical estimates were: 1) probability of completing six cycles of chemotherapy, 2) probability of surviving five years, 3) median survival, and 4) probability of ER/hospital visits during treatment. Estimates for two patients, one with a low comorbidity index (patient 1) and the other with a moderate index (patient 2), were included. The survey was administered in three rounds, and panelists could revise their subsequent responses based on review of the anonymous opinions of their peers. The ranges were smaller for IV compared with IP/IV therapy. Ranges decreased with each round. Consensus converged around outcomes related to IP/IV chemotherapy for: 1) completion of 6 cycles of therapy (type 1 patient, 62%, type 2 patient, 43%); 2) percentage of patients surviving 5 years (type 1 patient, 66%, type 2 patient, 47%); and 3) median survival (type 1 patient, 83 months, type 2 patient, 58 months). The group required three rounds to achieve consensus on the probabilities of ER/hospital visits (type 1 patient, 24%, type 2 patient, 35%). Initial estimates of survival and adverse events associated with IP/IV chemotherapy differ among experts. The Delphi process works to build consensus and may be a pragmatic tool to inform patients of their expected outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

[A model for shared decision-making with frail older patients: consensus reached using Delphi technique].

PubMed

van de Pol, M H J; Fluit, C R M G; Lagro, J; Lagro-Janssen, A L M; Olde Rikkert, M G M

2017-01-01

To develop a model for shared decision-making with frail older patients. Online Delphi forum. We used a three-round Delphi technique to reach consensus on the structure of a model for shared decision-making with older patients. The expert panel consisted of 16 patients (round 1), and 59 professionals (rounds 1-3). In round 1, the panel of experts was asked about important steps in the process of shared decision-making and the draft model was introduced. Rounds 2 and 3 were used to adapt the model and test it for 'importance' and 'feasibility'. Consensus for the dynamic shared decision-making model as a whole was achieved for both importance (91% panel agreement) and feasibility (76% panel agreement). Shared decision-making with older patients is a dynamic process. It requires a continuous supportive dialogue between health care professional and patient.

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

Using the modified Delphi method to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy.

PubMed

Zang, Lei; Fan, Ning; Hai, Yong; Lu, S B; Su, Q J; Yang, J C; Du, Peng; Gao, Y J

2015-06-01

Although cervical radiculopathy is very common, there is no standard treatment for this condition, with little high-level evidence available to guide the treatment choice. Thus, this study aimed to review the current data on the management of cervical radiculopathy; and, further, to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy using the Delphi method. First, a systematic review of the previously established treatment guidelines and of articles related to cervical radiculopathy was conducted to establish a protocol for the clinical consensus of the treatment for cervical radiculopathy. Second, from February 2012 to June 2014, we performed a modified Delphi survey in which the current professional opinions from 30 experienced experts, representing almost all of the Chinese provinces, were gathered. Three rounds were performed, and consensus was defined as ≥70% agreement. Consensus of the treatments for cervical radiculopathy was reached on seven aspects, including the proportion of patients requiring only non-surgical therapies; the effectiveness of neck immobilization, physiotherapy, pharmacologic treatment; surgical indications; contraindications; surgery. The modified Delphi study conducted herein reached a consensus concerning several treatment issues for cervical radiculopathy. In the absence of high-level evidence, at present, these expert opinion findings will help guide health care providers to define the appropriate treatment in their regions. Items with no consensus provide excellent areas for future research.

Establishing key components of yoga interventions for musculoskeletal conditions: a Delphi survey

PubMed Central

2014-01-01

Background Evidence suggests yoga is a safe and effective intervention for the management of physical and psychosocial symptoms associated with musculoskeletal conditions. However, heterogeneity in the components and reporting of clinical yoga trials impedes both the generalization of study results and the replication of study protocols. The aim of this Delphi survey was to address these issues of heterogeneity, by developing a list of recommendations of key components for the design and reporting of yoga interventions for musculoskeletal conditions. Methods Recognised experts involved in the design, conduct, and teaching of yoga for musculoskeletal conditions were identified from a systematic review, and invited to contribute to the Delphi survey. Forty-one of the 58 experts contacted, representing six countries, agreed to participate. A three-round Delphi was conducted via electronic surveys. Round 1 presented an open-ended question, allowing panellists to individually identify components they considered key to the design and reporting of yoga interventions for musculoskeletal conditions. Thematic analysis of Round 1 identified items for quantitative rating in Round 2; items not reaching consensus were forwarded to Round 3 for re-rating. Results Thirty-six panellists (36/41; 88%) completed the three rounds of the Delphi survey. Panellists provided 348 comments to the Round 1 question. These comments were reduced to 49 items, grouped under five themes, for rating in subsequent rounds. A priori group consensus of ≥80% was reached on 28 items related to five themes concerning defining the yoga intervention, types of yoga practices to include in an intervention, delivery of the yoga protocol, domains of outcome measures, and reporting of yoga interventions for musculoskeletal conditions. Additionally, a priori consensus of ≥50% was reached on five items relating to minimum values for intervention parameters. Conclusions Expert consensus has provided a non-prescriptive reference list for the design and reporting of yoga interventions for musculoskeletal conditions. It is anticipated future research incorporating the Delphi guidelines will facilitate high quality international research in this field, increase homogeneity of intervention components and parameters, and enhance the comparison and reproducibility of research into the use of yoga for the management of musculoskeletal conditions. PMID:24942270

Standardizing hysteroscopy teaching: development of a curriculum using the Delphi method.

PubMed

Neveu, Marie-Emmanuelle; Debras, Elodie; Niro, Julien; Fernandez, Hervé; Panel, Pierre

2017-12-01

Hysteroscopy is performed often and in many indications but is challenging to learn. Hands-on training in live patients faces ethical, legal, and economic obstacles. Virtual reality simulation may hold promise as a hysteroscopy training tool. No validated curriculum specific in hysteroscopy exists. The aim of this study was to develop a hysteroscopy curriculum, using the Delphi method to identify skill requirements. Based on a literature review using the key words "curriculum," "simulation," and "hysteroscopy," we identified five technical and non-technical areas in which skills were required. Twenty hysteroscopy experts from different French hospital departments participated in Delphi rounds to select items in these five areas. The rounds were to be continued until 80-100% agreement was obtained for at least 60% of items. A curriculum was built based on the selected items and was evaluated in residents. From November 2014 to April 2015, 18 of 20 invited experts participated in three Delphi rounds. Of the 51 items selected during the first round, only 25 (49%) had 80-100% agreement during the second round, and a third round was therefore conducted. During this last round, 80-100% agreement was achieved for 31 (61%) items, which were used to create the curriculum. All 14 residents tested felt that a simulator training session was acceptable and helped them to improve their skills. We describe a simulation-based hysteroscopy curriculum focusing on skill requirements identified by a Delphi procedure. Its development allows standardization of training programs offered to residents.

A hospital-based child protection programme evaluation instrument: a modified Delphi study.

PubMed

Wilson, Denise; Koziol-McLain, Jane; Garrett, Nick; Sharma, Pritika

2010-08-01

Refine instrument for auditing hospital-based child abuse and neglect violence intervention programmes prior to field-testing. A modified Delphi study to identify and rate items and domains indicative of an effective and quality child abuse and neglect intervention programme. Experts participated in four Delphi rounds: two surveys, a one-day workshop and the opportunity to comment on the penultimate instrument. New Zealand. Twenty-four experts in the field of care and protection of children. Items with panel agreement >or=85% and mean importance rating >or=4.0 (scale from 1 (not important) to 5 (very important)). There was high-level consensus on items across Rounds 1 and 2 (89% and 85%, respectively). In Round 3 an additional domain (safety and security) was agreed upon and cultural issues, alert systems for children at risk, and collaboration among primary care, community, non-government and government agencies were discussed. The final instrument included nine domains ('policies and procedures', 'safety and security', 'collaboration', 'cultural environment', 'training of providers', 'intervention services', 'documentation' 'evaluation' and 'physical environment') and 64 items. The refined instrument represents the hallmarks of an ideal child abuse and neglect programme given current knowledge and experience. The instrument enables rigorous evaluations of hospital-based child abuse and neglect intervention programmes for quality improvement and benchmarking with other programmes.

A consensus definition of running-related injury in recreational runners: a modified Delphi approach.

PubMed

Yamato, Tiê Parma; Saragiotto, Bruno Tirotti; Lopes, Alexandre Dias

2015-05-01

Delphi study. To reach a consensus definition of running-related injury in recreational runners through a modified Delphi approach. Many studies have suggested the need for a standardized definition of running-related injury to provide uniformity to injury surveillance in running. We invited 112 researchers from running-related injury studies identified in a previous systematic review to classify words and terms frequently used in definitions of running-related injury in an online form during 3 rounds of study. In the last round, participants were asked to approve or disapprove the consensus definition. We considered an agreement level of at least 75% to be a consensus. Thirty-eight participants agreed to participate in the study. The response rates were 94.7% (n = 36) for the first round, 83.3% (n = 30) for the second round, and 86.7% (n = 26) for the third round. A consensus definition of running-related injury was reached, with 80% of participants approving the following: "Running-related (training or competition) musculoskeletal pain in the lower limbs that causes a restriction on or stoppage of running (distance, speed, duration, or training) for at least 7 days or 3 consecutive scheduled training sessions, or that requires the runner to consult a physician or other health professional." The proposed standardized definition of running-related injury could assist in standardizing the definitions used in sport science research and facilitate between-study comparisons. Future studies testing the validity of the proposed consensus definition, as well as its accurate translation to other languages, are also needed.

Expert validation of a teamwork assessment rubric: A modified Delphi study.

PubMed

Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

2016-01-01

Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with confidence in the university setting. Copyright © 2015 Elsevier Ltd. All rights reserved.

Quality of care for cancer patients on home parenteral nutrition: development of key interventions and outcome indicators using a two-round Delphi approach.

PubMed

Dreesen, Mira; Foulon, Veerle; Hiele, Martin; Vanhaecht, Kris; De Pourcq, Lutgart; Pironi, Loris; Van Gossum, André; Arends, Jann; Cuerda, Cristina; Thul, Paul; Bozzetti, Frederico; Willems, Ludo

2013-05-01

Clear recommendations on how to guide patients with cancer on home parenteral nutrition (HPN) are lacking as the use of HPN in this population remains a controversial issue. Therefore, the aims of this study were to rank treatment recommendations and main outcome indicators to ensure high-quality care and to indicate differences in care concerning benign versus malignant patients. Treatment recommendations, identified from published guidelines, were used as a starting point for a two-round Delphi approach. Comments and additional interventions proposed in the first round were reevaluated in the second round. Ordinal logistic regression with SPSS 2.0 was used to identify differences in care concerning benign versus malignant patients. Twenty-seven experts from five European countries completed two Delphi rounds. After the second Delphi round, the top three most important outcome indicators were (1) quality of life (QoL), (2) incidence of hospital readmission and (3) incidence of catheter-related infections. Forty-two interventions were considered as important for quality of care (28/42 based on published guidelines; 14/42 newly suggested by Delphi panel). The topics 'Liver disease' and 'Metabolic bone disease' were considered less important for cancer patients, together with use of infusion pumps (p = 0.004) and monitoring of vitamins and trace elements (p = 0.000). Monitoring of QoL is considered more important for cancer patients (p = 0.03). Using a two-round Delphi approach, we developed a minimal set of 42 interventions that may be used to determine quality of care in HPN patients with malignancies. This set of interventions differs from a similar set developed for benign patients.

Identifying criteria for the assessment of pharmacy students' communication skills with patients.

PubMed

Mackellar, Adele; Ashcroft, Darren M; Bell, Dawn; James, Delyth Higman; Marriott, John

2007-06-15

To identify criteria by which patients can assess the communication skills of pharmacy students. Potential assessment criteria were generated from 2 main sources: a literature review and a focus group discussion. A modified two-round Delphi survey was subsequently conducted with 35 professionals who were actively involved in teaching and assessing communication skills of pharmacy students to determine the importance and reliability of each criterion. Consensus ratings identified 7 criteria that were important measures of pharmacy students' communication skills and could be reliably assessed by patients. A modified two-round Delphi consultation survey successfully identified criteria that can be used by patients to assess the communication skills of pharmacy undergraduates. Future work will examine the feasibility of using patients as assessors of communication skills of pharmacy students, preregistration pharmacists, and qualified pharmacists.

Adaptation of a difficult-to-manage asthma programme for implementation in the Dutch context: a modified e-Delphi

PubMed Central

Honkoop, Persijn J; Pinnock, Hilary; Kievits-Smeets, Regien M M; Sterk, Peter J; Dekhuijzen, P N Richard; in ’t Veen, Johannes C C M

2017-01-01

Patients with difficult-to-manage asthma represent a heterogeneous subgroup of asthma patients who require extensive assessment and tailored management. The International Primary Care Respiratory Group approach emphasises the importance of differentiating patients with asthma that is difficult to manage from those with severe disease. Local adaptation of this approach, however, is required to ensure an appropriate strategy for implementation in the Dutch context. We used a modified three-round e-Delphi approach to assess the opinion of all relevant stakeholders (general practitioners, pulmonologists, practice nurses, pulmonary nurses and people with asthma). In the first round, the participants were asked to provide potentially relevant items for a difficult-to-manage asthma programme, which resulted in 67 items. In the second round, we asked participants to rate the relevance of specific items on a seven-point Likert scale, and 46 items were selected as relevant. In the third round, the selected items were categorised and items were ranked within the categories according to relevance. Finally, we created the alphabet acronym for the categories ‘the A–I of difficult-to-manage asthma’ to resonate with an established Dutch ‘A–E acronym for determining asthma control’. This should facilitate implementation of this programme within the existing structure of educational material on asthma and chronic obstructive pulmonary disease (COPD) in primary care, with potential for improving management of difficult-to-manage asthma. Other countries could use a similar approach to create a locally adapted version of such a programme. PMID:28184039

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people

PubMed Central

Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Background Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Methods Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Results Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Conclusion Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond. PMID:29155870

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people.

PubMed

Stewart, Derek; Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond.

The Norwegian General Practice--Nursing Home criteria (NORGEP-NH) for potentially inappropriate medication use: A web-based Delphi study.

PubMed

Nyborg, Gunhild; Straand, Jørund; Klovning, Atle; Brekke, Mette

2015-06-01

To develop a set of explicit criteria for pharmacologically inappropriate medication use in nursing homes. In an expert panel, a three-round Delphi consensus process was conducted via survey software. Norway. Altogether 80 participants - specialists in geriatrics or clinical pharmacology, physicians in nursing homes and experienced pharmacists - agreed to participate in the survey. Of these, 62 completed the first round, and 49 panellists completed all three rounds (75.4% of those ultimately entering the survey). The authors developed a list of 27 criteria based on the Norwegian General Practice (NORGEP) criteria, literature, and clinical experience. The main outcome measure was the panellists' evaluation of the clinical relevance of each suggested criterion on a digital Likert scale from 1 (no clinical relevance) to 10. In the first round panellists could also suggest new criteria to be included in the process. For each criterion, degree of consensus was based on the average Likert score and corresponding standard deviation (SD). A list of 34 explicit criteria for potentially inappropriate medication use in nursing homes was developed through a three-round web-based Delphi consensus process. Degree of consensus increased with each round. No criterion was voted out. Suggestions from the panel led to the inclusion of seven additional criteria in round two. The NORGEP-NH list may serve as a tool in the prescribing process and in medication list reviews and may also be used in quality assessment and for research purposes.

A consensus exercise identifying priorities for research into clinical effectiveness among children's orthopaedic surgeons in the United Kingdom.

PubMed

Perry, D C; Wright, J G; Cooke, S; Roposch, A; Gaston, M S; Nicolaou, N; Theologis, T

2018-05-01

Aims High-quality clinical research in children's orthopaedic surgery has lagged behind other surgical subspecialties. This study used a consensus-based approach to identify research priorities for clinical trials in children's orthopaedics. Methods A modified Delphi technique was used, which involved an initial scoping survey, a two-round Delphi process and an expert panel formed of members of the British Society of Children's Orthopaedic Surgery. The survey was conducted amongst orthopaedic surgeons treating children in the United Kingdom and Ireland. Results A total of 86 clinicians contributed to both rounds of the Delphi process, scoring priorities from one (low priority) to five (high priority). Elective topics were ranked higher than those relating to trauma, with the top ten elective research questions scoring higher than the top question for trauma. Ten elective, and five trauma research priorities were identified, with the three highest ranked questions relating to the treatment of slipped capital femoral epiphysis (mean score 4.6/ 5), Perthes' disease (4.5) and bone infection (4.5). Conclusion This consensus-based research agenda will guide surgeons, academics and funders to improve the evidence in children's orthopaedic surgery and encourage the development of multicentre clinical trials. Cite this article: Bone Joint J 2018;100-B:680-4.

Development of criteria for evaluating clinical response in thyroid eye disease using a modified Delphi technique.

PubMed

Douglas, Raymond S; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A; Cahill, Kenneth; Dolman, Peter J; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J; Khanna, Dinesh

2009-09-01

To identify components of a provisional clinical response index for thyroid eye disease using a modified Delphi technique. The International Thyroid Eye Disease Society conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in thyroid eye disease. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty-four respondents participated in the Delphi 1 survey, providing 220 unique items. Ninety-two members (100% of the respondents from Delphi 1 plus 8 new participants) responded in Delphi 2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi 3 (67 criteria were excluded because of redundancy). Criteria with a mean greater than 6 (1 = least appropriate to 9 = most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for thyroid eye disease. These measures will be iteratively refined for use in multicenter clinical trials.

Development of criteria for evaluating clinical response in thyroid eye disease (CRI-TED) using a modified Delphi technique

PubMed Central

Douglas, Raymond S.; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A.; Cahill, Kenneth; Dolman, Peter J.; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J.; Khanna, Dinesh

2014-01-01

To identify components of a provisional clinical response index for thyroid eye disease (CRI-TED) using a modified Delphi technique. The International Thyroid Eye Disease Society (ITEDS) conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in TED. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty four respondents participated in the Delphi-1 survey, providing 220 unique items. Ninety- two members (100% of the respondents from Delphi 1 plus eight new participants) responded in Delphi-2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi-3 (67 criteria were excluded due to redundancy). Criteria with a mean greater than 6 (1 least appropriate to 9 most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for TED. These measures will be iteratively refined for use in multicenter clinical trials. PMID:19752424

Guidelines for Reporting Case Studies on Extracorporeal Treatments in Poisonings: Methodology

PubMed Central

Lavergne, Valéry; Ouellet, Georges; Bouchard, Josée; Galvao, Tais; Kielstein, Jan T; Roberts, Darren M; Kanji, Salmaan; Mowry, James B; Calello, Diane P; Hoffman, Robert S; Gosselin, Sophie; Nolin, Thomas D; Goldfarb, David S; Burdmann, Emmanuel A; Dargan, Paul I; Decker, Brian Scott; Hoegberg, Lotte C; Maclaren, Robert; Megarbane, Bruno; Sowinski, Kevin M; Yates, Christopher; Mactier, Robert; Wiegand, Timothy; Ghannoum, Marc

2014-01-01

A literature review performed by the EXtracorporeal TReatments In Poisoning (EXTRIP) workgroup highlighted deficiencies in the existing literature, especially the reporting of case studies. Although general reporting guidelines exist for case studies, there are none in the specific field of extracorporeal treatments in toxicology. Our goal was to construct and propose a checklist that systematically outlines the minimum essential items to be reported in a case study of poisoned patients undergoing extracorporeal treatments. Through a modified two-round Delphi technique, panelists (mostly chosen from the EXTRIP workgroup) were asked to vote on the pertinence of a set of items to identify those considered minimally essential for reporting complete and accurate case reports. Furthermore, independent raters validated the clarity of each selected items between each round of voting. All case reports containing data on extracorporeal treatments in poisoning published in Medline in 2011 were reviewed during the external validation rounds. Twenty-one panelists (20 from the EXTRIP workgroup and an invited expert on pharmacology reporting guidelines) participated in the modified Delphi technique. This group included journal editors and experts in nephrology, clinical toxicology, critical care medicine, emergency medicine, and clinical pharmacology. Three independent raters participated in the validation rounds. Panelists voted on a total of 144 items in the first round and 137 items in the second round, with response rates of 96.3% and 98.3%, respectively. Twenty case reports were evaluated at each validation round and the independent raters' response rate was 99.6% and 98.8% per validation round. The final checklist consists of 114 items considered essential for case study reporting. This methodology of alternate voting and external validation rounds was useful in developing the first reporting guideline for case studies in the field of extracorporeal treatments in poisoning. We believe that this guideline will improve the completeness and transparency of published case reports and that the systematic aggregation of information from case reports may provide early signals of effectiveness and/or harm, thereby improving healthcare decision-making. PMID:24890576

Career and Technical Education at a Crossroads: A Delphi Study

ERIC Educational Resources Information Center

Cutright, Michael W.

2011-01-01

Career and technical education in the United States has reached a critical juncture. A three round Delphi method was used to determine a consensus on the future events of career and technical education to better inform educational decision makers. Forty-one individual experts in the field were invited to serve as panelists for the Delphi study and…

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

Planning the content of a brief educational course in maxillofacial emergencies for staff in accident and emergency departments: a modified Delphi study.

PubMed

Elledge, Ross O C; McAleer, Sean

2015-02-01

It is well known that staff in accident and emergency (A&E) departments lack the knowledge and confidence needed to deal with maxillofacial emergencies, and that it is related to limited education at undergraduate and postgraduate levels. We therefore aimed to design a syllabus for a short course to educate staff about the most common emergencies. To find out which learning outcomes should be included and to reach a consensus, we did a 3-stage modified Delphi study of the opinions of members of the British Association of Oral and Maxillofacial Surgeons (BAOMS). Of a possible 890 members, 188 responded (21%) in the second round and 105 in the third (12%). Eighteen (37%) of the 49 proposed learning outcomes were rated very important and all of them were retained in the syllabus after the third round. Thirty (61%) items were retained with a consensus of 51% or above in the final round. The Delphi technique is a useful addition to the armamentarium of those involved in education, and has been used effectively in syllabus design. We achieved good consensus on the items to be included and the syllabus will be piloted locally. Copyright © 2014 The British Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

An international survey and modified Delphi process revealed editors’ perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals

PubMed Central

Galipeau, James; Cobey, Kelly D.; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants’ list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 “highly rated” competency-related statements and another 86 “included” items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future. PMID:28979768

An international survey and modified Delphi process revealed editors' perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals.

PubMed

Galipeau, James; Cobey, Kelly D; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants' list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 "highly rated" competency-related statements and another 86 "included" items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future.

Teaching Competencies for Community Preceptors.

PubMed

Brink, Darin; Simpson, Deb; Crouse, Byron; Morzinski, Jeffrey; Bower, Douglas; Westra, Ruth

2018-05-01

Although community physicians provide one-fourth of the outpatient training received in medical school, usually there is no formal training of the preceptor. Currently there is no agreed-upon list of teaching competencies for community physician-preceptors. Using a modified Delphi process, the authors aimed to identify core teaching competencies for community preceptors for use in training and evaluation. A medical educator and three faculty members with expertise in faculty development created a list of teaching competencies organized in five domains. These competencies were finalized through a multiround modified Delphi technique with key stakeholder groups including (1) nonphysician medical educators, (2) academic physicians involved in faculty development, (3) community physicians who regularly precept medical students, (4) family medicine residents, (5) third-year medical students in a 9-month-long longitudinal clerkship. Proposed competencies were retained if 70% of the participants ranked it as "very or extremely important." In the first round, 24 competencies were evaluated by 40 physician preceptors participating in a rural faculty development conference. These were refined, and four additional competencies were added by the cohort. Subsequent rounds utilized a survey approach with broader audiences resulting in a final list of 21 competencies in five domains. Five competency domains with 21 teaching competencies can now be used to guide community preceptors' training and evaluation.

1988 Delphi survey of nursing research priorities for New York State.

PubMed

Shortridge, L; Doswell, W; Evans, M E; Levin, R F; Millor, G K; Carter, E

1989-09-01

In order to inform decisions about nursing research and health care policy, the Council on Nursing Research of the New York State Nurses Association (NYSNA) conducted a Delphi survey to identify the priorities for nursing research in New York state. The Delphi technique is a method of eliciting judgements from experts for the purpose of short-term forecasting and planning. The survey was conducted by mail in three rounds during 1988. Round I required participants to identify three primary research priorities for the nursing profession. In Round II participants ranked the 37 most frequently identified categories from Round I. The highest 16 categories from Round II were ranked by participants in Round III to provide the final 10 nursing research priority categories for New York state. All members of the New York State Nurses Association holding a minimum of a master's degree in nursing were invited to participate. The response rates were: Round I, 34% (N = 872); Round II, 38% (N = 985); Round III 37% (N = 974). Of the 10 nursing research priority categories identified in the final round, 5 relate to nurses, 2 relate to nursing, and 3 relate to clients. None of the high-risk conditions or populations with whom nurses work appear in the top 10, and only 2 of these are ranked in the top 15 priority categories. These priority categories will be used by the NYSNA Council on Nursing Research to influence its future agenda and activities. They can be used by the nursing profession and others for planning, policy making, and establishing nursing research funding priorities.(ABSTRACT TRUNCATED AT 250 WORDS)

An electronic delphi study to establish pediatric intensive care nursing research priorities in twenty European countries*.

PubMed

Tume, Lyvonne N; van den Hoogen, Agnes; Wielenga, Joke M; Latour, Jos M

2014-06-01

To identify and to establish research priorities for pediatric intensive care nursing science across Europe. A modified three-round electronic Delphi technique was applied. Questionnaires were translated into seven different languages. European PICUs. The participants included pediatric intensive care clinical nurses, managers, educators, and researchers. In round 1, the qualitative responses were analyzed by content analysis and a list of research statements and domains was generated. In rounds 2 and 3, the statements were ranked on a scale of one to six (not important to most important). Mean scores and SDs were calculated for rounds 2 and 3. None. Round 1 started with 90 participants, with round 3 completed by 64 (71%). The seven highest ranking statements (≥ 5.0 mean score) were related to end-of-life care, decision making around forgoing and sustaining treatment, prevention of pain, education and competencies for pediatric intensive care nurses, reducing healthcare-associated infections, identifying appropriate nurse staffing levels, and implementing evidence into nursing practice. Nine research domains were prioritized, and these were as follows: 1) clinical nursing care practices, 2) pain and sedation, 3) quality and safety, 4) respiratory and mechanical ventilation, 5) child- and family-centered care, 6) ethics, 7) professional issues in nursing, 8) hemodynamcis and resuscitation, and 9) trauma and neurocritical care. The results of this study inform the European Society of Pediatric and Neonatal Intensive Care's nursing research agenda in the future. The results allow nurse researchers within Europe to encourage collaborative initiatives for nursing research.

Contemporary management of paraesophaegeal hernias: establishing a European expert consensus.

PubMed

Bonrath, E M; Grantcharov, T P

2015-08-01

The surgical treatment of paraesophageal hernias remains a challenge due to the lack of consensus regarding principles of operative treatment. The objectives of this study were to achieve consensus on key topics through expert opinion using a Delphi methodology. A Delphi survey combined with a face-to-face meeting was conducted. A panel of European experts in foregut surgery from high-volume centres generated items in the first survey round. In subsequent rounds, the panel rated agreement with statements on a 5-point Likert-type scale. Internal consistency (consensus) was predefined as Cronbach's α > .80. Items that >70 % of the panel either rated as irrelevant/unimportant, or relevant/important were selected as consensus items, while topics that did not reach this cut-off were termed "undecided/controversial". Three survey rounds were completed: 19 experts from 10 countries completed round one, 18 continued through rounds two and three. Internal consistency was high in rounds two and three (α > .90). Fifty-eight additional/revised items derived from comments and free-text entries were included in round three. In total, 118 items were rated; consensus agreement was achieved for 70 of these. Examples of consensus topics are the relevance of the disease profile for assessing surgical urgency and complexity, the role of clinical history as the mainstay of patient follow-up, indications for revision surgery, and training and credentialing recommendations. Topics with the most "undecided/controversial" items were follow-up, postoperative care and surgical technique. This Delphi study achieved expert consensus on key topics in the operative management of paraesophageal hernias, providing an overview of the current opinion among European foregut surgeons. Moreover, areas with substantial variability in opinions were identified reflecting the current lack of empirical evidence and opportunities for future research.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas

PubMed Central

Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-01-01

Introduction The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. Methods and analysis We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. Ethics and dissemination We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. PMID:28780546

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology.

PubMed

King, Andrew; Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-10-25

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development.

Procedure competencies and job functions of the urologic advanced practice nurse.

PubMed

Kleier, Jo Ann

2009-01-01

A 2-round modified Delphi study recruited a panel urologic advanced practice nurse experts to identify the procedure competencies and job functions unique to the role of the advanced practice nurse specializing in the care of urology patients.

National Delphi study to determine competencies for nursing leadership in public health.

PubMed

Misener, T R; Alexander, J W; Blaha, A J; Clarke, P N; Cover, C M; Felton, G M; Fuller, S G; Herman, J; Rodes, M M; Sharp, H F

1997-01-01

To identify competencies needed by nurse leaders in public health programs. Five-round national Delphi. Convenience sample of members of major public health nursing associations and nurse and non-nurse public health leaders in the USA. Mailed survey in 1994-1995 using a modified snowball technique based on a modification of the Pew Foundation health professions' competencies for Round 1. Four additional rounds produced consensus. Initially, 62 competencies were identified. Factor analysis resulted in four factors: political competencies, business acumen, program leadership, and management capabilities; 57 competencies were clustered in the four groupings and accounted for 91.4% of the variance. Graduate schools in nursing and public health must prepare students with broad-based competencies from a variety of disciplines. Findings of this national survey provide a database for curriculum development and evaluation of programs to prepare nurse leaders for roles in public health-based delivery systems.

Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment.

PubMed

Hepworth, Lauren R; Rowe, Fiona J

2018-02-01

The aim of this study was to ascertain what items stroke survivors and stroke care professionals think are important when assessing quality of life for stroke survivors with visual impairment for inclusion in the new patient-reported outcome measure. A reactive Delphi process was used in a three-round electronic-based survey. The items presented consisted of 62 items originally sourced from a systematic review of existing vision-related quality of life instruments and stroke survivor interviews, reduced and refined following a ranking exercise and pilot with stroke survivors with visual impairment. Stakeholders (stroke survivors/clinicians) were invited to take part in the process. A consensus definition of ≥70% was decided a priori. Participants were asked to rank importance on a 9-point scale and categorize the items by relevance to types of visual impairment following stroke or not relevant. Analysis of consensus, stability, and agreement was conducted. In total, 113 participants registered for the Delphi survey of which 47 (41.6%) completed all three rounds. Response rates to the three rounds were 78/113 (69.0%), 61/76 (81.3%), and 49/64 (76.6%), respectively. The participants included orthoptists (45.4%), occupational therapists (44.3%), and stroke survivors (10.3%). Consensus was reached on 56.5% of items in the three-round process, all for inclusion. A consensus was reached for 83.8% in the categorization of items. The majority (82.6%) of consensus were for relevant to 'all visual impairment following stroke'; two items were deemed 'not relevant'. The lack of item reduction achieved by this Delphi process highlights the need for additional methods of item reduction in the development of a new PROM for visual impairment following stroke. These results will be considered alongside Rasch analysis to achieve further item reduction. However, the Delphi survey remains important as it provides clinical and patient insight into each item rather than purely relying on the psychometric data.

Administration and leadership competencies: establishment of a national consensus for emergency medicine.

PubMed

Thoma, Brent; Poitras, Julien; Penciner, Rick; Sherbino, Jonathan; Holroyd, Brian R; Woods, Robert A

2015-03-01

The Royal College of Physicians and Surgeons of Canada requires emergency medicine (EM) residency programs to meet training objectives relating to administration and leadership. The purpose of this study was to establish a national consensus on the competencies for inclusion in an EM administration and leadership curriculum. A modified Delphi process involving two iterative rounds of an electronic survey was used to achieve consensus on competencies for inclusion in an EM administration and leadership curriculum. An initial list of competencies was compiled using peer-reviewed and grey literature. The participants included 14 EM residency program directors and 43 leadership and administration experts from across Canada who were recruited using a snowball technique. The proposed competencies were organized using the CanMEDS Physician Competency Framework and presented in English or French. Consensus was defined a priori as >70% agreement. Nearly all (13 of 14) of the institutions with an FRCPC EM program had at least one participant complete both surveys. Thirty-five of 57 (61%) participants completed round 1, and 30 (53%) participants completed both rounds. Participants suggested an additional 16 competencies in round 1. The results of round 1 informed the decisions in round 2. Fifty-nine of 109 (54.1%) competencies achieved consensus for inclusion. Based on a national modified Delphi process, we describe 59 competencies for inclusion in an EM administration and leadership curriculum that was arranged by CanMEDS Role. EM educators may consider these competencies when designing local curricula.

Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel

PubMed Central

Boulkedid, Rym; Sibony, Olivier; Goffinet, François; Fauconnier, Arnaud; Branger, Bernard; Alberti, Corinne

2013-01-01

Objective Measuring the quality of inpatient obstetrical care using quality indicators is becoming increasingly important for both patients and healthcare providers. However, there is no consensus about which measures are optimal. We describe a modified Delphi method to identify a set of indicators for continuously monitoring the quality of maternity care by healthcare professionals. Methodology and Main Findings An international French-speaking multidisciplinary panel comprising 22 obstetricians-gynaecologists, 12 midwives, and 1 paediatrician assessed potential indicators extracted from a medical literature search, using a two-round Delphi procedure followed by a physical meeting. Each panellist rated each indicator based on validity and feasibility. In the first round, 35 panellists from 5 countries and 20 maternity units evaluated 26 indicators including 15 related to the management of the overall population of pregnant women, 3 to the management of women followed from the first trimester of pregnancy, 2 to the management of low-risk pregnant women, and 6 to the management of neonates. 25 quality indicators were kept for next step. In the second round, 27 (27/35: 77%) panellists selected 17 indicators; the remaining 8 indicators were discussed during a physical meeting. The final set comprised 18 indicators. Conclusion A multidisciplinary panel selected indicators that reflect the quality of obstetrical care. This set of indicators could be used to assess and monitor obstetrical care, with the goal of improving the quality of care in maternity units. PMID:23577143

Use of a Computer-Mediated Delphi Process to Validate a Mass Casualty Conceptual Model

PubMed Central

CULLEY, JOAN M.

2012-01-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters. PMID:21076283

Use of a computer-mediated Delphi process to validate a mass casualty conceptual model.

PubMed

Culley, Joan M

2011-05-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters.

STEM integration in middle school career and technical education programs: A Delphi design study

NASA Astrophysics Data System (ADS)

Wu-Rorrer, Billy Ray

The purpose of this qualitative method study with a Delphi research design sought to determine how STEM programs can be effectively integrated into middle school career and technical education programs by local, state, and national educators, administrators, directors, specialists, and curriculum writers. The significance of the study is to provide leaders in CTE with a greater awareness, insight, and strategies about how CTE programs can more effectively integrate academics into career and technical education programs through STEM-related programming. The findings will increase the limited amount of available literature providing best practice strategies for the integration of STEM curriculum into middle school CTE programs. One basic question has guided this research: How can STEM programs be effectively integrated into middle school career and technical education programs? A total of twelve strategies were identified. The strategies of real-world applications and administrative buy-in were the two predominant strategies consistently addressed throughout the review of literature and all three sub-questions in the research study. The Delphi design study consisted of pilot round and three rounds of data collection on barriers, strategies, and professional development for STEM integration in middle school career and technical education programs. Four panelists participated in the pilot round, and 16 panel members not involved in the pilot round participated in the three rounds of questioning and consensus building. In the future, more comprehensive studies can build upon this foundational investigation of middle school CTE programs.

Development of an active behavioural physiotherapy intervention (ABPI) for acute whiplash-associated disorder (WAD) II management: a modified Delphi study.

PubMed

Wiangkham, Taweewat; Duda, Joan; Haque, M Sayeed; Rushton, Alison

2016-09-14

To develop an active behavioural physiotherapy intervention (ABPI) for managing acute whiplash-associated disorder (WAD) II using a modified Delphi method to develop consensus for the basic features of the ABPI. Modified Delphi study. Our systematic review and meta-analysis evaluating conservative management for acute WADII found that a combined ABPI may be a useful intervention to prevent patients progressing to chronicity. No previous research has considered a combined behavioural approach and active physiotherapy in the management of acute WADII patients. The ABPI was therefore developed using a rigorous consensus method using international research and local clinical whiplash experts. Descriptive statistics were used to assess consensus in each round. Online international survey. A purposive sample of 97 potential participants (aiming to recruit n=30) consisting of international research whiplash experts, UK private physiotherapists and UK postgraduate musculoskeletal physiotherapy students were invited to participate via electronic mail with an attached participant information sheet and consent form. 36 individuals signed and returned the consent form. In round 1, 32/36 participants (response rate=89%, mean age±SD=36.03±13.22 years) across 8 countries (Australia, Finland, Greece, India, Netherlands, Norway, Sweden and UK) contributed to round 1 questionnaire. Response rates were 78% and 75% for rounds 2 and 3, respectively. Following round 3, 12 underlying principles (eg, return to normal function as soon as possible, pain management, encouragement of self-management, reduce fear avoidance and anxiety) achieved consensus. The treatment components reaching consensus included behavioural (eg, education, reassurance, self-management) and physiotherapy components (eg, exercises for stability and mobility). No passive intervention achieved consensus. Experts suggested and agreed the underlying principles and treatment components of the ABPI for the management of acute WADII. The ABPI was underpinned by social cognitive theory focusing on self-efficacy enhancement prior to conducting a phase II trial. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Personalising care of adults with asthma from Asia: a modified e-Dephi consensus study to inform management tailored to attitude and control profiles.

PubMed

Chisholm, Alison; Price, David B; Pinnock, Hilary; Lee, Tan Tze; Roa, Camilo; Cho, Sang-Heon; David-Wang, Aileen; Wong, Gary; van der Molen, Thys; Ryan, Dermot; Castillo-Carandang, Nina; Yong, Yee Vern

2017-01-05

REALISE Asia-an online questionnaire-based study of Asian asthma patients-identified five patient clusters defined in terms of their control status and attitude towards their asthma (categorised as: 'Well-adjusted and at least partly controlled'; 'In denial about symptoms'; 'Tolerating with poor control'; 'Adrift and poorly controlled'; 'Worried with multiple symptoms'). We developed consensus recommendations for tailoring management of these attitudinal-control clusters. An expert panel undertook a three-round electronic Delphi (e-Delphi): Round 1: panellists received descriptions of the attitudinal-control clusters and provided free text recommendations for their assessment and management. Round 2: panellists prioritised Round 1 recommendations and met (or joined a teleconference) to consolidate the recommendations. Round 3: panellists voted and prioritised the remaining recommendations. Consensus was defined as Round 3 recommendations endorsed by >50% of panellists. Highest priority recommendations were those receiving the highest score. The multidisciplinary panellists (9 clinicians, 1 pharmacist and 1 health social scientist; 7 from Asia) identified consensus recommendations for all clusters. Recommended pharmacological (e.g., step-up/down; self-management; simplified regimen) and non-pharmacological approaches (e.g., trigger management, education, social support; inhaler technique) varied substantially according to each cluster's attitude to asthma and associated psychosocial drivers of behaviour. The attitudinal-control clusters defined by REALISE Asia resonated with the international panel. Consensus was reached on appropriate tailored management approaches for all clusters. Summarised and incorporated into a structured management pathway, these recommendations could facilitate personalised care. Generalisability of these patient clusters should be assessed in other socio-economic, cultural and literacy groups and nationalities in Asia.

Modified Policy-Delphi study for exploring obesity prevention priorities

PubMed Central

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-01-01

Introduction Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of ‘intrusiveness’ has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. Methods and analysis The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethics and dissemination Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. PMID:27601495

Modified Policy-Delphi study for exploring obesity prevention priorities.

PubMed

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-09-06

Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of 'intrusiveness' has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study.

PubMed

Blackwood, Bronagh; Ringrow, Suzanne; Clarke, Mike; Marshall, John; Rose, Louise; Williamson, Paula; McAuley, Danny

2015-08-20

Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children. We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes. The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

A consensus-based gold standard for the evaluation of mass casualty triage systems.

PubMed

Lerner, E Brooke; McKee, Courtney H; Cady, Charles E; Cone, David C; Colella, M Riccardo; Cooper, Arthur; Coule, Phillip L; Lairet, Julio R; Liu, J Marc; Pirrallo, Ronald G; Sasser, Scott M; Schwartz, Richard; Shepherd, Greene; Swienton, Raymond E

2015-01-01

Accuracy and effectiveness analyses of mass casualty triage systems are limited because there are no gold standard definitions for each of the triage categories. Until there is agreement on which patients should be identified by each triage category, it will be impossible to calculate sensitivity and specificity or to compare accuracy between triage systems. To develop a consensus-based, functional gold standard definition for each mass casualty triage category. National experts were recruited through the lead investigators' contacts and their suggested contacts. Key informant interviews were conducted to develop a list of potential criteria for defining each triage category. Panelists were interviewed in order of their availability until redundancy of themes was achieved. Panelists were blinded to each other's responses during the interviews. A modified Delphi survey was developed with the potential criteria identified during the interview and delivered to all recruited experts. In the early rounds, panelists could add, remove, or modify criteria. In the final rounds edits were made to the criteria until at least 80% agreement was achieved. Thirteen national and local experts were recruited to participate in the project. Six interviews were conducted. Three rounds of voting were performed, with 12 panelists participating in the first round, 12 in the second round, and 13 in the third round. After the first two rounds, the criteria were modified according to respondent suggestions. In the final round, over 90% agreement was achieved for all but one criterion. A single e-mail vote was conducted on edits to the final criterion and consensus was achieved. A consensus-based, functional gold standard definition for each mass casualty triage category was developed. These gold standard definitions can be used to evaluate the accuracy of mass casualty triage systems after an actual incident, during training, or for research.

Use of the Delphi process in paediatric cataract management.

PubMed

Serafino, Massimiliano; Trivedi, Rupal H; Levin, Alex V; Wilson, M Edward; Nucci, Paolo; Lambert, Scott R; Nischal, Ken K; Plager, David A; Bremond-Gignac, Dominique; Kekunnaya, Ramesh; Nishina, Sachiko; Tehrani, Nasrin N; Ventura, Marcelo C

2016-05-01

To identify areas of consensus and disagreement in the management of paediatric cataract using a modified Delphi approach among individuals recognised for publishing in this field. A modified Delphi method. International paediatric cataract experts with a publishing record in paediatric cataract management. The process consisted of three rounds of anonymous electronic questionnaires followed by a face-to-face meeting, followed by a fourth anonymous electronic questionnaire. The executive committee created questions to be used for the electronic questionnaires. Questions were designed to have unit-based, multiple choice or true-false answers. The questionnaire included issues related to the preoperative, intraoperative and postoperative management of paediatric cataract. Consensus based on 85% of panellists being in agreement for electronic questionnaires or 80% for the face-to-face meeting, and near consensus based on 70%. Sixteen of 22 invited paediatric cataract surgeons agreed to participate. We arrived at consensus or near consensus for 85/108 (78.7%) questions and non-consensus for the remaining 23 (21.3%) questions. Those questions where consensus was not reached highlight areas of either poor evidence or contradicting evidence, and may help investigators identify possible research questions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study

PubMed Central

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-01-01

Objectives To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. Methods A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. Results In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Conclusions Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. PMID:24670554

Medication administration errors from a nursing viewpoint: a formal consensus of definition and scenarios using a Delphi technique.

PubMed

Shawahna, Ramzi; Masri, Dina; Al-Gharabeh, Rawan; Deek, Rawan; Al-Thayba, Lama; Halaweh, Masa

2016-02-01

To develop and achieve formal consensus on a definition of medication administration errors and scenarios that should or should not be considered as medication administration errors in hospitalised patient settings. Medication administration errors occur frequently in hospitalised patient settings. Currently, there is no formal consensus on a definition of medication administration errors or scenarios that should or should not be considered as medication administration errors. This was a descriptive study using Delphi technique. A panel of experts (n = 50) recruited from major hospitals, nursing schools and universities in Palestine took part in the study. Three Delphi rounds were followed to achieve consensus on a proposed definition of medication administration errors and a series of 61 scenarios representing potential medication administration error situations formulated into a questionnaire. In the first Delphi round, key contact nurses' views on medication administration errors were explored. In the second Delphi round, consensus was achieved to accept the proposed definition of medication administration errors and to include 36 (59%) scenarios and exclude 1 (1·6%) as medication administration errors. In the third Delphi round, consensus was achieved to consider further 14 (23%) and exclude 2 (3·3%) as medication administration errors while the remaining eight (13·1%) were considered equivocal. Of the 61 scenarios included in the Delphi process, experts decided to include 50 scenarios as medication administration errors, exclude three scenarios and include or exclude eight scenarios depending on the individual clinical situation. Consensus on a definition and scenarios representing medication administration errors can be achieved using formal consensus techniques. Researchers should be aware that using different definitions of medication administration errors, inclusion or exclusion of medication administration error situations could significantly affect the rate of medication administration errors reported in their studies. Consensual definitions and medication administration error situations can be used in future epidemiology studies investigating medication administration errors in hospitalised patient settings which may permit and promote direct comparisons of different studies. © 2015 John Wiley & Sons Ltd.

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

[Construction of a physiological aging scale for healthy people based on a modified Delphi method].

PubMed

Long, Yao; Zhou, Xuan; Deng, Pengfei; Liao, Xiong; Wu, Lei; Zhou, Jianming; Huang, Helang

2016-04-01

To build a physiological aging scale for healthy people.
 We collected age-related physiologic items through literature screening and expert interview. Two rounds of Delphi were implemented. The importance, feasibility and the degree of authority for the physiological index system were graded. Using analytic hierarchy process, we determined the weight of dimensions and items.
 Using Delphy mothod, 17 physiological and other professional experts offered the results as follow: coefficient of expert authorities Cr was 0.86±0.03, coordination coefficients for the first and second round were 0.264(χ2=229.691, P<0.001) and 0.293(χ2=228.474，P<0.001), respectively. The consistency was good. The aging scale for healthy people included 3 dimensions, namely physical form, feeling movement and functional status. Each dimension had 8 items. The weight coefficients for the 3 dimensions were 0.54, 0.16, and 0.30, respectively. The Cronbach's α coefficient of the scale was 0.893, the reliability was 0.796, and the variance of the common factor was 58.17%.
 The improved Delphi method or physiological aging scale is satisfied, which can provide reference for the evaluation of aging.

Guiding Principles for Student Leadership Development in the Doctor of Pharmacy Program to Assist Administrators and Faculty Members in Implementing or Refining Curricula

PubMed Central

Boyle, Cynthia J.; Janke, Kristin K.

2013-01-01

Objective. To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Results. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Conclusions. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought. PMID:24371345

Guiding principles for student leadership development in the doctor of pharmacy program to assist administrators and faculty members in implementing or refining curricula.

PubMed

Traynor, Andrew P; Boyle, Cynthia J; Janke, Kristin K

2013-12-16

To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought.

Clarifying concepts of food parenting practices. A Delphi study with an application to snacking behavior.

PubMed

Gevers, D W M; Kremers, S P J; de Vries, N K; van Assema, P

2014-08-01

Inconsistencies in measurements of food parenting practices continue to exist. Fundamental to this problem is the lack of clarity about what is understood by different concepts of food parenting practices. The purpose of this study was to clarify food parenting practice concepts related to snacking. A three round Delphi study among an international group of experts (n = 63) was conducted. In the first round, an open-ended survey was used to collect food parenting practice descriptions and concept labels associated with those practices. In the second round, participants were asked to match up descriptions with the appropriate concept labels. The third and final round allowed participants to reconsider how descriptions and concept labels were matched, taking into account the opinions expressed in round two. Round one produced 408 descriptions of food parenting practices and 110 different concept names. Round two started with 116 descriptions of food parenting practices and 20 concept names. On 40 descriptions, consensus regarding the underlying concept name was reached in round two. Of the remaining 76 descriptions, consensus on 47 descriptions regarding the underlying concept name was reached in round three. The present study supports the essential process of consensus development with respect to food parenting practices concepts. Copyright © 2014 Elsevier Ltd. All rights reserved.

DIET@NET: Best Practice Guidelines for dietary assessment in health research.

PubMed

Cade, Janet E; Warthon-Medina, Marisol; Albar, Salwa; Alwan, Nisreen A; Ness, Andrew; Roe, Mark; Wark, Petra A; Greathead, Katharine; Burley, Victoria J; Finglas, Paul; Johnson, Laura; Page, Polly; Roberts, Katharine; Steer, Toni; Hooson, Jozef; Greenwood, Darren C; Robinson, Sian

2017-11-15

Dietary assessment is complex, and strategies to select the most appropriate dietary assessment tool (DAT) in epidemiological research are needed. The DIETary Assessment Tool NETwork (DIET@NET) aimed to establish expert consensus on Best Practice Guidelines (BPGs) for dietary assessment using self-report. The BPGs were developed using the Delphi technique. Two Delphi rounds were conducted. A total of 131 experts were invited, and of these 65 accepted, with 48 completing Delphi round I and 51 completing Delphi round II. In all, a total of 57 experts from North America, Europe, Asia and Australia commented on the 47 suggested guidelines. Forty-three guidelines were generated, grouped into the following four stages: Stage I. Define what is to be measured in terms of dietary intake (what? who? and when?); Stage II. Investigate different types of DATs; Stage III. Evaluate existing tools to select the most appropriate DAT by evaluating published validation studies; Stage IV. Think through the implementation of the chosen DAT and consider sources of potential biases. The Delphi technique consolidated expert views on best practice in assessing dietary intake. The BPGs provide a valuable guide for health researchers to choose the most appropriate dietary assessment method for their studies. These guidelines will be accessible through the Nutritools website, www.nutritools.org .

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors

PubMed Central

Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

Background The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Methods Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. Findings All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. Conclusions This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention. PMID:26726801

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors.

PubMed

Balaguer, Albert; Monforte-Royo, Cristina; Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention.

Future directions in clinical child and adolescent psychology: a Delphi survey.

PubMed

James, Rochelle L; Roberts, Michael C

2009-10-01

This study sought to identify the future directions in three domains: clinical practice, research, and training of clinical child and adolescent psychologists in the upcoming decade. Doctoral-level active members in the field were surveyed via a two-round Delphi survey (45 in round 1; 35 in round 2). Evidence-based practice received the greatest consensus by the participants and highest rank in each of the three domains. Other highly ranked clinical practice directions included prevention and early diagnosis and treatment, and clinical services for specific psychological problems. Research directions focused on biological and social factors interactions in the etiology and treatment and specific child and adolescent disorders. In the training domain, major directions included the pursuit of specialty training in child and adolescent psychology and training emphasizing the biological basis of behavior. Implications of these future directions are discussed.

Evaluating the construct of triage acuity against a set of reference vignettes developed via modified Delphi method.

PubMed

Twomey, Michèle; Wallis, Lee A; Myers, Jonathan E

2014-07-01

To evaluate the construct of triage acuity as measured by the South African Triage Scale (SATS) against a set of reference vignettes. A modified Delphi method was used to develop a set of reference vignettes. Delphi participants completed a 2-round consensus-building process, and independently assigned triage acuity ratings to 100 written vignettes unaware of the ratings given by others. Triage acuity ratings were summarised for all vignettes, and only those that reached 80% consensus during round 2 were included in the reference set. Triage ratings for the reference vignettes given by two independent experts using the SATS were compared with the ratings given by the international Delphi panel. Measures of sensitivity, specificity, associated percentages for over-triage/under-triage were used to evaluate the construct of triage acuity (as measured by the SATS) by examining the association between the ratings by the two experts and the international panel. On completion of the Delphi process, 42 of the 100 vignettes reached 80% consensus on their acuity rating and made up the reference set. On average, over all acuity levels, sensitivity was 74% (CI 64% to 82%), specificity 92% (CI 87% to 94%), under-triage occurred 14% (CI 8% to 23%) and over-triage 12% (CI 8% to 23%) of the time. The results of this study provide an alternative to evaluating triage scales against the construct of acuity as measured with the SATS. This method of using 80% consensus vignettes may, however, systematically bias the validity estimate towards better performance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Developing an industry-oriented safety curriculum using the Delphi technique.

PubMed

Chen, Der-Fa; Wu, Tsung-Chih; Chen, Chi-Hsiang; Chang, Shu-Hsuan; Yao, Kai-Chao; Liao, Chin-Wen

2016-09-01

In this study, we examined the development of industry-oriented safety degree curricula at a college level. Based on a review of literature on the practices and study of the development of safety curricula, we classified occupational safety and health curricula into the following three domains: safety engineering, health engineering, and safety and health management. We invited 44 safety professionals to complete a four-round survey that was designed using a modified Delphi technique. We used Chi-square statistics to test the panel experts' consensus on the significance of the items in the three domains and employed descriptive statistics to rank the participants' rating of each item. The results showed that the top three items for each of the three domains were Risk Assessment, Dangerous Machinery and Equipment, and Fire and Explosion Prevention for safety engineering; Ergonomics, Industrial Toxicology, and Health Risk Assessment for health engineering; and Industrial Safety and Health Regulations, Accident Investigation and Analysis, and Emergency Response for safety and health management. Only graduates from safety programmes who possess practical industry-oriented abilities can satisfy industry demands and provide value to the existence of college safety programmes.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology

PubMed Central

Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-01-01

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development. PMID:29282445

Using a Delphi process to establish consensus on emergency medicine clerkship competencies.

PubMed

Penciner, Rick; Langhan, Trevor; Lee, Richard; McEwen, Jill; Woods, Robert A; Bandiera, Glen

2011-01-01

Currently, there is no consensus on the core competencies required for emergency medicine (EM) clerkships in Canada. Existing EM curricula have been developed through informal consensus or local efforts. The Delphi process has been used extensively as a means for establishing consensus. The purpose of this project was to define core competencies for EM clerkships in Canada, to validate a Delphi process in the context of national curriculum development, and to demonstrate the adoption of the CanMEDS physician competency paradigm in the undergraduate medical education realm. Using a modified Delphi process, we developed a consensus amongst a panel of expert emergency physicians from across Canada utilizing the CanMEDS 2005 Physician Competency Framework. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). This study demonstrated that a modified Delphi process can result in a strong consensus around a realistic number of core competencies for EM clerkships. We propose that such a method could be used by other medical specialties and health professions to develop rotation-specific core competencies.

Expert Consensus for Discharge Referral Decisions Using Online Delphi

PubMed Central

Bowles, Kathy H.; Holmes, John H.; Naylor, Mary D.; Liberatore, Matthew; Nydick, Robert

2003-01-01

This paper describes the results of using a modified Delphi approach designed to achieve consensus from eight discharge planning experts regarding the decision to refer hospitalized older adults for post-discharge follow-up. Experts reviewed 150 cases using an online website designed to facilitate their interaction and efforts to reach agreement on the need for a referral for post-discharge care and the appropriate site for such care. In contrast to an average of eight weeks to complete just 50 cases using the traditional mail method, the first online Delphi round for 150 cases were completed in six weeks. Data provided by experts suggest that online Delphi is a time efficient and acceptable methodology for reaching group consensus. Other benefits include instant access to Delphi decision results, live knowledge of the time requirements and progress of each expert, and cost savings in postage, paper, copying, and storage of paper documents. This online Delphi methodology is highly recommended. PMID:14728143

Three nested randomized controlled trials of peer-only or multiple stakeholder group feedback within Delphi surveys during core outcome and information set development.

PubMed

Brookes, Sara T; Macefield, Rhiannon C; Williamson, Paula R; McNair, Angus G; Potter, Shelley; Blencowe, Natalie S; Strong, Sean; Blazeby, Jane M

2016-08-17

Methods for developing a core outcome or information set require involvement of key stakeholders to prioritise many items and achieve agreement as to the core set. The Delphi technique requires participants to rate the importance of items in sequential questionnaires (or rounds) with feedback provided in each subsequent round such that participants are able to consider the views of others. This study examines the impact of receiving feedback from different stakeholder groups, on the subsequent rating of items and the level of agreement between stakeholders. Randomized controlled trials were nested within the development of three core sets each including a Delphi process with two rounds of questionnaires, completed by patients and health professionals. Participants rated items from 1 (not essential) to 9 (absolutely essential). For round 2, participants were randomized to receive feedback from their peer stakeholder group only (peer) or both stakeholder groups separately (multiple). Decisions as to which items to retain following each round were determined by pre-specified criteria. Whilst type of feedback did not impact on the percentage of items for which a participant subsequently changed their rating, or the magnitude of change, it did impact on items retained at the end of round 2. Each core set contained discordant items retained by one feedback group but not the other (3-22 % discordant items). Consensus between patients and professionals in items to retain was greater amongst those receiving multiple group feedback in each core set (65-82 % agreement for peer-only feedback versus 74-94 % for multiple feedback). In addition, differences in round 2 scores were smaller between stakeholder groups receiving multiple feedback than between those receiving peer group feedback only. Variability in item scores across stakeholders was reduced following any feedback but this reduction was consistently greater amongst the multiple feedback group. In the development of a core outcome or information set, providing feedback within Delphi questionnaires from all stakeholder groups separately may influence the final core set and improve consensus between the groups. Further work is needed to better understand how participants rate and re-rate items within a Delphi process. The three randomized controlled trials reported here were each nested within the development of a core information or outcome set to investigate processes in core outcome and information set development. Outcomes were not health-related and therefore trial registration was not applicable.

Use of a Web-based Delphi for identifying critical components of a professional science master's program in biotechnology

NASA Astrophysics Data System (ADS)

Kantz, Jeannine Wells

The primary purpose of this research was to develop a model for a professional science master's program combining biotechnology and business. The objectives were to identify stakeholder preferences for various dimensions of a professional science master's program combining biotechnology and business and to identify differences in priorities between subgroups. A secondary purpose was to examine user preferences between Web-based and traditional methods of conducting a Delphi study and the panelist's impressions of its usefulness for program development. Prior to the first round, demographic data were collected on panelists regarding their gender, age, years experience in their current field, position title and education levels. Round 1 started with eight open-ended questions designed to investigate (a) learning objectives, (b) internships, (c) thesis vs. non-thesis degrees, (d) program focus (e) possible entry level positions, (f) roles for the industry advisory board, (g) recommended hours of hands-on experience and (h) other issues of importance. The final round ended with three questions to assess the panelists' perception of the usefulness of the Delphi for program development in higher education. Twenty-four panelists started Round 1 and participation in subsequent rounds varied from 17 in Round 2 to 11 in Round 4. Education level varied and included all levels of education in science and business. Issues emerged early in the study regarding development of different program tracks and the program goals, which were clarified in subsequent rounds. Significant differences occurred between industry and academic subgroups for two tracks, six skills designated for tracks, method of evaluating the internship, and entry-level positions appropriate for new graduates. When analyzed by level of confidence (high confidence vs. low confidence), significant differences occurred for (a) the number of semesters of hands-on experience students should have upon graduation, (b) skills recommended for core curriculum, (c) skills recommended for tracks, (d) compensation level and (e) entry level positions for new graduates. Perceived usefulness of the Delphi for program development was varied with only 10 panelists responding---five in favor, three undecided, and two against.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas.

PubMed

Hoekstra, Dyon; Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-08-04

The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.

PubMed

Birko, Stanislav; Dove, Edward S; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts' variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions. PMID:26270647

Developing a research agenda for the American Society of Colon and Rectal Surgeons: results of a delphi approach.

PubMed

Burt, Caroline G; Cima, Robert R; Koltun, Walter A; Littlejohn, Charles E; Ricciardi, Rocco; Temple, Larissa K; Rothenberger, David A; Baxter, Nancy N

2009-05-01

By use of a systematic approach, the aim of this project was to survey a group of colorectal specialists and reach a consensus on the research questions of highest importance in terms of clinical care. A modified Delphi process was performed. In Round 1 research questions were solicited from members of The American Society of Colon and Rectal Surgeons. A review group categorized the results, combined similar questions, and presented them to The American Society of Colon and Rectal Surgeons membership in Round 2 for prioritizing according to importance. In Round 3 the 50 questions with the highest scores in Round 2 were reranked by The American Society of Colon and Rectal Surgeons membership to produce the 20 highest-priority research questions. A total of 203 respondents in Round 1 submitted 746 questions. The review team reduced these to 105 individual questions encompassing 21 topics in colorectal surgical practice. In Rounds 2 and 3, 399 and 360 respondents, respectively, prioritized the questions presented. The final 20 items included 14 questions related to colorectal cancer, and 6 were on benign disease topics. The research agenda produced by this study reflects the clinical issues of greatest importance to colorectal surgeons. The results are of potential benefit to researchers, funding organizations, medical journals, and ultimately, patients.

International identification of research priorities for postgraduate theses in musculoskeletal physiotherapy using a modified Delphi technique.

PubMed

Rushton, Alison; Moore, Ann

2010-04-01

Research priorities are established to identify gaps and maximise opportunities in developing an evidence base. Numerous postgraduate research theses are undertaken each year within the specialist area of musculoskeletal physiotherapy, and although some are published, greater potential for influence exists. This paper identifies international research priorities for postgraduate theses developed using a consensual Delphi process. A purposive sample included course tutors and expert clinicians nominated by Member Organisations of the International Federation of Orthopaedic Manipulative Physical Therapists (N=91). Round 1 requested >10 priorities for theses, and content analysis identified research themes. Round 2 requested participants rank the importance of each theme on a 1-5 scale, and round 3 requested ranking the importance and feasibility of the research question areas within each agreed theme. Descriptive analysis and use of Kendall's coefficient of concordance enabled interpretation of consensus. The response rate of 68% was good, identifying 23 research themes in round 1. Round 2 identified 14 research themes as important. Participant rating of the importance and feasibility of research question areas in round 3 supported 43 agreed priorities demonstrating good measurement validity. Establishing priorities provides a vision of how postgraduate theses can contribute to the developing evidence base and offer a focus for international collaboration. Copyright 2009 Elsevier Ltd. All rights reserved.

Determining the Essential Components of State and Institution Dual Credit Program Policy in New Mexico: A Delphi Study with High School and College Experts

ERIC Educational Resources Information Center

Carlson, Gregory Dean

2013-01-01

The purpose of this Delphi study was to determine the essential components of dual credit in New Mexico. Dual credit experts from colleges and high schools in New Mexico were asked to participate in a three-round Delphi study to determine what the future policy of dual credit should be, and why it should be that way. Definitions of dual credit may…

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study

PubMed Central

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-01

Objectives To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Setting Hospitals and community health centres in Taiwan. Method A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. Participants 15 Chinese healthcare practitioners with more than 6 months’ experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Results Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. Conclusions The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. PMID:28093428

Assessing Consensus Between UK Renal Clinicians on Listing for Kidney Transplantation: A Modified Delphi Study.

PubMed

Tonkin-Crine, Sarah; Pruthi, Rishi; Taylor, Dominic M; Leydon, Geraldine M; Calestani, Melania; Oniscu, Gabriel C; Bradley, J Andrew; Tomson, Charles R; Bradley, Clare; Dudley, Christopher; Watson, Christopher J E; Draper, Heather; Johnson, Rachel J; Metcalfe, Wendy; Fogarty, Damian G; Ravanan, Rommel; Roderick, Paul

2018-05-01

It is well recognized that there is significant variation between centers in access to kidney transplantation. In the absence of high-grade evidence, it is unclear whether variation is due to patient case mix, other center factors, or individual clinician decisions. This study sought consensus between UK clinicians on factors that should influence access to kidney transplantation. As part of the Access to Transplantation and Transplant Outcome Measures project, consultant nephrologists and transplant surgeons in 71 centers were invited to participate in a Delphi study involving 2 rounds. During rounds 1 and 2, participants rated their agreement to 29 statements covering 8 topics regarding kidney transplantation. A stakeholder meeting was used to discuss statements of interest after the 2 rounds. In total, 122 nephrologists and 16 transplant surgeons from 45 units participated in rounds 1 and 2. After 2 rounds, 12 of 29 statements reached consensus. Fifty people participated in the stakeholder meeting. After the stakeholder meeting, a further 4 statements reached agreement. Of the 8 topics covered, consensus was reached in 6: use of a transplant protocol, patient age, body mass index, patient compliance with treatment, cardiac workup, and use of multidisciplinary meetings. Consensus was not reached on screening for malignancy and use of peripheral Doppler studies. The Delphi process identified factors upon which clinicians agreed and areas where consensus could not be achieved. The findings should inform national guidelines to support decision making in the absence of high quality evidence and to guide areas that warrant future research.

Assessing Consensus Between UK Renal Clinicians on Listing for Kidney Transplantation: A Modified Delphi Study

PubMed Central

Tonkin-Crine, Sarah; Pruthi, Rishi; Taylor, Dominic M.; Leydon, Geraldine M.; Calestani, Melania; Oniscu, Gabriel C.; Bradley, J. Andrew; Tomson, Charles R.; Bradley, Clare; Dudley, Christopher; Watson, Christopher J.E.; Draper, Heather; Johnson, Rachel J.; Metcalfe, Wendy; Fogarty, Damian G.; Ravanan, Rommel; Roderick, Paul

2018-01-01

Background It is well recognized that there is significant variation between centers in access to kidney transplantation. In the absence of high-grade evidence, it is unclear whether variation is due to patient case mix, other center factors, or individual clinician decisions. This study sought consensus between UK clinicians on factors that should influence access to kidney transplantation. Methods As part of the Access to Transplantation and Transplant Outcome Measures project, consultant nephrologists and transplant surgeons in 71 centers were invited to participate in a Delphi study involving 2 rounds. During rounds 1 and 2, participants rated their agreement to 29 statements covering 8 topics regarding kidney transplantation. A stakeholder meeting was used to discuss statements of interest after the 2 rounds. Results In total, 122 nephrologists and 16 transplant surgeons from 45 units participated in rounds 1 and 2. After 2 rounds, 12 of 29 statements reached consensus. Fifty people participated in the stakeholder meeting. After the stakeholder meeting, a further 4 statements reached agreement. Of the 8 topics covered, consensus was reached in 6: use of a transplant protocol, patient age, body mass index, patient compliance with treatment, cardiac workup, and use of multidisciplinary meetings. Consensus was not reached on screening for malignancy and use of peripheral Doppler studies. Conclusions The Delphi process identified factors upon which clinicians agreed and areas where consensus could not be achieved. The findings should inform national guidelines to support decision making in the absence of high quality evidence and to guide areas that warrant future research. PMID:29796414

Feasibility of multi-sector policy measures that create activity-friendly environments for children: results of a Delphi study.

PubMed

Aarts, Marie-Jeanne; Schuit, Albertine J; van de Goor, Ien Am; van Oers, Hans Am

2011-12-15

Although multi-sector policy is a promising strategy to create environments that stimulate physical activity among children, little is known about the feasibility of such a multi-sector policy approach. The aims of this study were: to identify a set of tangible (multi-sector) policy measures at the local level that address environmental characteristics related to physical activity among children; and to assess the feasibility of these measures, as perceived by local policy makers. In four Dutch municipalities, a Delphi study was conducted among local policy makers of different policy sectors (public health, sports, youth and education, spatial planning/public space, traffic and transportation, and safety). In the first Delphi round, respondents generated a list of possible policy measures addressing three environmental correlates of physical activity among children (social cohesion, accessibility of facilities, and traffic safety). In the second Delphi round, policy makers weighted different feasibility aspects (political feasibility, cultural/community acceptability, technical feasibility, cost feasibility, and legal feasibility) and assessed the feasibility of the policy measures derived from the first round. The third Delphi round was aimed at reaching consensus by feedback of group results. Finally, one overall feasibility score was calculated for each policy measure. Cultural/community acceptability, political feasibility, and cost feasibility were considered most important feasibility aspects. The Delphi studies yielded 16 feasible policy measures aimed at physical and social environmental correlates of physical activity among children. Less drastic policy measures were considered more feasible, whereas environmental policy measures were considered less feasible. This study showed that the Delphi technique can be a useful tool in reaching consensus about feasible multi-sector policy measures. The study yielded several feasible policy measures aimed at physical and social environmental correlates of physical activity among children and can assist local policy makers in designing multi-sector policies aimed at an activity-friendly environment for children.

The Underutilization of Information and Communication Technology-Assisted Collaborative Project-Based Learning among International Educators: A Delphi Study

ERIC Educational Resources Information Center

Kramer, Barry S.; Walker, Andrew E.; Brill, Jennifer M.

2007-01-01

This study explores the barriers associated with teachers implementing information and communication technology-assisted collaborative project-based learning (ICTCPrjBL) as a classroom teaching methodology with students. We used a Web-based Delphi method to engage experienced educators in anonymous consensus building consisting of three rounds of…

A Delphi Study on Technology Enhanced Learning (TEL) Applied on Computer Science (CS) Skills

ERIC Educational Resources Information Center

Porta, Marcela; Mas-Machuca, Marta; Martinez-Costa, Carme; Maillet, Katherine

2012-01-01

Technology Enhanced Learning (TEL) is a new pedagogical domain aiming to study the usage of information and communication technologies to support teaching and learning. The following study investigated how this domain is used to increase technical skills in Computer Science (CS). A Delphi method was applied, using three-rounds of online survey…

The Essential Components of Coach Training for Mental Health Professionals: A Delphi Study

ERIC Educational Resources Information Center

Moriarity, Marlene Therese

2010-01-01

Purpose. The purpose of this study was to discover how coach training experts define coaching and what they would identify to be the essential components of a coach training program for mental health professionals. Methods. A panel of nine experts, through an iterative Delphi process of responding to three rounds of questionnaires, provided…

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study.

PubMed

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-09-01

To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Futurescapes: evidence expectations in the USA for comparative effectiveness research for drugs in 2020.

PubMed

Messner, Donna A; Mohr, Penny; Towse, Adrian

2015-08-01

Explore key factors influencing future expectations for the production of evidence from comparative effectiveness research for drugs in the USA in 2020 and construct three plausible future scenarios. Semistructured key informant interviews and three rounds of modified Delphi with systematic scenario-building methods. Most influential key factors were: health delivery system integration; electronic health record development; exploitation of very large databases and mixed data sources; and proactive patient engagement in research. The scenario deemed most likely entailed uneven development of large integrated health systems with pockets of increased provider risk for patient care, enhanced data collection systems, changing incentives to do comparative effectiveness research and new opportunities for evidence generation partnerships.

Terminating Sequential Delphi Survey Data Collection

ERIC Educational Resources Information Center

Kalaian, Sema A.; Kasim, Rafa M.

2012-01-01

The Delphi survey technique is an iterative mail or electronic (e-mail or web-based) survey method used to obtain agreement or consensus among a group of experts in a specific field on a particular issue through a well-designed and systematic multiple sequential rounds of survey administrations. Each of the multiple rounds of the Delphi survey…

A Delphi study and ranking exercise to support commissioning services: future delivery of Thrombectomy services in England.

PubMed

Halvorsrud, Kristoffer; Flynn, Darren; Ford, Gary A; McMeekin, Peter; Bhalla, Ajay; Balami, Joyce; Craig, Dawn; White, Phil

2018-02-22

Intra-arterial thrombectomy is the gold standard treatment for large artery occlusive stroke. However, the evidence of its benefits is almost entirely based on trials delivered by experienced neurointerventionists working in established teams in neuroscience centres. Those responsible for the design and prospective reconfiguration of services need access to a comprehensive and complementary array of information on which to base their decisions. This will help to ensure the demonstrated effects from trials may be realised in practice and account for regional/local variations in resources and skill-sets. One approach to elucidate the implementation preferences and considerations of key experts is a Delphi survey. In order to support commissioning decisions, we aimed using an electronic Delphi survey to establish consensus on the options for future organisation of thrombectomy services among physicians with clinical experience in managing large artery occlusive stroke. A Delphi survey was developed with 12 options for future organisation of thrombectomy services in England. A purposive sampling strategy established an expert panel of stroke physicians from the British Association of Stroke Physicians (BASP) Clinical Standards and/or Executive Membership that deliver 24/7 intravenous thrombolysis. Options with aggregate scores falling within the lowest quartile were removed from the subsequent Delphi round. Options reaching consensus following the two Delphi rounds were then ranked in a final exercise by both the wider BASP membership and the British Society of Neuroradiologists (BSNR). Eleven stroke physicians from BASP completed the initial two Delphi rounds. Three options achieved consensus, with subsequently wider BASP (97%, n = 43) and BSNR members (86%, n = 21) assigning the highest approval rankings in the final exercise for transferring large artery occlusive stroke patients to nearest neuroscience centre for thrombectomy based on local CT/CT Angiography. The initial Delphi rounds ensured optimal reduction of options by an expert panel of stroke physicians, while subsequent ranking exercises allowed remaining options to be ranked by a wider group of experts within stroke to reach consensus. The preferred implementation option for thrombectomy is investigating suspected acute stroke patients by CT/CT Angiography and secondary transfer of large artery occlusive stroke patients to the nearest neuroscience (thrombectomy) centre.

A True Delphi Approach: Developing a Tailored Curriculum in Response to Local Agriscience Need

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rubenstein, Eric; Thoron, Andrew; Burleson, Sarah

2012-02-07

The Delphi approach is a structured communication technique, developed as a systematic, interactive forecasting method which relies on a panel of experts. In this specific case experts from Industry, Education and Extension fields addressed needs for educational programs in a traditional agriculturally-based community, environmentally conscious practices in order to restore environmental integrity and multi-disciplinary approach to solve sustainability problems facing the agricultural industry. The experts were divided into two main groups, (A) Secondary and (B) Post-secondary, and answered questionnaires in three rounds: • 1st Round – Participants generated a list of knowledge, skills, and competencies followed • 2nd Round –more » Panelists rated each item • 3rd Round – Panelists were given the opportunity to combine and add additional items As a result, top six items from both groups were not found similar, secondary panelists centralized around employment skills and post-secondary panelists focused on content areas. Implications include a need for content-based curriculum for post-secondary graduates, utilization of true-Delphi technique for future curriculum development research and further examination of students that complete secondary and post-secondary programs in biofuels/sustainable agriculture.« less

International Occupational Therapy Research Priorities.

PubMed

Mackenzie, Lynette; Coppola, Susan; Alvarez, Liliana; Cibule, Lolita; Maltsev, Sergey; Loh, Siew Yim; Mlambo, Tecla; Ikiugu, Moses N; Pihlar, Zdenka; Sriphetcharawut, Sarinya; Baptiste, Sue; Ledgerd, Richard

2017-04-01

Occupational therapy is a global profession represented by the World Federation of Occupational Therapists (WFOT). International research priorities are needed for strategic guidance on global occupational therapy practice. The objective of this study was to develop international research priorities to reflect global occupational therapy practice. A Delphi study using three rounds of electronic surveys, distributed to WFOT member organizations and WFOT accredited universities, was conducted. Data were analyzed after each round, and priorities were presented for rating and ranking in order of importance. Forty-six (53%) out of 87 WFOT member countries participated in the Delphi process. Eight research priorities were confirmed by the final electronic survey round. Differences were observed in rankings given by member organizations and university respondents. Despite attrition at Round 3, the final research priorities will help to focus research efforts in occupational therapy globally. Follow-up research is needed to determine how the research priorities are being adopted internationally.

Standardised method for reporting exercise programmes: protocol for a modified Delphi study.

PubMed

Slade, Susan C; Dionne, Clermont E; Underwood, Martin; Buchbinder, Rachelle

2014-12-30

Exercise is integral to health across the lifespan and important for people with chronic health conditions. A systematic review of exercise trials for chronic conditions reported suboptimal descriptions of the evaluated interventions and concluded that this hinders interpretation and replication. The aim of this project is to develop a standardised method for reporting essential exercise programme details being evaluated in clinical trials. A modified Delphi technique will be used to gain consensus among international exercise experts. We will use three sequential rounds of anonymous online questionnaires to refine a standardised checklist. A draft checklist of potentially relevant items was developed based on the results of a systematic review of exercise systematic reviews. An international panel of experts was identified by exercise systematic review authorship, established international profile in exercise research and practice and by peer referral. In round 1, the international panel of experts will be asked to rate the importance of each draft item and provide additional suggestions for revisions or new items. Consensus will be considered reached if at least 70% of the panel strongly agree/disagree that an item should be included or excluded. Where agreement is not reached or there are suggestions for altered or new items, these will be taken to round 2 together with an aggregated summary of round 1 responses. Following the second round, a ranking of item importance will be made to rationalise the number of items. The final template will be distributed to panel members for approval. Ethics approval was received from The Cabrini Institute Ethics Committee, Melbourne, Australia (HREC 02-07-04-14). We plan to use a stepwise process to develop and refine a standardised and internationally agreed template for explicit reporting of exercise programmes. The template will be generalisable across all types of exercise interventions. The findings will be disseminated through peer-reviewed publications and conference presentations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Core Domains for Clinical Research in Acute Respiratory Failure Survivors: An International Modified Delphi Consensus Study.

PubMed

Turnbull, Alison E; Sepulveda, Kristin A; Dinglas, Victor D; Chessare, Caroline M; Bingham, Clifton O; Needham, Dale M

2017-06-01

To identify the "core domains" (i.e., patient outcomes, health-related conditions, or aspects of health) that relevant stakeholders agree are essential to assess in all clinical research studies evaluating the outcomes of acute respiratory failure survivors after hospital discharge. A two-round consensus process, using a modified Delphi methodology, with participants from 16 countries, including patient and caregiver representatives. Prior to voting, participants were asked to review 1) results from surveys of clinical researchers, acute respiratory failure survivors, and caregivers that rated the importance of 19 preliminary outcome domains and 2) results from a qualitative study of acute respiratory failure survivors' outcomes after hospital discharge, as related to the 19 preliminary outcome domains. Participants also were asked to suggest any additional potential domains for evaluation in the first Delphi survey. Web-based surveys of participants representing four stakeholder groups relevant to clinical research evaluating postdischarge outcomes of acute respiratory failure survivors: clinical researchers, clinicians, patients and caregivers, and U.S. federal research funding organizations. None. None. Survey response rates were 97% and 99% in round 1 and round 2, respectively. There were seven domains that met the a priori consensus criteria to be designated as core domains: physical function, cognition, mental health, survival, pulmonary function, pain, and muscle and/or nerve function. This study generated a consensus-based list of core domains that should be assessed in all clinical research studies evaluating acute respiratory failure survivors after hospital discharge. Identifying appropriate measurement instruments to assess these core domains is an important next step toward developing a set of core outcome measures for this field of research.

[The application of Delphi method in improving the score table for the hygienic quantifying and classification of hotels].

PubMed

Wang, Zi-yun; Liu, Yong-quan; Wang, Hong-bo; Zheng, Yang; Wu, Qi; Yang, Xia; Wu, Yong-wei; Zhao, Yi-ming

2009-04-01

By means of Delphi method and expert panel consultations, to choose suitable indicators and improve the score table for classifying the hygienic condition of hotels so that it can be widely used at nationwide. A two-round Delphi consultation was held to choose suitable indicators among 78 experts from 18 provinces, municipalities and autonomous regions. The suitable indicators were selected according to the importance recognized by experts. The average length of service in public health of the experts was (21.08 +/- 5.78) years and the average coefficient of experts' authorities C(r) was 0.89 +/- 0.07. The response rates of the two-round consultation were 98.72% (77/78) and 100.00% (77/77). The average feedback time were (8.49 +/- 4.48) d, (5.86 +/- 2.28) d, and the difference between two rounds was statistically significant (t = 4.60, P < 0.01). Kendall's coefficient were 0.26 (chi(2) = 723.63, P < 0.01), 0.32 (chi(2) = 635.65, P < 0.01) and opinions among experts became consistent. The score table for the hygienic quantifying and classification of hotels was composed of three first-class indicators (hygienic management, hygienic facilities and hygienic practices) and 36 second-class indicators. The weight coefficients of the three first-class indicators were 0.35, 0.34, 0.31. Delphi method might be used in a large-scale consultation among experts and be propitious to improve the score table for the hygienic quantifying and classification.

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

PubMed

Bank, Ilana; Cheng, Adam; McLeod, Peter; Bhanji, Farhan

2015-11-01

By the end of residency training, pediatric emergency medicine (PEM) residents are expected to have developed the confidence and abilities required to manage acutely ill children. Acquisition of competence requires exposure and/or supplemental formal education for critical and noncritical medical clinical presentations. Simulation can provide experiential learning and can improve trainees' knowledge, skills, and attitudes. The primary objective of this project was to identify the content for a simulation-based national curriculum for PEM training. We recruited participants for the Delphi study by contacting current PEM program directors and immediate past program directors as well as simulation experts at all of the Canadian PEM fellowship sites. We determined the appropriate core content for the Delphi study by combining the PEM core content requirements of the Royal College of Physicians and Surgeons of Canada (RCPSC) and the American Board of Pediatrics (ABP). Using the Delphi method, we achieved consensus amongst the national group of PEM and simulation experts. The participants completed a three-round Delphi (using a four-point Likert scale). Response rates for the Delphi were 85% for the first round and 77% for second and third rounds. From the initial 224 topics, 53 were eliminated (scored <2). Eighty-five topics scored between 2 and 3, and 87 scored between 3 and 4. The 48 topics, which were scored between 3.5 and 4.0, were labeled as "key curriculum topics." We have iteratively identified a consensus for the content of a national simulation-based curriculum.

Development of key indicators of hospital resilience: a modified Delphi study.

PubMed

Zhong, Shuang; Clark, Michele; Hou, Xiang-Yu; Zang, Yuli; FitzGerald, Gerard

2015-04-01

Hospital resilience is an emerging concept, which can be defined as 'a hospital's ability to resist, absorb, and respond to the shock of disasters while maintaining its critical health care functions, and then recover to its original state or adapt to a new one'. Our aim was to develop a comprehensive framework of key indicators of hospital resilience. A panel of 33 Chinese experts was invited to participate in a three-round, modified Delphi study to develop a set of potential measures previously derived from a literature review. In the first round, these potential measures were modified to cover the comprehensive domains of hospital resilience. The importance of proposed measures was scored by experts on a five-point Likert scale. Subsequently, the experts reconsidered their voting in light of the previous aggregated results. Agreement on measures was defined as at least 70% of the responders agreeing or strongly agreeing to the inclusion of a measure. A large proportion of preliminary measures (89.5%) were identified as having good potential for assessing hospital resilience. These measures were categorized into eight domains, 17 subdomains, and 43 indicators. The highest rated indicators (mean score) were: equipment for on-site rescue (4.7), plan initiation (4.6), equipment for referral of patients with complex care needs (4.5), the plan execution (4.4), medication management strategies (4.4), emergency medical treatment conditions (4.4), disaster committee (4.4), stock types and quantities for essential medications (4.4), surge capacity of emergency beds (4.4), and mass-casualty triage protocols (4.4). This framework identifies a comprehensive set of indicators of hospital resilience. It can be used for hospital assessment, as well as informing priority practices to address future disasters better. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

From equity to power: Critical Success Factors for Twinning between midwives, a Delphi study.

PubMed

Cadée, Franka; Nieuwenhuijze, Marianne J; Lagro-Janssen, Antoine L M; de Vries, Raymond

2018-02-28

To gain consensus for Critical Success Factors associated with Twinning in Midwifery. International publications identify midwifery as important for improving maternity care worldwide. Midwifery is a team effort where midwives play a key role. Yet their power to take on this role is often lacking. Twinning has garnered potential to develop power in professionals, however, its success varies because implementation is not always optimal. Critical Success Factors have demonstrated positive results in the managerial context and can be helpful to build effective Twinning relationships. We approached 56 midwife Twinning experts from 19 countries to participate in three Delphi rounds between 2016 - 2017. In round 1, experts gave input through an open ended questionnaire and this was analysed to formulate Critical Success Factors statements that were scored on a 1-7 Likert scale aiming to gain consensus in rounds 2 and 3. These statements were operationalized for practical use such as a check list in planning, monitoring and evaluation in the field. Thirty-three experts from 14 countries took part in all three Delphi rounds, producing 58 initial statements. This resulted in 25 Critical Success Factors covering issues of management, communication, commitment and values, most focus on equity. The Critical Success Factors formulated represent the necessary ingredients for successful Twinning by providing a practical implementation framework and promote further research into the effect of Twinning. Findings show that making equity explicit in Twinning may contribute towards the power of midwives to take on their identified key role. © 2018 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Medication dispensing errors in Palestinian community pharmacy practice: a formal consensus using the Delphi technique.

PubMed

Shawahna, Ramzi; Haddad, Aseel; Khawaja, Baraa; Raie, Rand; Zaneen, Sireen; Edais, Tasneem

2016-10-01

Background Medication dispensing errors (MDEs) are frequent in community pharmacy practice. A definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice were not previously approached using formal consensus techniques. Objective This study was conducted to achieve consensus on a definition of MDEs and a wide range of scenarios that should or should not be considered as MDEs in Palestinian community pharmacy practice by a panel of community pharmacists. Setting Community pharmacy practice in Palestine. Method This was a descriptive study using the Delphi technique. A panel of fifty community pharmacists was recruited from different geographical locations of the West Bank of Palestine. A three round Delphi technique was followed to achieve consensus on a proposed definition of MDEs and 83 different scenarios representing potential MDEs using a nine-point scale. Main outcome measure Agreement or disagreement of a panel of community pharmacists on a proposed definition of MDEs and a series of scenarios representing potential MDEs. Results In the first Delphi round, views of key contact community pharmacists on MDEs were explored and situations representing potential MDEs were collected. In the second Delphi round, consensus was achieved to accept the proposed definition and to include 49 (59 %) of the 83 proposed scenarios as MDEs. In the third Delphi round, consensus was achieved to include further 13 (15.7 %) scenarios as MDEs, exclude 9 (10.8 %) scenarios and the rest of 12 (14.5 %) scenarios were considered equivocal based on the opinions of the panelists. Conclusion Consensus on a definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice was achieved using a formal consensus technique. The use of consensual definitions and scenarios representing MDE situations in community pharmacy practice might minimize methodological variations and their significant effects on the number and rate of MDEs reported in different studies.

What Are We Aiming For?--A Delphi Study on the Development of Civic Scientific Literacy in Sweden

ERIC Educational Resources Information Center

Chang Rundgren, Shu-Nu; Rundgren, Carl-Johan

2017-01-01

Based on the EU FP 7 project, PROFILES, this article presents our findings from a three-round Delphi study conducted in Sweden that aimed at establishing a consensus on how science education should be developed for citizens to enhance civic scientific literacy. A total of 100 stakeholders (9th graders, school teachers, scientists, and science…

The trials methodological research agenda: results from a priority setting exercise.

PubMed

Tudur Smith, Catrin; Hickey, Helen; Clarke, Mike; Blazeby, Jane; Williamson, Paula

2014-01-23

Research into the methods used in the design, conduct, analysis, and reporting of clinical trials is essential to ensure that effective methods are available and that clinical decisions made using results from trials are based on the best available evidence, which is reliable and robust. An on-line Delphi survey of 48 UK Clinical Research Collaboration registered Clinical Trials Units (CTUs) was undertaken. During round one, CTU Directors were asked to identify important topics that require methodological research. During round two, their opinion about the level of importance of each topic was recorded, and during round three, they were asked to review the group's average opinion and revise their previous opinion if appropriate. Direct reminders were sent to maximise the number of responses at each round. Results are summarised using descriptive methods. Forty one (85%) CTU Directors responded to at least one round of the Delphi process: 25 (52%) responded in round one, 32 (67%) responded in round two, 24 (50%) responded in round three. There were only 12 (25%) who responded to all three rounds and 18 (38%) who responded to both rounds two and three. Consensus was achieved amongst CTU Directors that the top three priorities for trials methodological research were 'Research into methods to boost recruitment in trials' (considered the highest priority), 'Methods to minimise attrition' and 'Choosing appropriate outcomes to measure'. Fifty other topics were included in the list of priorities and consensus was reached that two topics, 'Radiotherapy study designs' and 'Low carbon trials', were not priorities. This priority setting exercise has identified the research topics felt to be most important to the key stakeholder group of Directors of UKCRC registered CTUs. The use of robust methodology to identify these priorities will help ensure that this work informs the trials methodological research agenda, with a focus on topics that will have most impact and relevance.

The trials methodological research agenda: results from a priority setting exercise

PubMed Central

2014-01-01

Background Research into the methods used in the design, conduct, analysis, and reporting of clinical trials is essential to ensure that effective methods are available and that clinical decisions made using results from trials are based on the best available evidence, which is reliable and robust. Methods An on-line Delphi survey of 48 UK Clinical Research Collaboration registered Clinical Trials Units (CTUs) was undertaken. During round one, CTU Directors were asked to identify important topics that require methodological research. During round two, their opinion about the level of importance of each topic was recorded, and during round three, they were asked to review the group’s average opinion and revise their previous opinion if appropriate. Direct reminders were sent to maximise the number of responses at each round. Results are summarised using descriptive methods. Results Forty one (85%) CTU Directors responded to at least one round of the Delphi process: 25 (52%) responded in round one, 32 (67%) responded in round two, 24 (50%) responded in round three. There were only 12 (25%) who responded to all three rounds and 18 (38%) who responded to both rounds two and three. Consensus was achieved amongst CTU Directors that the top three priorities for trials methodological research were ‘Research into methods to boost recruitment in trials’ (considered the highest priority), ‘Methods to minimise attrition’ and ‘Choosing appropriate outcomes to measure’. Fifty other topics were included in the list of priorities and consensus was reached that two topics, ‘Radiotherapy study designs’ and ‘Low carbon trials’, were not priorities. Conclusions This priority setting exercise has identified the research topics felt to be most important to the key stakeholder group of Directors of UKCRC registered CTUs. The use of robust methodology to identify these priorities will help ensure that this work informs the trials methodological research agenda, with a focus on topics that will have most impact and relevance. PMID:24456928

Modified international e-Delphi survey to define healthcare professional competencies for working with teenagers and young adults with cancer

PubMed Central

Taylor, Rachel M; Feltbower, Richard G; Aslam, Natasha; Raine, Rosalind; Whelan, Jeremy S; Gibson, Faith

2016-01-01

Objectives To provide international consensus on the competencies required by healthcare professionals in order to provide specialist care for teenagers and young adults (TYA) with cancer. Design Modified e-Delphi survey. Setting International, multicentre study. Participants Experts were defined as professionals having worked in TYA cancer care for more than 12 months. They were identified through publications and professional organisations. Methods Round 1, developed from a previous qualitative study, included 87 closed-ended questions with responses on a nine-point Likert scale and further open-ended responses to identify other skills, knowledge and attitudes. Round 2 contained only items with no consensus in round 1 and suggestions of additional items of competency. Consensus was defined as a median score ranging from 7 to 9 and strength of agreement using mean absolute deviation of the median. Results A total of 179 registered to be members of the expert panel; valid responses were available from 158 (88%) in round 1 and 136/158 (86%) in round 2. The majority of participants were nurses (35%) or doctors (39%) from Europe (55%) or North America (35%). All 87 items in round 1 reached consensus with an additional 15 items identified for round 2, which also reached consensus. The strength of agreement was mostly high for statements. The areas of competence rated most important were agreed to be: ‘Identify the impact of disease on young people's life’ (skill), ‘Know about side effects of treatment and how this might be different to those experienced by children or older adults’ (knowledge), ‘Honesty’ (attitude) and ‘Listen to young people's concerns’ (aspect of communication). Conclusions Given the high degree of consensus, this list of competencies should influence education curriculum, professional development and inform workforce planning. Variation in strength of agreement for some competencies between professional groups should be explored further in pursuit of effective multidisciplinary team working. PMID:27142859

An examination of the research priorities for a hospice service in New Zealand: A Delphi study.

PubMed

de Vries, Kay; Walton, Jo; Nelson, Katherine; Knox, Rhondda

2016-06-01

Palliative care research is relatively diverse and prioritizing research in this field is dependent on multiple factors such as complex ethical decisions in designing and conducting the research; access to participants who may be deemed "vulnerable" and an increasingly medically focused approach to care. The aim of this study was to inform organizational decision-making and policy development regarding future research priorities for a hospice service in New Zealand. A modified three-round Delphi technique was employed. Participants were drawn from one dedicated specialist palliative care service that delivers care in the community, day-care, hospice inpatient, aged residential care, and acute hospital palliative care service. A purposive sample included palliative care staff (n = 10, 18, 9, for rounds 1-3, respectively) volunteers (n = 10, 12, 11); and patients and family carers (n = 6, 8, for rounds 1 and 2). Patients and family carers were not involved in the third round. At final ranking of six research themes encompassing 23 research topics were identified by staff and volunteers. These were: symptom management; aged care; education; community; patient and family; and bereavement support and young people. Patients and family carers agreed on four themes, made up of 10 research topics. These were: decision-making, bereavement and loss, symptom management; and recognition of need and response of service. The study generated a rich set of research themes and specific research topics. The perspectives of staff and volunteers are significantly different from those of patients and family members, in spite of the recognition by all concerned that palliative care services work within a philosophy of patient-centered care. Open discussion of ideas has the potential to engage both staff and patients and carers in quality improvement initiatives, and to reinforce the value of research for patient care.

Management of Helicobacter pylori infection in Latin America: A Delphi technique-based consensus

PubMed Central

Rollan, Antonio; Arab, Juan Pablo; Camargo, M Constanza; Candia, Roberto; Harris, Paul; Ferreccio, Catterina; Rabkin, Charles S; Gana, Juan Cristóbal; Cortés, Pablo; Herrero, Rolando; Durán, Luisa; García, Apolinaria; Toledo, Claudio; Espino, Alberto; Lustig, Nicole; Sarfatis, Alberto; Figueroa, Catalina; Torres, Javier; Riquelme, Arnoldo

2014-01-01

AIM: To optimize diagnosis and treatment guidelines for this geographic region, a panel of gastroenterologists, epidemiologists, and basic scientists carried out a structured evaluation of available literature. METHODS: Relevant questions were distributed among the experts, who generated draft statements for consideration by the entire panel. A modified three-round Delphi technique method was used to reach consensus. Critical input was also obtained from representatives of the concerned medical community. The quality of the evidence and level of recommendation supporting each statement was graded according to United States Preventive Services Task Force criteria. RESULTS: A group of ten experts was established. The survey included 15 open-ended questions that were distributed among the experts, who assessed the articles associated with each question. The levels of agreement achieved by the panel were 50% in the first round, 73.3% in the second round and 100% in the third round. Main consensus recommendations included: (1) when available, urea breath and stool antigen test (HpSA) should be used for non-invasive diagnosis; (2) detect and eradicate Helicobacter pylori (H. pylori) in all gastroscopy patients to decrease risk of peptic ulcer disease, prevent o retard progression in patients with preneoplastic lesions, and to prevent recurrence in patients treated for gastric cancer; (3) further investigate implementation issues and health outcomes of H. pylori eradication for primary prevention of gastric cancer in high-risk populations; (4) prescribe standard 14-d triple therapy or sequential therapy for first-line treatment; (5) routinely assess eradication success post-treatment in clinical settings; and (6) select second- and third-line therapies according to antibiotic susceptibility testing. CONCLUSION: These achievable steps toward better region-specific management can be expected to improve clinical health outcomes. PMID:25152601

A Delphi Study: The Characteristics of Democratic Schools

ERIC Educational Resources Information Center

Korkmaz, H. Eylem; Erden, Münire

2014-01-01

The authors aim to identify characteristics of democratic schools. The Delphi technique used in this study is based on attaining a consensus among a group of experts over 3 rounds with 22 experts from 9 countries participating in the first round. By the end of the third round, 339 items referring to democratic school characteristics were…

Issues Facing Urban Agriscience Teachers: A Delphi Study

ERIC Educational Resources Information Center

Warner, Wendy J.; Washburn, Shannon G.

2009-01-01

This national study used the Delphi technique to identify the issues facing urban agriscience teachers. The first round of the study used a questionnaire with one open-ended question to generate responses from the expert panel. In the second round, respondents were asked to rate their level of agreement with 72 issues identified in round one using…

Development of quality indicators for physiotherapy for patients with PAOD in the Netherlands: a Delphi study.

PubMed

Gijsbers, H J H; Lauret, G J; van Hofwegen, A; van Dockum, T A; Teijink, J A W; Hendriks, H J M

2016-06-01

The aim of the study was to develop quality indicators (QIs) for physiotherapy management of patients with intermittent claudication (IC) in the Netherlands. As part of an international six-step method to develop QIs, an online survey Delphi-procedure was completed. After two Delphi-rounds a validation round was performed. Twenty-six experts were recruited to participate in this study. Twenty-four experts completed two Delphi-rounds. A third round was conducted inviting 1200 qualified and registered physiotherapists of the Dutch integrated care network 'Claudicationet' to validate a draft set of quality indicators. Out of 83 potential QIs in the Dutch physiotherapy guideline on 'Intermittent claudication', consensus among the experts selected nine indicators. All nine quality indicators were validated by 300 physiotherapists. A final set of nine indicators was derived from (1) a Dutch evidence-based physiotherapy guideline, (2) an expert Delphi procedure and (3) a validation by 300 physiotherapists. This set of indicators should be validated in clinical practice. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Content Validity of a Psychotherapeutic Intervention Model in Nursing: A Modified e-Delphi Study.

PubMed

Sampaio, Francisco Miguel Correia; Sequeira, Carlos; Lluch Canut, Teresa

2017-04-01

To estimate the content validity of a psychotherapeutic intervention model in nursing. Mental health nurses encounter great extrinsic difficulties when it comes to providing psychotherapeutic interventions due to the fact that they are not allowed to perform such practice in some countries. In this light, the pursuit of a psychotherapeutic intervention model in nursing seems germane to guide the professionals' psychotherapeutic practice, contributing hereof to increase mental health nurses' professional autonomy. Modified e-Delphi. Data were collected from October 2015 to January 2016 by means of three rounds of online questionnaires. The initial questionnaire was structured into five sections: general structure of the model, patients' exclusion criteria, assessment framework, nursing diagnoses, and nursing psychotherapeutic interventions. From the 42 experts invited, at least twenty (20) participated in each round. The experts achieved consensus with regard to the conclusion that nursing psychotherapeutic interventions should always seek to address a nursing diagnosis. These defined furthermore that a psychotherapeutic intervention model in nursing should be exercised by means of 3 to 12 sessions using Nursing Interventions Classification (NIC) as a resource. Finally, experts deemed that the model should follow the principles of integrative psychotherapy, so that techniques from different schools of psychotherapy could therefore be used in conjunction to promote the resolution of a nursing diagnosis. Achieving consensus about the structure of a psychotherapeutic intervention model in nursing is imperative to guide nurses in the provision of nursing psychotherapeutic interventions and to enable an effective evaluation of the health gains associated with its implementation. Copyright © 2016 Elsevier Inc. All rights reserved.

Projecting Agricultural Education Programs for the 21st Century Using a Modified Delphi Technique.

ERIC Educational Resources Information Center

Iverson, Maynard J.

A modified three-step Delphi procedure was used to conduct a series of national studies of futurists regarded by their peers as top experts in agricultural education. The primary objective was to project enrollments in agricultural education programs for the 21st century. Other study objectives were to ascertain whether the Delphi technique could…

Development of quality indicators for transition from pediatric to adult care in sickle cell disease: A modified Delphi survey of adult providers.

PubMed

Sobota, Amy E; Shah, Nishita; Mack, Jennifer W

2017-06-01

Transition from pediatric to adult care is a vulnerable time for young adults with sickle cell disease (SCD); however, improvements in transition are limited by a lack of quality indicators. The purpose of this study was to establish quality indicators for transition in SCD and to determine the optimal timing between the final pediatric visit and the first adult provider visit. We conducted a modified Delphi survey to reach a consensus on which quality indicators are most important for a successful transition. Our expert panel consisted of members of the Sickle Cell Adult Provider Network. In the first round, the participants ranked a list of quality indicators by importance. In the second round, the participants chose their "top 5" quality indicators in terms of importance and also ranked them on feasibility. The response rates for the two rounds were 68 and 96%, respectively. Nine quality indicators were chosen as "top 5" by a majority of respondents, including communication between pediatric and adult providers, timing of first adult visit, patient self-efficacy, quality of life, and trust with their adult provider. Based on the comments from round 1, respondents were also asked for the optimal timing between leaving pediatric care and entering adult care. Most recommended a first adult visit within 2 months of the final pediatric visit. By using these quality indicators chosen by the majority of respondents, we can better develop and evaluate transition programs for young adults with SCD and improve health outcomes for these vulnerable patients. © 2016 Wiley Periodicals, Inc.

Identifying nurse and health visitor priorities in a PCT using the Delphi technique.

PubMed

Brooks, Nicky; Barrett, Anna

2003-08-01

A three-stage Delphi investigation was undertaken over a 4-month period in a primary care trust to identify the perceived clinical needs of nurses. Practice nurses, district nurses, health visitors and community hospital nurses all participated. In round 1, there were 28 replies from these groups of nurses, in round 2 there were 31, and in round 3 there were 25 replies. In round 1, 77 issues (excluding duplications) were identified. These were separated into three themes according to the most appropriate method for addressing the issue: education (29 issues), research (16 issues) and management (32). In round 2, the issues were redistributed in the three areas and staff were asked to choose the ten most important issues from education, research and management. Finally, in round 3 the ten issues in education, research and management were prioritized in terms of the "most pressing". The most pressing education need was recognizing accountability; the most pressing research need was caseload/dependency scoring--matching staff levels to workload, and the most pressing management need was risk management, e.g. staff safety. The results have identified locally that there is a gap between the modernization agenda and what nursing staff consider to be the issues that need addressing locally. If measures are not put in place to address these local issues, there is a danger that nurses will not take a full and active role in the modernization of the NHS.

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

Nature-based care opportunities and barriers in oncology contexts: a modified international e-Delphi survey.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-10-16

To develop recommendations regarding opportunities and barriers for nature-based care in oncology contexts using a structured knowledge generation process involving relevant healthcare and design experts. Four-round modified electronic Delphi study. Oncology patients' nature-based recommendations, uncovered in preceding qualitative investigation, were included in the first round for the expert participants' consideration. Key items (opportunities and barriers) were developed using data aggregation and synthesis, followed by item prioritisation and 10-point Likert scale ranking (1=not important, 10=very important). Descriptive statistics were calculated to assess items of highest importance representing expert recommendations. Online Delphi process constituting an electronic international survey. A purposive sample of 200 potential panellists (recruitment target n=40) comprising healthcare practitioners, managers, designers, architects and researchers were invited to participate; experts were identified via research networks, snowballing and systematic literature review. 38 experts across seven countries (Australia, USA, UK, New Zealand, Canada, Denmark and Sweden) returned questionnaire 1, which determined consent and acceptance for participation. Initial response rate was 19%, and subsequent response rates were 84%, 82% and 84% for rounds 2, 3 and 4, respectively. The Delphi panel developed recommendations consisting of 10 opportunities and 10 barriers. The following opportunities were rated to be of highest importance: window views from clinical areas onto nature; outdoor settings, gardens and courtyards with easy and effortless access; and nature-based physical exercise adapted to patient requirements. Highest-rated barriers for nature-based oncology care included lack of knowledge and awareness about benefits of nature engagement and inaccessibility, not considering access requirements for the very sick and frail. Experts suggested and agreed on a set of recommendations, which represent critical considerations for the safe adoption of nature-based oncology opportunities. These findings fill a gap in understanding about helpful nature-based oncology care and may translate into oncology design and innovation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Engaging communication experts in a Delphi process to identify patient behaviors that could enhance communication in medical encounters

PubMed Central

2010-01-01

Background The communication literature currently focuses primarily on improving physicians' verbal and non-verbal behaviors during the medical interview. The Four Habits Model is a teaching and research framework for physician communication that is based on evidence linking specific communication behaviors with processes and outcomes of care. The Model conceptualizes basic communication tasks as "Habits" and describes the sequence of physician communication behaviors during the clinical encounter associated with improved outcomes. Using the Four Habits Model as a starting point, we asked communication experts to identify the verbal communication behaviors of patients that are important in outpatient encounters. Methods We conducted a 4-round Delphi process with 17 international experts in communication research, medical education, and health care delivery. All rounds were conducted via the internet. In round 1, experts reviewed a list of proposed patient verbal communication behaviors within the Four Habits Model framework. The proposed patient verbal communication behaviors were identified based on a review of the communication literature. The experts could: approve the proposed list; add new behaviors; or modify behaviors. In rounds 2, 3, and 4, they rated each behavior for its fit (agree or disagree) with a particular habit. After each round, we calculated the percent agreement for each behavior and provided these data in the next round. Behaviors receiving more than 70% of experts' votes (either agree or disagree) were considered as achieving consensus. Results Of the 14 originally-proposed patient verbal communication behaviors, the experts modified all but 2, and they added 20 behaviors to the Model in round 1. In round 2, they were presented with 59 behaviors and 14 options to remove specific behaviors for rating. After 3 rounds of rating, the experts retained 22 behaviors. This set included behaviors such as asking questions, expressing preferences, and summarizing information. Conclusion The process identified communication tasks and verbal communication behaviors for patients similar to those outlined for physicians in the Four Habits Model. This represents an important step in building a single model that can be applied to teaching patients and physicians the communication skills associated with improved satisfaction and positive outcomes of care. PMID:20403173

Identification and Development of Items Comprising Organizational Citizenship Behaviors Among Pharmacy Faculty

PubMed Central

Semsick, Gretchen R.

2016-01-01

Objective. Identify behaviors that can compose a measure of organizational citizenship by pharmacy faculty. Methods. A four-round, modified Delphi procedure using open-ended questions (Round 1) was conducted with 13 panelists from pharmacy academia. The items generated were evaluated and refined for inclusion in subsequent rounds. A consensus was reached after completing four rounds. Results. The panel produced a set of 26 items indicative of extra-role behaviors by faculty colleagues considered to compose a measure of citizenship, which is an expressed manifestation of collegiality. Conclusions. The items generated require testing for validation and reliability in a large sample to create a measure of organizational citizenship. Even prior to doing so, the list of items can serve as a resource for mentorship of junior and senior faculty alike. PMID:28179717

Psychosocial care for persons affected by emergencies and major incidents: a Delphi study to determine the needs of professional first responders for education, training and support.

PubMed

Drury, John; Kemp, Verity; Newman, Jonathan; Novelli, David; Doyle, Christopher; Walter, Darren; Williams, Richard

2013-10-01

The role of ambulance clinicians in providing psychosocial care in major incidents and emergencies is recognised in recent Department of Health guidance. The study described in this paper identified NHS professional first responders' needs for education about survivors' psychosocial responses, training in psychosocial skills, and continuing support. Ambulance staff participated in an online Delphi questionnaire, comprising 74 items (Round 1) on 7-point Likert scales. Second-round and third-round participants each received feedback based on the previous round, and responded to modified versions of the original items and to new items for clarification. One hundred and two participants took part in Round 1; 47 statements (64%) achieved consensus. In Round 2, 72 people from Round 1 participated; 15 out of 39 statements (38%) achieved consensus. In Round 3, 49 people from Round 2 participated; 15 out of 27 statements (59%) achieved consensus. Overall, there was consensus in the following areas: 'psychosocial needs of patients' (consensus in 34/37 items); 'possible sources of stress in your work' (8/9); 'impacts of distress in your work' (7/10); 'meeting your own emotional needs' (4/5); 'support within your organisation' (2/5); 'needs for training in psychosocial skills for patients' (15/15); 'my needs for psychosocial training and support' (5/6). Ambulance clinicians recognise their own education needs and the importance of their being offered psychosocial training and support. The authors recommend that, in order to meet patients' psychosocial needs effectively, ambulance clinicians are provided with education and training in a number of skills and their own psychosocial support should be enhanced.

Addressing the workplace needs of Western Australian midwives: a Delphi study.

PubMed

Hauck, Yvonne L; Bayes, Sara J; Robertson, Jeanette M

2012-05-01

To determine the workplace needs of Western Australian midwives working in public metropolitan secondary hospitals. Using a three-round Delphi approach, Round 1 incorporated focus groups and a questionnaire. Fifteen focus groups were conducted with midwives also having the option of contributing through an open-ended questionnaire. During Round 2, 38 items reflecting seven themes were prioritised with a final ranking performed in Round 3. In total, 114 midwives participated in Round 1, 72 in Round 2 and 89 in Round 3. During Round 1, workplace needs identified as being met included: working across all areas of midwifery; ability to work in areas of interest; opportunity to work with low to moderate risk women; supportive colleagues; accessible parking; hospital close to home and friendly work atmosphere. Round 2 items revealed the five top unmet needs as: adequate midwifery staff coverage; access to maintained equipment; competitive pay scales; patient safety issues and opportunities to implement midwifery models. The top ranked needs from Round 3 included: recognising the unpredictable nature of midwifery services; provision of competent medical coverage, and adequate midwifery staff coverage. Demand for maternity services is unpredictable; however, in order to maintain a sustainable maternity workforce, WA midwives' prioritised needs would suggest health management focus upon expanding the availability of midwifery models of care, fostering flexible working conditions and ensuring collaboration between maternity health professionals occurs within clinically safe staffing levels.

Teacher Competencies in Health Education: Results of a Delphi Study

PubMed Central

Moynihan, Sharon; Paakkari, Leena; Välimaa, Raili; Jourdan, Didier; Mannix-McNamara, Patricia

2015-01-01

Objective The aim of this research study was to identify the core competencies for health education teachers in supporting the development of health literacy among their students. Method/Results A three round Delphi method was employed. Experts in health education were asked to identify core competencies for school health educators. Twenty six participants from the academic field were invited to participate in the study. Twenty participants completed the first round of the Delphi, while eighteen took part in round two and fifteen participated in the final round. Data were collected using an electronic questionnaire. The first round contained an open ended question in which participants were asked to name and define all the competencies they perceived were important. Thematic analysis was undertaken on these data. A list of 36 competencies was created from this round. This list was then returned to the same participants and they were asked to rate each competency on a 7 point semantic differential scale in terms of importance. The resulting data were then analysed. For the final round, participants were presented with a list of 33 competencies and were asked to rank them again, in order of importance. Conclusion Twelve core competencies emerged from the analysis and these competencies comprised of a mixture of knowledge, attitude and skills. The authors suggest that how these competencies are achieved and operationalised in the school context can be quite complex and multi-faceted. While the authors do not seek to generalise from the study they suggest that these competencies are an important input for all stakeholders, in order to question national and international teacher guidelines. In addition the competencies identified may provide a useful starting point for others to undertake deeper analysis of what it means to be an effective health educator in schools. PMID:26630180

Identifying seminal papers in the Australasian Journal on Ageing 1982-2011: a Delphi consensus approach.

PubMed

Parkinson, Lynne; Richardson, Kristy; Sims, Jane; Wells, Yvonne; Naganathan, Vasi; Brooke, Elizabeth; Lindley, Richard

2013-10-01

The aim of this study was to identify seminal Australasian Journal on Ageing papers published over 30 years through a Delphi consensus process. The main data collection was a three-round Delphi consensus study with 38 past and current members of the Australasian Journal on Ageing Editorial Board, Editorial Team and Management Committee. Three papers were agreed as top-ranking. One of the top-ranking articles was also highly cited. One article was published in the 1990 s, two in 2001. While it is difficult to judge how well the top-ranking papers represent seminal papers arising over 30 years, these papers do represent three different research strengths in Australasia, they do span three different disciplines, and they do reflect some of the diversity that characterises ageing research in Australasia over 30 years. © 2013 ACOTA.

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study.

PubMed

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-16

To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Hospitals and community health centres in Taiwan. A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. 15 Chinese healthcare practitioners with more than 6 months' experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Developing Canadian oncology education goals and objectives for medical students: a national modified Delphi study.

PubMed

Tam, Vincent C; Ingledew, Paris-Ann; Berry, Scott; Verma, Sunil; Giuliani, Meredith E

2016-01-01

Studies have shown that there is a deficiency in focused oncology teaching during medical school in Canada. This study aimed to develop oncology education goals and objectives for medical students through consensus of oncology educators from across Canada. In 2014 we created a comprehensive list of oncology education objectives using existing resources. Experts in oncology education and undergraduate medical education from all 17 Canadian medical schools were invited to participate in a 3-round modified Delphi process. In round 1, the participants scored the objectives on a 9-point Likert scale according to the degree to which they agreed an objective should be taught to medical students. Objectives with a mean score of 7.0 or greater were retained, those with a mean score of 1.0-3.9 were excluded, and those with a mean score of 4.0-6.9 were discussed at a round 2 Web meeting. In round 3, the participants voted on inclusion and exclusion of the round 2 objectives. Thirty-four (92%) of the 37 invited oncology educators, representing 14 medical schools, participated in the study. They included oncologists, family physicians, members of undergraduate medical education curriculum committees and a psychologist. Of the 214 objectives reviewed in round 1, 146 received a mean score of 7.0 or greater, and 68 were scored 4.0-6.9; no objective received a mean score below 4.0. Nine new objectives were suggested. The main themes of participants' comments were to minimize the number of objectives and to aim objectives at the knowledge level required for family physicians. In round 2, the participants were able to combine 28 of the objectives with other existing objectives. In round 3, 7 of the 49 objectives received consensus of at least 75% for inclusion. The final Canadian Oncology Goals and Objectives for Medical Students contained 10 goals and 153 objectives. Through a systematic process, we created a comprehensive, consensus-based set of oncology goals and objectives to facilitate the design of undergraduate medical education curricula and improve oncology education for medical students.

Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

PubMed

Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

2016-07-01

To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

Research priorities in Italian diabetes nursing care: findings from a Delphi study.

PubMed

Palese, A; Gentilini, S; Lo Grasso, G; Branca, M T; Chiandetti, R; Mansutti, I

2015-01-01

Defining a set of research priorities for diabetes nursing care in the Italian context. A two-step study design based on a modified Delphi technique was undertaken in 2013. In the first stage of research, five systematic reviews of literature were performed. Among them 865 recommendations in diabetes nursing care emerged, and 217 (25.1%) were categorized at level IV or lower, thus based on a lack of knowledge and therefore a potential research area. Homogeneous recommendations among the 217 emerged and were categorized by two researchers independently: 96 final recommendations were identified and transformed into items embodied into a questionnaire. A Likert scale ranging from 1 (very low) to 5 (very high) was used to collect the consensus regarding priority. For that purpose a sample of 200 nurses was randomly considered. Potential participants were invited to cooperate via email through a letter reporting aims and methods. In the first round 85 nurses participated; in the third and final round, only 13 nurses took part. Participants have identified 14 research priorities categorized into three main areas: 1) education strategies' effectiveness (n=7); 2) models of care delivery and advanced nursing education effectiveness (n=4); and 3) in specific clinical issues (n=3). More research on patient education and on models of care delivery and advanced nursing education should be included in any future Italian agenda.

Evaluation Criteria for Nursing Student Application of Evidence-Based Practice: A Delphi Study.

PubMed

Bostwick, Lina; Linden, Lois

2016-06-01

Core clinical evaluation criteria do not exist for measuring prelicensure baccalaureate nursing students' application of evidence-based practice (EBP) during direct care assignments. The study objective was to achieve consensus among EBP nursing experts to create clinical criteria for faculty to use in evaluating students' application of EBP principles. A three-round Delphi method was used. Experts were invited to participate in Web-based surveys. Data were analyzed using qualitative coding and categorizing. Quantitative analyses were descriptive calculations for rating and ranking. Expert consensus occurred in the Delphi rounds. The study provides a set of 10 core clinical evaluation criteria for faculty evaluating students' progression toward competency in their application of EBP. A baccalaureate program curriculum requiring the use of Bostwick's EBP Core Clinical Evaluation Criteria will provide a clear definition for understanding basic core EBP competence as expected for the assessment of student learning. [J Nurs Educ. 2016;55(5):336-341.]. Copyright 2016, SLACK Incorporated.

Improving Patient Safety in Public Hospitals: Developing Standard Measures to Track Medical Errors and Process Breakdowns.

PubMed

Ackerman, Sara L; Gourley, Gato; Le, Gem; Williams, Pamela; Yazdany, Jinoos; Sarkar, Urmimala

2018-03-14

The aim of the study was to develop standards for tracking patient safety gaps in ambulatory care in safety net health systems. Leaders from five California safety net health systems were invited to participate in a modified Delphi process sponsored by the Safety Promotion Action Research and Knowledge Network (SPARKNet) and the California Safety Net Institute in 2016. During each of the three Delphi rounds, the feasibility and validity of 13 proposed patient safety measures were discussed and prioritized. Surveys and transcripts from the meetings were analyzed to understand the decision-making process. The Delphi process included eight panelists. Consensus was reached to adopt 9 of 13 proposed measures. All 9 measures were unanimously considered valid, but concern was expressed about the feasibility of implementing several of the measures. Although safety net health systems face high barriers to standardized measurement, our study demonstrates that consensus can be reached on acceptable and feasible methods for tracking patient safety gaps in safety net health systems. If accompanied by the active participation key stakeholder groups, including patients, clinicians, staff, data system professionals, and health system leaders, the consensus measures reported here represent one step toward improving ambulatory patient safety in safety net health systems.

Developing Resident-Sensitive Quality Measures: A Model From Pediatric Emergency Medicine.

PubMed

Schumacher, Daniel J; Holmboe, Eric S; van der Vleuten, Cees; Busari, Jamiu O; Carraccio, Carol

2017-12-05

To begin closing the gap with respect to quality measures available for use among residents, the authors sought to identify and develop resident-sensitive quality measures (RSQMs) for use in the pediatric emergency department (PED) setting. In May 2016, the authors reviewed National Quality Measures Clearinghouse (NQMC) measures to identify resident-sensitive measures. To create additional measures focused on common, acute illnesses (acute asthma exacerbation, bronchiolitis, closed head injury [CHI]) in the PED, the authors used a nominal group technique (NGT) and Delphi process from September to December 2016. To achieve a local focus for developing these measures, all NGT and Delphi participants were from Cincinnati Children's Hospital Medical Center. Delphi participants rated measures developed through the NGT in two areas: importance of measure to quality care and likelihood that measure represents the work of a resident. The review of NQMC measures identified 28 of 183 as being potentially resident-sensitive. The NGT produced 67 measures for asthma, 46 for bronchiolitis, and 48 for CHI. These were used in the first round of the Delphi process. After two rounds, 18 measures for asthma, 21 for bronchiolitis, and 22 for CHI met automatic inclusion criteria. In round three, participants categorized the potential final measures by their top 10 and next 5. This study describes a template for identifying and developing RSQMs that may promote high-quality care delivery during and following training. Next steps should include implementing and seeking validity evidence for the locally developed measures.

Operationalising elaboration theory for simulation instruction design: a Delphi study.

PubMed

Haji, Faizal A; Khan, Rabia; Regehr, Glenn; Ng, Gary; de Ribaupierre, Sandrine; Dubrowski, Adam

2015-06-01

The aim of this study was to assess the feasibility of incorporating the Delphi process within the simplifying conditions method (SCM) described in elaboration theory (ET) to identify conditions impacting the complexity of procedural skills for novice learners. We generated an initial list of conditions impacting the complexity of lumbar puncture (LP) from key informant interviews (n = 5) and a literature review. Eighteen clinician-educators from six different medical specialties were subsequently recruited as expert panellists. Over three Delphi rounds, these panellists rated: (i) their agreement with the inclusion of the simple version of the conditions in a representative ('epitome') training scenario, and (ii) how much the inverse (complex) version increases LP complexity for a novice. Cronbach's α-values were used to assess inter-rater agreement. All panellists completed Rounds 1 and 2 of the survey and 17 completed Round 3. In Round 1, Cronbach's α-values were 0.89 and 0.94 for conditions that simplify and increase LP complexity, respectively; both values increased to 0.98 in Rounds 2 and 3. With the exception of 'high CSF (cerebral spinal fluid) pressure', panellists agreed with the inclusion of all conditions in the simplest (epitome) training scenario. Panellists rated patient movement, spinal anatomy, patient cooperativeness, body habitus, and the presence or absence of an experienced assistant as having the greatest impact on the complexity of LP. This study demonstrated the feasibility of using expert consensus to establish conditions impacting the complexity of procedural skills, and the benefits of incorporating the Delphi method into the SCM. These data can be used to develop and sequence simulation scenarios in a progressively challenging manner. If the theorised learning gains associated with ET are realised, the methods described in this study may be applied to the design of simulation training for other procedural and non-procedural skills, thereby advancing the agenda of theoretically based instruction design in health care simulation. © 2015 John Wiley & Sons Ltd.

Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure

PubMed Central

2013-01-01

Background The quantity and quality of studies in child and adolescent physical activity and sedentary behaviour have rapidly increased, but research directions are often pursued in a reactive and uncoordinated manner. Aim To arrive at an international consensus on research priorities in the area of child and adolescent physical activity and sedentary behaviour. Methods Two independent panels, each consisting of 12 experts, undertook three rounds of a Delphi methodology. The Delphi methodology required experts to anonymously answer questions put forward by the researchers with feedback provided between each round. Results The primary outcome of the study was a ranked set of 29 research priorities that aimed to be applicable for the next 10 years. The top three ranked priorities were: developing effective and sustainable interventions to increase children’s physical activity long-term; policy and/or environmental change and their influence on children’s physical activity and sedentary behaviour; and prospective, longitudinal studies of the independent effects of physical activity and sedentary behaviour on health. Conclusions These research priorities can help to guide decisions on future research directions. PMID:24228891

Major incident triage: A consensus based definition of the essential life-saving interventions during the definitive care phase of a major incident.

PubMed

Vassallo, James; Smith, Jason E; Bruijns, Stevan R; Wallis, Lee A

2016-09-01

Triage is a key principle in the effective management of major incidents. The process currently relies on algorithms assigning patients to specific triage categories; there is, however, little guidance as to what these categories represent. Previously, these algorithms were validated against injury severity scores, but it is accepted now that the need for life-saving intervention is a more important outcome. However, the definition of a life-saving intervention is unclear. The aim of this study was to define what constitutes a life-saving intervention, in order to facilitate the definition of an adult priority one patient during the definitive care phase of a major incident. We conducted a modified Delphi study, using a panel of subject matter experts drawn from the United Kingdom and Republic of South Africa with a background in Emergency Care or Major Incident Management. The study was conducted using an online survey tool, over three rounds between July and December 2013. A four point Likert scale was used to seek consensus for 50 possible interventions, with a consensus level set at 70%. 24 participants completed all three rounds of the Delphi, with 32 life-saving interventions reaching consensus. This study provides a consensus definition of what constitutes a life-saving intervention in the context of an adult, priority one patient during the definitive care phase of a major incident. The definition will contribute to further research into major incident triage, specifically in terms of validation of an adult major incident triage tool. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development of a clinical definition for acute respiratory distress syndrome using the Delphi technique.

PubMed

Ferguson, Niall D; Davis, Aileen M; Slutsky, Arthur S; Stewart, Thomas E

2005-06-01

The objective of this study is to describe the implementation of formal consensus techniques in the development of a clinical definition for acute respiratory distress syndrome. A Delphi consensus process was conducted using e-mail. Sixteen panelists who were both researchers and opinion leaders were systematically recruited. The Delphi technique was performed over 4 rounds on the background of an explicit definition framework. Item generation was performed in round 1, item reduction in rounds 2 and 3, and definition evaluation in round 4. Explicit consensus thresholds were used throughout. Of the 16 panelists, 11 actually participated in developing a definition that met a priori consensus rules on the third iteration. New incorporations in the Delphi definition include the use of a standardized oxygenation assessment and the documentation of either a predisposing factor or decreased thoracic compliance. The panelists rated the Delphi definition as acceptable to highly acceptable (median score, 6; range, 5-7 on a 7-point Likert scale). We conclude that it is feasible to consider using formal consensus in the development of future definitions of acute respiratory distress syndrome. Testing of sensibility, reliability, and validity are needed for this preliminary definition; these test results should be incorporated into future iterations of this definition.

Development of disaster mental health guidelines through the Delphi process in Japan.

PubMed

Suzuki, Yuriko; Fukasawa, Maiko; Nakajima, Satomi; Narisawa, Tomomi; Kim, Yoshiharu

2012-07-02

The mental health community in Japan had started reviewing the country's disaster mental health guidelines before the Great East Japan Earthquake, aiming to revise them based on evidence and experience accumulated in the last decade. Given the wealth of experience and knowledge acquired in the field by many Japanese mental health professionals, we decided to develop the guidelines through systematic consensus building and selected the Delphi method. After a thorough literature review and focus group interviews, 96 items regarding disaster mental health were included in Delphi Round 1. Of 100 mental health professionals experienced in disaster response who were invited to participate, 97 agreed. The appropriateness of each statement was assessed by the participants using a Likert scale (1: extremely inappropriate, 9: very appropriate) and providing free comments in three rounds. Consensus by experts was defined as an average score of ≥7 for which ≥70% of participants assigned this score, and items reaching consensus were included in the final guidelines. Overall, of the 96 items (89 initially asked and 7 added items), 77 items were agreed on (46 items in Round 1, and 19 positive and 12 negative agreed on items in Round 2). In Round 2, three statements with which participants agreed most strongly were: 1) A protocol for emergency work structure and information flow should be prepared in normal times; 2) The mental health team should attend regular meetings on health and medicine to exchange information; and 3) Generally, it is recommended not to ask disaster survivors about psychological problems at the initial response but ask about their present worries and physical condition. Three statements with which the participants disagreed most strongly in this round were: 1) Individuals should be encouraged to provide detailed accounts of their experiences; 2) Individuals should be provided with education if they are interested in receiving it; and 3) Bad news should be withheld from distressed individuals for fear of causing more upset. Most items which achieved agreement in Round 1 were statements described in previous guidelines or publications, or statements regarding the basic attitude of human service providers. The revised guidelines were thus developed based on the collective wisdom drawn from Japanese practitioners' experience while also considering the similarities and differences from the international standards.

A proposed adaptation of the European Foundation for Quality Management Excellence Model to physical activity programmes for the elderly - development of a quality self-assessment tool using a modified Delphi process

PubMed Central

2011-01-01

Background There has been a growing concern in designing physical activity (PA) programmes for elderly people, since evidence suggests that such health promotion interventions may reduce the deleterious effects of the ageing process. Complete programme evaluations are a necessary prerequisite to continuous quality improvements. Being able to refine, adapt and create tools that are suited to the realities and contexts of PA programmes for the elderly in order to support its continuous improvement is, therefore, crucial. Thus, the aim of this study was to develop a self-assessment tool for PA programmes for the elderly. Methods A 3-round Delphi process was conducted via the Internet with 43 national experts in PA for the elderly, management and delivery of PA programmes for the elderly, sports management, quality management and gerontology, asking experts to identify the propositions that they considered relevant for inclusion in the self-assessment tool. Experts reviewed a list of proposed statements, based on the criteria and sub-criteria from the European Foundation for Quality Management Excellence Model (EFQM) and PA guidelines for older adults and rated each proposition from 1 to 8 (disagree to agree) and modified and/or added propositions. Propositions receiving either bottom or top scores of greater than 70% were considered to have achieved consensus to drop or retain, respectively. Results In round 1, of the 196 originally-proposed statements (best practice principles), the experts modified 41, added 1 and achieved consensus on 93. In round 2, a total of 104 propositions were presented, of which experts modified 39 and achieved consensus on 53. In the last round, of 51 proposed statements, the experts achieved consensus on 19. After 3 rounds of rating, experts had not achieved consensus on 32 propositions. The resulting tool consisted of 165 statements that assess nine management areas involved in the development of PA programmes for the elderly. Conclusion Based on experts' opinions, a self-assessment tool was found in order to access quality of PA programmes for the elderly. Information obtained with evaluations would be useful to organizations seeking to improve their services, customer satisfaction and, consequently, adherence to PA programmes, targeting the ageing population. PMID:21958203

Identifying opportunities for nature engagement in cancer care practice and design: protocol for four-round modified electronic Delphi.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-03-08

Opportunities to engage with nature have shown relevance in experiences of health and recovery of patients with cancer and are attracting interest in cancer care practice and design. Such healthcare innovations can widen the horizon of possible supportive care solutions but require deliberate and rigorous investigation to ensure responsible action is taken and wastage avoided. This protocol outlines a study designed to solicit knowledge from relevant experts drawn from a range of healthcare practitioners, management representatives, designers and researchers to explore levels of opinion consensus for determining opportunities for, and barriers to, providing helpful nature engagement in cancer care settings. A 4-round modified electronic Delphi methodology will be used to conduct a structured, iterative feedback process for querying and synthesising expert opinion. Round 1 administers an open-ended questionnaire to a panel of selected, relevant experts who will consider the own recommendations of patients with cancer for nature engagement (drawn from a preceding investigation) before contributing salient issues (items) with relevance to the topic. Round 2 circulates anonymised summaries of responses back to the experts who verify and, if they wish, reconsider their own responses. Rounds 3 and 4 determine and rank experts' top 10 items using a 10-point Likert-type scale. Descriptive statistics (median and mean scores) will be calculated to indicate the items' relative importance. Levels of consensus will be explored with consensus defined as 75% agreement. Ethics approval for this study was obtained from the Institution's Human Research Ethics Committee (blinded for review). It is anticipated that the results will be published in peer-reviewed journals and presented in a variety of forums. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Toward an essential ethic for teaching science in the new millennium

NASA Astrophysics Data System (ADS)

Hays, Irene De La Bretonne

The purpose of this study was to identify and explore values and views that might underlie an essential ethic for teaching science in the new millennium. With such an ethic, teachers may be better able to prepare young people to form and fully participate in communities that restore and sustain Earth. Reviewed in the literature for this study were changing philosophies and theories from early indigenous cultures to the present on the nature of nature, the value of nature, and the human relationship with nature. These philosophies and theories were found to influence values that today underlie the work scientists do and the ways young people are educated in science. In the study, two groups of participants--Nature Writers and scientists--revealed the essence and meaning of their relationship with nature. A two-stage, modified Delphi method was used for collecting data. Stage One comprised the first "round" of the Delphi and involved content analysis of writings by a select group of U.S. Nature Writers from the early 1800s to the present. In Stage Two, comprising three rounds of the modified Delphi, perspectives of Nature Writers were imbedded in questionnaires and presented for response to a select group of scientists connected with research and education at National Laboratories across the country. Finally, results from each participant group were brought together in a recursive process, one with the other, to determine findings. Strong Earth-care values, including receptivity, responsibility, interdependence, respect, cooperation, love, and care, were found to be held in common by the Nature Writers and scientists in this study and could form the foundation for an essential ethic for teaching science. The strongest dissonance between Nature Writers and scientists was evident in emotional and spiritual domains--despite that many scientists revealed emotional and spiritual elements in stories told of their experiences with nature. Contrary to what might have been expected from scientists based on theories of science and practices of science education represented in the literature, few scientists revealed negative, utilitarian, or dominionistic affiliations with nature. In contrast, no Nature Writers revealed such affiliations.

Defining the Key Competencies in Radiation Protection for Endovascular Procedures: A Multispecialty Delphi Consensus Study.

PubMed

Doyen, Bart; Maurel, Blandine; Cole, Jonathan; Maertens, Heidi; Mastracci, Tara; Van Herzeele, Isabelle

2018-02-01

Radiation protection training courses currently focus on broad knowledge topics which may not always be relevant in daily practice. The goal of this study was to determine the key competencies in radiation protection that every endovascular team member should possess and apply routinely, through multispecialty clinical content expert consensus. Consensus was obtained through a two round modified Delphi methodology. The expert panel consisted of European vascular surgeons, interventional radiologists, and interventional cardiologists/angiologists experienced in endovascular procedures. An initial list of statements, covering knowledge skills, technical skills and attitudes was created, based on a literature search. Additional statements could be suggested by the experts in the first Delphi round. Each of the statements had to be rated on a 5- point Likert scale. A statement was considered to be a key competency when the internal consistency was greater than alpha = 0.80 and at least 80% of the experts agreed (rating 4/5) or strongly agreed (rating 5/5) with the statement. Questionnaires were emailed to panel members using the Surveymonkey service. Forty-one of 65 (63.1%) invited experts agreed to participate in the study. The response rates were 36 out of 41 (87.8%): overall 38 out of 41(92.6%) in the first round and 36 out of 38 (94.7%) in the second round. The 71 primary statements were supplemented with nine items suggested by the panel. The results showed excellent consensus among responders (Cronbach's alpha = 0.937 first round; 0.958 s round). Experts achieved a consensus that 30 of 33 knowledge skills (90.9%), 23 of 27 technical skills (82.1%), and 15 of 20 attitudes (75.0%) should be considered as key competencies. A multispecialty European endovascular expert panel reached consensus about the key competencies in radiation protection. These results may serve to create practical and relevant radiation protection training courses in the future, enhancing radiation safety for both patients and the entire endovascular team. Copyright © 2017 European Society for Vascular Surgery. All rights reserved.

A Delphi study on research priorities for trauma nursing.

PubMed

Bayley, E W; Richmond, T; Noroian, E L; Allen, L R

1994-05-01

To identify and prioritize research questions of importance to trauma patient care and of interest to trauma nurses. A three-round Delphi technique was used to solicit, identify, and prioritize problems for trauma nursing research. In round 1, experienced trauma nurses (N = 208) generated 513 problems, which were analyzed, categorized, and collapsed into 111 items for subsequent rounds. Round 2 participants rated each research question on a 1 to 7 scale on two criteria: impact on patient welfare and value for practicing nurses. Group median scores provided by 166 round 2 respondents and respondents' individual round 2 scores were indicated on the round 3 questionnaire. Subjects rated the questions again on the same criteria and indicated whether nurses, independently or in collaboration with other health professionals, should assume responsibility for that research. Median and mean scores and rank order were determined for each item. Respondents who completed all three rounds (n = 137) had a mean of 8.3 years of trauma experience. Nine research questions ranked within the top 20 on both criteria. The two research questions that ranked highest on both criteria were: What are the most effective nursing interventions in the prevention of pulmonary and circulatory complications in trauma patients? and What are the most effective methods for preventing aspiration in trauma patients during the postoperative phase? The third-ranked question regarding patient welfare was: What psychological and lifestyle changes result from traumatic injury? Regarding value for practicing nurses, What are the most effective educational methods to prepare and maintain proficiency in trauma care providers? ranked third. These research priorities provide impetus and direction for nursing and collaborative investigation in trauma care.

Setting a health policy research agenda for controlling cancer burden in Korea.

PubMed

Jang, Sung-In; Cho, Kyoung-Hee; Kim, Sun Jung; Lee, Kwang-Sig; Park, Eun-Cheol

2015-04-01

The aim of study was to provide suggestions for prioritizing research in effort to reduce cancer burden in Korea based on a comprehensive analysis of cancer burden and Delphi consensus among cancer experts. Twenty research plans covering 10 topics were selected based on an assessment of the literature, and e-mail surveys were analyzed using a two-round modified Delphi method. Thirty-four out of 79 experts were selected from four organizations to participate in round one, and 21 experts among them had completed round two. Each item had two questions; one regarding the agreement of the topic as a priority item to reduce cancer burden, and the other about the importance of the item on a nine-point scale. A consensus was defined to be an average lower coefficient of variation with less than 30% in importance. Seven plans that satisfied the three criteria were selected as priority research plans for reducing cancer burden. These plans are "research into advanced clinical guidelines for thyroid cancer given the current issue with over-diagnosis," "research into smoking management plans through price and non-price cigarette policy initiatives," "research into ways to measure the quality of cancer care," "research on policy development to expand hospice care," "research into the spread and management of Helicobacter pylori," "research on palliative care in a clinical setting," and "research into alternative mammography methods to increase the accuracy of breast cancer screenings." The seven plans identified in this study should be prioritized to reduce the burden of cancer in Korea. We suggest that policy makers and administrators study and invest significant effort in these plans.

Pharmacy executives: leadership issues and associated skills, knowledge, and abilities in the U.S. Department of Defense.

PubMed

Meadows, Andrew B; Finstuen, Kenn; Hudak, Ronald P

2003-01-01

To identify the issues or problems that current and aspiring U.S. Department of Defense (DoD) pharmacy executives will face in the future and to define the skills, knowledge, and abilities (SKAs) required to successfully address these issues. Delphi method for executive decision making. DoD. Ninety-three pharmacists serving in the military grades of lieutenant colonel/commander and colonel/captain, as well as pharmacists selected for promotion to those grades. iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants identified five major issues believed to be of greatest importance to pharmacy executives and reported specific SKAs that might be needed to successfully manage those issues. An expert panel sorted these issues into meaningful domains, then provided an appropriate title for each domain. Round 2--on a 7-point scale, respondents rated the SKA items according to their assessment of how much a future DoD pharmacy executive would need each SKA. Response rates were 44.1% and 46.2% for Delphi rounds 1 and 2, respectively. The first round generated 62 unique issues facing pharmacy executives. The expert panel reviewed and sorted the issues into eight domains and selected an appropriate title for each domain. The domains identified by the panel were human resources, pharmacy operations/business practices, information management and technology, financial resources, formulary management, drug therapy management, pharmacy benefit management, and leadership. During round 2, 73.3% of the top 15 rated SKAs came from the drug therapy management, leadership, and formulary management domains. The three highest-rated SKAs were "ability to see the big picture," "ability to build strong relations with medical staffs," and "skills in both writing and verbal communication." The issues facing future DoD pharmacy executives will require them to expand their clinical abilities as well as their ability to collaborate and communicate with other professionals.

Using a web-based survey tool to undertake a Delphi study: application for nurse education research.

PubMed

Gill, Fenella J; Leslie, Gavin D; Grech, Carol; Latour, Jos M

2013-11-01

The Internet is increasingly being used as a data collection medium to access research participants. This paper reports on the experience and value of using web-survey software to conduct an eDelphi study to develop Australian critical care course graduate practice standards. The eDelphi technique used involved the iterative process of administering three rounds of surveys to a national expert panel. The survey was developed online using SurveyMonkey. Panel members responded to statements using one rating scale for round one and two scales for rounds two and three. Text boxes for panel comments were provided. For each round, the SurveyMonkey's email tool was used to distribute an individualized email invitation containing the survey web link. The distribution of panel responses, individual responses and a summary of comments were emailed to panel members. Stacked bar charts representing the distribution of responses were generated using the SurveyMonkey software. Panel response rates remained greater than 85% over all rounds. An online survey provided numerous advantages over traditional survey approaches including high quality data collection, ease and speed of survey administration, direct communication with the panel and rapid collation of feedback allowing data collection to be undertaken in 12 weeks. Only minor challenges were experienced using the technology. Ethical issues, specific to using the Internet to conduct research and external hosting of web-based software, lacked formal guidance. High response rates and an increased level of data quality were achieved in this study using web-survey software and the process was efficient and user-friendly. However, when considering online survey software, it is important to match the research design with the computer capabilities of participants and recognize that ethical review guidelines and processes have not yet kept pace with online research practices. Copyright © 2013 Elsevier Ltd. All rights reserved.

Development of an Index of Engagement in HIV Care: An Adapted Internet-Based Delphi Process

PubMed Central

Koester, Kimberly A; Wood, Troy; Neilands, Torsten B; Pomeranz, Jamie L; Christopoulos, Katerina A

2017-01-01

Background Improving engagement in medical care among persons living with human immunodeficiency virus (HIV) is critical to optimizing clinical outcomes and reducing onward transmission of HIV. However, a clear conceptualization of what it means to be engaged in HIV care is lacking, and thus efforts to measure and enhance engagement in care are limited. Objective This paper describes the use of a modified online Delphi process of consensus building to solicit input from a range of HIV and non-HIV researchers and providers, and to integrate that input with focus group data conducted with HIV-infected patients. The overarching goal was to generate items for a patient-centered measure of engagement in HIV care for use in future research and clinical practice. Methods We recruited 66 expert panelists from around the United States. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. Results We recruited 66 expert panelists from around the United States and 64 (97%) were retained for four rounds of data collection. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. The process resulted in an expansion to 120 topics that were subsequently reduced to 13 candidate items for the planned assessment measure. Conclusions The process was an efficient method of soliciting input from geographically separated and busy experts across a range of disciplines and professional roles with the aim of arriving at a coherent definition of engagement in HIV care and a manageable set of survey items to assess it. Next steps are to validate the utility of the new measure in predicting retention in care, adherence to treatment, and clinical outcomes among patients living with HIV. PMID:29208589

A pushing chronic care forward in Abu Dhabi by identifying priorities and addressing barriers: a modified Delphi technique

PubMed Central

Loney, Tom; Lapão, Luis V

2018-01-01

Objective This study aimed to elucidate the top five key priorities and barriers to chronic care in the health system of Abu Dhabi, United Arab Emirates (UAE). Design A modified Delphi study was performed to reach consensus on priority areas and barriers to the development of the Chronic Care Model in the health system of Abu Dhabi. Individual wireless audience response devices (keypads) linked to a computer were used to reduce 28 priorities and 20 barriers to the top five during three iterative rounds over three consecutive days. Setting Chronic care services for patients with diabetes, cardiovascular diseases and cancer, in both private and publicly funded healthcare services in the emirate of Abu Dhabi. Participants A purposive sample of 20 health systems’ experts were recruited. They were front-line healthcare workers from the public and private sector working in the delivery of care for patients with diabetes, cardiovascular diseases and cancer. Results The ‘overall organizational leadership in chronic illness care’ was ranked as the most important priority to address (26.3%) and ‘patient compliance’ was ranked as the most important barrier (36.8%) to the development of the Chronic Care Model. Conclusions This study has identified the current priorities and barriers to improving chronic care within Abu Dhabi’s healthcare system. Our paper addresses the UAE’s 2021 Agenda of achieving a world-class healthcare system, and findings may help inform strategic changes required to achieve this mission. PMID:29866724

Global research priorities for interpersonal violence prevention: a modified Delphi study.

PubMed

Mikton, Christopher R; Tanaka, Masako; Tomlinson, Mark; Streiner, David L; Tonmyr, Lil; Lee, Bandy X; Fisher, Jane; Hegadoren, Kathy; Pim, Joam Evans; Wang, Shr-Jie Sharlenna; MacMillan, Harriet L

2017-01-01

To establish global research priorities for interpersonal violence prevention using a systematic approach. Research priorities were identified in a three-round process involving two surveys. In round 1, 95 global experts in violence prevention proposed research questions to be ranked in round 2. Questions were collated and organized according to the four-step public health approach to violence prevention. In round 2, 280 international experts ranked the importance of research in the four steps, and the various substeps, of the public health approach. In round 3, 131 international experts ranked the importance of detailed research questions on the public health step awarded the highest priority in round 2. In round 2, "developing, implementing and evaluating interventions" was the step of the public health approach awarded the highest priority for four of the six types of violence considered (i.e. child maltreatment, intimate partner violence, armed violence and sexual violence) but not for youth violence or elder abuse. In contrast, "scaling up interventions and evaluating their cost-effectiveness" was ranked lowest for all types of violence. In round 3, research into "developing, implementing and evaluating interventions" that addressed parenting or laws to regulate the use of firearms was awarded the highest priority. The key limitations of the study were response and attrition rates among survey respondents. However, these rates were in line with similar priority-setting exercises. These findings suggest it is premature to scale up violence prevention interventions. Developing and evaluating smaller-scale interventions should be the funding priority.

Global research priorities for interpersonal violence prevention: a modified Delphi study

PubMed Central

Tanaka, Masako; Tomlinson, Mark; Streiner, David L; Tonmyr, Lil; Lee, Bandy X; Fisher, Jane; Hegadoren, Kathy; Pim, Joam Evans; Wang, Shr-Jie Sharlenna; MacMillan, Harriet L

2017-01-01

Abstract Objective To establish global research priorities for interpersonal violence prevention using a systematic approach. Methods Research priorities were identified in a three-round process involving two surveys. In round 1, 95 global experts in violence prevention proposed research questions to be ranked in round 2. Questions were collated and organized according to the four-step public health approach to violence prevention. In round 2, 280 international experts ranked the importance of research in the four steps, and the various substeps, of the public health approach. In round 3, 131 international experts ranked the importance of detailed research questions on the public health step awarded the highest priority in round 2. Findings In round 2, “developing, implementing and evaluating interventions” was the step of the public health approach awarded the highest priority for four of the six types of violence considered (i.e. child maltreatment, intimate partner violence, armed violence and sexual violence) but not for youth violence or elder abuse. In contrast, “scaling up interventions and evaluating their cost–effectiveness” was ranked lowest for all types of violence. In round 3, research into “developing, implementing and evaluating interventions” that addressed parenting or laws to regulate the use of firearms was awarded the highest priority. The key limitations of the study were response and attrition rates among survey respondents. However, these rates were in line with similar priority-setting exercises. Conclusion These findings suggest it is premature to scale up violence prevention interventions. Developing and evaluating smaller-scale interventions should be the funding priority. PMID:28053363

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research.

PubMed

Staniszewska, S; Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. One hundred forty-three participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites.

Reaching Consensus on Essential Biomedical Science Learning Objectives in a Dental Curriculum.

PubMed

Best, Leandra; Walton, Joanne N; Walker, Judith; von Bergmann, HsingChi

2016-04-01

This article describes how the University of British Columbia Faculty of Dentistry reached consensus on essential basic biomedical science objectives for DMD students and applied the information to the renewal of its DMD curriculum. The Delphi Method was used to build consensus among dental faculty members and students regarding the relevance of over 1,500 existing biomedical science objectives. Volunteer panels of at least three faculty members (a basic scientist, a general dentist, and a dental specialist) and a fourth-year dental student were formed for each of 13 biomedical courses in the first two years of the program. Panel members worked independently and anonymously, rating each course objective as "need to know," "nice to know," "irrelevant," or "don't know." Panel members were advised after each round which objectives had not yet achieved a 75% consensus and were asked to reconsider their ratings. After a maximum of three rounds to reach consensus, a second group of faculty experts reviewed and refined the results to establish the biomedical science objectives for the renewed curriculum. There was consensus on 46% of the learning objectives after round one, 80% after round two, and 95% after round three. The second expert group addressed any remaining objectives as part of its review process. Only 47% of previous biomedical science course objectives were judged to be essential or "need to know" for the general dentist. The consensus reached by participants in the Delphi Method panels and a second group of faculty experts led to a streamlined, better integrated DMD curriculum to prepare graduates for future practice.

Building a Privacy, Ethics, and Data Access Framework for Real World Computerised Medical Record System Data: A Delphi Study. Contribution of the Primary Health Care Informatics Working Group.

PubMed

Liyanage, H; Liaw, S-T; Di Iorio, C T; Kuziemsky, C; Schreiber, R; Terry, A L; de Lusignan, S

2016-11-10

Privacy, ethics, and data access issues pose significant challenges to the timely delivery of health research. Whilst the fundamental drivers to ensure that data access is ethical and satisfies privacy requirements are similar, they are often dealt with in varying ways by different approval processes. To achieve a consensus across an international panel of health care and informatics professionals on an integrated set of privacy and ethics principles that could accelerate health data access in data-driven health research projects. A three-round consensus development process was used. In round one, we developed a baseline framework for privacy, ethics, and data access based on a review of existing literature in the health, informatics, and policy domains. This was further developed using a two-round Delphi consensus building process involving 20 experts who were members of the International Medical Informatics Association (IMIA) and European Federation of Medical Informatics (EFMI) Primary Health Care Informatics Working Groups. To achieve consensus we required an extended Delphi process. The first round involved feedback on and development of the baseline framework. This consisted of four components: (1) ethical principles, (2) ethical guidance questions, (3) privacy and data access principles, and (4) privacy and data access guidance questions. Round two developed consensus in key areas of the revised framework, allowing the building of a newly, more detailed and descriptive framework. In the final round panel experts expressed their opinions, either as agreements or disagreements, on the ethics and privacy statements of the framework finding some of the previous round disagreements to be surprising in view of established ethical principles. This study develops a framework for an integrated approach to ethics and privacy. Privacy breech risk should not be considered in isolation but instead balanced by potential ethical benefit.

NETS1HD: study protocol for development of a core outcome set for use in determining the overall success of Hirschsprung's disease treatment.

PubMed

Allin, Benjamin; Bradnock, Timothy; Kenny, Simon; Walker, Gregor; Knight, Marian

2016-12-07

Use of core outcome sets in research has been proposed as a method for countering the problems caused by heterogeneity of outcome measure reporting. Heterogeneity of outcome measure reporting occurs in Hirschsprung's disease (HD) research and is limiting the development of a robust evidence base to support clinical practice. Candidate outcome measures have been identified through a systematic review. These outcome measures will form the starting point for a three-phase online Delphi process to be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel; panel 2 is a non-neonatal panel; and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1 to 9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's HD. In round 2, experts will be presented with the same list of outcome measures and graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure, taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels, which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. Results of the Delphi process will be discussed, and outcomes will be re-scored. Outcome measures where >70% of participants at the meeting scored it 7-9 and <15% scored it 1-3 will form the core outcome set. Development of a core outcome set will help to reduce heterogeneity of outcome measure reporting in HD. This will increase the quality of research taking place and ultimately improve care provided to infants with HD.

Development of a Quality and Safety Competency Curriculum for Radiation Oncology Residency: An International Delphi Study.

PubMed

Adleman, Jenna; Gillan, Caitlin; Caissie, Amanda; Davis, Carol-Anne; Liszewski, Brian; McNiven, Andrea; Giuliani, Meredith

2017-06-01

To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through web conference discussion and reranked in Round 2. An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of a Quality and Safety Competency Curriculum for Radiation Oncology Residency: An International Delphi Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Adleman, Jenna; Gillan, Caitlin; Radiation Medicine Program, Princess Margaret Cancer Centre, Toronto, Ontario

Purpose: To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. Methods and Materials: A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through webmore » conference discussion and reranked in Round 2. Results: An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. Conclusions: This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs.« less

Determination of clinically relevant content for a musculoskeletal anatomy curriculum for physical medicine and rehabilitation residents.

PubMed

Lisk, Kristina; Flannery, John F; Loh, Eldon Y; Richardson, Denyse; Agur, Anne M R; Woods, Nicole N

2014-01-01

To address the need for more clinical anatomy training in residency education, many postgraduate programs have implemented structured anatomy courses into their curriculum. Consensus often does not exist on specific content and level of detail of the content that should be included in such curricula. This article describes the use of the Delphi method to identify clinically relevant content to incorporate in a musculoskeletal anatomy curriculum for Physical Medicine and Rehabilitation (PM&R) residents. A two round modified Delphi involving PM&R experts was used to establish the curricular content. The anatomical structures and clinical conditions presented to the expert group were compiled using multiple sources: clinical musculoskeletal anatomy cases from the PM&R residency program at the University of Toronto; consultation with PM&R experts; and textbooks. In each round, experts rated the importance of each curricular item to PM&R residency education using a five-point Likert scale. Internal consistency (Cronbach's alpha) was used to determine consensus at the end of each round and agreement scores were used as an outcome measure to determine the content to include in the curriculum. The overall internal consistency in both rounds was 0.99. A total of 37 physiatrists from across Canada participated and the overall response rate over two rounds was 97%. The initial curricular list consisted of 361 items. After the second iteration, the list was reduced by 44%. By using a national consensus method we were able to objectively determine the relevant anatomical structures and clinical musculoskeletal conditions important in daily PM&R practice. © 2013 American Association of Anatomists.

Expert consensus on facilitators and barriers to return-to-work following surgery for non-traumatic upper extremity conditions: a Delphi study.

PubMed

Peters, S E; Johnston, V; Ross, M; Coppieters, M W

2017-02-01

This Delphi study aimed to reach consensus on important facilitators and barriers for return-to-work following surgery for non-traumatic upper extremity conditions. In Round 1, experts ( n = 42) listed 134 factors, which were appraised in Rounds 2 and 3. Consensus (⩾85% agreement) was achieved for 13 facilitators (high motivation to return-to-work; high self-efficacy for return-to-work and recovery; availability of modified/alternative duties; flexible return-to-work arrangements; positive coping skills; limited heavy work exertion; supportive return-to-work policies; supportive supervisor/management; no catastrophic thinking; no fear avoidance to return-to-work; no fear avoidance to pain/activity; return to meaningful work duties; high job satisfaction) and six barriers (mood disorder diagnosis; pain/symptoms at more than one musculoskeletal site; heavy upper extremity exertions at work; lack of flexible return-to-work arrangements; lack of support from supervisor/management; high level of pain catastrophizing). Future prognostic studies are required to validate these biopsychosocial factors to further improve return-to-work outcomes. V.

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

Defining the role of a forensic hospital registered nurse using the Delphi method.

PubMed

Newman, Claire; Patterson, Karen; Eason, Michelle; Short, Ben

2016-11-01

A Delphi survey was undertaken to refine the position description of a registered nurse working in a forensic hospital, in New South Wales, Australia. Prior to commencing operation in 2008, position descriptions were developed from a review of legislation, as well as policies and procedures used by existing forensic mental health services in Australia. With an established workforce and an evolving model of care, a review of the initial registered nurse position description was required. An online Delphi survey was undertaken. Eight executive (88.9%) and 12 (58.3%) senior nursing staff participated in the first survey round. A total of four survey rounds were completed. At the final round, there was consensus (70%) that the revised position description was either very or somewhat suitable. There were a total of nine statements, from 31 originally produced in round 1, that did not reach consensus. The Delphi survey enabled a process for refining the Forensic Hospital registered nurse position description. Methods that facilitate executive and senior nursing staff consensus in the development and review of position descriptions should be considered in nursing management. © 2016 John Wiley & Sons Ltd.

Diagnosis and Management of Iliac Artery Endofibrosis: Results of a Delphi Consensus Study.

PubMed

2016-07-01

Iliac endofibrosis is a rare condition that may result in a reduction of blood flow to the lower extremity in young, otherwise healthy individuals. The data to inform everyday clinical management are weak and therefore a Delphi consensus methodology was used to explore areas of consensus and disagreement concerning the diagnosis and management of patients with suspected iliac endofibrosis. A three-round Delphi questionnaire approach was used among vascular surgeons, sports physicians, sports scientists, radiologists, and clinical vascular scientists with experience of treating this condition to explore diagnosis and clinical management issues for patients with suspected iliac artery endofibrosis. Analysis is based on 18 responses to round 2 and 14 responses to round 3, with agreement reported when 70% of respondents were in agreement. Initially there was agreement on the typical symptoms at presentation and the need for an exercise test in the diagnosis. Round 3 clarified that duplex ultrasound was a useful tool in the diagnosis of endofibrosis. There was consensus on the most appropriate type of surgery (endarterectomy and vein patch) and that endovascular interventions were inadvisable. The final round helped to inform aspects of the natural history and post-operative surveillance. Progression of the disease was likely with continued exercise but cessation may prevent progression. Surveillance after surgery is generally recommended yearly with at least a clinical assessment. There is broad agreement about the presenting symptoms and the investigations required to confirm (or exclude) the diagnosis of iliac endofibrosis. There was consensus on the surgical approach to repair. Disagreement existed about the specific diagnostic criteria that should be applied during non-invasive testing and about post-operative care and resumption of exercise. Copyright © 2016 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Towards a definition of neurodisability: a Delphi survey.

PubMed

Morris, Christopher; Janssens, Astrid; Tomlinson, Richard; Williams, Jane; Logan, Stuart

2013-12-01

The aim of this study was to develop, systematically, a consensus-based definition for 'neurodisability' that is meaningful to health professionals and parents of children with neurological conditions. A multidisciplinary group of health professionals was recruited through child development teams and professional societies in the UK; several parents of children with neurological conditions worked with the research team. Professionals participated in three rounds of a Delphi survey. Participants rated their agreement with a proposed definition in each round, and feedback was used to refine the definition. Finally, a perspective was sought from international experts. Responses to the three rounds were as follows: round 1,245 out of 290 (84.4%); round 2,242 out of 300 (80.6%); and round 3,237 out of 297 (79.7%). Agreement with the proposed definition was extremely high in every round (89.0%, 90.1%, and 93.6% respectively). The final version of the definition was widely endorsed among professionals, parents, and a small number of international colleagues. The final definition is as follows: 'Neurodisability describes a group of congenital or acquired long-term conditions that are attributed to impairment of the brain and/or neuromuscular system and create functional limitations. A specific diagnosis may not be identified. Conditions may vary over time, occur alone or in combination, and include a broad range of severity and complexity. The impact may include difficulties with movement, cognition, hearing and vision, communication, emotion, and behaviour'. An agreed definition of neurodisability will be useful for conducting research or clinical evaluations with people affected by neurological problems. © 2013 Crown copyright. Developmental Medicine and Child Neurology © 2013 Mac Keith Press. This article is published with the permission of the Controller of HMSO and the Queen's Printer for Scotland.

A core outcome set for localised prostate cancer effectiveness trials: protocol for a systematic review of the literature and stakeholder involvement through interviews and a Delphi survey.

PubMed

MacLennan, Steven; Bekema, Hendrika J; Williamson, Paula R; Campbell, Marion K; Stewart, Fiona; MacLennan, Sara J; N'Dow, James M O; Lam, Thomas B L

2015-03-04

Prostate cancer is a growing health problem worldwide. The management of localised prostate cancer is controversial. It is unclear which of several surgical, radiotherapeutic, ablative, and surveillance treatments is the most effective. All have cost, process and recovery, and morbidity implications which add to treatment decision-making complexity for patients and healthcare professionals. Evidence from randomised controlled trials (RCTs) is not optimal because of uncertainty as to what constitutes important outcomes. Another issue hampering evidence synthesis is heterogeneity of outcome definition, measurement, and reporting. This project aims to determine which outcomes are the most important to patients and healthcare professionals, and use these findings to recommend a standardised core outcome set for comparative effectiveness trials of treatments for localised prostate cancer, to optimise decision-making. The range of potentially important outcomes and measures will be identified through systematic reviews of the literature and semi-structured interviews with patients. A consultation exercise involving representatives from two key stakeholder groups (patients and healthcare professionals) will ratify the list of outcomes to be entered into a three round Delphi study. The Delphi process will refine and prioritise the list of identified outcomes. A methodological substudy (nested RCT design) will also be undertaken. Participants will be randomised after round one of the Delphi study to one of three feedback groups, based on different feedback strategies, in order to explore the potential impact of feedback strategies on participant responses. This may assist the design of a future core outcome set and Delphi studies. Following the Delphi study, a final consensus meeting attended by representatives from both stakeholder groups will determine the final recommended core outcome set. This study will inform clinical practice and future trials of interventions of localised prostate cancer by standardising a core outcome set which should be considered in comparative effectiveness studies for localised prostate cancer.

Development of quality indicators to evaluate antibiotic treatment of patients with community-acquired pneumonia in Indonesia.

PubMed

Farida, Helmia; Rondags, Angelique; Gasem, M Hussein; Leong, Katharina; Adityana, A; van den Broek, Peterhans J; Keuter, Monique; Natsch, Stephanie

2015-04-01

To develop an instrument for evaluating the quality of antibiotic management of patients with community-acquired pneumonia (CAP) applicable in a middle-income developing country. A previous study and Indonesian guidelines were reviewed to derive potential quality of care indicators (QIs). An expert panel performed a two-round Delphi consensus procedure on the QI's relevance to patient recovery, reduction of antimicrobial resistance and cost containment. Applicability in practice, including reliability, feasibility and opportunity for improvement, was determined in a data set of 128 patients hospitalised with CAP in Semarang, Indonesia. Fifteen QIs were selected by the consensus procedure. Five QIs did not pass feasibility criteria, because of inappropriate documentation, inefficient laboratory services or patient factors. Three QIs provided minor opportunity for improvement. Two QIs contradicted each other; one of these was considered not valid and excluded. A final set of six QIs was defined for use in the Indonesian setting. Using the Delphi method, we defined a list of QIs for assessing the quality of care, in particular antibiotic treatment, for CAP in Indonesia. For further improvement, a modified Delphi method that includes discussion, a sound medical documentation system, improvement of microbiology laboratory services, and multi-center applicability tests are needed to develop a valid and applicable QI list for the Indonesian setting. © 2014 John Wiley & Sons Ltd.

Assessment of mastication in healthy children and children with cerebral palsy: a validity and consistency study.

PubMed

Remijn, L; Speyer, R; Groen, B E; Holtus, P C M; van Limbeek, J; Nijhuis-van der Sanden, M W G

2013-05-01

The aim of this study was to develop the Mastication Observation and Evaluation instrument for observing and assessing the chewing ability of children eating solid and lumpy foods. This study describes the process of item definition and item selection and reports the content validity, reproducibility and consistency of the instrument. In the developmental phase, 15 experienced speech therapists assessed item relevance and descriptions over three Delphi rounds. Potential items were selected based on the results from a literature review. At the initial Delphi round, 17 potential items were included. After three Delphi rounds, 14 items that regarded as providing distinctive value in assessment of mastication (consensus >75%) were included in the Mastication Observation and Evaluation instrument. To test item reproducibility and consistency, two experts and five students evaluated video recordings of 20 children (10 children with cerebral palsy aged 29-65 months and 10 healthy children aged 11-42 months) eating bread and a biscuit. Reproducibility was estimated by means of the intraclass correlation coefficient (ICC). With the exception of one item concerning chewing duration, all items showed good to excellent intra-observer agreement (ICC students: 0.73-1.0). With the exception of chewing duration and number of swallows, inter-observer agreement was fair to excellent for all items (ICC experts: 0.68-1.0 and ICC students: 0.42-1.0). Results indicate that this tool is a feasible instrument and could be used in clinical practice after further research is completed on the reliability of the tool. © 2013 Blackwell Publishing Ltd.

Clinical Experiences for Agricultural Teacher Education Programs in North Carolina, South Carolina, and Virginia.

ERIC Educational Resources Information Center

Dobbins, Thomas R.; Camp, William G.

2003-01-01

In a three-round Delphi, secondary agriculture teachers and administrators, field staff and agriculture teacher educators (n=31, 33, 29) compiled a list of 102 tasks for early field experiences and student teaching experiences in agricultural education. The list is comprehensive enough for the three states where it was developed and flexible…

Ethical challenges facing veterinary professionals in Ireland: results from Policy Delphi with vignette methodology

PubMed Central

Magalhães-Sant'Ana, M.; More, S. J.; Morton, D. B.; Hanlon, A.

2016-01-01

Ethics is key to the integrity of the veterinary profession. Despite its importance, there is a lack of applied research on the range of ethical challenges faced by veterinarians. A three round Policy Delphi with vignette methodology was used to record the diversity of views on ethical challenges faced by veterinary professionals in Ireland. Forty experts, comprising veterinary practitioners, inspectors and nurses, accepted to participate. In round 1, twenty vignettes describing a variety of ethically challenging veterinary scenarios were ranked in terms of ethical acceptability, reputational risk and perceived standards of practice. Round 2 aimed at characterising challenges where future policy development or professional guidance was deemed to be needed. In round 3, possible solutions to key challenges were explored. Results suggest that current rules and regulations are insufficient to ensure best veterinary practices and that a collective approach is needed to harness workable solutions for the identified ethical challenges. Challenges pertaining mostly to the food chain seem to require enforcement measures whereas softer measures that promote professional discretion were preferred to address challenges dealing with veterinary clinical services. These findings can support veterinary representative bodies, advisory committees and regulatory authorities in their decision making, policy and regulation. PMID:27613779

Ethical challenges facing veterinary professionals in Ireland: results from Policy Delphi with vignette methodology.

PubMed

Magalhães-Sant'Ana, M; More, S J; Morton, D B; Hanlon, A

2016-10-29

Ethics is key to the integrity of the veterinary profession. Despite its importance, there is a lack of applied research on the range of ethical challenges faced by veterinarians. A three round Policy Delphi with vignette methodology was used to record the diversity of views on ethical challenges faced by veterinary professionals in Ireland. Forty experts, comprising veterinary practitioners, inspectors and nurses, accepted to participate. In round 1, twenty vignettes describing a variety of ethically challenging veterinary scenarios were ranked in terms of ethical acceptability, reputational risk and perceived standards of practice. Round 2 aimed at characterising challenges where future policy development or professional guidance was deemed to be needed. In round 3, possible solutions to key challenges were explored. Results suggest that current rules and regulations are insufficient to ensure best veterinary practices and that a collective approach is needed to harness workable solutions for the identified ethical challenges. Challenges pertaining mostly to the food chain seem to require enforcement measures whereas softer measures that promote professional discretion were preferred to address challenges dealing with veterinary clinical services. These findings can support veterinary representative bodies, advisory committees and regulatory authorities in their decision making, policy and regulation. British Veterinary Association.

Quality Metrics in Neonatal and Pediatric Critical Care Transport: A National Delphi Project.

PubMed

Schwartz, Hamilton P; Bigham, Michael T; Schoettker, Pamela J; Meyer, Keith; Trautman, Michael S; Insoft, Robert M

2015-10-01

The transport of neonatal and pediatric patients to tertiary care facilities for specialized care demands monitoring the quality of care delivered during transport and its impact on patient outcomes. In 2011, pediatric transport teams in Ohio met to identify quality indicators permitting comparisons among programs. However, no set of national consensus quality metrics exists for benchmarking transport teams. The aim of this project was to achieve national consensus on appropriate neonatal and pediatric transport quality metrics. Modified Delphi technique. The first round of consensus determination was via electronic mail survey, followed by rounds of consensus determination in-person at the American Academy of Pediatrics Section on Transport Medicine's 2012 Quality Metrics Summit. All attendees of the American Academy of Pediatrics Section on Transport Medicine Quality Metrics Summit, conducted on October 21-23, 2012, in New Orleans, LA, were eligible to participate. Candidate quality metrics were identified through literature review and those metrics currently tracked by participating programs. Participants were asked in a series of rounds to identify "very important" quality metrics for transport. It was determined a priori that consensus on a metric's importance was achieved when at least 70% of respondents were in agreement. This is consistent with other Delphi studies. Eighty-two candidate metrics were considered initially. Ultimately, 12 metrics achieved consensus as "very important" to transport. These include metrics related to airway management, team mobilization time, patient and crew injuries, and adverse patient care events. Definitions were assigned to the 12 metrics to facilitate uniform data tracking among programs. The authors succeeded in achieving consensus among a diverse group of national transport experts on 12 core neonatal and pediatric transport quality metrics. We propose that transport teams across the country use these metrics to benchmark and guide their quality improvement activities.

Standards for UNiversal reporting of patient Decision Aid Evaluation studies: the development of SUNDAE Checklist.

PubMed

Sepucha, Karen R; Abhyankar, Purva; Hoffman, Aubri S; Bekker, Hilary L; LeBlanc, Annie; Levin, Carrie A; Ropka, Mary; Shaffer, Victoria A; Sheridan, Stacey L; Stacey, Dawn; Stalmeier, Peep; Vo, Ha; Wills, Celia E; Thomson, Richard

2018-05-01

Patient decision aids (PDAs) are evidence-based tools designed to help patients make specific and deliberated choices among healthcare options. The International Patient Decision Aid Standards (IPDAS) Collaboration review papers and Cochrane systematic review of PDAs have found significant gaps in the reporting of evaluations of PDAs, including poor or limited reporting of PDA content, development methods and delivery. This study sought to develop and reach consensus on reporting guidelines to improve the quality of publications evaluating PDAs. An international workgroup, consisting of members from IPDAS Collaboration, followed established methods to develop reporting guidelines for PDA evaluation studies. This paper describes the results from three completed phases: (1) planning, (2) drafting and (3) consensus, which included a modified, two-stage, online international Delphi process. The work was conducted over 2 years with bimonthly conference calls and three in-person meetings. The workgroup used input from these phases to produce a final set of recommended items in the form of a checklist. The SUNDAE Checklist (Standards for UNiversal reporting of patient Decision Aid Evaluations) includes 26 items recommended for studies reporting evaluations of PDAs. In the two-stage Delphi process, 117/143 (82%) experts from 14 countries completed round 1 and 96/117 (82%) completed round 2. Respondents reached a high level of consensus on the importance of the items and indicated strong willingness to use the items when reporting PDA studies. The SUNDAE Checklist will help ensure that reports of PDA evaluation studies are understandable, transparent and of high quality. A separate Explanation and Elaboration publication provides additional details to support use of the checklist. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process.

PubMed

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-09-10

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention.

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process

PubMed Central

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-01-01

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention. PMID:26378557

Academic Primer Series: Key Papers About Competency-Based Medical Education.

PubMed

Cooney, Robert; Chan, Teresa M; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-06-01

Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Based on the online discussions of the 2016-2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs.

Core outcome domains for clinical trials in non-specific low back pain.

PubMed

Chiarotto, Alessandro; Deyo, Richard A; Terwee, Caroline B; Boers, Maarten; Buchbinder, Rachelle; Corbin, Terry P; Costa, Leonardo O P; Foster, Nadine E; Grotle, Margreth; Koes, Bart W; Kovacs, Francisco M; Lin, Chung-Wei Christine; Maher, Chris G; Pearson, Adam M; Peul, Wilco C; Schoene, Mark L; Turk, Dennis C; van Tulder, Maurits W; Ostelo, Raymond W

2015-06-01

Inconsistent reporting of outcomes in clinical trials of patients with non-specific low back pain (NSLBP) hinders comparison of findings and the reliability of systematic reviews. A core outcome set (COS) can address this issue as it defines a minimum set of outcomes that should be reported in all clinical trials. In 1998, Deyo et al. recommended a standardized set of outcomes for LBP clinical research. The aim of this study was to update these recommendations by determining which outcome domains should be included in a COS for clinical trials in NSLBP. An International Steering Committee established the methodology to develop this COS. The OMERACT Filter 2.0 framework was used to draw a list of potential core domains that were presented in a Delphi study. Researchers, care providers and patients were invited to participate in three Delphi rounds and were asked to judge which domains were core. A priori criteria for consensus were established before each round and were analysed together with arguments provided by panellists on importance, overlap, aggregation and/or addition of potential core domains. The Steering Committee discussed the final results and made final decisions. A set of 280 experts was invited to participate in the Delphi; response rates in the three rounds were 52, 50 and 45%. Of 41 potential core domains presented in the first round, 13 had sufficient support to be presented for rating in the third round. Overall consensus was reached for the inclusion of three domains in this COS: 'physical functioning', 'pain intensity' and 'health-related quality of life'. Consensus on 'physical functioning' and 'pain intensity' was consistent across all stakeholders, 'health-related quality of life' was not supported by the patients, and all the other domains were not supported by two or more groups of stakeholders. Weighting all possible argumentations, the Steering Committee decided to include in the COS the three domains that reached overall consensus and the domain 'number of deaths'. The following outcome domains were included in this updated COS: 'physical functioning', 'pain intensity', 'health-related quality of life' and 'number of deaths'. The next step for the development of this COS will be to determine which measurement instruments best measure these domains.

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

MOMENT--Management of Otitis Media with Effusion in Cleft Palate: protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey.

PubMed

Harman, Nicola L; Bruce, Iain A; Callery, Peter; Tierney, Stephanie; Sharif, Mohammad Owaise; O'Brien, Kevin; Williamson, Paula R

2013-03-12

Cleft palate (CP) has an incidence of approximately 1 in 700. Children with CP are also susceptible to otitis media with effusion (OME), with approximately 90% experiencing nontrivial OME. There are several approaches to the management of OME in children with CP. The Management of Otitis Media with Effusion in Children with Cleft Palate (MOMENT) study is a feasibility study that includes the development of a core outcome set for use in future trials of the management of OME in children with CP. The MOMENT study will include a systematic review of the literature to identify a list of outcomes that have previously been reported. This list of outcomes will be used in a Delphi study with cleft clinicians. The Delphi study is anticipated to include three rounds. The first round will ask clinicians to score the outcome list and to add any outcomes they think are relevant. The second round involves presentation of scores according to stakeholder group and the opportunity for participants to rescore outcomes. To ensure that the opinion of parents and children are sought, qualitative interviews will be completed with a purposive sample in parallel. In the final round of the Delphi process, participants will be shown the distribution of scores, for each outcome, for all stakeholder groups separately as well as a summary of the results concerning outcomes from the qualitative interviews with parents. A final consensus meeting will be held with all stakeholders, including parents and children, to review outcomes. A core outcome set represents the minimum that should be measured in a clinical trial for a particular condition. The MOMENT study will aim to identify a core outcome set that can be used in future trials of the management of OME, improving the consistency of research in this clinical area.

Indicators for evaluating European population health: a Delphi selection process.

PubMed

Freitas, Ângela; Santana, Paula; Oliveira, Mónica D; Almendra, Ricardo; Bana E Costa, João C; Bana E Costa, Carlos A

2018-04-27

Indicators are essential instruments for monitoring and evaluating population health. The selection of a multidimensional set of indicators should not only reflect the scientific evidence on health outcomes and health determinants, but also the views of health experts and stakeholders. The aim of this study is to describe the Delphi selection process designed to promote agreement on indicators considered relevant to evaluate population health at the European regional level. Indicators were selected in a Delphi survey conducted using a web-platform designed to implement and monitor participatory processes. It involved a panel of 51 experts and 30 stakeholders from different areas of knowledge and geographies. In three consecutive rounds the panel indicated their level of agreement or disagreement with indicator's relevance for evaluating population health in Europe. Inferential statistics were applied to draw conclusions on observed level of agreement (Scott's Pi interrater reliability coefficient) and opinion change (McNemar Chi-square test). Multivariate analysis of variance was conducted to check if the field of expertise influenced the panellist responses (Wilk's Lambda test). The panel participated extensively in the study (overall response rate: 80%). Eighty indicators reached group agreement for selection in the areas of: economic and social environment (12); demographic change (5); lifestyle and health behaviours (8); physical environment (6); built environment (12); healthcare services (11) and health outcomes (26). Higher convergence of group opinion towards agreement on the relevance of indicators was seen for lifestyle and health behaviours, healthcare services, and health outcomes. The panellists' field of expertise influenced responses: statistically significant differences were found for economic and social environment (p < 0.05 in round 1 and 2), physical environment (p < 0.01 in round 1) and health outcomes (p < 0.01 in round 3). The high levels of participation observed in this study, by involving experts and stakeholders and ascertaining their views, underpinned the added value of using a transparent Web-Delphi process to promote agreement on what indicators are relevant to appraise population health.

Linking NHS data for pediatric pharmacovigilance: Results of a Delphi survey.

PubMed

Hopf, Y M; Francis, J; Helms, P J; Haughney, J; Bond, C

2016-01-01

Adverse drug events are a major cause of patient safety incidents. Current systems of pharmacovigilance under-report adverse drug reactions (ADRs), especially in children, leading to delays in their identification. This is of particular concern, as children especially have an increased vulnerability to ADRs. The objective was to seek consensus among healthcare professionals (HCPs) about barriers and facilitators to the linkage of routinely collected health data for pediatric pharmacovigilance in Scotland. A Delphi survey was conducted with a random sample of HCPs including nurses, pharmacists and doctors, working in primary or secondary care, in Scotland. Participants were identified from sampling frames of the target professionals such as an NHS workforce list for general practitioners and recruited by postal invitation. A total of 819 HCPs were invited to take part. Those agreeing to participate were given the option of completing the questionnaires online or as hard copy. Reminders were sent twice at a fortnightly interval. Questions content included description of professional role as well as testing for the willingness to support the proposed project and was informed by the Theoretical Domains Framework of Behavior Change (TDF) and earlier qualitative work. Three Delphi rounds were administered, including a first round for item generation. 121 of those invited agreed to take part (15%). The first round of the Delphi study included 21 open questions and generated over a 1000 individual statements from 61 participants that returned the questionnaires (50.4%). These were rationalized to 149 items for the second round in which participants rated their views on the importance (or not) of each item on a 9-point Likert scale (strongly disagree - strongly agree). After the third round, there was consensus on items that focused on professional standards, and practical requirements, overall there was support for data linkage and a multi-professional approach. It would be acceptable to stakeholders to introduce a data linkage system for pharmacovigilance as long as identified concerns are addressed. Concerns included adherence to current professional, legal and ethical standards, as well resolving practical issues. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Ethics and Agricultural Education: Determining Needs.

ERIC Educational Resources Information Center

Foster, Billye

2000-01-01

In a three-round Delphi (n=197, 109, 75), secondary teachers (61.5% in agriculture) identified important ethical issues regarding land and water use: conversion of agricultural land for urban development, water rights control, and public land used for agriculture. Nearly all addressed ethical issues in class. (SK)

A process for developing standards to promote quality in general practice.

PubMed

Khoury, Julie; Krejany, Catherine J; Versteeg, Roald W; Lodewyckx, Michaela A; Pike, Simone R; Civil, Michael S; Jiwa, Moyez

2018-06-02

Since 1991, the Royal Australian College of General Practitioners' (RACGP) Standards for General Practices (the Standards) have provided a framework for quality care, risk management and best practice in the operation of Australian general practices. The Standards are also linked to incentives for general practice remuneration. These Standards were revised in 2017. The objective of this study is to describe the process undertaken to develop the fifth edition Standards published in 2017 to inform future standards development both nationally and internationally. A modified Delphi process was deployed to develop the fifth edition Standards. Development was directed by the RACGP and led by an expert panel of GPs and representatives of stakeholder groups who were assisted and facilitated by a team from RACGP. Each draft was released for stakeholder feedback and tested twice before the final version was submitted for approval by the RACGP board. Four rounds of consultation and two rounds of piloting were carried out over 32 months. The Standards were redrafted after each round. One hundred and fifty-two individuals and 225 stakeholder groups participated in the development of the Standards. Twenty-three new indicators were recommended and grouped into three sections in a new modular structure that was different from the previous edition. The Standards represent the consensus view of national stakeholders on the indicators of quality and safety in Australian general practice and primary care.

Return to play after hamstring injuries in football (soccer): a worldwide Delphi procedure regarding definition, medical criteria and decision-making.

PubMed

van der Horst, Nick; Backx, Fjg; Goedhart, Edwin A; Huisstede, Bionka Ma

2017-11-01

There are three major questions about return to play (RTP) after hamstring injuries: How should RTP be defined? Which medical criteria should support the RTP decision? And who should make the RTP decision? The study aimed to provide a clear RTP definition and medical criteria for RTP and to clarify RTP consultation and responsibilities after hamstring injury. The study used the Delphi procedure. The results of a systematic review were used as a starting point for the Delphi procedure. Fifty-eight experts in the field of hamstring injury management selected by 28 FIFA Medical Centres of Excellence worldwide participated. Each Delphi round consisted of a questionnaire, an analysis and an anonymised feedback report. After four Delphi rounds, with more than 83% response for each round, consensus was achieved that RTP should be defined as 'the moment a player has received criteria-based medical clearance and is mentally ready for full availability for match selection and/or full training'. The experts reached consensus on the following criteria to support the RTP decision: medical staff clearance, absence of pain on palpation, absence of pain during strength and flexibility testing, absence of pain during/after functional testing, similar hamstring flexibility, performance on field testing, and psychological readiness. It was also agreed that RTP decisions should be based on shared decision-making, primarily via consultation with the athlete, sports physician, physiotherapist, fitness trainer and team coach. The consensus regarding aspects of RTP should provide clarity and facilitate the assessment of when RTP is appropriate after hamstring injury, so as to avoid or reduce the risk of injury recurrence because of a premature RTP. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

International perspective on common core competencies for occupational physicians: a modified Delphi study.

PubMed

Lalloo, Drushca; Demou, Evangelia; Kiran, Sibel; Cloeren, Marianne; Mendes, René; Macdonald, Ewan B

2016-07-01

The competencies required of occupational physicians (OPs) have been the subject of peer-reviewed research in Europe and individual countries around the world. In the European Union (EU), there has been development of guidance on training and common competencies, but little research has extended beyond this. The aim of this study was to obtain consensus on and identify the common core competencies required of OPs around the world. A modified Delphi study was carried out among representative organisations and networks of OPs in a range of countries around the world. It was conducted in 2 rounds using a questionnaire based on the specialist training syllabus of a number of countries, expert panel reviews and conference discussions. Responses were received from 51 countries around the world, with the majority from Europe (60%; 59%) and North and South America (24%; 32%) in rounds 1 and 2, respectively. General principles of assessment and management of occupational hazards to health and good clinical care were jointly considered most important in ranking when compared with the other topic areas. Assessment of disability and fitness for work, communication skills and legal and ethical issues completed the top five. In both rounds, research methods and teaching and educational supervision were considered least important. This study has established the current priorities among OPs across 51 countries of the common competencies required for occupational health (OH) practice. These findings can serve as a platform for the development of common core competencies/qualifications within specific geographical regions or internationally. This is particularly pertinent with globalisation of commerce and free movement within the EU. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

The Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE): Construct and Content Validation Using a Modified Delphi Method.

PubMed

Paquette-Warren, Jann; Tyler, Marie; Fournie, Meghan; Harris, Stewart B

2017-06-01

In order to scale-up successful innovations, more evidence is needed to evaluate programs that attempt to address the rising prevalence of diabetes and the associated burdens on patients and the healthcare system. This study aimed to assess the construct and content validity of the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE), a tool developed to guide the evaluation, design and implementation with built-in knowledge translation principles. A modified Delphi method, including 3 individual rounds (questionnaire with 7-point agreement/importance Likert scales and/or open-ended questions) and 1 group round (open discussion) were conducted. Twelve experts in diabetes, research, knowledge translation, evaluation and policy from Canada (Ontario, Quebec and British Columbia) and Australia participated. Quantitative consensus criteria were an interquartile range of ≤1. Qualitative data were analyzed thematically and confirmed by participants. An importance scale was used to determine a priority multi-level indicator set. Items rated very or extremely important by 80% or more of the experts were reviewed in the final group round to build the final set. Participants reached consensus on the content and construct validity of DEFINE, including its title, overall goal, 5-step evaluation approach, medical and nonmedical determinants of health schematics, full list of indicators and associated measurement tools, priority multi-level indicator set and next steps in DEFINE's development. Validated by experts, DEFINE has the right theoretic components to evaluate comprehensively diabetes prevention and management programs and to support acquisition of evidence that could influence the knowledge translation of innovations to reduce the burden of diabetes. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

A Screening Tool to Identify Spasticity in Need of Treatment

PubMed Central

Zorowitz, Richard D.; Wein, Theodore H.; Dunning, Kari; Deltombe, Thierry; Olver, John H.; Davé, Shashank J.; Dimyan, Michael A.; Kelemen, John; Pagan, Fernando L.; Evans, Christopher J.; Gillard, Patrick J.; Kissela, Brett M.

2017-01-01

Objective To develop a clinically useful patient-reported screening tool for health care providers to identify patients with spasticity in need of treatment regardless of etiology. Design Eleven spasticity experts participated in a modified Delphi panel and reviewed and revised 2 iterations of a screening tool designed to identify spasticity symptoms and impact on daily function and sleep. Spasticity expert panelists evaluated items pooled from existing questionnaires to gain consensus on the screening tool content. The study also included cognitive interviews of 20 patients with varying spasticity etiologies to determine if the draft screening tool was understandable and relevant to patients with spasticity. Results The Delphi panel reached an initial consensus on 21 of 47 items for the screening tool and determined that the tool should have no more than 11 to 15 items and a 1-month recall period for symptom and impact items. After 2 rounds of review, 13 items were selected and modified by the expert panelists. Most patients (n = 16 [80%]) completed the cognitive interview and interpreted the items as intended. Conclusions Through the use of a Delphi panel and patient interviews, a 13-item spasticity screening tool was developed that will be practical and easy to use in routine clinical practice. PMID:27552355

Determinants of Social Accountability in Iranian Nursing and Midwifery Schools: A Delphi Study.

PubMed

Salehmoghaddam, Amir Reza; Mazloom, Seyed Reza; Sharafkhani, Mohammad; Gholami, Hassan; Emami Zeydi, Amir; Khorashadizadeh, Fatemeh; Emadzadeh, Ali

2017-04-01

Revising the medical education programs to meet the needs of society has become both a necessity and an important priority due to the considerable increase of population, changing patterns of diseases, and new health priorities. While this necessity has been highlighted in Iran's Fifth Development Plan as well as its National 2025 Vision Plan, the determinants of social accountability have not been explained yet. This study aimed to develop determinants of social accountability in the Iranian Nursing and Midwifery Schools. This classic Delphi study included thirty experts in Nursing and Midwifery Education, Research and Services selected based on purposive sampling and three rounds of Delphi technique and conducted in Nursing and Midwifery School of Mashhad University of Medical Sciences. The primary data were collected using an initial structured questionnaire prepared through extensive review of literature. SPSS 11.5 software was used to analyze the data. The interquartile deviation and percentage of agreement were also used to study the consensus of opinion by experts. Finding obtained from the rounds of Delphi resulted in selecting 69 determinants out of the initial pool of 128 primary determinants of social accountability. The items were selected based on experts' consensus and categorized under three main activities of Nursing and Midwifery School, namely education, research, and service. Social accountability determinants were explained by 69 items for Schools of Nursing and Midwifery in Iran. The proposed determinants can be used by managers and authorities of Nursing and Midwifery School, policy makers, and evaluating institutions associated with them to ensure realizing social accountability goals.

Construct Validation of Content Standards for Teaching

ERIC Educational Resources Information Center

van der Schaaf, Marieke F.; Stokking, Karel M.

2011-01-01

Current international demands to strengthen the teaching profession have led to an increased development and use of professional content standards. The study aims to provide insight in the construct validity of content standards by researching experts' underlying assumptions and preferences when participating in a delphi method. In three rounds 21…

What do we mean by "socialization to the model"? A Delphi study.

PubMed

Roos, Jo; Wearden, Alison

2009-05-01

The term "socialization to the model" is frequently used in the Cognitive Behavioural Therapy (CBT) literature, but it is unclear exactly what constitutes socialization to the model and there is a paucity of research in this area. This study aimed to develop a working definition of "socialization to the model". A three-round electronic Delphi technique was used to generate data and to achieve a consensus agreement amongst a panel of experts (N = 9) in response to two questions pertaining to what constitutes "socialization to the model". All elements generated in response to the primary question at the first round were retained throughout and scored an IQR of

Editors’ Perspectives on Enhancing Manuscript Quality and Editorial Decisions Through Peer Review and Reviewer Development

PubMed Central

Janke, Kristin K.; Traynor, Andrew P.

2017-01-01

Objectives. To identify peer reviewer and peer review characteristics that enhance manuscript quality and editorial decisions, and to identify valuable elements of peer reviewer training programs. Methods. A three-school, 15-year review of pharmacy practice and pharmacy administration faculty’s publications was conducted to identify high-publication volume journals for inclusion. Editors-in-chief identified all editors managing manuscripts for participation. A three-round modified Delphi process was used. Rounds advanced from open-ended questions regarding actions and attributes of good reviewers to consensus-seeking and clarifying questions related to quality, importance, value, and priority. Results. Nineteen editors representing eight pharmacy journals participated. Three characteristics of reviews were rated required or helpful in enhancing manuscript quality by all respondents: includes a critical analysis of the manuscript (88% required, 12% helpful), includes feedback that contains both strengths and areas of improvement (53% required, 47% helpful), and speaks to the manuscript’s utility in the literature (41% required, 59% helpful). Hands-on experience with review activities (88%) and exposure to good and bad reviews (88%) were identified as very valuable to peer reviewer development. Conclusion. Reviewers, individuals involved in faculty development, and journals should work to assist new reviewers in defining focused areas of expertise, building knowledge in these areas, and developing critical analysis skills. PMID:28630514

Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

PubMed

Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

2014-06-25

The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our study. Based upon this consultation process, a guideline will be developed on instrument selection for outcomes to be included in a COS.

A Delphi Consensus of the Crucial Steps in Gastric Bypass and Sleeve Gastrectomy Procedures in the Netherlands.

PubMed

Kaijser, Mirjam A; van Ramshorst, Gabrielle H; Emous, Marloes; Veeger, Nic J G M; van Wagensveld, Bart A; Pierie, Jean-Pierre E N

2018-04-09

Bariatric procedures are technically complex and skill demanding. In order to standardize the procedures for research and training, a Delphi analysis was performed to reach consensus on the practice of the laparoscopic gastric bypass and sleeve gastrectomy in the Netherlands. After a pre-round identifying all possible steps from literature and expert opinion within our study group, questionnaires were send to 68 registered Dutch bariatric surgeons, with 73 steps for bypass surgery and 51 steps for sleeve gastrectomy. Statistical analysis was performed to identify steps with and without consensus. This process was repeated to reach consensus of all necessary steps. Thirty-eight participants (56%) responded in the first round and 32 participants (47%) in the second round. After the first Delphi round, 19 steps for gastric bypass (26%) and 14 for sleeve gastrectomy (27%) gained full consensus. After the second round, an additional amount of 10 and 12 sub-steps was confirmed as key steps, respectively. Thirteen steps in the gastric bypass and seven in the gastric sleeve were deemed advisable. Our expert panel showed a high level of consensus expressed in a Cronbach's alpha of 0.82 for the gastric bypass and 0.87 for the sleeve gastrectomy. The Delphi consensus defined 29 steps for gastric bypass and 26 for sleeve gastrectomy as being crucial for correct performance of these procedures to the standards of our expert panel. These results offer a clear framework for the technical execution of these procedures.

Defining a Leader Role curriculum for radiation oncology: A global Delphi consensus study.

PubMed

Turner, Sandra; Seel, Matthew; Trotter, Theresa; Giuliani, Meredith; Benstead, Kim; Eriksen, Jesper G; Poortmans, Philip; Verfaillie, Christine; Westerveld, Henrike; Cross, Shamira; Chan, Ming-Ka; Shaw, Timothy

2017-05-01

The need for radiation oncologists and other radiation oncology (RO) professionals to lead quality improvement activities and contribute to shaping the future of our specialty is self-evident. Leadership knowledge, skills and behaviours, like other competencies, can be learned (Blumenthal et al., 2012). The objective of this study was to define a globally applicable competency set specific to radiation oncology for the CanMEDS Leader Role (Frank et al., 2015). A modified Delphi consensus process delivering two rounds of on-line surveys was used. Participants included trainees, radiation/clinical oncologists and other RO team members (radiation therapists, physicists, and nurses), professional educators and patients. 72 of 95 (76%) invitees from nine countries completed the Round 1 (R1) survey. Of the 72 respondents to RI, 70 completed Round 2 (R2) (97%). In R1, 35 items were deemed for 'inclusion' and 21 for 'exclusion', leaving 41 'undetermined'. After review of items, informed by participant comments, 14 competencies from the 'inclusion' group went into the final curriculum; 12 from the 'undetermined' group went to R2. In R2, 6 items reached consensus for inclusion. This process resulted in 20 RO Leader Role competencies with apparent global applicability. This is the first step towards developing learning, teaching and assessment tools for this important area of training. Copyright © 2017 Elsevier B.V. All rights reserved.

Framework of behavioral indicators evaluating TB health promotion outcomes: a modified Delphi study of TB policymakers and health workers.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Oren, Eyal; Cao, Jia

2015-12-15

Although TB health promotion directed at policy makers and healthcare workers (HCWs) is considered important to tuberculosis (TB) control, no indicators currently assess the impact of such promotional activities. This article is the second in a series of papers that seek to establish a framework of behavioral indicators for outcome evaluation of TB health promotion, using the Delphi method. In the first article, we sought to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. The objective of this second article is to present an indicator framework that can be used to assess behavioral outcomes of TB health promotion directed at policy makers and HCWs. A two-round, modified Delphi method was used to establish the indicators. Sixteen experts who were knowledgeable and experienced in the field of TB control were consulted in Delphi surveys. A questionnaire was developed following 4 steps, and involved ranking indicators on a five-point Likert scale. The consensus level was 70 %. Median, mode, and Coefficient of variation (CV) were used to describe expert responses. An authority coefficient (Cr) was used to assess the degree of each expert's authority. Consensus was achieved following the two survey rounds and several iterations among the experts. For TB health-promotion activities directed at policymakers, the experts reached consensus on 2 domains ("Resource inputs" and "Policymaking and monitoring behaviors"), 4 subdomains ("Human resources" among others), and 13 indicators ("Human resources per 100,000 person" among others). For TB health-promotion activities directed at HCWs, the experts reached consensus on 5 domains ("Self-protective behaviors" among others), 6 sub-domains ("Preventing infection" among others), and 15 indicators ("Average hours of daily workplace disinfection by ultraviolet radiation" among others). This study identified a conceptual framework of core behavioral indicators to evaluate TB health-promotion activities directed at policymakers and HCWs involved in TB control. Validation in other parts of the world could lead to global consensus on behavioral indicators to evaluate TB health promotion targeted at policymakers and HCWs.

Consensus-based cross-European recommendations for the identification, measurement and valuation of costs in health economic evaluations: a European Delphi study.

PubMed

van Lier, Lisanne I; Bosmans, Judith E; van Hout, Hein P J; Mokkink, Lidwine B; van den Hout, Wilbert B; de Wit, G Ardine; Dirksen, Carmen D; Nies, Henk L G R; Hertogh, Cees M P M; van der Roest, Henriëtte G

2017-12-19

Differences between country-specific guidelines for economic evaluations complicate the execution of international economic evaluations. The aim of this study was to develop cross-European recommendations for the identification, measurement and valuation of resource use and lost productivity in economic evaluations using a Delphi procedure. A comprehensive literature search was conducted to identify European guidelines on the execution of economic evaluations or costing studies as part of economic evaluations. Guideline recommendations were extracted by two independent reviewers and formed the basis for the first round of the Delphi study, which was conducted among European health economic experts. During three written rounds, consensus (agreement of 67% or higher) was sought on items concerning the identification, measurement and valuation of costs. Recommendations from 18 guidelines were extracted. Consensus among 26 panellists from 17 European countries was reached on 61 of 68 items. The recommendations from the Delphi study are to adopt a societal perspective, to use patient report for measuring resource use and lost productivity, to value both constructs with use of country-specific standardized/unit costs and to use country-specific discounting rates. This study provides consensus-based cross-European recommendations on how to measure and value resource use and lost productivity in economic evaluations. These recommendations are expected to support researchers, healthcare professionals, and policymakers in executing and appraising economic evaluations performed in international contexts.

Benchmarks for effective primary care-based nursing services for adults with depression: a Delphi study.

PubMed

McIlrath, Carole; Keeney, Sinead; McKenna, Hugh; McLaughlin, Derek

2010-02-01

This paper is a report of a study conducted to identify and gain consensus on appropriate benchmarks for effective primary care-based nursing services for adults with depression. Worldwide evidence suggests that between 5% and 16% of the population have a diagnosis of depression. Most of their care and treatment takes place in primary care. In recent years, primary care nurses, including community mental health nurses, have become more involved in the identification and management of patients with depression; however, there are no appropriate benchmarks to guide, develop and support their practice. In 2006, a three-round electronic Delphi survey was completed by a United Kingdom multi-professional expert panel (n = 67). Round 1 generated 1216 statements relating to structures (such as training and protocols), processes (such as access and screening) and outcomes (such as patient satisfaction and treatments). Content analysis was used to collapse statements into 140 benchmarks. Seventy-three benchmarks achieved consensus during subsequent rounds. Of these, 45 (61%) were related to structures, 18 (25%) to processes and 10 (14%) to outcomes. Multi-professional primary care staff have similar views about the appropriate benchmarks for care of adults with depression. These benchmarks could serve as a foundation for depression improvement initiatives in primary care and ongoing research into depression management by nurses.

Information needs of patients with whiplash associated disorders: A Delphi study of patient beliefs.

PubMed

Sterling, Joanna; Maujean, Annick; Sterling, Michele

2018-02-01

Whiplash associated disorders (WAD) result in significant personal and economic costs. Patient education and reassurance are recommended treatments for acute WAD but the information needs of patients have not been investigated. To determine what information whiplash-injured patients believe is important to help recovery in the acute stage of injury. A Delphi design survey series with three rounds. Thirty-three participants who had sustained a whiplash injury within the last three years were invited to participate. Participants were asked to provide five statements, in response to an open-ended question, regarding what they believed was the most important information to provide to patients following a whiplash injury. Nineteen patients responded and 85 statements were collected and reviewed independently by two of the authors to remove duplicates. The importance of the remaining items was rated by the participants in the second survey round. Items rated by >50% of participants as important were included in the third survey round. To be deemed key information, >80% of participants had to rate an item as important in this final round. Eighteen items met the criteria for key information. These points addressed four areas: assessment and treatment, recovery and symptoms, patient attitudes during treatment and relationships with health practitioners. The key information points endorsed by patients in this study may provide useful information to constitute a basis for reassurance and education provided to patients with WAD. The results also suggest that improved relationships between patients with whiplash and health practitioners is required. Copyright © 2017 Elsevier Ltd. All rights reserved.

Corruption and oil exploration: expert agreement about the prevention of HIV/AIDS in the Niger Delta of Nigeria.

PubMed

Udoh, Isidore A; Stammen, Ronald M; Mantell, Joanne E

2008-08-01

The Niger Delta, according to the Nigerian Ministry of Health, has a disproportionately high HIV infection rate, which is double the national average. The United Nations Development Program attributes the spiraling HIV infection rate in the region to poverty, migration and gender inequality. This paper examines two complementary suppositions: Is the high prevalence of HIV in the Niger Delta related to incompetent leadership and corruption? Is it related to the negative effects of oil exploration in the region? Currently, there is a dearth of research on the effectiveness of government programs or the role of the oil industry on the impact of AIDS in Nigeria. To address this gap, we conducted a survey with 27 internationally renowned experts from diverse disciplines using a three-round modified Delphi to formulate consensus about the impact of weak governance and oil corruption on AIDS in the Niger Delta. Results from the Delphi suggest that these factors and others have exacerbated the transmission of HIV in the region. To mitigate the impact of AIDS in the region, efforts to engage oil companies in implementing HIV prevention programs as part of their corporate environmental responsibility to the community are urgently needed.

Validation of quality indicators for the organization of palliative care: a modified RAND Delphi study in seven European countries (the Europall project).

PubMed

Woitha, Kathrin; Van Beek, Karen; Ahmed, Nisar; Jaspers, Birgit; Mollard, Jean M; Ahmedzai, Sam H; Hasselaar, Jeroen; Menten, Johan; Vissers, Kris; Engels, Yvonne

2014-02-01

Validated quality indicators can help health-care professionals to evaluate their medical practices in a comparative manner to deliver optimal clinical care. No international set of quality indicators to measure the organizational aspects of palliative care settings exists. To develop and validate a set of structure and process indicators for palliative care settings in Europe. A two-round modified RAND Delphi process was conducted to rate clarity and usefulness of a previously developed set of 110 quality indicators. In total, 20 multi-professional palliative care teams of centers of excellence from seven European countries. In total, 56 quality indicators were rated as useful. These valid quality indicators concerned the following domains: the definition of a palliative care service (2 quality indicators), accessibility to palliative care (16 quality indicators), specific infrastructure to deliver palliative care (8 quality indicators), symptom assessment tools (1 quality indicator), specific personnel in palliative care services (9 quality indicators), documentation methodology of clinical data (14 quality indicators), evaluation of quality and safety procedures (1 quality indicator), reporting of clinical activities (1 quality indicator), and education in palliative care (4 quality indicator). The modified RAND Delphi process resulted in 56 international face-validated quality indicators to measure and compare organizational aspects of palliative care. These quality indicators, aimed to assess and improve the organization of palliative care, will be pilot tested in palliative care settings all over Europe and be used in the EU FP7 funded IMPACT project.

Identifying Psychological Contract Breaches to Guide Improvements in Faculty Recruitment, Retention, and Development

PubMed Central

Desselle, Shane P.; Draugalis, JoLaine R.; Spies, Alan R.; Davis, Tamra S.; Bolino, Mark

2012-01-01

Objective. To identify pharmacy faculty members’ perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. Methods. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Results. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. Conclusion. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development. PMID:22919084

Identifying psychological contract breaches to guide improvements in faculty recruitment, retention, and development.

PubMed

Peirce, Gretchen L; Desselle, Shane P; Draugalis, JoLaine R; Spies, Alan R; Davis, Tamra S; Bolino, Mark

2012-08-10

To identify pharmacy faculty members' perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development.

Validation of a clinical leadership qualities framework for managers in aged care: a Delphi study.

PubMed

Jeon, Yun-Hee; Conway, Jane; Chenoweth, Lynn; Weise, Janelle; Thomas, Tamsin Ht; Williams, Anna

2015-04-01

To establish validity of a clinical leadership framework for aged care middle managers (The Aged care Clinical Leadership Qualities Framework). Middle managers in aged care have responsibility not only for organisational governance also and operational management but also quality service delivery. There is a need to better define clinical leadership abilities in aged care middle managers, in order to optimise their positional authority to lead others to achieve quality outcomes. A Delphi method. Sixty-nine experts in aged care were recruited, representing rural, remote and metropolitan community and residential aged care settings. Panellists were asked to rate the proposed framework in terms of the relevance and importance of each leadership quality using four-point Likert scales, and to provide comments. Three rounds of consultation were conducted. The number and corresponding percentage of the relevance and importance rating for each quality was calculated for each consultation round, as well as mean scores. Consensus was determined to be reached when a percentage score reached 70% or greater. Twenty-three panellists completed all three rounds of consultation. Following the three rounds of consultation, the acceptability and face validity of the framework was confirmed. The study confirmed the framework as useful in identifying leadership requirements for middle managers in Australian aged care settings. The framework is the first validated framework of clinical leadership attributes for middle managers in aged care and offers an initial step forward in clarifying the aged care middle manager role. The framework provides clarity in the breadth of role expectations for the middle managers and can be used to inform an aged care specific leadership program development, individuals' and organisations' performance and development processes; and policy and guidelines about the types of activities required of middle managers in aged care. © 2014 John Wiley & Sons Ltd.

Obstacles to comprehensive dental care in patients with sustained limitations of their decision-making abilities: findings from a Delphi study.

PubMed

Blaizot, Alessandra; Catteau, Céline; Delfosse, Caroline; Hamel, Olivier; Trentesaux, Thomas

2018-06-01

The objective of this study was to explore the therapeutic limitations experienced by a panel of special-care dentists in France when treating patients with sustained limitations of their decision-making abilities. We used a Delphi technique conducted in three rounds from 01 June 2014 to 30 September 2015. A first questionnaire comprising open-ended questions was addressed to 72 panellists. A content analysis of the returned questionnaires served to draft a second questionnaire comprising closed-ended questions; this was sent to the 28 panellists who responded in the first round. A third questionnaire was sent to the 20 panellists who responded in the second round to give them an opportunity to reconsider their response in the context of the second-round response group. Sixteen panellists answered the last round. A large majority agreed on the importance of providing comprehensive care, but they encountered obstacles at two time points: (i) when proposing the care; and (ii) when setting it up. The panel put forward recommendations in two main areas: (i) the training of those involved in oral health decisions; and (ii) dental care management and organization of the care system. The study provided a foundation for building future orientations in health care for patients with limited decision-making abilities. © 2018 Eur J Oral Sci.

Effective self-management strategies for bipolar disorder: A community-engaged Delphi Consensus Consultation study.

PubMed

Michalak, Erin E; Suto, Melinda J; Barnes, Steven J; Hou, Sharon; Lapsley, Sara; Scott, Mike W; Murray, Greg; Austin, Jehannine; Elliott, Nusha Balram; Berk, Lesley; Crest Bd

2016-12-01

Self-management represents an important complement to psychosocial treatments for bipolar disorder (BD), but research is limited. Specifically, little is known about self-management approaches for elevated mood states; this study investigated self-management strategies for: (1) maintaining balance in mood, and (2) stopping progression into hypomania/mania. To identify the common components of BD self-management, Delphi Consensus Consultation methods were combined with a Community-Based Participatory Research (CBPR) approach across five study phases: (1) Qualitative dataset content analysis; (2) Academic/grey literature reviews; (3) Content analysis; (4) Two Delphi rounds (rating strategies on a 5-point Likert scale, Very Unhelpful-Very Helpful), and; (5) Quantitative analysis and interpretation. Participants were people with BD and healthcare providers. Phases 1 and 2 identified 262 and 3940 candidate strategies, respectively; 3709 were discarded as duplicates/unintelligible. The remaining 493 were assessed via Delphi methods in Phase 4: 101 people with BD and 52 healthcare providers participated in Round 1; 83 of the BD panel (82%) and 43 of the healthcare provider panel (83%) participated in Round 2-exploratory factor analysis (EFA) was conducted on Round 2 results. EFA was underpowered and sample was not ethnically diverse, limiting generalizability. High concordance was observed in ratings of strategy effectiveness between the two panels. Future research could usefully investigate the provisional discovery here of underlying factors which link individual strategies. For example, 'maintaining hope' underpinned strategies for maintaining balance, and 'decreasing use of stimulants' underpinned strategies to interrupt hypo/manic ascent. There is merit in combining CBPR and Delphi methods. Copyright © 2016 Elsevier B.V. All rights reserved.

Development of a core outcome set for use in determining the overall success of gastroschisis treatment.

PubMed

Allin, Benjamin; Ross, Andrew; Marven, Sean; J Hall, Nigel; Knight, Marian

2016-07-27

Gastroschisis research is limited in quality by the presence of significant heterogeneity in outcome measure reporting (PloS One 10(1):e0116908, 2015). Using core outcome sets in research is one proposed method for addressing this problem (Trials 13:103, 2012; Clin Rheumatol 33(9):1313-1322, 2014; Health Serv Res Policy 17(1):1-2, 2012). Ultimately, standardising outcome measure reporting will improve research quality and translate into improvements in patient care. Candidate outcome measures have been identified through systematic reviews. These outcome measures will form the starting point for an online, three-phase Delphi process that will be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel, panel 2 is a non-neonatal panel and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1-9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's gastroschisis treatment. In round 2, experts will be presented with the same list of outcome measures and with graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. The results of the Delphi process will be discussed, and outcomes re-scored. Outcome measures where > 70 % of the participants at the meeting scored them as 7-9 and < 15 % scored them as 1-3 will form the core outcome set. Development of a core outcome set will help to reduce the heterogeneity of the outcome measure reporting in gastroschisis. This will increase the quality of research taking place and ultimately improve care provided to infants with gastroschisis.

Priorities for research in child maltreatment, intimate partner violence and resilience to violence exposures: results of an international Delphi consensus development process.

PubMed

Wathen, C Nadine; MacGregor, Jennifer C D; Hammerton, Joanne; Coben, Jeffrey H; Herrman, Helen; Stewart, Donna E; MacMillan, Harriet L

2012-08-21

Intimate partner violence (IPV) and child maltreatment (CM) are major global public health problems. The Preventing Violence Across the Lifespan (PreVAiL) Research Network, an international group of over 60 researchers and national and international knowledge-user partners in CM and IPV, sought to identify evidence-based research priorities in IPV and CM, with a focus on resilience, using a modified Delphi consensus development process. Review of existing empirical evidence, PreVAiL documents and team discussion identified a starting list of 20 priorities in the following categories: resilience to violence exposure (RES), CM, and IPV, as well as priorities that cross-cut the content areas (CC), and others specific to research methodologies (RM) in violence research. PreVAiL members (N = 47) completed two online survey rounds, and one round of discussions via three teleconference calls to rate, rank and refine research priorities. Research priorities were: to examine key elements of promising or successful programmes in RES/CM/IPV to build intervention pilot work; CC: to integrate violence questions into national and international surveys, and RM: to investigate methods for collecting and collating datasets to link data and to conduct pooled, meta and sub-group analyses to identify promising interventions for particular groups. These evidence-based research priorities, developed by an international team of violence, gender and mental health researchers and knowledge-user partners, are of relevance for prevention and resilience-oriented research in the areas of IPV and CM.

Standardization of definitions in focal therapy of prostate cancer: report from a Delphi consensus project.

PubMed

Postema, A W; De Reijke, T M; Ukimura, O; Van den Bos, W; Azzouzi, A R; Barret, E; Baumunk, D; Blana, A; Bossi, A; Brausi, M; Coleman, J A; Crouzet, S; Dominguez-Escrig, J; Eggener, S; Ganzer, R; Ghai, S; Gill, I S; Gupta, R T; Henkel, T O; Hohenfellner, M; Jones, J S; Kahmann, F; Kastner, C; Köhrmann, K U; Kovacs, G; Miano, R; van Moorselaar, R J; Mottet, N; Osorio, L; Pieters, B R; Polascik, T J; Rastinehad, A R; Salomon, G; Sanchez-Salas, R; Schostak, M; Sentker, L; Tay, K J; Varkarakis, I M; Villers, A; Walz, J; De la Rosette, J J

2016-10-01

To reach standardized terminology in focal therapy (FT) for prostate cancer (PCa). A four-stage modified Delphi consensus project was undertaken among a panel of international experts in the field of FT for PCa. Data on terminology in FT was collected from the panel by three rounds of online questionnaires. During a face-to-face meeting on June 21, 2015, attended by 38 experts, all data from the online rounds were reviewed and recommendations for definitions were formulated. Consensus was attained on 23 of 27 topics; Targeted FT was defined as a lesion-based treatment strategy, treating all identified significant cancer foci; FT was generically defined as an anatomy-based (zonal) treatment strategy. Treatment failure due to the ablative energy inadequately destroying treated tissue is defined as ablation failure. In targeting failure the energy is not adequately applied to the tumor spatially and selection failure occurs when a patient was wrongfully selected for FT. No definition of biochemical recurrence can be recommended based on the current data. Important definitions for outcome measures are potency (minimum IIEF-5 score of 21), incontinence (new need for pads or leakage) and deterioration in urinary function (increase in IPSS >5 points). No agreement on the best quality of life tool was established, but UCLA-EPIC and EORTC-QLQ-30 were most commonly supported by the experts. A complete overview of statements is presented in the text. Focal therapy is an emerging field of PCa therapeutics. Standardization of definitions helps to create comparable research results and facilitate clear communication in clinical practice.

Priorities for research in child maltreatment, intimate partner violence and resilience to violence exposures: results of an international Delphi consensus development process

PubMed Central

2012-01-01

Background Intimate partner violence (IPV) and child maltreatment (CM) are major global public health problems. The Preventing Violence Across the Lifespan (PreVAiL) Research Network, an international group of over 60 researchers and national and international knowledge-user partners in CM and IPV, sought to identify evidence-based research priorities in IPV and CM, with a focus on resilience, using a modified Delphi consensus development process. Methods Review of existing empirical evidence, PreVAiL documents and team discussion identified a starting list of 20 priorities in the following categories: resilience to violence exposure (RES), CM, and IPV, as well as priorities that cross-cut the content areas (CC), and others specific to research methodologies (RM) in violence research. PreVAiL members (N = 47) completed two online survey rounds, and one round of discussions via three teleconference calls to rate, rank and refine research priorities. Results Research priorities were: to examine key elements of promising or successful programmes in RES/CM/IPV to build intervention pilot work; CC: to integrate violence questions into national and international surveys, and RM: to investigate methods for collecting and collating datasets to link data and to conduct pooled, meta and sub-group analyses to identify promising interventions for particular groups. Conclusions These evidence-based research priorities, developed by an international team of violence, gender and mental health researchers and knowledge-user partners, are of relevance for prevention and resilience-oriented research in the areas of IPV and CM. PMID:22908894

Expert agreed standards for the selection and development of cancer support group leaders: an online reactive Delphi study.

PubMed

Pomery, Amanda; Schofield, Penelope; Xhilaga, Miranda; Gough, Karla

2018-01-01

The aim of this study was to develop pragmatic, consensus-based minimum standards for the role of a cancer support group leader. Secondly, to produce a structured interview designed to assess the knowledge, skills and attributes of the individuals who seek to undertake the role. An expert panel of 73 academics, health professionals, cancer agency workers and cancer support group leaders were invited to participate in a reactive online Delphi study involving three online questionnaire rounds. Participants determined and ranked requisite knowledge, skills and attributes (KSA) for cancer support group leaders, differentiated ideal from required KSA to establish minimum standards, and agreed on a method of rating KSA to determine suitability and readiness. Forty-five experts (62%) participated in round 1, 36 (49%) in round 2 and 23 (31%) in round 3. In round 1, experts confirmed 59 KSA identified via a systemic review and identified a further 55 KSA. In round 2, using agreement ≥75%, 52 KSA emerged as minimum standards for support group leaders. In round 3, consensus was reached on almost every aspect of the content and structure of a structured interview. Panel member comments guided refinement of wording, re-ordering of questions and improvement of probing questions. Alongside a novel structured interview, the first consensus-based minimum standards have been developed for cancer support group leaders, incorporating expert consensus and pragmatic considerations. Pilot and field testing will be used to appraise aspects of clinical utility and establish a rational scoring model for the structured interview.

Quality indicators for in-hospital geriatric co-management programmes: a systematic literature review and international Delphi study

PubMed Central

Van Grootven, Bastiaan; McNicoll, Lynn; Mendelson, Daniel A; Friedman, Susan M; Fagard, Katleen; Milisen, Koen; Flamaing, Johan; Deschodt, Mieke

2018-01-01

Objective To find consensus on appropriate and feasible structure, process and outcome indicators for the evaluation of in-hospital geriatric co-management programmes. Design An international two-round Delphi study based on a systematic literature review (searching databases, reference lists, prospective citations and trial registers). Setting Western Europe and the USA. Participants Thirty-three people with at least 2 years of clinical experience in geriatric co-management were recruited. Twenty-eight experts (16 from the USA and 12 from Europe) participated in both Delphi rounds (85% response rate). Measures Participants rated the indicators on a nine-point scale for their (1) appropriateness and (2) feasibility to use the indicator for the evaluation of geriatric co-management programmes. Indicators were considered appropriate and feasible based on a median score of seven or higher. Consensus was based on the level of agreement using the RAND/UCLA Appropriateness Method. Results In the first round containing 37 indicators, there was consensus on 14 indicators. In the second round containing 44 indicators, there was consensus on 31 indicators (structure=8, process=7, outcome=16). Experts indicated that co-management should start within 24 hours of hospital admission using defined criteria for selecting appropriate patients. Programmes should focus on the prevention and management of geriatric syndromes and complications. Key areas for comprehensive geriatric assessment included cognition/delirium, functionality/mobility, falls, pain, medication and pressure ulcers. Key outcomes for evaluating the programme included length of stay, time to surgery and the incidence of complications. Conclusion The indicators can be used to assess the performance of geriatric co-management programmes and identify areas for improvement. Furthermore, the indicators can be used to monitor the implementation and effect of these programmes. PMID:29549210

Suicide first aid guidelines for Sri Lanka: a Delphi consensus study.

PubMed

De Silva, Saranga A; Colucci, Erminia; Mendis, Jayan; Kelly, Claire M; Jorm, Anthony F; Minas, Harry

2016-01-01

Sri Lanka has one of the highest suicide rates in the world. Gatekeeper programs aimed at specific target groups could be a promising suicide prevention strategy in the country. The aim of this study was to develop guidelines that help members of the public to provide first aid to persons in Sri Lanka who are at risk of suicide. The Delphi method was used to elicit consensus on potential helping statements to include in the guidelines. These statements describe information members of the public should have and actions they can take to help a person who is experiencing suicidal thoughts. An expert panel, comprised of mental health and suicide experts in Sri Lanka, rated each statement. The panellists were encouraged to suggest any additional action that was not included in the original questionnaire and, in particular, to include items that were culturally appropriate or gender specific. Responses to open-ended questions were used to generate new items. These items were included in the subsequent Delphi rounds. Three Delphi rounds were carried out. Statements were accepted for inclusion in the guidelines if they were endorsed (rated as essential or important) by at least 80 % of the panel. Statements endorsed by 70-79 % of the panel were re-rated in the following round. Statements with less than 70 % endorsement, or re-rated items that did not receive 80 % or higher endorsement were rejected. The output from the Delphi process was a set of endorsed statements. In the first round questionnaire 473 statements were presented to the panel and 58 new items were generated from responses to the open-ended questions. Of the total 531 statements presented, 304 were endorsed. These statements were used to develop the suicide first aid guidelines for Sri Lanka. By engaging Sri Lankans who are experts in the field of mental health or suicide this research developed culturally appropriate guidelines for providing mental health first aid to a person at risk of suicide in Sri Lanka. The guidelines may serve as a basis for developing training for members of the public to provide mental health first aid to persons at risk of suicide as part of Sri Lanka's suicide prevention strategy.

Identification of Workplace Skills and Competencies Essential for Marketing Occupations.

ERIC Educational Resources Information Center

Ruhland, Sheila K.

A study examined the types of academic skills and workplace competencies that will be needed by persons employed in marketing occupations in the future. Three rounds of a Delphi questionnaire were mailed to 23 persons who were recommended by secondary and postsecondary marketing teachers in Missouri as having expertise in marketing occupations. In…

A medical school's organizational readiness for curriculum change (MORC): development and validation of a questionnaire.

PubMed

Jippes, Mariëlle; Driessen, Erik W; Broers, Nick J; Majoor, Gerard D; Gijselaers, Wim H; van der Vleuten, Cees P M

2013-09-01

Because successful change implementation depends on organizational readiness for change, the authors developed and assessed the validity of a questionnaire, based on a theoretical model of organizational readiness for change, designed to measure, specifically, a medical school's organizational readiness for curriculum change (MORC). In 2012, a panel of medical education experts judged and adapted a preliminary MORC questionnaire through a modified Delphi procedure. The authors administered the resulting questionnaire to medical school faculty involved in curriculum change and tested the psychometric properties using exploratory and confirmatory factor analysis, and generalizability analysis. The mean relevance score of the Delphi panel (n = 19) reached 4.2 on a five-point Likert-type scale (1 = not relevant and 5 = highly relevant) in the second round, meeting predefined criteria for completing the Delphi procedure. Faculty (n = 991) from 131 medical schools in 56 countries completed MORC. Exploratory factor analysis yielded three underlying factors-motivation, capability, and external pressure-in 12 subscales with 53 items. The scale structure suggested by exploratory factor analysis was confirmed by confirmatory factor analysis. Cronbach alpha ranged from 0.67 to 0.92 for the subscales. Generalizability analysis showed that the MORC results of 5 to 16 faculty members can reliably evaluate a school's organizational readiness for change. MORC is a valid, reliable questionnaire for measuring organizational readiness for curriculum change in medical schools. It can identify which elements in a change process require special attention so as to increase the chance of successful implementation.

The use of advanced web-based survey design in Delphi research.

PubMed

Helms, Christopher; Gardner, Anne; McInnes, Elizabeth

2017-12-01

A discussion of the application of metadata, paradata and embedded data in web-based survey research, using two completed Delphi surveys as examples. Metadata, paradata and embedded data use in web-based Delphi surveys has not been described in the literature. The rapid evolution and widespread use of online survey methods imply that paper-based Delphi methods will likely become obsolete. Commercially available web-based survey tools offer a convenient and affordable means of conducting Delphi research. Researchers and ethics committees may be unaware of the benefits and risks of using metadata in web-based surveys. Discussion paper. Two web-based, three-round Delphi surveys were conducted sequentially between August 2014 - January 2015 and April - May 2016. Their aims were to validate the Australian nurse practitioner metaspecialties and their respective clinical practice standards. Our discussion paper is supported by researcher experience and data obtained from conducting both web-based Delphi surveys. Researchers and ethics committees should consider the benefits and risks of metadata use in web-based survey methods. Web-based Delphi research using paradata and embedded data may introduce efficiencies that improve individual participant survey experiences and reduce attrition across iterations. Use of embedded data allows the efficient conduct of multiple simultaneous Delphi surveys across a shorter timeframe than traditional survey methods. The use of metadata, paradata and embedded data appears to improve response rates, identify bias and give possible explanation for apparent outlier responses, providing an efficient method of conducting web-based Delphi surveys. © 2017 John Wiley & Sons Ltd.

Delphi based consensus study into planning for chemical incidents.

PubMed

Crawford, I W F; Mackway-Jones, K; Russell, D R; Carley, S D

2004-01-01

To achieve consensus in all phases of chemical incident planning and response. A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required.

Delphi based consensus study into planning for chemical incidents

PubMed Central

Crawford, I; Mackway-Jones, K; Russell, D; Carley, S

2004-01-01

Objective: To achieve consensus in all phases of chemical incident planning and response. Design: A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. Results: A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. Conclusions: The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required. PMID:14734369

Developing a guideline for clinical trial protocol content: Delphi consensus survey

PubMed Central

2012-01-01

Background Recent evidence has highlighted deficiencies in clinical trial protocols, having implications for many groups. Existing guidelines for randomized clinical trial (RCT) protocol content vary substantially and most do not describe systematic methodology for their development. As one of three prespecified steps for the systematic development of a guideline for trial protocol content, the objective of this study was to conduct a three-round Delphi consensus survey to develop and refine minimum content for RCT protocols. Methods Panellists were identified using a multistep iterative approach, met prespecified minimum criteria and represented key stakeholders who develop or use clinical trial protocols. They were asked to rate concepts for importance in a minimum set of items for RCT protocols. The main outcome measures were degree of importance (scale of 1 to 10; higher scores indicating higher importance) and level of consensus for items. Results were presented as medians, interquartile ranges, counts and percentages. Results Ninety-six expert panellists participated in the Delphi consensus survey including trial investigators, methodologists, research ethics board members, funders, industry, regulators and journal editors. Response rates were between 88 and 93% per round. Overall, panellists rated 63 of 88 concepts of high importance (of which 50 had a 25th percentile rating of 8 or greater), 13 of moderate importance (median 6 or 7) and 12 of low importance (median less than or equal to 5) for minimum trial protocol content. General and item-specific comments and subgroup results provided valuable insight for further discussions. Conclusions This Delphi process achieved consensus from a large panel of experts from diverse stakeholder groups on essential content for RCT protocols. It also highlights areas of divergence. These results, complemented by other empirical research and consensus meetings, are helping guide the development of a guideline for protocol content. PMID:23006145

USING THE DELPHI TECHNIQUE TO DEVELOP EFFECTIVENESS INDICATORS FOR SOCIAL MARKETING COMMUNICATION TO REDUCE HEALTH-RISK BEHAVIORS AMONG YOUTH.

PubMed

Vantamay, Nottakrit

2015-09-01

This study aimed to develop effectiveness indicators for social marketing communication to reduce health-risk behaviors among Thai youth by using the Delphi technique. The Delphi technique is a research approach used to gain consensus through a series of two or more rounds of questionnaire surveys where information and results are fed back to panel members between each round and it has been extensively used to generate many indicators relevant to health behaviors. The Delphi technique was conducted in 3 rounds by consulting a panel of 15 experts in the field of social marketing communication for public health campaigns in Thailand. We found forty-nine effectiveness indicators in eight core components reached consensus. These components were: 1) attitude about health-risk behavior reduction, 2) subjective norms, 3) perceived behavioral control, 4) intention to reduce health-risk behaviors, 5) practices for reducing health-risk behaviors, 6) knowledge about the dangers and impact of health-risk behaviors, 7) campaign brand equity, and 8) communication networks. These effectiveness indicators could be applied by health promotion organizations for evaluating the effectiveness of social marketing communication to effectively reduce health-risk behaviors among youth.

Core Outcome Domains for early phase clinical trials of sound-, psychology-, and pharmacology-based interventions to manage chronic subjective tinnitus in adults: the COMIT'ID study protocol for using a Delphi process and face-to-face meetings to establish consensus.

PubMed

Fackrell, Kathryn; Smith, Harriet; Colley, Veronica; Thacker, Brian; Horobin, Adele; Haider, Haúla F; Londero, Alain; Mazurek, Birgit; Hall, Deborah A

2017-08-23

The reporting of outcomes in clinical trials of subjective tinnitus indicates that many different tinnitus-related complaints are of interest to investigators, from perceptual attributes of the sound (e.g. loudness) to psychosocial impacts (e.g. quality of life). Even when considering one type of intervention strategy for subjective tinnitus, there is no agreement about what is critically important for deciding whether a treatment is effective. The main purpose of this observational study is, therefore to, develop Core Outcome Domain Sets for the three different intervention strategies (sound, psychological, and pharmacological) for adults with chronic subjective tinnitus that should be measured and reported in every clinical trial of these interventions. Secondary objectives are to identify the strengths and limitations of our study design for recruiting and reducing attrition of participants, and to explore uptake of the core outcomes. The 'Core Outcome Measures in Tinnitus: International Delphi' (COMIT'ID) study will use a mixed-methods approach that incorporates input from health care users at the pre-Delphi stage, a modified three-round Delphi survey and final consensus meetings (one for each intervention). The meetings will generate recommendations by stakeholder representatives on agreed Core Outcome Domain Sets specific to each intervention. A subsequent step will establish a common cross-cutting Core Outcome Domain Set by identifying the common outcome domains included in all three intervention-specific Core Outcome Domain Sets. To address the secondary objectives, we will gather feedback from participants about their experience of taking part in the Delphi process. We aspire to conduct an observational cohort study to evaluate uptake of the core outcomes in published studies at 7 years following Core Outcome Set publication. The COMIT'ID study aims to develop a Core Outcome Domain Set that is agreed as critically important for deciding whether a treatment for subjective tinnitus is effective. Such a recommendation would help to standardise future clinical trials worldwide and so we will determine if participation increases use of the Core Outcome Set in the long term. This project has been registered (November 2014) in the database of the Core Outcome Measures in Effectiveness Trials (COMET) initiative.

Expert surgical consensus for prenatal counseling using the Delphi method.

PubMed

Berman, Loren; Jackson, Jordan; Miller, Kristen; Kowalski, Rebecca; Kolm, Paul; Luks, Francois I

2017-11-28

Pediatric surgeons frequently offer prenatal consultation for congenital pulmonary airway malformation (CPAM) and congenital diaphragmatic hernia (CDH); however, there is no evidence-based consensus to guide prenatal decision making and counseling for these conditions. Eliciting feedback from experts is integral to defining best practice regarding prenatal counseling and intervention. A Delphi consensus process was undertaken using a panel of pediatric surgeons identified as experts in fetal therapy to address current limitations. Areas of discrepancy in the literature on CPAM and CDH were identified and used to generate a list of content and intervention questions. Experts were invited to participate in an online Delphi survey. Items that did not reach first-round consensus were broken down into additional questions, and consensus was achieved in the second round. Fifty-four surgeons (69%) responded to at least one of the two survey rounds. During round one, consensus was reached on 54 of 89 survey questions (61%), and 45 new questions were developed. During round two, consensus was reached on 53 of 60 survey questions (88%). We determined expert consensus to establish guidelines regarding perinatal management of CPAM and CDH. Our results can help educate pediatric surgeons participating in perinatal care of these patients. V. Copyright © 2017 Elsevier Inc. All rights reserved.

Constructing post-surgical discharge instructions through a Delphi consensus methodology.

PubMed

Scott, Aaron R; Sanderson, Cody J; Rush, Augustus J; Alore, Elizabeth A; Naik, Aanand D; Berger, David H; Suliburk, James W

2018-05-01

Patient education materials are a crucial part of physician-patient communication. We hypothesize that available discharge instructions are difficult to read and fail to address necessary topics. Our objective is to evaluate readability and content of surgical discharge instructions using thyroidectomy to develop standardized discharge materials. Thyroidectomy discharge materials were analyzed for readability and assessed for content. Fifteen endocrine surgeons participated in a modified Delphi consensus panel to select necessary topics. Using readability best practices, we created standardized discharge instructions which included all selected topics. The panel evaluated 40 topics, selected 23, deemed 4 inappropriate, consolidated 5, and did not reach consensus on 8 topics after 4 rounds. The evaluated instructions' reading levels ranged from grade 6.5 to 13.2; none contained all consensus topics. Current post surgical thyroidectomy discharge instructions are more difficult to read than recommended by literacy standards and omit consensus warning signs of major complications. Our easy-to-read discharge instructions cover pertinent topics and may enhance patient education. Delphi methodology is useful for developing post-surgical instructions. Patient education materials need appropriate readability levels and content. We recommend the Delphi method to select content using consensus expert opinion whenever higher level data is lacking. Copyright © 2017 Elsevier B.V. All rights reserved.

Building expert agreement on the importance and feasibility of workplace health promotion interventions for nurses and midwives: A modified Delphi consultation.

PubMed

Perry, Lin; Nicholls, Rachel; Duffield, Christine; Gallagher, Robyn

2017-11-01

To use a Delphi panel to determine the relative importance and feasibility of workplace health promotion interventions to promote and support the health of the Australian nursing and midwifery workforce. The nursing workforce experiences rates of ill health above that of other workforces, yet there is little investment in workplace health promotion. The study used a modified Delphi design conducted between September and November 2015. Eleven of 19 purposively selected expert panellists discussed, rated and provided feedback through two rounds of an electronic questionnaire about the relative importance and feasibility of 46 workplace health promotion interventions and processes for nurses and midwives. Scores for importance and feasibility were calculated and ranked and a composite score of importance multiplied by feasibility. Mental health strategies were prioritized as the most important and feasible of the intervention topics, followed closely by healthy eating and physical activity interventions; smoking cessation ranked lowest. The most highly ranked interventions targeted healthy eating, stress management and resilience training. Highest ranked processes to support development of a healthy work environment included intersectoral collaboration and employee wellness groups. Study findings prompt consideration of health promotion opportunities to support nurses' health and well-being. Findings identified key workplace health promotion priorities and provide direction for policy makers and managers to promote nursing and midwifery workforce health. © 2017 John Wiley & Sons Ltd.

Consensus achievement of leadership, organisational and individual factors that influence safety climate: Implications for nursing management.

PubMed

Fischer, Shelly A; Jones, Jacqueline; Verran, Joyce A

2018-01-01

To validate a framework of factors that influence the relationship of transformational leadership and safety climate, and to enable testing of safety chain factors by generating hypotheses regarding their mediating and moderating effects. Understanding the patient safety chain and mechanisms by which leaders affect a strong climate of safety is essential to transformational leadership practice, education, and research. A systematic review of leadership and safety literature was used to develop an organising framework of factors proposed to influence the climate of safety. A panel of 25 international experts in leadership and safety engaged a three-round modified Delphi study with Likert-scored surveys. Eighty per cent of participating experts from six countries were retained to the final survey round. Consensus (>66% agreement) was achieved on 40 factors believed to influence safety climate in the acute care setting. Consensus regarding specific factors that play important roles in an organisation's climate of safety can be reached. Generally, the demonstration of leadership commitment to safety is key to cultivating a culture of patient safety. Transformational nurse leaders should consider and employ all three categories of factors in daily leadership activities and decision-making to drive a strong climate of patient safety. © 2017 John Wiley & Sons Ltd.

Determining procedures for simulation-based training in radiology: a nationwide needs assessment.

PubMed

Nayahangan, Leizl Joy; Nielsen, Kristina Rue; Albrecht-Beste, Elisabeth; Bachmann Nielsen, Michael; Paltved, Charlotte; Lindorff-Larsen, Karen Gilboe; Nielsen, Bjørn Ulrik; Konge, Lars

2018-06-01

New training modalities such as simulation are widely accepted in radiology; however, development of effective simulation-based training programs is challenging. They are often unstructured and based on convenience or coincidence. The study objective was to perform a nationwide needs assessment to identify and prioritize technical procedures that should be included in a simulation-based curriculum. A needs assessment using the Delphi method was completed among 91 key leaders in radiology. Round 1 identified technical procedures that radiologists should learn. Round 2 explored frequency of procedure, number of radiologists performing the procedure, risk and/or discomfort for patients, and feasibility for simulation. Round 3 was elimination and prioritization of procedures. Response rates were 67 %, 70 % and 66 %, respectively. In Round 1, 22 technical procedures were included. Round 2 resulted in pre-prioritization of procedures. In round 3, 13 procedures were included in the final prioritized list. The three highly prioritized procedures were ultrasound-guided (US) histological biopsy and fine-needle aspiration, US-guided needle puncture and catheter drainage, and basic abdominal ultrasound. A needs assessment identified and prioritized 13 technical procedures to include in a simulation-based curriculum. The list may be used as guide for development of training programs. • Simulation-based training can supplement training on patients in radiology. • Development of simulation-based training should follow a structured approach. • The CAMES Needs Assessment Formula explores needs for simulation training. • A national Delphi study identified and prioritized procedures suitable for simulation training. • The prioritized list serves as guide for development of courses in radiology.

Challenges faced with the implementation of Web-Based Data Query Systems for population health: development of a questionnaire based on expert consensus.

PubMed

Ahuja, Manik; Aseltine, Robert; Warren, Nicholas; Reisine, Susan; Williams, Pam Holtzclaw; Cislo, Andy

2018-01-01

State health agencies (SHA) and local health agencies (LHA) face several challenges with the dissemination of local health data using Web-Based Data Query Systems (WDQS). To help guide future research, this study aimed to utilize expert consensus to identify the most relevant items that contribute to these challenges. A total of 17 researchers and public health professionals agreed to participate in a three-round Delphi process. In round 1, four topics were represented on a 42-item questionnaire using a 5-point Likert scale, along with free-text responses. Free-text responses were analyzed leading to a series of items for a second Delphi round. Participants were given an opportunity to revise results in round 3 for items that did not meet consensus in round 1 or round 2. Consensus on expert opinions was defined at interquartile range (IQR) ≤ 1. The experts reached consensus on a total of 21 (50%) of the 42 items presented in the initial questionnaire. Eleven of the 15 (73%) of the items extracted from the free-text responses met consensus. Items in consensus from this pilot study were used to develop an instrument for a broader survey across Behavioral Risk Factor Surveillance System (BRFSS) coordinators across all 50 US states. Experts confirmed that software development costs, inadequate human resources, data sharing gaps, a lack of political support, and poor data quality contribute significantly to challenges in their data implementation. The findings from this pilot study inform us of items of public health significance that will help guide future research.

Characteristics of a global classification system for perinatal deaths: a Delphi consensus study.

PubMed

Wojcieszek, Aleena M; Reinebrant, Hanna E; Leisher, Susannah Hopkins; Allanson, Emma; Coory, Michael; Erwich, Jan Jaap; Frøen, J Frederik; Gardosi, Jason; Gordijn, Sanne; Gulmezoglu, Metin; Heazell, Alexander E P; Korteweg, Fleurisca J; McClure, Elizabeth; Pattinson, Robert; Silver, Robert M; Smith, Gordon; Teoh, Zheyi; Tunçalp, Özge; Flenady, Vicki

2016-08-15

Despite the global burden of perinatal deaths, there is currently no single, globally-acceptable classification system for perinatal deaths. Instead, multiple, disparate systems are in use world-wide. This inconsistency hinders accurate estimates of causes of death and impedes effective prevention strategies. The World Health Organisation (WHO) is developing a globally-acceptable classification approach for perinatal deaths. To inform this work, we sought to establish a consensus on the important characteristics of such a system. A group of international experts in the classification of perinatal deaths were identified and invited to join an expert panel to develop a list of important characteristics of a quality global classification system for perinatal death. A Delphi consensus methodology was used to reach agreement. Three rounds of consultation were undertaken using a purpose built on-line survey. Round one sought suggested characteristics for subsequent scoring and selection in rounds two and three. The panel of experts agreed on a total of 17 important characteristics for a globally-acceptable perinatal death classification system. Of these, 10 relate to the structural design of the system and 7 relate to the functional aspects and use of the system. This study serves as formative work towards the development of a globally-acceptable approach for the classification of the causes of perinatal deaths. The list of functional and structural characteristics identified should be taken into consideration when designing and developing such a system.

Development of a consensus taxonomy of sedentary behaviors (SIT): report of Delphi Round 1.

PubMed

Chastin, Sebastien Francois Martin; Schwarz, Ulf; Skelton, Dawn A; Skelton, Dawn Ann

2013-01-01

Over the last decade, sedentary behaviors have emerged as a distinctive behavioral paradigm with deleterious effects on health independent of physical activity. The next phase of research is to establish dose response between sedentary behaviors and health outcomes and improve understanding of context and determinants of these behaviors. Establishing a common taxonomy of these behaviors is a necessary step in this process. The Sedentary behavior International Taxonomy project was developed to establish a classification of sedentary behaviors by use of a formal consensus process. The study follows a Delphi process in three Rounds. A preparatory stage informed the development of terms of reference documents. In Round 1, experts were asked to make statements about the taxonomy; 1) its purpose and use ; 2) the domains, categories or facets that should be consider and include; 3) the structure/architecture to arrange and link these domains and facets. In Round 2 experts will be presented with a draft taxonomy emerging from Round 1 and invited to comment and propose alterations. The taxonomy will then be finalised at the outset of this stage. Results of Round 1 are reported here. There is a general consensus that a taxonomy will help advances in research by facilitating systematic and standardised: 1) investigation and analysis; 2) reporting and communication; 3) data pooling, comparison and meta-analysis; 4) development of measurement tools; 4) data descriptions, leading to higher quality in data querying and facilitate discoveries. There is also a consensus that such a taxonomy should be flexible to accommodate diverse purposes of use, and future advances in the field and yet provide a cross-disciplinary common language. A consensual taxonomy structure emerged with nine primary facets (Purpose, Environment, Posture, Social, Measurement, Associated behavior, Status, Time, Type) and the draft structure presented here for Round 2.

Which Behavior Change Techniques May Help Waterpipe Smokers to Quit? An Expert Consensus Using a Modified Delphi Technique.

PubMed

O'Neill, Nancy; Dogar, Omara; Jawad, Mohammed; Kellar, Ian; Kanaan, Mona; Siddiqi, Kamran

2018-01-05

Waterpipe smoking is addictive and harmful. The determinants of waterpipe smoking may differ from those of cigarette smoking; therefore, behavioral approaches to support quitting may also differ between these two tobacco products. While some evidence exists on effective behavioral change techniques (BCTs) to facilitate cigarette smoking cessation, there is little research on waterpipe smoking cessation. Twenty-four experts were selected from the author lists of peer-reviewed, randomized controlled trials on waterpipe smoking cessation. They were invited to two rounds of a consensus development exercise using modified Delphi technique. Experts ranked 55 BCTs categorized further into those that promote; "awareness of harms of waterpipe smoking and advantages of quitting" (14), "preparation and planning to quit" (29), and "relapse prevention and sustaining an ex-smoker identity" (12) on their potential effectiveness. Kendall's W statistics was used to assess agreement. Fifteen experts responded in round 1 and 14 completed both rounds. A strong consensus was achieved for BCTs that help in "relapse prevention and sustaining ex-smoker identity" (w = 0.7; p < .001) and a moderate for those that promote "awareness of harms of waterpipe smoking and advantages of quitting" (w = 0.6; p < .001) and "preparation and planning to quit" (w = 0.6; p < .001). Providing information on the consequences of waterpipe smoking and its cessation, assessing readiness and ability to quit, and making people aware of the withdrawal symptoms, were the three highest-ranking BCTs. Based on expert consensus, an inventory of BCTs ordered for their potential effectiveness can be useful for health professionals offering cessation support to waterpipe smokers. Waterpipe smoking is addictive, harmful, and gaining global popularity, particularly among youth. An expert consensus on behavior change techniques, likely to be effective in supporting waterpipe smokers to quit, has practice and research implications. Smoking cessation advisors can use these techniques to counsel waterpipe smokers who wish to quit. Behavioral and public health scientists can also use these to develop and evaluate behavioral support interventions for this client group. © The Author(s) 2016. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Controversy between anesthesiologists and obstetricians on the labour ward: the Delphi method is used as a consensus-building technique.

PubMed

Nguyen-Lu, Nhathien; Downey, Kristi; Carvalho, Jose C A

2015-03-01

Obstetricians and anesthesiologists may interpret medical evidence differently, which could potentially generate conflict and compromise patient care. We sought to identify the most important controversial topics involving obstetricians and anesthesiologists on the labour ward that had the potential to affect patient outcome. We conducted a consensus-building study based on the Delphi technique. A panel of experts comprised of obstetric anesthesiologists and obstetricians responded to a series of four parallel sequential questionnaires interspersed with feedback. The first round consisted of an open questionnaire: Which topics in patient management would rouse a difference of opinion between anesthesiologists and obstetricians that may interfere with patient outcome, and why? The second round sought agreement on the topics, and the third round sought to rank the topics, and their underlying reasons, that scored at least 60% agreement. The final round allowed each discipline insight into the controversies gathered by the other discipline. Ten anesthesiologists and ten obstetricians participated in the study. Anesthesiologists identified twice as many controversial topics as the obstetricians (six vs three, respectively). The obstetricians agreed with all topics identified by the anesthesiologists, but agreed with only five of the 18 (28%) reasons to support them. Anesthesiologists agreed with all topics raised by the obstetricians, but agreed with only three of the six (50%) reasons to support them. Both the obstetricians and the anesthesiologists identified several controversial topics that may influence clinical practice on the labour ward. This information could serve as the basis to develop educational programs and strategies to improve communication between the two disciplines.

Acne severity grading: determining essential clinical components and features using a Delphi consensus.

PubMed

Tan, Jerry; Wolfe, Barat; Weiss, Jonathan; Stein-Gold, Linda; Bikowski, Joseph; Del Rosso, James; Webster, Guy F; Lucky, Anne; Thiboutot, Diane; Wilkin, Jonathan; Leyden, James; Chren, Mary-Margaret

2012-08-01

There are multiple global scales for acne severity grading but no singular standard. Our objective was to determine the essential clinical components (content items) and features (property-related items) for an acne global grading scale for use in research and clinical practice using an iterative method, the Delphi process. Ten acne experts were invited to participate in a Web-based Delphi survey comprising 3 iterative rounds of questions. In round 1, the experts identified the following clinical components (primary acne lesions, number of lesions, extent, regional involvement, secondary lesions, and patient experiences) and features (clinimetric properties, ease of use, categorization of severity based on photographs or text, and acceptance by all stakeholders). In round 2, consensus for inclusion in the scale was established for primary lesions, number, sites, and extent; as well as clinimetric properties and ease of use. In round 3, consensus for inclusion was further established for categorization and acceptance. Patient experiences were excluded and no consensus was achieved for secondary lesions. The Delphi panel consisted solely of the United States (U.S.)-based acne experts. Using an established method for achieving consensus, experts in acne vulgaris concluded that an ideal acne global grading scale would comprise the essential clinical components of primary acne lesions, their quantity, extent, and facial and extrafacial sites of involvement; with features of clinimetric properties, categorization, efficiency, and acceptance. Copyright © 2011 American Academy of Dermatology, Inc. Published by Mosby, Inc. All rights reserved.

Community Engagement in the CTSA Program: Stakeholder Responses from a National Delphi Process

PubMed Central

Seifer, Sarena D.; Stupak, Matthew; Martinez, Linda Sprague

2014-01-01

Abstract In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community‐Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. PMID:24841362

Community engagement in the CTSA program: stakeholder responses from a national Delphi process.

PubMed

Freeman, Elmer; Seifer, Sarena D; Stupak, Matthew; Martinez, Linda Sprague

2014-06-01

In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community-Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. © 2014 Wiley Periodicals, Inc.

The U. S. transportation sector in the year 2030: results of a two-part Delphi survey.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Morrison, G.; Stephens, T.S.; Univ. of California at Davis)

2011-10-11

A two-part Delphi Survey was given to transportation experts attending the Asilomar Conference on Transportation and Energy in August, 2011. The survey asked respondents about trends in the US transportation sector in 2030. Topics included: alternative vehicles, high speed rail construction, rail freight transportation, average vehicle miles traveled, truck versus passenger car shares, vehicle fuel economy, and biofuels in different modes. The survey consisted of two rounds -- both asked the same set of seven questions. In the first round, respondents were given a short introductory paragraph about the topic and asked to use their own judgment in their responses.more » In the second round, the respondents were asked the same questions, but were also given results from the first round as guidance. The survey was sponsored by Argonne National Lab (ANL), the National Renewable Energy Lab (NREL), and implemented by University of California at Davis, Institute of Transportation Studies. The survey was part of the larger Transportation Energy Futures (TEF) project run by the Department of Energy, Office of Energy Efficiency and Renewable Energy. Of the 206 invitation letters sent, 94 answered all questions in the first round (105 answered at least one question), and 23 of those answered all questions in the second round. 10 of the 23 second round responses were at a discussion section at Asilomar, while the remaining were online. Means and standard deviations of responses from Round One and Two are given in Table 1 below. One main purpose of Delphi surveys is to reduce the variance in opinions through successive rounds of questioning. As shown in Table 1, the standard deviations of 25 of the 30 individual sub-questions decreased between Round One and Round Two, but the decrease was slight in most cases.« less

An Instrument to Measure Maturity of Integrated Care: A First Validation Study

PubMed Central

2018-01-01

Introduction: Lessons captured from interviews with 12 European regions are represented in a new instrument, the B3-Maturity Model (B3-MM). B3-MM aims to assess maturity along 12 dimensions reflecting the various aspects that need to be managed in order to deliver integrated care. The objective of the study was to test the content validity of B3-MM as part of SCIROCCO (Scaling Integrated Care into Context), a European Union funded project. Methods: A literature review was conducted to compare B3-MM’s 12 dimensions and their measurement scales with existing measures and instruments that focus on assessing the development of integrated care. Subsequently, a three-round survey conducted through a Delphi study with international experts in the field of integrated care was performed to test the relevance of: 1) the dimensions, 2) the maturity indicators and 3) the assessment scale used in B3-MM. Results: The 11 articles included in the literature review confirmed all the dimensions described in the original version of B3-MM. The Delphi study rounds resulted in various phrasing amendments of indicators and assessment scale. Full agreement among the experts on the relevance of the 12 B3-MM dimensions, their indicators, and assessment scale was reached after the third Delphi round. Conclusion and discussion: The B3-MM dimensions, maturity indicators and assessment scale showed satisfactory content validity. While the B3-MM is a unique instrument based on existing knowledge and experiences of regions in integrated care, further testing is needed to explore other measurement properties of B3-MM. PMID:29588644

Developing End-of-Training Entrustable Professional Activities for Psychiatry: Results and Methodological Lessons.

PubMed

Young, John Q; Hasser, Caitlin; Hung, Erick K; Kusz, Martin; O'Sullivan, Patricia S; Stewart, Colin; Weiss, Andrea; Williams, Nancy

2018-07-01

To develop entrustable professional activities (EPAs) for psychiatry and to demonstrate an innovative, validity-enhancing methodology that may be relevant to other specialties. A national task force employed a three-stage process from May 2014 to February 2017 to develop EPAs for psychiatry. In stage 1, the task force used an iterative consensus-driven process to construct proposed EPAs. Each included a title, full description, and relevant competencies. In stage 2, the task force interviewed four nonpsychiatric experts in EPAs and further revised the EPAs. In stage 3, the task force performed a Delphi study of national experts in psychiatric education and assessment. All survey participants completed a brief training program on EPAs. Quantitative and qualitative analysis led to further modifications. Essentialness was measured on a five-point scale. EPAs were included if the content validity index was at least 0.8 and the lower end of the asymmetric confidence interval was not lower than 4.0. Stages 1 and 2 yielded 24 and 14 EPAs, respectively. In stage 3, 31 of the 39 invited experts participated in both rounds of the Delphi study. Round 1 reduced the proposed EPAs to 13. Ten EPAs met the inclusion criteria in Round 2. The final EPAs provide a strong foundation for competency-based assessment in psychiatry. Methodological features such as critique by nonpsychiatry experts, a national Delphi study with frame-of-reference training, and stringent inclusion criteria strengthen the content validity of the findings and may serve as a model for future efforts in other specialties.

Competencies for Student Leadership Development in Doctor of Pharmacy Curricula to Assist Curriculum Committees and Leadership Instructors

PubMed Central

Traynor, Andrew P.; Boyle, Cynthia J.

2013-01-01

Objective. To assist curriculum committees and leadership instructors by gathering expert opinion to define student leadership development competencies for pharmacy curricula. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define competencies for student leadership development in pharmacy curricula. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes. Round 2 grouped responses for agreement rating and comment. Round 3 allowed rating and comment on competencies not yet meeting consensus, which was prospectively set at 80%. Results. Eleven competencies attained 80% consensus or higher and were grouped into 3 areas: leadership knowledge, personal leadership commitment, and leadership skill development. Connections to contemporary leadership development literature were outlined for each competency as a means of verifying the panel’s work. Conclusions. The leadership competencies will aid students in addressing: What is leadership? Who am I as a leader? What skills and abilities do I need to be effective? The competencies will help curriculum committees and leadership instructors to focus leadership development opportunities, identify learning assessments, and define program evaluation. PMID:24371346

Competencies for student leadership development in doctor of pharmacy curricula to assist curriculum committees and leadership instructors.

PubMed

Janke, Kristin K; Traynor, Andrew P; Boyle, Cynthia J

2013-12-16

To assist curriculum committees and leadership instructors by gathering expert opinion to define student leadership development competencies for pharmacy curricula. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define competencies for student leadership development in pharmacy curricula. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes. Round 2 grouped responses for agreement rating and comment. Round 3 allowed rating and comment on competencies not yet meeting consensus, which was prospectively set at 80%. Eleven competencies attained 80% consensus or higher and were grouped into 3 areas: leadership knowledge, personal leadership commitment, and leadership skill development. Connections to contemporary leadership development literature were outlined for each competency as a means of verifying the panel's work. The leadership competencies will aid students in addressing: What is leadership? Who am I as a leader? What skills and abilities do I need to be effective? The competencies will help curriculum committees and leadership instructors to focus leadership development opportunities, identify learning assessments, and define program evaluation.

Return to play criteria after hamstring muscle injury in professional football: a Delphi consensus study.

PubMed

Zambaldi, Mattia; Beasley, Ian; Rushton, Alison

2017-08-01

Hamstring muscle injury (HMI) is the most common injury in professional football and has a high re-injury rate. Despite this, there are no validated criteria to support return to play (RTP) decisions. To use the Delphi method to reach expert consensus on RTP criteria after HMI in professional football. All professional football clubs in England (n=92) were invited to participate in a 3-round Delphi study. Round 1 requested a list of criteria used for RTP decisions after HMI. Responses were independently collated by 2 researchers under univocal definitions of RTP criteria. In round 2 participants rated their agreement for each RTP criterion on a 1-5 Likert Scale. In round 3 participants re-rated the criteria that had reached consensus in round 2. Descriptive statistics and Kendall's coefficient of concordance enabled interpretation of consensus. Participation rate was limited at 21.7% (n=20), while retention rate was high throughout the 3 rounds (90.0%, 85.0%, 90.0%). Round 1 identified 108 entries with varying definitions that were collated into a list of 14 RTP criteria. Rounds 2 and 3 identified 13 and 12 criteria reaching consensus, respectively. Five domains of RTP assessment were identified: functional performance, strength, flexibility, pain and player's confidence. The highest-rated criteria were in the functional performance domain, with particular importance given to sprint ability. This study defined a list of consensually agreed RTP criteria for HMI in professional football. Further work is now required to determine the validity of the identified criteria. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Future Directions for Business Education: A Delphi Study

ERIC Educational Resources Information Center

Kesten, Cyril A.; Lambrecht, Judith J.

2010-01-01

Purpose: The purpose of this study was to synthesize perceptions from the field about current issues and to propose future directions for the field of business education. Method: A modified three-stage Delphi study was carried out with business educators who attended national conferences and/or belonged to national professional organizations.…

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research

PubMed Central

Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

Background While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. Objective To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. Methods The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. Results 143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. Conclusions GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites. PMID:28768629

Structured reporting for fibrosing lung disease: a model shared by radiologist and pulmonologist.

PubMed

Sverzellati, Nicola; Odone, Anna; Silva, Mario; Polverosi, Roberta; Florio, Carlo; Cardinale, Luciano; Cortese, Giancarlo; Addonisio, Giancarlo; Zompatori, Maurizio; Dalpiaz, Giorgia; Piciucchi, Sara; Larici, Anna Rita

2018-04-01

To apply the Delphi exercise with iterative involvement of radiologists and pulmonologists with the aim of defining a structured reporting template for high-resolution computed tomography (HRCT) of patients with fibrosing lung disease (FLD). The writing committee selected the HRCT criteria-the Delphi items-for rating from both radiology panelists (RP) and pulmonology panelists (PP). The Delphi items were first rated by RPs as "essential", "optional", or "not relevant". The items rated "essential" by < 80% of the RP were selected for the PP rating. The format of reporting was rated by both RP and PP. A total of 42 RPs and 12 PPs participated to the survey. In both Delphi round 1 and 2, 10/27 (37.7%) items were rated "essential" by more than 80% of RP. The remaining 17/27 (63.3%) items were rated by the PP in round 3, with 2/17 items (11.7%) rated "essential" by the PP. PP proposed additional items for conclusion domain, which were rated by RPs in the fourth round. Poor consensus was observed for the format of reporting. This study provides a template for structured report of FLD that features essential items as agreed by expert thoracic radiologists and pulmonologists.

Academic Primer Series: Key Papers About Competency-Based Medical Education

PubMed Central

Cooney, Robert; Chan, Teresa M.; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-01-01

Introduction Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Methods Based on the online discussions of the 2016–2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Results Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. Conclusion We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs. PMID:28611893

Corruption and oil exploration: expert agreement about the prevention of HIV/AIDS in the Niger Delta of Nigeria

PubMed Central

Udoh, Isidore A.; Stammen, Ronald M.; Mantell, Joanne E.

2008-01-01

The Niger Delta, according to the Nigerian Ministry of Health, has a disproportionately high HIV infection rate, which is double the national average. The United Nations Development Program attributes the spiraling HIV infection rate in the region to poverty, migration and gender inequality. This paper examines two complementary suppositions: Is the high prevalence of HIV in the Niger Delta related to incompetent leadership and corruption? Is it related to the negative effects of oil exploration in the region? Currently, there is a dearth of research on the effectiveness of government programs or the role of the oil industry on the impact of AIDS in Nigeria. To address this gap, we conducted a survey with 27 internationally renowned experts from diverse disciplines using a three-round modified Delphi to formulate consensus about the impact of weak governance and oil corruption on AIDS in the Niger Delta. Results from the Delphi suggest that these factors and others have exacerbated the transmission of HIV in the region. To mitigate the impact of AIDS in the region, efforts to engage oil companies in implementing HIV prevention programs as part of their corporate environmental responsibility to the community are urgently needed. PMID:17906312

Potential Effects of the Electronic Health Record on the Small Physician Practice: A Delphi Study.

PubMed

Sines, Chad C; Griffin, Gerald R

2017-01-01

The Health Information Technology for Economic and Clinical Health (HITECH) Act established the requirement of all medical practices to have certified electronic health records (EHRs). Some primary concerns that have been delaying implementation are issues of cost, revenue impact, and the effect on the patient encounter. Small physician practices (one to four physicians) account for 46 percent of all physicians. The purpose of this qualitative study using a modified Delphi research design was to examine the potential effect of the adoption of the EHR on revenue, unintended costs or savings, and changes in the patient encounter. Fifteen expert panelists completed the three-round survey process. The expert panelists reached a consensus that EHRs would reduce the number of patients seen per day, thereby reducing their revenue. Although the panelists limited their discussion on the effect of patient outcomes, their most dominant concern was the loss of face-to-face time with the patient. They felt that the use of an EHR would reduce the focus on the patient and potentially cause physicians to miss medical conditions. The results of this study indicate an avenue for EHR vendors to develop educational avenues to teach physicians how to optimize the EHR as well as to share success stories that demonstrate improved financial impact.

The process of collecting and evaluating evidences for the development of Guidelines for the management of rheumatoid arthritis, Japan College of Rheumatology 2014: Utilization of GRADE approach.

PubMed

Kojima, Masayo; Nakayama, Takeo; Kawahito, Yutaka; Kaneko, Yuko; Kishimoto, Mitsumasa; Hirata, Shintaro; Seto, Yohei; Endo, Hirahito; Ito, Hiromu; Kojima, Toshihisa; Nishida, Keiichiro; Matsushita, Isao; Tsutani, Kiichiro; Igarashi, Ataru; Kamatani, Naoyuki; Hasegawa, Mieko; Miyasaka, Nobuyuki; Yamanaka, Hisashi

2016-01-01

To describe the process of collecting and evaluating evidence for treating rheumatoid arthritis (RA) for developing clinical practice guidelines (CPGs) for rheumatologists in Japan. The task force comprised rheumatologists, epidemiologists, health economists, and patients. First, the critical outcomes were determined according to a three-round Delphi method, and eight topics with 88 clinical questions (CQs) were formulated. A systematic review of CQs was conducted using the Cochran Database of Systematic Reviews, MEDLINE, and Japana Centra Revvo Medicina (2003-2012). A questionnaire survey and focus group interview were performed to capture the patients' values and preferences. Data from the National Health Insurance drug price list and product information provided by pharmaceutical companies were collected to evaluate drug cost and safety. The GRADE approach was used to describe the evidence quality and determine the strength of recommendations. Recommendations were developed using a modified Delphi method by a multidisciplinary panel including patients. Eight meetings and frequent e-mail communications were conducted to draft a quality assessment of evidence and recommendations. For 88 CQs, recommendation statements were determined. Using the GRADE approach, new CPGs successfully addressed important clinical issues for treating RA patients. Timely updating of recommendations should be routinely considered.

Potential Effects of the Electronic Health Record on the Small Physician Practice: A Delphi Study

PubMed Central

Sines, Chad C.; Griffin, Gerald R.

2017-01-01

The Health Information Technology for Economic and Clinical Health (HITECH) Act established the requirement of all medical practices to have certified electronic health records (EHRs). Some primary concerns that have been delaying implementation are issues of cost, revenue impact, and the effect on the patient encounter. Small physician practices (one to four physicians) account for 46 percent of all physicians. The purpose of this qualitative study using a modified Delphi research design was to examine the potential effect of the adoption of the EHR on revenue, unintended costs or savings, and changes in the patient encounter. Fifteen expert panelists completed the three-round survey process. The expert panelists reached a consensus that EHRs would reduce the number of patients seen per day, thereby reducing their revenue. Although the panelists limited their discussion on the effect of patient outcomes, their most dominant concern was the loss of face-to-face time with the patient. They felt that the use of an EHR would reduce the focus on the patient and potentially cause physicians to miss medical conditions. The results of this study indicate an avenue for EHR vendors to develop educational avenues to teach physicians how to optimize the EHR as well as to share success stories that demonstrate improved financial impact. PMID:28566989

Consensus development on the essential competencies for Iranian public health nutritionists.

PubMed

Sadeghi-Ghotbabadi, Farzaneh; Shakibazadeh, Elham; Omidvar, Nasrin; Mortazavi, Fathieh; Kolahdooz, Fariba

2015-03-01

To assess key experts' opinion regarding essential competencies required for effective public health nutrition practice within the health-care system of Iran. Qualitative study using the modified Delphi technique through an email-delivered questionnaire. Iran. Fifty-five experts were contacted through email. The inclusion criterion for the study panel was being in a relevant senior-level position in nutrition science or public health nutrition in Iran. In the first round, forty-two out of fifty-five experts responded to the questionnaire (response rate=76 %). A sixty-five-item questionnaire was designed with nine competency areas, including 'nutrition science', 'planning and implementing nutritional interventions', 'health and nutrition services', 'advocacy and communication', 'assessment and analysis', 'evaluation', 'cultural, social and political aspects', 'using technology' and 'leadership and management'. All experts who had participated in the first round completed a modified version of the questionnaire with seventy-seven items in the second round. The experts scored 'nutrition science' as the most essential competency area, while more applied areas such as 'management and leadership' were less emphasized. In both rounds, the mean difference between the opinions of the necessity of each area was 5.6 %. The Iranian experts had general agreement on most of the core competency areas of public health nutritionists. The results indicated the need for capacity building and revisions to educational curricula for public health nutritionist programmes, with more emphasis on skill-based competency development.

Defining the Medical Library Association research agenda: methodology and final results from a consensus process

PubMed Central

Eldredge, Jonathan D.; Harris, Martha R.; Ascher, Marie T.

2009-01-01

Objective: Using a group consensus methodology, the research sought to generate a list of the twelve to fifteen most important and answerable research questions in health sciences librarianship as part of a broader effort to implement the new Medical Library Association (MLA) research policy. Methods: The delphi method was used. The committee distributed a brief survey to all estimated 827 MLA leaders and 237 MLA Research Section members, requesting they submit what they considered to be the most important and answerable research questions facing the profession. The submitted questions were then subjected to 2 rounds of voting to produce a short list of top-ranked questions. Results: The survey produced 62 questions from 54 MLA leaders and MLA Research Section members, who responded from an estimated potential population of 1,064 targeted colleagues. These questions were considered by the process participants to be the most important and answerable research questions facing the profession. Through 2 rounds of voting, these 62 questions were reduced to the final 12 highest priority questions. Conclusion: The modified delphi method accomplished its desired survey and consensus goals. Future survey and consensus processes will be revised to generate more initial questions and to distill a larger number of ranked prioritized research questions. PMID:19626143

Definition of a COPD self-management intervention: International Expert Group consensus.

PubMed

Effing, Tanja W; Vercoulen, Jan H; Bourbeau, Jean; Trappenburg, Jaap; Lenferink, Anke; Cafarella, Paul; Coultas, David; Meek, Paula; van der Valk, Paul; Bischoff, Erik W M A; Bucknall, Christine; Dewan, Naresh A; Early, Frances; Fan, Vincent; Frith, Peter; Janssen, Daisy J A; Mitchell, Katy; Morgan, Mike; Nici, Linda; Patel, Irem; Walters, Haydn; Rice, Kathryn L; Singh, Sally; Zuwallack, Richard; Benzo, Roberto; Goldstein, Roger; Partridge, Martyn R; van der Palen, Job

2016-07-01

There is an urgent need for consensus on what defines a chronic obstructive pulmonary disease (COPD) self-management intervention. We aimed to obtain consensus regarding the conceptual definition of a COPD self-management intervention by engaging an international panel of COPD self-management experts using Delphi technique features and an additional group meeting.In each consensus round the experts were asked to provide feedback on the proposed definition and to score their level of agreement (1=totally disagree; 5=totally agree). The information provided was used to modify the definition for the next consensus round. Thematic analysis was used for free text responses and descriptive statistics were used for agreement scores.In total, 28 experts participated. The consensus round response rate varied randomly over the five rounds (ranging from 48% (n=13) to 85% (n=23)), and mean definition agreement scores increased from 3.8 (round 1) to 4.8 (round 5) with an increasing percentage of experts allocating the highest score of 5 (round 1: 14% (n=3); round 5: 83% (n=19)).In this study we reached consensus regarding a conceptual definition of what should be a COPD self-management intervention, clarifying the requisites for such an intervention. Operationalisation of this conceptual definition in the near future will be an essential next step. The content of this work is not subject to copyright. Design and branding are copyright ©ERS 2016.

Chiropractic Integrated Care Pathway for Low Back Pain in Veterans: Results of a Delphi Consensus Process.

PubMed

Lisi, Anthony J; Salsbury, Stacie A; Hawk, Cheryl; Vining, Robert D; Wallace, Robert B; Branson, Richard; Long, Cynthia R; Burgo-Black, A Lucille; Goertz, Christine M

2018-02-01

The purpose of this study was to develop an integrated care pathway for doctors of chiropractic, primary care providers, and mental health professionals who manage veterans with low back pain, with or without mental health comorbidity, within Department of Veterans Affairs health care facilities. The research method used was a consensus process. A multidisciplinary investigative team reviewed clinical guidelines and Veterans Affairs pain and mental health initiatives to develop seed statements and care algorithms to guide chiropractic management and collaborative care of veterans with low back pain. A 5-member advisory committee approved initial recommendations. Veterans Affairs-based panelists (n = 58) evaluated the pathway via e-mail using a modified RAND/UCLA methodology. Consensus was defined as agreement by 80% of panelists. The modified Delphi process was conducted in July to December 2016. Most (93%) seed statements achieved consensus during the first round, with all statements reaching consensus after 2 rounds. The final care pathway addressed the topics of informed consent, clinical evaluation including history and examination, screening for red flags, documentation, diagnostic imaging, patient-reported outcomes, adverse event reporting, chiropractic treatment frequency and duration standards, tailored approaches to chiropractic care in veteran populations, and clinical presentation of common mental health conditions. Care algorithms outlined chiropractic case management and interprofessional collaboration and referrals between doctors of chiropractic and primary care and mental health providers. This study offers an integrative care pathway that includes chiropractic care for veterans with low back pain. Copyright © 2018. Published by Elsevier Inc.

Health Professionals' Perceptions of Sexual Assault Management: A Delphi Study

ERIC Educational Resources Information Center

Jancey, Jonine; Meuleners, Lynn; Phillips, Maureen

2011-01-01

Objective: To explore health professionals' perceptions of sexual assault management practices and identify issues related to these practices across Western Australia (WA). Design: A two-round electronic Delphi study was undertaken with health professionals (medical doctors, registered nurses, social workers and managers). Setting: Healthcare…

Quality indicators for in-hospital geriatric co-management programmes: a systematic literature review and international Delphi study.

PubMed

Van Grootven, Bastiaan; McNicoll, Lynn; Mendelson, Daniel A; Friedman, Susan M; Fagard, Katleen; Milisen, Koen; Flamaing, Johan; Deschodt, Mieke

2018-03-16

To find consensus on appropriate and feasible structure, process and outcome indicators for the evaluation of in-hospital geriatric co-management programmes. An international two-round Delphi study based on a systematic literature review (searching databases, reference lists, prospective citations and trial registers). Western Europe and the USA. Thirty-three people with at least 2 years of clinical experience in geriatric co-management were recruited. Twenty-eight experts (16 from the USA and 12 from Europe) participated in both Delphi rounds (85% response rate). Participants rated the indicators on a nine-point scale for their (1) appropriateness and (2) feasibility to use the indicator for the evaluation of geriatric co-management programmes. Indicators were considered appropriate and feasible based on a median score of seven or higher. Consensus was based on the level of agreement using the RAND/UCLA Appropriateness Method. In the first round containing 37 indicators, there was consensus on 14 indicators. In the second round containing 44 indicators, there was consensus on 31 indicators (structure=8, process=7, outcome=16). Experts indicated that co-management should start within 24 hours of hospital admission using defined criteria for selecting appropriate patients. Programmes should focus on the prevention and management of geriatric syndromes and complications. Key areas for comprehensive geriatric assessment included cognition/delirium, functionality/mobility, falls, pain, medication and pressure ulcers. Key outcomes for evaluating the programme included length of stay, time to surgery and the incidence of complications. The indicators can be used to assess the performance of geriatric co-management programmes and identify areas for improvement. Furthermore, the indicators can be used to monitor the implementation and effect of these programmes. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A Delphi study to develop practical diagnostic guidelines for visual stress (pattern-related visual stress).

PubMed

Evans, Bruce J W; Allen, Peter M; Wilkins, Arnold J

Visual stress (VS) is characterised by symptoms of visual perceptual distortions and eyestrain when viewing text, symptoms that are alleviated by individually prescribed coloured filters. A recent review supports the existence of VS and its treatment, but noted that controversy remains, in part due to inconsistencies in the diagnosis of the condition. The present paper reviews the diagnostic criteria for VS in the literature and reports a Delphi analysis of the criteria currently used in clinical practice. Twenty-six eyecare practitioners were invited to participate in a Delphi study. They were selected because they were frequent prescribers of precision tinted lenses. In the first round they were sent a list of the indicators for which there is literature to suggest a relevance in the diagnosis of VS. The practitioners were invited to rank the indicators and add any additional criteria they use in diagnosis. In the second round a revised list was circulated, including items added from the responses in the first round. The respondents included optometrists, orthoptists and opticians. In the first round the response rate was 85%. Ninety-one percent of those who participated in the first round also responded in the second round. Strong indicators in the second round included the symptom of words moving when reading, voluntary use of an overlay for a prolonged period, improved performance of ≥15% with an overlay on the Wilkins Rate of Reading test, and an abnormally high score on the Pattern Glare Test. The strongest diagnostic criteria are combined in a diagnostic tool. This is proposed as a guide for clinical practice and further research. Copyright © 2016 Spanish General Council of Optometry. Published by Elsevier España, S.L.U. All rights reserved.

Development of key performance indicators to evaluate centralized intake for patients with osteoarthritis and rheumatoid arthritis.

PubMed

Barber, Claire E; Patel, Jatin N; Woodhouse, Linda; Smith, Christopher; Weiss, Stephen; Homik, Joanne; LeClercq, Sharon; Mosher, Dianne; Christiansen, Tanya; Howden, Jane Squire; Wasylak, Tracy; Greenwood-Lee, James; Emrick, Andrea; Suter, Esther; Kathol, Barb; Khodyakov, Dmitry; Grant, Sean; Campbell-Scherer, Denise; Phillips, Leah; Hendricks, Jennifer; Marshall, Deborah A

2015-11-14

Centralized intake is integral to healthcare systems to support timely access to appropriate health services. The aim of this study was to develop key performance indicators (KPIs) to evaluate centralized intake systems for patients with osteoarthritis (OA) and rheumatoid arthritis (RA). Phase 1 involved stakeholder meetings including healthcare providers, managers, researchers and patients to obtain input on candidate KPIs, aligned along six quality dimensions: appropriateness, accessibility, acceptability, efficiency, effectiveness, and safety. Phase 2 involved literature reviews to ensure KPIs were based on best practices and harmonized with existing measures. Phase 3 involved a three-round, online modified Delphi panel to finalize the KPIs. The panel consisted of two rounds of rating and a round of online and in-person discussions. KPIs rated as valid and important (≥7 on a 9-point Likert scale) were included in the final set. Twenty-five KPIs identified and substantiated during Phases 1 and 2 were submitted to 27 panellists including healthcare providers, managers, researchers, and patients in Phase 3. After the in-person meeting, three KPIs were removed and six were suggested. The final set includes 9 OA KPIs, 10 RA KPIs and 9 relating to centralized intake processes for both conditions. All 28 KPIs were rated as valid and important. Arthritis stakeholders have proposed 28 KPIs that should be used in quality improvement efforts when evaluating centralized intake for OA and RA. The KPIs measure five of the six dimensions of quality and are relevant to patients, practitioners and health systems.

Classification of drugs with different risk profiles.

PubMed

Saedder, Eva Aggerholm; Brock, Birgitte; Nielsen, Lars Peter; Bonnerup, Dorthe Krogsgaard; Lisby, Marianne

2015-08-01

A risk stratification approach is needed to identify patients at high risk of medication errors and a resulting high need of medication review. The aim of this study was to perform risk stratification (distinguishing between low-risk, medium-risk and high-risk drugs) for drugs found to cause serious adverse reactions due to medication errors. The study employed a modified Delphi technique. Drugs from a systematic literature search were included into two rounds of a Delphi process. A panel of experts was asked to evaluate each identified drug's potential for harm and for clinically relevant drug-drug interactions on a scale from 1 (low risk) to 9 (high risk). A total of 36 experts were appointed to serve on the panel. Consensus was reached for 29/57 (51%) drugs or drug classes that cause harm, and for 32/57 (56%) of the drugs or drug classes that cause interactions. For the remaining drugs, a decision was made based on the median score. Two lists, one stating the drugs' potential for causing harm and the other stating clinically relevant drug-drug interactions, were stratified into low-risk, medium-risk and high-risk drugs. Based on a modified Delphi technique, we created two lists of drugs stratified into a low-risk, a medium-risk and a high-risk group of clinically relevant interactions or risk of harm to patients. The lists could be incorporated into a risk-scoring tool that stratifies the performance of medication reviews according to patients' risk of experiencing adverse reactions. none. not relevant.

Identifying content for simulation-based curricula in urology: a national needs assessment.

PubMed

Nayahangan, Leizl Joy; Bølling Hansen, Rikke; Gilboe Lindorff-Larsen, Karen; Paltved, Charlotte; Nielsen, Bjørn Ulrik; Konge, Lars

2017-12-01

Simulation-based training is well recognized in the transforming field of urological surgery; however, integration into the curriculum is often unstructured. Development of simulation-based curricula should follow a stepwise approach starting with a needs assessment. This study aimed to identify technical procedures in urology that should be included in a simulation-based curriculum for residency training. A national needs assessment was performed using the Delphi method involving 56 experts with significant roles in the education of urologists. Round 1 identified technical procedures that newly qualified urologists should perform. Round 2 included a survey using an established needs assessment formula to explore: the frequency of procedures; the number of physicians who should be able to perform the procedure; the risk and/or discomfort to patients when a procedure is performed by an inexperienced physician; and the feasibility of simulation training. Round 3 involved elimination and reranking of procedures according to priority. The response rates for the three Delphi rounds were 70%, 55% and 67%, respectively. The 34 procedures identified in Round 1 were reduced to a final prioritized list of 18 technical procedures for simulation-based training. The five procedures that reached the highest prioritization were cystoscopy, transrectal ultrasound-guided biopsy of the prostate, placement of ureteral stent, insertion of urethral and suprapubic catheter, and transurethral resection of the bladder. The prioritized list of technical procedures in urology that were identified as highly suitable for simulation can be used as an aid in the planning and development of simulation-based training programs.

Assessment of chronic post-surgical pain after knee replacement: development of a core outcome set.

PubMed

Wylde, V; MacKichan, F; Bruce, J; Gooberman-Hill, R

2015-05-01

Approximately 20% of patients experience chronic post-surgical pain (CPSP) after total knee replacement (TKR). There is scope to improve assessment of CPSP after TKR, and this study aimed to develop a core outcome set. Eighty patients and 43 clinicians were recruited into a three-round modified Delphi study. In Round 1, participants were presented with 56 pain features identified from a systematic review, structured interviews with patients and focus groups with clinicians. Participants assigned importance ratings, using a 1-9 scale, to individual pain features; those features rated as most important were retained in subsequent rounds. Consensus that a pain feature should be included in the core outcome set was defined as the feature having a rating of 7-9 by ≥70% of both panels (patients and clinicians) and 1-3 by ≤15% of both panels or rated as 7-9 by ≥90% of one panel. Round 1 was completed by 71 patients and 39 clinicians, and Round 3 by 62 patients and 33 clinicians. The final consensus was that 33 pain features were important. These were grouped into an 8-item core outcome set comprising: pain intensity, pain interference with daily living, pain and physical functioning, temporal aspects of pain, pain description, emotional aspects of pain, use of pain medication, and improvement and satisfaction with pain relief. This core outcome set serves to guide assessment of CPSP after TKR. Consistency in assessment can promote standardized reporting and facilitate comparability between studies that address a common but understudied type of CPSP. © 2014 The Authors. European Journal of Pain published by John Wiley & Sons Ltd on behalf of European Pain Federation - EFIC®.

Pharmacist provision of primary health care: a modified Delphi validation of pharmacists' competencies.

PubMed

Kennie-Kaulbach, Natalie; Farrell, Barbara; Ward, Natalie; Johnston, Sharon; Gubbels, Ashley; Eguale, Tewodros; Dolovich, Lisa; Jorgenson, Derek; Waite, Nancy; Winslade, Nancy

2012-03-28

Pharmacists have expanded their roles and responsibilities as a result of primary health care reform. There is currently no consensus on the core competencies for pharmacists working in these evolving practices. The aim of this study was to develop and validate competencies for pharmacists' effective performance in these roles, and in so doing, document the perceived contribution of pharmacists providing collaborative primary health care services. Using a modified Delphi process including assessing perception of the frequency and criticality of performing tasks, we validated competencies important to primary health care pharmacists practising across Canada. Ten key informants contributed to competency drafting; thirty-three expert pharmacists replied to a second round survey. The final primary health care pharmacist competencies consisted of 34 elements and 153 sub-elements organized in seven CanMeds-based domains. Highest importance rankings were allocated to the domains of care provider and professional, followed by communicator and collaborator, with the lower importance rankings relatively equally distributed across the manager, advocate and scholar domains. Expert pharmacists working in primary health care estimated their most important responsibilities to be related to direct patient care. Competencies that underlie and are required for successful fulfillment of these patient care responsibilities, such as those related to communication, collaboration and professionalism were also highly ranked. These ranked competencies can be used to help pharmacists understand their potential roles in these evolving practices, to help other health care professionals learn about pharmacists' contributions to primary health care, to establish standards and performance indicators, and to prioritize supports and education to maximize effectiveness in this role.

Pharmacist provision of primary health care: a modified Delphi validation of pharmacists' competencies

PubMed Central

2012-01-01

Background Pharmacists have expanded their roles and responsibilities as a result of primary health care reform. There is currently no consensus on the core competencies for pharmacists working in these evolving practices. The aim of this study was to develop and validate competencies for pharmacists' effective performance in these roles, and in so doing, document the perceived contribution of pharmacists providing collaborative primary health care services. Methods Using a modified Delphi process including assessing perception of the frequency and criticality of performing tasks, we validated competencies important to primary health care pharmacists practising across Canada. Results Ten key informants contributed to competency drafting; thirty-three expert pharmacists replied to a second round survey. The final primary health care pharmacist competencies consisted of 34 elements and 153 sub-elements organized in seven CanMeds-based domains. Highest importance rankings were allocated to the domains of care provider and professional, followed by communicator and collaborator, with the lower importance rankings relatively equally distributed across the manager, advocate and scholar domains. Conclusions Expert pharmacists working in primary health care estimated their most important responsibilities to be related to direct patient care. Competencies that underlie and are required for successful fulfillment of these patient care responsibilities, such as those related to communication, collaboration and professionalism were also highly ranked. These ranked competencies can be used to help pharmacists understand their potential roles in these evolving practices, to help other health care professionals learn about pharmacists' contributions to primary health care, to establish standards and performance indicators, and to prioritize supports and education to maximize effectiveness in this role. PMID:22455482

Identifying Ethical Issues in Mental Health Research with Minors Adolescents: Results of a Delphi Study

PubMed Central

Hiriscau, Elisabeta Ioana; Stingelin-Giles, Nicola; Wasserman, Danuta; Reiter-Theil, Stella

2016-01-01

Research with minors, especially for preventive purposes, e.g., suicide prevention, investigating risk or self-destructive behaviors such as deviance, drug abuse, or suicidal behavior, is ethically sensitive. We present a Delphi study exploring the ethical implications of the needs formulated by researchers in an international pre-conference who would benefit from ethics support and guidance in conducting Mental Health Research with minors. The resulting List of Ethical Issues (LEI) was submitted to a 2-rounds Delphi process via the Internet, including 34 multidisciplinary experts. In the first round, the experts reviewed the LEI and completed a questionnaire. Results from this round were analyzed and grouped in nine categories comprising 40 items. In the second round, the experts had to agree/disagree with the needs expressed in the LEI leading to a final list of 25 ethical issues considered relevant for Mental Health Research with minors such as: confidentiality of the sensitive data, competence for consenting alone and risk of harm and stigma related to the methodology used in research. It was shown that studies like SEYLE (Saving and Empowering Young Lives in Europe) trigger among researchers wishes to obtain specific recommendations helping to comply with standards for good practice in conducting research with minors. PMID:27187425

Identifying Ethical Issues in Mental Health Research with Minors Adolescents: Results of a Delphi Study.

PubMed

Hiriscau, Elisabeta Ioana; Stingelin-Giles, Nicola; Wasserman, Danuta; Reiter-Theil, Stella

2016-05-11

Research with minors, especially for preventive purposes, e.g., suicide prevention, investigating risk or self-destructive behaviors such as deviance, drug abuse, or suicidal behavior, is ethically sensitive. We present a Delphi study exploring the ethical implications of the needs formulated by researchers in an international pre-conference who would benefit from ethics support and guidance in conducting Mental Health Research with minors. The resulting List of Ethical Issues (LEI) was submitted to a 2-rounds Delphi process via the Internet, including 34 multidisciplinary experts. In the first round, the experts reviewed the LEI and completed a questionnaire. Results from this round were analyzed and grouped in nine categories comprising 40 items. In the second round, the experts had to agree/disagree with the needs expressed in the LEI leading to a final list of 25 ethical issues considered relevant for Mental Health Research with minors such as: confidentiality of the sensitive data, competence for consenting alone and risk of harm and stigma related to the methodology used in research. It was shown that studies like SEYLE (Saving and Empowering Young Lives in Europe) trigger among researchers wishes to obtain specific recommendations helping to comply with standards for good practice in conducting research with minors.

Barriers and facilitators to providing undergraduate physiotherapy clinical education in the primary care setting: a three-round Delphi study.

PubMed

McMahon, S; Cusack, T; O'Donoghue, G

2014-03-01

With the global shift in health care from secondary to primary care, employment opportunities for newly qualified physiotherapists are likely to be in the primary care setting. However, to date, undergraduate physiotherapy clinical education has been centred around secondary care, focusing on acute services in large teaching hospitals. For contemporary physiotherapists to become effective first-contact primary care providers, they need to be exposed to the primary care environment during their undergraduate education. To explore the concept and identify perceived barriers and facilitators to providing physiotherapy undergraduate clinical placements in the primary healthcare setting A three-round Delphi survey was used. Participants were asked to answer open-ended questions with regard to: (i) student preparation for and (ii) provision of primary care placements (Round 1). Content analysis was employed to identify key themes. These themes generated statements for Round 2. In Round 2, participants were asked to rate their level of agreement/disagreement with the generated statements. In Round 3, a final rating process was conducted. Level of consensus was established as ≥70% agreement, with an interquartile range of ≤1. One hundred and ninety-eight primary care physiotherapy staff. Barriers identified included shortage of resources (e.g. staff) and a lack of tradition; in other words, students are not traditionally educated in the primary care setting. Response rates were 60% (120/198), 70% (84/120) and 76% (64/84) for Rounds 1, 2 and 3, respectively. All seven key facilitators identified reached consensus. They included additional support for staff taking students and motivated students. This study revealed that there is support for the provision of physiotherapy clinical education in the primary care setting. Through careful consideration with clear planning and collaboration with all stakeholders, it may be possible to convert the main barriers identified into facilitators to ensure that there will be an adequately prepared physiotherapy work force in the future. Copyright © 2013 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

A Delphi Study of Agriculture Teacher Perceptions of Problems in Student Retention.

ERIC Educational Resources Information Center

Dyer, James E.; Breja, Lisa M.; Ball, Anna L.

2003-01-01

A four-round Delphi study of secondary agriculture teachers (17, 17, 22, and 21 responses) identified and rated student retention problems. Consensus was reached on these items: scheduling difficulties, lack of counselor support, image, increased graduation requirements, college entrance requirements, competition from other activities, block…

Single-Parent Nontraditional Students: Faculty Support within the Classroom Environment

ERIC Educational Resources Information Center

Allen-Drewry, Lisa M.

2017-01-01

Purpose: The purpose of this Delphi study was to explore single-parent nontraditional student experiences within nontraditional university classroom environments and to determine methods for providing better support within the classroom setting. Methodology: The Delphi technique was conducted through 3 survey rounds to explore ways professors and…

Identifying the features of an exercise addiction: A Delphi study

PubMed Central

Macfarlane, Lucy; Owens, Glynn; Cruz, Borja del Pozo

2016-01-01

Objectives There remains limited consensus regarding the definition and conceptual basis of exercise addiction. An understanding of the factors motivating maintenance of addictive exercise behavior is important for appropriately targeting intervention. The aims of this study were twofold: first, to establish consensus on features of an exercise addiction using Delphi methodology and second, to identify whether these features are congruous with a conceptual model of exercise addiction adapted from the Work Craving Model. Methods A three-round Delphi process explored the views of participants regarding the features of an exercise addiction. The participants were selected from sport and exercise relevant domains, including physicians, physiotherapists, coaches, trainers, and athletes. Suggestions meeting consensus were considered with regard to the proposed conceptual model. Results and discussion Sixty-three items reached consensus. There was concordance of opinion that exercising excessively is an addiction, and therefore it was appropriate to consider the suggestions in light of the addiction-based conceptual model. Statements reaching consensus were consistent with all three components of the model: learned (negative perfectionism), behavioral (obsessive–compulsive drive), and hedonic (self-worth compensation and reduction of negative affect and withdrawal). Conclusions Delphi methodology allowed consensus to be reached regarding the features of an exercise addiction, and these features were consistent with our hypothesized conceptual model of exercise addiction. This study is the first to have applied Delphi methodology to the exercise addiction field, and therefore introduces a novel approach to exercise addiction research that can be used as a template to stimulate future examination using this technique. PMID:27554504

Consensus on the criteria needed for creating a rare-disease patient registry. A Delphi study.

PubMed

Cavero-Carbonell, Clara; Gras-Colomer, Elena; Guaita-Calatrava, Rosana; López-Briones, Carmen; Amorós, Rubén; Abaitua, Ignacio; Posada, Manuel; Zurriaga, Oscar

2016-06-01

Patient registries (PRs) are important tools for public-health surveillance and rare-disease research. The purpose of this study is to identify the most important criteria for the creation of a rare-disease PR that could be used by public-health authorities to develop health policies. A consensus-development Delphi study was used, with participants selected for their expertize in rare diseases and registries. Participants were asked to complete a questionnaire on the most important criteria for creating PRs. Three rounds were performed. Agreement was reached on half the questions in the first round and on 89% of questions in the final round, with a total expert participation rate of around 60% by the final stage. This study made it possible to reach a broader consensus starting from experts' initial assessment of the features that should be considered for the creation of a rare-disease PR. The consensus method used made it possible to define the characteristics of a PR based on expert opinion within a rare-disease framework. This study may serve as a guide for helping other researchers plan and build a rare-disease PR. © The Author 2015. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A Delphi study on environmental factors that impact work and social life participation of individuals with multiple sclerosis in Austria and Switzerland.

PubMed

Prodinger, Birgit; Weise, Andrea P; Shaw, Lynn; Stamm, Tanja A

2010-01-01

This study aimed to gain knowledge about environmental factors (EFs) that impact work and social life participation of people with multiple sclerosis (MS) in Austria and Switzerland to extend the knowledge of participation and to identify key areas for measuring participation. A three-round Delphi study was conducted defining patients as experts. In the 1st round, qualitative data was gathered through questionnaires, analyzed with content analysis, and factors were assigned to EFs as classified in the ICF. In the 2nd and 3rd round, experts judged EFs according to its relevance to obtain consensus (cut-off 75%). Categories were ranked on a scale from mostly important to important. One hundred and twelve Austrian and 109 Swiss experts were recruited. The content analysis revealed 768 EFs. The study resulted in a list of 176 consensus factors for Austria and 177 Switzerland. Five categories revealed to be highly important, 12 moderately important, 6 fairly important, and 10 important. This study indicates that participation in work or social life is influenced by physical, social, attitudinal, and policy factors. Consensus factors afford insights into areas for consideration in the development of participation outcome measurements and support a comprehensive and inclusive rehabilitation approach.

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses 1

PubMed Central

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; de Domenico, Edvane Birelo Lopes

2016-01-01

Abstract Objective: to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. Method: methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. Results: the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. Conclusion: the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. PMID:27305184

Allied health clinicians using translational research in action to develop a reliable stroke audit tool.

PubMed

Abery, Philip; Kuys, Suzanne; Lynch, Mary; Low Choy, Nancy

2018-05-23

To design and establish reliability of a local stroke audit tool by engaging allied health clinicians within a privately funded hospital. Design: Two-stage study involving a modified Delphi process to inform stroke audit tool development and inter-tester reliability. Allied health clinicians. A modified Delphi process to select stroke guideline recommendations for inclusion in the audit tool. Reliability study: 1 allied health representative from each discipline audited 10 clinical records with sequential admissions to acute and rehabilitation services. Recommendations were admitted to the audit tool when 70% agreement was reached, with 50% set as the reserve agreement. Inter-tester reliability was determined using intra-class correlation coefficients (ICCs) across 10 clinical records. Twenty-two participants (92% female, 50% physiotherapists, 17% occupational therapists) completed the modified Delphi process. Across 6 voting rounds, 8 recommendations reached 70% agreement and 2 reached 50% agreement. Two recommendations (nutrition/hydration; goal setting) were added to ensure representation for all disciplines. Substantial consistency across raters was established for the audit tool applied in acute stroke (ICC .71; range .48 to .90) and rehabilitation (ICC.78; range .60 to .93) services. Allied health clinicians within a privately funded hospital generally agreed in an audit process to develop a reliable stroke audit tool. Allied health clinicians agreed on stroke guideline recommendations to inform a stroke audit tool. The stroke audit tool demonstrated substantial consistency supporting future use for service development. This process, which engages local clinicians, could be adopted by other facilities to design reliable audit tools to identify local service gaps to inform changes to clinical practice. © 2018 John Wiley & Sons, Ltd.

Identification of competencies for patient education in physiotherapy using a Delphi approach.

PubMed

Forbes, Roma; Mandrusiak, Allison; Smith, Michelle; Russell, Trevor

2018-06-01

Patient education is a critical part of physiotherapy practice however an empirically derived set of competencies for its use does not exist. This study aimed to generate a set of competencies for patient education in physiotherapy using a consensus approach. A Delphi study with two rounds using a panel of expert physiotherapists within Australia was undertaken. In the first round, the panel of 12 specialist physiotherapists identified competencies required for patient education in the physiotherapy setting. Framework analysis was applied to develop a set of competencies that were assessed in the second round where ≥80% agreement of importance from the panel indicated consensus. Response rates of specialist physiotherapists agreeing to participate were 67% for the first round and 100% for the second round. Analysis following the first round produced 25 competencies. The second round resulted in agreement on a final set of 22 competencies. This study developed a concise list of competencies for patient education with a high level of expert agreement. By identifying the key competencies in this area, there is potential to benchmark patient education training and assessment of physiotherapists for improved educational and professional outcomes. Copyright © 2017 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Latin American Consensus for Pediatric Cardiopulmonary Resuscitation 2017: Latin American Pediatric Critical Care Society Pediatric Cardiopulmonary Resuscitation Committee.

PubMed

López-Herce, Jesús; Almonte, Enma; Alvarado, Manuel; Bogado, Norma Beatriz; Cyunel, Mariana; Escalante, Raffo; Finardi, Christiane; Guzmán, Gustavo; Jaramillo-Bustamante, Juan C; Madrid, Claudia C; Matamoros, Martha; Moya, Luis Augusto; Obando, Grania; Reboredo, Gaspar; López, Lissette R; Scheu, Christian; Valenzuela, Alejandro; Yerovi, Rocío; Yock-Corrales, Adriana

2018-03-01

To develop a Latin American Consensus about Pediatric Cardiopulmonary Resuscitation. To clarify, reinforce, and adapt some specific recommendations for pediatric patients and to stimulate the implementation of these recommendations in clinical practice. Expert consensus recommendations with Delphi methodology. Latin American countries. Experts in pediatric cardiopulmonary resuscitation from 19 Latin American countries. Delphi methodology for expert consensus. The goal was to reach consensus with all the participating experts for every recommendation. An agreement of at least 80% of the participating experts had to exist in order to deliver a recommendation. Two Delphi voting rounds were sent out electronically. The experts were asked to score between 1 and 9 their level of agreement for each recommendation. The score was then classified into three groups: strong agreement (score 7-9), moderate agreement (score 4-6), and disagreement (score 1-3). Nineteen experts from 19 countries participated in both voting rounds and in the whole process of drafting the recommendations. Sixteen recommendations about organization of cardiopulmonary resuscitation, prevention, basic resuscitation, advanced resuscitation, and postresuscitation measures were approved. Ten of them had a consensus of 100%. Four of them were agreed by all the participants except one (94.7% consensus). One recommendation was agreed by all except two experts (89.4%), and finally, one was agreed by all except three experts (84.2%). All the recommendations reached a level of agreement. This consensus adapts 16 international recommendations to Latin America in order to improve the practice of cardiopulmonary resuscitation in children. Studies should be conducted to analyze the effectiveness of the implementation of these recommendations.

Surviving critical illness: what is next? An expert consensus statement on physical rehabilitation after hospital discharge.

PubMed

Major, M E; Kwakman, R; Kho, M E; Connolly, B; McWilliams, D; Denehy, L; Hanekom, S; Patman, S; Gosselink, R; Jones, C; Nollet, F; Needham, D M; Engelbert, R H H; van der Schaaf, M

2016-10-29

The study objective was to obtain consensus on physical therapy (PT) in the rehabilitation of critical illness survivors after hospital discharge. Research questions were: what are PT goals, what are recommended measurement tools, and what constitutes an optimal PT intervention for survivors of critical illness? A Delphi consensus study was conducted. Panelists were included based on relevant fields of expertise, years of clinical experience, and publication record. A literature review determined five themes, forming the basis for Delphi round one, which was aimed at generating ideas. Statements were drafted and ranked on a 5-point Likert scale in two additional rounds with the objective to reach consensus. Results were expressed as median and semi-interquartile range, with the consensus threshold set at ≤0.5. Ten internationally established researchers and clinicians participated in this Delphi panel, with a response rate of 80 %, 100 %, and 100 % across three rounds. Consensus was reached on 88.5 % of the statements, resulting in a framework for PT after hospital discharge. Essential handover information should include information on 15 parameters. A core set of outcomes should test exercise capacity, skeletal muscle strength, function in activities of daily living, mobility, quality of life, and pain. PT interventions should include functional exercises, circuit and endurance training, strengthening exercises for limb and respiratory muscles, education on recovery, and a nutritional component. Screening tools to identify impairments in other health domains and referral to specialists are proposed. A consensus-based framework for optimal PT after hospital discharge is proposed. Future research should focus on feasibility testing of this framework, developing risk stratification tools and validating core outcome measures for ICU survivors.

Guideline for Reporting Interventions on Spinal Manipulative Therapy: Consensus on Interventions Reporting Criteria List for Spinal Manipulative Therapy (CIRCLe SMT).

PubMed

Groeneweg, Ruud; Rubinstein, Sidney M; Oostendorp, Rob A B; Ostelo, Raymond W J G; van Tulder, Maurits W

2017-02-01

The aim of the Consensus on Interventions Reporting Criteria List for Spinal Manipulative Therapy (CIRCLe SMT) study was to develop a criteria list for reporting spinal manipulative therapy (SMT). A Delphi procedure was conducted from September 2011 to April 2013 and consisted of international experts in the field of SMT. The authors formed a steering committee and invited participants, selected initial items, structured the comments of the participants after each Delphi round, and formulated the feedback. To ensure content validity, a large number of international experts from different SMT-related disciplines were invited to participate. A workshop was organized following the consensus phase, and it was used to discuss and refine the wording of the items. In total, 123 experts from 18 countries participated. These experts included clinicians (70%), researchers (93%), and academics working in the area of SMT (27%), as well as journal editors (14%). (Note: The total is more than 100% because most participants reported 2 jobs.) Three Delphi rounds were necessary to reach a consensus. The criteria list comprised 24 items under 5 domains, including (1) rationale of the therapy, (2) description of the intervention, (3) SMT techniques, (4) additional intervention/techniques, and (5) quantitative data. A valid criteria list was constructed with the aim of promoting consistency in reporting SMT intervention in scientific publications. Copyright © 2016. Published by Elsevier Inc.

Development of community based curriculum on ophthalmology for under graduate medical course in Bangladesh.

PubMed

Khan, A K; Hussain, A Z M I

2012-08-01

The curriculum represents the expression of educational ideas in practice. Ophthalmic education is the corner stone to improve eye care globally. Curriculum needs continuous modification varying in different geographic locations. Though 90% of common conditions are either preventable or curable but emphasis on the common conditions is inadequate. This is a stepwise descriptive study aiming to develop a community based ophthalmology curriculum for undergraduate medical course in Bangladesh conducted during March 2007 to February 2008 at UniSA School of Public Health and Life Sciences, University of South Asia, Banani, Dhaka. Delphi technique, a modified qualitative method was used to accumulate data and reaching a consensus opinion for developing the curriculum. Study approach includes two iterative rounds and finally a workshop. Iteration of round-I was "What are the eye diseases with overall knowledge of their management one MBBS physician should acquire"; followed by a list of eye diseases and topics for expert opinion. The response was collated. Iteration round-II was "How much a MBBS student should have percentage of knowledge, attitude and skills on each topic while being taught". The response was collated and presented to panel of expert ophthalmologists for discussion and validation. In the round-I Delphi, 400 (62%) out to total 641 ophthalmologist were randomly selected dividing in categories (62% in each) of Professor-22, Associate Professor-12, Assistant Professor-26, Consultant-27, ophthalmologists working in NGO-56 and ophthalmologists in private sector-257. Sixty (15%) responded with opinion. In the round-II, 200 (31%) including 60 of round-I, selected randomly but proportionately as before. Forty five (22.5%) responded with opinion. Result collated. The results and opinion of respondents were presented at a workshop attended by 24 (80%), out of 30 invited expert ophthalmic specialists for discussion, criticism, opinion, addition, modification and finally for validation. On the basis of the opinion of the respondents, reviewing literature, analyzing the ocular disease pattern in Bangladesh and also analyzing the present ophthalmology curriculum, a community and need based ophthalmology curriculum for undergraduate medical course in Bangladesh was developed. This research would help developing community and need based ophthalmology curriculum for undergraduate medical course in Bangladesh.

Distribution network connection pricing framework and methodology: identification of areas of improvement for Sarawak Energy Berhad Connection Charges Guidelines through modified delphi method

NASA Astrophysics Data System (ADS)

Tan, J. K.; Abas, N.

2017-07-01

Complaints on issues and matters related to connection charges have been very common for electricity supply utility companies around the world including Sarawak Energy Berhad. In order to identify the areas that can be improved, a mixed method of exploratory research involving qualitative and quantitative methods have been designed and undertaken rather than a single method of survey. This will ensure a more comprehensive and detailed understanding of the issues from various target groups. The method is designed under three phases, employing Modified Delphi Technique for phase 1 through a series of stake holder engagements, online and offline survey questionnaires to be filled by internal wiring contractors for phase 2 whilst under phase 3, case studies shall be carried out on the issues identified from phase 1 and phase 2 of the study. This paper presented the findings from the Modified Delphi Technique. The findings revealed that there are areas of improvement for Sarawak Energy Berhad connection guidelines in term of differentiation of dedicated and shared assets which leads to unfairness to the connecting customers, inconsistency and non-transparent in charging. The findings of Modified Delphi Technique shall be used for implementation of phase 2 and phase 3 of the study.

Development of key performance indicators for prehospital emergency care.

PubMed

Murphy, Adrian; Wakai, Abel; Walsh, Cathal; Cummins, Fergal; O'Sullivan, Ronan

2016-04-01

Key performance indicators (KPIs) are used to monitor and evaluate critical areas of clinical and support functions that influence patient outcome. Traditional prehospital emergency care performance monitoring has focused solely on response time metrics. The landscape of emergency care delivery in Ireland is in the process of significant national reconfiguration. The development of KPIs is therefore considered one of the key priorities in prehospital research. The aim of this study was to develop a suite of KPIs for prehospital emergency care in Ireland. A systematic literature review of prehospital care performance measurement was undertaken followed by a three-round Delphi consensus process facilitated by a broad-based multidisciplinary group of panellists. The consensus process was conducted between June 2012 and October 2013. Each candidate indicator on the Delphi survey questionnaire was rated using a 5-point Likert-type rating scale. Agreement was defined as at least 70% of responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using descriptive statistics. Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Of the 78 citations identified by the systematic review, 5 relevant publications were used to select candidate indicators for the Delphi round 1 questionnaire. Response rates in Delphi rounds 1 and 2 were 89% and 83%, respectively. Following the consensus development conference, 101 KPIs reached consensus. Based on the Donabedian framework for quality-of-care indicators, 7 of the KPIs which reached agreement were structure KPIs, 74 were process KPIs and 20 were outcome KPIs. The highest ranked indicator was a process KPI ('Direct transport of ST-elevation myocardial infarction patients to a primary percutaneous intervention (PCI)-capable facility for ECG to PCI time <90 min'). Improving the quality of prehospital care requires the development and implementation of performance measurement using scientifically valid and reliable KPIs. Employing a Delphi panel of key multidisciplinary Emergency Medical Service stakeholders, it was feasible to develop a suite of 101 KPIs for performance monitoring of prehospital emergency care in Ireland. This suite of KPIs may contribute to a framework for achieving safer, better care in the prehospital environment. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

From control to causation: Validating a 'complex systems model' of running-related injury development and prevention.

PubMed

Hulme, A; Salmon, P M; Nielsen, R O; Read, G J M; Finch, C F

2017-11-01

There is a need for an ecological and complex systems approach for better understanding the development and prevention of running-related injury (RRI). In a previous article, we proposed a prototype model of the Australian recreational distance running system which was based on the Systems Theoretic Accident Mapping and Processes (STAMP) method. That model included the influence of political, organisational, managerial, and sociocultural determinants alongside individual-level factors in relation to RRI development. The purpose of this study was to validate that prototype model by drawing on the expertise of both systems thinking and distance running experts. This study used a modified Delphi technique involving a series of online surveys (December 2016- March 2017). The initial survey was divided into four sections containing a total of seven questions pertaining to different features associated with the prototype model. Consensus in opinion about the validity of the prototype model was reached when the number of experts who agreed or disagreed with survey statement was ≥75% of the total number of respondents. A total of two Delphi rounds was needed to validate the prototype model. Out of a total of 51 experts who were initially contacted, 50.9% (n = 26) completed the first round of the Delphi, and 92.3% (n = 24) of those in the first round participated in the second. Most of the 24 full participants considered themselves to be a running expert (66.7%), and approximately a third indicated their expertise as a systems thinker (33.3%). After the second round, 91.7% of the experts agreed that the prototype model was a valid description of the Australian distance running system. This is the first study to formally examine the development and prevention of RRI from an ecological and complex systems perspective. The validated model of the Australian distance running system facilitates theoretical advancement in terms of identifying practical system-wide opportunities for the implementation of sustainable RRI prevention interventions. This 'big picture' perspective represents the first step required when thinking about the range of contributory causal factors that affect other system elements, as well as runners' behaviours in relation to RRI risk. Copyright © 2017 Elsevier Ltd. All rights reserved.

Experience of Delphi technique in the process of establishing consensus on core competencies.

PubMed

Raghav, Pankaja Ravi; Kumar, Dewesh; Bhardwaj, Pankaj

2016-01-01

The Department of Community Medicine and Family Medicine (CMFM) has been started as a new model for imparting the components of family medicine and delivering health-care services at primary and secondary levels in all six newly established All India Institute of Medical Sciences (AIIMS), but there is no competency-based curriculum for it. The paper aims to share the experience of Delphi method in the process of developing consensus on core competencies of the new model of CMFM in AIIMS for undergraduate medical students in India. The study adopted different approaches and methods, but Delphi was the most critical method used in this research. In Delphi, the experts were contacted by e-mail and their feedback on the same was analyzed. Two rounds of Delphi were conducted in which 150 participants were contacted in Delphi-I but only 46 responded. In Delphi-II, 26 participants responded whose responses were finally considered for analysis. Three of the core competencies namely clinician, primary-care physician, and professionalism were agreed by all the participants, and the least agreement was observed in the competencies of epidemiologist and medical teacher. The experts having more experience were less consistent as responses were changed from agree to disagree in more than 15% of participants and 6% changed from disagree to agree. Within the given constraints, the final list of competencies and skills for the discipline of CMFM compiled after the Delphi process will provide a useful insight into the development of competency-based curriculum of the subject.

Current and Emerging Ethical Issues in Counseling: A Delphi Study of Expert Opinions

ERIC Educational Resources Information Center

Herlihy, Barbara; Dufrene, Roxane L.

2011-01-01

A Delphi study was conducted to ascertain the opinions of panel experts regarding the most important current and emerging ethical issues facing the counseling profession. Expert opinions on ethical issues in counselor preparation also were sought. Eighteen panelists responded to 3 rounds of data collection interspersed with feedback. Themes that…

Development of a School Nursing Research Agenda in Florida: A Delphi Study

ERIC Educational Resources Information Center

Gordon, Shirley C.; Barry, Charlotte D.

2006-01-01

Research is important to the image, visibility, and viability of school nursing. Each state school nursing association should evaluate member commitment to school nursing research based on their unique set of financial, educational, and organizational resources. A 3-round Delphi study was conducted in which Florida school nurses identified…

Rehabilitation Counselor Competencies When Working With Hispanic/Latino Immigrant Injured Workers: A Delphi Study

ERIC Educational Resources Information Center

Santos Román, Leslie M.; Estrada-Hernández, Noel

2017-01-01

Purpose: To explore and identify attitudes, knowledge, and skills rehabilitation practitioners in the private sector need when working with Hispanic/Latino immigrant injured workers. Methods: This study employed a 3-round Delphi study to obtain a consensus of 8 rehabilitation practitioners who had experience and expertise working with…

Exploring Nurse Leaders' Policy Participation Within the Context of a Nursing Conceptual Framework.

PubMed

Waddell, Ashley; Adams, Jeffrey M; Fawcett, Jacqueline

2017-11-01

This study was designed to describe and quantify the experiences of nurse leaders working to influence policy and to build consensus for priority skills and knowledge useful in policy efforts within the context of a nursing conceptual framework. The conceptual model for nursing and health policy and the Adams influence model were combined into a conceptual framework used to guide this two-round modified Delphi study. Twenty-two nurse leaders who were members of a state action coalition participated in the Round 1 focus group; 15 of these leaders completed the Round 2 electronic survey. Round 1 themes indicated the value of a passion for policy, the importance of clear communication, and an understanding the who and when of policy work. Round 2 data reinforced the importance of clear communication regarding policy engagement; knowing the who and when of policy closely followed, and having a passion for policy work was identified as least important. These themes inform learning objectives for nursing education and preparation for interactions with public officials because influencing policy requires knowledge, skills, and persistence. Study findings begin to describe how nurse leaders influence policy within the context of a nursing conceptual framework and generate implications for research, education, and professional practice.

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists

PubMed Central

2017-01-01

Purpose This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. Methods A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects’ responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Results Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Conclusion Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience. PMID:28900069

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists.

PubMed

Hwang, Yoon-Sook; Kang, Hyun-Sook; Kim, Soo-Hwa; Moon, Hee-Jung; Lee, Sun-Mi; Jung, Jae-Yeon; Hwang, Su-Jeong; Ha, Jung-Eun

2017-01-01

This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects' responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience.

International definition of a point-of-care test in family practice: a modified e-Delphi procedure.

PubMed

Schols, Angel M R; Dinant, Geert-Jan; Hopstaken, Rogier; Price, Christopher P; Kusters, Ron; Cals, Jochen W L

2018-01-29

The use of point-of-care tests (POCTs) in family practice is increasing, and the term POCT is often used in medical literature and clinical practice. Yet, no widely supported definition by several professional fields exists. To reach consensus on an international definition of a POCT in family practice. We performed a modified international e-Delphi procedure of four rounds among expert panel members from different professional backgrounds-family practitioners, laboratory specialists, policymakers, researchers and manufacturers. Of 27 panel members from seven different countries, 26 participated in all rounds. Most panel members were active in POCT research or policymaking and 70% worked in family medicine. After choosing important components, structuring of answers and feedback, the following definition was chosen as the best or second best definition by 81% of panel members: a point-of-care test in family practice is a test to support clinical decision making, which is performed by a qualified member of the practice staff nearby the patient and on any part of the patient's body or its derivatives, during or very close to the time of consultation, to help the patient and physician to decide upon the best suited approach, and of which the results should be known at the time of the clinical decision making. The definition emerging from this study can inform family practitioners, laboratory specialists, policymakers and manufacturers on the most widely supported and recognized definition and could act as a clear starting point for the organization and execution of professional point-of-care testing in family practice worldwide. © The Author(s) 2018. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study

PubMed Central

Gagliardi, Diana; Rondinone, Bruna M; Mirabile, Marco; Buresti, Giuliana; Ellwood, Peter; Hery, Michel; Paszkiewicz, Peter; Valenti, Antonio; Iavicoli, Sergio

2017-01-01

Objectives This study, developed within the frame of the Partnership for European Research on Occupational Safety and Health joint research activities and based on the frame designed by the 2013 European Agency for Safety and Health at Work (EU-OSHA) study, is the first example of using the points of view of European occupational safety and health (OSH) researchers. The objective is to identify priorities for OSH research that may contribute to the achievement of present and future sustainable growth objectives set by the European strategies. Methods The study was carried out using a modified Delphi method with a two-round survey. Each round involved a panel of about 110 researchers representing the network member institutes was selected according to specific criteria, including the ownership of research expertise in at least one of the four macroareas identified by the reference report developed by EU-OSHA in 2013. Results The study identified some innovative research topics (for example, ‘Emerging technological devices’ and ‘OSH consequences of markets integration’) and research priorities (ie, crowdsourcing, e-work, zero-hours contracts) that are not reflected in previous studies of this nature. The absence of any reference to violence and harassment at work among the researchers’ proposals is a major difference from previous similar studies, while topics related to gender issues and electromagnetic fields show a lower importance. Conclusions The innovative design of a research priorities identification process, which takes advantage of a large, representative and qualified panel of European researchers allowed the definition of a number of research priorities able to support the inclusion of innovative OSH research issues in the scope of the next European research agenda. PMID:28645965

[Applying the Modified Delphi Technique to Develop the Role of HIV Case Managers and Essential Nursing Competencies in HIV Care].

PubMed

Ko, Nai-Ying; Hsieh, Chia-Yin; Chen, Yen-Chin; Tsai, Chen-Hsi; Liu, Hsiao-Ying; Liu, Li-Fang

2015-08-01

Since 2005, the Taiwan Centers for Disease Control (Taiwan CDC) initiated an HIV case management program in AIDS-designated hospitals to provide integrative services and risk-reduction counseling for HIV-infected individuals. In light of the increasingly complex and highly specialized nature of clinical care, expanding and improving competency-based professional education is important to enhance the quality of HIV/AIDS care. The aim of this study was to develop the essential competency framework for HIV care for HIV case managers in Taiwan. We reviewed essential competencies of HIV care from Canada, the United Kingdom, and several African countries and devised descriptions of the roles of case managers and of the associated core competencies for HIV care in Taiwan. The modified Delphi technique was used to evaluate the draft framework of these roles and core competencies. A total of 15 HIV care experts were invited to join the expert panel to review and rank the draft framework. The final framework consisted of 7 roles and 27 competencies for HIV case managers. In Round 1, only 3 items did not receive consensus approval from the experts. After modification based on opinions of the experts, 7 roles and 27 competencies received 97.06% consensus approval in Round 2 and were organized into the final framework for HIV case managers. These roles and associated core competencies were: HIV Care Expert (9 competencies), Communicator (1 competency), Collaborator (4 competencies), Navigator (2 competencies), Manager (4 competencies), Advocate (2 competencies), and Professional (5 competencies). The authors developed an essential competency framework for HIV care using the consensus of a multidisciplinary expert panel. Curriculum developers and advanced nurses and practitioners may use this framework to support developments and to ensure a high quality of HIV care.

Development of a Consensus Taxonomy of Sedentary Behaviors (SIT): Report of Delphi Round 1

PubMed Central

Chastin, Sebastien Francois Martin; Schwarz, Ulf; Skelton, Dawn Ann

2013-01-01

Background Over the last decade, sedentary behaviors have emerged as a distinctive behavioral paradigm with deleterious effects on health independent of physical activity. The next phase of research is to establish dose response between sedentary behaviors and health outcomes and improve understanding of context and determinants of these behaviors. Establishing a common taxonomy of these behaviors is a necessary step in this process. Aim The Sedentary behavior International Taxonomy project was developed to establish a classification of sedentary behaviors by use of a formal consensus process. Methods The study follows a Delphi process in three Rounds. A preparatory stage informed the development of terms of reference documents. In Round 1, experts were asked to make statements about the taxonomy; 1) its purpose and use ; 2) the domains, categories or facets that should be consider and include; 3) the structure/architecture to arrange and link these domains and facets. In Round 2 experts will be presented with a draft taxonomy emerging from Round 1 and invited to comment and propose alterations. The taxonomy will then be finalised at the outset of this stage. Results Results of Round 1 are reported here. There is a general consensus that a taxonomy will help advances in research by facilitating systematic and standardised: 1) investigation and analysis; 2) reporting and communication; 3) data pooling, comparison and meta-analysis; 4) development of measurement tools; 4) data descriptions, leading to higher quality in data querying and facilitate discoveries. There is also a consensus that such a taxonomy should be flexible to accommodate diverse purposes of use, and future advances in the field and yet provide a cross-disciplinary common language. A consensual taxonomy structure emerged with nine primary facets (Purpose, Environment, Posture, Social, Measurement, Associated behavior, Status, Time, Type) and the draft structure presented here for Round 2. PMID:24312653

TREatment of ATopic eczema (TREAT) Registry Taskforce: protocol for an international Delphi exercise to identify a core set of domains and domain items for national atopic eczema registries.

PubMed

Gerbens, Louise A A; Boyce, Aaron E; Wall, Dmitri; Barbarot, Sebastien; de Booij, Richard J; Deleuran, Mette; Middelkamp-Hup, Maritza A; Roberts, Amanda; Vestergaard, Christian; Weidinger, Stephan; Apfelbacher, Christian J; Irvine, Alan D; Schmitt, Jochen; Williamson, Paula R; Spuls, Phyllis I; Flohr, Carsten

2017-02-27

Patients with moderate-to-severe atopic eczema (AE) often require photo- or systemic immunomodulatory therapies to induce disease remission and maintain long-term control. The current evidence to guide clinical management is small, despite the frequent and often off-label use of these treatments. Registries of patients on photo- and systemic immunomodulatory therapies could fill this gap, and the collection of a core set concerning these therapies in AE will allow direct comparisons across registries as well as data sharing and pooling. Using an eDelphi approach, the international TREatment of ATopic eczema (TREAT) Registry Taskforce aims to seek consensus between key stakeholders internationally on a core set of domains and domain items for AE patient registries with a research focus that collect data of children and adults on photo- and systemic immunomodulatory therapies. Participants from six stakeholder groups will be invited: doctors, nurses, non-clinical researchers, patients, as well as industry and regulatory body representatives. The eDelphi will comprise three sequential online rounds, requesting participants to rate the importance of each proposed domain and domain items. Participants will be able to add domains and domain items to the proposed list in round 1. A final consensus meeting will be held with representatives of each stakeholder group. Identifying a uniform core set of domains and domain items to be captured by AE patient registries will increase the utility of individual registries, and provide greater insight into the effectiveness, safety and cost-effectiveness of photo- and systemic immunomodulatory therapies to guide clinical management across dermatology centres and country borders. Not applicable. This eDelphi study was registered in the Core Outcome Measures for Effectiveness Trials (COMET) database.

Development and face validation of strategies for improving consultation skills.

PubMed

Lefroy, Janet; Thomas, Adam; Harrison, Chris; Williams, Stephen; O'Mahony, Fidelma; Gay, Simon; Kinston, Ruth; McKinley, R K

2014-12-01

While formative workplace based assessment can improve learners' skills, it often does not because the procedures used do not facilitate feedback which is sufficiently specific to scaffold improvement. Provision of pre-formulated strategies to address predicted learning needs has potential to improve the quality and automate the provision of written feedback. To systematically develop, validate and maximise the utility of a comprehensive list of strategies for improvement of consultation skills through a process involving both medical students and their clinical primary and secondary care tutors. Modified Delphi study with tutors, modified nominal group study with students with moderation of outputs by consensus round table discussion by the authors. 35 hospital and 21 GP tutors participated in the Delphi study and contributed 153 new or modified strategies. After review of these and the 205 original strategies, 265 strategies entered the nominal group study to which 46 year four and five students contributed, resulting in the final list of 249 validated strategies. We have developed a valid and comprehensive set of strategies which are considered useful by medical students. This list can be immediately applied by any school which uses the Calgary Cambridge Framework to inform the content of formative feedback on consultation skills. We consider that the list could also be mapped to alternative skills frameworks and so be utilised by schools which do not use the Calgary Cambridge Framework.

Using a Delphi process to define priorities for prison health research in Canada

PubMed Central

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-01

Objectives A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. Setting We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. Participants We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators’ professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Primary and secondary outcome measures Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. Results In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Conclusions Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. PMID:26769790

Developing consensus-based policy solutions for medicines adherence for Europe: a delphi study

PubMed Central

2012-01-01

Background Non-adherence to prescribed medication is a pervasive problem that can incur serious effects on patients’ health outcomes and well-being, and the availability of resources in healthcare systems. This study aimed to develop practical consensus-based policy solutions to address medicines non-adherence for Europe. Methods A four-round Delphi study was conducted. The Delphi Expert Panel comprised 50 participants from 14 countries and was representative of: patient/carers organisations; healthcare providers and professionals; commissioners and policy makers; academics; and industry representatives. Participants engaged in the study remotely, anonymously and electronically. Participants were invited to respond to open questions about the causes, consequences and solutions to medicines non-adherence. Subsequent rounds refined responses, and sought ratings of the relative importance, and operational and political feasibility of each potential solution to medicines non-adherence. Feedback of individual and group responses was provided to participants after each round. Members of the Delphi Expert Panel and members of the research group participated in a consensus meeting upon completion of the Delphi study to discuss and further refine the proposed policy solutions. Results 43 separate policy solutions to medication non-adherence were agreed by the Panel. 25 policy solutions were prioritised based on composite scores for importance, and operational and political feasibility. Prioritised policy solutions focused on interventions for patients, training for healthcare professionals, and actions to support partnership between patients and healthcare professionals. Few solutions concerned actions by governments, healthcare commissioners, or interventions at the system level. Conclusions Consensus about practical actions necessary to address non-adherence to medicines has been developed for Europe. These actions are also applicable to other regions. Prioritised policy solutions for medicines non-adherence offer a benefit to policymakers and healthcare providers seeking to address this multifaceted, complex problem. PMID:23176439

Practitioner consensus on the determinants of capacity building practice in high-income countries.

PubMed

Swanepoel, Elizabeth; Fox, Ann; Hughes, Roger

2015-07-01

To assess and develop consensus among experienced public health nutrition practitioners from high-income countries regarding conceptualisation of capacity building in practice, and to test the content validity of a previously published conceptual framework for capacity building in public health nutrition practice. A Delphi study involving three iterations of email-delivered questionnaires testing a range of capacity determinants derived from the literature. Consensus was set at >50% of panellists ranking items as 'very important' on a five-point Likert scale across three survey rounds. Public health nutrition practice in Australia, the UK, Canada and the USA. Public health nutrition practitioners and academics. Result A total of thirty expert panellists (68% of an initial panel of forty-four participants) completed all three rounds of Delphi questionnaires. Consensus identified determinants of capacity building in practice including partnerships, resourcing, community development, leadership, workforce development, intelligence and quality of project management. The findings from the study suggest there is broad agreement among public health nutritionists from high-income countries about how they conceptualise capacity building in public health nutrition practice. This agreement suggests considerable content validity for a capacity building conceptual framework proposed by Baillie et al. (Public Health Nutr 12, 1031-1038). More research is needed to apply the conceptual framework to the implementation and evaluation of strategies that enhance the practice of capacity building approaches by public health nutrition professionals.

Designing a Standardized Laparoscopy Curriculum for Gynecology Residents: A Delphi Approach

PubMed Central

Shore, Eliane M.; Lefebvre, Guylaine G.; Husslein, Heinrich; Bjerrum, Flemming; Sorensen, Jette Led; Grantcharov, Teodor P.

2015-01-01

Background Evidence suggests that simulation leads to improved operative skill, shorter operating room time, and better patient outcomes. Currently, no standardized laparoscopy curriculum exists for gynecology residents. Objective To design a structured laparoscopy curriculum for gynecology residents using Delphi consensus methodology. Methods This study began with Delphi methodology to determine expert consensus on the components of a gynecology laparoscopic skills curriculum. We generated a list of cognitive content, technical skills, and nontechnical skills for training in laparoscopic surgery, and asked 39 experts in gynecologic education to rate the items on a Likert scale (1–5) for inclusion in the curriculum. Consensus was predefined as Cronbach α of ≥ 0.80. We then conducted another Delphi survey with 9 experienced users of laparoscopic virtual reality simulators to delineate relevant curricular tasks. Finally, a cross-sectional design defined benchmark scores for all identified tasks, with 10 experienced gynecologic surgeons performing the identified tasks at basic, intermediate, and advanced levels. Results Consensus (Cronbach α = 0.85) was achieved in the first round of the curriculum Delphi, and after 2 rounds (Cronbach α = 0.80) in the virtual reality curriculum Delphi. Consensus was reached for cognitive, technical, and nontechnical skills as well as for 6 virtual reality tasks. Median time and economy of movement scores defined benchmarks for all tasks. Conclusions This study used Delphi consensus to develop a comprehensive curriculum for teaching gynecologic laparoscopy. The curriculum conforms to current educational standards of proficiency-based training, and is suggested as a standard in residency programs. PMID:26221434

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Developing tools for identifying employer and employee satisfaction of nursing new graduates in China.

PubMed

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study.

The Delphi Technique in Identifying Learning Objectives for the Development of Science, Technology and Society Modules for Palestinian Ninth Grade Science Curriculum

NASA Astrophysics Data System (ADS)

Abualrob, Marwan M. A.; Gnanamalar Sarojini Daniel, Esther

2013-10-01

This article outlines how learning objectives based upon science, technology and society (STS) elements for Palestinian ninth grade science textbooks were identified, which was part of a bigger study to establish an STS foundation in the ninth grade science curriculum in Palestine. First, an initial list of STS elements was determined. Second, using this list, ninth grade science textbooks and curriculum document contents were analyzed. Third, based on this content analysis, a possible list of 71 learning objectives for the integration of STS elements was prepared. This list of learning objectives was refined by using a two-round Delphi technique. The Delphi study was used to rate and to determine the consensus regarding which items (i.e. learning objectives for STS in the ninth grade science textbooks in Palestine) are to be accepted for inclusion. The results revealed that of the initial 71 objectives in round one, 59 objectives within round two had a mean score of 5.683 or higher, which indicated that the learning objectives could be included in the development of STS modules for ninth grade science in Palestine.

Measuring organisational readiness for patient engagement (MORE): an international online Delphi consensus study.

PubMed

Oostendorp, Linda J M; Durand, Marie-Anne; Lloyd, Amy; Elwyn, Glyn

2015-02-14

Widespread implementation of patient engagement by organisations and clinical teams is not a reality yet. The aim of this study is to develop a measure of organisational readiness for patient engagement designed to monitor and facilitate a healthcare organisation's willingness and ability to effectively implement patient engagement in healthcare. The development of the MORE (Measuring Organisational Readiness for patient Engagement) scale was guided by Weiner's theory of organisational readiness for change. Weiner postulates that an organisation's readiness is determined by both the willingness and ability to implement the change (i.e. in this context: patient engagement). A first version of the scale was developed based on a literature search and evaluation of pre-existing tools. We invited multi-disciplinary stakeholders to participate in a two-round online Delphi survey. Respondents were asked to rate the importance of each proposed item, and to comment on the proposed domains and items. Second round participants received feedback from the first round and were asked to re-rate the importance of the revised, new and unchanged items, and to provide comments. The first version of the scale contained 51 items divided into three domains: (1) Respondents' characteristics; (2) the organisation's willingness to implement patient engagement; and (3) the organisation's ability to implement patient engagement. 131 respondents from 16 countries (health care managers, policy makers, clinicians, patients and patient representatives, researchers, and other stakeholders) completed the first survey, and 72 of them also completed the second survey. During the Delphi process, 34 items were reworded, 8 new items were added, 5 items were removed, and 18 were combined. The scale's instructions were revised. The final version of MORE totalled 38 items; 5 on stakeholders, 13 on an organisation's willingness to implement, and 20 on an organisation's ability to implement patient engagement in healthcare. The Delphi technique was successfully used to refine the scale's instructions, domains and items, using input from a broad range of international stakeholders, hoping that MORE can be applied in a variety of healthcare contexts worldwide. Further assessment is needed to determine the psychometric properties of the scale.

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research.

PubMed

Staniszewska, S; Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-08-02

Background  While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. Objective  To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. Methods  The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. Results  143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. Conclusions  GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Identifying the relevant features of the National Digital Cadastral Database (NDCDB) for spatial analysis by using the Delphi Technique

NASA Astrophysics Data System (ADS)

Halim, N. Z. A.; Sulaiman, S. A.; Talib, K.; Ng, E. G.

2018-02-01

This paper explains the process carried out in identifying the relevant features of the National Digital Cadastral Database (NDCDB) for spatial analysis. The research was initially a part of a larger research exercise to identify the significance of NDCDB from the legal, technical, role and land-based analysis perspectives. The research methodology of applying the Delphi technique is substantially discussed in this paper. A heterogeneous panel of 14 experts was created to determine the importance of NDCDB from the technical relevance standpoint. Three statements describing the relevant features of NDCDB for spatial analysis were established after three rounds of consensus building. It highlighted the NDCDB’s characteristics such as its spatial accuracy, functions, and criteria as a facilitating tool for spatial analysis. By recognising the relevant features of NDCDB for spatial analysis in this study, practical application of NDCDB for various analysis and purpose can be widely implemented.

Essential Concepts of Nanoscale Science and Technology for High School Students Based on a Delphi Study by the Expert Community

NASA Astrophysics Data System (ADS)

Sakhnini, Sohair; Blonder, Ron

2015-07-01

Nanoscale science and technology (NST) is an important new field in modern science. In the current study, we seek to answer the question: 'What are the essential concepts of NST that should be taught in high school'? A 3-round Delphi study methodology was applied based on 2 communities of experts in nanotechnology research and science education. Eight essential concepts in NST were identified. Each concept is accompanied by its explanation, definition, importance and includes subcategories that compose it. Three concepts emerged in the Delphi study, which were not identified before: functionality, classification of nanomaterials, and the making of nanotechnology. Differences between the concepts suggested by the 2 communities of experts were found. The results of this study serve as a tool to examine different nanotechnology programs that were reported thus far and to make recommendations for designing a NST program for high school students that includes the essential concepts.

Determinants of adolescents' ineffective and improved coping with cyberbullying: a Delphi study.

PubMed

Jacobs, Niels C L; Dehue, Francine; Völlink, Trijntje; Lechner, Lilian

2014-06-01

The study's aim was to obtain an overview of all relevant variables involved in ineffective coping behavior and improvement in coping behavior as it pertains to cyberbullying among adolescents, in order to systematically develop a theory- and evidence-based intervention. This was done by means of a three round online Delphi study. First, 20 key experts listed possible relevant determinants. Next, 70 experts scored these determinants on their relevance and finally, experts rerated relevance of each determinant based on group median scores. The experts agreed that 115 items are relevant for ineffective (62) or improvement in (53) coping behavior. New found determinants were the extent to which one can adjust behavior upon feedback, impulsivity, self-confidence, communication style, personality, decision-making skills, conflict resolution skills, previous participation in personal resilience training, social relationships, rumors and self-disclosure. We conclude that the Delphi technique is useful in discovering new and relevant determinants of behavior. Copyright © 2014 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Exploring emerging learning needs: a UK-wide consultation on environmental sustainability learning objectives for medical education.

PubMed

Walpole, Sarah C; Mortimer, Frances; Inman, Alice; Braithwaite, Isobel; Thompson, Trevor

2015-12-24

This study aimed to engage wide-ranging stakeholders and develop consensus learning objectives for undergraduate and postgraduate medical education. A UK-wide consultation garnered opinions of healthcare students, healthcare educators and other key stakeholders about environmental sustainability in medical education. The policy Delphi approach informed this study. Draft learning objectives were revised iteratively during three rounds of consultation: online questionnaire or telephone interview, face-to-face seminar and email consultation. Twelve draft learning objectives were developed based on review of relevant literature. In round one, 64 participants' median ratings of the learning objectives were 3.5 for relevance and 3.0 for feasibility on a Likert scale of one to four. Revisions were proposed, e.g. to highlight relevance to public health and professionalism. Thirty three participants attended round two. Conflicting opinions were explored. Added content areas included health benefits of sustainable behaviours. To enhance usability, restructuring provided three overarching learning objectives, each with subsidiary points. All participants from rounds one and two were contacted in round three, and no further edits were required. This is the first attempt to define consensus learning objectives for medical students about environmental sustainability. Allowing a wide range of stakeholders to comment on multiple iterations of the document stimulated their engagement with the issues raised and ownership of the resulting learning objectives.

Identifying Core Mobile Learning Faculty Competencies Based Integrated Approach: A Delphi Study

ERIC Educational Resources Information Center

Elbarbary, Rafik Said

2015-01-01

This study is based on the integrated approach as a concept framework to identify, categorize, and rank a key component of mobile learning core competencies for Egyptian faculty members in higher education. The field investigation framework used four rounds Delphi technique to determine the importance rate of each component of core competencies…

Characteristics of Viable and Sustainable Workers for the Year 2015.

ERIC Educational Resources Information Center

Dean, Brenda Pennington; West, Russell

A two-round Delphi study was conducted to identify the characteristics of viable and sustainable employees in northeastern Tennessee in 2015. The Delphi panel selected for the study consisted of 25 experts who represented a cross-section of the businesses and communities in the 10-county area of northeastern Tennessee served by Walters State…

Measuring elimination of podoconiosis, endemicity classifications, case definition and targets: an international Delphi exercise.

PubMed

Deribe, Kebede; Wanji, Samuel; Shafi, Oumer; Muheki Tukahebwa, Edridah; Umulisa, Irenee; Davey, Gail

2015-09-01

Podoconiosis is one of the major causes of lymphoedema in the tropics. Nonetheless, currently there are no endemicity classifications or elimination targets to monitor the effects of interventions. This study aimed at establishing case definitions and indicators that can be used to assess endemicity, elimination and clinical outcomes of podoconiosis. This paper describes the result of a Delphi technique used among 28 experts. A questionnaire outlining possible case definitions, endemicity classifications, elimination targets and clinical outcomes was developed. The questionnaire was distributed to experts working on podoconiosis and other neglected tropical diseases in two rounds. The experts rated the importance of case definitions, endemic classifications, elimination targets and the clinical outcome measures. Median and mode were used to describe the central tendency of expert responses. The coefficient of variation was used to describe the dispersals of expert responses. Consensus on definitions and indicators for assessing endemicity, elimination and clinical outcomes of podoconiosis directed at policy makers and health workers was achieved following the two rounds of Delphi approach among the experts. Based on the two Delphi rounds we discuss potential indicators and endemicity classification of this disabling disease, and the ongoing challenges to its elimination in countries with the highest prevalence. Consensus will help to increase effectiveness of podoconiosis elimination efforts and ensure comparability of outcome data. © The Author 2015. Published by Oxford University Press on behalf of Royal Society of Tropical Medicine and Hygiene.

How to use the nominal group and Delphi techniques.

PubMed

McMillan, Sara S; King, Michelle; Tully, Mary P

2016-06-01

Introduction The Nominal Group Technique (NGT) and Delphi Technique are consensus methods used in research that is directed at problem-solving, idea-generation, or determining priorities. While consensus methods are commonly used in health services literature, few studies in pharmacy practice use these methods. This paper provides an overview of the NGT and Delphi technique, including the steps involved and the types of research questions best suited to each method, with examples from the pharmacy literature. Methodology The NGT entails face-to-face discussion in small groups, and provides a prompt result for researchers. The classic NGT involves four key stages: silent generation, round robin, clarification and voting (ranking). Variations have occurred in relation to generating ideas, and how 'consensus' is obtained from participants. The Delphi technique uses a multistage self-completed questionnaire with individual feedback, to determine consensus from a larger group of 'experts.' Questionnaires have been mailed, or more recently, e-mailed to participants. When to use The NGT has been used to explore consumer and stakeholder views, while the Delphi technique is commonly used to develop guidelines with health professionals. Method choice is influenced by various factors, including the research question, the perception of consensus required, and associated practicalities such as time and geography. Limitations The NGT requires participants to personally attend a meeting. This may prove difficult to organise and geography may limit attendance. The Delphi technique can take weeks or months to conclude, especially if multiple rounds are required, and may be complex for lay people to complete.

Development of guidelines to assist organisations to support employees returning to work after an episode of anxiety, depression or a related disorder: a Delphi consensus study with Australian professionals and consumers

PubMed Central

2012-01-01

Background Mental disorders are a significant cause of disability and loss of workplace productivity. The scientific evidence for how organisations should best support those returning to work after common mental disorders is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods A systematic review of websites, books and journal articles was conducted to develop a 387 item survey containing strategies that organisations might use to support those returning to work after common mental disorders. Three panels of Australian experts (66 health professionals, 30 employers and 80 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results The participation rate across all three rounds was 60.2% (57.6% health professionals, 76.7% employers, 56.3% consumers). 308 strategies were endorsed as essential or important by at least 80% of all three panels. The endorsed strategies provided information on policy and procedures, the roles of supervisors, employees and colleagues in managing absence and return to work, and provision of mental health information and training. Conclusions The guidelines outline strategies for organisations supporting those returning to work after common mental disorders. It is hoped that they may be used to inform policy and practice in a variety of workplaces. PMID:22943604

Development of a scale for the evaluation of patients’ rights prerequisites at educational hospitals in Iran: a study using the Delphi technique

PubMed Central

Aazami, Sanaz; Mozafari, Mosayeb

2015-01-01

The patients’ rights status is one of the essential elements in defining norms related to the concept of clinical governance system. In addition, the patients’ rights status is an important index for quality of care offered in the health care system. However, the lack of a coherent instrument makes it difficult to evaluate patients’ rights status in hospitals and clinics. The aim of this study was to develop an instrument for the evaluation of patients’ rights prerequisites at educational hospitals in Iran. This study was conducted using the modified Delphi technique. In this study, 36 experts in the fields of law, medicine, and professional ethics were participated. The panel of experts participated in 3 rounds. First, experts were asked to judge some pre-identified items, and then, excluded items were judged again in the second round. At the end of the third round, all of the agreed items were included in the final list to form an evaluative scale on practice of patients’ rights. Experts were asked to judge a total 171 items in 3 rounds. Around 31% (n = 53) of items obtained the panel’s approval to be included in the final version of the scale. The experts’ opinions were collected using face-to-face interviews and electronic email during a 6-month period of data collection from October 2013 to February 2014. This study developed a 53-item scale for evaluation of patients’ rights prerequisites in educational hospitals in Iran. This scale was developed in 7 areas of commitments including university education, research, supervision, process management, physical structure, organizational policy, and human resources management. This study developed an evaluative scale to assess the practice of patients’ rights in educational hospitals. The items in the final version of this scale were obtained from a consensus of experts and the instrument can be used to evaluate the context and prerequisites for practice of patients’ rights in Iranian educational hospitals. PMID:27354900

Framework of behavioral indicators for outcome evaluation of TB health promotion: a Delphi study of TB suspects and Tb patients

PubMed Central

2014-01-01

Background Health promotion for prevention and control of Tuberculosis (TB) is implemented worldwide because of its importance, but few reports have evaluated its impact on behavior due to a lack of standard outcome indicators. The objective of this study was to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. Methods A two-round modified Delphi method involving sixteen TB control experts was used to establish a framework of behavioral indicators for outcome evaluation of TB health promotion targeted at TB suspects and patients. Results Sixteen of seventeen invited experts in TB control (authority score of 0.91 on a 1.0 scale) participated in round 1 survey. All sixteen experts also participated in a second round survey. After two rounds of surveys and several iterations among the experts, there was consensus on a framework of indicators for measuring outcomes of TB health promotion for TB suspects and patients. For TB suspects, the experts reached consensus on 2 domains (“Healthcare seeking behavior” and “Transmission prevention”), 3 subdomains (“Seeking care after onset of TB symptoms”, “Pathways of seeking care” and “Interpersonal contact etiquette”), and 8 indicators (including among others, “Length of patient delay”). For TB patients, consensus was reached on 3 domains (“Adherence to treatment”, “Healthy lifestyle” and “Transmission prevention”), 8 subdomains (including among others, “Adherence to their medication”), and 14 indicators (including “Percentage of patients who adhered to their medication”). Operational definitions and data sources were provided for each indicator. Conclusions The findings of this study provide the basis for debate among international experts on a framework for achieving global consensus on outcome indicators for TB health promotion interventions targeted at TB patients and suspects. Such consensus will help to increase effectiveness of TB health promotion, while ensuring international comparability of outcome data. PMID:24884569

Framework of behavioral indicators for outcome evaluation of TB health promotion: a Delphi study of TB suspects and Tb patients.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Zhang, Yanqi; Wang, Qingya; Zhang, Shun; Cao, Jia

2014-05-16

Health promotion for prevention and control of Tuberculosis (TB) is implemented worldwide because of its importance, but few reports have evaluated its impact on behavior due to a lack of standard outcome indicators. The objective of this study was to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. A two-round modified Delphi method involving sixteen TB control experts was used to establish a framework of behavioral indicators for outcome evaluation of TB health promotion targeted at TB suspects and patients. Sixteen of seventeen invited experts in TB control (authority score of 0.91 on a 1.0 scale) participated in round 1 survey. All sixteen experts also participated in a second round survey. After two rounds of surveys and several iterations among the experts, there was consensus on a framework of indicators for measuring outcomes of TB health promotion for TB suspects and patients. For TB suspects, the experts reached consensus on 2 domains ("Healthcare seeking behavior" and "Transmission prevention"), 3 subdomains ("Seeking care after onset of TB symptoms", "Pathways of seeking care" and "Interpersonal contact etiquette"), and 8 indicators (including among others, "Length of patient delay"). For TB patients, consensus was reached on 3 domains ("Adherence to treatment", "Healthy lifestyle" and "Transmission prevention"), 8 subdomains (including among others, "Adherence to their medication"), and 14 indicators (including "Percentage of patients who adhered to their medication"). Operational definitions and data sources were provided for each indicator. The findings of this study provide the basis for debate among international experts on a framework for achieving global consensus on outcome indicators for TB health promotion interventions targeted at TB patients and suspects. Such consensus will help to increase effectiveness of TB health promotion, while ensuring international comparability of outcome data.

Management of nonalcoholic fatty liver disease: An evidence-based clinical practice review

PubMed Central

Arab, Juan P; Candia, Roberto; Zapata, Rodrigo; Muñoz, Cristián; Arancibia, Juan P; Poniachik, Jaime; Soza, Alejandro; Fuster, Francisco; Brahm, Javier; Sanhueza, Edgar; Contreras, Jorge; Cuellar, M Carolina; Arrese, Marco; Riquelme, Arnoldo

2014-01-01

AIM: To build a consensus among Chilean specialists on the appropriate management of patients with nonalcoholic fatty liver disease (NAFLD) in clinical practice. METHODS: NAFLD has now reached epidemic proportions worldwide. The optimal treatment for NAFLD has not been established due to a lack of evidence-based recommendations. An expert panel of members of the Chilean Gastroenterological Society and the Chilean Hepatology Association conducted a structured analysis of the current literature on NAFLD therapy. The quality of the evidence and the level of recommendations supporting each statement were assessed according to the recommendations of the United States Preventive Services Task Force. A modified three-round Delphi technique was used to reach a consensus among the experts. RESULTS: A group of thirteen experts was established. The survey included 17 open-ended questions that were distributed among the experts, who assessed the articles associated with each question. The levels of agreement achieved by the panel were 93.8% in the first round and 100% in the second and third rounds. The final recommendations support the indication of lifestyle changes, including diet and exercise, for all patients with NAFLD. Proven pharmacological therapies include only vitamin E and pioglitazone, which can be used in nondiabetic patients with biopsy-proven nonalcoholic steatohepatitis (the progressive form of NAFLD), although the long-term safety and efficacy of these therapies have not yet been established. CONCLUSION: Current NAFLD management is rapidly evolving, and new pathophysiology-based therapies are expected to be introduced in the near future. All NAFLD patients should be evaluated using a three-focused approach that considers the risks of liver disease, diabetes and cardiovascular events. PMID:25232252

CATALISE: A Multinational and Multidisciplinary Delphi Consensus Study. Identifying Language Impairments in Children.

PubMed

Bishop, D V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2016-01-01

Delayed or impaired language development is a common developmental concern, yet there is little agreement about the criteria used to identify and classify language impairments in children. Children's language difficulties are at the interface between education, medicine and the allied professions, who may all adopt different approaches to conceptualising them. Our goal in this study was to use an online Delphi technique to see whether it was possible to achieve consensus among professionals on appropriate criteria for identifying children who might benefit from specialist services. We recruited a panel of 59 experts representing ten disciplines (including education, psychology, speech-language therapy/pathology, paediatrics and child psychiatry) from English-speaking countries (Australia, Canada, Ireland, New Zealand, United Kingdom and USA). The starting point for round 1 was a set of 46 statements based on articles and commentaries in a special issue of a journal focusing on this topic. Panel members rated each statement for both relevance and validity on a seven-point scale, and added free text comments. These responses were synthesised by the first two authors, who then removed, combined or modified items with a view to improving consensus. The resulting set of statements was returned to the panel for a second evaluation (round 2). Consensus (percentage reporting 'agree' or 'strongly agree') was at least 80 percent for 24 of 27 round 2 statements, though many respondents qualified their response with written comments. These were again synthesised by the first two authors. The resulting consensus statement is reported here, with additional summary of relevant evidence, and a concluding commentary on residual disagreements and gaps in the evidence base.

Development and validation of a mass casualty conceptual model.

PubMed

Culley, Joan M; Effken, Judith A

2010-03-01

To develop and validate a conceptual model that provides a framework for the development and evaluation of information systems for mass casualty events. The model was designed based on extant literature and existing theoretical models. A purposeful sample of 18 experts validated the model. Open-ended questions, as well as a 7-point Likert scale, were used to measure expert consensus on the importance of each construct and its relationship in the model and the usefulness of the model to future research. Computer-mediated applications were used to facilitate a modified Delphi technique through which a panel of experts provided validation for the conceptual model. Rounds of questions continued until consensus was reached, as measured by an interquartile range (no more than 1 scale point for each item); stability (change in the distribution of responses less than 15% between rounds); and percent agreement (70% or greater) for indicator questions. Two rounds of the Delphi process were needed to satisfy the criteria for consensus or stability related to the constructs, relationships, and indicators in the model. The panel reached consensus or sufficient stability to retain all 10 constructs, 9 relationships, and 39 of 44 indicators. Experts viewed the model as useful (mean of 5.3 on a 7-point scale). Validation of the model provides the first step in understanding the context in which mass casualty events take place and identifying variables that impact outcomes of care. This study provides a foundation for understanding the complexity of mass casualty care, the roles that nurses play in mass casualty events, and factors that must be considered in designing and evaluating information-communication systems to support effective triage under these conditions.

How to Choose? Using the Delphi Method to Develop Consensus Triggers and Indicators for Disaster Response.

PubMed

Lis, Rebecca; Sakata, Vicki; Lien, Onora

2017-08-01

To identify key decisions along the continuum of care (conventional, contingency, and crisis) and the critical triggers and data elements used to inform those decisions concerning public health and health care response during an emergency. A classic Delphi method, a consensus-building survey technique, was used with clinicians around Washington State to identify regional triggers and indicators. Additionally, using a modified Delphi method, we combined a workshop and single-round survey with panelists from public health (state and local) and health care coalitions to identify consensus state-level triggers and indicators. In the clinical survey, 122 of 223 proposed triggers or indicators (43.7%) reached consensus and were deemed important in regional decision-making during a disaster. In the state-level survey, 110 of 140 proposed triggers or indicators (78.6%) reached consensus and were deemed important in state-level decision-making during a disaster. The identification of consensus triggers and indicators for health care emergency response is crucial in supporting a comprehensive health care situational awareness process. This can inform the creation of standardized questions to ask health care, public health, and other partners to support decision-making during a response. (Disaster Med Public Health Preparedness. 2017;11:467-472).

Determining the Criteria and Their Weights for Medical Schools' Ranking: A National Consensus.

PubMed

Mojtahedzadeh, Rita; Mohammadi, Aeen; Kohan, Noushin; Gharib, Mitra; Zolfaghari, Mitra

2016-06-01

Delphi as a consensus development technique enables anonymous, systematic refinement of expert opinion with the aim of arriving at a combined or consensual position. In this study, we determined the criteria and their weights for Iranian Medical Schools' ranking through a Delphi process. An expert committee devised 13 proposed criteria with 32 indicators with their weights, which were arranged hierarchically in the form of a tree diagram. We used the Delphi technique to reach a consensus on these criteria and weights among the deans of 38 public Iranian medical schools. For this purpose, we devised and sent a questionnaire to schools and asked them to suggest or correct the criteria and their weights. We repeated this process in two rounds till all the schools reached an acceptable consensus on them. All schools reached a consensus on the set of 13 criteria and 30 indicators and their weights in three main contexts of education, research and facilities, and equipment which were used for Medical Schools' ranking. Using Delphi technique for devising the criteria and their weights in evaluation processes such as ranking makes their results more acceptable among universities.

Standards for midwife practitioners of external cephalic version: A Delphi study.

PubMed

Walker, Shawn; Perilakalathil, Prasanth; Moore, Jenny; Gibbs, Claire L; Reavell, Karen; Crozier, Kenda

2015-05-01

expansion of advanced and specialist midwifery practitioner roles across professional boundaries requires an evidence-based framework to evaluate achievement and maintenance of competency. In order to develop the role of Breech Specialist Midwife to include the autonomous performance of external cephalic version within one hospital, guidance was required on standards of training and skill development, particularly in the use of ultrasound. a three-round Delphi survey was used to determine consensus among an expert panel, including highly experienced obstetric and midwife practitioners, as well as sonographers. The first round used mostly open-ended questions to gather data, from which statements were formed and returned to the panel for evaluation in subsequent rounds. standards for achieving and maintaining competence to perform ECV, and in the use of basic third trimester ultrasound as part of this practice, should be the same for midwives and doctors. The maintenance of proficiency requires regular practice. midwives can appropriately expand their sphere of practice to include ECV and basic third trimester ultrasound, according to internal guidelines, following the completion of a competency-based training programme roughly equivalent to those used to guide obstetric training. Ideally, ECV services should be offered in organised clinics where individual practitioners in either profession are able to perform approximately 30 or more ECVs per year in order to maintain an appropriate level of skill. Copyright © 2015 Elsevier Ltd. All rights reserved.

Design of a consensus-derived synoptic operative report for lung cancer surgery.

PubMed

Schneider, Laura; Shargall, Yaron; Schieman, Colin; Seely, Andrew J; Srinathan, Sadeesh; Malthaner, Richard A; Pierre, Andrew F; Safieddine, Najib; Vaillancourt, Rosaire; Plourde, Madelaine; Bond, James; Johnson, Scott; Smith, Shona E; Finley, Christian J

2014-04-01

For lung cancer surgery, a narrative operative report is the standard reporting procedure, whereas a synoptic-style report is increasingly utilized by healthcare professionals in various specialties with great success. A synoptic operative report more succinctly and accurately captures vital information and is rapidly generated with good intraobserver reliability. The objective of this study was to systematically develop a synoptic operative report for lung cancer surgery following a modified Delphi consensus model with the support of the Canadian thoracic surgery community. Using online survey software, thoracic surgeons and related physicians were asked to suggest and rate data elements for a synoptic report following the modified Delphi consensus model. The consensus exercise-derived template was forwarded to a small working group, who further refined the definition and priority designation of elements until the working group had reached a satisfactory consensus. In all, 139 physicians were invited to participate in the consensus exercise, with 36.7%, 44.6%, and 19.5% response rates, respectively, in the three rounds. Eighty-nine elements were agreed upon at the conclusion of the exercise, but 141 elements were forwarded to the working group. The working group agreed upon a final data set of 180 independently defined data elements, with 72 mandatory and 108 optional elements for implementation in the final report. This study demonstrates the process involved in developing a multidisciplinary, consensus-based synoptic lung cancer operative report. This novel report style is a quality improvement initiative to improve the capture, dissemination, readability, and potential utility of critical surgical information. Copyright © 2014 The Society of Thoracic Surgeons. Published by Elsevier Inc. All rights reserved.

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

Using the Delphi method to develop nursing-sensitive quality indicators for the NICU.

PubMed

Chen, Lin; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-02-01

To develop nursing-sensitive quality indicators consistent with current medical practices in Chinese neonatal intensive care units. The development of nursing-sensitive quality indicators has become a top priority in nursing management. To the best of our knowledge, there has been no objective, scientific and sensitive evaluation of the quality of neonatal intensive care unit nursing in China. A modified Delphi technique was used to seek opinions from experts about what should be used and prioritised as indicators of quality care in neonatal intensive care unit nursing. Based on a literature review, we identified 21 indicators of nursing-sensitive quality in the neonatal intensive care unit. Our group of 11 consultants chose 13 indicators to be discussed using the Delphi method. In October and November 2014, 39 neonatal intensive care unit experts in 18 tertiary hospitals spread across six provinces participated in two rounds of Delphi panels. Of the 13 indicators discussed, 11 were identified as indicators of nursing-sensitive quality in the neonatal intensive care unit: rate of nosocomial infections, rate of accidental endotracheal extubation, rate of errors in medication administration, rate of treatment for pain, rate of peripheral venous extravasation, rate of compliance with handwashing techniques, incidence of pressure ulcers, incidence of noise, the bed-to-care ratio, the proportion of nurses with greater than five years neonatal intensive care unit experience and incidence of retinopathy. The 11 neonatal intensive care unit nursing-sensitive indicators identified by the Delphi method integrated with basic Chinese practices provide a basis for nursing management and the monitoring of nursing quality. This study identified nursing-sensitive quality indicators for neonatal intensive care unit care that are suitable for current clinical practice in China. © 2016 John Wiley & Sons Ltd.

Application of the Delphi technique in healthcare maintenance.

PubMed

Njuangang, Stanley; Liyanage, Champika; Akintoye, Akintola

2017-10-09

Purpose The purpose of this paper is to examine the research design, issues and considerations in the application of the Delphi technique to identify, refine and rate the critical success factors and performance measures in maintenance-associated infections. Design/methodology/approach In-depth literature review through the application of open and axial coding were applied to formulate the interview and research questions. These were used to conduct an exploratory case study of two healthcare maintenance managers, randomly selected from two National Health Service Foundation Trusts in England. The results of exploratory case study provided the rationale for the application of the Delphi technique in this research. The different processes in the application of the Delphi technique in healthcare research are examined thoroughly. Findings This research demonstrates the need to apply and integrate different research methods to enhance the validity of the Delphi technique. The rationale for the application of the Delphi technique in this research is because some healthcare maintenance managers lack knowledge about basic infection control (IC) principles to make hospitals safe for patient care. The result of first round of the Delphi exercise is a useful contribution in its own rights. It identified a number of salient issues and differences in the opinions of the Delphi participants, noticeably between healthcare maintenance managers and members of the infection control team. It also resulted in useful suggestions and comments to improve the quality and presentation of the second- and third-round Delphi instruments. Practical implications This research provides a research methodology that can be adopted by researchers investigating new and emerging issues in the healthcare sector. As this research demonstrates, the Delphi technique is relevant in soliciting expert knowledge and opinion to identify performance measures to control maintenance-associated infections in hospitals. The methodology provided here could be applied by other researchers elsewhere to probe, investigate and generate rich information about new and emerging healthcare research topics. Originality/value The authors demonstrate how different research methods can be integrated to enhance the validity of the Delphi technique. For example, the results of an exploratory case study provided the rationale for the application of the Delphi technique investigating the key performance measures in maintenance-associated infections. The different processes involved in the application of the Delphi technique are also carefully explored and discussed in depth.

Establishing a Taxonometric Structure for the Study of Biotechnology in Secondary School Technology Education.

ERIC Educational Resources Information Center

Wells, John G.

1994-01-01

A Delphi panel of 19 experts identified 8 main knowledge areas of biotechnology: bioprocessing, foundations, genetic engineering, agriculture, biochemistry, medicine, environment, and bioethics. Round 2 elicited 84 subdivisions and round 3 adjusted the ratings. The resulting classification suggests a different context and focus for technology…

Devising a consensus definition and framework for non-technical skills in healthcare to support educational design: A modified Delphi study.

PubMed

Gordon, Morris; Baker, Paul; Catchpole, Ken; Darbyshire, Daniel; Schocken, Dawn

2015-01-01

Non-technical skills are a subset of human factors that focus on the individual and promote safety through teamwork and awareness. There is no widely adopted competency- or outcome-based framework for non-technical skills training in healthcare. The authors set out to devise such a framework using a modified Delphi approach. An exhaustive list of published and team suggested items was presented to the expert panel for ranking and to propose a definition. In the second round, a focused list was presented, as well as the proposed definition elements. The finalised framework was sent to the panel for review. Sixteen experts participated. The final framework consists of 16 competencies for all and eight specific competencies for team leaders. The consensus definition describes non-technical skills as "a set of social (communication and team work) and cognitive (analytical and personal behaviour) skills that support high quality, safe, effective and efficient inter-professional care within the complex healthcare system". The authors have produced a new competency framework, through the works of an International expert panel, which is not discipline specific that can be used by curriculum developers, educational innovators and clinical teachers to support developments in the field.

Developing a Physiotherapy-Specific Preliminary Clinical Decision-Making Tool for Oxygen Titration: A Modified Delphi Study

PubMed Central

Duong, Michelle; Bertin, Kendra; Henry, Renee; Singh, Deepti; Timmins, Nolla; Brooks, Dina; Mathur, Sunita

2014-01-01

ABSTRACT Purpose: To develop and evaluate a preliminary clinical decision-making tool (CDMT) to assist physiotherapists in titrating oxygen for acutely ill adults in Ontario. Methods: A panel of 14 experienced cardiorespiratory physiotherapists was recruited. Factors relating to oxygen titration were identified using a modified Delphi technique. Four rounds of questionnaires were conducted, during which the goals were to (1) generate factors, (2) reduce factors and debate contentious factors, (3) finalize factors and develop the preliminary CDMT, and (4) evaluate the usability of the tool in a clinical context. Results: The panel reached consensus on a total of 89 factors, which were compiled to create the preliminary CDMT. The global tool reached consensus for sensibility, receiving a mean score of 6/7 on a 7-point Likert-type scale (1=unacceptable; 7=excellent). Five of the nine individual components of evaluation of the tool achieved scores ≥6.0; the remaining four had mean scores between 5.4 and 5.9. Conclusion: This study produced a preliminary CDMT for oxygen titration, which the panel agreed was highly comprehensible and globally sensible. Further research is necessary to evaluate the sensibility and applicability of the tool in a clinical setting. PMID:25125782

Issues and Needs in Rural Early Childhood Special Education Services in Florida: A Delphi Study.

ERIC Educational Resources Information Center

Weiss, Keith E.; Correa, Vivian I.

A Delphi Technique was used to examine the problems of early childhood special education programs in rural Florida. Two rounds of questionnaires were completed by a panel of early childhood special education administrators and teachers from 14 of Florida's 27 rural counties. In response to the questionnaires, the panel developed 51 problem-related…

Transatlantic Multispecialty Consensus on Fundamental Endovascular Skills: Results of a Delphi Consensus Study.

PubMed

Maertens, H; Aggarwal, R; Macdonald, S; Vermassen, F; Van Herzeele, I

2016-01-01

The aim of this study was to establish a consensus on Fundamental Endovascular Skills (FES) for educational purposes and development of training curricula for endovascular procedures. The term "Fundamental Endovascular Skills" is widely used; however, the current literature does not explicitly describe what skills are included in this concept. Endovascular interventions are performed by several specialties that may have opposing perspectives on these skills. A two round Delphi questionnaire approach was used. Experts from interventional cardiology, interventional radiology, and vascular surgery from the United States and Europe were invited to participate. An electronic questionnaire was generated by endovascular therapists with an appropriate educational background but who would not participate in subsequent rounds. The questionnaire consisted of 50 statements describing knowledge, technical, and behavioral skills during endovascular procedures. Experts received the questionnaires by email. They were asked to rate the importance of each skill on a Likert scale from 1 to 5. A statement was considered fundamental when more than 90% of the experts rated it 4 or 5 out of 5. Twenty-three of 53 experts invited agreed to participate: six interventional radiologists (2 USA, 4 Europe), 10 vascular surgeons (4 USA, 6 Europe), and seven interventional cardiologists (4 USA, 3 Europe). There was a 100% response rate in the first round and 87% in the second round. Results showed excellent consensus among responders (Cronbach's alpha = .95 first round; .93 second round). Ninety percent of all proposed skills were considered fundamental. The most critical skills were determined. A transatlantic multispecialty consensus was achieved about the content of "FES" among interventional radiologists, interventional cardiologists, and vascular surgeons from Europe and the United States. These results can serve as directive principles for developing endovascular training curricula. Copyright © 2015 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Consulting the oracle: ten lessons from using the Delphi technique in nursing research.

PubMed

Keeney, Sinead; Hasson, Felicity; McKenna, Hugh

2006-01-01

The aim of this paper was to provide insight into the Delphi technique by outlining our personal experiences during its use over a 10-year period in a variety of applications. As a means of achieving consensus on an issue, the Delphi research method has become widely used in healthcare research generally and nursing research in particular. The literature on this technique is expanding, mainly addressing what it is and how it should be used. However, there is still much confusion and uncertainty surrounding it, particularly about issues such as modifications, consensus, anonymity, definition of experts, how 'experts' are selected and how non-respondents are pursued. This issues that arise when planning and carrying out a Delphi study include the definition of consensus; the issue of anonymity vs. quasi-anonymity for participants; how to estimate the time needed to collect the data, analyse each 'round', feed back results to participants, and gain their responses to this feedback; how to define and select the 'experts' who will be asked to participate; how to enhance response rates; and how many 'rounds' to conduct. Many challenges and questions are raised when using the Delphi technique, but there is no doubt that it is an important method for achieving consensus on issues where none previously existed. Researchers need to adapt the method to suit their particular study.

Towards an International Classification for Patient Safety: a Delphi survey.

PubMed

Thomson, Richard; Lewalle, Pierre; Sherman, Heather; Hibbert, Peter; Runciman, William; Castro, Gerard

2009-02-01

Interpretation and comparison of patient safety information have been compromised by the lack of a common understanding of the concepts involved. The World Alliance set out to develop an International Classification for Patient Safety (ICPS) to address this, and to test the relevance and acceptability of the draft ICPS and progressively refine it prior to field testing. Two-stage Delphi survey. Quantitative and qualitative analyses informed the review of the ICPS. International web-based survey of expert opinion. Experts in the fields of patient safety, health policy, reporting systems, safety and quality control, classification theory and development, health informatics, consumer advocacy, law and medicine; 253 responded to the first round survey, 30% of whom responded to the second round. In the first round, 14% felt that the conceptual framework was missing at least one class, although it was apparent that most respondents were actually referring to concepts they felt should be included within the classes rather than the classes themselves. There was a need for clarification of several components of the classification, particularly its purpose, structure and depth. After revision and feedback, round 2 results were more positive, but further significant changes were made to the conceptual framework and to the major classes in response to concerns about terminology and relationships between classes. The Delphi approach proved invaluable, as both a consensus-building exercise and consultation process, in engaging stakeholders to support completion of the final draft version of the ICPS. Further refinement will occur.

Towards an International Classification for Patient Safety: a Delphi survey

PubMed Central

Thomson, Richard; Lewalle, Pierre; Sherman, Heather; Hibbert, Peter; Runciman, William; Castro, Gerard

2009-01-01

Objective Interpretation and comparison of patient safety information have been compromised by the lack of a common understanding of the concepts involved. The World Alliance set out to develop an International Classification for Patient Safety (ICPS) to address this, and to test the relevance and acceptability of the draft ICPS and progressively refine it prior to field testing. Design Two-stage Delphi survey. Quantitative and qualitative analyses informed the review of the ICPS. Setting International web-based survey of expert opinion. Participants Experts in the fields of patient safety, health policy, reporting systems, safety and quality control, classification theory and development, health informatics, consumer advocacy, law and medicine; 253 responded to the first round survey, 30% of whom responded to the second round. Results In the first round, 14% felt that the conceptual framework was missing at least one class, although it was apparent that most respondents were actually referring to concepts they felt should be included within the classes rather than the classes themselves. There was a need for clarification of several components of the classification, particularly its purpose, structure and depth. After revision and feedback, round 2 results were more positive, but further significant changes were made to the conceptual framework and to the major classes in response to concerns about terminology and relationships between classes. Conclusions The Delphi approach proved invaluable, as both a consensus-building exercise and consultation process, in engaging stakeholders to support completion of the final draft version of the ICPS. Further refinement will occur. PMID:19147596

The transculturality of 'gut feelings'. Results from a French Delphi consensus survey.

PubMed

Le Reste, Jean-Yves; Coppens, Magali; Barais, Marie; Nabbe, Patrice; Le Floch, Bernard; Chiron, Benoît; Dinant, Geert Jan; Berkhout, Christophe; Stolper, Erik; Barraine, Pierre

2013-12-01

General Practitioners (GPs) sometimes base their clinical decisions on 'gut feelings.' Research into the significance of this phenomenon with focus groups and a Delphi consensus procedure in the Netherlands provided a concept of 'gut feelings:' a sense of alarm, a sense of reassurance and several determinants. The transculturality of 'gut feelings' has been examined briefly until now as the issue is complex. To determine whether a consensus on 'gut feelings' in general practice in France could be obtained. Using a similar Delphi consensus procedure and the same six initial statements as in the Netherlands, and compare the French results with the seven final Dutch consensual statements. Qualitative research, including a Delphi consensus procedure after a forward-backward translation (FBT) of the initial Dutch statements of 'gut feelings.' A heterogeneous sample of 34 French expert GPs participated. FBT of the final French statements was undertaken for a content comparison with the Dutch. After three Delphi rounds, French GPs reached agreement on nine statements. Many similarities have been found between the Dutch and the French defining statements, with reservations concerning the 'sense of reassurance,' which French GPs seemed to feel more cautious about. 'Gut feelings' are a well-defined concept in France too. The Dutch and the French consensual statements seem very close. The transculturality of the concept is confirmed, which is a new indicator that 'gut feelings' are a self-contained concept.

SAGES research agenda in gastrointestinal and endoscopic surgery: updated results of a Delphi study.

PubMed

Stefanidis, Dimitrios; Montero, Paul; Urbach, David R; Qureshi, Alia; Perry, Kyle; Bachman, Sharon L; Madan, Atul; Petersen, Rebecca; Pryor, Aurora D

2014-10-01

Research in gastrointestinal and endoscopic surgery has witnessed unprecedented growth since the introduction of minimally invasive techniques in surgery. Coordination and focus of research efforts could further advance this rapidly expanding field. The objective of this study was to update the SAGES research agenda for gastrointestinal and endoscopic surgery. A modified Delphi methodology was used to create the research agenda. Using an iterative, anonymous web-based survey, the general membership and leadership of SAGES were asked for input over three rounds. Initially submitted research questions were reviewed and consolidated by an expert panel and redistributed to the membership for priority ranking using a 5-point Likert scale of importance. The top 40 research questions of this round were then redistributed to and re-rated by members, and a final ranking was established. Comparisons were made between membership and leadership responses. 283 initially submitted research questions were condensed into 89 distinct questions, which were rated by 388 respondents to determine the top 40 questions. 460 respondents established the final ranking of these 40 most important research questions. Topics represented included training and technique, gastrointestinal, hernia, GERD, bariatric surgery, and endoscopy. The top question was, "How do we best train, assess, and maintain proficiency of surgeons and surgical trainees in flexible endoscopy, laparoscopy, and open surgery?" 28% of responders were leadership and the rest general members with the majority of ratings (73%) being similar between the groups. While SAGES leadership rated the majority of questions (89%) lower, they rated nonclinical questions higher compared with general membership. An updated research agenda for gastrointestinal and endoscopic surgery was developed using a systematic methodology. This agenda may assist investigators and funding organizations to concentrate their efforts in the highest research priority areas and editors and reviewers in assessing the merit and relevance of scientific work.

Youth injury prevention in Canada: use of the Delphi method to develop recommendations.

PubMed

Pike, Ian; Piedt, Shannon; Davison, Colleen M; Russell, Kelly; Macpherson, Alison K; Pickett, William

2015-12-22

The Health Behaviour in School-aged Children Survey is one of very few cross-national health surveys that includes information on injury occurrence and prevention within adolescent populations. A collaboration to develop a Canadian youth injury report using these data resulted in, Injury among Young Canadians: A national study of contextual determinants. The objective of this study was to develop specific evidence-based, policy-oriented recommendations arising from the national report, using a modified-Delphi process with a panel of expert stakeholders. Eight injury prevention experts and a 3-person youth advisory team associated with a Canadian injury prevention organization (Parachute Canada) reviewed, edited and commented on report recommendations through a three-stage iterative modified-Delphi process. From an initial list of 27 draft recommendations, the modified-Delphi process resulted in a final list of 19 specific recommendations, worded to resonate with the group(s) responsible to lead or take the recommended action. Two recommendations were rated as "extremely important" or "very important" by 100 % of the expert panel, two were deleted, a further two recommendations were deleted but the content included as text in the report, and four were merged with other existing recommendations. The modified-Delphi process was an appropriate method to achieve agreement on 19 specific evidence-based, policy-oriented recommendations to complement the national youth injury report. In providing their input, it is noted that the injury stakeholders each acted as individual experts, unattached to any organizational position or policy. These recommendations will require multidisciplinary collaborations in order to support the proposed policy development, additional research, programming and clear decision-making for youth injury prevention.

Defining the activities of publicness for Korea's public community hospitals using the Delphi method.

PubMed

Lee, Kunsei; Kim, Hyun Joo; You, Myoungsoon; Lee, Jin-Seok; Eun, Sang Jun; Jeong, Hyoseon; Ahn, Hye Mi; Lee, Jin Yong

2017-03-01

This study aims to identify which activities of a public community hospital (PHC) should be included in their definition of publicness and tries to achieve a consensus among experts using the Delphi method. We conduct 2 rounds of the Delphi process with 17 panel members using a developed draft of tentative activities for publicness including 5 main categories covering 27 items. The questions remain the same in both rounds and the applicability of each of the 27 items to publicness is measured on a 9-point scale. If the participants believe government funding is needed, we ask how much they think the government should support each item on a 0% to 100% scale. After conducting 2 rounds of the Delphi process, 22 out of the 27 items reached a consensus as activities defining the publicness of the PHCs. Among the 5 major categories, in category C, activities preventing market failure, all 10 items were considered activities of publicness. Nine of these were evaluated as items that should be compensated at 100% of total financial loss by the Korean government. Throughout results, we were able to define the activities of the PCH that encompassed its publicness and confirm that there are "good deficits" in the context of the PCHs. Thus, some PCH deficits are unavoidable and not wasted as these monies support a necessary role and function in providing public health. The Korean government should therefore consider taking actions such as exempting such "good deficits" or providing additional financial aid to reimburse the PHCs for "good deficits."

Subjective and clinical assessment criteria suggestive for five clinical patterns discernible in nonspecific neck pain patients. A Delphi-survey of clinical experts.

PubMed

Dewitte, Vincent; Peersman, Wim; Danneels, Lieven; Bouche, Katie; Roets, Arne; Cagnie, Barbara

2016-12-01

Nonspecific neck pain patients form a heterogeneous group with different musculoskeletal impairments. Classifying nonspecific neck pain patients into subgroups based on clinical characteristics might lead to more comprehensive diagnoses and can guide effective management. To establish consensus among a group of experts regarding the clinical criteria suggestive of a clinical dominance of 'articular', 'myofascial', 'neural', 'central' and 'sensorimotor control' dysfunction patterns distinguishable in patients with nonspecific neck pain. Delphi study. A focus group with 10 academic experts was organized to elaborate on the different dysfunction patterns discernible in neck pain patients. Consecutively, a 3-round online Delphi-survey was designed to obtain consensual symptoms and physical examination findings for the 5 distinct dysfunction patterns resulting from the focus group. A total of 21 musculoskeletal physical therapists from Belgium and the Netherlands experienced in assessing and treating neck pain patients completed the 3-round Delphi-survey. Respectively, 33 (response rate, 100.0%), 27 (81.8%) and 21 (63.6%) respondents replied to rounds 1, 2 and 3. Eighteen 'articular', 16 'myofascial', 20 'neural', 18 'central' and 10 'sensorimotor control' clinical indicators reached a predefined ≥80% consensus level. These indicators suggestive of a clinical dominance of 'articular', 'myofascial', 'neural', 'central', and 'sensorimotor control' dysfunction patterns may help clinicians to assess and diagnose patients with nonspecific neck pain. Future validity testing is needed to determine how these criteria may help to improve the outcome of physical therapy interventions in nonspecific neck pain patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

Current opinion and consensus statement regarding the diagnosis, prognosis, and treatment of patients with essential thrombocythemia: a survey of the Spanish Group of Ph-negative Myeloproliferative Neoplasms (GEMFIN) using the Delphi method.

PubMed

Besses, C; Hernández-Boluda, J C; Pérez Encinas, M; Raya, J M; Hernández-Rivas, J M; Jiménez Velasco, A; Martínez Lopez, J; Vicente, V; Burgaleta, C

2016-04-01

The current consensus on the diagnosis, prognosis, and treatment of essential thrombocythemia (ET) is based on experts' recommendations. However, several aspects of the diagnosis of, prognosis of, and therapy for ET are still controversial. The Delphi method was employed with an expert panel of members of the Spanish Group of Ph-negative Myeloproliferative Neoplasms in order to identify the degree of agreement on the diagnosis, prognosis, and treatment of ET. Nine leading experts selected a total of 41 clinical hematologists with well-known expertise in ET. An electronic questionnaire was used to collect the questions rated in a four-step scale. The questions were grouped into four blocks: diagnosis, risk stratification, goals of therapy, and treatment strategy. After the first round consisting of 80 questions, a second round including 14 additional questions focused on the recommendations advocated by experts of the European LeukemiaNet in 2011 was analyzed. The median and mean values for the first and second rounds were calculated. A summary of the conclusions considered as the most representative of each block of questions is presented. The Delphi method is a powerful instrument to address the current approaches and controversies surrounding ET.

The Canadian Assessment of Physical Literacy: Development of a Model of Children's Capacity for a Healthy, Active Lifestyle Through a Delphi Process.

PubMed

Francis, Claire E; Longmuir, Patricia E; Boyer, Charles; Andersen, Lars Bo; Barnes, Joel D; Boiarskaia, Elena; Cairney, John; Faigenbaum, Avery D; Faulkner, Guy; Hands, Beth P; Hay, John A; Janssen, Ian; Katzmarzyk, Peter T; Kemper, Han C; Knudson, Duane; Lloyd, Meghann; McKenzie, Thomas L; Olds, Tim S; Sacheck, Jennifer M; Shephard, Roy J; Zhu, Weimo; Tremblay, Mark S

2016-02-01

The Canadian Assessment of Physical Literacy (CAPL) was conceptualized as a tool to monitor children's physical literacy. The original model (fitness, activity behavior, knowledge, motor skill) required revision and relative weights for calculating/interpreting scores were required. Nineteen childhood physical activity/fitness experts completed a 3-round Delphi process. Round 1 was open-ended questions. Subsequent rounds rated statements using a 5-point Likert scale. Recommendations were sought regarding protocol inclusion, relative importance within composite scores and score interpretation. Delphi participant consensus was achieved for 64% (47/73) of statement topics, including a revised conceptual model, specific assessment protocols, the importance of longitudinal tracking, and the relative importance of individual protocols and composite scores. Divergent opinions remained regarding the inclusion of sleep time, assessment/ scoring of the obstacle course assessment of motor skill, and the need for an overall physical literacy classification. The revised CAPL model (overlapping domains of physical competence, motivation, and knowledge, encompassed by daily behavior) is appropriate for monitoring the physical literacy of children aged 8 to 12 years. Objectively measured domains (daily behavior, physical competence) have higher relative importance. The interpretation of CAPL results should be reevaluated as more data become available.

Independence and shared decision making: the role of smart home technology in empowering older adults.

PubMed

Demiris, George

2009-01-01

This study aims to explore the concepts of independence and shared decision making in the context of smart home technologies for older adults. We conducted a Delphi study with three rounds involving smart home designers, and researchers as well as community dwelling older adults. While there were differences in the way different stakeholders define these concepts, the study findings provide clear implications for the design, implementation and evaluation of smart home applications.

Mental Health First Aid guidelines for helping a suicidal person: a Delphi consensus study in the Philippines

PubMed Central

2010-01-01

Background This study aimed to develop guidelines for how a member of the Filipino public should provide mental health first aid to a person who is suicidal. Methods The guidelines were produced by developing a questionnaire containing possible first aid actions and asking an expert panel of 34 Filipino mental health clinicians to rate whether each action should be included in the guidelines. The content of the questionnaire was based on a systematic search of the relevant evidence and claims made by authors of consumer and carer guides and websites. The panel members were asked to complete the questionnaire by web survey. Three rounds of the rating were carried and, at the end of each round, items that reached the consensus criterion were selected for inclusion in the guidelines. During the first round, panel members were also asked to suggest any additional actions that were not covered in the original questionnaire (to include items that are relevant to local cultural circumstances, values, and social norms). Responses to these open-ended questions were used to generate new items. Results The output from the Delphi process was a set of agreed upon action statements. The Delphi process started with 138 statements, 48 new items were written based on suggestions from panel members and, of these 186 items, 102 met the consensus criterion. These statements were used to develop the guidelines appended to this paper. The guidelines are currently being translated into local languages. Conclusions There are a number of actions that are considered to be useful for members of the public when they encounter someone who is experiencing suicidal thoughts or engaging in suicidal behaviour. Although the guidelines are designed for members of the public, they may also be helpful to non-mental health professionals working in health and welfare settings. PMID:21167076

Mental Health First Aid guidelines for helping a suicidal person: a Delphi consensus study in Japan

PubMed Central

2011-01-01

Background This study aimed to develop guidelines for how a member of the Japanese public should provide mental health first aid to a person who is suicidal. Methods The guidelines were produced by developing a questionnaire containing possible first aid actions and asking an expert panel of 32 Japanese mental health professionals to rate whether each action should be included in the guidelines. The content of the questionnaire was based on a systematic search of the relevant evidence and claims made by authors of consumer and carer guides and websites. The panel members were asked to complete the questionnaire by web survey. Three rounds of the rating were carried and, at the end of each round, items that reached the consensus criterion were selected for inclusion in the guidelines. During the first round, panel members were also asked to suggest any additional actions that were not covered in the original questionnaire (to include items that are relevant to local cultural circumstances, values, and social norms). Responses to these open-ended questions were used to generate new items. Results The output from the Delphi process was a set of agreed upon action statements. The Delphi process started with 138 statements, 38 new items were written based on suggestions from panel members and, of these 176 items, 56 met the consensus criterion. These statements were used to develop the guidelines appended to this article. Conclusions There are a number of actions that are considered to be useful for members of the Japanese public when they encounter someone who is experiencing suicidal thoughts or engaging in suicidal behaviour. Although the guidelines are designed for members of the public, they may also be helpful to health professionals working in health and welfare settings who do not have clinical mental health training. PMID:21592409

Study of labor-negotiation productivity concerns in the petroleum-refining industry

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, J.E.

The primary objective of this study was to identify productivity factors relative to negotiating future labor contracts with the Oil, Chemical and Atomic Workers International Union (OCAWIU). A Delphi research method was utilized to accomplish this purpose. The study utilized three rounds to obtain the stated objectives. Round one involved the use of an open instrument to solicit productivity factors that would be beneficial in future negotiations with the OCAWIU. In round two, two separate instruments were sent to the panel members who were asked to judge the value of each item on the first instrument, and to rank themore » ten most significant items on the second. The round three instruments were individualized for each panel member. The productivity items were rated by the panel members, and descriptive statistics were used to describe the combined order of listings and weights for determining the relative importance of each factor in the consensus model. The nonparametric statistics were used to examine the degree of consensus between the mean values on the first instrument with the ranked values for the second instrument. No significant differences were formed. Twenty-five productivity items were identified and prioritized as viable negotiable items with the OCAWIU.« less

Using a Delphi process to define priorities for prison health research in Canada.

PubMed

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-14

A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators' professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Defining Advance Care Planning for Adults: A Consensus Definition from a Multidisciplinary Delphi Panel

PubMed Central

Sudore, Rebecca L.; Lum, Hillary D.; You, John J.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Matlock, Daniel D.; Rietjens, Judith A. C.; Korfage, Ida J.; Ritchie, Christine S.; Kutner, Jean S.; Teno, Joan M.; Thomas, Judy; McMahan, Ryan D.; Heyland, Daren K.

2017-01-01

Background Despite increasing interest in advance care planning (ACP) and prior ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. Objective To develop a consensus definition of ACP for adults. Design Delphi Panel Setting/Participants Participants included a multidisciplinary panel of international ACP experts consisting of 52 clinicians, researchers, and policy leaders from 4 countries, and a patient/surrogate advisory committee. Measurements We conducted 10 rounds of a modified Delphi method and qualitatively analyzed panelists’ input. Panelists identified several themes lacking consensus, and iteratively discussed and developed a final consensus definition. Results Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients’ values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: “Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness.” The panel also described strategies to best support adults in ACP. Conclusions A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. PMID:28062339

Defining Advance Care Planning for Adults: A Consensus Definition From a Multidisciplinary Delphi Panel.

PubMed

Sudore, Rebecca L; Lum, Hillary D; You, John J; Hanson, Laura C; Meier, Diane E; Pantilat, Steven Z; Matlock, Daniel D; Rietjens, Judith A C; Korfage, Ida J; Ritchie, Christine S; Kutner, Jean S; Teno, Joan M; Thomas, Judy; McMahan, Ryan D; Heyland, Daren K

2017-05-01

Despite increasing interest in advance care planning (ACP) and previous ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. The aim of this study was to develop a consensus definition of ACP for adults. We convened a Delphi panel of multidisciplinary, international ACP experts consisting of 52 clinicians, researchers, and policy leaders from four countries and a patient/surrogate advisory committee. We conducted 10 rounds using a modified Delphi method and qualitatively analyzed panelists' input. Panelists identified several themes lacking consensus and iteratively discussed and developed a final consensus definition. Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients' values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: "Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness." The panel also described strategies to best support adults in ACP. A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. Published by Elsevier Inc.

Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

PubMed

Turner, S; Ollerhead, E; Cook, A

2017-10-09

In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and logistically challenging. Identifying such research priorities can be particularly challenging for complex public health problems as there is a need to consult a number of experts across disciplines and with a range of expertise. This study investigated the use of Delphi-like survey methods in identifying important research priorities relating to health inequalities and framing tractable research questions for topic areas identified. The study was conducted in two phases, both using Delphi-like survey methods. Firstly, public health professionals with an interest in health inequalities were asked to identify research priorities. Secondly academic researchers were asked to frame tractable research questions relating to the priorities identified. These research priorities identified using Delphi-like survey methods were subsequently compared to those identified using different methods. A total of 52 public health professionals and 21 academics across the United Kingdom agreed to take part. The response rates were high, from public health professionals across three survey rounds (69%, 50% and 40%) and from academics across one round (52%), indicating that participants were receptive to the method and motivated to respond. The themes identified as encompassing the most important research priorities were mental health, healthy environment and health behaviours. Within these themes, the topic areas that emerged most strongly included community interventions for prevention of mental health problems and the food and alcohol environment. Some responses received from academic researchers were (as requested) in the form of tractable research questions, whereas others contributed further potential topic areas instead. Delphi-like survey methods are practical and productive as a means of obtaining opinions from a wide number of relevant experts identifying potential priority topic areas for research; however, this method is less appropriate for framing tractable research questions.

Multinational evidence-based recommendations on how to investigate and follow-up undifferentiated peripheral inflammatory arthritis: integrating systematic literature research and expert opinion of a broad international panel of rheumatologists in the 3E Initiative.

PubMed

Machado, P; Castrejon, I; Katchamart, W; Koevoets, R; Kuriya, B; Schoels, M; Silva-Fernández, L; Thevissen, K; Vercoutere, W; Villeneuve, E; Aletaha, D; Carmona, L; Landewé, R; van der Heijde, D; Bijlsma, J W J; Bykerk, V; Canhão, H; Catrina, A I; Durez, P; Edwards, C J; Mjaavatten, M D; Leeb, B F; Losada, B; Martín-Mola, E M; Martinez-Osuna, P; Montecucco, C; Müller-Ladner, U; Østergaard, M; Sheane, B; Xavier, R M; Zochling, J; Bombardier, C

2011-01-01

To develop evidence-based recommendations on how to investigate and follow-up undifferentiated peripheral inflammatory arthritis (UPIA). 697 rheumatologists from 17 countries participated in the 3E (Evidence, Expertise, Exchange) Initiative of 2008-9 consisting of three separate rounds of discussions and modified Delphi votes. In the first round 10 clinical questions were selected. A bibliographic team systematically searched Medline, Embase, the Cochrane Library and ACR/EULAR 2007-2008 meeting abstracts. Relevant articles were reviewed for quality assessment, data extraction and synthesis. In the second round each country elaborated a set of national recommendations. Finally, multinational recommendations were formulated and agreement among the participants and the potential impact on their clinical practice was assessed. A total of 39,756 references were identified, of which 250 were systematically reviewed. Ten multinational key recommendations about the investigation and follow-up of UPIA were formulated. One recommendation addressed differential diagnosis and investigations prior to establishing the operational diagnosis of UPIA, seven recommendations related to the diagnostic and prognostic value of clinical and laboratory assessments in established UPIA (history and physical examination, acute phase reactants, autoantibodies, radiographs, MRI and ultrasound, genetic markers and synovial biopsy), one recommendation highlighted predictors of persistence (chronicity) and the final recommendation addressed monitoring of clinical disease activity in UPIA. Ten recommendations on how to investigate and follow-up UPIA in the clinical setting were developed. They are evidence-based and supported by a large panel of rheumatologists, thus enhancing their validity and practical use.

Important challenges for coordination and inter-municipal cooperation in health care services: a Delphi study

PubMed Central

2013-01-01

Background Demographical changes have stimulated a coordination reform in the Norwegian health care sector, creating new working practices and extending coordination within and between primary and hospital care, increasing the need for inter-municipal cooperation (IMC). This study aimed to identify challenges to coordination and IMC in the Norwegian health care sector as a basis for further theorizing and managerial advice in this growing area of research and practice. Methods A Delphi study of consensus development was used. Experts in coordination and IMC in health care services were selected by the healthcare manager or the councillor in their respective municipalities. In the first round, an expert panel received open-ended questions addressing possible challenges, and their answers were categorized and consolidated as the basis for further validation in the second round. The expert panel members were then asked to point out important statements in the third round, before the most important statements ranked by a majority of the members were rated again in the fourth round, including the option to explain the ratings. The same procedure was used in round five, with the exception that the expert panel members could view the consolidated results of their previous rankings as the basis for a new and final rating. The statements reaching consensus in round five were abstracted and themed. Results Nineteen experts consented to participate. Nine experts (47%) completed all of the five rounds. Eight statements concerning coordination reached consensus, resulting in four themes covering these challenges: different culture, uneven balance of power, lack of the possibility to communicate electronically, and demanding tasks in relation to resources. Three statements regarding challenges to IMC reached consensus, resulting in following themes: coopetition, complex leadership, and resistance to change. Conclusions This study identified several important challenges for coordination and it supports previous research. IMC in health care services deals with challenges other than coordination, and these must be addressed specifically. Our study contributes to extended knowledge of theoretical and practical implications in the field of coordination and IMC in health care sector. PMID:24171839

Research priorities for multi-institutional collaborative research in surgical education.

PubMed

Stefanidis, Dimitrios; Cochran, Amalia; Sevdalis, Nick; Mellinger, John; Phitayakorn, Roy; Sullivan, Maura; Barney, Linda

2015-01-01

Research in surgical education has seen unprecedented growth but originates from single institutions and remains uncoordinated; this study aimed to generate a list of research priorities in surgical educational topics. The membership of the Association for Surgical Education was asked to submit up to 5 research questions concerned with multi-institutional collaborative surgical education research and to identify challenges faced by surgical education researchers. A modified Delphi methodology was used to create the research agenda based on these responses. Surgical educators responded to 3 survey rounds. Categories of submitted questions included teaching methods and curriculum development; assessment and competency; simulation; medical student preparation and selection; impact of work hour restrictions; and faculty development. Participants cited institutional culture and practice variability and lack of institutional review board coordination as common barriers to collaborative research, while identifying extensive planning, frequent communication, and availability of dedicated research coordinators as the most important facilitators. Using a Delphi methodology, a prioritized agenda for multi-institutional surgical education research was developed that may help advance surgeon education. Copyright © 2015 Elsevier Inc. All rights reserved.

Core competencies for emergency medicine clerkships: results of a Canadian consensus initiative.

PubMed

Penciner, Rick; Woods, Robert A; McEwen, Jill; Lee, Richard; Langhan, Trevor; Bandiera, Glen

2013-01-01

There is no consensus on what constitutes the core competencies for emergency medicine (EM) clerkship rotations in Canada. Existing EM curricula have been developed through informal consensus and often focus on EM content to be known at the end of training rather than what is an appropriate focus for a time-limited rotation in EM. We sought to define the core competencies for EM clerkship in Canada through consensus among an expert panel of Canadian EM educators. We used a modified Delphi method and the CanMEDS 2005 Physician Competency Framework to develop a consensus among expert EM educators from across Canada. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). A complete list of competencies is provided. This study established a national consensus defining the core competencies for EM clerkship in Canada.

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study

PubMed Central

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-01-01

Background The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. Objective This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. Design A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Results Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. Discussion and conclusions This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. PMID:27540101

Development of guidelines for giving community presentations about eating disorders: a Delphi study.

PubMed

Doley, Joanna Rachel; Hart, Laura Merilyn; Stukas, Arthur Anthony; Morgan, Amy Joanna; Rowlands, Danielle Lisa; Paxton, Susan Jessica

2017-01-01

Concerns exist around how to talk about eating disorders (EDs) due to evidence that suggests discussing ED symptoms and behaviours may cause or worsen symptoms in vulnerable people. Using expert consensus, we developed a set of guidelines for giving safe community presentations about EDs. Participants with professional ED expertise, and people with lived experience of an ED, were recruited for a Delphi study. N  = 26 panel members rated 367 statements for both a) inclusion in guidelines, and b) their potential to be helpful (increase knowledge, reduce stigma) or harmful (increase stigma, cause/worsen ED symptoms). After each round of the study, statements were classified as endorsed, re-rate, or not endorsed. 208 statements were endorsed by the panel over three rounds. 13 statements were strongly endorsed in the first round, with both people with lived experience and professionals agreeing it is important for presentations to include information on etiology of EDs and to promote help-seeking. Several statements had a high level of disagreement between those with lived experience and professionals, including the idea that presentations should suggest dieting is likely to result in weight gain. The experts were able to develop consensus on a wide range of issues. Panel members, particularly people with lived experience, were sensitive to aspects of presentations that may be harmful to an audience. The guidelines fill an important gap in the literature and provide guidance to those educating the public about EDs; they should, however, be further evaluated to test their efficacy.

Metadata-driven Delphi rating on the Internet.

PubMed

Deshpande, Aniruddha M; Shiffman, Richard N; Nadkarni, Prakash M

2005-01-01

Paper-based data collection and analysis for consensus development is inefficient and error-prone. Computerized techniques that could improve efficiency, however, have been criticized as costly, inconvenient and difficult to use. We designed and implemented a metadata-driven Web-based Delphi rating and analysis tool, employing the flexible entity-attribute-value schema to create generic, reusable software. The software can be applied to various domains by altering the metadata; the programming code remains intact. This approach greatly reduces the marginal cost of re-using the software. We implemented our software to prepare for the Conference on Guidelines Standardization. Twenty-three invited experts completed the first round of the Delphi rating on the Web. For each participant, the software generated individualized reports that described the median rating and the disagreement index (calculated from the Interpercentile Range Adjusted for Symmetry) as defined by the RAND/UCLA Appropriateness Method. We evaluated the software with a satisfaction survey using a five-level Likert scale. The panelists felt that Web data entry was convenient (median 4, interquartile range [IQR] 4.0-5.0), acceptable (median 4.5, IQR 4.0-5.0) and easily accessible (median 5, IQR 4.0-5.0). We conclude that Web-based Delphi rating for consensus development is a convenient and acceptable alternative to the traditional paper-based method.

Nursing diagnoses (NANDA-I) in hematology-oncology: a Delphi-study.

PubMed

Speksnijder, Herma T; Mank, Arno P; van Achterberg, Theo

2011-01-01

To identify NANDA-I diagnoses that are most relevant to hematology-oncology nursing in Europe. In a two-round, electronic, quantitative Delphi study, 28 experts from nine European countries assessed the relevance of NANDA-I diagnoses and health problems. This study identified 64 relevant diagnoses and three health problems. All experts listed 11 diagnoses: "imbalanced nutrition: less than body requirements,"diarrhea,"fatigue,"risk for bleeding,"risk for infection,"impaired oral mucous membrane,"risk for impaired skin integrity,"impaired skin integrity,"hyperthermia,"nausea,"acute pain," and the health problem "pruritis." The "NANDA-I classification 2009-2011" describes, in almost all disease- and treatment-related problems, nursing diagnoses as relevant to the adult patient with hematological malignancy. These diagnoses are therefore recommended. © 2011, The Authors. International Journal of Nursing Terminologies and Classifications © 2011, NANDA International.

Essential Concepts of Nanoscale Science and Technology for High School Students Based on a Delphi Study by the Expert Community

ERIC Educational Resources Information Center

Sakhnini, Sohair; Blonder, Ron

2015-01-01

Nanoscale science and technology (NST) is an important new field in modern science. In the current study, we seek to answer the question: "What are the essential concepts of NST that should be taught in high school"? A 3-round Delphi study methodology was applied based on 2 communities of experts in nanotechnology research and science…

Frontline over ivory tower: key competencies in community-based curricula.

PubMed

Millar, Adam; Malcolm, Janine; Cheng, Alice; Fine, Rebecca; Wong, Rene

2015-01-01

The Royal College of Physicians and Surgeons of Canada mandates that community experiences be incorporated into medicine-based specialties. Presently there is wide variability in community endocrine experiences across Canadian training programs. This is complicated by the paucity of literature providing guidance on what constitutes a 'community' rotation. A modified Delphi technique was used to determine the CanMEDS competencies best taught in a community endocrinology curriculum. The Delphi technique is a qualitative-research method that uses a series of questionnaires sent to a group of experts with controlled feedback provided by the researchers after each survey round. The experts in this study included endocrinology program directors, community endocrinologists, endocrinology residents and recent endocrinology graduates. Thirty four out of 44 competencies rated by the panel were deemed suitable for a community curriculum. The experts considered the "Manager" role best taught in the community, while they considered the community least suitable to learn the "Medical Expert" competency. To our knowledge, this is the first time the content of a community-based subspecialty curriculum was determined using the Delphi process in Canada. These findings suggest that community settings have potential to fill in gaps in residency training in regards to the CanMEDS Manager role. The results will aid program directors in designing competency-based community endocrinology rotations and competency-based community rotations in other medical subspecialty programs.

Development of a core outcome set for effectiveness trials aimed at optimising prescribing in older adults in care homes.

PubMed

Millar, Anna N; Daffu-O'Reilly, Amrit; Hughes, Carmel M; Alldred, David P; Barton, Garry; Bond, Christine M; Desborough, James A; Myint, Phyo K; Holland, Richard; Poland, Fiona M; Wright, David

2017-04-12

Prescribing medicines for older adults in care homes is known to be sub-optimal. Whilst trials testing interventions to optimise prescribing in this setting have been published, heterogeneity in outcome reporting has hindered comparison of interventions, thus limiting evidence synthesis. The aim of this study was to develop a core outcome set (COS), a list of outcomes which should be measured and reported, as a minimum, for all effectiveness trials involving optimising prescribing in care homes. The COS was developed as part of the Care Homes Independent Pharmacist Prescribing Study (CHIPPS). A long-list of outcomes was identified through a review of published literature and stakeholder input. Outcomes were reviewed and refined prior to entering a two-round online Delphi exercise and then distributed via a web link to the CHIPPS Management Team, a multidisciplinary team including pharmacists, doctors and Patient Public Involvement representatives (amongst others), who comprised the Delphi panel. The Delphi panellists (n = 19) rated the importance of outcomes on a 9-point Likert scale from 1 (not important) to 9 (critically important). Consensus for an outcome being included in the COS was defined as ≥70% participants scoring 7-9 and <15% scoring 1-3. Exclusion was defined as ≥70% scoring 1-3 and <15% 7-9. Individual and group scores were fed back to participants alongside the second questionnaire round, which included outcomes for which no consensus had been achieved. A long-list of 63 potential outcomes was identified. Refinement of this long-list of outcomes resulted in 29 outcomes, which were included in the Delphi questionnaire (round 1). Following both rounds of the Delphi exercise, 13 outcomes (organised into seven overarching domains: medication appropriateness, adverse drug events, prescribing errors, falls, quality of life, all-cause mortality and admissions to hospital (and associated costs)) met the criteria for inclusion in the final COS. We have developed a COS for effectiveness trials aimed at optimising prescribing in older adults in care homes using robust methodology. Widespread adoption of this COS will facilitate evidence synthesis between trials. Future work should focus on evaluating appropriate tools for these key outcomes to further reduce heterogeneity in outcome measurement in this context.

Defining a set of standardised outcome measures for newly diagnosed patients with multiple myeloma using the Delphi consensus method: the IMPORTA project.

PubMed

Blade, Joan; Calleja, Miguel Ángel; Lahuerta, Juan José; Poveda, José Luis; de Paz, Héctor David; Lizán, Luis

2018-02-22

To define a standard set of outcomes and the most appropriate instruments to measure them for managing newly diagnosed patients with multiple myeloma (MM). A literature review and five discussion groups facilitated the design of two-round Delphi questionnaire. Delphi panellists (haematologists, hospital pharmacists and patients) were identified by the scientific committee, the Spanish Program of Haematology Treatments Foundation, the Spanish Society of Hospital Pharmacies and the Spanish Community of Patients with MM. Panellist's perception about outcomes' suitability and feasibility of use was assessed on a seven-point Likert scale. Consensus was reached when at least 75% of the respondents reached agreement or disagreement. A scientific committee led the project. Fifty-one and 45 panellists participated in the first and second Delphi rounds, respectively. Consensus was reached to use overall survival, progression-free survival, minimal residual disease and treatment response to assess survival and disease control. Panellists agreed to measure health-related quality of life, pain, performance status, fatigue, psychosocial status, symptoms, self-perception on body image, sexuality and preferences/satisfaction. However, panellist did not reach consensus about the feasibility of assessing in routine practice psychosocial status, symptoms, self-perception on body image and sexuality. Consensus was reached to collect patient-reported outcomes through the European Organisation for the Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire (QLQ) Core questionnaire 30 (C30), three items from EORTC-QLQ-Multiple Myeloma (MY20) and EORTC-QLQ-Breast Cancer (BR23), pain Visual Analogue Scale, Morisky-Green and ad hoc questions about patients' preferences/satisfaction. A consensual standard set of outcomes for managing newly diagnosed patients with MM has been defined. The feasibility of its implementation in routine practice will be assessed in a future pilot study. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

The main indicators for Iranian hospital ethical accreditation

PubMed Central

ENJOO, SEYED ALI; AMINI, MITRA; TABEI, SEYED ZIAADIN; MAHBUDI, ALI; KAVOSI, ZAHRA; SABER, MAHBOOBEH

2015-01-01

Introduction The application of organizational ethics in hospitals is one of the novel ways to improve medical ethics. Nowadays achieving efficient and sufficient ethical hospital indicators seems to be inevitable. In this connection, the present study aims to determine the best indicators in hospital accreditation. Methods 69 indicators in 11 fields to evaluate hospital ethics were achieved through a five-step qualitative and quantitative study including literature review, expert focus group, Likert scale survey, 3 rounded Delphi, and content validity measurement. Expert focus group meeting was conducted, employing Nominal Group Technique (NGT). After running NGT, a three rounded Delphi and parallel to Delphi and a Likert scale survey were performed to obtain objective indicators for each domain. The experts were all healthcare professionals who were also medical ethics researchers, teachers, or PhD students. Content validity measurements were computed, using the viewpoints of two different expert groups, some ethicists, and some health care professionals (n=46). Results After conducting NGT, Delphi, Likert survey, 11 main domains were listed including:  Informed consent, Medical confidentiality, Physician-patient economic relations, Ethics consultation policy in the hospital, Ethical charter of hospital, Breaking bad medical news protocol, Respect for the patients’ rights, Clinical ethics committee, Spiritual and palliative care unit programs in the hospitals, Healthcare professionals’ communication skills, and Equitable access to the healthcare. Also 71 objective indicators for these 11 domains were listed in 11 tables with 5 to 8 indicators per table. Content Validity Ratio (CVR) measurements were done and 69 indicators were highlighted. Conclusion The domains listed in this study seem to be the most important ones for evaluating hospital ethics programs and services. Healthcare organizations’ accreditation and ranking are crucial for the improvement of healthcare services. Ethics programs would also motivate hospitals to improve their services and move towards patients’ satisfaction. In this regard, more involvement of bioethicists can help healthcare organizations to develop ethics programs and ensure ethics-based practice in hospitals. PMID:26269789

Defining the Bobath concept using the Delphi technique.

PubMed

Raine, Sue

2006-03-01

The Bobath concept, based on the work of Berta and Karel Bobath, offers therapists working in the field of neurological rehabilitation a framework for their clinical interventions. It is the most commonly used approach in the UK. Although they recognize that over the last half-century the concept has undergone considerable developments, proponents of the Bobath concept have been criticized for not publishing these changes. The aim of the present study was to use the Delphi technique to enable experts in the field to define the current Bobath concept. A four-round Delphi study design was used. The sample included all members of the British Bobath Tutor's Association, who are considered experts in the field. Initial statements were identified from the literature, with respondents generating additional statements during the study. The level of agreement was determined using a five-point Likert scale. The respondents were then provided with feedback on group opinions and given an opportunity to re-rate each statement. The level of group consensus was set at 80%. Fifteen experts took part. The response rate was 85% in the first round, and 93% in each subsequent round. Ten statements from the literature were rated with a further 12 generated by the experts. Thirteen statements achieved consensus for agreement and seven for disagreement. The Delphi study was an effective research tool, maintaining anonymity of responses and exploring expert opinions on the Bobath concept. The experts stated that Bobath's work has been misunderstood if it is considered as the inhibition of spasticity and the facilitation of normal movement, as described in some literature. They agreed that the Bobath concept was developed by the Bobaths as a living concept, understanding that as therapists' knowledge base grows their view of treatment broadens.

Research priorities in medical education at Shiraz University of Medical Sciences:categories and subcategories in the Iranian context

PubMed Central

NABEIEI, PARISA; AMINI, MITRA; GHANAVATI, SHIRIN; MARHAMATI, SAADAT

2016-01-01

Introduction Research in education is a globally significant issue without a long history. Due to the importance of the issue in Health System Development programs, this study intended to determine research priorities in medical education, considering their details and functions. By determining barriers existing in research in education progress, it is tried to make research priorities more functional by recommending acceptable strategies. Methods This is a qualitative-descriptive study in two descriptive phases. The goal of these phases was to determine research priorities subcategories in medical education by Nominal Group Technique (NGT) and two rounds of Delphi method. Through the first phase, subcategories of research priorities were determined, using Nominal Group Technique under medical education experts’ supervision. Through two rounds of Delphi, a questionnaire was constructed based on the subcategories. Eventually, research priorities were determined based on their highest score (scores more than 7 out of 10). Results In the first phase (NGT), 35 priorities in 5 major fields of medical education were presented. In the second phase, priorities were scored, using Delphi method. Medical Ethics and professionalism gained the highest scores (7.63±1.26) and educational evaluation the lowest (7.28±1.52). In this stage, 7 items were omitted but 2 of them were added again after experts’ revision in the third round of Delphi. Conclusion According to the results of the present study and based on previous studies, it really seems that the fields of “Learning and Teaching Approaches” and “Medical Ethics and Professionalism” were more important. Because of financial and resource limitations in our country and the importance of research priorities, it is recommended to frequently study “research priorities determination program” at universities. PMID:26793723

Association of Postoperative Readmissions With Surgical Quality Using a Delphi Consensus Process to Identify Relevant Diagnosis Codes.

PubMed

Mull, Hillary J; Graham, Laura A; Morris, Melanie S; Rosen, Amy K; Richman, Joshua S; Whittle, Jeffery; Burns, Edith; Wagner, Todd H; Copeland, Laurel A; Wahl, Tyler; Jones, Caroline; Hollis, Robert H; Itani, Kamal M F; Hawn, Mary T

2018-04-18

Postoperative readmission data are used to measure hospital performance, yet the extent to which these readmissions reflect surgical quality is unknown. To establish expert consensus on whether reasons for postoperative readmission are associated with the quality of surgery in the index admission. In a modified Delphi process, a panel of 14 experts in medical and surgical readmissions comprising physicians and nonphysicians from Veterans Affairs (VA) and private-sector institutions reviewed 30-day postoperative readmissions from fiscal years 2008 through 2014 associated with inpatient surgical procedures performed at a VA medical center between October 1, 2007, and September 30, 2014. The consensus process was conducted from January through May 2017. Reasons for readmission were grouped into categories based on International Classification of Diseases, Ninth Revision (ICD-9) diagnosis codes. Panelists were given the proportion of readmissions coded by each reason and median (interquartile range) days to readmission. They answered the question, "Does the readmission reason reflect possible surgical quality of care problems in the index admission?" on a scale of 1 (never related) to 5 (directly related) in 3 rounds of consensus building. The consensus process was completed in May 2017 and data were analyzed in June 2017. Consensus on proportion of ICD-9-coded readmission reasons that reflected quality of surgical procedure. In 3 Delphi rounds, the 14 panelists achieved consensus on 50 reasons for readmission; 12 panelists also completed group telephone calls between rounds 1 and 2. Readmissions with diagnoses of infection, sepsis, pneumonia, hemorrhage/hematoma, anemia, ostomy complications, acute renal failure, fluid/electrolyte disorders, or venous thromboembolism were considered associated with surgical quality and accounted for 25 521 of 39 664 readmissions (64% of readmissions; 7.5% of 340 858 index surgical procedures). The proportion of readmissions considered to be not associated with surgical quality varied by procedure, ranging from to 21% (613 of 2331) of readmissions after lower-extremity amputations to 47% (745 of 1598) of readmissions after cholecystectomy. One-third of postoperative readmissions are unlikely to reflect problems with surgical quality. Future studies should test whether restricting readmissions to those with specific ICD-9 codes might yield a more useful quality measure.

Validation of the process criteria for assessment of a hospital nursing service.

PubMed

Feldman, Liliane Bauer; Cunha, Isabel Cristina Kowal Olm; D'Innocenzo, Maria

2013-01-01

to validate an instrument containing process criteria for assessment of a hospital nursing service based on the National Accreditation Organization program. a descriptive, quantitative methodological study performed in stages. An instrument constructed with 69 process criteria was assessed by 49 nurses from accredited hospitals in 2009, according to a Likert scale, and validated by 16 judges through Delphi rounds in 2010. the original instrument assessed by nurses with 69 process criteria was judged by the degree of importance, and changed to 39 criteria. In the first Delphi round, the 39 criteria reached consensus among the 19 judges, with a medium reliability by Cronbach's alpha. In the second round, 40 converging criteria were validated by 16 judges, with high reliability. The criteria addressed management, costs, teaching, education, indicators, protocols, human resources, communication, among others. the 40 process criteria formed a validated instrument to assess the hospital nursing service which, when measured, can better direct interventions by nurses in reaching and strengthening outcomes.

Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature.

PubMed

Moreira, Danilo Gomes; Costello, Joseph T; Brito, Ciro J; Adamczyk, Jakub G; Ammer, Kurt; Bach, Aaron J E; Costa, Carlos M A; Eglin, Clare; Fernandes, Alex A; Fernández-Cuevas, Ismael; Ferreira, José J A; Formenti, Damiano; Fournet, Damien; Havenith, George; Howell, Kevin; Jung, Anna; Kenny, Glen P; Kolosovas-Machuca, Eleazar S; Maley, Matthew J; Merla, Arcangelo; Pascoe, David D; Priego Quesada, Jose I; Schwartz, Robert G; Seixas, Adérito R D; Selfe, James; Vainer, Boris G; Sillero-Quintana, Manuel

2017-10-01

The importance of using infrared thermography (IRT) to assess skin temperature (t sk ) is increasing in clinical settings. Recently, its use has been increasing in sports and exercise medicine; however, no consensus guideline exists to address the methods for collecting data in such situations. The aim of this study was to develop a checklist for the collection of t sk using IRT in sports and exercise medicine. We carried out a Delphi study to set a checklist based on consensus agreement from leading experts in the field. Panelists (n = 24) representing the areas of sport science (n = 8; 33%), physiology (n = 7; 29%), physiotherapy (n = 3; 13%) and medicine (n = 6; 25%), from 13 different countries completed the Delphi process. An initial list of 16 points was proposed which was rated and commented on by panelists in three rounds of anonymous surveys following a standard Delphi procedure. The panel reached consensus on 15 items which encompassed the participants' demographic information, camera/room or environment setup and recording/analysis of t sk using IRT. The results of the Delphi produced the checklist entitled "Thermographic Imaging in Sports and Exercise Medicine (TISEM)" which is a proposal to standardize the collection and analysis of t sk data using IRT. It is intended that the TISEM can also be applied to evaluate bias in thermographic studies and to guide practitioners in the use of this technique. Copyright © 2017 Elsevier Ltd. All rights reserved.

Considerations when conducting e-Delphi research: a case study.

PubMed

Toronto, Coleen

2017-06-22

Background E-Delphi is a way to access a geographically dispersed group of experts. It is similar to other Delphi methods but conducted online. E-research methodologies, such as the e-Delphi method, have yet to undergo significant critical discussion. Aim To highlight some of the challenges nurse researchers may wish to consider when using e-Delphi in their research. Discussion This paper provides details about the author's approach to conducting an e-Delphi study in which a group of health literacy nurse experts (n=41) used an online survey platform to identify and prioritise essential health literacy competencies for registered nurses. Conclusion This paper advances methodological discourse about e-Delphi by critically assessing an e-Delphi case study. The online survey platform used in this study was advantageous for the researcher and the experts: the experts could participate at any time and place where the internet was available; the researcher could efficiently access a national group of experts, track responses and analyse data in each round. Implications for practice E-Delphi studies create opportunities for nurse researchers to conduct research nationally and internationally. Before conducting an e-Delphi study, researchers should carefully consider the design and methods for collecting data, to avoid challenges that could potentially compromise the quality of the findings. Researchers are encouraged to publish details about their approaches to e-Delphi studies, to advance the state of the science.

A Delphi survey on diagnosis and management of stress velopharyngeal insufficiency in wind musicians.

PubMed

Evans, Alison; Driscoll, Tim; Ackermann, Bronwen

2014-10-01

The aim of this study was to identify current trends in clinical assessment and management of stress velopharyngeal insufficiency (VPI) in wind musicians. This was an online two-round Delphi survey of health practitioners familiar with assessing and treating musicians with stress VPI. Fourteen specialists (seven otolaryngologists and seven speech-language pathologists) from four countries participated in the Delphi survey. From the first round questionnaire, 32 items were identified as being causes, assessment tools, diagnostic indicators, and treatment methods for stress VPI. The second round questionnaire revealed that prolonged exposure to high intra-oral pressures was important in determining the cause of stress VPI. The most important assessment tools for stress VPI were case history and nasendoscopy. The most important indicator for stress VPI was self-reported symptoms. There was no clear agreement identified on the management methods for stress VPI for musicians. However, the trend followed by most of the survey participants was a combination of conservative management approaches (including rest or watch and wait, speech-language pathology intervention, velopharyngeal muscle training, and changes to the instrument or reed), and then, if symptoms persist, to use injection pharyngoplasty or pharyngeal flap. This survey demonstrates that no standard management protocol currently exists for musicians diagnosed with stress VPI, but provides current trends in the assessment and management which can be used in future guidelines for health professionals who treat wind musicians.

Development of an evidence-based protocol for care of pilonidal sinus wounds healing by secondary intent using a modified reactive Delphi procedure. Part one: the literature review*.

PubMed

Harris, Connie L; Holloway, Samantha

2012-04-01

This article is in two parts. The overall aim of this section was to review the literature in relation to pilonidal sinus wounds (PSW) healing by secondary intent for a Master's of Science in Wound Healing and Tissue Repair thesis. The purpose of the literature review was to determine if an evidence-based guideline or consensus document existed for the care of these wounds, and if not, to determine the topics from which to develop items for the first round of a modified reactive Delphi questionnaire. Part two will describe the iterative process, the analysis and the results. The review found no best practice guidelines concerning PSW, and only one clinical pathway. Seventeen areas of interest were identified that may contribute to optimal healing conditions or to delayed healing. These included microbiology of infected PSW, signs and symptoms of localised or deeper (spreading) chronic wound infection, swab for c&s, role of topical antiseptics or antimicrobials, systemic antibiotics, local wound interventions, optimal positioning, wound cleansing, principles of moist wound healing/dressing selection, topical negative pressure (TNP) therapy, peri-wound skin decontamination and depilation, pain control, physical activities, optimal nutrition and patient education. © 2011 The Authors. © 2011 Blackwell Publishing Ltd and Medicalhelplines.com Inc.

Improving care standards for patients with spinal trauma combining a modified e-Delphi process and stakeholder interviews: a study protocol.

PubMed

Sharwood, Lisa N; Stanford, Ralph; Middleton, James W; Burns, Brian; Joseph, Anthony; Flower, Oliver; Rigby, Oran; Ball, Jonathon; Dhaliwal, Shelly

2017-01-19

Around 300 people sustain a new traumatic spinal cord injury (TSCI) in Australia each year; a relatively low incidence injury with extremely high long-term associated costs. Care standards are inconsistent nationally, lacking in consensus across important components of care such as prehospital spinal immobilisation, timing of surgery and timeliness of transfer to specialist services. This study aims to develop 'expertly defined' and agreed standards of care across the majority of disciplines involved for these patients. A modified e-Delphi process will be used to gain consensus for best practice across specific clinical early care areas for the patient with TSCI; invited participants will include clinicians across Australia with relevant and significant expertise. A rapid literature review will identify available evidence, including any current guidelines from 2005 to 2015. Level and strength of evidence identified, including areas of contention, will be used to formulate the first round survey questions and statements. Participants will undertake 2-3 online survey rounds, responding anonymously to questionnaires regarding care practices and indicating their agreement or otherwise with practice standard statements. Relevant key stakeholders, including patients, will also be interviewed face to face. Ethics approval for this study was obtained by the NSW Population & Health Services Research Ethics Committee on 14 January 2016 (HREC/12/CIPHS/74). Seeking comprehensive understanding of how the variation in early care pathways and treatment can be addressed to achieve optimal patient outcomes and economic costs; the overall aim is the agreement to a consistent approach to the triage, treatment, transport and definitive care of acute TSCI victims. The agreed practice standards of care will inform the development of a Clinical Pathway with practice change strategies for implementation. These standards will offer a benchmark for state-wide and potentially national policy. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study.

PubMed

Gagliardi, Diana; Rondinone, Bruna M; Mirabile, Marco; Buresti, Giuliana; Ellwood, Peter; Hery, Michel; Paszkiewicz, Peter; Valenti, Antonio; Iavicoli, Sergio

2017-06-23

This study, developed within the frame of the Partnership for European Research on Occupational Safety and Health joint research activities and based on the frame designed by the 2013 European Agency for Safety and Health at Work (EU-OSHA) study, is the first example of using the points of view of European occupational safety and health (OSH) researchers.The objective is to identify priorities for OSH research that may contribute to the achievement of present and future sustainable growth objectives set by the European strategies. The study was carried out using a modified Delphi method with a two-round survey. Each round involved a panel of about 110 researchers representing the network member institutes was selected according to specific criteria, including the ownership of research expertise in at least one of the four macroareas identified by the reference report developed by EU-OSHA in 2013. The study identified some innovative research topics (for example, 'Emerging technological devices' and 'OSH consequences of markets integration') and research priorities (ie, crowdsourcing, e-work, zero-hours contract s ) that are not reflected in previous studies of this nature.The absence of any reference to violence and harassment at work among the researchers' proposals is a major difference from previous similar studies, while topics related to gender issues and electromagnetic fields show a lower importance. The innovative design of a research priorities identification process, which takes advantage of a large, representative and qualified panel of European researchers allowed the definition of a number of research priorities able to support the inclusion of innovative OSH research issues in the scope of the next European research agenda. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A cross-validation Delphi method approach to the diagnosis and treatment of personality disorders in older adults.

PubMed

Rosowsky, Erlene; Young, Alexander S; Malloy, Mary C; van Alphen, S P J; Ellison, James M

2018-03-01

The Delphi method is a consensus-building technique using expert opinion to formulate a shared framework for understanding a topic with limited empirical support. This cross-validation study replicates one completed in the Netherlands and Belgium, and explores US experts' views on the diagnosis and treatment of older adults with personality disorders (PD). Twenty-one geriatric PD experts participated in a Delphi survey addressing diagnosis and treatment of older adults with PD. The European survey was translated and administered electronically. First-round consensus was reached for 16 out of 18 items relevant to diagnosis and specific mental health programs for personality disorders in older adults. Experts agreed on the usefulness of establishing criteria for specific types of treatments. The majority of psychologists did not initially agree on the usefulness of pharmacotherapy. Expert consensus was reached following two subsequent rounds after clarification addressing medication use. Study results suggest consensus among regarding psychosocial treatments. Limited acceptance amongst US psychologists about the suitability of pharmacotherapy for late-life PDs contrasted with the views expressed by experts surveyed in Netherlands and Belgium studies.

Standardized reporting guidelines for emergency department syncope risk-stratification research.

PubMed

Sun, Benjamin C; Thiruganasambandamoorthy, Venkatesh; Cruz, Jeffrey Dela

2012-06-01

There is increasing research interest in the risk stratification of emergency department (ED) syncope patients. A major barrier to comparing and synthesizing existing research is wide variation in the conduct and reporting of studies. The authors wanted to create standardized reporting guidelines for ED syncope risk-stratification research using an expert consensus process. In that pursuit, a panel of syncope researchers was convened and a literature review was performed to identify candidate reporting guideline elements. Candidate elements were grouped into four sections: eligibility criteria, outcomes, electrocardiogram (ECG) findings, and predictors. A two-round, modified Delphi consensus process was conducted using an Internet-based survey application. In the first round, candidate elements were rated on a five-point Likert scale. In the second round, panelists rerated items after receiving information about group ratings from the first round. Items that were rated by >80% of the panelists at the two highest levels of the Likert scale were included in the final guidelines. There were 24 panelists from eight countries who represented five clinical specialties. The panel identified an initial set of 183 candidate elements. After two survey rounds, the final reporting guidelines included 92 items that achieved >80% consensus. These included 10 items for study eligibility, 23 items for outcomes, nine items for ECG abnormalities, and 50 items for candidate predictors. Adherence to these guidelines should facilitate comparison of future research in this area. © 2012 by the Society for Academic Emergency Medicine.

Critical care nursing interventions and the time required for their completion in Intensive Care Units: A Delphi study.

PubMed

Palomar-Aumatell, Xavier; Subirana-Casacuberta, Mireia; Mila-Villarroel, Raimon

2017-12-01

To determine which interventions within the Nursing Interventions Classification are most often applied in intensive care units and to validate the time required for each. A three-stage e-Delphi was conducted; 21 panelists were recruited, seven manager nurses and 14 clinical nurses with higher degrees and more than five years experience in intensive care nursing. The first round explored the most common interventions applied. Additionally, panelists were asked to propose others. In the second round, participants reflected on the interventions where no consensus was reached as well as to estimate the time required for each intervention. In the third, panelists were queried about the time required for the interventions for which consensus regarding the time was not reached. A total of 183 interventions were included; 50% of the "Physiological: Complex" domain. The list included 52 (90%) of the 58 "core interventions for critical care nursing" identified in the Nursing Interventions Classification. The time required for 89.1% of the interventions was the same as in the Nursing Interventions Classification seminal work recommendations. Results provide a clear picture of nursing activity in general intensive care units, allows to tailor the Nursing Intervetions Classification in Catalonia context and to confirm findings of previous studies. Copyright © 2017 Elsevier Ltd. All rights reserved.

International consensus on the most useful physical examination tests used by physiotherapists for patients with headache: A Delphi study.

PubMed

Luedtke, K; Boissonnault, W; Caspersen, N; Castien, R; Chaibi, A; Falla, D; Fernández-de-Las-Peñas, C; Hall, T; Hirsvang, J R; Horre, T; Hurley, D; Jull, G; Krøll, L S; Madsen, B K; Mallwitz, J; Miller, C; Schäfer, B; Schöttker-Königer, T; Starke, W; von Piekartz, H; Watson, D; Westerhuis, P; May, A

2016-06-01

A wide range of physical tests have been published for use in the assessment of musculoskeletal dysfunction in patients with headache. Which tests are used depends on a physiotherapist's clinical and scientific background as there is little guidance on the most clinically useful tests. To identify which physical examination tests international experts in physiotherapy consider the most clinically useful for the assessment of patients with headache. Delphi survey with pre-specified procedures based on a systematic search of the literature for physical examination tests proposed for the assessment of musculoskeletal dysfunction in patients with headache. Seventeen experts completed all three rounds of the survey. Fifteen tests were included in round one with eleven additional tests suggested by the experts. Finally eleven physical examination tests were considered clinically useful: manual joint palpation, the cranio-cervical flexion test, the cervical flexion-rotation test, active range of cervical movement, head forward position, trigger point palpation, muscle tests of the shoulder girdle, passive physiological intervertebral movements, reproduction and resolution of headache symptoms, screening of the thoracic spine, and combined movement tests. Eleven tests are suggested as a minimum standard for the physical examination of musculoskeletal dysfunctions in patients with headache. Copyright © 2016 Elsevier Ltd. All rights reserved.

Integrating Palliative Care Into Comprehensive Cancer Centers: Consensus-Based Development of Best Practice Recommendations

PubMed Central

Stiel, Stephanie; Simon, Steffen T.; Schmitz, Andrea; van Oorschot, Birgitt; Stachura, Peter; Ostgathe, Christoph

2016-01-01

Background. International associations admit that specialized palliative care (SPC) is an obvious component of excellent cancer care. Nevertheless, gaps in integration at the international level have been identified. Recommendations for integrating SPC in clinical care, research, and education are needed, which are subject of the present study. Materials and Methods. A Delphi study, with three written Delphi rounds, including a face-to-face-meeting with a multiprofessional expert panel (n = 52) working in SPC in 15 German Comprehensive Cancer Centers (CCCs) funded by the German Cancer Aid was initiated. Initial recommendations are built on evidence-based literature. Consensus was defined in advance with ≥80% agreement based on the question of whether each recommendation was unambiguously formulated, relevant, and realizable for a CCC. Results. A total of 38 experts (73.1%) from 15 CCCs performed all three Delphi rounds. Consensus was achieved for 29 of 30 recommendations. High agreement related to having an organizationally and spatially independent palliative care unit (≥6 beds), a mobile multiprofessional SPC team, and cooperation with community-based SPC. Until round 3, an ongoing discussion was registered on hospice volunteers, a chair of palliative care, education in SPC among staff in emergency departments, and integration of SPC in decision-making processes such as tumor boards or consultation hours. Integration of SPC in decision-making processes was not consented by a low-rated feasibility (76.3%) due to staff shortage. Conclusion. Recommendations should be considered when developing standards for cancer center of excellence in Germany. Definition and implementation of indicators of integration of SPC in CCCs and evaluation of its effectiveness are current and future challenges. Implications for Practice: General and specialized palliative care (SPC) is an integral part of comprehensive cancer care. However, significant diversity concerning the design of SPC in the German Comprehensive Cancer Center (CCC) Network led to the establishment of consensual best practice recommendations for integration of SPC into the clinical structures, processes, research, and education throughout the CCC network. The recommendations contribute to a greater awareness relating to the strategic direction and development of SPC in CCCs. The access to information about SPC and access to offers regarding SPC shall be facilitated by implementing the recommendations in the course of treatment of patients with cancer. PMID:27440065

Judgment skills, a missing component in health literacy: development of a tool for asthma patients in the Italian-speaking region of Switzerland.

PubMed

Moreno Londoño, Ana Maria; Schulz, Peter J

2014-04-01

Health literacy has been recognized as an important factor influencing health behaviors and health outcomes. However, its definition is still evolving, and the tools available for its measurement are limited in scope. Based on the conceptualization of health literacy within the Health Empowerment Model, the present study developed and validated a tool to assess patient's health knowledge use, within the context of asthma self-management. A review of scientific literature on asthma self-management, and several interviews with pulmonologists and asthma patients were conducted. From these, 19 scenarios with 4 response options each were drafted and assembled in a scenario-based questionnaire. Furthermore, a three round Delphi procedure was carried out, to validate the tool with the participation of 12 specialists in lung diseases. The face and content validity of the tool were achieved by face-to-face interviews with 2 pulmonologists and 5 patients. Consensus among the specialists on the adequacy of the response options was achieved after the three round Delphi procedure. The final tool has a 0.97 intra-class correlation coefficient (ICC), indicating a strong level of agreement among experts on the ratings of the response options. The ICC for single scenarios, range from 0.92 to 0.99. The newly developed tool provides a final score representing patient's health knowledge use, based on the specialist's consensus. This tool contributes to enriching the measurement of a more advanced health literacy dimension.

Components of cognitive competence predictive of occupational competence in persons with dementia: a Delphi study.

PubMed

Zur, Briana M; Rudman, Debbie Laliberte; Johnson, Andrew M; Roy, Eric A; Wells, Jennie L

2013-04-01

Within the area of dementia care, occupational therapists are asked to predict occupational competence in everyday living and often do so by assessing cognitive competence. Considering the cognitive changes that occur with dementia over time, the construct of cognitive competence is a key consideration. Still, a gap exists in the literature examining the relationship between cognitive competence and occupational competence. This study developed a consensus among participating Canadian occupational therapists regarding the components of cognitive competence they considered essential to predict occupational competence in people with dementia. A three-round Delphi study was completed with English- and French-speaking occupational therapists (n = 127; 116; 125) experienced in dementia care. Ten cognitive components were identified as essential to predict occupational competence in individuals with dementia. The 10 identified components provide direction for assessment practices and education in dementia care and for development of measurement tools.

Components of a Measure to Describe Organizational Culture in Academic Pharmacy.

PubMed

Desselle, Shane; Rosenthal, Meagen; Holmes, Erin R; Andrews, Brienna; Lui, Julia; Raja, Leela

2017-12-01

Objective. To develop a measure of organizational culture in academic pharmacy and identify characteristics of an academic pharmacy program that would be impactful for internal (eg, students, employees) and external (eg, preceptors, practitioners) clients of the program. Methods. A three-round Delphi procedure of 24 panelists from pharmacy schools in the U.S. and Canada generated items based on the Organizational Culture Profile (OCP), which were then evaluated and refined for inclusion in subsequent rounds. Items were assessed for appropriateness and impact. Results. The panel produced 35 items across six domains that measured organizational culture in academic pharmacy: competitiveness, performance orientation, social responsibility, innovation, emphasis on collegial support, and stability. Conclusion. The items generated require testing for validation and reliability in a large sample to finalize this measure of organizational culture.

[A Delphi Method Survey of the Core Competences of Post-Acute-Care Nurses in Caring for Acute Stroke Patients].

PubMed

Chi, Shu-Ching; Yeh, Lily; Lu, Meei-Shiow; Lin, Pei-Yu

2015-12-01

Post-acute care (PAC) service is becoming increasingly important in Taiwan as a core focus of government policies that are designed to ensure continuity of care. In order to improve PAC nursing education and quality of care, the present study applies a modified Delphi method to identify the core competences of nurses who provide PAC services to acute stroke patients. We surveyed 18 experts in post-acute care and long-term care anonymously using a 29-question questionnaire in order to identify the essential professional skills that are required to perform PAC effectively. The results of this survey indicate that the core competences of PAC may be divided into two categories: Case Management and Care Management. Case Management includes Direct Care, Communication, Health Care Education, Nursing Consulting, and Family Assessment & Health Care. Care Management includes Interdisciplinary Teamwork, Patient Care Management, and Resource Integration. The importance and practicality of each item was evaluated using a 7-point Likert scale. The experts required 2 rounds to reach a consensus about the importance and 3 rounds to determine the practicality of PAC core competences. This process highlighted the differing points of view that are held by professionals in the realms of nursing, medicine, and national health policy. The PAC in-job training program in its current form inadequately cul-tivates core competence in Care Management. The results of the present study may be used to inform the development of PAC nurse orientation training programs and continuing education courses.

The Safety of Appropriate Use of Over-the-Counter Proton Pump Inhibitors: An Evidence-Based Review and Delphi Consensus.

PubMed

Johnson, David A; Katz, Philip O; Armstrong, David; Cohen, Henry; Delaney, Brendan C; Howden, Colin W; Katelaris, Peter; Tutuian, Radu I; Castell, Donald O

2017-04-01

The availability of over-the-counter (OTC) proton pump inhibitors (PPIs) for the short-term (2 weeks) management of frequent heartburn (≥2 days/week) has increased markedly, yet evidence-based recommendations have not been developed. A panel of nine international experts in gastroesophageal reflux disease developed consensus statements regarding the risks and benefits of OTC PPIs using a modified Delphi process. Consensus (based on ≥80% approval) was reached through multiple rounds of remote voting and a final round of live voting. To identify relevant data, the available literature was searched and summarized. Grading of Recommendations, Assessment, Development and Evaluation (GRADE) system terminology was used to rate the quality of evidence and strength of recommendations; consensus was based on ≥2/3 agreement. After 4 rounds of review, consensus was achieved for 18 statements. Notably, the available data did not directly reflect OTC use, but instead, prescription use; therefore, extrapolations to the OTC setting were often necessary. This limitation is regrettable, but it justifies performing this exercise to provide evidence-based expert opinion on a widely used class of drugs. The panel determined that using OTC PPIs according to label instructions is unlikely to mask the symptoms of esophageal or gastric cancer or adversely impact the natural history of related precursor conditions. OTC PPIs are not expected to substantially affect micronutrient absorption or bone mineral density or cause community-acquired pneumonia, Clostridium difficile infection, or cardiovascular adverse events. However, OTC PPI use may be associated with slightly increased risks for infectious diarrhea, certain idiosyncratic reactions, and cirrhosis-related spontaneous bacterial peritonitis. The available evidence does not suggest that OTC PPI use consistent with label instructions is associated with substantial health risks. To minimize potential risks, healthcare professionals and consumers must actively participate in decision making when managing reflux-related symptoms in the self-care setting.

Study plan to identify long term national telecommunications need and priorities applying Delphi techniques (handbook). [technological forecasting - United States of America

NASA Technical Reports Server (NTRS)

1974-01-01

A handbook that explains the basic Delphi methodology and discusses modified Delphi techniques is presented. The selection of communications experts to participate in a study, the construction of questionnaires on potential communications developments, and requisite technology is treated. No two modified Delphi studies were the same, which reflects the flexibility and adaptability of the technique. Each study must be specifically tailored to a particular case, and consists of seeking a consensus of opinion among experts about a particular subject and attendant conditions that may prevail in the future.

Establishing nursing-sensitive quality indicators for the operating room: A cross-sectional Delphi survey conducted in China.

PubMed

Wu, Qi; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-01-01

Nursing-sensitive quality indicators comprise principles, procedures, and assessments to quantify the level of nursing quality in hospital departments. Although studies have demonstrated that quality indicators are essential for monitoring nursing practice in the operating room (OR), nursing quality in China is highly subjective and localised OR nursing-sensitive quality indicators are lacking. This study aimed to establish scientific, objective and comprehensive nursing-sensitive quality indicators for the OR to evaluate and monitor OR nursing care quality in China. Literature search for relevant evidence-based studies was performed using Cochrane, Medline, PubMed, Embase, and other databases, followed by literature review and group discussion by the expert panel. Two successive rounds of Delphi surveys were conducted using questionnaires completed by the expert panel to reach consensus and define nursing-sensitive quality indicators for the OR. Two rounds of Delphi surveys each had 100% questionnaire retrieval rate, with Kendall W coordination coefficients ranging from 0.096 to 0.263 (P<0.001). In round 1 of expert evaluation of 26 indicators, Kendall's W was 0.263 for importance, 0.126 for rationality, and 0.125 for feasibility of data collection (all P<0.001). After round 2, 23 items were established as OR nursing-sensitive quality indicators, including rates of work time wastage, surgery start-time delay, OR turnover time between surgeries, same-day surgery cancellation, and number of monthly surgeries in each OR; checking surgical patients, surgery site marking, allergy history, and antibiotics use 60min before incision; and also assessing expected surgical time, sterilisation indicator results, availability of surgical instruments and materials, and instrument count. Scientific, practical, and reliable OR nursing-sensitive quality indicators can be established based on evidence-based studies and expert consensus using the Delphi method. The quality indicators developed in this study may provide an objective and quantitative reference for evaluating nursing quality in Chinese ORs. Copyright © 2016 Australian College of Critical Care Nurses Ltd. Published by Elsevier Ltd. All rights reserved.

Criteria required for an acceptable point-of-care test for UTI detection: Obtaining consensus using the Delphi technique.

PubMed

Weir, Nichola-Jane M; Pattison, Sally H; Kearney, Paddy; Stafford, Bob; Gormley, Gerard J; Crockard, Martin A; Gilpin, Deirdre F; Tunney, Michael M; Hughes, Carmel M

2018-01-01

Urinary Tract Infections (UTIs) are common bacterial infections, second only to respiratory tract infections and particularly prevalent within primary care. Conventional detection of UTIs is culture, however, return of results can take between 24 and 72 hours. The introduction of a point of care (POC) test would allow for more timely identification of UTIs, facilitating improved, targeted treatment. This study aimed to obtain consensus on the criteria required for a POC UTI test, to meet patient need within primary care. Criteria for consideration were compiled by the research team. These criteria were validated through a two-round Delphi process, utilising an expert panel of healthcare professionals from across Europe and United States of America. Using web-based questionnaires, panellists recorded their level of agreement with each criterion based on a 5-point Likert Scale, with space for comments. Using median response, interquartile range and comments provided, criteria were accepted/rejected/revised depending on pre-agreed cut-off scores. The first round questionnaire presented thirty-three criteria to the panel, of which 22 were accepted. Consensus was not achieved for the remaining 11 criteria. Following response review, one criterion was removed, while after revision, the remaining 10 criteria entered the second round. Of these, four were subsequently accepted, resulting in 26 criteria considered appropriate for a POC test to detect urinary infections. This study generated an approved set of criteria for a POC test to detect urinary infections. Criteria acceptance and comments provided by the healthcare professionals also supports the development of a multiplex point of care UTI test.

A tool to support meaningful person-centred activity for clients with dementia - a Delphi study.

PubMed

Lloyd, Barbara; Stirling, Christine

2015-01-01

This paper reports on a study to validate the concept of the 'Activity Support Tool' that aimed to assist dementia service workers to identify and act upon the support needs of people with dementia living alone, in line with the person-centred ideal. The tool was part of a two-stage exploratory qualitative study, which used interview and observational data from seven people with dementia living alone. Findings highlighted that people with dementia use objects and spaces within their homes to maintain or re-enact identities from the past. Thematic results from interviews were translated into a tool, with construct validation using the Delphi technique. Eighteen expert health professionals received round one of the questionnaire and six participants completed round three. The first round directed our focus towards operationalizing the person-centred ideal of dementia care. The tool was considered by almost all advisory panel members to be a potentially valuable resource for helping to address impediments to integrated, effective and person-centred dementia care. Specific strengths identified were simplicity, person-centeredness and applicability across service settings. Issues of concern included practicability, risk management, gender stereotyping and terminology. The results support the findings of previous research into the intuitive and ethical appeal, but problematic applicability, of person-centred dementia services. Health professionals with a range of service-related expertise found the concept of person-centred care compelling, but required tangible, enduring structures to translate the ideal into practical action. The tool now requires further research to test its usefulness in practice.

Supporting the Evaluation and Implementation of Musculoskeletal Models of Care: A Globally Informed Framework for Judging Readiness and Success.

PubMed

Briggs, Andrew M; Jordan, Joanne E; Jennings, Matthew; Speerin, Robyn; Bragge, Peter; Chua, Jason; Woolf, Anthony D; Slater, Helen

2017-04-01

To develop a globally informed framework to evaluate readiness for implementation and success after implementation of musculoskeletal models of care (MOCs). Three phases were undertaken: 1) a qualitative study with 27 Australian subject matter experts (SMEs) to develop a draft framework; 2) an eDelphi study with an international panel of 93 SMEs across 30 nations to evaluate face validity, and refine and establish consensus on the framework components; and 3) translation of the framework into a user-focused resource and evaluation of its acceptability with the eDelphi panel. A comprehensive evaluation framework was developed for judging the readiness and success of musculoskeletal MOCs. The framework consists of 9 domains, with each domain containing a number of themes underpinned by detailed elements. In the first Delphi round, scores of "partly agree" or "completely agree" with the draft framework ranged 96.7%-100%. In the second round, "essential" scores ranged 58.6%-98.9%, resulting in 14 of 34 themes being classified as essential. SMEs strongly agreed or agreed that the final framework was useful (98.8%), usable (95.1%), credible (100%) and appealing (93.9%). Overall, 96.3% strongly supported or supported the final structure of the framework as it was presented, while 100%, 96.3%, and 100% strongly supported or supported the content within the readiness, initiating implementation, and success streams, respectively. An empirically derived framework to evaluate the readiness and success of musculoskeletal MOCs was strongly supported by an international panel of SMEs. The framework provides an important internationally applicable benchmark for the development, implementation, and evaluation of musculoskeletal MOCs. © 2016, American College of Rheumatology.

Optimising perioperative care for hip and knee arthroplasty in South Africa: a Delphi consensus study.

PubMed

Plenge, U; Nortje, M B; Marais, L C; Jordaan, J D; Parker, R; van der Westhuizen, N; van der Merwe, J F; Marais, J; September, W V; Davies, G L; Pretorius, T; Solomon, C; Ryan, P; Torborg, A M; Farina, Z; Smit, R; Cairns, C; Shanahan, H; Sombili, S; Mazibuko, A; Hobbs, H R; Porrill, O S; Timothy, N E; Siebritz, R E; van der Westhuizen, C; Troskie, A J; Blake, C A; Gray, L A; Munting, T W; Steinhaus, H K S; Rowe, P; van der Walt, J G; Isaacs Noordien, R; Theron, A; Biccard, B M

2018-05-09

A structured approach to perioperative patient management based on an enhanced recovery pathway protocol facilitates early recovery and reduces morbidity in high income countries. However, in low- and middle-income countries (LMICs), the feasibility of implementing enhanced recovery pathways and its influence on patient outcomes is scarcely investigated. To inform similar practice in LMICs for total hip and knee arthroplasty, it is necessary to identify potential factors for inclusion in such a programme, appropriate for LMICs. Applying a Delphi method, 33 stakeholders (13 arthroplasty surgeons, 12 anaesthetists and 8 physiotherapists) from 10 state hospitals representing 4 South African provinces identified and prioritised i) risk factors associated with poor outcomes, ii) perioperative interventions to improve outcomes and iii) patient and clinical outcomes necessary to benchmark practice for patients scheduled for primary elective unilateral total hip and knee arthroplasty. Thirty of the thirty-three stakeholders completed the 3 months Delphi study. The first round yielded i) 36 suggestions to preoperative risk factors, ii) 14 (preoperative), 18 (intraoperative) and 23 (postoperative) suggestions to best practices for perioperative interventions to improve outcomes and iii) 25 suggestions to important postsurgical outcomes. These items were prioritised by the group in the consecutive rounds and consensus was reached for the top ten priorities for each category. The consensus derived risk factors, perioperative interventions and important outcomes will inform the development of a structured, perioperative multidisciplinary enhanced patient care protocol for total hip and knee arthroplasty. It is anticipated that this study will provide the construct necessary for developing pragmatic enhanced care pathways aimed at improving patient outcomes after arthroplasty in LMICs.

European neonatal intensive care nursing research priorities: an e-Delphi study.

PubMed

Wielenga, Joke M; Tume, Lyvonne N; Latour, Jos M; van den Hoogen, Agnes

2015-01-01

This study aimed to identify and prioritise neonatal intensive care nursing research topics across Europe using an e-Delphi technique. An e-Delphi technique with three questionnaire rounds was performed. Qualitative responses of round one were analysed by content analysis and research statements were generated to be ranged on importance on a scale of 1-6 (not important to most important). Neonatal intensive care units (NICUs) in 17 European countries. NICU clinical nurses, managers, educators and researchers (n=75). None. A list of 43 research statements in eight domains. The six highest ranking statements (≥5.0 mean score) were related to prevention and reduction of pain (mean 5.49; SD 1.07), medication errors (mean 5.20; SD 1.13), end-of-life care (mean 5.05; SD 1.18), needs of parents and family (mean 5.04; SD 1.23), implementing evidence into nursing practice (mean 5.02; SD 1.03), and pain assessment (mean 5.02; SD 1.11). The research domains were prioritised and ranked: (1) pain and stress; (2) family centred care; (3) clinical nursing care practices; (4) quality and safety; (5) ethics; (6) respiratory and ventilation; (7) infection and inflammation; and (8) professional issues in neonatal intensive care nursing. The results of this study might support developing a nursing research strategy for the nursing section of the European Society of Paediatric and Neonatal Intensive Care. In addition, this may promote more European researcher collaboratives for neonatal nursing research. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Global health resource utilization associated with pacemaker complications.

PubMed

Waweru, Catherine; Steenrod, Anna; Wolff, Claudia; Eggington, Simon; Wright, David Jay; Wyrwich, Kathleen W

2017-07-01

To estimate health resource utilization (HRU) associated with the management of pacemaker complications in various healthcare systems. Electrophysiologists (EPs) from four geographical regions (Western Europe, Australia, Japan, and North America) were invited to participate. Survey questions focused on HRU in the management of three chronic pacemaker complications (i.e. pacemaker infections requiring extraction, lead fractures/insulation breaches requiring replacement, and upper extremity deep venous thrombosis [DVT]). Panelists completed a maximum of two web-based surveys (iterative rounds). Mean, median values, and interquartile ranges were calculated and used to establish consensus. Overall, 32 and 29 panelists participated in the first and second rounds of the Delphi panel, respectively. Consensus was reached on treatment and HRU associated with a typical pacemaker implantation and complications. HRU was similar across regions, except for Japan, where panelists reported the longest duration of hospital stay in all scenarios. Infections were the most resource-intensive complications and were characterized by intravenous antibiotics days of 9.6?13.5 days and 21.3?29.2 days for pocket and lead infections respectively; laboratory and diagnostic tests, and system extraction and replacement procedures. DVT, on the other hand, was the least resource intensive complication. The results of the panel represent the views of the respondents who participated and may not be generalizable outside of this panel. The surveys were limited in scope and, therefore, did not include questions on management of acute complications (e.g. hematoma, pneumothorax). The Delphi technique provided a reliable and efficient approach to estimating resource utilization associated with chronic pacemaker complications. Estimates from the Delphi panel can be used to generate costs of pacemaker complications in various regions.

Reaching consensus on the physiotherapeutic management of patients following upper abdominal surgery: a pragmatic approach to interpret equivocal evidence.

PubMed

Hanekom, Susan D; Brooks, Dina; Denehy, Linda; Fagevik-Olsén, Monika; Hardcastle, Timothy C; Manie, Shamila; Louw, Quinette

2012-02-06

Postoperative pulmonary complications remain the most significant cause of morbidity following open upper abdominal surgery despite advances in perioperative care. However, due to the poor quality primary research uncertainty surrounding the value of prophylactic physiotherapy intervention in the management of patients following abdominal surgery persists. The Delphi process has been proposed as a pragmatic methodology to guide clinical practice when evidence is equivocal. The objective was to develop a clinical management algorithm for the post operative management of abdominal surgery patients. Eleven draft algorithm statements extracted from the extant literature by the primary research team were verified and rated by scientist clinicians (n=5) in an electronic three round Delphi process. Algorithm statements which reached a priori defined consensus-semi-interquartile range (SIQR)<0.5-were collated into the algorithm. The five panelists allocated to the abdominal surgery Delphi panel were from Australia, Canada, Sweden, and South Africa. The 11 draft algorithm statements were edited and 5 additional statements were formulated. The panel reached consensus on the rating of all statements. Four statements were rated essential. An expert Delphi panel interpreted the equivocal evidence for the physiotherapeutic management of patients following upper abdominal surgery. Through a process of consensus a clinical management algorithm was formulated. This algorithm can now be used by clinicians to guide clinical practice in this population.

What should be included in the assessment of laypersons' paediatric basic life support skills? Results from a Delphi consensus study.

PubMed

Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim; Bohnstedt, Cathrine; Sønderskov, Claus; Østergaard, Doris; Tolsgaard, Martin Grønnebæk

2018-01-18

Assessment of laypersons' Paediatric Basic Life Support (PBLS) skills is important to ensure acquisition of effective PBLS competencies. However limited evidence exists on which PBLS skills are essential for laypersons. The same challenges exist with respect to the assessment of foreign body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts suggested items to assess laypersons' PBLS and FBAOM skills. In the second round, the suggested items received comments from and were rated by 26 experts (93%) on a 5-point scale (1 = not relevant to 5 = essential). Revised items were anonymously presented in a third round for comments and 23 (82%) experts completed a re-rating. Items with a score above 3 by more than 80% of the experts in the third round were included in an assessment instrument. In the first round, 19 and 15 items were identified to assess PBLS and FBAOM skills, respectively. The ratings and comments from the last two rounds resulted in nine and eight essential assessment items for PBLS and FBAOM skills, respectively. The PBLS items included: "Responsiveness"," Call for help", "Open airway"," Check breathing", "Rescue breaths", "Compressions", "Ventilations", "Time factor" and "Use of AED". The FBAOM items included: "Identify different stages of foreign body airway obstruction", "Identify consciousness", "Call for help", "Back blows", "Chest thrusts/abdominal thrusts according to age", "Identify loss of consciousness and change to CPR", "Assessment of breathing" and "Ventilation". For assessment of laypersons some PBLS and FBAOM skills described in guidelines are more important than others. Four out of nine of PBLS skills focus on airway and breathing skills, supporting the major importance of these skills for laypersons' resuscitation attempts. International consensus on how to assess laypersons' paediatric basic life support and foreign body airway obstruction management skills was established. The assessment of these skills may help to determine when laypersons have acquired competencies. Not relevant.

A definition for aggressive disease in patients with HER-2 negative metastatic breast cancer: an expert consensus of the Spanish Society of Medical Oncology (SEOM).

PubMed

González, A; Lluch, A; Aba, E; Albanell, J; Antón, A; Álvarez, I; Ayala, F; Barnadas, A; Calvo, L; Ciruelos, E; Cortés, J; de la Haba, J; López-Vega, J M; Martínez, E; Muñoz, M; Peláez, I; Redondo, A; Rodríguez, Á; Rodríguez, C A; Ruíz, A; Llombart, A

2017-05-01

To converge on an expert opinion to define aggressive disease in patients with HER2-negative mBC using a modified Delphi methodology. A panel of 21 breast cancer experts from the Spanish Society of Medical Oncology agreed upon a survey which comprised 47 questions that were grouped into three sections: relevance for defining aggressive disease, aggressive disease criteria and therapeutic goals. Answers were rated using a 9-point Likert scale of relevance or agreement. Among the 88 oncologists that were invited to participate, 81 answered the first round (92%), 70 answered the second round (80%), and 67 answered the third round (76%) of the survey. There was strong agreement regarding the fact that identifying patients with aggressive disease needs to be adequately addressed to help practitioners to decide the best treatment options for patients with HER2-negative mBC. The factors that were considered to be strongly relevant to classifying patients with aggressive HER2-negative mBC were a high tumor burden, a disease-free interval of less than 12-24 months after surgery, the presence of progressive disease during adjuvant or neoadjuvant chemotherapy and having a triple-negative phenotype. The main therapeutic goals were controlling symptoms, improving quality of life and increasing the time to progression and overall survival. High tumor burden, time to recurrence after prior therapy and having a triple-negative phenotype were the prognostic factors for which the greatest consensus was found for identifying patients with aggressive HER2-negative mBC. Identifying patients with aggressive disease leads to different therapeutic approaches.

On the qi deficiency in traditional Chinese medicine.

PubMed

Chiang, Hui-Chu; Chang, Hen-Hong; Huang, Po-Yu; Hsu, Mutsu

2014-09-01

Qi deficiency (QD), one of the most common disorders in Traditional Chinese medicine (TCM), is relevant to many disorders in obstetrics and gynecology. This study aimed to identify the common processes and criteria for diagnosing QD among contemporary proficient TCM practitioners. Steps of decision tree analysis and modified Delphi method were merged together into four-round postal questionnaires to collect qualitative and quantitative data. Open-ended questions and content analysis were used to explore the proficient TCM practitioners' cognitive activities used for diagnosis. The statements obtained from the qualitative responses were used to develop the items for subsequent questionnaires. Based on the TCM practitioners' responses, the diagnostic processes and criteria for making diagnosis were generated. Twenty-eight out of the 30 participants completed all four questionnaires from June 2007 to January 2010. The 11 diagnostic procedures identified in the returned first round of questionnaires were used as the alternatives to select and rank for all the steps to diagnose QD. After three more rounds of postal surveys, an algorithm with a five-stage diagnostic process as well as sets of decision criteria were identified. Although the priorities of procedures and descriptions of reasoning were varied, the content revealed the major themes in the model. The criteria to differentiate signs and symptoms (S/S) included five principles for correlating S/S with QD, and 17 S/S should be differentiated carefully. The results demonstrate that the TCM practitioners precisely diagnosed QD using a number of specific procedures and criteria that could be used as a reference to understand women complaining of S/S that could be similar to QD. Copyright © 2014. Published by Elsevier B.V.

Multinational evidence-based recommendations on how to investigate and follow-up undifferentiated peripheral inflammatory arthritis: integrating systematic literature research and expert opinion of a broad international panel of rheumatologists in the 3E Initiative

PubMed Central

Machado, P; Castrejon, I; Katchamart, W; Koevoets, R; Kuriya, B; Schoels, M; Silva-Fernández, L; Thevissen, K; Vercoutere, W; Villeneuve, E; Aletaha, D; Carmona, L; Landewé, R; van der Heijde, D; Bijlsma, J W J; Bykerk, V; Canhão, H; Catrina, A I; Durez, P; Edwards, C J; Mjaavatten, M D; Leeb, B F; Losada, B; Martín-Mola, E M; Martinez-Osuna, P; Montecucco, C; Müller-Ladner, U; Østergaard, M; Sheane, B; Xavier, R M; Zochling, J; Bombardier, C

2011-01-01

Objective To develop evidence-based recommendations on how to investigate and follow-up undifferentiated peripheral inflammatory arthritis (UPIA). Methods 697 rheumatologists from 17 countries participated in the 3E (Evidence, Expertise, Exchange) Initiative of 2008–9 consisting of three separate rounds of discussions and modified Delphi votes. In the first round 10 clinical questions were selected. A bibliographic team systematically searched Medline, Embase, the Cochrane Library and ACR/EULAR 2007–2008 meeting abstracts. Relevant articles were reviewed for quality assessment, data extraction and synthesis. In the second round each country elaborated a set of national recommendations. Finally, multinational recommendations were formulated and agreement among the participants and the potential impact on their clinical practice was assessed. Results A total of 39 756 references were identified, of which 250 were systematically reviewed. Ten multinational key recommendations about the investigation and follow-up of UPIA were formulated. One recommendation addressed differential diagnosis and investigations prior to establishing the operational diagnosis of UPIA, seven recommendations related to the diagnostic and prognostic value of clinical and laboratory assessments in established UPIA (history and physical examination, acute phase reactants, autoantibodies, radiographs, MRI and ultrasound, genetic markers and synovial biopsy), one recommendation highlighted predictors of persistence (chronicity) and the final recommendation addressed monitoring of clinical disease activity in UPIA. Conclusions Ten recommendations on how to investigate and follow-up UPIA in the clinical setting were developed. They are evidence-based and supported by a large panel of rheumatologists, thus enhancing their validity and practical use. PMID:20724311

Patients’ and Clinicians’ Views of the Psychological Components of Tinnitus Treatment That Could Inform Audiologists’ Usual Care: A Delphi Survey

PubMed Central

Taylor, John; Hall, Deborah A.; Walker, Dawn-Marie; McMurran, Mary; Casey, Amanda; Stockdale, David; Featherstone, Debbie; Hoare, Derek J.

2018-01-01

Objectives: The aim of this study was to determine which components of psychological therapies are most important and appropriate to inform audiologists’ usual care for people with tinnitus. Design: A 39-member panel of patients, audiologists, hearing therapists, and psychologists completed a three-round Delphi survey to reach consensus on essential components of audiologist-delivered psychologically informed care for tinnitus. Results: Consensus (≥80% agreement) was reached on including 76 of 160 components. No components reached consensus for exclusion. The components reaching consensus were predominantly common therapeutic skills such as Socratic questioning and active listening, rather than specific techniques, for example, graded exposure therapy or cognitive restructuring. Consensus on educational components to include largely concerned psychological models of tinnitus rather than neurophysiological information. Conclusions: The results of this Delphi survey provide a tool to develop audiologists’ usual tinnitus care using components that both patients and clinicians agree are important and appropriate to be delivered by an audiologist for adults with tinnitus-related distress. Research is now necessary to test the added effects of these components when delivered by audiologists. PMID:28930785

A checklist to assess the quality of reports on spa therapy and balneotherapy trials was developed using the Delphi consensus method: the SPAC checklist.

PubMed

Kamioka, Hiroharu; Kawamura, Yoichi; Tsutani, Kiichiro; Maeda, Masaharu; Hayasaka, Shinya; Okuizum, Hiroyasu; Okada, Shinpei; Honda, Takuya; Iijima, Yuichi

2013-08-01

The purpose of this study was to develop a checklist of items that describes and measures the quality of reports of interventional trials assessing spa therapy. The Delphi consensus method was used to select the number of items in the checklist. A total of eight individuals participated, including an epidemiologist, a clinical research methodologist, clinical researchers, a medical journalist, and a health fitness programmer. Participants ranked on a 9-point Likert scale whether an item should be included in the checklist. Three rounds of the Delphi method were conducted to achieve consensus. The final checklist contained 19 items, with items related to title, place of implementation (specificity of spa), care provider influence, and additional measures to minimize the potential bias from withdrawals, loss to follow-up, and low treatment adherence. This checklist is simple and quick to complete, and should help clinicians and researchers critically appraise the medical and healthcare literature, reviewers assess the quality of reports included in systematic reviews, and researchers plan interventional trials of spa therapy. Copyright © 2013 Elsevier Ltd. All rights reserved.

When, why and how foot orthoses (FOs) should be prescribed for children with flexible pes planus: a Delphi survey of podiatrists

PubMed Central

Uden, Hayley; Kumar, Saravana; Banwell, Helen A.

2018-01-01

Background Flexible pes planus (flat feet) in children is a common reason parents and caregivers seek health professionals consult and a frequent reason podiatrists prescribe foot orthoses. Yet no universal agreement exists on the diagnosis of this condition, or when and how foot orthoses should be prescribed. The aim of this study was to garner consensus and agreement among podiatrists on the use of FOs for paediatric flexible pes planus. Methods A three round Delphi consensus survey was undertaken with 15 podiatry experts from Australia, New Zealand and the United Kingdom. Round One gathered consensus on the diagnosis and intervention into paediatric pes planus with specific questions on types of FOs and prescription variables used. Round Two and Three were based on answers from Round One and gathered agreement (rationale for choices) on a five point Likert scale. 70% of respondents had to agree to a statement for it to be accepted as consensus or agreement. Results Consensus and agreement was achieved for 83 statements directing the diagnosis of pes planus (using FPI-6 and/or rearfoot measures), common signs and symptoms (e.g., pain, fatigue, abnormal gait and other functional concerns) that direct when to intervene into paediatric flexible pes planus. Prefabricated orthoses were the preferred intervention where adequate control is gained with their use. When customised orthoses are prescribed, a vertical [heel] cast pour (71.4%) and minimal arch fill (76.9%) are the prescription variables of choice, plus or minus additional variables (i.e., medial heel (Kirby) skive, the use of a University of California Biomechanical Laboratory device or a medial flange) dependent on level of disorder and plane of excessive motion. Conclusions This study identified consensus and agreement on a series of diagnosis methods and interventions for the paediatric flexible pes planus. A clinical protocol was developed from the resultant consensus statements which provides clinicians with a series of evidenced-informed statements to better guide them on when, how and why FOs are used specific to this population. PMID:29682429

Development of core outcome sets for effectiveness trials of interventions to prevent and/or treat delirium (Del-COrS): study protocol.

PubMed

Rose, Louise; Agar, Meera; Burry, Lisa D; Campbell, Noll; Clarke, Mike; Lee, Jacques; Siddiqi, Najma; Page, Valerie J

2017-09-18

Delirium is a common, serious and potentially preventable condition with devastating impact on the quality of life prompting a proliferation of interventional trials. Core outcome sets aim to standardise outcome reporting by identifying outcomes perceived fundamental for measurement in trials of a specific interest area. Our aim is to develop international consensus on two core outcome sets for trials of interventions to prevent and/or treat delirium, irrespective of study population. We aim to identify additional core outcomes specific to the critically ill, acutely hospitalised patients, palliative care and older adults. We will conduct a systematic review of published and ongoing delirium trials (1980 onwards) and one-on-one interviews of patients who have experienced delirium and family members. These data will inform Delphi round 1 of a two-stage consensus process. In round 2, we will provide participants their own response, summarised group responses and those of patient/family participants for rescoring. We will randomise participants to receive feedback as proportion scoring the outcome as critical or as group mean responses. We will hold a consensus meeting using nominal group technique to finalise outcomes for inclusion. We will repeat the Delphi process and consensus meeting to select measures for each core outcome. We will recruit 240 Delphi participants giving us 80% power to detect a 1.0-1.5 point (9-point scale) difference by feedback method between rounds. We will analyse differences for subsequent scores, magnitude of opinion change, items retained and level of agreement. We are obtaining research ethics approvals according to local governance. Participation will be voluntary and data deidentified. Support from three international delirium organisations will be instrumental in dissemination and core outcome set uptake. We will disseminate through peer-reviewed open access publications and present at conferences selected to reach a wide range of knowledge users. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Prevention and control of major non-communicable diseases in China from 1990 to 2009: results of a two-round Delphi survey.

PubMed

Lv, Jun; Liu, Miao; Jiang, Yu; Li, Li-Ming

2013-02-12

The aim of this study was to learn about the progress of the prevention and control of major non-communicable diseases (NCDs) in China from 1990 to 2009 and to determine what prevention and control gaps remain based on the opinions of a group of panellists. Sixty-four panellists, who are members of the Subcommittee of the Non-Communicable Diseases, the Expert Committee on Disease Control and Prevention established by China's Ministry of Health in 2010, were invited to participate in an email-based, two-round Delphi survey. In each round, a structured questionnaire was given to participants, who were asked to rate the importance and practical implementation of items relevant to the prevention and control of NCDs over two periods, 1990-1999 and 2000-2009, on a 10-point scale. Of the 64 panellists invited, 20 (31.3%) completed the first-round survey, and, of those, 14 (70.0%) completed the second-round survey. Of the 237 common variables in the two survey rounds, there were 161 (67.9%) and 209 (88.2%) with an interquartile range ≤2 in the first round and second round, respectively. These results indicated a better expert consensus in the second round. There were 92 items in total in the second round of the questionnaire, 88 (95.7%) of which had median importance rating scores of equal to or greater than 7.00. The median scores for the practical implementation items during 2000-2009 were greater than those for the 1990-1999 period. The results indicate improved implementation in the recent decade. China has made progress in the prevention and control of NCDs during the 21st century. However, these intuitive rating results indicate that there are still large action gaps in the fight against epidemic NCDs in China.

TCM Pattern Questionnaire for Lateral Elbow Pain: Development of an Instrument via a Delphi Process

PubMed Central

Bian, Zhao-Xiang

2016-01-01

Individualized acupuncture treatment has been practiced for pain therapy. This study used acupuncture treatment for lateral elbow pain (LEP) as an example to study the diagnostic practice of individualized acupuncture treatment. A provisional version of LEP pattern questionnaire was developed based on a recent systematic review on TCM pattern diagnosis for LEP. A Delphi panel of 33 clinical experts from seven different countries was formed, and the Delphi survey was conducted in Chinese and English language for two rounds. Consensus was achieved from all 26 panelists who responded to the second round on 243 items of the instrument, which included a 72-question-long questionnaire. The mean level of expert consensus on the items of the final questionnaire was 85%. Consensus was found on four TCM patterns that could underlie LEP, namely, the wind-cold-dampness pattern, the qi stagnation and blood stasis pattern, the dual deficiency of qi and blood pattern, and the retained dampness-heat pattern. A list of signs and symptoms indicating one of the four TCM patterns and a list of preferred treatment modalities for each pattern were also generated. Our instrument shows considerable content validity. Further validity and reliability studies are under way. PMID:27525024

Too Fit To Fracture: outcomes of a Delphi consensus process on physical activity and exercise recommendations for adults with osteoporosis with or without vertebral fractures.

PubMed

Giangregorio, L M; McGill, S; Wark, J D; Laprade, J; Heinonen, A; Ashe, M C; MacIntyre, N J; Cheung, A M; Shipp, K; Keller, H; Jain, R; Papaioannou, A

2015-03-01

An international consensus process resulted in exercise and physical activity recommendations for individuals with osteoporosis. Emphasis was placed on strength, balance, and postural alignment. Rather than providing generic restrictions, activity should be encouraged while considering impairments, fracture risk, activity history, and preference, and guidance on spine sparing techniques should be provided. The objectives of this study were to establish expert consensus on key questions posed by patients or health care providers regarding recommended assessment domains to inform exercise prescription, therapeutic goals of exercise, and physical activity and exercise recommendations for individuals with osteoporosis or osteoporotic vertebral fracture. The Too Fit To Fracture expert panel identified researchers and clinicians with expertise in exercise and osteoporosis and stakeholder groups. We delivered a modified online Delphi survey (two rounds) to establish consensus on assessment, exercise, and physical activities for three cases with varying risk (osteoporosis based on bone mineral density; 1 spine fracture and osteoporosis; multiple spine fractures, osteoporosis, hyperkyphosis, and pain). Duplicate content analyses of free text responses were performed. Response rates were 52% (39/75) and 69% (48/70) for each round. Key consensus points are the following: (a) Current physical activity guidelines are appropriate for individuals with osteoporosis without spine fracture, but not for those with spine fracture; (b) after spine fracture, physical activity of moderate intensity is preferred to vigorous; (c) daily balance training and endurance training for spinal extensor muscles are recommended for all; (d) providing guidance on spine-sparing techniques (e.g., hip hinge) during activities of daily living or leisure, considering impairments, fracture risk, activity history, and preference, is recommended rather than providing generic restrictions (e.g., lifting <10 lbs, no twisting), but for those with vertebral fracture, especially in the presence of pain, multiple fractures, or hyperkyphosis, the risks of many activities may outweigh the benefits-physical therapist consultation is recommended. Examples of spine-sparing techniques and exercise prescription elements are provided. Our recommendations guide health care providers on assessment, exercise prescription, and safe movement for individuals with osteoporosis.

Too Fit To Fracture: outcomes of a Delphi consensus process on physical activity and exercise recommendations for adults with osteoporosis with or without vertebral fractures

PubMed Central

McGill, S.; Wark, J. D.; Laprade, J.; Heinonen, A.; Ashe, M. C.; MacIntyre, N. J.; Cheung, A. M.; Shipp, K.; Keller, H.; Jain, R.; Papaioannou, A.

2016-01-01

Summary An international consensus process resulted in exercise and physical activity recommendations for individuals with osteoporosis. Emphasis was placed on strength, balance, and postural alignment. Rather than providing generic restrictions, activity should be encouraged while considering impairments, fracture risk, activity history, and preference, and guidance on spine sparing techniques should be provided. Introduction The objectives of this study were to establish expert consensus on key questions posed by patients or health care providers regarding recommended assessment domains to inform exercise prescription, therapeutic goals of exercise, and physical activity and exercise recommendations for individuals with osteoporosis or osteoporotic vertebral fracture. Methods The Too Fit To Fracture expert panel identified researchers and clinicians with expertise in exercise and osteoporosis and stakeholder groups. We delivered a modified online Delphi survey (two rounds) to establish consensus on assessment, exercise, and physical activities for three cases with varying risk (osteoporosis based on bone mineral density; 1 spine fracture and osteoporosis; multiple spine fractures, osteoporosis, hyperkyphosis, and pain). Duplicate content analyses of free text responses were performed. Results Response rates were 52 % (39/75) and 69 % (48/70) for each round. Key consensus points are the following: (a) Current physical activity guidelines are appropriate for individuals with osteoporosis without spine fracture, but not for those with spine fracture; (b) after spine fracture, physical activity of moderate intensity is preferred to vigorous; (c) daily balance training and endurance training for spinal extensor muscles are recommended for all; (d) providing guidance on spine-sparing techniques (e.g., hip hinge) during activities of daily living or leisure, considering impairments, fracture risk, activity history, and preference, is recommended rather than providing generic restrictions (e.g., lifting <10 lbs, no twisting), but for those with vertebral fracture, especially in the presence of pain, multiple fractures, or hyperkyphosis, the risks of many activities may outweigh the benefits—physical therapist consultation is recommended. Examples of spine-sparing techniques and exercise prescription elements are provided. Conclusions Our recommendations guide health care providers on assessment, exercise prescription, and safe movement for individuals with osteoporosis. PMID:25510579

Consensus on the Definition of Advanced Parkinson's Disease: A Neurologists-Based Delphi Study (CEPA Study).

PubMed

Luquin, Maria-Rosario; Kulisevsky, Jaime; Martinez-Martin, Pablo; Mir, Pablo; Tolosa, Eduardo S

2017-01-01

To date, no consensus exists on the key factors for diagnosing advanced Parkinson disease (APD). To obtain consensus on the definition of APD, we performed a prospective, multicenter, Spanish nationwide, 3-round Delphi study (CEPA study). An ad hoc questionnaire was designed with 33 questions concerning the relevance of several clinical features for APD diagnosis. In the first-round, 240 neurologists of the Spanish Movement Disorders Group participated in the study. The results obtained were incorporated into the questionnaire and both, results and questionnaire, were sent out to and fulfilled by 26 experts in Movement Disorders. Review of results from the second-round led to a classification of symptoms as indicative of "definitive," "probable," and "possible" APD. This classification was confirmed by 149 previous participating neurologists in a third-round, where 92% completely or very much agreed with the classification. Definitive symptoms of APD included disability requiring help for the activities of daily living, presence of motor fluctuations with limitations to perform basic activities of daily living without help, severe dysphagia, recurrent falls, and dementia. These results will help neurologists to identify some key factors in APD diagnosis, thus allowing users to categorize the patients for a homogeneous recognition of this condition.

Establishment of a dental license regulation authority is required in Korea: results of the Delphi technique.

PubMed

Choi, Jin-Woo; Kim, Kack-Kyun; Lee, Jihyun; Choi, Dong-Ju; Kim, Kyung-Nyun

2017-01-01

In addition to dental education, a system for the evaluation and management of dental licensing and certification is required to meet the growing societal demand for more competent dentists. In this study, the Delphi technique was used to gather opinions from a variety of professionals on the problems of and remedies for the dental license management system in Korea. Delphi surveys were conducted from April 2016 to October 2016 in South Korea. A variety of dental professionals were included and categorized into 3 groups according to their expertise as follows: the basic dentistry group, the clinical dentistry group, and the policy group. The Delphi technique was conducted in 3 rounds of e-mail surveys, each with different questions that probed with increasing depth on the dental license management system. In each successive round, the responses were categorized, scored on a Likert scale, and statistically analyzed. After categorizing the results of the first survey and ranking the results of the second survey using the Delphi technique, regulation by a licensing authority was found to be the most critical issue. This was followed by the license renewal system, continuing education, a tiered licensure system, improvement of foreign license approval, and utilization of retirees, in decreasing order of importance. The third Delphi survey showed a similar ranking, with regulation by a licensing authority being the major concern. Opinions regarding the dental license management system were provided as open-ended responses. The responses of the 3 groups showed statistically significant differences in the scores for the issue of regulation by a licensing authority. After re-grouping into the dentistry group and the policy group, the issue received a significantly higher score in the dentistry group. The quality of dental treatment should be managed to protect patients and dental professionals. For this purpose, the establishment of an independent license regulation authority along with legislative changes is required.

Consensus development of core competencies in intensive and critical care medicine training in China.

PubMed

Hu, Xiaoyun; Xi, Xiuming; Ma, Penglin; Qiu, Haibo; Yu, Kaijiang; Tang, Yaoqing; Qian, Chuanyun; Fang, Qiang; Wang, Yushan; Yu, Xiangyou; Xu, Yuan; Du, Bin

2016-10-16

The aim of this study is to develop consensus on core competencies required for postgraduate training in intensive care medicine. We used a combination of a modified Delphi method and a nominal group technique to create and modify the list of core competencies to ensure maximum consensus. Ideas were generated modified from Competency Based Training in Intensive Care Medicine in Europe collaboration (CoBaTrICE) core competencies. An online survey invited healthcare professionals, educators, and trainees to rate and comment on these competencies. The output from the online survey was edited and then reviewed by a nominal group of 13 intensive care professionals to identify each competence for importance. The resulting list was then recirculated in the nominal group for iterative rating. The online survey yielded a list of 199 competencies for nominal group reviewing. After five rounds of rating, 129 competencies entered the final set defined as core competencies. We have generated a set of core competencies using a consensus technique which can serve as an indicator for training program development.

Providing mental health first aid in the workplace: a Delphi consensus study.

PubMed

Bovopoulos, Nataly; Jorm, Anthony F; Bond, Kathy S; LaMontagne, Anthony D; Reavley, Nicola J; Kelly, Claire M; Kitchener, Betty A; Martin, Angela

2016-08-02

Mental health problems are common in the workplace, but workers affected by such problems are not always well supported by managers and co-workers. Guidelines exist for the public on how to provide mental health first aid, but not specifically on how to tailor one's approach if the person of concern is a co-worker or employee. A Delphi consensus study was carried out to develop guidelines on additional considerations required when offering mental health first aid in a workplace context. A systematic search of websites, books and journal articles was conducted to develop a questionnaire with 246 items containing actions that someone may use to offer mental health first aid to a co-worker or employee. Three panels of experts from English-speaking countries were recruited (23 consumers, 26 managers and 38 workplace mental health professionals), who independently rated the items over three rounds for inclusion in the guidelines. The retention rate of the expert panellists across the three rounds was 61.7 %. Of the 246 items, 201 items were agreed to be important or very important by at least 80 % of panellists. These 201 endorsed items included actions on how to approach and offer support to a co-worker, and additional considerations where the person assisting is a supervisor or manager, or is assisting in crisis situations such as acute distress. The guidelines outline strategies for a worker to use when they are concerned about the mental health of a co-worker or employee. They will be used to inform future tailoring of Mental Health First Aid training when it is delivered in workplace settings and could influence organisational policies and procedures.

Research priorities in nursing--a Delphi study among Swedish nurses.

PubMed

Bäck-Pettersson, Siv; Hermansson, Evelyn; Sernert, Ninni; Björkelund, Cecilia

2008-08-01

The main aim was to illuminate essential areas for future patient-related nursing research. The secondary aim was to stimulate nurses to explore important research areas based on clinical practice. Priority-setting is regarded as one of the main strategies to ensure excellence in nursing science, to direct nursing research and develop healthcare practice accordingly as well as strengthening the nursing profession's research commitment. A three-round Delphi survey was conducted. A panel of 118 clinicians, in various nursing, teaching and administrative positions participated. Ninety-five panel members completed all three rounds (81%). The majority were female, aged 25-67 (mean 49) years, with an average of 23 (range 1-40) years in nursing, working in hospitals (42%), primary healthcare centres, community care (44%) and administration/education (14%). Sixty-six per cent had graduate diplomas and 34% had an academic education, ranging from bachelors' to doctoral degrees. Three hundred and eighty nursing research areas were identified, evaluated and ranked using content analysis and descriptive statistics. The participants' prioritized research aimed at preserving humanistic values and developing cross-organisational collaboration in the healthcare system. Nursing research aimed at preserving human dignity in geriatric care, respectful transfers, continuity of care and exploring the characteristics of a caring encounter were ranked high relative to the patient welfare, to the healthcare organisation and to the nursing profession. Nurses prioritize research that will improve clinical practice, assure patients' wellbeing and a caring environment. Nurses can reach consensus on the objectives of patient-related nursing research despite differences in age, workplace, educational period and level of academic degree. Relevance to clinical practice. When prioritizing important areas for patient-related nursing research, informed nursing practitioners' commitment initiates knowledge development within clinical practice from a nursing science perspective as well as expanding cross-professional and cross-organisational collaboration.

Therapist competencies necessary for the delivery of compassion-focused therapy: A Delphi study.

PubMed

Liddell, Alice E; Allan, Steven; Goss, Ken

2017-06-01

Compassion-focused therapy (CFT) has shown promising results for a range of clinical presentations. This study explored the therapeutic competencies required to deliver CFT and organized these into a coherent framework. The Delphi method was used to explore and refine competencies for delivering CFT in three rounds of data collection. The first round involved interviews with 12 experts in CFT. Data were analysed using template analysis to generate a draft competency framework. The main competencies were used to create a survey for rounds two and three involving CFT experts and practitioners. Data collected from the surveys were used to refine the competencies. The CFT competency framework (CFT-CF) that was produced comprised 25 main competencies within six key areas of competence. The areas were as follows: competencies in creating safeness, meta-skills, non-phase-specific skills, phase-specific skills, knowledge and understanding and use of supervision. The main competencies included several subcompetencies specifying knowledge, skills and attributes needed to demonstrate the main competence. Overall, there was consensus on 14 competencies and 20 competencies exceeded an 80% agreement level. Some of the CFT competencies overlapped with existing therapies, whilst others were specific to CFT. The CFT-CF provides useful guidance for clinicians, supervisors and training programmes. Further research could develop the CFT-CF into a therapist rating scale in order to measure the outcome of training and to assess treatment fidelity in clinical trials. The compassion-focused therapy competency framework (CFT-CF) identifies therapeutic competencies that overlap with existing treatments as well as those specific to compassion-focused therapy (CFT). The CFT-CF builds guidance for the competencies required to deliver CFT in a range of clinical settings. The CFT-CF provides guidance for those training CFT therapists. The CFT-CF could be used as a basis to develop a therapist rating scale. © 2016 The British Psychological Society.

Caries preventive measures in orthodontic practice: the development of a clinical practice guideline.

PubMed

Oosterkamp, B C M; van der Sanden, W J M; Frencken, J E F M; Kuijpers-Jagtman, A M

2016-02-01

White spot lesions (WSLs) are a side effect of orthodontic treatment, causing esthetic problems and a risk of deeper enamel and dentine lesions. Many strategies have been developed for preventing WSLs, but great variability exists in preventive measures between orthodontists. This study developed statements on which a clinical practice guideline (CPG) can be developed in order to help orthodontists select preventive measures based on the best available evidence. A nominal group technique (RAND-e modified Delphi procedure) was used. A multidisciplinary expert panel rated 264 practice- and evidence-based statements related to the management of WSLs. To provide panel members with the same knowledge, a total of six articles obtained from a systematic review of the literature were read by the panel in preparation of three consensus rounds. According to the technique, a threshold of 75% of all ratings within any 3-point section of the 9-point scale regarding a specific statement was accepted as consensus. After the first and second consensus rounds, consensus was reached on 37.5 and 31.1% of statements, respectively. For the remaining 31.4% of statements, consensus was reached during a 4-h consensus meeting. Statements on the management of WSLs derived from a systematic literature review combined with expert opinion were formally integrated toward consensus through a nominal group technique. These statements formed the basis for developing a CPG on the management of WSLs before and during orthodontic treatment. © 2015 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Components of a Measure to Describe Organizational Culture in Academic Pharmacy

PubMed Central

Rosenthal, Meagen; Holmes, Erin R.; Andrews, Brienna; Lui, Julia; Raja, Leela

2017-01-01

Objective. To develop a measure of organizational culture in academic pharmacy and identify characteristics of an academic pharmacy program that would be impactful for internal (eg, students, employees) and external (eg, preceptors, practitioners) clients of the program. Methods. A three-round Delphi procedure of 24 panelists from pharmacy schools in the U.S. and Canada generated items based on the Organizational Culture Profile (OCP), which were then evaluated and refined for inclusion in subsequent rounds. Items were assessed for appropriateness and impact. Results. The panel produced 35 items across six domains that measured organizational culture in academic pharmacy: competitiveness, performance orientation, social responsibility, innovation, emphasis on collegial support, and stability. Conclusion. The items generated require testing for validation and reliability in a large sample to finalize this measure of organizational culture. PMID:29367768

Development of the Korean framework for senior-friendly hospitals: a Delphi study.

PubMed

Kim, Yoon-Sook; Han, Seol-Heui; Hwang, Jeong-Hae; Park, Jae-Min; Lee, Jongmin; Choi, Jaekyung; Moon, Yeonsil; Kim, Hee Joung; Shin, Grace Jung Eun; Lee, Ji-Sun; Choi, Ye Ji; Uhm, Kyeong Eun; Kim, In Ae; Nam, Ji-Won

2017-08-04

Aging is an inevitable part of life. One can maintain well-being and wellness even after discharge and/or transition if his or her functional decline is minimized, sudden decline is prevented, and functioning is promoted during hospitalization. Caring appropriately for elderly patients requires the systematic application of Senior-Friendly Hospital principles to all operating systems, including medical centres' organization and environment, as well as patient treatment processes. The Senior-Friendly Hospital framework is valid and important for patient safety and quality improvement. This study aimed to make recommendations regarding the development of the Korean Framework for Senior-Friendly Hospitals for older patients' care management, patient safety interventions, and health promotion, via a Delphi survey. Two rounds of Delphi surveying were conducted with 15 participants who had at least 3 years' experience in accreditation surveying and medical accreditation standards, survey methods, and accreditation investigator education. In each round, we calculated statistics describing each standard's validity and feasibility. The Korean Framework for Senior-Friendly Hospitals included 4 Chapters, 11 categories, and 67 standards through consensus of the Senior-Friendly Hospitals task force and experts' peer review. After the two rounds of Delphi surveying, validity evaluation led to no changes in standards of the Senior-Friendly Hospitals; however, the number of standards showing adequate validity decreased from 67 to 58. Regarding feasibility, no changes were necessary in the standards; however, the number of categories showing adequate feasibility decreased from 11 to 8 and from 67 to 30, respectively. The excluded categories were 3.2, 4.2, and 4.3 (service, transportation, and signage and identification). The highest feasibility values were given to standards 2.1.1, 4.1.4, and 4.1.6. The highest feasibility score was given to standard 2.4.2. The Korean Framework for Senior-Friendly Hospitals needs to include 4 Chapters, 8 categories, and 30 standards. The Accreditation Program for Healthcare Organizations should include Senior-Friendly Hospitals -relevant standards considering Korea's medical environment.

ISSLS Prize Winner: Consensus on the Clinical Diagnosis of Lumbar Spinal Stenosis: Results of an International Delphi Study.

PubMed

Tomkins-Lane, Christy; Melloh, Markus; Lurie, Jon; Smuck, Matt; Battié, Michele C; Freeman, Brian; Samartzis, Dino; Hu, Richard; Barz, Thomas; Stuber, Kent; Schneider, Michael; Haig, Andrew; Schizas, Constantin; Cheung, Jason Pui Yin; Mannion, Anne F; Staub, Lukas; Comer, Christine; Macedo, Luciana; Ahn, Sang-Ho; Takahashi, Kazuhisa; Sandella, Danielle

2016-08-01

Delphi. The aim of this study was to obtain an expert consensus on which history factors are most important in the clinical diagnosis of lumbar spinal stenosis (LSS). LSS is a poorly defined clinical syndrome. Criteria for defining LSS are needed and should be informed by the experience of expert clinicians. Phase 1 (Delphi Items): 20 members of the International Taskforce on the Diagnosis and Management of LSS confirmed a list of 14 history items. An online survey was developed that permits specialists to express the logical order in which they consider the items, and the level of certainty ascertained from the questions. Phase 2 (Delphi Study) Round 1: Survey distributed to members of the International Society for the Study of the Lumbar Spine. Round 2: Meeting of 9 members of Taskforce where consensus was reached on a final list of 10 items. Round 3: Final survey was distributed internationally. Phase 3: Final Taskforce consensus meeting. A total of 279 clinicians from 29 different countries, with a mean of 19 (±SD: 12) years in practice participated. The six top items were "leg or buttock pain while walking," "flex forward to relieve symptoms," "feel relief when using a shopping cart or bicycle," "motor or sensory disturbance while walking," "normal and symmetric foot pulses," "lower extremity weakness," and "low back pain." Significant change in certainty ceased after six questions at 80% (P < .05). This is the first study to reach an international consensus on the clinical diagnosis of LSS, and suggests that within six questions clinicians are 80% certain of diagnosis. We propose a consensus-based set of "seven history items" that can act as a pragmatic criterion for defining LSS in both clinical and research settings, which in the long term may lead to more cost-effective treatment, improved health care utilization, and enhanced patient outcomes. 2.

PIM-Check: development of an international prescription-screening checklist designed by a Delphi method for internal medicine patients.

PubMed

Desnoyer, Aude; Blanc, Anne-Laure; Pourcher, Valérie; Besson, Marie; Fonzo-Christe, Caroline; Desmeules, Jules; Perrier, Arnaud; Bonnabry, Pascal; Samer, Caroline; Guignard, Bertrand

2017-07-31

Potentially inappropriate medication (PIM) occurs frequently and is a well-known risk factor for adverse drug events, but its incidence is underestimated in internal medicine. The objective of this study was to develop an electronic prescription-screening checklist to assist residents and young healthcare professionals in PIM detection. Five-step study involving selection of medical domains, literature review and 17 semistructured interviews, a two-round Delphi survey, a forward/back-translation process and an electronic tool development. 22 University and general hospitals from Canada, Belgium, France and Switzerland. 40 physicians and 25 clinical pharmacists were involved in the study.Agreement with the checklist statements and their usefulness for healthcare professional training were evaluated using two 6-point Likert scales (ranging from 0 to 5). Agreement and usefulness ratings were defined as: >65% of the experts giving the statement a rating of 4 or 5, during the first Delphi-round and >75% during the second. 166 statements were generated during the first two steps. Mean agreement and usefulness ratings were 4.32/5 (95% CI 4.28 to 4.36) and 4.11/5 (4.07 to 4.15), respectively, during the first Delphi-round and 4.53/5 (4.51 to 4.56) and 4.36/5 (4.33 to 4.39) during the second (p<0.001). The final checklist includes 160 statements in 17 medical domains and 56 pathologies. An algorithm of approximately 31 000 lines was developed including comorbidities and medications variables to create the electronic tool. PIM-Check is the first electronic prescription-screening checklist designed to detect PIM in internal medicine. It is intended to help young healthcare professionals in their clinical practice to detect PIM, to reduce medication errors and to improve patient safety. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

PIM-Check: development of an international prescription-screening checklist designed by a Delphi method for internal medicine patients

PubMed Central

Desnoyer, Aude; Blanc, Anne-Laure; Pourcher, Valérie; Besson, Marie; Fonzo-Christe, Caroline; Desmeules, Jules; Perrier, Arnaud; Bonnabry, Pascal; Samer, Caroline; Guignard, Bertrand

2017-01-01

Objectives Potentially inappropriate medication (PIM) occurs frequently and is a well-known risk factor for adverse drug events, but its incidence is underestimated in internal medicine. The objective of this study was to develop an electronic prescription-screening checklist to assist residents and young healthcare professionals in PIM detection. Design Five-step study involving selection of medical domains, literature review and 17 semistructured interviews, a two-round Delphi survey, a forward/back-translation process and an electronic tool development. Setting 22 University and general hospitals from Canada, Belgium, France and Switzerland. Participants 40 physicians and 25 clinical pharmacists were involved in the study. Agreement with the checklist statements and their usefulness for healthcare professional training were evaluated using two 6-point Likert scales (ranging from 0 to 5). Primary and secondary outcome measures Agreement and usefulness ratings were defined as: >65% of the experts giving the statement a rating of 4 or 5, during the first Delphi-round and >75% during the second. Results 166 statements were generated during the first two steps. Mean agreement and usefulness ratings were 4.32/5 (95% CI 4.28 to 4.36) and 4.11/5 (4.07 to 4.15), respectively, during the first Delphi-round and 4.53/5 (4.51 to 4.56) and 4.36/5 (4.33 to 4.39) during the second (p<0.001). The final checklist includes 160 statements in 17 medical domains and 56 pathologies. An algorithm of approximately 31 000 lines was developed including comorbidities and medications variables to create the electronic tool. Conclusion PIM-Check is the first electronic prescription-screening checklist designed to detect PIM in internal medicine. It is intended to help young healthcare professionals in their clinical practice to detect PIM, to reduce medication errors and to improve patient safety. PMID:28760793

TREatment of ATopic eczema (TREAT) Registry Taskforce: An international Delphi exercise to identify a core set of domains and domain items for national atopic eczema photo- and systemic therapy registries.

PubMed

Gerbens, L A A; Apfelbacher, C J; Irvine, A D; Barbarot, S; de Booij, R J; Boyce, A E; Deleuran, M; Eichenfield, L F; Hof, M H; Middelkamp-Hup, M A; Roberts, A; Schmitt, J; Vestergaard, C; Wall, D; Weidinger, S; Williamson, P R; Flohr, C; Spuls, P I

2018-05-15

Evidence of immunomodulatory therapies to guide clinical management for atopic eczema (AE) is scarce, despite frequent and often off-label use. Patient registries provide valuable evidence for the effects of treatments under real world conditions which can inform treatment guidelines, give the opportunity for health economic evaluation and the evaluation of quality of care, as well as pharmacogenetic and -dynamic research which cannot be adequately addressed in clinical trials. The TREatment of ATopic eczema (TREAT) Registry Taskforce aims to seek international consensus on a core set of domains and items ('what to measure') for AE research registries, using a Delphi approach. Participants from six stakeholder groups were included: doctors, nurses, non-clinical researchers, patients, industry and regulatory body representatives. The eDelphi comprised 3 sequential online rounds, requesting participants to rate the importance of each proposed domain item. Participants could add domain items to the proposed list in round 1. A final consensus meeting was held to ratify the core set. 479 participants from 36 countries accessed the eDelphi platform, of whom 86%, 79% and 74% completed rounds 1, 2, and 3 respectively. At the face-to-face consensus meeting attended by 42 participants the final core set was established containing 19 domains with 69 domain items (49 baseline and 20 follow-up items). This core set of domains and items to be captured by national AE systemic therapy registries will standardise data collection and thereby allow direct comparability across registries and facilitate data pooling between countries. Ultimately, it will provide greater insight into the effectiveness, safety and cost-effectiveness of photo- and systemic immunomodulatory therapies. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Legislative priorities for transportation safety in Virginia : a pilot application of a modified delphi technique : final report.

DOT National Transportation Integrated Search

1985-01-01

Using a modified version of the Delphi technique, a panel of transportation safety experts developed the following list of legislative priorities for submission to the Department of Motor Vehicles (DMV) Legislative Package for the 1986 session of the...

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study.

PubMed

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-08-18

The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

A Delphi approach to reach consensus on primary care guidelines regarding youth violence prevention.

PubMed

De Vos, Edward; Spivak, Howard; Hatmaker-Flanigan, Elizabeth; Sege, Robert D

2006-10-01

Anticipatory guidance is a cornerstone of modern pediatric practice. In recognition of its importance for child well being, injury prevention counseling is a standard element of that guidance. Over the last 20 years, there has been growing recognition that intentional injury or violence is one of the leading causes of morbidity and mortality among youth. The US Surgeon General identified youth violence as a major public health issue and a top priority. Yet, only recently has the scope of injury prevention counseling been expanded to include violence. Pediatric health care providers agree that youth violence-prevention counseling should be provided, yet the number of topics available, the already lengthy list of other anticipatory guidance topics to be covered, developmental considerations, and the evidence base make the selection of an agreed-on set a considerable challenge. The purpose of this study was to systematically identify and prioritize specific counseling topics in violence prevention that could be integrated into anticipatory guidance best practice. A modified electronic Delphi process was used to gain consensus among 50 national multidisciplinary violence-prevention experts. Participants were unaware of other participants' identities. The process consisted of 4 serial rounds of inquiry beginning with a broad open-ended format for the generation of anticipatory guidance and screening topics across 5 age groups (infant, toddler, school age, adolescent, and all ages). Each subsequent round narrowed the list of topics toward the development of a manageable set of essential topics for screening and counseling about positive youth development and violence prevention. Forty-seven unique topics were identified, spanning birth to age 21 years. Topics cover 4 broad categories (building blocks): physical safety, parent centered, child centered, and community connection. Participants placed topics into their developmentally appropriate visit-based schedule and made suggestions for an appropriate topic reinforcement schedule. The resulting schedule provides topics for introduction and reinforcement at each visit. The Delphi technique proved a useful approach for accessing expert opinion, for analyzing and synthesizing results, for achieving consensus, and for setting priorities among the numerous anticipatory guidance and assessment topics relevant for raising resilient, violence-free youth.

Elder-friendly emergency services in Brazil: necessary conditions for care.

PubMed

Santos, Mariana Timmers Dos; Lima, Maria Alice Dias da Silva; Zucatti, Paula Buchs

2016-01-01

To identify and analyze the aspects necessary to provide an elder-friendly emergency service (ES) from the perspective of nurses. This is a descriptive, quantitative study using the Delphi technique in three rounds. Nurses with professional experience in the ES and/or researchers with publications and/or conducting research in the study area were selected. The first round of the Delphi panel had 72 participants, the second 49, and the third 44. An online questionnaire was used based on a review of the scientific literature with questions organized into the central dimensions of elder-friendly hospitals. A five-point Likert scale was used for each question and a 70% consensus level was established. There were 38 aspects identified as necessary for elderly care that were organized into central dimensions. The study's results are consistent with the findings in scientific literature and suggest indicators for quality of care and training for an elder-friendly ES. Identificar e analisar aspectos necessários para um atendimento amigo do idoso nos serviços de emergência (SE), na perspectiva de enfermeiros. Estudo descritivo, quantitativo, com utilização da Técnica Delphi, em três rodadas. Foram selecionados enfermeiros com experiência profissional em SE e/ou pesquisadores com publicações e/ou desenvolvendo pesquisas na área de estudo. A primeira rodada do painel Delphi contou com 72 participantes, a segunda com 49 e a terceira com 44. Foi utilizado questionário on-line, baseado na revisão da literatura científica, com questões organizadas em dimensões centrais de hospitais amigos do idoso. Foi utilizada uma escala de Likert de 5 pontos para cada questão e estabelecido nível de consenso de 70%. Foram identificados 38 aspectos necessários para o atendimento ao idoso, organizados em dimensões centrais. Os resultados do estudo são consistentes com os achados na literatura científica e sugerem indicadores para qualidade do cuidado e para formação de SE amigos do idoso.

A core outcome set for evaluating self-management interventions in people with comorbid diabetes and severe mental illness: study protocol for a modified Delphi study and systematic review.

PubMed

Taylor, Johanna; Böhnke, Jan R; Wright, Judy; Kellar, Ian; Alderson, Sarah L; Hughes, Tom; Holt, Richard I G; Siddiqi, Najma

2017-02-14

People with diabetes and comorbid severe mental illness (SMI) form a growing population at risk of increased mortality and morbidity compared to those with diabetes or SMI alone. There is increasing interest in interventions that target diabetes in SMI in order to help to improve physical health and reduce the associated health inequalities. However, there is a lack of consensus about which outcomes are important for this comorbid population, with trials differing in their focus on physical and mental health. A core outcome set, which includes outcomes across both conditions that are relevant to patients and other key stakeholders, is needed. This study protocol describes methods to develop a core outcome set for use in effectiveness trials of self-management interventions for adults with comorbid type-2 diabetes and SMI. We will use a modified Delphi method to identify, rank, and agree core outcomes. This will comprise a two-round online survey and multistakeholder workshops involving patients and carers, health and social care professionals, health care commissioners, and other experts (e.g. academic researchers and third sector organisations). We will also select appropriate measurement tools for each outcome in the proposed core set and identify gaps in measures, where these exist. The proposed core outcome set will provide clear guidance about what outcomes should be measured, as a minimum, in trials of interventions for people with coexisting type-2 diabetes and SMI, and improve future synthesis of trial evidence in this area. We will also explore the challenges of using online Delphi methods for this hard-to-reach population, and examine differences in opinion about which outcomes matter to diverse stakeholder groups. COMET registration: http://www.comet-initiative.org/studies/details/911 . Registered on 1 July 2016.

Evaluation of the Walking Index for Spinal Cord Injury II (WISCI-II) in children with Spinal Cord Injury (SCI).

PubMed

Calhoun Thielen, C; Sadowsky, C; Vogel, L C; Taylor, H; Davidson, L; Bultman, J; Gaughan, J; Mulcahey, M J

2017-05-01

Mixed methods were used in this study. The appropriateness of the levels of the Walking Index for Spinal Cord Injury II (WISCI-II) for application in children was critically reviewed by physical therapists using the Modified Delphi Technique, and the inter- and intra-rater reliability of the WISCI-II in children was evaluated. To examine the construct validity, and to establish reliability of the WISCI-II related to its use in children with spinal cord injury (SCI). United States of America. Using a Modified Delphi Technique, physical therapists critically reviewed the WISCI-II levels for pediatric utilization. Concurrently, ambulatory children under age 18 years with SCI were evaluated using the WISCI-II on two occasions by the same therapist to establish intra-rater reliability. One trial was photographed and de-identified. Each photograph was reviewed by four different physical therapists who gave WISCI-II scores to establish inter-rater reliability. Summary and descriptive statistics were used to calculate the frequency of yes/no responses for each WISCI-II level question and to determine the percent agreement for each question. Inter- and intra-rater reliability was calculated using interclass correlation coefficients (ICCs) with 95% confidence intervals (CI). Construct validity was confirmed after one Delphi round during which at least 80% agreement was established by 51 physical therapists on the appropriateness of the WISCI-II levels for children. Fifty-two children with SCI aged 2-17 years completed repeated WISCI-II assessments and 40 de-identified photographs were scored by four physical therapists. Intra- and inter-rater reliability was high (ICC=0.997, CI=0.995-0.998 and ICC=0.97, CI=0.95-0.98, respectively). This study demonstrates support for the use of the WISCI-II in ambulatory children with SCI. This study was funded by the Craig H Neilsen Foundation, Spinal Cord Injury Research on the Translation Spectrum, Senior Research Award #282592 (Mulcahey, PI).

Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies.

PubMed

Diamond, Ivan R; Grant, Robert C; Feldman, Brian M; Pencharz, Paul B; Ling, Simon C; Moore, Aideen M; Wales, Paul W

2014-04-01

To investigate how consensus is operationalized in Delphi studies and to explore the role of consensus in determining the results of these studies. Systematic review of a random sample of 100 English language Delphi studies, from two large multidisciplinary databases [ISI Web of Science (Thompson Reuters, New York, NY) and Scopus (Elsevier, Amsterdam, NL)], published between 2000 and 2009. About 98 of the Delphi studies purported to assess consensus, although a definition for consensus was only provided in 72 of the studies (64 a priori). The most common definition for consensus was percent agreement (25 studies), with 75% being the median threshold to define consensus. Although the authors concluded in 86 of the studies that consensus was achieved, consensus was only specified a priori (with a threshold value) in 42 of these studies. Achievement of consensus was related to the decision to stop the Delphi study in only 23 studies, with 70 studies terminating after a specified number of rounds. Although consensus generally is felt to be of primary importance to the Delphi process, definitions of consensus vary widely and are poorly reported. Improved criteria for reporting of methods of Delphi studies are required. Copyright © 2014 Elsevier Inc. All rights reserved.

Which Dimensions of Patient-Centeredness Matter? - Results of a Web-Based Expert Delphi Survey.

PubMed

Zill, Jördis M; Scholl, Isabelle; Härter, Martin; Dirmaier, Jörg

2015-01-01

Present models and definitions of patient-centeredness revealed a lack of conceptual clarity. Based on a prior systematic literature review, we developed an integrative model with 15 dimensions of patient-centeredness. The aims of this study were to 1) validate, and 2) prioritize these dimensions. A two-round web-based Delphi study was conducted. 297 international experts were invited to participate. In round one they were asked to 1) give an individual rating on a nine-point-scale on relevance and clarity of the dimensions, 2) add missing dimensions, and 3) prioritize the dimensions. In round two, experts received feedback about the results of round one and were asked to reflect and re-rate their own results. The cut-off for the validation of a dimension was a median < 7 on one of the criteria. 105 experts participated in round one and 71 in round two. In round one, one new dimension was suggested and included for discussion in round two. In round two, this dimension did not reach sufficient ratings to be included in the model. Eleven dimensions reached a median ≥ 7 on both criteria (relevance and clarity). Four dimensions had a median < 7 on one or both criteria. The five dimensions rated as most important were: patient as a unique person, patient involvement in care, patient information, clinician-patient communication and patient empowerment. 11 out of the 15 dimensions have been validated through experts' ratings. Further research on the four dimensions that received insufficient ratings is recommended. The priority order of the dimensions can help researchers and clinicians to focus on the most important dimensions of patient-centeredness. Overall, the model provides a useful framework that can be used in the development of measures, interventions, and medical education curricula, as well as the adoption of a new perspective in health policy.

Which Dimensions of Patient-Centeredness Matter? - Results of a Web-Based Expert Delphi Survey

PubMed Central

Zill, Jördis M.; Scholl, Isabelle; Härter, Martin; Dirmaier, Jörg

2015-01-01

Background Present models and definitions of patient-centeredness revealed a lack of conceptual clarity. Based on a prior systematic literature review, we developed an integrative model with 15 dimensions of patient-centeredness. The aims of this study were to 1) validate, and 2) prioritize these dimensions. Method A two-round web-based Delphi study was conducted. 297 international experts were invited to participate. In round one they were asked to 1) give an individual rating on a nine-point-scale on relevance and clarity of the dimensions, 2) add missing dimensions, and 3) prioritize the dimensions. In round two, experts received feedback about the results of round one and were asked to reflect and re-rate their own results. The cut-off for the validation of a dimension was a median < 7 on one of the criteria. Results 105 experts participated in round one and 71 in round two. In round one, one new dimension was suggested and included for discussion in round two. In round two, this dimension did not reach sufficient ratings to be included in the model. Eleven dimensions reached a median ≥ 7 on both criteria (relevance and clarity). Four dimensions had a median < 7 on one or both criteria. The five dimensions rated as most important were: patient as a unique person, patient involvement in care, patient information, clinician-patient communication and patient empowerment. Discussion 11 out of the 15 dimensions have been validated through experts’ ratings. Further research on the four dimensions that received insufficient ratings is recommended. The priority order of the dimensions can help researchers and clinicians to focus on the most important dimensions of patient-centeredness. Overall, the model provides a useful framework that can be used in the development of measures, interventions, and medical education curricula, as well as the adoption of a new perspective in health policy. PMID:26539990

Key performance indicators to benchmark hospital information systems - a delphi study.

PubMed

Hübner-Bloder, G; Ammenwerth, E

2009-01-01

To identify the key performance indicators for hospital information systems (HIS) that can be used for HIS benchmarking. A Delphi survey with one qualitative and two quantitative rounds. Forty-four HIS experts from health care IT practice and academia participated in all three rounds. Seventy-seven performance indicators were identified and organized into eight categories: technical quality, software quality, architecture and interface quality, IT vendor quality, IT support and IT department quality, workflow support quality, IT outcome quality, and IT costs. The highest ranked indicators are related to clinical workflow support and user satisfaction. Isolated technical indicators or cost indicators were not seen as useful. The experts favored an interdisciplinary group of all the stakeholders, led by hospital management, to conduct the HIS benchmarking. They proposed benchmarking activities both in regular (annual) intervals as well as at defined events (for example after IT introduction). Most of the experts stated that in their institutions no HIS benchmarking activities are being performed at the moment. In the context of IT governance, IT benchmarking is gaining importance in the healthcare area. The found indicators reflect the view of health care IT professionals and researchers. Research is needed to further validate and operationalize key performance indicators, to provide an IT benchmarking framework, and to provide open repositories for a comparison of the HIS benchmarks of different hospitals.

Delphi survey to identify topics to be addressed at the initial follow-up consultation after oesophageal cancer surgery.

PubMed

Jacobs, M; Henselmans, I; Macefield, R C; Blencowe, N S; Smets, E M A; de Haes, J C J M; Sprangers, M A G; Blazeby, J M; van Berge Henegouwen, M I

2014-12-01

There is no consensus among patients and healthcare professionals (HCPs) on the topics that need to be addressed after oesophageal cancer surgery. The aim of this study was to identify these topics, using a two-round Delphi survey. In round 1, patients and HCPs (surgeons, dieticians, nurses) were invited to rate the importance of 49 topics. The proportion of panellists that considered a topic to be of low, moderate or high importance was then calculated for each of these two groups. Based on these proportions and the i.q.r., topics were categorized as: 'consensus to be included', 'consensus to be excluded' and 'no consensus'. Only topics in the first category were included in the second round. In round 2, panellists were provided with individual and group feedback. To be included in the final list, topics had to meet criteria for consensus and stability. There were 108 patients and 77 HCPs in the round 2 analyses. In general, patients and HCPs considered the same topics important. The final list included 23 topics and revealed that it was most important to address: cancer removed/lymph nodes, the new oesophagus, eating and drinking, surgery, alarming new complaints and the recovery period. The study provides surgeons with a list of topics selected by patients and HCPs that may be addressed systematically at the initial follow-up consultation after oesophageal cancer surgery. © 2014 BJS Society Ltd. Published by John Wiley & Sons Ltd.

Criteria required for an acceptable point-of-care test for UTI detection: Obtaining consensus using the Delphi technique

PubMed Central

Kearney, Paddy; Stafford, Bob; Gormley, Gerard J.; Crockard, Martin A.; Gilpin, Deirdre F.

2018-01-01

Background Urinary Tract Infections (UTIs) are common bacterial infections, second only to respiratory tract infections and particularly prevalent within primary care. Conventional detection of UTIs is culture, however, return of results can take between 24 and 72 hours. The introduction of a point of care (POC) test would allow for more timely identification of UTIs, facilitating improved, targeted treatment. This study aimed to obtain consensus on the criteria required for a POC UTI test, to meet patient need within primary care. Methods Criteria for consideration were compiled by the research team. These criteria were validated through a two-round Delphi process, utilising an expert panel of healthcare professionals from across Europe and United States of America. Using web-based questionnaires, panellists recorded their level of agreement with each criterion based on a 5-point Likert Scale, with space for comments. Using median response, interquartile range and comments provided, criteria were accepted/rejected/revised depending on pre-agreed cut-off scores. Results The first round questionnaire presented thirty-three criteria to the panel, of which 22 were accepted. Consensus was not achieved for the remaining 11 criteria. Following response review, one criterion was removed, while after revision, the remaining 10 criteria entered the second round. Of these, four were subsequently accepted, resulting in 26 criteria considered appropriate for a POC test to detect urinary infections. Conclusion This study generated an approved set of criteria for a POC test to detect urinary infections. Criteria acceptance and comments provided by the healthcare professionals also supports the development of a multiplex point of care UTI test. PMID:29879161

Attribution of mental illness to work: a Delphi study.

PubMed

Wong, M G P; Poole, C J M; Agius, R

2015-07-01

Clinicians may be asked whether mental ill-health has been caused by work but there is no guidance on how this judgement should be made. To seek a consensus on the factors that should be considered and how they should be sought when attributing mental ill-health to work. A three-round Delphi study involving expert academics, occupational physicians, psychiatrists and psychologists. We deemed consensus had been reached when 66% or more of the experts were in agreement. Of 54 invited experts, 35 (65%) took part in the first round, 30 of these 35 (86%) in the second and 29 of these 30 (97%) in the final round. Consensus was reached for 11 workplace stressors: high job strain; effort-reward imbalance; major trauma; interpersonal conflict; inadequate support; role ambiguity; person-job mismatch; organizational injustice; organizational culture; work scheduling and threats to job security. Seven personal factors were identified as being important: previous mental illness; personality traits of neuroticism; adverse life events or social circumstances; resilience; a family history of mental illness and secondary gain. The worker, manager and co-workers were thought to be the most useful sources of workplace information. Consensus was reached for a definition of occupational mental illness but not for a threshold of work-relatedness. The attribution of mental ill-health to work is complex and involves the consideration of both workplace stressors and personal factors of vulnerability. Clinical consultation with an occupational physician who is familiar with the workplace is central to the process. © The Author 2015. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Emergency medicine in the developing world: a Delphi study.

PubMed

Hodkinson, Peter W; Wallis, Lee A

2010-07-01

Emergency medicine (EM) as a specialty has developed rapidly in the western world, but remains largely immature in developing nations. There is an urgent need for emergency services, but no clear guidelines are available on the priorities for establishing EM in the developing world. This study seeks to establish consensus on key areas of EM development in developing world settings, with respect to scope of EM, staffing needs, training requirements, and research priorities. A three-round Delphi study was conducted via e-mail. A panel was convened of 50 EM specialists or equivalent, with experience in or interest in EM in the developing world. In the first round, panelists provided free-text statements on scope, staffing, training, and research priorities for EM in the developing world. A five-point Likert scale was used to rate agreement with the statements in Rounds 2 and 3. Consensus statements are presented as a series of synopsis statements for each of the four major themes. A total of 168 of 208 statements (81%) had reached consensus at the end of the study. Key areas in which consensus was reached included EM being a specialist-driven service, with substantial role for nonphysicians. International training courses should be adapted to local needs. EM research in developing countries should be clinically driven and focus on local issues of importance. The scope and function of EM and relationships with other specialties are defined. Unambiguous principles are laid out for the development of the specialty in developing world environments. The next step required in this process is translation into practical guidelines for the development of EM in developing world settings where they may be used to drive policy, protocols, and research. 2010 by the Society for Academic Emergency Medicine

Multidisciplinary Consensus on the Nonadherence to Clinical Management of Inhaled Therapy in Spanish asthma patients.

PubMed

López-Viña, Antolín; Giner, Jordi; Molina, Jesús; Palicio, Javier; Plaza, Javier; Quintano, José Antonio; Quirce, Santiago; Soria, Cristina; Uréndez, Ana María; Plaza, Vicente

2017-08-01

Rates of nonadherence to asthma treatment in Spain are between 24% and 76%, which results in poor disease control and increased health care costs. The main objective of this multidisciplinary consensus was to investigate the opinions of health professionals and patients regarding adherence to inhaled therapy in Spain. The results will help to identify the causes of nonadherence and to establish strategies to detect and correct the problem. This research was conducted by using a modified Delphi method organized into 2 rounds and involving a panel of 64 physicians, 16 nurses, and 10 community pharmacists. In addition, 70 patients with asthma completed a simplified 1-round survey, based on the Delphi questionnaire. The items proposed to reach a consensus included topics such as impact and causes of nonadherence, as well as strategies to improve adherence to treatment. Expert panelists reached a consensus on ~80% of the items proposed. They agreed that the lack of control in asthma has an important economic impact. The causes of nonadherence with more agreement were the patients' beliefs about treatment and the complexity of the inhalation devices. Panelists agreed that the most important strategies to improve adherence were modification of patients' beliefs, training of professionals in the management of adherence, and personalization of interventions. Most patients only agreed with items that referred to strategies to improve adherence. Although the problems, impact, causes, and interventions regarding nonadherence to asthma treatment are known, adequate monitoring of adherence to treatment is not performed. A multidisciplinary and personalized approach is necessary to control and improve adherence. Copyright © 2017 Elsevier HS Journals, Inc. All rights reserved.

Follow-up intervals in patients with Cushing's disease: recommendations from a panel of experienced pituitary clinicians.

PubMed

Geer, Eliza B; Ayala, Alejandro; Bonert, Vivien; Carmichael, John D; Gordon, Murray B; Katznelson, Laurence; Manuylova, Ekaterina; Shafiq, Ismat; Surampudi, Vijaya; Swerdloff, Ronald S; Broder, Michael S; Cherepanov, Dasha; Eagan, Marianne; Lee, Jackie; Said, Qayyim; Neary, Maureen P; Biller, Beverly M K

2017-08-01

Follow-up guidelines are needed to assess quality of care and to ensure best long-term outcomes for patients with Cushing's disease (CD). The purpose of this study was to assess agreement by experts on recommended follow-up intervals for CD patients at different phases in their treatment course. The RAND/UCLA modified Delphi process was used to assess expert consensus. Eleven clinicians who regularly manage CD patients rated 79 hypothetical patient scenarios before and after ("second round") an in-person panel discussion to clarify definitions. Scenarios described CD patients at various time points after treatment. For each scenario, panelists recommended follow-up intervals in weeks. Panel consensus was assigned as follows: "agreement" if no more than two responses were outside a 2 week window around the median response; "disagreement" if more than two responses were outside a 2 week window around the median response. Recommendations were developed based on second round results. Panel agreement was 65.9% before and 88.6% after the in-person discussion. The panel recommended follow-up within 8 weeks for patients in remission on glucocorticoid replacement and within 1 year of surgery; within 4 weeks for patients with uncontrolled persistent or recurrent disease; within 8-24 weeks in post-radiotherapy patients controlled on medical therapy; and within 24 weeks in asymptomatic patients with stable plasma ACTH concentrations after bilateral adrenalectomy. With a high level of consensus using the Delphi process, panelists recommended regular follow-up in most patient scenarios for this chronic condition. These recommendations may be useful for assessment of CD care both in research and clinical practice.

A Composite Indicator to Assess the Quality of Care in the Management of Patients With Rheumatoid Arthritis in Outpatient Rheumatology Clinics.

PubMed

Martín-Martínez, María Auxiliadora; Andreu-Sanchez, Jose Luis; Sanchez-Alonso, Fernando; Corominas, Hector; Perez-Venegas, Jose Javier; Roman-Ivorra, Jose Andres; Alperi, Mercedes; Blanco-Alonso, Ricardo; Caliz, Rafael; Chamizo-Carmona, Eugenio; Graña-Gil, Jenaro; Hernández, Blanca; Marras, Carlos; Mazzucchelli, Ramon; Medina Luezas, Julio Antonio; Naranjo-Hernández, Antonio; Ortiz, Ana; Roselló, Rosa; Sanchez-Nievas, Ginés; Sanmartí, Raimon; Vela-Casasempere, Paloma

2017-08-05

The current guidelines in the treatment of rheumatoid arthritis (RA) include the early diagnosis and early use of disease modifying drugs to achieve remission or low disease activity level, known as "Treat to Target" (T2T). The objective of this study is to develop a composite indicator (CI) to evaluate the quality of care in the management of patients with RA, according to the T2T strategy and other general recommendations concerning the management of these patients. The phases of the construction of the CI were: 1) selection of quality criteria through expert judgment; 2) prioritization of the criteria, according to relevance and feasibility, applying the Delphi methodology (two rounds) involving 20 experts; 3) design of quality indicators; and 4) calculation of the weighted CI, using the mean value in relevance and feasibility granted by the experts. The source of information for the calculation of the CI are the medical records of patients with RA. Twelve criteria out of 37 required a second Delphi round. Thirty-one criteria were prioritized. These criteria presented a median in relevance and feasibility greater than or equal to 7.5, with an interquartile range of less than 3.5, and a level of agreement (score greater than or equal to 8) greater than or equal to 80%. The constructed CI allows us to evaluate the quality of care of patients with RA following the T2T strategy in the rheumatology units of Spanish hospitals, offering a valid and easily interpretable summary measure. Copyright © 2017 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Defining consensus norms for palliative care of people with intellectual disabilities in Europe, using Delphi methods: A White Paper from the European Association of Palliative Care

PubMed Central

Tuffrey-Wijne, Irene; McLaughlin, Dorry; Curfs, Leopold; Dusart, Anne; Hoenger, Catherine; McEnhill, Linda; Read, Sue; Ryan, Karen; Satgé, Daniel; Straßer, Benjamin; Westergård, Britt-Evy; Oliver, David

2015-01-01

Background: People with intellectual disabilities often present with unique challenges that make it more difficult to meet their palliative care needs. Aim: To define consensus norms for palliative care of people with intellectual disabilities in Europe. Design: Delphi study in four rounds: (1) a taskforce of 12 experts from seven European countries drafted the norms, based on available empirical knowledge and regional/national guidelines; (2) using an online survey, 34 experts from 18 European countries evaluated the draft norms, provided feedback and distributed the survey within their professional networks. Criteria for consensus were clearly defined; (3) modifications and recommendations were made by the taskforce; and (4) the European Association for Palliative Care reviewed and approved the final version. Setting and participants: Taskforce members: identified through international networking strategies. Expert panel: a purposive sample identified through taskforce members’ networks. Results: A total of 80 experts from 15 European countries evaluated 52 items within the following 13 norms: equity of access, communication, recognising the need for palliative care, assessment of total needs, symptom management, end-of-life decision making, involving those who matter, collaboration, support for family/carers, preparing for death, bereavement support, education/training and developing/managing services. None of the items scored less than 86% agreement, making a further round unnecessary. In light of respondents’ comments, several items were modified and one item was deleted. Conclusion: This White Paper presents the first guidance for clinical practice, policy and research related to palliative care for people with intellectual disabilities based on evidence and European consensus, setting a benchmark for changes in policy and practice. PMID:26346181

Gait and Lower Limb Observation of Paediatrics (GALLOP): development of a consensus based paediatric podiatry and physiotherapy standardised recording proforma.

PubMed

Cranage, Simone; Banwell, Helen; Williams, Cylie M

2016-01-01

Paediatric gait and lower limb assessments are frequently undertaken in podiatry and physiotherapy clinical practice and this is a growing area of expertise within Australia. No concise paediatric standardised recording proforma exists to assist clinicians in clinical practice. The aim of this study was to develop a gait and lower limb standardised recording proforma guided by the literature and consensus, for assessment of the paediatric foot and lower limb in children aged 0-18 years. Expert Australian podiatrists and physiotherapists were invited to participate in a three round Delphi survey panel using the online Qualtrics(©) survey platform. The first round of the survey consisted of open-ended questions on paediatric gait and lower limb assessment developed from existing templates and a literature search of standardised lower limb assessment methods. Rounds two and three consisted of statements developed from the first round responses. Questions and statements were included in the final proforma if 70 % or more of the participants indicated consensus or agreement with the assessment method and if there was support within the literature for paediatric age-specific normative data with acceptable reliability of outcome measures. There were 17 of the 21 (81 %) participants who completed three rounds of the survey. Consensus was achieved for 41 statements in Round one, 54 statements achieved agreement in two subsequent rounds. Participants agreed on 95 statements relating to birth history, developmental history, hip measurement, rotation of the lower limb, ankle range of motion, foot posture, balance and gait. Assessments with acceptable validity and reliability were included within the final Gait and Lower Limb Observation of Paediatrics (GALLOP) proforma. The GALLOP proforma is a consensus based, systematic and standardised way to collect information and outcome measures in paediatric lower limb assessment. This standardised recording proforma will assist professions to collect information in a standardised format based on best evidence assessment methods whilst aiding consistency in communication between health professionals.

Finding common ground in implementation: towards a theory of gradual commonality.

PubMed

Ter Haar, Marian; Aarts, Noelle; Verhoeven, Piet

2016-03-01

This article reports on an empirical study that aimed to design a practice-based theory about collaboration on the local implementation of a nationally developed health-promoting intervention. The study's objective is to better understand the dynamic process of complex collaboration. The research is based on a Delphi study among some 100 individuals in local and regional networks, in which various professionals work together to implement the BeweegKuur, which translates as 'course of exercise'. The BeweegKuur is a combined lifestyle intervention aimed at promoting sufficient physical exercise and a healthy diet among people in the Netherlands who are overweight and at risk of diabetes. The Delphi study in three rounds systematically and interactively constructs a common perspective on implementation, reflecting stakeholders' ideas about the collaboration and providing an insight into how these ideas are influenced by the context of the implementation. The statistical and qualitative analyses of the responses to the feedback in the Delphi study form the basis for this practice-based theory on complex collaboration, called the theory of gradual commonality. During interaction, consensus gradually emerges about co-creation as a collaboration strategy. Co-creation leaves room for various ways of achieving the ambitions of the BeweegKuur. This article discusses the importance of this practice-based theory and the value of the Delphi research strategy for promoting health. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Engaging Patients and Caregivers Managing Rare Diseases to Improve the Methods of Clinical Guideline Development: A Research Protocol

PubMed Central

Kinnett, Kathi; Grant, Sean; Lucas, Ann; Martin, Ann; Denger, Brian; Peay, Holly; Coulter, Ian; Fink, Arlene

2017-01-01

Background Clinical guidelines provide systematically developed recommendations for deciding on appropriate health care options for specific conditions and clinical circumstances. Up until recently, patients and caregivers have rarely been included in the process of developing care guidelines. Objective This project will develop and test a new online method for including patients and their caregivers in this process using Duchenne muscular dystrophy (DMD) care guidelines as an example. The new method will mirror and complement the RAND/UCLA Appropriateness Method (RAM)—the gold standard approach for conducting clinical expert panels that uses a modified Delphi format. RAM is often used in clinical guideline development to determine care appropriateness and necessity in situations where existing clinical evidence is uncertain, weak, or unavailable. Methods To develop the new method for engaging patients and their caregivers in guideline development, we will first conduct interviews with experts on RAM, guideline development, patient engagement, and patient-centeredness and engage with Duchenne patients and caregivers to identify how RAM should be modified for the purposes of patient engagement and what rating criteria should patients and caregivers use to provide their input during the process of guideline development. Once the new method is piloted, we will test it by conducting two concurrently run patient/caregiver panels that will rate patient-centeredness of a subset of DMD care management recommendations already deemed clinically appropriate and necessary. The ExpertLens™ system—a previously evaluated online modified Delphi system that combines two rounds of rating with a round of feedback and moderated online discussions—will be used to conduct these panels. In addition to developing and testing the new engagement method, we will work with the members of our project’s Advisory Board to generate a list of best practices for enhancing the level of patient and caregiver involvement in the guideline development process. We will solicit input on these best practice from Duchenne patients, caregivers, and clinicians by conducting a series of round-table discussions and making a presentation at an annual conference on Duchenne. Results The study protocol was reviewed by RAND’s Human Subjects Protection Committee, which determined it to be exempt from review. Interviews with RAM experts have been completed. The projected study completion date is May 2020. Conclusions We expect that the new method will make it easier to engage large numbers of patients and caregivers in the process of guideline development in a rigorous and culturally appropriate manner that is consistent with the way clinicians participate in guideline development. Moreover, this project will develop best practices that could help involve patients and caregivers in the clinical guideline development process in other clinical areas, thereby facilitating the work of guideline developers. PMID:28455279

Mapping the Demand for Serious Games in Postgraduate Medical Education Using the Entrustable Professional Activities Framework.

PubMed

Graafland, Maurits; Ten Cate, Olle; van Seventer, Jan-Pieter; Schraagen, Jan Maarten C; Schijven, Marlies P

2015-10-01

Serious games are potentially powerful tools for residency training and increasingly attract attention from medical educators. At present, serious games have little evidence-based relations with competency-based medical education, which may impede their incorporation into residency training programs. The aim of this study was to identify highly valued entrustable professional activities (EPAs) to support designers in the development of new, serious games built on a valid needs-assessment. All 149 licensed medical specialists from seven specialties in one academic hospital participated in seven different Delphi expert panels. They filled out a two-round Delphi survey, aimed at identifying the most valuable EPAs in their respective curricula. Specialists were asked to name the most highly valued EPA in their area in the first Delphi round. In the second round, the generated responses were presented and ranked according to priority by the medical specialists. Sixty-two EPAs were identified as valuable training subjects throughout five specialties. Eleven EPAs--"management of trauma patient," "chest tube placement," "laparoscopic cholecystectomy," "assessment of vital signs," "airway management," "induction of general anesthesia," "assessment of suicidal patient," "psychiatric assessment," "gastroscopy," "colonoscopy," and "resuscitation of emergency patients"--were consistently given a high score. The future medical specialist is an active learner, comfortable with digital techniques and learning strategies such as serious gaming. In order to maximize the impact and acceptance of new serious games, it is vital to select the most relevant training subjects. Although some serious games have already targeted top-priority EPAs, plenty of opportunities remain.

Programme Reporting Standards (PRS) for improving the reporting of sexual, reproductive, maternal, newborn, child and adolescent health programmes.

PubMed

Kågesten, Anna E; Tunçalp, Özge; Portela, Anayda; Ali, Moazzam; Tran, Nhan; Gülmezoglu, A Metin

2017-08-03

Information about design, implementation, monitoring and evaluation is central to understand the impact of programmes within the field of sexual, reproductive, maternal, newborn, child and adolescent health (SRMNCAH). Existing reporting guidelines do not orient on reporting of contextual and implementation issues in sufficient detail. We therefore developed Programme Reporting Standards (PRS) to be used by SRMNCAH programme implementers and researchers. Building on the first step of the PRS development (a systematic review to identify reporting items), we conducted a three-round online Delphi consensus survey with experts. Consensus was defined a-priori as 80% agreement of items as essential. This was followed by a technical consultation with a group of experts to refine the items, definitions and their structuring. The revised PRS was piloted to assess its relevance to current SRMNCAH programme reports and identify key issues regarding the use of the PRS. Of the 81 participants invited to the Delphi survey, 20 responded to all three rounds. In the final round, 27 items received consensus as essential; three items were ranked as "borderline" essential; 20 items as supplementary. The items were subsequently revised, followed by a technical consultation with 29 experts to further review and refine the PRS. The feedback resulted in substantial changes to the structure and content of the PRS into 24 items across five domains: Programme overview; Programme components and implementation; Monitoring of Implementation; Evaluation and Results; and Synthesis. This version was used in a piloting exercise, where questions regarding how much information to report and how to comment on the quality of the information reported were addressed. All items were kept in the PRS following the pilot although minor changes were made to the flow and description of items. The PRS 1.0 is the result of a structured, collaborative process, including methods to incorporate input from SRMNCAH stakeholders. The World Health Organization will develop a document that explains the items in greater detail, and will also apply the PRS to on-going initiatives. We welcome continuous input from the field, while it is being used, to improve its relevance and usefulness.

Achieving Consensus for the Design and Delivery of an Online Intervention to Support Midwives in Work-Related Psychological Distress: Results From a Delphi Study.

PubMed

Pezaro, Sally; Clyne, Wendy

2016-07-12

Some midwives are known to experience both professional and organizational sources of psychological distress, which can manifest as a result of the emotionally demanding midwifery work, and the traumatic work environments they endure. An online intervention may be one option midwives may engage with in pursuit of effective support. However, the priorities for the development of an online intervention to effectively support midwives in work-related psychological distress have yet to be explored. The aim of this study was to explore priorities in the development of an online intervention to support midwives in work-related psychological distress. A two-round online Delphi study was conducted. This study invited both qualitative and quantitative data from experts recruited via a scoping literature search and social media channels. In total, 185 experts were invited to participate in this Delphi study. Of all participants invited to contribute, 35.7% (66/185) completed Round 1 and of those who participated in this first round, 67% (44/66) continued to complete Round 2. Out of 39 questions posed over two rounds, 18 statements (46%) achieved consensus, 21 (54%) did not. Participants were given the opportunity to write any additional comments as free text. In total, 1604 free text responses were collected and categorized into 2446 separate statements of opinion, creating a total of 442 themes. Overall, participants agreed that in order to effectively support midwives in work-related psychological distress, online interventions should make confidentiality and anonymity a high priority, along with 24-hour mobile access, effective moderation, an online discussion forum, and additional legal, educational, and therapeutic components. It was also agreed that midwives should be offered a simple user assessment to identify those people deemed to be at risk of either causing harm to others or experiencing harm themselves, and direct them to appropriate support. This study has identified priorities for the development of online interventions to effectively support midwives in work-related psychological distress. The impact of any future intervention of this type will be optimized by utilizing these findings in the development process.

Achieving Consensus for the Design and Delivery of an Online Intervention to Support Midwives in Work-Related Psychological Distress: Results From a Delphi Study

PubMed Central

Clyne, Wendy

2016-01-01

Background Some midwives are known to experience both professional and organizational sources of psychological distress, which can manifest as a result of the emotionally demanding midwifery work, and the traumatic work environments they endure. An online intervention may be one option midwives may engage with in pursuit of effective support. However, the priorities for the development of an online intervention to effectively support midwives in work-related psychological distress have yet to be explored. Objective The aim of this study was to explore priorities in the development of an online intervention to support midwives in work-related psychological distress. Methods A two-round online Delphi study was conducted. This study invited both qualitative and quantitative data from experts recruited via a scoping literature search and social media channels. Results In total, 185 experts were invited to participate in this Delphi study. Of all participants invited to contribute, 35.7% (66/185) completed Round 1 and of those who participated in this first round, 67% (44/66) continued to complete Round 2. Out of 39 questions posed over two rounds, 18 statements (46%) achieved consensus, 21 (54%) did not. Participants were given the opportunity to write any additional comments as free text. In total, 1604 free text responses were collected and categorized into 2446 separate statements of opinion, creating a total of 442 themes. Overall, participants agreed that in order to effectively support midwives in work-related psychological distress, online interventions should make confidentiality and anonymity a high priority, along with 24-hour mobile access, effective moderation, an online discussion forum, and additional legal, educational, and therapeutic components. It was also agreed that midwives should be offered a simple user assessment to identify those people deemed to be at risk of either causing harm to others or experiencing harm themselves, and direct them to appropriate support. Conclusions This study has identified priorities for the development of online interventions to effectively support midwives in work-related psychological distress. The impact of any future intervention of this type will be optimized by utilizing these findings in the development process. PMID:27405386

Nurses' Empowerment Scale for ICU patients' families: an instrument development study.

PubMed

Li, Hong; Liu, Ya-Lan; Qiu, Li; Chen, Qiao-Ling; Wu, Jing-Bing; Chen, Li-Li; Li, Na

2016-09-01

Family members provide essential support for ICU patients, contributing to their mental and physical recovery. Empowering ICU patients' families may help them overcome inadequacies and meet their own and patients' acknowledged needs. Nursing should understand and address patients' families' empowerment status. To develop a tool, the Nurses' Empowerment Scale for Intensive Care Unit (ICU) Patients' Families (NESIPF), to help ICU nursing staff assess the empowerment status of patients' families. Four-phase instrument development study. A 19-item instrument was initially generated based on literature review and interviews with family members of ICU patients. The Delphi research method was applied to gain expert opinion and consensus via rounds of questionnaires. A panel of 27 experts experienced in critical care medicine, nursing and psychology participated in two Delphi rounds and their input helped formulate an 18-item pretest instrument. Families of 20 patients were recruited to examine instrument readability. After a 2-week interval, another 20 patients' families were recruited to examine test-retest reliability. Two hundred questionnaires were then administered and analysed to examine the instrument's construct validity, criterion-related validity and internal consistency. Expert authority coefficients of two Delphi rounds reached 0·89 and 0·91. Kendall' W coefficients of 0·113 (P < 0·001) in round 1 and 0·220 (P < 0·001) in round 2 indicated slight to fair agreement among experts. Content validity index (CVI) reached 1·0 for 12 items; the CVI for item 13 was <0·7 so it was excluded. Cronbach's α coefficient was 0·92, indicating acceptable internal consistency reliability. The coefficient of internal consistency of each dimension was 0·717-0·921. The Pearson correlation coefficient >0·9 (P < 0·05) showed an acceptable test-retest reliability. The instrument has acceptable reliability and validity and can assess the empowerment status of families of critically ill patients. Knowledge of families' empowerment status may help to address their psychological needs and their ability to provide family support. © 2014 British Association of Critical Care Nurses.

Determination of Problematic ICD-9-CM Subcategories for Further Study of Coding Performance: Delphi Method

PubMed Central

Zeng, Xiaoming; Bell, Paul D

2011-01-01

In this study, we report on a qualitative method known as the Delphi method, used in the first part of a research study for improving the accuracy and reliability of ICD-9-CM coding. A panel of independent coding experts interacted methodically to determine that the three criteria to identify a problematic ICD-9-CM subcategory for further study were cost, volume, and level of coding confusion caused. The Medicare Provider Analysis and Review (MEDPAR) 2007 fiscal year data set as well as suggestions from the experts were used to identify coding subcategories based on cost and volume data. Next, the panelists performed two rounds of independent ranking before identifying Excisional Debridement as the subcategory that causes the most confusion among coders. As a result, they recommended it for further study aimed at improving coding accuracy and variation. This framework can be adopted at different levels for similar studies in need of a schema for determining problematic subcategories of code sets. PMID:21796264

Validating competencies for an undergraduate training program in rural medicine using the Delphi technique.

PubMed

Gouveia, Eneline Ah; Braga, Taciana D; Heráclio, Sandra A; Pessoa, Bruno Henrique S

2016-01-01

Worldwide, half the population lives in rural or remote areas; however, less than 25% of doctors work in such regions. Despite the continental dimensions of Brazil and its enormous cultural diversity, only some medical schools in this country offer students the opportunity to acquire work experience focused on medicine in rural or remote areas. The objective of the present study was to develop a framework of competencies for a longitudinal medical training program in rural medicine as an integrated part of medical training in Brazil. Two rounds of a modified version of the Delphi technique were conducted. Initially, a structured questionnaire was elaborated, based on a literature review. This questionnaire was submitted to the opinion of 20 panelists affiliated with the Rural Medicine Working Party of the Brazilian Society of Family and Community Medicine. The panelists were asked to evaluate the relevance of the competencies using a five-point Likert-type scale. In this study, the consensus criterion for a competency to be included in the framework was it being deemed 'very important' or 'indispensable' by a simple majority of the participants, while the criterion for excluding a competency was that a simple majority of the panel members considered that it 'should not be included' or was 'of little importance'. When a consensus was not reached regarding a given competency, it was submitted to a second round to enable the panelists to re-evaluate the now dichotomized questions. Compliance in responding to the questionnaire was better among the panelists predominantly involved in teaching activities (85%; n=12) compared to those working principally in patient care (45%; n=8). The questionnaire consisted of 26 core competencies and 165 secondary competencies. After evaluation by the specialists, all the 26 core competencies were classified as relevant, with none being excluded and only eight secondary competencies failing to achieve a consensus. No new competencies were suggested. Of the competencies that failed to reach a consensus in the first round, seven were excluded from the framework in the second round, with most of these being associated with hospital procedures. A framework of competencies for a program in rural medicine was developed and validated. It consists of 26 core competencies and 158 secondary competencies that should be useful when constructing competency-based curricula in rural medicine for medical education in Brazil.

Characteristics of student preparedness for clinical learning: clinical educator perspectives using the Delphi approach

PubMed Central

2012-01-01

Background During clinical placements, clinical educators facilitate student learning. Previous research has defined the skills, attitudes and practices that pertain to an ideal clinical educator. However, less attention has been paid to the role of student readiness in terms of foundational knowledge and attitudes at the commencement of practice education. Therefore, the aim of this study was to ascertain clinical educators’ views on the characteristics that they perceive demonstrate that a student is well prepared for clinical learning. Methods A two round on-line Delphi study was conducted. The first questionnaire was emailed to a total of 636 expert clinical educators from the disciplines of occupational therapy, physiotherapy and speech pathology. Expert clinical educators were asked to describe the key characteristics that indicate a student is prepared for a clinical placement and ready to learn. Open-ended responses received from the first round were subject to a thematic analysis and resulted in six themes with 62 characteristics. In the second round, participants were asked to rate each characteristic on a 7 point Likert Scale. Results A total of 258 (40.56%) responded to the first round of the Delphi survey while 161 clinical educators completed the second (62.40% retention rate). Consensus was reached on 57 characteristics (six themes) using a cut off of greater than 70% positive respondents and an interquartile deviation IQD of equal or less than 1. Conclusions This study identified 57 characteristics (six themes) perceived by clinical educators as indicators of a student who is prepared and ready for clinical learning. A list of characteristics relating to behaviours has been compiled and could be provided to students to aid their preparation for clinical learning and to universities to incorporate within curricula. In addition, the list provides a platform for discussions by professional bodies about the role of placement education. PMID:23145840

Development of clinical practice guidelines for supportive care in childhood cancer--prioritization of topics using a Delphi approach.

PubMed

Loeffen, E A H; Mulder, R L; Kremer, L C M; Michiels, E M C; Abbink, F C H; Ball, L M; Segers, H; Mavinkurve-Groothuis, A M C; Smit, F J; Vonk, I J M; Vd Wetering, M D; Tissing, W J E

2015-07-01

Currently, very few guidelines for supportive care for children with cancer exist. In the Netherlands, nationwide guidelines are over 10 years old and mostly based on expert opinion. Consequently, there is growing support and need for clinical practice guidelines (CPGs), which ought to be developed with a well-defined methodology and include a systematic search of literature, evidence summaries, and a transparent description of the decision process for the final recommendations. Development of CPGs is time consuming; therefore, it is important to prioritize topics for which there is the greatest clinical demand. This study aims to prioritize childhood cancer supportive care topics for development of CPGs. A Delphi survey consisting of two rounds was conducted to prioritize relevant childhood cancer supportive care topics for the development of CPGs. A group of experts comprising 15 pediatric oncologists, 15 pediatric oncology nurses, and 15 general pediatricians involved in care for childhood cancer patients were invited to participate. All relevant supportive care topics in childhood cancer were rated. In both rounds, 36 panellists (82%) responded. Agreement between panellists was very good, with an intraclass correlation coefficient of 0.918 (95% confidence interval (CI) = 0.849-0.966, p < 0.001) in round 2. The ten topics with the highest score in the final round were infection, sepsis, febrile neutropenia, pain, nausea/vomiting, restrictions in daily life and activities, palliative care, procedural sedation, terminal care, and oral mucositis. We successfully used a Delphi survey to prioritize childhood cancer supportive care topics for the development of CPGs. This is a first step towards uniform and evidence-based Dutch guidelines in supportive care in childhood cancer. Even though performed nationally, we believe that this study can also be regarded as an example starting point for international development of CPGs in the field of supportive care in cancer or any other field for that matter.

Development of a tool to support holistic generic assessment of clinical procedure skills.

PubMed

McKinley, Robert K; Strand, Janice; Gray, Tracey; Schuwirth, Lambert; Alun-Jones, Tom; Miller, Helen

2008-06-01

The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff. Results In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station. This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).

Quality pharmacy services and key performance indicators in Polish NICUs: a Delphi approach.

PubMed

Krzyżaniak, Natalia; Pawłowska, Iga; Bajorek, Beata

2018-03-31

Background Currently, there is no literature describing what a quality level of practice entails in Polish neonatal intensive care units (NICUs), nor are there any means of currently measuring the quality of pharmaceutical care provided to NICU patients. Objective To identify a set of essential pharmacist roles and pharmacy-relevant key performance indicators (KPI's) suitable for Polish neonatal intensive units (NICUs). Setting Polish hospital pharmacies and NICUs. Method Using a modified Delphi technique, potential KPI's structured along Donabedian's domains as well as pharmacy services were presented to an expert panel of stakeholders. Two online, consecutive Delphi rounds, were completed by panellists between August and September 2017. Main outcome measure To identify the minimum level of pharmacy services that should be consistently provided to NICU patients. Results A total of 16 panellists contributed to the expert panel. Overall, consensus of 75% was reached for 23 indicators and for 28 roles. When considering pharmacy services for the NICU, the experts were found to highly value traditional pharmacy roles, such as dispensing and extemporaneous compounding, however, they were still eager for roles in the other domains, such as educational and clinical services, to be listed as essential for NICU practice. Panellists were found to positively value the list of indicators presented, and excluded only 9 out of the total list. Conclusion There is a need for future research to establish a minimum standard of practice for Polish pharmacists to encourage the progression and standardisation of hospital pharmacy services to meet the level of practice seen in NICUs worldwide.

Determining an Imaging Literacy Curriculum for Radiation Oncologists: An International Delphi Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Giuliani, Meredith E., E-mail: Meredith.Giuliani@rmp.uhn.on.ca; Department of Radiation Oncology, University of Toronto, Toronto, Ontario; Gillan, Caitlin

2014-03-15

Purpose: Rapid evolution of imaging technologies and their integration into radiation therapy practice demands that radiation oncology (RO) training curricula be updated. The purpose of this study was to develop an entry-to-practice image literacy competency profile. Methods and Materials: A list of 263 potential imaging competency items were assembled from international objectives of training. Expert panel eliminated redundant or irrelevant items to create a list of 97 unique potential competency items. An international 2-round Delphi process was conducted with experts in RO. In round 1, all experts scored, on a 9-point Likert scale, the degree to which they agreed anmore » item should be included in the competency profile. Items with a mean score ≥7 were included, those 4 to 6 were reviewed in round 2, and items scored <4 were excluded. In round 2, items were discussed and subsequently ranked for inclusion or exclusion in the competency profile. Items with >75% voting for inclusion were included in the final competency profile. Results: Forty-nine radiation oncologists were invited to participate in round 1, and 32 (65%) did so. Participants represented 24 centers in 6 countries. Of the 97 items ranked in round 1, 80 had a mean score ≥7, 1 item had a score <4, and 16 items with a mean score of 4 to 6 were reviewed and rescored in round 2. In round 2, 4 items had >75% of participants voting for inclusion and were included; the remaining 12 were excluded. The final list of 84 items formed the final competency profile. The 84 enabling competency items were aggregated into the following 4 thematic groups of key competencies: (1) imaging fundamentals (42 items); (2) clinical application (27 items); (3) clinical management (5 items); and (4) professional practice (10 items). Conclusions: We present an imaging literacy competency profile which could constitute the minimum training standards in radiation oncology residency programs.« less

Validation of the new diagnosis grouping system for pediatric emergency department visits using the International Classification of Diseases, 10th Revision.

PubMed

Lee, Jin Hee; Hong, Ki Jeong; Kim, Do Kyun; Kwak, Young Ho; Jang, Hye Young; Kim, Hahn Bom; Noh, Hyun; Park, Jungho; Song, Bongkyu; Jung, Jae Yun

2013-12-01

A clinically sensible diagnosis grouping system (DGS) is needed for describing pediatric emergency diagnoses for research, medical resource preparedness, and making national policy for pediatric emergency medical care. The Pediatric Emergency Care Applied Research Network (PECARN) developed the DGS successfully. We developed the modified PECARN DGS based on the different pediatric population of South Korea and validated the system to obtain the accurate and comparable epidemiologic data of pediatric emergent conditions of the selected population. The data source used to develop and validate the modified PECARN DGS was the National Emergency Department Information System of South Korea, which was coded by the International Classification of Diseases, 10th Revision (ICD-10) code system. To develop the modified DGS based on ICD-10 code, we matched the selected ICD-10 codes with those of the PECARN DGS by the General Equivalence Mappings (GEMs). After converting ICD-10 codes to ICD-9 codes by GEMs, we matched ICD-9 codes into PECARN DGS categories using the matrix developed by PECARN group. Lastly, we conducted the expert panel survey using Delphi method for the remaining diagnosis codes that were not matched. A total of 1879 ICD-10 codes were used in development of the modified DGS. After 1078 (57.4%) of 1879 ICD-10 codes were assigned to the modified DGS by GEM and PECARN conversion tools, investigators assigned each of the remaining 801 codes (42.6%) to DGS subgroups by 2 rounds of electronic Delphi surveys. And we assigned the remaining 29 codes (4%) into the modified DGS at the second expert consensus meeting. The modified DGS accounts for 98.7% and 95.2% of diagnoses of the 2008 and 2009 National Emergency Department Information System data set. This modified DGS also exhibited strong construct validity using the concepts of age, sex, site of care, and seasons. This also reflected the 2009 outbreak of H1N1 influenza in Korea. We developed and validated clinically feasible and sensible DGS system for describing pediatric emergent conditions in Korea. The modified PECARN DGS showed good comprehensiveness and demonstrated reliable construct validity. This modified DGS based on PECARN DGS framework may be effectively implemented for research, reporting, and resource planning in pediatric emergency system of South Korea.

A National Needs Assessment to Identify Technical Procedures in Vascular Surgery for Simulation Based Training.

PubMed

Nayahangan, L J; Konge, L; Schroeder, T V; Paltved, C; Lindorff-Larsen, K G; Nielsen, B U; Eiberg, J P

2017-04-01

Practical skills training in vascular surgery is facing challenges because of an increased number of endovascular procedures and fewer open procedures, as well as a move away from the traditional principle of "learning by doing." This change has established simulation as a cornerstone in providing trainees with the necessary skills and competences. However, the development of simulation based programs often evolves based on available resources and equipment, reflecting convenience rather than a systematic educational plan. The objective of the present study was to perform a national needs assessment to identify the technical procedures that should be integrated in a simulation based curriculum. A national needs assessment using a Delphi process was initiated by engaging 33 predefined key persons in vascular surgery. Round 1 was a brainstorming phase to identify technical procedures that vascular surgeons should learn. Round 2 was a survey that used a needs assessment formula to explore the frequency of procedures, the number of surgeons performing each procedure, risk and/or discomfort, and feasibility for simulation based training. Round 3 involved elimination and ranking of procedures. The response rate for round 1 was 70%, with 36 procedures identified. Round 2 had a 76% response rate and resulted in a preliminary prioritised list after exploring the need for simulation based training. Round 3 had an 85% response rate; 17 procedures were eliminated, resulting in a final prioritised list of 19 technical procedures. A national needs assessment using a standardised Delphi method identified a list of procedures that are highly suitable and may provide the basis for future simulation based training programs for vascular surgeons in training. Copyright © 2017 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

PREFERRED REPORTING ITEMS FOR STUDIES MAPPING ONTO PREFERENCE-BASED OUTCOME MEASURES: THE MAPS STATEMENT.

PubMed

Petrou, Stavros; Rivero-Arias, Oliver; Dakin, Helen; Longworth, Louise; Oppe, Mark; Froud, Robert; Gray, Alastair

2015-01-01

"Mapping" onto generic preference-based outcome measures is increasingly being used as a means of generating health utilities for use within health economic evaluations. Despite publication of technical guides for the conduct of mapping research, guidance for the reporting of mapping studies is currently lacking. The MAPS (MApping onto Preference-based measures reporting Standards) statement is a new checklist, which aims to promote complete and transparent reporting of mapping studies. In the absence of previously published reporting checklists or reporting guidance documents, a de novo list of reporting items was created by a working group comprised of six health economists and one Delphi methodologist. A two-round, modified Delphi survey with representatives from academia, consultancy, health technology assessment agencies, and the biomedical journal editorial community was used to identify a list of essential reporting items from this larger list. From the initial de novo list of twenty-nine candidate items, a set of twenty-three essential reporting items was developed. The items are presented numerically and categorized within six sections, namely: (i) title and abstract, (ii) introduction, (iii) methods, (iv) results, (v) discussion, and (vi) other. The MAPS statement is best applied in conjunction with the accompanying MAPS explanation and elaboration document. It is anticipated that the MAPS statement will improve the clarity, transparency. and completeness of reporting of mapping studies. To facilitate dissemination and uptake, the MAPS statement is being co-published by seven health economics and quality of life journals, and broader endorsement is encouraged. The MAPS working group plans to assess the need for an update of the reporting checklist in five years' time.

Identification of Core Competencies for an Undergraduate Food Safety Curriculum Using a Modified Delphi Approach

ERIC Educational Resources Information Center

Johnston, Lynette M.; Wiedmann, Martin; Orta-Ramirez, Alicia; Oliver, Haley F.; Nightingale, Kendra K.; Moore, Christina M.; Stevenson, Clinton D.; Jaykus, Lee-Ann

2014-01-01

Identification of core competencies for undergraduates in food safety is critical to assure courses and curricula are appropriate in maintaining a well-qualified food safety workforce. The purpose of this study was to identify and refine core competencies relevant to postsecondary food safety education using a modified Delphi method. Twenty-nine…

The Semiconductor Industry and Emerging Technologies: A Study Using a Modified Delphi Method

ERIC Educational Resources Information Center

Jordan, Edgar A.

2010-01-01

The purpose of this qualitative descriptive study was to determine what leaders in the semiconductor industry thought the future of computing would look like and what emerging materials showed the most promise to overcome the current theoretical limit of 10 nanometers for silicon dioxide. The researcher used a modified Delphi technique in two…

Exploring Research Themes in Public Engagement within a Natural History Museum: A Modified Delphi Approach

ERIC Educational Resources Information Center

Seakins, Amy; Dillon, Justin

2013-01-01

The primacy of the research question in designing studies affords an opportunity for enhancing collaborations between researchers and "practitioners". This paper describes the use of a modified Delphi technique to co-generate research questions for a collaborative research study co-funded by a university and a natural history museum.…

Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis Standard Reporting and Evaluation Guidelines: Results of a National Institutes of Health Working Group.

PubMed

Maverakis, Emanual; Wang, Elizabeth A; Shinkai, Kanade; Mahasirimongkol, Surakameth; Margolis, David J; Avigan, Mark; Chung, Wen-Hung; Goldman, Jennifer; La Grenade, Lois; Pirmohamed, Munir; Shear, Neil H; Tassaeeyakul, Wichittra; Hoetzenecker, Wolfram; Klaewsongkram, Jettanong; Rerkpattanapipat, Ticha; Manuyakorn, Wiparat; Yasuda, Sally Usdin; Sharon, Victoria R; Sukhov, Andrea; Micheletti, Robert; Struewing, Jeff; French, Lars E; Cheng, Michelle Y

2017-06-01

Toxic epidermal necrolysis (TEN) and Stevens-Johnson Syndrome (SJS) are rare, acute, life-threatening dermatologic disorders involving the skin and mucous membranes. Research into these conditions is hampered by a lack of standardization of case reporting and data collection. To establish a standardized case report form to facilitate comparisons and maintain data quality based on an international panel of SJS/TEN experts who performed a Delphi consensus-building exercise. The elements presented for committee scrutiny were adapted from previous case report forms and from PubMed literature searches of highly cited manuscripts pertaining to SJS/TEN. The expert opinions and experience of the members of the consensus group were included in the discussion. Overall, 21 out of 29 experts who were invited to participate in the online Delphi exercise agreed to participate. Surveys at each stage were administered via an online survery software tool. For the first 2 Delphi rounds, results were analyzed using the Interpercentile Range Adjusted for Symmetry method and statements that passed consensus formulated a new case report form. For the third Delphi round, the case report form was presented to the committee, who agreed that it was "appropriate and useful" for documenting cases of SJS/TEN, making it more reliable and valuable for future research endeavors. With the consensus of international experts, a case report form for SJS/TEN has been created to help standardize the collection of patient information in future studies and the documentation of individual cases.

Dupuytren disease: European hand surgeons, hand therapists, and physical medicine and rehabilitation physicians agree on a multidisciplinary treatment guideline: results from the HANDGUIDE study.

PubMed

Huisstede, Bionka M A; Hoogvliet, Peter; Coert, J Henk; Fridén, Jan

2013-12-01

Multidisciplinary treatment guidelines for Dupuytren disease can aid in optimizing the quality of care for patients with this disorder. Therefore, this study aimed to achieve consensus on a multidisciplinary treatment guideline for Dupuytren disease. A European Delphi consensus strategy was initiated. A systematic review reporting on the effectiveness of interventions was conducted and used as an evidence-based starting point for this study. In total, 39 experts (hand surgeons, hand therapists, and physical medicine and rehabilitation physicians) participated in the Delphi consensus strategy. Each Delphi round consisted of a questionnaire, an analysis, and a feedback report. After four Delphi rounds, consensus was achieved on the description, symptoms, and diagnosis of Dupuytren disease. No nonsurgical interventions were included in the guideline. Needle and open fasciotomy, and a limited fasciectomy and dermofasciectomy, were seen as suitable surgical techniques for Dupuytren disease. Factors relevant for choosing one of these surgical techniques were identified and divided into patient-related (age, comorbidity), disease-related (palpable cord, previous surgery in the same area, skin involvement, time of recovery, recurrences), and surgeon-related (years of experience) factors. Associations of these factors with the choice of a specific surgical technique were reported in the guideline. Postsurgical rehabilitation should always include instructions and exercise therapy; postsurgical splinting should be performed on indication. Relevant details for the use of surgical and postsurgical interventions were described. This treatment guideline is likely to promote further discussion on related clinical and scientific issues and may therefore contribute to better treatment of patients with Dupuytren disease.

Development of a standardized training course for laparoscopic procedures using Delphi methodology.

PubMed

Bethlehem, Martijn S; Kramp, Kelvin H; van Det, Marc J; ten Cate Hoedemaker, Henk O; Veeger, Nicolaas J G M; Pierie, Jean Pierre E N

2014-01-01

Content, evaluation, and certification of laparoscopic skills and procedure training lack uniformity among different hospitals in The Netherlands. Within the process of developing a new regional laparoscopic training curriculum, a uniform and transferrable curriculum was constructed for a series of laparoscopic procedures. The aim of this study was to determine regional expert consensus regarding the key steps for laparoscopic appendectomy and cholecystectomy using Delphi methodology. Lists of suggested key steps for laparoscopic appendectomy and cholecystectomy were created using surgical textbooks, available guidelines, and local practice. A total of 22 experts, working for teaching hospitals throughout the region, were asked to rate the suggested key steps for both procedures on a Likert scale from 1-5. Consensus was reached with Crohnbach's α ≥ 0.90. Of the 22 experts, 21 completed and returned the survey (95%). Data analysis already showed consensus after the first round of Delphi on the key steps for laparoscopic appendectomy (Crohnbach's α = 0.92) and laparoscopic cholecystectomy (Crohnbach's α = 0.90). After the second round, 15 proposed key steps for laparoscopic appendectomy and 30 proposed key steps for laparoscopic cholecystectomy were rated as important (≥4 by at least 80% of the expert panel). These key steps were used for the further development of the training curriculum. By using the Delphi methodology, regional consensus was reached on the key steps for laparoscopic appendectomy and cholecystectomy. These key steps are going to be used for standardized training and evaluation purposes in a new regional laparoscopic curriculum. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

[Prioritization and Consentation of Criteria for the Appraisal, Funding and Evaluation of Projects from the German Innovationsfonds: A multi-perspective Delphi study].

PubMed

Schmitt, J; Petzold, T; Nellessen-Martens, G; Pfaff, H

2015-09-01

The German Innovationsfonds provides the chance for evidence-based developments of the German healthcare system. Prioritization of recommendations for an effective, efficient, fair, transparent, and sustainable granting of funds through a transparent, evidence-driven consensus-process involving all relevant stakeholder groups. Representatives from health and research policy, payers, patient representatives, healthcare providers, and scientists were invited to nominate participants for an electronic 3 round iterative Delphi-study to prioritize the thematic focus, requirements concerning study methods, the team of applicants, evaluation, utilization of study results, and for the selection of reviewers. Criteria considered as relevant by at least 60% of the panel (consensus definition) in the first 2 Delphi rounds were rated as facultative, preferable, or obligatory criteria for project funding. Data were analyzed descriptively. ( Datenbank Versorgungsforschung Deutschland VfD_15_003561). All invited stakeholder groups except payers participated. 34 (85%) of 40 nominated representatives participated in the Delphi-study. A total of 64 criteria were consented as relevant for project review and funding concerning the thematic focus (n=28), methodological requirements (n=13), requirements for applicants (n=4), for the evaluation (n=4), utilization (n=6), and selection of peer reviewers (n=9). It is the collective responsibility of all stakeholders to spend the designated funds as efficient and sustainable as possible. The consented recommendations shall serve decision makers as a resource for the granting of funds and the evaluation of the Innovationsfonds. © Georg Thieme Verlag KG Stuttgart · New York.

Personal Learning Environments and University Teacher Roles Explored Using Delphi

ERIC Educational Resources Information Center

Shaikh, Zaffar Ahmed; Khoja, Shakeel Ahmed

2014-01-01

This paper presents the results of research using an online Delphi method, which aimed to explore university teacher roles and readiness for learner-centred pedagogy, driven by personal learning environments (PLEs). Using a modified Policy Delphi technique, a group of researchers worked with 34 international experts who are university teachers by…

Development of Cardiovascular Quality Indicators for Rheumatoid Arthritis: Results from an International Expert Panel Using a Novel Online Process

PubMed Central

Barber, Claire E. H.; Marshall, Deborah A; Alvarez, Nanette; John Mancini, G. B.; Lacaille, Diane; Keeling, Stephanie; Aviña-Zubieta, J. Antonio; Khodyakov, Dmitry; Barnabe, Cheryl; Faris, Peter; Smith, Alexa; Noormohamed, Raheem; Hazlewood, Glen; Martin, Liam O.; Esdaile, John M.

2016-01-01

Objective Patients with rheumatoid arthritis (RA) have a high risk of premature cardiovascular disease (CVD). We developed CVD quality indicators (QIs) for screening and use in Rheumatology clinics. Methods A systematic review of the literature on CVD risk reduction in RA and the general population was conducted. Based on the best practices identified from this review, a draft set of 12 candidate QIs were presented to a Canadian panel of rheumatologists and cardiologists (n=6) from three academic centers to achieve consensus on the QI specifications. The resulting 11 QIs were then evaluated by an online modified-Delphi panel of multidisciplinary health professionals and patients (n = 43) to determine their relevance, validity and feasibility in three rounds of online voting and threaded discussion using a modified RAND/UCLA Appropriateness Methodology. Results Response rates for the online panel were 86%. All 11 QIs were rated as highly relevant, valid and feasible (median rating ≥7 on a 1–9 scale) with no significant disagreement. The final QI set addresses the following themes: communication to primary care about increased CV risk in RA, CV risk assessment, defining smoking status and providing cessation counseling, screening and addressing hypertension, dyslipidemia and diabetes, exercise recommendations, body mass index screening and lifestyle counseling, minimizing corticosteroid use and communicating to patients at high risk of CVD about the risks/benefits of non-steroidal anti-inflammatory drugs. Conclusion Eleven QIs for CVD care in RA patients have been developed and are rated as highly relevant, valid and feasible by an international multidisciplinary panel. PMID:26178275

Identifying Medication Management Smartphone App Features Suitable for Young Adults With Developmental Disabilities: Delphi Consensus Study

PubMed Central

Salgado, Teresa M; Fedrigon, Alexa; Riccio Omichinski, Donna; Meade, Michelle A

2018-01-01

Background Smartphone apps can be a tool to facilitate independent medication management among persons with developmental disabilities. At present, multiple medication management apps exist in the market, but only 1 has been specifically designed for persons with developmental disabilities. Before initiating further app development targeting this population, input from stakeholders including persons with developmental disabilities, caregivers, and professionals regarding the most preferred features should be obtained. Objective The aim of this study was to identify medication management app features that are suitable to promote independence in the medication management process by young adults with developmental disabilities using a Delphi consensus method. Methods A compilation of medication management app features was performed by searching the iTunes App Store, United States, in February 2016, using the following terms: adherence, medication, medication management, medication list, and medication reminder. After identifying features within the retrieved apps, a final list of 42 features grouped into 4 modules (medication list, medication reminder, medication administration record, and additional features) was included in a questionnaire for expert consensus rating. A total of 52 experts in developmental disabilities, including persons with developmental disabilities, caregivers, and professionals, were invited to participate in a 3-round Delphi technique. The purpose was to obtain consensus on features that are preferred and suitable to promote independence in the medication management process among persons with developmental disabilities. Consensus for the first, second, and third rounds was defined as ≥90%, ≥80%, and ≥75% agreement, respectively. Results A total of 75 responses were received over the 3 Delphi rounds—30 in the first round, 24 in the second round, and 21 in the third round. At the end of the third round, cumulative consensus was achieved for 60% (12/20) items in the medication list module, 100% (3/3) in the medication reminder module, 67% (2/3) in the medication administration record module, and 63% (10/16) in the additional features module. In addition to the medication list, medication reminder, and medication administration record features, experts selected the following top 3 most important additional features: automatic refills through pharmacies; ability to share medication information from the app with providers; and ability to share medication information from the app with family, friends, and caregivers. The top 3 least important features included a link to an official drug information source, privacy settings and password protection, and prescription refill reminders. Conclusions Although several mobile apps for medication management exist, few are specifically designed to support persons with developmental disabilities in the complex medication management process. Of the 42 different features assessed, 64% (27/42) achieved consensus for inclusion in a future medication management app. This study provides information on the features of a medication management app that are most important to persons with developmental disabilities, caregivers, and professionals. PMID:29792292

Crossing the quality chasm: the role of information technology departments.

PubMed

Weir, Charlene R; Hicken, Bret L; Rappaport, Hank Steven; Nebeker, Jonathan R

2006-01-01

Integrating information technology (IT) into medical settings is considered essential to transforming hospitals into 21st-century health care institutions. Yet the role of IT departments in maximizing the effectiveness of information systems is not well understood. This article reports a 3-round Delphi panel of Veterans Administration personnel experienced with provider order entry electronic systems. In round 1, 35 administrative, clinical, and IT personnel answered 10 open-ended questions about IT strategies and structures that best support successful transformation. In round 2, panelists rated item importance and ranked proposed strategies. In round 3, panelists received aggregate feedback and rerated the items. Four domains emerged from round 1: IT organization, IT performance monitoring, user-support activities, and core IT responsibilities (eg, computer security, training). In rounds 2 and 3, IT performance monitoring was rated the most important, closely followed by clinical support. Strategies associated with each domain are identified and discussed.

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol

PubMed Central

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-01-01

Introduction Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues—including conceptualisation, measurement and data analysis—that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. Methods and analysis This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. Ethics and dissemination An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. PMID:28188154

Management of intrathecal baclofen therapy for severe acquired brain injury: consensus and recommendations for good clinical practice.

PubMed

De Tanti, Antonio; Scarponi, Federico; Bertoni, Michele; Gasperini, Giulio; Lanzillo, Bernardo; Molteni, Franco; Posteraro, Federico; Vitale, Dino Francesco; Zanpolini, Mauro

2017-08-01

Although widespread in the treatment of generalised spasticity due to severe acquired brain injury, clinical use of intrathecal baclofen administered through an implanted catheter is not yet supported by full scientific evidence. The aim of the study is to provide recommendations for good clinical practice regarding intrathecal baclofen therapy. We used a modified RAND Delphi method to develop consensus-based medical guidelines, involving clinicians who use intrathecal baclofen therapy throughout Italy. The clinicians were asked 38 questions grouped in six areas (patient selection, contraindications for implant, tests prior to implant, method of implant and management of therapy, efficacy evaluation and goal setting, and management of complications). To establish consensus, 75% agreement was required in answers to every question. Consensus was reached on the second round of the Delphi process on 27/38 questions (71%), specifically those regarding identification of objectives, efficacy evaluation, and method of implant and management of therapy, whereas management of complications and contraindications for implant remained critical areas. Despite the limits of our method, a set of recommendations was drawn up for clinical practice in this sector. The study also revealed residual critical areas and indicated future lines of research necessary to reach evidence-based consensus.

Outcomes of Moral Case Deliberation - the development of an evaluation instrument for clinical ethics support (the Euro-MCD)

PubMed Central

2014-01-01

Background Clinical ethics support, in particular Moral Case Deliberation, aims to support health care providers to manage ethically difficult situations. However, there is a lack of evaluation instruments regarding outcomes of clinical ethics support in general and regarding Moral Case Deliberation (MCD) in particular. There also is a lack of clarity and consensuses regarding which MCD outcomes are beneficial. In addition, MCD outcomes might be context-sensitive. Against this background, there is a need for a standardised but flexible outcome evaluation instrument. The aim of this study was to develop a multi-contextual evaluation instrument measuring health care providers’ experiences and perceived importance of outcomes of Moral Case Deliberation. Methods A multi-item instrument for assessing outcomes of Moral Case Deliberation (MCD) was constructed through an iterative process, founded on a literature review and modified through a multistep review by ethicists and health care providers. The instrument measures perceived importance of outcomes before and after MCD, as well as experienced outcomes during MCD and in daily work. A purposeful sample of 86 European participants contributed to a Delphi panel and content validity testing. The Delphi panel (n = 13), consisting of ethicists and ethics researchers, participated in three Delphi-rounds. Health care providers (n = 73) participated in the content validity testing through ‘think-aloud’ interviews and a method using Content Validity Index. Results The development process resulted in the European Moral Case Deliberation Outcomes Instrument (Euro-MCD), which consists of two sections, one to be completed before a participant’s first MCD and the other after completing multiple MCDs. The instrument contains a few open-ended questions and 26 specific items with a corresponding rating/response scale representing various MCD outcomes. The items were categorised into the following six domains: Enhanced emotional support, Enhanced collaboration, Improved moral reflexivity, Improved moral attitude, Improvement on organizational level and Concrete results. Conclusions A tentative instrument has been developed that seems to cover main outcomes of Moral Case Deliberation. The next step will be to test the Euro-MCD in a field study. PMID:24712735