Projecting Agricultural Education Programs for the 21st Century Using a Modified Delphi Technique.

ERIC Educational Resources Information Center

Iverson, Maynard J.

A modified three-step Delphi procedure was used to conduct a series of national studies of futurists regarded by their peers as top experts in agricultural education. The primary objective was to project enrollments in agricultural education programs for the 21st century. Other study objectives were to ascertain whether the Delphi technique could…

BCQ+: a body constitution questionnaire to assess Yang-Xu. Part I: establishment of a first final version through a Delphi process.

PubMed

Su, Yi-Chang; Chen, Li-Li; Lin, Jun-Dai; Lin, Jui-Shan; Huang, Yi-Chia; Lai, Jim-Shoung

2008-12-01

Assessing an individual's level of Yang deficiency (Yang-Xu) by its manifestations is a frequent issue in traditional Chinese medicine (TCM) clinical trials. To this end, an objective, reliable and rigorous diagnostic tool is required. This study aimed to develop a first final version of the Yang-Xu Constitution Questionnaire. We conducted 3 steps to develop such an objective measurement tool: 1) the research team was formed and a panel of 26 experts was selected for the Delphi process; 2) items for the questionnaire were generated by literature review and a Delphi process; items were reworded into colloquial questions; face and content validity of the items were evaluated through a Delphi process again; 3) the difficulty of the questionnaire was evaluated in a pilot study with 81 subjects aged 20-60 years. The literature review retrieved 35 relevant items which matched the definition of 'constitution' and 'Yang-Xu'. After a first Delphi process, 22 items were retained and translated into colloquial questions. According to the second part of the Delphi process, the content validity index of each of the 22 questions ranged between 0.85-1. These 22 questions were evaluated by 81 subjects, 2 questions that were hard to tell the difference were combined; 3 questions were modified after the research team had discussed the participants' feedback. Finally, the questionnaire was established with 21 questions. This first final version of a questionnaire to assess Yang-Xu constitution with considerable face and content validity may serve as a basis to develop an advanced Yang-Xu questionnaire. 2008 S. Karger AG, Basel.

Study plan to identify long term national telecommunications need and priorities applying Delphi techniques (handbook). [technological forecasting - United States of America

NASA Technical Reports Server (NTRS)

1974-01-01

A handbook that explains the basic Delphi methodology and discusses modified Delphi techniques is presented. The selection of communications experts to participate in a study, the construction of questionnaires on potential communications developments, and requisite technology is treated. No two modified Delphi studies were the same, which reflects the flexibility and adaptability of the technique. Each study must be specifically tailored to a particular case, and consists of seeking a consensus of opinion among experts about a particular subject and attendant conditions that may prevail in the future.

Validation of quality indicators for the organization of palliative care: a modified RAND Delphi study in seven European countries (the Europall project).

PubMed

Woitha, Kathrin; Van Beek, Karen; Ahmed, Nisar; Jaspers, Birgit; Mollard, Jean M; Ahmedzai, Sam H; Hasselaar, Jeroen; Menten, Johan; Vissers, Kris; Engels, Yvonne

2014-02-01

Validated quality indicators can help health-care professionals to evaluate their medical practices in a comparative manner to deliver optimal clinical care. No international set of quality indicators to measure the organizational aspects of palliative care settings exists. To develop and validate a set of structure and process indicators for palliative care settings in Europe. A two-round modified RAND Delphi process was conducted to rate clarity and usefulness of a previously developed set of 110 quality indicators. In total, 20 multi-professional palliative care teams of centers of excellence from seven European countries. In total, 56 quality indicators were rated as useful. These valid quality indicators concerned the following domains: the definition of a palliative care service (2 quality indicators), accessibility to palliative care (16 quality indicators), specific infrastructure to deliver palliative care (8 quality indicators), symptom assessment tools (1 quality indicator), specific personnel in palliative care services (9 quality indicators), documentation methodology of clinical data (14 quality indicators), evaluation of quality and safety procedures (1 quality indicator), reporting of clinical activities (1 quality indicator), and education in palliative care (4 quality indicator). The modified RAND Delphi process resulted in 56 international face-validated quality indicators to measure and compare organizational aspects of palliative care. These quality indicators, aimed to assess and improve the organization of palliative care, will be pilot tested in palliative care settings all over Europe and be used in the EU FP7 funded IMPACT project.

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study

PubMed Central

2017-01-01

Background Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. Objective The aim of this study was to develop and prioritize measures of digital patient engagement based on patients’ use of the US Department of Veterans Affairs (VA)’s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. Methods We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. Results All 12 experts completed the study’s three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian’s three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). Conclusions This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients’ use of VA’s My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. PMID:28550008

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study.

PubMed

Garvin, Lynn A; Simon, Steven R

2017-05-26

Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. The aim of this study was to develop and prioritize measures of digital patient engagement based on patients' use of the US Department of Veterans Affairs (VA)'s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. All 12 experts completed the study's three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian's three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients' use of VA's My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. ©Lynn A Garvin, Steven R Simon. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.05.2017.

Development of an Electronic Pediatric All-Cause Harm Measurement Tool Using a Modified Delphi Method.

PubMed

Stockwell, David Christopher; Bisarya, Hema; Classen, David C; Kirkendall, Eric S; Lachman, Peter I; Matlow, Anne G; Tham, Eric; Hyman, Dan; Lehman, Samuel M; Searles, Elizabeth; Muething, Stephen E; Sharek, Paul J

2016-12-01

To have impact on reducing harm in pediatric inpatients, an efficient and reliable process for harm detection is needed. This work describes the first step toward the development of a pediatric all-cause harm measurement tool by recognized experts in the field. An international group of leaders in pediatric patient safety and informatics were charged with developing a comprehensive pediatric inpatient all-cause harm measurement tool using a modified Delphi technique. The process was conducted in 5 distinct steps: (1) literature review of triggers (elements from a medical record that assist in identifying patient harm) for inclusion; (2) translation of triggers to likely associated harm, improving the ability for expert prioritization; (3) 2 applications of a modified Delphi selection approach with consensus criteria using severity and frequency of harm as well as detectability of the associated trigger as criteria to rate each trigger and associated harm; (4) developing specific trigger logic and relevant values when applicable; and (5) final vetting of the entire trigger list for pilot testing. Literature and expert panel review identified 108 triggers and associated harms suitable for consideration (steps 1 and 2). This list was pared to 64 triggers and their associated harms after the first of the 2 independent expert reviews. The second independent expert review led to further refinement of the trigger package, resulting in 46 items for inclusion (step 3). Adding in specific trigger logic expanded the list. Final review and voting resulted in a list of 51 triggers (steps 4 and 5). Application of a modified Delphi method on an expert-constructed list of 108 triggers, focusing on severity and frequency of harms as well as detectability of triggers in an electronic medical record, resulted in a final list of 51 pediatric triggers. Pilot testing this list of pediatric triggers to identify all-cause harm for pediatric inpatients is the next step to establish the appropriateness of each trigger for inclusion in a global pediatric safety measurement tool.

Evaluating the construct of triage acuity against a set of reference vignettes developed via modified Delphi method.

PubMed

Twomey, Michèle; Wallis, Lee A; Myers, Jonathan E

2014-07-01

To evaluate the construct of triage acuity as measured by the South African Triage Scale (SATS) against a set of reference vignettes. A modified Delphi method was used to develop a set of reference vignettes. Delphi participants completed a 2-round consensus-building process, and independently assigned triage acuity ratings to 100 written vignettes unaware of the ratings given by others. Triage acuity ratings were summarised for all vignettes, and only those that reached 80% consensus during round 2 were included in the reference set. Triage ratings for the reference vignettes given by two independent experts using the SATS were compared with the ratings given by the international Delphi panel. Measures of sensitivity, specificity, associated percentages for over-triage/under-triage were used to evaluate the construct of triage acuity (as measured by the SATS) by examining the association between the ratings by the two experts and the international panel. On completion of the Delphi process, 42 of the 100 vignettes reached 80% consensus on their acuity rating and made up the reference set. On average, over all acuity levels, sensitivity was 74% (CI 64% to 82%), specificity 92% (CI 87% to 94%), under-triage occurred 14% (CI 8% to 23%) and over-triage 12% (CI 8% to 23%) of the time. The results of this study provide an alternative to evaluating triage scales against the construct of acuity as measured with the SATS. This method of using 80% consensus vignettes may, however, systematically bias the validity estimate towards better performance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Development and pilot testing of an informed consent video for patients with limb trauma prior to debridement surgery using a modified Delphi technique.

PubMed

Lin, Yen-Ko; Chen, Chao-Wen; Lee, Wei-Che; Lin, Tsung-Ying; Kuo, Liang-Chi; Lin, Chia-Ju; Shi, Leiyu; Tien, Yin-Chun; Cheng, Yuan-Chia

2017-11-29

Ensuring adequate informed consent for surgery in a trauma setting is challenging. We developed and pilot tested an educational video containing information regarding the informed consent process for surgery in trauma patients and a knowledge measure instrument and evaluated whether the audiovisual presentation improved the patients' knowledge regarding their procedure and aftercare and their satisfaction with the informed consent process. A modified Delphi technique in which a panel of experts participated in successive rounds of shared scoring of items to forecast outcomes was applied to reach a consensus among the experts. The resulting consensus was used to develop the video content and questions for measuring the understanding of the informed consent for debridement surgery in limb trauma patients. The expert panel included experienced patients. The participants in this pilot study were enrolled as a convenience sample of adult trauma patients scheduled to receive surgery. The modified Delphi technique comprised three rounds over a 4-month period. The items given higher scores by the experts in several categories were chosen for the subsequent rounds until consensus was reached. The experts reached a consensus on each item after the three-round process. The final knowledge measure comprising 10 questions was developed and validated. Thirty eligible trauma patients presenting to the Emergency Department (ED) were approached and completed the questionnaires in this pilot study. The participants exhibited significantly higher mean knowledge and satisfaction scores after watching the educational video than before watching the video. Our process is promising for developing procedure-specific informed consent and audiovisual aids in medical and surgical specialties. The educational video was developed using a scientific method that integrated the opinions of different stakeholders, particularly patients. This video is a useful tool for improving the knowledge and satisfaction of trauma patients in the ED. The modified Delphi technique is an effective method for collecting experts' opinions and reaching a consensus on the content of educational materials for informed consent. Institutions should prioritize patient-centered health care and develop a structured informed consent process to improve the quality of care. The ClinicalTrials.gov Identifier is NCT01338480 . The date of registration was April 18, 2011 (retrospectively registered).

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique

PubMed Central

Barry, Emma; O'Brien, Kirsty; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-01-01

Objective There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Design Two-round modified Delphi consensus method. Setting Irish and UK general practice. Participants A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. Results 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). Conclusions The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. PMID:27601499

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique.

PubMed

Barry, Emma; O'Brien, Kirsty; Moriarty, Frank; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-09-06

There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Two-round modified Delphi consensus method. Irish and UK general practice. A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Allied health clinicians using translational research in action to develop a reliable stroke audit tool.

PubMed

Abery, Philip; Kuys, Suzanne; Lynch, Mary; Low Choy, Nancy

2018-05-23

To design and establish reliability of a local stroke audit tool by engaging allied health clinicians within a privately funded hospital. Design: Two-stage study involving a modified Delphi process to inform stroke audit tool development and inter-tester reliability. Allied health clinicians. A modified Delphi process to select stroke guideline recommendations for inclusion in the audit tool. Reliability study: 1 allied health representative from each discipline audited 10 clinical records with sequential admissions to acute and rehabilitation services. Recommendations were admitted to the audit tool when 70% agreement was reached, with 50% set as the reserve agreement. Inter-tester reliability was determined using intra-class correlation coefficients (ICCs) across 10 clinical records. Twenty-two participants (92% female, 50% physiotherapists, 17% occupational therapists) completed the modified Delphi process. Across 6 voting rounds, 8 recommendations reached 70% agreement and 2 reached 50% agreement. Two recommendations (nutrition/hydration; goal setting) were added to ensure representation for all disciplines. Substantial consistency across raters was established for the audit tool applied in acute stroke (ICC .71; range .48 to .90) and rehabilitation (ICC.78; range .60 to .93) services. Allied health clinicians within a privately funded hospital generally agreed in an audit process to develop a reliable stroke audit tool. Allied health clinicians agreed on stroke guideline recommendations to inform a stroke audit tool. The stroke audit tool demonstrated substantial consistency supporting future use for service development. This process, which engages local clinicians, could be adopted by other facilities to design reliable audit tools to identify local service gaps to inform changes to clinical practice. © 2018 John Wiley & Sons, Ltd.

Legislative priorities for transportation safety in Virginia : a pilot application of a modified delphi technique : final report.

DOT National Transportation Integrated Search

1985-01-01

Using a modified version of the Delphi technique, a panel of transportation safety experts developed the following list of legislative priorities for submission to the Department of Motor Vehicles (DMV) Legislative Package for the 1986 session of the...

Development of criteria for evaluating clinical response in thyroid eye disease using a modified Delphi technique.

PubMed

Douglas, Raymond S; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A; Cahill, Kenneth; Dolman, Peter J; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J; Khanna, Dinesh

2009-09-01

To identify components of a provisional clinical response index for thyroid eye disease using a modified Delphi technique. The International Thyroid Eye Disease Society conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in thyroid eye disease. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty-four respondents participated in the Delphi 1 survey, providing 220 unique items. Ninety-two members (100% of the respondents from Delphi 1 plus 8 new participants) responded in Delphi 2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi 3 (67 criteria were excluded because of redundancy). Criteria with a mean greater than 6 (1 = least appropriate to 9 = most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for thyroid eye disease. These measures will be iteratively refined for use in multicenter clinical trials.

Development of criteria for evaluating clinical response in thyroid eye disease (CRI-TED) using a modified Delphi technique

PubMed Central

Douglas, Raymond S.; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A.; Cahill, Kenneth; Dolman, Peter J.; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J.; Khanna, Dinesh

2014-01-01

To identify components of a provisional clinical response index for thyroid eye disease (CRI-TED) using a modified Delphi technique. The International Thyroid Eye Disease Society (ITEDS) conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in TED. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty four respondents participated in the Delphi-1 survey, providing 220 unique items. Ninety- two members (100% of the respondents from Delphi 1 plus eight new participants) responded in Delphi-2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi-3 (67 criteria were excluded due to redundancy). Criteria with a mean greater than 6 (1 least appropriate to 9 most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for TED. These measures will be iteratively refined for use in multicenter clinical trials. PMID:19752424

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study.

PubMed

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-16

To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Hospitals and community health centres in Taiwan. A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. 15 Chinese healthcare practitioners with more than 6 months' experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Use of the Delphi process in paediatric cataract management.

PubMed

Serafino, Massimiliano; Trivedi, Rupal H; Levin, Alex V; Wilson, M Edward; Nucci, Paolo; Lambert, Scott R; Nischal, Ken K; Plager, David A; Bremond-Gignac, Dominique; Kekunnaya, Ramesh; Nishina, Sachiko; Tehrani, Nasrin N; Ventura, Marcelo C

2016-05-01

To identify areas of consensus and disagreement in the management of paediatric cataract using a modified Delphi approach among individuals recognised for publishing in this field. A modified Delphi method. International paediatric cataract experts with a publishing record in paediatric cataract management. The process consisted of three rounds of anonymous electronic questionnaires followed by a face-to-face meeting, followed by a fourth anonymous electronic questionnaire. The executive committee created questions to be used for the electronic questionnaires. Questions were designed to have unit-based, multiple choice or true-false answers. The questionnaire included issues related to the preoperative, intraoperative and postoperative management of paediatric cataract. Consensus based on 85% of panellists being in agreement for electronic questionnaires or 80% for the face-to-face meeting, and near consensus based on 70%. Sixteen of 22 invited paediatric cataract surgeons agreed to participate. We arrived at consensus or near consensus for 85/108 (78.7%) questions and non-consensus for the remaining 23 (21.3%) questions. Those questions where consensus was not reached highlight areas of either poor evidence or contradicting evidence, and may help investigators identify possible research questions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Identification of Core Competencies for an Undergraduate Food Safety Curriculum Using a Modified Delphi Approach

ERIC Educational Resources Information Center

Johnston, Lynette M.; Wiedmann, Martin; Orta-Ramirez, Alicia; Oliver, Haley F.; Nightingale, Kendra K.; Moore, Christina M.; Stevenson, Clinton D.; Jaykus, Lee-Ann

2014-01-01

Identification of core competencies for undergraduates in food safety is critical to assure courses and curricula are appropriate in maintaining a well-qualified food safety workforce. The purpose of this study was to identify and refine core competencies relevant to postsecondary food safety education using a modified Delphi method. Twenty-nine…

The Semiconductor Industry and Emerging Technologies: A Study Using a Modified Delphi Method

ERIC Educational Resources Information Center

Jordan, Edgar A.

2010-01-01

The purpose of this qualitative descriptive study was to determine what leaders in the semiconductor industry thought the future of computing would look like and what emerging materials showed the most promise to overcome the current theoretical limit of 10 nanometers for silicon dioxide. The researcher used a modified Delphi technique in two…

Exploring Research Themes in Public Engagement within a Natural History Museum: A Modified Delphi Approach

ERIC Educational Resources Information Center

Seakins, Amy; Dillon, Justin

2013-01-01

The primacy of the research question in designing studies affords an opportunity for enhancing collaborations between researchers and "practitioners". This paper describes the use of a modified Delphi technique to co-generate research questions for a collaborative research study co-funded by a university and a natural history museum.…

Personal Learning Environments and University Teacher Roles Explored Using Delphi

ERIC Educational Resources Information Center

Shaikh, Zaffar Ahmed; Khoja, Shakeel Ahmed

2014-01-01

This paper presents the results of research using an online Delphi method, which aimed to explore university teacher roles and readiness for learner-centred pedagogy, driven by personal learning environments (PLEs). Using a modified Policy Delphi technique, a group of researchers worked with 34 international experts who are university teachers by…

European undergraduate curriculum in geriatric medicine developed using an international modified Delphi technique

PubMed Central

Masud, Tahir; Blundell, Adrian; Gordon, Adam Lee; Mulpeter, Ken; Roller, Regina; Singler, Katrin; Goeldlin, Adrian; Stuck, Andreas

2014-01-01

Introduction: the rise in the number of older, frail adults necessitates that future doctors are adequately trained in the skills of geriatric medicine. Few countries have dedicated curricula in geriatric medicine at the undergraduate level. The aim of this project was to develop a consensus among geriatricians on a curriculum with the minimal requirements that a medical student should achieve by the end of medical school. Methods: a modified Delphi process was used. First, educational experts and geriatricians proposed a set of learning objectives based on a literature review. Second, three Delphi rounds involving a panel with 49 experts representing 29 countries affiliated to the European Union of Medical Specialists (UEMS) was used to gain consensus for a final curriculum. Results: the number of disagreements following Delphi Rounds 1 and 2 were 81 and 53, respectively. Complete agreement was reached following the third round. The final curriculum consisted of detailed objectives grouped under 10 overarching learning outcomes. Discussion: a consensus on the minimum requirements of geriatric learning objectives for medical students has been agreed by European geriatricians. Major efforts will be needed to implement these requirements, given the large variation in the quality of geriatric teaching in medical schools. This curriculum is a first step to help improve teaching of geriatrics in medical schools, and will also serve as a basis for advancing postgraduate training in geriatrics across Europe. PMID:24603283

Multidisciplinary Delphi Development of a Scale to Evaluate Team Function in Obstetric Emergencies: The PETRA Scale.

PubMed

Balki, Mrinalini; Hoppe, David; Monks, David; Cooke, Mary Ellen; Sharples, Lynn; Windrim, Rory

2017-06-01

The objective of this study was to develop a new interdisciplinary teamwork scale, the Perinatal Emergency: Team Response Assessment (PETRA), for the management of obstetric crises, through consensus agreement of obstetric caregivers. This prospective study was performed using expert consensus, based on a Delphi method. The study investigators developed a new PETRA tool, specifically related to obstetric crisis management, based on the existing literature and discussions among themselves. The scale was distributed to a selected panel of experts in the field for the Delphi process. After each round of Delphi, every component of the scale was analyzed quantitatively by the percentage of agreement ratings and each comment reviewed by the blinded investigators. The assessment scale was then modified, with components of less than 80% agreement removed from the scale. The process was repeated on three occasions to reach a consensus and final PETRA scale. Fourteen of 24 invited experts participated in the Delphi process. The original PETRA scale included six categories and 48 items, one global scale item, and a 3-point rubric for rating. The overall percentage agreement by experts in the first, second, and third rounds was 95.0%, 93.2%, and 98.5%, respectively. The final scale after the third round of Delphi consisted of the following seven categories: shared mental model, communication, situational awareness, leadership, followership, workload management, and positive/effective behaviours and attitudes. There were 34 individual items within these categories, each with a 5-point rating rubric (1 = unacceptable to 5 = perfect). Using a structured Delphi method, we established the face and content validity of this assessment scale that focuses on important aspects of interdisciplinary teamwork in the management of obstetric crises. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Improving the care of older persons in Australian prisons using the Policy Delphi method.

PubMed

Patterson, Karen; Newman, Claire; Doona, Katherine

2016-09-01

There are currently no internationally recognised and approved processes relating to the care of older persons with dementia in prison. This research aimed to develop tools and procedures related to managing the care of, including the identification and assessment of, older persons with dementia who are imprisoned in New South Wales, Australia. A modified approach to the Policy Delphi method, using both surveys and facilitated discussion groups, enabled experts to come together to discuss improving the quality of care provision for older persons with dementia in prison and achieve research aims. © The Author(s) 2014.

Use of modified Delphi to plan knowledge translation for decision makers: an application in the field of advanced practice nursing.

PubMed

Carter, Nancy; Lavis, John N; MacDonald-Rencz, Sandra

2014-01-01

Disseminating research to decision makers is difficult. Interaction between researchers and decision makers can identify key messages and processes for dissemination. To gain agreement on the key findings from a synthesis on the integration of advanced practice nurses, we used a modified Delphi process. Nursing decision makers contributed ideas via e-mail, discussed and clarified ideas face to face, and then prioritized statements. Sixteen (89%) participated and 14 (77%) completed the final phase. Priority key messages were around access to care and outcomes. The majority identified "NPs increase access to care" and "NPs and CNSs improve patient and system outcomes" as priority messaging statements. Participants agreed policy makers and the public were target audiences for messages. Consulting with policy makers provided the necessary context to develop tailored policy messages and is a helpful approach for research dissemination. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi consensus approach.

PubMed

Wakai, Abel; O'Sullivan, Ronan; Staunton, Paul; Walsh, Cathal; Hickey, Fergal; Plunkett, Patrick K

2013-04-01

The objective of this study was to develop a consensus among emergency medicine (EM) specialists working in Ireland for emergency department (ED) key performance indicators (KPIs). The method employed was a three-round electronic modified-Delphi process. An online questionnaire with 54 potential KPIs was set up for round 1 of the Delphi process. The Delphi panel consisted of all registered EM specialists in Ireland. Each indicator on the questionnaire was rated using a five-point Likert-type rating scale. Agreement was defined as at least 70% of the responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using standard descriptive statistics. Data were also analysed as the mean of the Likert rating with 95% confidence intervals (95% CIs). Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Statistical analyses were carried out using SPSS version 16.0. The response rates in rounds 1, 2 and 3 were 86, 88 and 88%, respectively. Ninety-seven potential indicators reached agreement after the three rounds. In the context of the Donabedian structure-process-outcome framework of performance indicators, 41 (42%) of the agreed indicators were structure indicators, 52 (54%) were process indicators and four (4%) were outcome indicators. Overall, the top-three highest rated indicators were: presence of a dedicated ED clinical information system (4.7; 95% CI 4.6-4.9), ED compliance with minimum design standards (4.7; 95% CI 4.5-4.8) and time from ED arrival to first ECG in suspected cardiac chest pain (4.7; 95% CI 4.5-4.9). The top-three highest rated indicators specific to clinical care of children in EDs were: time to administration of antibiotics in children with suspected bacterial meningitis (4.6; 95% CI 4.5-4.8), separate area available within EDs (seeing both adults and children) to assess children (4.4; 95% CI 4.2-4.6) and time to administration of analgesia in children with forearm fractures (4.4; 95% CI 4.2-4.7). Employing a Delphi consensus process, it was possible to reach a consensus among EM specialists in Ireland on a suite of 97 KPIs for EDs.

Seeking an oracle: using the Delphi process to develop practice guidelines for the treatment of endometriosis with Chinese herbal medicine.

PubMed

Flower, Andrew; Lewith, George T; Little, Paul

2007-11-01

For most complementary and alternative medicine interventions, the absence of a high-quality evidence base to define good practice presents a serious problem for clinicians, educators, and researchers. The Delphi process may offer a pragmatic way to establish good practice guidelines until more rigorous forms of assessment can be undertaken. To use a modified Delphi to develop good practice guidelines for a feasibility study exploring the role of Chinese herbal medicine (CHM) in the treatment of endometriosis. To compare the outcomes from Delphi with data derived from a systematic review of the Chinese language database. An expert group was convened for a three-round Delphi that initially produced key statements relating to the CHM diagnosis and treatment of endometriosis (round 1) and then anonymously rated these on a 1-7 Likert scale (rounds 2 and 3). Statements with a median score of 5 and above were regarded as demonstrating positive group consensus. The differential diagnoses within Chinese Medicine and rating of the clinical value of individual herbs were then contrasted with comparable data from a review of Chinese language reports in the Chinese Biomedical Retrieval System (1978-2002), and China Academy of Traditional Chinese Medicine (1985-2002) databases and the Chinese TCM and magazine literature (1984-2004) databases. Consensus (good practice) guidelines for the CHM treatment of endometriosis relating to common diagnostic patterns, herb selection, dosage, and patient management were produced. The Delphi guidelines demonstrated a high degree of congruence with the information from the Chinese language databases. In the absence of rigorous evidence, Delphi offers a way to synthesize expert knowledge relating to diagnosis, patient management, and herbal selection in the treatment of endometriosis. The limitations of the expert group and the inability of Delphi to capture the subtle nuances of individualized clinical decision-making limit the usefulness of this approach.

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Building expert agreement on the importance and feasibility of workplace health promotion interventions for nurses and midwives: A modified Delphi consultation.

PubMed

Perry, Lin; Nicholls, Rachel; Duffield, Christine; Gallagher, Robyn

2017-11-01

To use a Delphi panel to determine the relative importance and feasibility of workplace health promotion interventions to promote and support the health of the Australian nursing and midwifery workforce. The nursing workforce experiences rates of ill health above that of other workforces, yet there is little investment in workplace health promotion. The study used a modified Delphi design conducted between September and November 2015. Eleven of 19 purposively selected expert panellists discussed, rated and provided feedback through two rounds of an electronic questionnaire about the relative importance and feasibility of 46 workplace health promotion interventions and processes for nurses and midwives. Scores for importance and feasibility were calculated and ranked and a composite score of importance multiplied by feasibility. Mental health strategies were prioritized as the most important and feasible of the intervention topics, followed closely by healthy eating and physical activity interventions; smoking cessation ranked lowest. The most highly ranked interventions targeted healthy eating, stress management and resilience training. Highest ranked processes to support development of a healthy work environment included intersectoral collaboration and employee wellness groups. Study findings prompt consideration of health promotion opportunities to support nurses' health and well-being. Findings identified key workplace health promotion priorities and provide direction for policy makers and managers to promote nursing and midwifery workforce health. © 2017 John Wiley & Sons Ltd.

A Modified Delphi to Identify the Significant Works Pertaining to the Understanding of Reading Comprehension and Content Analysis of the Identified Works

ERIC Educational Resources Information Center

Zunker, Norma D.; Pearce, Daniel L.

2012-01-01

The first part of this study explored the significant works pertaining to the understanding of reading comprehension using a Modified Delphi Method. A panel of reading comprehension experts identified 19 works they considered to be significant to the understanding of reading comprehension. The panel of experts identified the reasons they…

Recommended Skill Requirements of Recent Management Information Systems Graduates for Employment: A Modified Delphi Study

ERIC Educational Resources Information Center

Strnad, Michael A., Sr.

2013-01-01

The purpose of this Modified Delphi study was to achieve a consensus and forecast a prediction from expert IT hiring managers on what skills are required of MIS graduates for employment. In doing so, guidance could be provided to academic leaders who design curricula for MIS students on the required skills for employment. This study was conducted…

The National Health Educator Job Analysis 2010: Process and Outcomes

ERIC Educational Resources Information Center

Doyle, Eva I.; Caro, Carla M.; Lysoby, Linda; Auld, M. Elaine; Smith, Becky J.; Muenzen, Patricia M.

2012-01-01

The National Health Educator Job Analysis 2010 was conducted to update the competencies model for entry- and advanced-level health educators. Qualitative and quantitative methods were used. Structured interviews, focus groups, and a modified Delphi technique were implemented to engage 59 health educators from diverse work settings and experience…

Rating scale for the assessment of competence in ultrasound-guided peripheral vascular access - a Delphi Consensus Study.

PubMed

Primdahl, Stine C; Todsen, Tobias; Clemmesen, Louise; Knudsen, Lars; Weile, Jesper

2016-09-21

Peripheral vascular access is vital for treatment and diagnostics of hospitalized patients. Ultrasound-guided vascular access (UGVA) is superior to the landmark technique. To ensure competence-based education, an assessment tool of UGVA competence is needed. We aimed to develop a global rating scale (RS) for assessment of UGVA competence based on opinions on the content from ultrasound experts in a modified Delphi consensus study. We included experts from anesthesiology, emergency medicine and radiology across university hospitals in Denmark. Nine elements were drafted based on existing literature and recommendations from international societies. In a multi-round survey, the experts rated the elements on a five-point Likert scale according to importance, and suggested missing elements. The final Delphi round occurred when >80% of the experts rated all elements ≥4 on the Likert scale. Sixteen experts consented to participate in the study, one withdrew consent prior to the first Delphi round, and 14 completed all three Delphi rounds. In the first Delphi round the experts excluded one element from the scale and changed the content of two elements. In the second Delphi round, the experts excluded one element from the scale. In the third Delphi round, consensus was obtained on the eight elements: preparation of utensils, ergonomics, preparation of the ultrasound device, identification of blood vessels, anatomy, hygiene, coordination of the needle, and completion of the procedure. We developed an RS for assessment of UGVA competence based on opinions of ultrasound experts through a modified Delphi consensus study.

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study.

PubMed

Mascherek, Anna C; Schwappach, David L B

2016-08-05

Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study

PubMed Central

Mascherek, Anna C

2016-01-01

Objective Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. Design As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Results Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Conclusions Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. PMID:27496233

The Determination of Relevant Goals and Criteria Used to Select an Automated Patient Care Information System

PubMed Central

Chocholik, Joan K.; Bouchard, Susan E.; Tan, Joseph K. H.; Ostrow, David N.

1999-01-01

Objectives: To determine the relevant weighted goals and criteria for use in the selection of an automated patient care information system (PCIS) using a modified Delphi technique to achieve consensus. Design: A three-phase, six-round modified Delphi process was implemented by a ten-member PCIS selection task force. The first phase consisted of an exploratory round. It was followed by the second phase, of two rounds, to determine the selection goals and finally the third phase, of three rounds, to finalize the selection criteria. Results: Consensus on the goals and criteria for selecting a PCIS was measured during the Delphi process by reviewing the mean and standard deviation of the previous round's responses. After the study was completed, the results were analyzed using a limits-of-agreement indicator that showed strong agreement of each individual's responses between each of the goal determination rounds. Further analysis for variability in the group's response showed a significant movement to consensus after the first goal-determination iteration, with consensus reached on all goals by the end of the second iteration. Conclusion: The results indicated that the relevant weighted goals and criteria used to make the final decision for an automated PCIS were developed as a result of strong agreement among members of the PCIS selection task force. It is therefore recognized that the use of the Delphi process was beneficial in achieving consensus among clinical and nonclinical members in a relatively short time while avoiding a decision based on political biases and the “groupthink” of traditional committee meetings. The results suggest that improvements could be made in lessening the number of rounds by having information available through side conversations, by having other statistical indicators besides the mean and standard deviation available between rounds, and by having a content expert address questions between rounds. PMID:10332655

Distribution network connection pricing framework and methodology: identification of areas of improvement for Sarawak Energy Berhad Connection Charges Guidelines through modified delphi method

NASA Astrophysics Data System (ADS)

Tan, J. K.; Abas, N.

2017-07-01

Complaints on issues and matters related to connection charges have been very common for electricity supply utility companies around the world including Sarawak Energy Berhad. In order to identify the areas that can be improved, a mixed method of exploratory research involving qualitative and quantitative methods have been designed and undertaken rather than a single method of survey. This will ensure a more comprehensive and detailed understanding of the issues from various target groups. The method is designed under three phases, employing Modified Delphi Technique for phase 1 through a series of stake holder engagements, online and offline survey questionnaires to be filled by internal wiring contractors for phase 2 whilst under phase 3, case studies shall be carried out on the issues identified from phase 1 and phase 2 of the study. This paper presented the findings from the Modified Delphi Technique. The findings revealed that there are areas of improvement for Sarawak Energy Berhad connection guidelines in term of differentiation of dedicated and shared assets which leads to unfairness to the connecting customers, inconsistency and non-transparent in charging. The findings of Modified Delphi Technique shall be used for implementation of phase 2 and phase 3 of the study.

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process.

PubMed

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-09-10

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention.

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process

PubMed Central

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-01-01

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention. PMID:26378557

Improving Patient Safety in Public Hospitals: Developing Standard Measures to Track Medical Errors and Process Breakdowns.

PubMed

Ackerman, Sara L; Gourley, Gato; Le, Gem; Williams, Pamela; Yazdany, Jinoos; Sarkar, Urmimala

2018-03-14

The aim of the study was to develop standards for tracking patient safety gaps in ambulatory care in safety net health systems. Leaders from five California safety net health systems were invited to participate in a modified Delphi process sponsored by the Safety Promotion Action Research and Knowledge Network (SPARKNet) and the California Safety Net Institute in 2016. During each of the three Delphi rounds, the feasibility and validity of 13 proposed patient safety measures were discussed and prioritized. Surveys and transcripts from the meetings were analyzed to understand the decision-making process. The Delphi process included eight panelists. Consensus was reached to adopt 9 of 13 proposed measures. All 9 measures were unanimously considered valid, but concern was expressed about the feasibility of implementing several of the measures. Although safety net health systems face high barriers to standardized measurement, our study demonstrates that consensus can be reached on acceptable and feasible methods for tracking patient safety gaps in safety net health systems. If accompanied by the active participation key stakeholder groups, including patients, clinicians, staff, data system professionals, and health system leaders, the consensus measures reported here represent one step toward improving ambulatory patient safety in safety net health systems.

Proposal of quality indicators for cardiac rehabilitation after acute coronary syndrome in Japan: a modified Delphi method and practice test.

PubMed

Ohtera, Shosuke; Kanazawa, Natsuko; Ozasa, Neiko; Ueshima, Kenji; Nakayama, Takeo

2017-01-27

Cardiac rehabilitation is underused and its quality in practice is unclear. A quality indicator is a measurable element of clinical practice performance. This study aimed to propose a set of quality indicators for cardiac rehabilitation following an acute coronary event in the Japanese population and conduct a small-size practice test to confirm feasibility and applicability of the indicators in real-world clinical practice. This study used a modified Delphi technique (the RAND/UCLA appropriateness method), a consensus method which involves an evidence review, a face-to-face multidisciplinary panel meeting and repeated anonymous rating. Evidence to be reviewed included clinical practice guidelines available in English or Japanese and existing quality indicators. Performance of each indicator was assessed retrospectively using medical records at a university hospital in Japan. 10 professionals in cardiac rehabilitation for the consensus panel. In the literature review, 23 clinical practice guidelines and 16 existing indicators were identified to generate potential indicators. Through the consensus-building process, a total of 30 indicators were assessed and finally 13 indicators were accepted. The practice test (n=39) revealed that 74% of patients underwent cardiac rehabilitation. Median performance of process measures was 93% (IQR 46-100%). 'Communication with the doctor who referred the patient to cardiac rehabilitation' and 'continuous participation in cardiac rehabilitation' had low performance (32% and 38%, respectively). A modified Delphi technique identified a comprehensive set of quality indicators for cardiac rehabilitation. The single-site, small-size practice test confirmed that most of the proposed indicators were measurable in real-world clinical practice. However, some clinical processes which are not covered by national health insurance in Japan had low performance. Further studies will be needed to clarify and improve the quality of care in cardiac rehabilitation. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study.

PubMed

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D

2017-01-01

As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Panelist's responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. Copyright® by the International Brazilian Journal of Urology.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study

PubMed Central

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D.

2017-01-01

ABSTRACT Introduction As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. Materials and methods We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Results Panelist’s responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Conclusions Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. PMID:28379668

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.

PubMed

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

Gaining consensus on family carer needs when caring for someone dying at home to develop the Carers' Alert Thermometer (CAT): a modified Delphi study.

PubMed

Knighting, Katherine; O'Brien, Mary R; Roe, Brenda; Gandy, Rob; Lloyd-Williams, Mari; Nolan, Mike; Jack, Barbara A

2016-01-01

To report a multi-phase modified Delphi study conducted with carers and professionals to identify the priority areas for inclusion in an alert screening tool for carers providing support to someone dying at home. Internationally, there is a growing emphasis on increasing choice for patients who wish to die at home which relies heavily on care provided by the unpaid family carers. Family carers can have high levels of unmet needs comprising their psychological and physical health and their ability to provide effective care and support. Development of an alert tool to identify carers' needs in everyday practice required identification and consensus of the priority areas of need for inclusion. Multi-phase modified Delphi study and instrument development. Qualitative and quantitative data collection took place between 2011-2013 with 111 carers and 93 professionals to identify carers' needs and gain consensus on the priority areas for inclusion in the alert tool. An expert panel stage and final evidence review post-Delphi were used. The Delphi panels had high levels of agreement and consensus. Ten areas of carer need across two themes of 'the current caring situation' and 'the carer's own health and well-being' were prioritized for inclusion in the alert tool. An optional end-of-life planning question was included following the final stages. The results provide evidence of carers' needs to be assessed, areas for consideration in the education of those who support carers and someone dying at home and targeting of services, while demonstrating the usefulness and adaptability of the Delphi method. © 2015 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Defining a Bobath clinical framework - A modified e-Delphi study.

PubMed

Vaughan-Graham, Julie; Cott, Cheryl

2016-11-01

To gain consensus within the expert International Bobath Instructors Training Association (IBITA) on a Bobath clinical framework on which future efficacy studies can be based. A three-round modified e-Delphi approach was used with 204 full members of the IBITA. Twenty-one initial statements were generated from the literature. Consensus was defined a priori as at least 80% of the respondents with a level of agreement on a Likert scale of 4 or 5. The Delphi questionnaire for each round was available online for two weeks. Summary reports and subsequent questionnaires were posted within four weeks. Ninety-four IBITA members responded, forming the Delphi panel, of which 68 and 66 responded to Rounds Two and Three, respectively. The 21 initial statements were revised to 17 statements and five new statements in Round Two in which eight statements were accepted and two statements were eliminated. Round Three presented 12 revised statements, all reaching consensus. The Delphi was successful in gaining consensus on a Bobath clinical framework in a geographically diverse expert association, identifying the unique components of Bobath clinical practice. Discussion throughout all three Rounds revolved primarily around the terminology of atypical and compensatory motor behavior and balance.

Digital Skills Acquisition: Future Trends among Older Adults

ERIC Educational Resources Information Center

Gilliam, Brian K.

2011-01-01

Purpose: The purpose of this study was to identify future trends and barriers that will either facilitate or impede the narrowing of the digital skills divide among older adults during the next 10 years. Methodology: To address the research questions, this study used a modified version of the Delphi process using a panel of experts who…

[Construction of a physiological aging scale for healthy people based on a modified Delphi method].

PubMed

Long, Yao; Zhou, Xuan; Deng, Pengfei; Liao, Xiong; Wu, Lei; Zhou, Jianming; Huang, Helang

2016-04-01

To build a physiological aging scale for healthy people.
 We collected age-related physiologic items through literature screening and expert interview. Two rounds of Delphi were implemented. The importance, feasibility and the degree of authority for the physiological index system were graded. Using analytic hierarchy process, we determined the weight of dimensions and items.
 Using Delphy mothod, 17 physiological and other professional experts offered the results as follow: coefficient of expert authorities Cr was 0.86±0.03, coordination coefficients for the first and second round were 0.264(χ2=229.691, P<0.001) and 0.293(χ2=228.474，P<0.001), respectively. The consistency was good. The aging scale for healthy people included 3 dimensions, namely physical form, feeling movement and functional status. Each dimension had 8 items. The weight coefficients for the 3 dimensions were 0.54, 0.16, and 0.30, respectively. The Cronbach's α coefficient of the scale was 0.893, the reliability was 0.796, and the variance of the common factor was 58.17%.
 The improved Delphi method or physiological aging scale is satisfied, which can provide reference for the evaluation of aging.

A modified Delphi method toward multidisciplinary consensus on functional convalescence recommendations after abdominal surgery.

PubMed

van Vliet, Daphne C R; van der Meij, Eva; Bouwsma, Esther V A; Vonk Noordegraaf, Antonie; van den Heuvel, Baukje; Meijerink, Wilhelmus J H J; van Baal, W Marchien; Huirne, Judith A F; Anema, Johannes R

2016-12-01

Evidence-based information on the resumption of daily activities following uncomplicated abdominal surgery is scarce and not yet standardized in medical guidelines. As a consequence, convalescence recommendations are generally not provided after surgery, leading to patients' insecurity, needlessly delayed recovery and prolonged sick leave. The aim of this study was to generate consensus-based multidisciplinary convalescence recommendations, including advice on return to work, applicable for both patients and physicians. Using a modified Delphi method among a multidisciplinary panel of 13 experts consisting of surgeons, occupational physicians and general practitioners, detailed recommendations were developed for graded resumption of 34 activities after uncomplicated laparoscopic cholecystectomy, laparoscopic and open appendectomy, laparoscopic and open colectomy and laparoscopic and open inguinal hernia repair. A sample of occupational physicians, general practitioners and surgeons assessed the recommendations on feasibility in daily practice. The response of this group of care providers was discussed with the experts in the final Delphi questionnaire round. Out of initially 56 activities, the expert panel selected 34 relevant activities for which convalescence recommendations were developed. After four Delphi rounds, consensus was reached for all of the 34 activities for all the surgical procedures. A sample of occupational physicians, general practitioners and surgeons regarded the recommendations as feasible in daily practice. Multidisciplinary convalescence recommendations regarding uncomplicated laparoscopic cholecystectomy, appendectomy (laparoscopic, open), colectomy (laparoscopic, open) and inguinal hernia repair (laparoscopic, open) were developed by a modified Delphi procedure. Further research is required to evaluate whether these recommendations are realistic and effective in daily practice.

Development of an antibiotic spectrum score based on veterans affairs culture and susceptibility data for the purpose of measuring antibiotic de-escalation: a modified Delphi approach.

PubMed

Madaras-Kelly, Karl; Jones, Makoto; Remington, Richard; Hill, Nicole; Huttner, Benedikt; Samore, Matthew

2014-09-01

Development of a numerical score to measure the microbial spectrum of antibiotic regimens (spectrum score) and method to identify antibiotic de-escalation events based on application of the score. Web-based modified Delphi method. Physician and pharmacist antimicrobial stewards practicing in the United States recruited through infectious diseases-focused listservs. Three Delphi rounds investigated: organisms and antibiotics to include in the spectrum score, operationalization of rules for the score, and de-escalation measurement. A 4-point ordinal scale was used to score antibiotic susceptibility for organism-antibiotic domain pairs. Antibiotic regimen scores, which represented combined activity of antibiotics in a regimen across all organism domains, were used to compare antibiotic spectrum administered early (day 2) and later (day 4) in therapy. Changes in spectrum score were calculated and compared with Delphi participants' judgments on de-escalation with 20 antibiotic regimen vignettes and with non-Delphi steward judgments on de-escalation of 300 pneumonia regimen vignettes. Method sensitivity and specificity to predict expert de-escalation status were calculated. Twenty-four participants completed all Delphi rounds. Expert support for concepts utilized in metric development was identified. For vignettes presented in the Delphi, the sign of change in score correctly classified de-escalation in all vignettes except those involving substitution of oral antibiotics. The sensitivity and specificity of the method to identify de-escalation events as judged by non-Delphi stewards were 86.3% and 96.0%, respectively. Identification of de-escalation events based on an algorithm that measures microbial spectrum of antibiotic regimens generally agreed with steward judgments of de-escalation status.

Identifying Critical Issues and Problems in Technology Education Using a Modified-Delphi Technique.

ERIC Educational Resources Information Center

Wicklein, Robert C.

1993-01-01

Critical issues for technology education (TE) identified by a 25-member Delphi panel were identification of the knowledge base, curriculum development approaches, interdisciplinary approaches, and teacher education reform. Problems identified included inadequate marketing/public relations, teacher shortage, lack of content consensus, and…

Family Medicine Global Health Fellowship Competencies: A Modified Delphi Study.

PubMed

Rayess, Fadya El; Filip, Anna; Doubeni, Anna; Wilson, Calvin; Haq, Cynthia; Debay, Marc; Anandarajah, Gowri; Heffron, Warren; Jayasekera, Neil; Larson, Paul; Dahlman, Bruce; Valdman, Olga; Hunt, Vince

2017-02-01

Many US medical schools and family medicine departments have responded to a growing interest in global health by developing global health fellowships. However, there are no guidelines or consensus statements outlining competencies for global health fellows. Our objective was to develop a mission and core competencies for Family Medicine Global Health Fellowships. A modified Delphi technique was used to develop consensus on fellowship competencies. A panel, comprised of 13 members with dual expertise in global health and medical education, undertook an iterative consensus process, followed by peer review, from April to December 2014. The panel developed a mission statement and identified six domains for family medicine global health fellowships: patient care, medical knowledge, professionalism, communication and leadership, teaching, and scholarship. Each domain includes a set of core and program-specific competencies. The family medicine global health competencies are intended to serve as an educational framework for the design, implementation, and evaluation of individual family medicine global health fellowship programs.

The competencies of Registered Nurses working in care homes: a modified Delphi study.

PubMed

Stanyon, Miriam Ruth; Goldberg, Sarah Elizabeth; Astle, Anita; Griffiths, Amanda; Gordon, Adam Lee

2017-07-01

registered Nurses (RNs) working in UK care homes receive most of their training in acute hospitals. At present the role of care home nursing is underdeveloped and it is seen as a low status career. We describe here research to define core competencies for RNs working in UK care homes. a two-stage process was adopted. A systematic literature review and focus groups with stakeholders provided an initial list of competencies. The competency list was modified over three rounds of a Delphi process with a multi-disciplinary expert panel of 28 members. twenty-two competencies entered the consensus process, all competencies were amended and six split. Thirty-one competencies were scored in round two, eight were agreed as essential, one competency was split into two. Twenty-four competencies were submitted for scoring in round three. In total, 22 competencies were agreed as essential for RNs working in care homes. A further 10 competencies did not reach consensus. the output of this study is an expert-consensus list of competencies for RNs working in care homes. This would be a firm basis on which to build a curriculum for this staff group. © The Author 2017. Published by Oxford University Press on behalf of the British Geriatrics Society.All rights reserved. For permissions, please email: journals.permissions@oup.com

Development of the Learning Health System Researcher Core Competencies.

PubMed

Forrest, Christopher B; Chesley, Francis D; Tregear, Michelle L; Mistry, Kamila B

2017-08-04

To develop core competencies for learning health system (LHS) researchers to guide the development of training programs. Data were obtained from literature review, expert interviews, a modified Delphi process, and consensus development meetings. The competencies were developed from August to December 2016 using qualitative methods. The literature review formed the basis for the initial draft of a competency domain framework. Key informant semi-structured interviews, a modified Delphi survey, and three expert panel (n = 19 members) consensus development meetings produced the final set of competencies. The iterative development process yielded seven competency domains: (1) systems science; (2) research questions and standards of scientific evidence; (3) research methods; (4) informatics; (5) ethics of research and implementation in health systems; (6) improvement and implementation science; and (7) engagement, leadership, and research management. A total of 33 core competencies were prioritized across these seven domains. The real-world milieu of LHS research, the embeddedness of the researcher within the health system, and engagement of stakeholders are distinguishing characteristics of this emerging field. The LHS researcher core competencies can be used to guide the development of learning objectives, evaluation methods, and curricula for training programs. © Health Research and Educational Trust.

[University studies plan in geriatric medicine developed using a modified Delphi technique].

PubMed

Vilches-Moraga, Arturo; Ariño-Blasco, Sergio; Verdejo-Bravo, Carlos; Mateos-Nozal, Jesús

2015-01-01

The increase in the number of frail elderly people has led to the necessity that all doctors of the future acquire sufficient knowledge on human ageing and the skills in the management of the patient of advanced age, as well as the diseases associated with ageing. Few countries offer geriatric medicine within undergraduate training. The purpose of the present project was to obtain a consensus between European geriatricians on the minimum requirements that medical students must achieve at the end of their university degree course. A modified Delphi process was used. Firstly, experts in education and geriatrics proposed a set of learning objectives based on a review of the literature. Three Delphi rounds were then performed, in which a panel of 49 experts representing 29 countries affiliated to the European Union of Medical Specialists took part. This enabled them to reach a consensus on a definitive study plan. The number of disagreements after the Delphi rounds 1 and 2 were 81 and 53, respectively. Full agreement was reached after the third round. The definitive study plan consisted of detailed objectives grouped under 10 general training objectives. A consensus has been reached between European geriatricians that sets specific training objectives for medical students. Great efforts will be required for the introduction of these requirements, given the variability there is in the quality of teaching in geriatrics. This study plan is a first step in helping to improve geriatrics teaching in faculties of medicine, and will also serve as a basis to make advances in the training in post-graduate geriatrics throughout Europe. Copyright © 2014 SEGG. Published by Elsevier Espana. All rights reserved.

Future Directions for Business Education: A Delphi Study

ERIC Educational Resources Information Center

Kesten, Cyril A.; Lambrecht, Judith J.

2010-01-01

Purpose: The purpose of this study was to synthesize perceptions from the field about current issues and to propose future directions for the field of business education. Method: A modified three-stage Delphi study was carried out with business educators who attended national conferences and/or belonged to national professional organizations.…

[Modified Delphi method in the constitution of school sanitation standard].

PubMed

Yin, Xunqiang; Liang, Ying; Tan, Hongzhuan; Gong, Wenjie; Deng, Jing; Luo, Jiayou; Di, Xiaokang; Wu, Yue

2012-11-01

To constitute school sanitation standard using modified Delphi method, and to explore the feasibility and the predominance of Delphi method in the constitution of school sanitation standard. Two rounds of expert consultations were adopted in this study. The data were analyzed with SPSS15.0 to screen indices of school sanitation standard. Thirty-two experts accomplished the 2 rounds of consultations. The average length of expert service was (24.69 ±8.53) years. The authority coefficient was 0.729 ±0.172. The expert positive coefficient was 94.12% (32/34) in the first round and 100% (32/32) in the second round. The harmonious coefficients of importance, feasibility and rationality in the second round were 0.493 (P<0.05), 0.527 (P<0.01), and 0.535 (P<0.01), respectively, suggesting unanimous expert opinions. According to the second round of consultation, 38 indices were included in the framework. Theoretical analysis, literature review, investigation and so on are generally used in health standard constitution currently. Delphi method is a rapid, effective and feasible method in this field.

Expert Consensus for Discharge Referral Decisions Using Online Delphi

PubMed Central

Bowles, Kathy H.; Holmes, John H.; Naylor, Mary D.; Liberatore, Matthew; Nydick, Robert

2003-01-01

This paper describes the results of using a modified Delphi approach designed to achieve consensus from eight discharge planning experts regarding the decision to refer hospitalized older adults for post-discharge follow-up. Experts reviewed 150 cases using an online website designed to facilitate their interaction and efforts to reach agreement on the need for a referral for post-discharge care and the appropriate site for such care. In contrast to an average of eight weeks to complete just 50 cases using the traditional mail method, the first online Delphi round for 150 cases were completed in six weeks. Data provided by experts suggest that online Delphi is a time efficient and acceptable methodology for reaching group consensus. Other benefits include instant access to Delphi decision results, live knowledge of the time requirements and progress of each expert, and cost savings in postage, paper, copying, and storage of paper documents. This online Delphi methodology is highly recommended. PMID:14728143

Indian Society of Gastroenterology consensus statements on Crohn's disease in India.

PubMed

Ramakrishna, Balakrishnan S; Makharia, Govind K; Ahuja, Vineet; Ghoshal, Uday C; Jayanthi, Venkataraman; Perakath, Benjamin; Abraham, Philip; Bhasin, Deepak K; Bhatia, Shobna J; Choudhuri, Gourdas; Dadhich, Sunil; Desai, Devendra; Goswami, Bhaba Dev; Issar, Sanjeev K; Jain, Ajay K; Kochhar, Rakesh; Loganathan, Goundappa; Misra, Sri Prakash; Ganesh Pai, C; Pal, Sujoy; Philip, Mathew; Pulimood, Anna; Puri, Amarender S; Ray, Gautam; Singh, Shivaram P; Sood, Ajit; Subramanian, Venkatraman

2015-01-01

In 2012, the Indian Society of Gastroenterology's Task Force on Inflammatory Bowel Diseases undertook an exercise to produce consensus statements on Crohn's disease (CD). This consensus, produced through a modified Delphi process, reflects our current recommendations for the diagnosis and management of CD in India. The consensus statements are intended to serve as a reference point for teaching, clinical practice, and research in India.

An international delphi survey for the definition of the variables for the development of new classification criteria for periodic fever aphtous stomatitis pharingitis cervical adenitis (PFAPA).

PubMed

Vanoni, Federica; Federici, Silvia; Antón, Jordi; Barron, Karyl S; Brogan, Paul; De Benedetti, Fabrizio; Dedeoglu, Fatma; Demirkaya, Erkan; Hentgen, Veronique; Kallinich, Tilmann; Laxer, Ronald; Russo, Ricardo; Toplak, Natasa; Uziel, Yosef; Martini, Alberto; Ruperto, Nicolino; Gattorno, Marco; Hofer, Michael

2018-04-18

Diagnosis of Periodic fever, aphthous stomatitis, pharyngitis and cervical adenitis (PFAPA) is currently based on a set of criteria proposed in 1999 modified from Marshall's criteria. Nevertheless no validated evidence based set of classification criteria for PFAPA has been established so far. The aim of this study was to identify candidate classification criteria PFAPA syndrome using international consensus formation through a Delphi questionnaire survey. A first open-ended questionnaire was sent to adult and pediatric clinicians/researchers, asking to identify the variables thought most likely to be helpful and relevant for the diagnosis of PFAPA. In a second survey, respondents were asked to select, from the list of variables coming from the first survey, the 10 features that they felt were most important, and to rank them in descending order from most important to least important. The response rate to the first and second Delphi was respectively 109/124 (88%) and 141/162 (87%). The number of participants that completed the first and second Delphi was 69/124 (56%) and 110/162 (68%). From the first Delphi we obtained a list of 92 variables, of which 62 were selected in the second Delphi. Variables reaching the top five position of the rank were regular periodicity, aphthous stomatitis, response to corticosteroids, cervical adenitis, and well-being between flares. Our process led to identification of features that were felt to be the most important as candidate classification criteria for PFAPA by a large sample of international rheumatologists. The performance of these items will be tested further in the next phase of the study, through analysis of real patient data.

Using the modified Delphi method to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy.

PubMed

Zang, Lei; Fan, Ning; Hai, Yong; Lu, S B; Su, Q J; Yang, J C; Du, Peng; Gao, Y J

2015-06-01

Although cervical radiculopathy is very common, there is no standard treatment for this condition, with little high-level evidence available to guide the treatment choice. Thus, this study aimed to review the current data on the management of cervical radiculopathy; and, further, to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy using the Delphi method. First, a systematic review of the previously established treatment guidelines and of articles related to cervical radiculopathy was conducted to establish a protocol for the clinical consensus of the treatment for cervical radiculopathy. Second, from February 2012 to June 2014, we performed a modified Delphi survey in which the current professional opinions from 30 experienced experts, representing almost all of the Chinese provinces, were gathered. Three rounds were performed, and consensus was defined as ≥70% agreement. Consensus of the treatments for cervical radiculopathy was reached on seven aspects, including the proportion of patients requiring only non-surgical therapies; the effectiveness of neck immobilization, physiotherapy, pharmacologic treatment; surgical indications; contraindications; surgery. The modified Delphi study conducted herein reached a consensus concerning several treatment issues for cervical radiculopathy. In the absence of high-level evidence, at present, these expert opinion findings will help guide health care providers to define the appropriate treatment in their regions. Items with no consensus provide excellent areas for future research.

Developing standards for the development of glaucoma virtual clinics using a modified Delphi approach.

PubMed

Kotecha, Aachal; Longstaff, Simon; Azuara-Blanco, Augusto; Kirwan, James F; Morgan, James Edwards; Spencer, Anne Fiona; Foster, Paul J

2018-04-01

To obtain consensus opinion for the development of a standards framework for the development and implementation of virtual clinics for glaucoma monitoring in the UK using a modified Delphi methodology. A modified Delphi technique was used that involved sampling members of the UK Glaucoma and Eire Society (UKEGS). The first round scored the strength of agreement to a series of standards statements using a 9-point Likert scale. The revised standards were subjected to a second round of scoring and free-text comment. The final standards were discussed and agreed by an expert panel consisting of seven glaucoma subspecialists from across the UK. A version of the standards was submitted to external stakeholders for a 3-month consultation. There was a 44% response rate of UKEGS members to rounds 1 and 2, consisting largely of consultant ophthalmologists with a specialist interest in glaucoma. The final version of the standards document was validated by stakeholder consultation and contains four sections pertaining to the patient groups, testing methods, staffing requirements and governance structure of NHS secondary care glaucoma virtual clinic models. Use of a modified Delphi approach has provided consensus agreement for the standards required for the development of virtual clinics to monitor glaucoma in the UK. It is anticipated that this document will be useful as a guide for those implementing this model of service delivery. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Greenhouse Facility Management Experts Identification of Competencies and Teaching Methods to Support Secondary Agricultural Education Instructors: A Modified Delphi Study

ERIC Educational Resources Information Center

Franklin, Edward A.

2011-01-01

In this study the Delphi technique has been used to develop a list of educational competencies for preparing secondary agricultural education instructors to effectively manage their school greenhouse facilities. The use of specialized facilities in agricultural education requires appropriate preparation of agricultural education teachers. The…

Emerging Issues in the Utilization of Weblogs in Higher Education Classrooms

ERIC Educational Resources Information Center

Ayao-ao, Shirley

2014-01-01

This paper examines the emerging issues in the utilization of weblogs in Philippine higher education and how these issues affect the performance of students. This study used a modified Delphi method. The Delphi panel consisted of 12 experts in the integration of technology, particularly blogs, in their teaching. The study yielded the following…

Japanese Clinical Guidelines for Endoscopic Treatment of Pancreatolithiasis.

PubMed

Inui, Kazuo; Igarashi, Yoshinori; Irisawa, Atsushi; Ohara, Hirotaka; Tazuma, Susumu; Hirooka, Yoshiki; Fujita, Naotaka; Miyakawa, Hiroyuki; Sata, Naohiro; Shimosegawa, Tooru; Tanaka, Masao; Shiratori, Keiko; Sugiyama, Masanori; Takeyama, Yoshifumi

2015-10-01

In addition to surgery, procedures for patients with pancreatolithiasis are developing; therefore, establishing practical guidelines for the management of pancreatolithiasis is required. Three committees (the professional committee for asking clinical questions (CQs) and statements by Japanese endoscopists, the expert panel committee for rating statements by the modified Delphi method, and the evaluating committee by moderators) were organized. Eight endoscopists and a surgeon for pancreatolithiasis made the CQs and statements from a total of 694 reports of published literature by PubMed search (from 1983 to 2012). The expert panelists individually rated these clinical statements using a modified Delphi approach, in which a clinical statement receiving a median score greater than 7 on a 9-point scale from the panel was regarded as valid. The professional committee made 3, 7, and 10 CQs and statements for the concept and pathogenesis, diagnosis, and treatment, respectively. The expert panelists regarded them as valid after a 2-round modified Delphi approach. After evaluation by the moderators, the Japanese clinical guidelines for pancreatolithiasis were established. Further discussions and studies for international guidelines are needed.

Using a Delphi approach to develop a strategy for A&E in defence nursing.

PubMed

Kenward, Gary; Berry, Andy; Despres, Julian; McLeod, Judith

The Armed Forces has seen an increase in the number of operational deployments overseas and a greater demand for Accident and Emergency (A&E) trained nurses. This article describes a modified Delphi study used to contribute to the development of a strategy for emergency nursing in the Defence Nursing Services. Twenty-eight A&E specialists took part and the key issues raised were recruitment and retention, staff development, new roles, research priorities, increased internal recruitment of A&E nurses to meet operational demands, and the need for a structured career pathway to help retention. The most pressing areas requiring research were evaluation of the nurse practitioner role, clinical competencies and managing heat injuries in the operational setting. The modified Delphi study provided a valuable and detailed insight into the challenges and aspirations of the military A&E nursing cadre and has assisted in developing a strategy for emergency nursing.

Nursing Information Systems Requirements: A Milestone for Patient Outcome and Patient Safety Improvement.

PubMed

Farzandipour, Mehrdad; Meidani, Zahra; Riazi, Hossein; Sadeqi Jabali, Monireh

2016-12-01

Considering the integral role of understanding users' requirements in information system success, this research aimed to determine functional requirements of nursing information systems through a national survey. Delphi technique method was applied to conduct this study through three phases: focus group method modified Delphi technique and classic Delphi technique. A cross-sectional study was conducted to evaluate the proposed requirements within 15 general hospitals in Iran. Forty-three of 76 approved requirements were clinical, and 33 were administrative ones. Nurses' mean agreements for clinical requirements were higher than those of administrative requirements; minimum and maximum means of clinical requirements were 3.3 and 3.88, respectively. Minimum and maximum means of administrative requirements were 3.1 and 3.47, respectively. Research findings indicated that those information system requirements that support nurses in doing tasks including direct care, medicine prescription, patient treatment management, and patient safety have been the target of special attention. As nurses' requirements deal directly with patient outcome and patient safety, nursing information systems requirements should not only address automation but also nurses' tasks and work processes based on work analysis.

A consensus exercise identifying priorities for research into clinical effectiveness among children's orthopaedic surgeons in the United Kingdom.

PubMed

Perry, D C; Wright, J G; Cooke, S; Roposch, A; Gaston, M S; Nicolaou, N; Theologis, T

2018-05-01

Aims High-quality clinical research in children's orthopaedic surgery has lagged behind other surgical subspecialties. This study used a consensus-based approach to identify research priorities for clinical trials in children's orthopaedics. Methods A modified Delphi technique was used, which involved an initial scoping survey, a two-round Delphi process and an expert panel formed of members of the British Society of Children's Orthopaedic Surgery. The survey was conducted amongst orthopaedic surgeons treating children in the United Kingdom and Ireland. Results A total of 86 clinicians contributed to both rounds of the Delphi process, scoring priorities from one (low priority) to five (high priority). Elective topics were ranked higher than those relating to trauma, with the top ten elective research questions scoring higher than the top question for trauma. Ten elective, and five trauma research priorities were identified, with the three highest ranked questions relating to the treatment of slipped capital femoral epiphysis (mean score 4.6/ 5), Perthes' disease (4.5) and bone infection (4.5). Conclusion This consensus-based research agenda will guide surgeons, academics and funders to improve the evidence in children's orthopaedic surgery and encourage the development of multicentre clinical trials. Cite this article: Bone Joint J 2018;100-B:680-4.

Defining Advance Care Planning for Adults: A Consensus Definition from a Multidisciplinary Delphi Panel

PubMed Central

Sudore, Rebecca L.; Lum, Hillary D.; You, John J.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Matlock, Daniel D.; Rietjens, Judith A. C.; Korfage, Ida J.; Ritchie, Christine S.; Kutner, Jean S.; Teno, Joan M.; Thomas, Judy; McMahan, Ryan D.; Heyland, Daren K.

2017-01-01

Background Despite increasing interest in advance care planning (ACP) and prior ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. Objective To develop a consensus definition of ACP for adults. Design Delphi Panel Setting/Participants Participants included a multidisciplinary panel of international ACP experts consisting of 52 clinicians, researchers, and policy leaders from 4 countries, and a patient/surrogate advisory committee. Measurements We conducted 10 rounds of a modified Delphi method and qualitatively analyzed panelists’ input. Panelists identified several themes lacking consensus, and iteratively discussed and developed a final consensus definition. Results Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients’ values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: “Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness.” The panel also described strategies to best support adults in ACP. Conclusions A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. PMID:28062339

Defining Advance Care Planning for Adults: A Consensus Definition From a Multidisciplinary Delphi Panel.

PubMed

Sudore, Rebecca L; Lum, Hillary D; You, John J; Hanson, Laura C; Meier, Diane E; Pantilat, Steven Z; Matlock, Daniel D; Rietjens, Judith A C; Korfage, Ida J; Ritchie, Christine S; Kutner, Jean S; Teno, Joan M; Thomas, Judy; McMahan, Ryan D; Heyland, Daren K

2017-05-01

Despite increasing interest in advance care planning (ACP) and previous ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. The aim of this study was to develop a consensus definition of ACP for adults. We convened a Delphi panel of multidisciplinary, international ACP experts consisting of 52 clinicians, researchers, and policy leaders from four countries and a patient/surrogate advisory committee. We conducted 10 rounds using a modified Delphi method and qualitatively analyzed panelists' input. Panelists identified several themes lacking consensus and iteratively discussed and developed a final consensus definition. Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients' values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: "Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness." The panel also described strategies to best support adults in ACP. A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. Published by Elsevier Inc.

Classification of drugs with different risk profiles.

PubMed

Saedder, Eva Aggerholm; Brock, Birgitte; Nielsen, Lars Peter; Bonnerup, Dorthe Krogsgaard; Lisby, Marianne

2015-08-01

A risk stratification approach is needed to identify patients at high risk of medication errors and a resulting high need of medication review. The aim of this study was to perform risk stratification (distinguishing between low-risk, medium-risk and high-risk drugs) for drugs found to cause serious adverse reactions due to medication errors. The study employed a modified Delphi technique. Drugs from a systematic literature search were included into two rounds of a Delphi process. A panel of experts was asked to evaluate each identified drug's potential for harm and for clinically relevant drug-drug interactions on a scale from 1 (low risk) to 9 (high risk). A total of 36 experts were appointed to serve on the panel. Consensus was reached for 29/57 (51%) drugs or drug classes that cause harm, and for 32/57 (56%) of the drugs or drug classes that cause interactions. For the remaining drugs, a decision was made based on the median score. Two lists, one stating the drugs' potential for causing harm and the other stating clinically relevant drug-drug interactions, were stratified into low-risk, medium-risk and high-risk drugs. Based on a modified Delphi technique, we created two lists of drugs stratified into a low-risk, a medium-risk and a high-risk group of clinically relevant interactions or risk of harm to patients. The lists could be incorporated into a risk-scoring tool that stratifies the performance of medication reviews according to patients' risk of experiencing adverse reactions. none. not relevant.

Nature-based care opportunities and barriers in oncology contexts: a modified international e-Delphi survey.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-10-16

To develop recommendations regarding opportunities and barriers for nature-based care in oncology contexts using a structured knowledge generation process involving relevant healthcare and design experts. Four-round modified electronic Delphi study. Oncology patients' nature-based recommendations, uncovered in preceding qualitative investigation, were included in the first round for the expert participants' consideration. Key items (opportunities and barriers) were developed using data aggregation and synthesis, followed by item prioritisation and 10-point Likert scale ranking (1=not important, 10=very important). Descriptive statistics were calculated to assess items of highest importance representing expert recommendations. Online Delphi process constituting an electronic international survey. A purposive sample of 200 potential panellists (recruitment target n=40) comprising healthcare practitioners, managers, designers, architects and researchers were invited to participate; experts were identified via research networks, snowballing and systematic literature review. 38 experts across seven countries (Australia, USA, UK, New Zealand, Canada, Denmark and Sweden) returned questionnaire 1, which determined consent and acceptance for participation. Initial response rate was 19%, and subsequent response rates were 84%, 82% and 84% for rounds 2, 3 and 4, respectively. The Delphi panel developed recommendations consisting of 10 opportunities and 10 barriers. The following opportunities were rated to be of highest importance: window views from clinical areas onto nature; outdoor settings, gardens and courtyards with easy and effortless access; and nature-based physical exercise adapted to patient requirements. Highest-rated barriers for nature-based oncology care included lack of knowledge and awareness about benefits of nature engagement and inaccessibility, not considering access requirements for the very sick and frail. Experts suggested and agreed on a set of recommendations, which represent critical considerations for the safe adoption of nature-based oncology opportunities. These findings fill a gap in understanding about helpful nature-based oncology care and may translate into oncology design and innovation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A Study to Identify the Training Needs of Life Insurance Sales Representatives in Taiwan Using the Delphi Approach

ERIC Educational Resources Information Center

Fan, Chiang Ku; Cheng, Chen-Liang

2006-01-01

This article reports a study conducted to identify the needs for continuing professional development for life insurance sales representatives and to examine the competencies needed by those sales representatives. A modified Delphi technique was used. Most life insurance companies in the USA implement an education and training plan advocated by the…

An Analysis of Factors that Inhibit Business Use of User-Centered Design Principles: A Delphi Study

ERIC Educational Resources Information Center

Hilton, Tod M.

2010-01-01

The use of user-centered design (UCD) principles has a positive impact on the use of web-based interactive systems in customer-centric organizations. User-centered design methodologies are not widely adopted in organizations due to intraorganizational factors. A qualitative study using a modified Delphi technique was used to identify the factors…

Using the Delphi Method for Selecting Effective Rehabilitation Practices for Case Study Research: Methods, Challenges, and Solutions and Implications for Future Research

ERIC Educational Resources Information Center

Fleming, Allison R.; Boeltzig-Brown, Heike; Foley, Susan M.

2015-01-01

Purpose: We describe a modified Delphi method used to select effective state vocational rehabilitation agency practices to prioritize rehabilitation services for individuals with most significant disabilities within the context of Order of Selection, an area where there is little known and published. Specifically, we describe how we applied the…

Identification of the Competencies Needed to Apply Social Marketing to Extension Programming: Results of a Delphi Study

ERIC Educational Resources Information Center

Warner, Laura A.; Stubbs, Eric; Murphrey, Theresa Pesl; Huynh, Phuong

2016-01-01

The purpose of this study was to identify the specific competencies needed to apply social marketing, a promising approach to behavior change, to Extension programming. A modified Delphi study was used to achieve group consensus among a panel of experts on the skills, characteristics, and knowledge needed to successfully apply this behavior change…

Achieving 90% Adoption of Clinical Practice Guidelines Using the Delphi Consensus Method in a Large Orthopedic Group.

PubMed

Bini, Stefano A; Mahajan, John

2016-11-01

Little is known about the implementation rate of clinical practice guidelines (CPGs). Our purpose was to report on the adoption rate of CPGs created and implemented by a large orthopedic group using the Delphi consensus method. The draft CPGs were created before the group's annual meeting by 5 teams each assigned a subset of topics. The draft guidelines included a statement and a summary of the available evidence. Each guideline was debated in both small-group and plenary sessions. Voting was anonymous and a 75% supermajority was required for passage. A Likert scale was used to survey the patient's experience with the process at 1 week, and the Kirkpatrick evaluation model was used to gauge the efficacy of the process over a 6-month time frame. Eighty-five orthopedic surgeons attended the meeting. Fifteen guidelines grouped into 5 topics were created. All passed. Eighty-six percent of attendees found the process effective and 84% felt that participating in the process made it more likely that they would adopt the guidelines. At 1 week, an average of 62% of attendees stated they were practicing the guideline as written (range: 35%-72%), and at 6 months, 96% stated they were practicing them (range: 82%-100%). We have demonstrated that a modified Delphi method for reaching consensus can be very effective in both creating CPGs and leading to their adoption. Further we have shown that the process is well received by participants and that an inclusionary approach can be highly successful. Copyright © 2016 Elsevier Inc. All rights reserved.

Identifying Core Concepts of Cybersecurity: Results of Two Delphi Processes

ERIC Educational Resources Information Center

Parekh, Geet; DeLatte, David; Herman, Geoffrey L.; Oliva, Linda; Phatak, Dhananjay; Scheponik, Travis; Sherman, Alan T.

2018-01-01

This paper presents and analyzes results of two Delphi processes that polled cybersecurity experts to rate cybersecurity topics based on importance, difficulty, and timelessness. These ratings can be used to identify core concepts--cross-cutting ideas that connect knowledge in the discipline. The first Delphi process identified core concepts that…

Development of an Index of Engagement in HIV Care: An Adapted Internet-Based Delphi Process

PubMed Central

Koester, Kimberly A; Wood, Troy; Neilands, Torsten B; Pomeranz, Jamie L; Christopoulos, Katerina A

2017-01-01

Background Improving engagement in medical care among persons living with human immunodeficiency virus (HIV) is critical to optimizing clinical outcomes and reducing onward transmission of HIV. However, a clear conceptualization of what it means to be engaged in HIV care is lacking, and thus efforts to measure and enhance engagement in care are limited. Objective This paper describes the use of a modified online Delphi process of consensus building to solicit input from a range of HIV and non-HIV researchers and providers, and to integrate that input with focus group data conducted with HIV-infected patients. The overarching goal was to generate items for a patient-centered measure of engagement in HIV care for use in future research and clinical practice. Methods We recruited 66 expert panelists from around the United States. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. Results We recruited 66 expert panelists from around the United States and 64 (97%) were retained for four rounds of data collection. Starting with six open-ended questions, we used four rounds of online Delphi data collection in tandem with 12 in-person focus groups with patients and cognitive interviews with 25 patients. The process resulted in an expansion to 120 topics that were subsequently reduced to 13 candidate items for the planned assessment measure. Conclusions The process was an efficient method of soliciting input from geographically separated and busy experts across a range of disciplines and professional roles with the aim of arriving at a coherent definition of engagement in HIV care and a manageable set of survey items to assess it. Next steps are to validate the utility of the new measure in predicting retention in care, adherence to treatment, and clinical outcomes among patients living with HIV. PMID:29208589

Development of ethical rules for boundaries of touch in complementary medicine--outcomes of a Delphi process.

PubMed

Schiff, Elad; Ben-Arye, Eran; Shilo, Margalit; Levy, Moti; Schachter, Leora; Weitchner, Na'ama; Golan, Ofra; Stone, Julie

2010-11-01

The practice of complementary medicine (CAM) often involves touch. The unique philosophy of many CAM therapies, and the setting in which treatments are provided create a therapeutic space which may be less clearly defined than in conventional settings - a space in which the boundaries between professional touch and personal/intimate touch may become easily obscured. Thus, complementary therapists need clear definitions and firm boundaries in order to maintain therapeutic efficacy and commitment. The aim of the process described in this article, was to develop ethical guidelines for boundaries of touch that will promote the safety and protection of the public which use CAM. Through a modified Delphi process, a diverse group of CAM practitioners, physicians, ethicists, legal consultants, health policy specialists, and representatives from the public, developed Ethical Rules for Boundaries of Touch in CAM. These guidelines may be implemented in ethical codes of professional CAM organizations, and also serve as a foundation for curriculums in ethics in CAM schools. Copyright © 2010 Elsevier Ltd. All rights reserved.

A modified Delphi study of structures and processes related to medicines management for elderly hospitalised patients in the United Arab Emirates.

PubMed

Al Shemeili, Saeed; Klein, Susan; Strath, Alison; Fares, Saleh; Stewart, Derek

2016-10-01

The structures and processes around the management of medicines for elderly, hospitalized patients are ill defined. This study aimed to determine consensus related to strategic and operational approaches in the United Arab Emirates. A modified Delphi technique, consensus study with first round statements developed from systematic reviews related to medicines management. Normalization process theory and the theoretical domains framework were applied in the construction of statements, organized into key elements of medicines management: guidelines for medicines management, medicines reconciliation, medicines selection, prescribing and review, medicines adherence, medicines counselling, health professional training and evaluation research. Seventy per cent (summative agree and strongly agree) was set as the target for consensus. Thirty panellists were recruited, representing senior physicians working within geriatrics, hospital pharmacy and nursing directors, chief health professionals (including social workers) and policy makers within the Health Authority of Abu Dhabi and academics. A high level of consensus was obtained for most statements relating to the structures and processes of medicines management. While consensus was not achieved for targeting only those patients with medicines related issues, it was achieved for focusing on all elderly admissions. Similarly, consensus was not achieved for which professions were most suited to roles but was achieved for trained and competent staff. High levels of consensus were obtained for structures and processes of medicines management relating to elderly hospitalized patients. Trained and competent health professionals were preferred to specific professions for any tasks and that all elderly patients and not targeted patients should be the focus for medicines management. © 2016 John Wiley & Sons, Ltd.

A proposed minimum data set for international primary care optometry: a modified Delphi study.

PubMed

Davey, Christopher J; Slade, Sarah V; Shickle, Darren

2017-07-01

To identify a minimum list of metrics of international relevance to public health, research and service development which can be extracted from practice management systems and electronic patient records in primary optometric practice. A two stage modified Delphi technique was used. Stage 1 categorised metrics that may be recorded as being part of a primary eye examination by their importance to research using the results from a previous survey of 40 vision science and public health academics. Delphi stage 2 then gauged the opinion of a panel of seven vision science academics and achieved consensus on contentious metrics and methods of grading/classification. A consensus regarding inclusion and response categories was achieved for nearly all metrics. A recommendation was made of 53 metrics which would be appropriate in a minimum data set. This minimum data set should be easily integrated into clinical practice yet allow vital data to be collected internationally from primary care optometry. It should not be mistaken for a clinical guideline and should not add workload to the optometrist. A pilot study incorporating an additional Delphi stage prior to implementation is advisable to refine some response categories. © 2017 The Authors. Ophthalmic and Physiological Optics published by John Wiley & Sons Ltd on behalf of College of Optometrists.

Defining a Research Agenda for Patient-Reported Outcomes in Surgery: A Delphi Survey of Stakeholders

PubMed Central

Pezold, Michael L.; Pusic, Andrea L.; Cohen, Wess A.; Hollenberg, James P.; Butt, Zeeshan; Flum, David R.; Temple, Larissa K.

2016-01-01

Background Identifying timely and important research questions using relevant patient-reported outcomes (PROs) in surgery remains paramount in the current medical climate. The inaugural Patient-Reported Outcomes in Surgery Conference brought together stakeholders in PROs research in surgery, with the aim of creating a research agenda to help determine future directions and advance cross-disciplinary collaboration. Study Design An iterative Web-based interface was used to create a modified Delphi survey. Participation was limited to conference registrants, which included surgeons, PROs researchers, payers, and other stakeholders. In the first round, research items were generated from qualitative review of responses to open-ended prompts. In the second round, items were ranked using a 5-point Likert scale; attendees were also asked to submit any new items. In the final round, the top 30 items and newly submitted items were redistributed for final ranking using a 3-point Likert scale. The top 20 items by mean rating were selected for the research agenda. Results In round one, participants submitted 459 items, which were reduced to 53 distinct items within seven themes of PROs research. A research agenda was formulated after two successive rounds of ranking. The research agenda identified three themes important for future PROs research in surgery: (1) PROs in the decision-making process, (2) integrating PROs into the EHR and, (3) measuring quality in surgery with PROs. Conclusions The PROS Conference research agenda was created using a modified Delphi survey of stakeholders that will help researchers, surgeons, and funders identify crucial areas of future PROs research in surgery. PMID:27437666

Development and face validation of strategies for improving consultation skills.

PubMed

Lefroy, Janet; Thomas, Adam; Harrison, Chris; Williams, Stephen; O'Mahony, Fidelma; Gay, Simon; Kinston, Ruth; McKinley, R K

2014-12-01

While formative workplace based assessment can improve learners' skills, it often does not because the procedures used do not facilitate feedback which is sufficiently specific to scaffold improvement. Provision of pre-formulated strategies to address predicted learning needs has potential to improve the quality and automate the provision of written feedback. To systematically develop, validate and maximise the utility of a comprehensive list of strategies for improvement of consultation skills through a process involving both medical students and their clinical primary and secondary care tutors. Modified Delphi study with tutors, modified nominal group study with students with moderation of outputs by consensus round table discussion by the authors. 35 hospital and 21 GP tutors participated in the Delphi study and contributed 153 new or modified strategies. After review of these and the 205 original strategies, 265 strategies entered the nominal group study to which 46 year four and five students contributed, resulting in the final list of 249 validated strategies. We have developed a valid and comprehensive set of strategies which are considered useful by medical students. This list can be immediately applied by any school which uses the Calgary Cambridge Framework to inform the content of formative feedback on consultation skills. We consider that the list could also be mapped to alternative skills frameworks and so be utilised by schools which do not use the Calgary Cambridge Framework.

An international survey and modified Delphi approach revealed numerous rapid review methods.

PubMed

Tricco, Andrea C; Zarin, Wasifa; Antony, Jesmin; Hutton, Brian; Moher, David; Sherifali, Diana; Straus, Sharon E

2016-02-01

To solicit experiences with and perceptions of rapid reviews from stakeholders, including researchers, policy makers, industry, journal editors, and health care providers. An international survey of rapid review producers and modified Delphi. Forty rapid review producers responded on our survey (63% response rate). Eighty-eight rapid reviews with 31 different names were reported. Rapid review commissioning organizations were predominantly government (78%) and health care (58%) organizations. Several rapid review approaches were identified, including updating the literature search of previous reviews (92%); limiting the search strategy by date of publication (88%); and having only one reviewer screen (85%), abstract data (84%), and assess the quality of studies (86%). The modified Delphi included input from 113 stakeholders on the rapid review approaches from the survey. Approach 1 (search limited by date and language; study selection by one reviewer only, and data abstraction and quality appraisal conducted by one reviewer and one verifier) was ranked the most feasible (72%, 81/113 responses), with the lowest perceived risk of bias (12%, 12/103); it also ranked second in timeliness (37%, 38/102) and fifth in comprehensiveness (5%, 5/100). Rapid reviews have many names and approaches, and some methods might be more desirable than others. Copyright © 2016 Elsevier Inc. All rights reserved.

Experiences and wisdom behind the numbers: qualitative analysis of the National Action Alliance for Suicide Prevention's Research Prioritization Task Force stakeholder survey.

PubMed

Booth, Chelsea L

2014-09-01

The Research Prioritization Task Force of the National Action Alliance for Suicide Prevention conducted a stakeholder survey including 716 respondents from 49 U.S. states and 18 foreign countries. To conduct a qualitative analysis on responses from individuals representing four main stakeholder groups: attempt and loss survivors, researchers, providers, and policy/administrators. This article focuses on a qualitative analysis of the early-round, open-ended responses collected in a modified online Delphi process, and, as an illustration of the research method, focuses on analysis of respondents' views of the role of life and emotional skills in suicide prevention. Content analysis was performed using both inductive and deductive code and category development and systematic qualitative methods. After the inductive coding was completed, the same data set was re-coded using the 12 Aspirational Goals (AGs) identified by the Delphi process. Codes and thematic categories produced from the inductive coding process were, in some cases, very similar or identical to the 12 AGs (i.e., those dealing with risk and protective factors, provider training, preventing reattempts, and stigma). Other codes highlighted areas that were not identified as important in the Delphi process (e.g., cultural/social factors of suicide, substance use). Qualitative and mixed-methods research are essential to the future of suicide prevention work. By design, qualitative research is explorative and appropriate for complex, culturally embedded social issues such as suicide. Such research can be used to generate hypotheses for testing and, as in this analysis, illuminate areas that would be missed in an approach that imposed predetermined categories on data. Published by Elsevier Inc.

Delphi`s DETOXSM process: Preparing to treat high organic content hazardous and mixed wastes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robertson, D.T.; Rogers, T.W.; Goldblatt, S.D.

1998-12-31

The US Department of Energy (DOE) Federal Energy Technology Center is sponsoring a full-scale technology demonstration of Delphi Research, Inc.`s patented DETOX{sup SM} catalytic wet chemical oxidation waste treatment process at the Savannah River Site (SRS) in South Carolina. The process is being developed primarily to treat hazardous and mixed wastes within the DOE complex as an alternative to incineration, but it has significant potential to treat wastes in the commercial sector. The results of the demonstration will be intensively studied and used to validate the technology. A critical objective in preparing for the demonstration was the successful completion ofmore » a programmatic Operational Readiness Review. Readiness Reviews are required by DOE for all new process startups. The Readiness Review provided the vehicle to ensure that Delphi was ready to start up and operate the DETOX{sup SM} process in the safest manner possible by implementing industry accepted management practices for safe operation. This paper provides an overview of the DETOX{sup SM} demonstration at SRS, and describes the crucial areas of the Readiness Review that marked the first steps in Delphi`s transition from a technology developer to an operating waste treatment services provider.« less

Developing a Canadian Curriculum for Simulation-Based Education in Obstetrics and Gynaecology: A Delphi Study.

PubMed

Craig, Catherine; Posner, Glenn D

2017-09-01

As obstetrics and gynaecology (Ob/Gyn) residency training programs move towards a competence-based approach to training and assessment, the development of a national standardized simulation curriculum is essential. The primary goal of this study was to define the fundamental content for the Canadian Obstetrics and Gynecology Simulation curriculum. A modified Delphi technique was used to achieve consensus in three rounds by surveying residency program directors or their local simulation educator delegates in 16 accredited Canadian Ob/Gyn residency programs. A consensus rate of 80% was agreed upon. Survey results were collected over 11 months in 2016. Response rates for the Delphi were 50% for the first round, 81% for the second round, and 94% for the third round. The first survey resulted in 84 suggested topics. These were organized into four categories: obstetrics high acuity low frequency events, obstetrics common events, gynaecology high acuity low frequency events, and gynaecology common events. Using the modified Delphi method, consensus was reached on 6 scenarios. This study identified the content for a national simulation-based curriculum for Ob/Gyn residency training programs and is the first step in the development of this curriculum. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Imaging of the small intestine in Crohn's disease: Joint position statement of the Indian Society of Gastroenterology and Indian Radiological and Imaging Association.

PubMed

Kedia, Saurabh; Sharma, Raju; Makharia, Govind K; Ahuja, Vineet; Desai, Devendra; Kandasamy, Devasenathipathy; Eapen, Anu; Ganesan, Karthik; Ghoshal, Uday C; Kalra, Naveen; Karthikeyan, D; Madhusudhan, Kumble Seetharama; Philip, Mathew; Puri, Amarender Singh; Puri, Sunil; Sinha, Saroj K; Banerjee, Rupa; Bhatia, Shobna; Bhat, Naresh; Dadhich, Sunil; Dhali, G K; Goswami, B D; Issar, S K; Jayanthi, V; Misra, S P; Nijhawan, Sandeep; Puri, Pankaj; Sarkar, Avik; Singh, S P; Srivastava, Anshu; Abraham, Philip; Ramakrishna, B S

2017-11-01

The Indian Society of Gastroenterology (ISG) Task Force on Inflammatory Bowel Disease and the Indian Radiological and Imaging Association (IRIA) developed combined ISG-IRIA evidence-based best-practice guidelines for imaging of the small intestine in patients with suspected or known Crohn's disease. These 29 position statements, developed through a modified Delphi process, are intended to serve as reference for teaching, clinical practice, and research.

Crucial design issues for special access technology; a Delphi study.

PubMed

O'Rourke, Pearl; Ekins, Ray; Timmins, Bernard; Timmins, Fiona; Long, Siobhan; Coyle, Eugene

2014-01-01

To develop and demonstrate a method to involve professional users of assistive technology (AT) in the development process of customisable products. Employing the ideas of user participation and mass customisation, this research addresses the need for reduced product costs and optimised product flexibility. An adaptable six-question Delphi study was developed to establish consensus among AT professionals on design issues relating to a specified AT domain requiring innovation. The study is demonstrated for the special access technology (SAT) domain. A modified morphological matrix structures the application of the study results to the product design process. Fourteen professionals from the Republic of Ireland and the UK participated. Consensus was reached on prevalent parts of SAT that malfunction, primary reasons for SAT malfunction, characteristics of clients associated with SAT selection, client needs regarding SAT use and training, desirable traits of SAT and clinicians' frustrations with SAT. The study revealed a range of problems related to SAT, highlighting the complexities of successful SAT adoption. The questions led to differentiated insights and enabled design solution conceptualisation from various perspectives. The approach was found to help facilitate efficient generation and application of professional users' knowledge during the design process of customisable AT.

DELPHI: An introduction to output layout and data content

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, C.F.

1994-08-16

DELPHI was the data summary and interpretation code used by gas diagnostics personnel during the period from 1968 through 1986. It was written by Floyd Momyer, and went through several revisions during its period of use. Described here is the final version, which provided the most extensive set of summary tables. Earlier versions of the code lacked some of the capabilities of the final version, but what they did include was of substantially the same format. DELPHI was run against most available input decks in the mid 1980s. Microfiche and hardcopy output were generated. Both now reside in our archives.more » These reruns used modified input decks, which may not have had the proper {open_quotes}trigger{close_quotes} to instruct DELPHI to output some tables. These tables could, therefore be missing from a printout even though the necessary data was present. Also, modifications to DELPHI did, in some instances, eliminate DELPHIs` capability to correctly output some of the earlier optional tables. This monologue is intended to compliment the archived printout, and to provide enough insight so that someone unfamiliar with the techniques of Gas Diagnostics can retrieve the results at some future date. DELPHI last ran on the CDC-7600 machines, and was not converted to run on the Crays when the CDC-7600`s were decommissioned. DELPHI accepted data from various analytical systems, set up data summary tables, and combined preshot tracer and detector data with these results to calculate the total production of measured species and the indicated fission yields and detector conversions.« less

Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement.

PubMed

McInnes, Matthew D F; Moher, David; Thombs, Brett D; McGrath, Trevor A; Bossuyt, Patrick M; Clifford, Tammy; Cohen, Jérémie F; Deeks, Jonathan J; Gatsonis, Constantine; Hooft, Lotty; Hunt, Harriet A; Hyde, Christopher J; Korevaar, Daniël A; Leeflang, Mariska M G; Macaskill, Petra; Reitsma, Johannes B; Rodin, Rachel; Rutjes, Anne W S; Salameh, Jean-Paul; Stevens, Adrienne; Takwoingi, Yemisi; Tonelli, Marcello; Weeks, Laura; Whiting, Penny; Willis, Brian H

2018-01-23

Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of 1 or more index tests against a reference standard, provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy. To develop the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagnostic test accuracy guideline as a stand-alone extension of the PRISMA statement. Modifications to the PRISMA statement reflect the specific requirements for reporting of systematic reviews and meta-analyses of diagnostic test accuracy studies and the abstracts for these reviews. Established standards from the Enhancing the Quality and Transparency of Health Research (EQUATOR) Network were followed for the development of the guideline. The original PRISMA statement was used as a framework on which to modify and add items. A group of 24 multidisciplinary experts used a systematic review of articles on existing reporting guidelines and methods, a 3-round Delphi process, a consensus meeting, pilot testing, and iterative refinement to develop the PRISMA diagnostic test accuracy guideline. The final version of the PRISMA diagnostic test accuracy guideline checklist was approved by the group. The systematic review (produced 64 items) and the Delphi process (provided feedback on 7 proposed items; 1 item was later split into 2 items) identified 71 potentially relevant items for consideration. The Delphi process reduced these to 60 items that were discussed at the consensus meeting. Following the meeting, pilot testing and iterative feedback were used to generate the 27-item PRISMA diagnostic test accuracy checklist. To reflect specific or optimal contemporary systematic review methods for diagnostic test accuracy, 8 of the 27 original PRISMA items were left unchanged, 17 were modified, 2 were added, and 2 were omitted. The 27-item PRISMA diagnostic test accuracy checklist provides specific guidance for reporting of systematic reviews. The PRISMA diagnostic test accuracy guideline can facilitate the transparent reporting of reviews, and may assist in the evaluation of validity and applicability, enhance replicability of reviews, and make the results from systematic reviews of diagnostic test accuracy studies more useful.

Core Domains for Clinical Research in Acute Respiratory Failure Survivors: An International Modified Delphi Consensus Study.

PubMed

Turnbull, Alison E; Sepulveda, Kristin A; Dinglas, Victor D; Chessare, Caroline M; Bingham, Clifton O; Needham, Dale M

2017-06-01

To identify the "core domains" (i.e., patient outcomes, health-related conditions, or aspects of health) that relevant stakeholders agree are essential to assess in all clinical research studies evaluating the outcomes of acute respiratory failure survivors after hospital discharge. A two-round consensus process, using a modified Delphi methodology, with participants from 16 countries, including patient and caregiver representatives. Prior to voting, participants were asked to review 1) results from surveys of clinical researchers, acute respiratory failure survivors, and caregivers that rated the importance of 19 preliminary outcome domains and 2) results from a qualitative study of acute respiratory failure survivors' outcomes after hospital discharge, as related to the 19 preliminary outcome domains. Participants also were asked to suggest any additional potential domains for evaluation in the first Delphi survey. Web-based surveys of participants representing four stakeholder groups relevant to clinical research evaluating postdischarge outcomes of acute respiratory failure survivors: clinical researchers, clinicians, patients and caregivers, and U.S. federal research funding organizations. None. None. Survey response rates were 97% and 99% in round 1 and round 2, respectively. There were seven domains that met the a priori consensus criteria to be designated as core domains: physical function, cognition, mental health, survival, pulmonary function, pain, and muscle and/or nerve function. This study generated a consensus-based list of core domains that should be assessed in all clinical research studies evaluating acute respiratory failure survivors after hospital discharge. Identifying appropriate measurement instruments to assess these core domains is an important next step toward developing a set of core outcome measures for this field of research.

STOPP/START Medication Criteria Modified for US Nursing Home Setting

PubMed Central

Khodyakov, Dmitry; Ochoa, Aileen; Olivieri-Mui, Brianne L.; Bouwmeester, Carla; Zarowitz, Barbara J.; Patel, Meenakshi; Ching, Diana; Briesacher, Becky

2016-01-01

STRUCTURED ABSTRACT BACKGROUND/OBJECTIVES A barrier to assessing the quality of prescribing in nursing homes (NH) is the lack of explicit criteria for this setting. Our objective was to develop a set of prescribing indicators measurable with available data from electronic nursing home databases by adapting the European-based 2014 STOPP/START criteria of potentially inappropriate and underused medications for the US setting. DESIGN A two-stage expert panel process. In first stage, investigator team reviewed 114 criteria for compatibility and measurability. In second stage, we convened an online modified e-Delphi (OMD) panel to rate the validity of criteria and two webinars to identify criteria with highest relevance to US NHs. PARTICIPANTS Seventeen experts with recognized reputations in NH care participated in the e-Delphi panel and 12 in the webinar. MEASUREMENTS Compatibility and measurability were assessed by comparing criteria to US terminology/setting standards and data elements in NH databases. Validity was rated with a 9-point Likert-type scale (1=not valid at all, 9=highly valid). Mean, median, interpercentile ranges, and agreement were determined for each criterion score. Relevance was determined by ranking the mean panel ratings on criteria that reached agreement; half of the criteria with the highest mean values were reviewed and approved by the webinar participants. RESULTS Fifty-three STOPP/START criteria were deemed as compatible with US setting and measurable using data from electronic NH databases. E-Delphi panelists rated 48 criteria as valid for US NHs. Twenty-four criteria were deemed as most relevant, consisting of 22 measures of potentially inappropriate medications and 2 measures of underused medications. CONCLUSION This study created the first explicit criteria for assessing the quality of prescribing in US NHs. PMID:28008599

Development of clinical pharmacy key performance indicators for hospital pharmacists using a modified Delphi approach.

PubMed

Fernandes, Olavo; Gorman, Sean K; Slavik, Richard S; Semchuk, William M; Shalansky, Steve; Bussières, Jean-François; Doucette, Douglas; Bannerman, Heather; Lo, Jennifer; Shukla, Simone; Chan, Winnie W Y; Benninger, Natalie; MacKinnon, Neil J; Bell, Chaim M; Slobodan, Jeremy; Lyder, Catherine; Zed, Peter J; Toombs, Kent

2015-06-01

Key performance indicators (KPIs) are quantifiable measures of quality. There are no published, systematically derived clinical pharmacy KPIs (cpKPIs). A group of hospital pharmacists aimed to develop national cpKPIs to advance clinical pharmacy practice and improve patient care. A cpKPI working group established a cpKPI definition, 8 evidence-derived cpKPI critical activity areas, 26 candidate cpKPIs, and 11 cpKPI ideal attributes in addition to 1 overall consensus criterion. Twenty-six clinical pharmacists and hospital pharmacy leaders participated in an internet-based 3-round modified Delphi survey. Panelists rated 26 candidate cpKPIs using 11 cpKPI ideal attributes and 1 overall consensus criterion on a 9-point Likert scale. A meeting was facilitated between rounds 2 and 3 to debate the merits and wording of candidate cpKPIs. Consensus was reached if 75% or more of panelists assigned a score of 7 to 9 on the consensus criterion during the third Delphi round. All panelists completed the 3 Delphi rounds, and 25/26 (96%) attended the meeting. Eight candidate cpKPIs met the consensus definition: (1) performing admission medication reconciliation (including best-possible medication history), (2) participating in interprofessional patient care rounds, (3) completing pharmaceutical care plans, (4) resolving drug therapy problems, (5) providing in-person disease and medication education to patients, (6) providing discharge patient medication education, (7) performing discharge medication reconciliation, and (8) providing bundled, proactive direct patient care activities. A Delphi panel of hospital pharmacists was successful in determining 8 consensus cpKPIs. Measurement and assessment of these cpKPIs will serve to advance clinical pharmacy practice and improve patient care. © The Author(s) 2015.

How to Choose? Using the Delphi Method to Develop Consensus Triggers and Indicators for Disaster Response.

PubMed

Lis, Rebecca; Sakata, Vicki; Lien, Onora

2017-08-01

To identify key decisions along the continuum of care (conventional, contingency, and crisis) and the critical triggers and data elements used to inform those decisions concerning public health and health care response during an emergency. A classic Delphi method, a consensus-building survey technique, was used with clinicians around Washington State to identify regional triggers and indicators. Additionally, using a modified Delphi method, we combined a workshop and single-round survey with panelists from public health (state and local) and health care coalitions to identify consensus state-level triggers and indicators. In the clinical survey, 122 of 223 proposed triggers or indicators (43.7%) reached consensus and were deemed important in regional decision-making during a disaster. In the state-level survey, 110 of 140 proposed triggers or indicators (78.6%) reached consensus and were deemed important in state-level decision-making during a disaster. The identification of consensus triggers and indicators for health care emergency response is crucial in supporting a comprehensive health care situational awareness process. This can inform the creation of standardized questions to ask health care, public health, and other partners to support decision-making during a response. (Disaster Med Public Health Preparedness. 2017;11:467-472).

Chiropractic Integrated Care Pathway for Low Back Pain in Veterans: Results of a Delphi Consensus Process.

PubMed

Lisi, Anthony J; Salsbury, Stacie A; Hawk, Cheryl; Vining, Robert D; Wallace, Robert B; Branson, Richard; Long, Cynthia R; Burgo-Black, A Lucille; Goertz, Christine M

2018-02-01

The purpose of this study was to develop an integrated care pathway for doctors of chiropractic, primary care providers, and mental health professionals who manage veterans with low back pain, with or without mental health comorbidity, within Department of Veterans Affairs health care facilities. The research method used was a consensus process. A multidisciplinary investigative team reviewed clinical guidelines and Veterans Affairs pain and mental health initiatives to develop seed statements and care algorithms to guide chiropractic management and collaborative care of veterans with low back pain. A 5-member advisory committee approved initial recommendations. Veterans Affairs-based panelists (n = 58) evaluated the pathway via e-mail using a modified RAND/UCLA methodology. Consensus was defined as agreement by 80% of panelists. The modified Delphi process was conducted in July to December 2016. Most (93%) seed statements achieved consensus during the first round, with all statements reaching consensus after 2 rounds. The final care pathway addressed the topics of informed consent, clinical evaluation including history and examination, screening for red flags, documentation, diagnostic imaging, patient-reported outcomes, adverse event reporting, chiropractic treatment frequency and duration standards, tailored approaches to chiropractic care in veteran populations, and clinical presentation of common mental health conditions. Care algorithms outlined chiropractic case management and interprofessional collaboration and referrals between doctors of chiropractic and primary care and mental health providers. This study offers an integrative care pathway that includes chiropractic care for veterans with low back pain. Copyright © 2018. Published by Elsevier Inc.

Deriving ICD-10 Codes for Patient Safety Indicators for Large-scale Surveillance Using Administrative Hospital Data.

PubMed

Southern, Danielle A; Burnand, Bernard; Droesler, Saskia E; Flemons, Ward; Forster, Alan J; Gurevich, Yana; Harrison, James; Quan, Hude; Pincus, Harold A; Romano, Patrick S; Sundararajan, Vijaya; Kostanjsek, Nenad; Ghali, William A

2017-03-01

Existing administrative data patient safety indicators (PSIs) have been limited by uncertainty around the timing of onset of included diagnoses. We undertook de novo PSI development through a data-driven approach that drew upon "diagnosis timing" information available in some countries' administrative hospital data. Administrative database analysis and modified Delphi rating process. All hospitalized adults in Canada in 2009. We queried all hospitalizations for ICD-10-CA diagnosis codes arising during hospital stay. We then undertook a modified Delphi panel process to rate the extent to which each of the identified diagnoses has a potential link to suboptimal quality of care. We grouped the identified quality/safety-related diagnoses into relevant clinical categories. Lastly, we queried Alberta hospital discharge data to assess the frequency of the newly defined PSI events. Among 2,416,413 national hospitalizations, we found 2590 unique ICD-10-CA codes flagged as having arisen after admission. Seven panelists evaluated these in a 2-round review process, and identified a listing of 640 ICD-10-CA diagnosis codes judged to be linked to suboptimal quality of care and thus appropriate for inclusion in PSIs. These were then grouped by patient safety experts into 18 clinically relevant PSI categories. We then analyzed data on 2,381,652 Alberta hospital discharges from 2005 through 2012, and found that 134,299 (5.2%) hospitalizations had at least 1 PSI diagnosis. The resulting work creates a foundation for a new set of PSIs for routine large-scale surveillance of hospital and health system performance.

Chartered Society of Physiotherapy's identification of national research priorities for physiotherapy using a modified Delphi technique.

PubMed

Rankin, Gabrielle; Rushton, Alison; Olver, Pat; Moore, Ann

2012-09-01

To define research priorities to strategically inform the evidence base for physiotherapy practice. A modified Delphi method using SurveyMonkey software identified priorities for physiotherapy research through national consensus. An iterative process of three rounds provided feedback. Round 1 requested five priorities using pre-defined prioritisation criteria. Content analysis identified research themes and topics. Round 2 requested rating of the importance of the research topics using a 1-5 Likert scale. Round 3 requested a further process of rating. Quantitative and qualitative data informed decision-making. Level of consensus was established as mean rating ≥ 3.5, coefficient of variation ≤ 30%, and ≥ 55% agreement. Consensus across participants was evaluated using Kendall's W. Four expert panels (n=40-61) encompassing a range of stakeholders and reflecting four core areas of physiotherapy practice were established by steering groups (n=204 participants overall). Response rates of 53-78% across three rounds were good. The identification of 24/185 topics for musculoskeletal, 43/174 for neurology, 30/120 for cardiorespiratory and medical rehabilitation, and 30/113 for mental and physical health and wellbeing as priorities demonstrated discrimination of the process. Consensus between participants was good for most topics. Measurement validity of the research topics was good. The involvement of multiple stakeholders as participants ensured the current context of the intended use of the priorities. From a process of national consensus involving key stakeholders, including service users, physiotherapy research topics have been identified and prioritised. Setting priorities provides a vision of how research can contribute to the developing research base in physiotherapy to maximise focus. Copyright © 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Guiding Principles for Student Leadership Development in the Doctor of Pharmacy Program to Assist Administrators and Faculty Members in Implementing or Refining Curricula

PubMed Central

Boyle, Cynthia J.; Janke, Kristin K.

2013-01-01

Objective. To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Results. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Conclusions. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought. PMID:24371345

Guiding principles for student leadership development in the doctor of pharmacy program to assist administrators and faculty members in implementing or refining curricula.

PubMed

Traynor, Andrew P; Boyle, Cynthia J; Janke, Kristin K

2013-12-16

To assist administrators and faculty members in colleges and schools of pharmacy by gathering expert opinion to frame, direct, and support investments in student leadership development. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define doctor of pharmacy (PharmD) student leadership instruction. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes to begin the generation of student leadership development guiding principles and competencies. Statements were identified as guiding principles when they were perceived as foundational to the instructional approach. Round 2 grouped responses for agreement rating and comment. Group consensus with a statement as a guiding principle was set prospectively at 80%. Round 3 allowed rating and comment on guidelines, modified from feedback in round 2, that did not meet consensus. The principles were verified by identifying common contemporary leadership development approaches in the literature. Twelve guiding principles, related to concepts of leadership and educational philosophy, were defined and could be linked to contemporary leadership development thought. These guiding principles describe the motivation for teaching leadership, the fundamental precepts of student leadership development, and the core tenets for leadership instruction. Expert opinion gathered using a Delphi process resulted in guiding principles that help to address many of the fundamental questions that arise when implementing or refining leadership curricula. The principles identified are supported by common contemporary leadership development thought.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology.

PubMed

King, Andrew; Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-10-25

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development.

Administration and leadership competencies: establishment of a national consensus for emergency medicine.

PubMed

Thoma, Brent; Poitras, Julien; Penciner, Rick; Sherbino, Jonathan; Holroyd, Brian R; Woods, Robert A

2015-03-01

The Royal College of Physicians and Surgeons of Canada requires emergency medicine (EM) residency programs to meet training objectives relating to administration and leadership. The purpose of this study was to establish a national consensus on the competencies for inclusion in an EM administration and leadership curriculum. A modified Delphi process involving two iterative rounds of an electronic survey was used to achieve consensus on competencies for inclusion in an EM administration and leadership curriculum. An initial list of competencies was compiled using peer-reviewed and grey literature. The participants included 14 EM residency program directors and 43 leadership and administration experts from across Canada who were recruited using a snowball technique. The proposed competencies were organized using the CanMEDS Physician Competency Framework and presented in English or French. Consensus was defined a priori as >70% agreement. Nearly all (13 of 14) of the institutions with an FRCPC EM program had at least one participant complete both surveys. Thirty-five of 57 (61%) participants completed round 1, and 30 (53%) participants completed both rounds. Participants suggested an additional 16 competencies in round 1. The results of round 1 informed the decisions in round 2. Fifty-nine of 109 (54.1%) competencies achieved consensus for inclusion. Based on a national modified Delphi process, we describe 59 competencies for inclusion in an EM administration and leadership curriculum that was arranged by CanMEDS Role. EM educators may consider these competencies when designing local curricula.

Teaching Competencies for Community Preceptors.

PubMed

Brink, Darin; Simpson, Deb; Crouse, Byron; Morzinski, Jeffrey; Bower, Douglas; Westra, Ruth

2018-05-01

Although community physicians provide one-fourth of the outpatient training received in medical school, usually there is no formal training of the preceptor. Currently there is no agreed-upon list of teaching competencies for community physician-preceptors. Using a modified Delphi process, the authors aimed to identify core teaching competencies for community preceptors for use in training and evaluation. A medical educator and three faculty members with expertise in faculty development created a list of teaching competencies organized in five domains. These competencies were finalized through a multiround modified Delphi technique with key stakeholder groups including (1) nonphysician medical educators, (2) academic physicians involved in faculty development, (3) community physicians who regularly precept medical students, (4) family medicine residents, (5) third-year medical students in a 9-month-long longitudinal clerkship. Proposed competencies were retained if 70% of the participants ranked it as "very or extremely important." In the first round, 24 competencies were evaluated by 40 physician preceptors participating in a rural faculty development conference. These were refined, and four additional competencies were added by the cohort. Subsequent rounds utilized a survey approach with broader audiences resulting in a final list of 21 competencies in five domains. Five competency domains with 21 teaching competencies can now be used to guide community preceptors' training and evaluation.

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol

PubMed Central

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-01-01

Introduction Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues—including conceptualisation, measurement and data analysis—that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. Methods and analysis This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. Ethics and dissemination An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. PMID:28188154

Experience of Delphi technique in the process of establishing consensus on core competencies.

PubMed

Raghav, Pankaja Ravi; Kumar, Dewesh; Bhardwaj, Pankaj

2016-01-01

The Department of Community Medicine and Family Medicine (CMFM) has been started as a new model for imparting the components of family medicine and delivering health-care services at primary and secondary levels in all six newly established All India Institute of Medical Sciences (AIIMS), but there is no competency-based curriculum for it. The paper aims to share the experience of Delphi method in the process of developing consensus on core competencies of the new model of CMFM in AIIMS for undergraduate medical students in India. The study adopted different approaches and methods, but Delphi was the most critical method used in this research. In Delphi, the experts were contacted by e-mail and their feedback on the same was analyzed. Two rounds of Delphi were conducted in which 150 participants were contacted in Delphi-I but only 46 responded. In Delphi-II, 26 participants responded whose responses were finally considered for analysis. Three of the core competencies namely clinician, primary-care physician, and professionalism were agreed by all the participants, and the least agreement was observed in the competencies of epidemiologist and medical teacher. The experts having more experience were less consistent as responses were changed from agree to disagree in more than 15% of participants and 6% changed from disagree to agree. Within the given constraints, the final list of competencies and skills for the discipline of CMFM compiled after the Delphi process will provide a useful insight into the development of competency-based curriculum of the subject.

Revised Conceptual Framework of Parent-to-Parent Support for Parents of Children Who Are Deaf or Hard of Hearing: A Modified Delphi Study.

PubMed

Henderson, Rebecca J; Johnson, Andrew M; Moodie, Sheila T

2016-06-01

A scoping review of the literature was conducted, resulting in the development of a conceptual framework of parent-to-parent support for parents with children who are Deaf or hard of hearing. This is the 2nd stage of a dual-stage scoping review. This study sought stakeholder opinion and feedback with an aim to achieve consensus on the constructs, components, and design of the initial conceptual framework. A modified electronic Delphi study was completed with 21 handpicked experts from 7 countries who have experience in provision, research, or experience in the area of parent-to-parent support. Participants completed an online questionnaire using an 11-point Likert scale (strongly disagree to strongly agree) and open-ended questions to answer various questions related to the descriptor terms, definitions, constructs, components, and overall design of the framework. Participant responses led to the revision of the original conceptual framework. The findings from this dual-stage scoping review and electronic Delphi study provide a conceptual framework that defines the vital contribution of parents in Early Hearing Detection and Intervention programs that will be a useful addition to these programs.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.

PubMed

Birko, Stanislav; Dove, Edward S; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts' variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions. PMID:26270647

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique.

PubMed

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method.

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique

PubMed Central

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method. PMID:25948132

Defining the Medical Library Association research agenda: methodology and final results from a consensus process

PubMed Central

Eldredge, Jonathan D.; Harris, Martha R.; Ascher, Marie T.

2009-01-01

Objective: Using a group consensus methodology, the research sought to generate a list of the twelve to fifteen most important and answerable research questions in health sciences librarianship as part of a broader effort to implement the new Medical Library Association (MLA) research policy. Methods: The delphi method was used. The committee distributed a brief survey to all estimated 827 MLA leaders and 237 MLA Research Section members, requesting they submit what they considered to be the most important and answerable research questions facing the profession. The submitted questions were then subjected to 2 rounds of voting to produce a short list of top-ranked questions. Results: The survey produced 62 questions from 54 MLA leaders and MLA Research Section members, who responded from an estimated potential population of 1,064 targeted colleagues. These questions were considered by the process participants to be the most important and answerable research questions facing the profession. Through 2 rounds of voting, these 62 questions were reduced to the final 12 highest priority questions. Conclusion: The modified delphi method accomplished its desired survey and consensus goals. Future survey and consensus processes will be revised to generate more initial questions and to distill a larger number of ranked prioritized research questions. PMID:19626143

Position Statement of the Israeli Society for Musculoskeletal Medicine on Intramuscular Stimulation for Myofascial Pain Syndrome-A Delphi Process.

PubMed

Ratmansky, Motti; Minerbi, Amir; Kalichman, Leonid; Kent, John; Wende, Osnat; Finestone, Aharon S; Vulfsons, Simon

2017-04-01

To develop consensus on a position paper on the use of intramuscular stimulation (IMS) for the treatment of myofascial pain syndrome (MPS) by physicians in Israel. The Israeli Society of Musculoskeletal Medicine ran a modified Delphi process to gather opinions from a multidisciplinary expert panel. Eight experts in the treatment of MPS were chosen and asked to participate, and six participated. The position paper was iterated three times. After three iterations, general consensus was reached by all six experts. The general statement that was agreed on was: "IMS is one of the preferred treatments for myofascial pain syndrome. The treatment is evidence-based, effective, safe, and inexpensive. The position of the Israeli Society of Musculoskeletal Medicine is that the treatment should be taught and used by all primary care physicians and those physicians in other areas of medicine who deal with pain in their work." The position paper is a basis for clinical work and education programs for physicians interested in a better understanding and ability to treat patients with a musculoskeletal complaint or manifestation of disease. © 2016 World Institute of Pain.

Using the Delphi Technique to Support Curriculum Development

ERIC Educational Resources Information Center

Sitlington, Helen Barbara; Coetzer, Alan John

2015-01-01

Purpose: The purpose of this paper is to present an analysis of the use of the Delphi technique to support curriculum development with a view to enhancing existing literature on use of the technique for renewal of business course curricula. Design/methodology/approach: The authors outline the Delphi process for obtaining consensus amongst a…

Setting Priorities for Gerontological Social Work Research: A National Delphi Study

ERIC Educational Resources Information Center

Burnette, Denise; Morrow-Howell, Nancy; Chen, Li-Mei

2003-01-01

Purpose: An increasingly important task for all disciplines involved in aging research is to identify and prioritize areas for investigation. This article reports the results of a national Delphi study on setting research priorities for gerontological social work. Design and Methods: Delphi methodology, a structured process for eliciting and…

The Global Spine Care Initiative: a consensus process to develop and validate a stratification scheme for surgical care of spinal disorders as a guide for improved resource utilization in low- and middle-income communities.

PubMed

Acaroğlu, Emre; Mmopelwa, Tiro; Yüksel, Selcen; Ayhan, Selim; Nordin, Margareta; Randhawa, Kristi; Haldeman, Scott

2017-10-16

The purpose of this study was to develop a stratification scheme for surgical spinal care to serve as a framework for referrals and distribution of patients with spinal disorders. We used a modified Delphi process. A literature search identified experts for the consensus panel and the panel was expanded by inviting spine surgeons known to be global opinion leaders. After creating a seed document of five hierarchical levels of surgical care, a four-step modified Delphi process (question validation, collection of factors, evaluation of factors, re-evaluation of factors) was performed. Of 78 invited experts, 19 participated in round 1, and of the 19, 14 participated in 2, and 12 in 3 and 4. Consensus was fairly heterogeneous for levels of care 2-4 (moderate resources). Only simple assessment methods based on the clinical skills of the medical personnel were considered feasible and safe in low-resource settings. Diagnosis, staging, and treatment were deemed feasible and safe in a specialized spine center. Accurate diagnostic workup was deemed feasible and safe for lower levels of care complexity (from level 3 upwards) compared to non-invasive procedures (level 4) and the full range of invasive procedures (level 5). This study introduces a five-level stratification scheme for the surgical care of spinal disorders. This stratification may provide input into the Global Spine Care Initiative care pathway that will be applied in medically underserved areas and low- and middle-income countries. These slides can be retrieved under Electronic Supplementary Material.

Consensus-based guidelines for Video EEG monitoring in the pre-surgical evaluation of children with epilepsy in the UK.

PubMed

Pressler, Ronit M; Seri, Stefano; Kane, Nick; Martland, Tim; Goyal, Sushma; Iyer, Anand; Warren, Elliott; Notghi, Lesley; Bill, Peter; Thornton, Rachel; Appleton, Richard; Doyle, Sarah; Rushton, Sarah; Worley, Alan; Boyd, Stewart G

2017-08-01

Paediatric Epilepsy surgery in the UK has recently been centralised in order to improve expertise and quality of service available to children. Video EEG monitoring or telemetry is a highly specialised and a crucial component of the pre-surgical evaluation. Although many Epilepsy Monitoring Units work to certain standards, there is no national or international guideline for paediatric video telemetry. Due to lack of evidence we used a modified Delphi process utilizing the clinical and academic expertise of the clinical neurophysiology sub-specialty group of Children's Epilepsy Surgical Service (CESS) centres in England and Wales. This process consisted of the following stages I: Identification of the consensus working group, II: Identification of key areas for guidelines, III: Consensus practice points and IV: Final review. Statements that gained consensus (median score of either 4 or 5 using a five-point Likerttype scale) were included in the guideline. Two rounds of feedback and amendments were undertaken. The consensus guidelines includes the following topics: referral pathways, neurophysiological equipment standards, standards of recording techniques, with specific emphasis on safety of video EEG monitoring both with and without drug withdrawal, a protocol for testing patient's behaviours, data storage and guidelines for writing factual reports and conclusions. All statements developed received a median score of 5 and were adopted by the group. Using a modified Delphi process we were able to develop universally-accepted video EEG guidelines for the UK CESS. Although these recommendations have been specifically developed for the pre-surgical evaluation of children with epilepsy, it is assumed that most components are transferable to any paediatric video EEG monitoring setting. Copyright © 2017 British Epilepsy Association. Published by Elsevier Ltd. All rights reserved.

What works for wellbeing in culture and sport? Report of a DELPHI process to support coproduction and establish principles and parameters of an evidence review.

PubMed

Daykin, Norma; Mansfield, Louise; Payne, Annette; Kay, Tess; Meads, Catherine; D'Innocenzo, Giorgia; Burnett, Adele; Dolan, Paul; Julier, Guy; Longworth, Louise; Tomlinson, Alan; Testoni, Stefano; Victor, Christina

2017-09-01

There is a growing recognition of the ways in which culture and sport can contribute to wellbeing. A strong evidence base is needed to support innovative service development and a 3-year research programme is being undertaken to capture best evidence of wellbeing impacts and outcomes of cultural and sporting activities in order to inform UK policy and practice. This article provides an overview of methods and findings from an initial coproduction process with key stakeholders that sought to explore and agree principles and parameters of the evidence review for culture, sport and wellbeing (CSW). A two-stage DELPHI process was conducted with a purposeful sample of 57 stakeholders between August and December 2015. Participants were drawn from a range of culture and sport organisations and included commissioners and managers, policy makers, representatives of service delivery organisations (SDOs) and scholars. The DELPHI 1 questionnaire was developed from extensive consultation in July and August 2015. It explored definitions of wellbeing, the role of evidence, quality assessment, and the culture and sport populations, settings and interventions that are most likely to deliver wellbeing outcomes. Following further consultation, the results, presented as a series of ranked statements, were sent back to participants (DELPHI 2), which allowed them to reflect on and, if they wished, express agreement or disagreement with the emerging consensus. A total of 40 stakeholders (70.02%) responded to the DELPHI questionnaires. DELPHI 1 mapped areas of agreement and disagreement, confirmed in DELPHI 2. The exercise drew together the key priorities for the CSW evidence review. The DELPHI process, in combination with face-to-face deliberation, enabled stakeholders to engage in complex discussion and express nuanced priorities while also allowing the group to come to an overall consensus and agree outcomes. The results will inform the CSW evidence review programme until its completion in March 2018.

What works for wellbeing in culture and sport? Report of a DELPHI process to support coproduction and establish principles and parameters of an evidence review

PubMed Central

Daykin, Norma; Mansfield, Louise; Payne, Annette; Kay, Tess; Meads, Catherine; D’Innocenzo, Giorgia; Burnett, Adele; Dolan, Paul; Julier, Guy; Longworth, Louise; Tomlinson, Alan; Testoni, Stefano; Victor, Christina

2016-01-01

Aims: There is a growing recognition of the ways in which culture and sport can contribute to wellbeing. A strong evidence base is needed to support innovative service development and a 3-year research programme is being undertaken to capture best evidence of wellbeing impacts and outcomes of cultural and sporting activities in order to inform UK policy and practice. This article provides an overview of methods and findings from an initial coproduction process with key stakeholders that sought to explore and agree principles and parameters of the evidence review for culture, sport and wellbeing (CSW). Methods: A two-stage DELPHI process was conducted with a purposeful sample of 57 stakeholders between August and December 2015. Participants were drawn from a range of culture and sport organisations and included commissioners and managers, policy makers, representatives of service delivery organisations (SDOs) and scholars. The DELPHI 1 questionnaire was developed from extensive consultation in July and August 2015. It explored definitions of wellbeing, the role of evidence, quality assessment, and the culture and sport populations, settings and interventions that are most likely to deliver wellbeing outcomes. Following further consultation, the results, presented as a series of ranked statements, were sent back to participants (DELPHI 2), which allowed them to reflect on and, if they wished, express agreement or disagreement with the emerging consensus. Results: A total of 40 stakeholders (70.02%) responded to the DELPHI questionnaires. DELPHI 1 mapped areas of agreement and disagreement, confirmed in DELPHI 2. The exercise drew together the key priorities for the CSW evidence review. Conclusion: The DELPHI process, in combination with face-to-face deliberation, enabled stakeholders to engage in complex discussion and express nuanced priorities while also allowing the group to come to an overall consensus and agree outcomes. The results will inform the CSW evidence review programme until its completion in March 2018. PMID:27789779

Expert validation of a teamwork assessment rubric: A modified Delphi study.

PubMed

Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

2016-01-01

Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with confidence in the university setting. Copyright © 2015 Elsevier Ltd. All rights reserved.

A DELPHI STUDY OF RISK FACTORS FOR ACHILLES TENDINOPATHY- OPINIONS OF WORLD TENDON EXPERTS

PubMed Central

Watson, Paul J.; Barry, Simon

2016-01-01

Background and Purpose Achilles tendinopathy can be a debilitating chronic condition for both active and inactive individuals. The identification of risk facors is important both in preventing but also treating tendinopathy, many factors have been proposed but there is a lack of primary epidemiological data. The purpose of this study was to develop a statement of expert consensus on risk factors for Achilles tendinopathy in active and sedentary patient populations to inform a primary epidemiological study. Study design Delphi study Methods and Measures An online Delphi study was completed inviting participation from world tendon experts. The consensus was developed using three rounds of the Delphi technique. The first round developed a complete list of potential risk factors, the second round refined this list but also separated the factors into two population groups – active/athletic and inactive/sedentary. The third round ranked this list in order of perceived importance. Results Forty-four experts were invited to participate, 16 participated in the first round (response rate 40%) and two dropped out in the second round (resulting in a response rate of 35%). A total of 27 intrinsic and eight extrinsic risk factors were identified during round one. During round two only 12 intrinsic and five extrinsic risk factors were identified as important in active/athletic tendinopathy while 14 intrinsic and three extrinsic factors were identified as important for inactive/sedentary tendinopathy. Conclusions Risk factors for Achilles tendinopathy were identified based on expert consensus, and these factors provide a basis for primary epidemiological studies. Plantarflexor strength was identified as the primary modifiable factor in the active/athletic group while systemic factors were identified as important in the inactive/sedentary group, many of the potential factors suggested for either group were non-modifiable. Non-modifiable factors include: previous tendinopathy, previous injury, advancing age, sex, steroid exposure, and antibiotic treatment. Level of evidence Level V PMID:27757281

Identifying criteria for the assessment of pharmacy students' communication skills with patients.

PubMed

Mackellar, Adele; Ashcroft, Darren M; Bell, Dawn; James, Delyth Higman; Marriott, John

2007-06-15

To identify criteria by which patients can assess the communication skills of pharmacy students. Potential assessment criteria were generated from 2 main sources: a literature review and a focus group discussion. A modified two-round Delphi survey was subsequently conducted with 35 professionals who were actively involved in teaching and assessing communication skills of pharmacy students to determine the importance and reliability of each criterion. Consensus ratings identified 7 criteria that were important measures of pharmacy students' communication skills and could be reliably assessed by patients. A modified two-round Delphi consultation survey successfully identified criteria that can be used by patients to assess the communication skills of pharmacy undergraduates. Future work will examine the feasibility of using patients as assessors of communication skills of pharmacy students, preregistration pharmacists, and qualified pharmacists.

Frontline over ivory tower: key competencies in community-based curricula.

PubMed

Millar, Adam; Malcolm, Janine; Cheng, Alice; Fine, Rebecca; Wong, Rene

2015-01-01

The Royal College of Physicians and Surgeons of Canada mandates that community experiences be incorporated into medicine-based specialties. Presently there is wide variability in community endocrine experiences across Canadian training programs. This is complicated by the paucity of literature providing guidance on what constitutes a 'community' rotation. A modified Delphi technique was used to determine the CanMEDS competencies best taught in a community endocrinology curriculum. The Delphi technique is a qualitative-research method that uses a series of questionnaires sent to a group of experts with controlled feedback provided by the researchers after each survey round. The experts in this study included endocrinology program directors, community endocrinologists, endocrinology residents and recent endocrinology graduates. Thirty four out of 44 competencies rated by the panel were deemed suitable for a community curriculum. The experts considered the "Manager" role best taught in the community, while they considered the community least suitable to learn the "Medical Expert" competency. To our knowledge, this is the first time the content of a community-based subspecialty curriculum was determined using the Delphi process in Canada. These findings suggest that community settings have potential to fill in gaps in residency training in regards to the CanMEDS Manager role. The results will aid program directors in designing competency-based community endocrinology rotations and competency-based community rotations in other medical subspecialty programs.

[Handover between home and respite care facilities : Delphi survey within the context of continuity of care for people with dementia].

PubMed

Kuske, S; Roes, M; Bartholomeyczik, S

2016-07-01

Criteria for the handover between healthcare settings were identified based on a review and on results of empirical data. This study was carried out to select the most relevant criteria for defining the quality of continuity of care of people with dementia (PwD) in the context of the handover between care at home and respite care facilities. A modified classical two-step Delphi design was used in combination with a group Delphi design. A total of 28 core criteria with a consensus strength of > 60 % are presented. Safety-relevant information, especially the personal habits of PwD and the role of informal caregivers in the handover between care settings are important. Furthermore, the following general principles to ensure the quality of continuity of the care of PwD were deduced: completeness, verification, multipath communication, timeliness and topicality, accessibility and defined responsibilities, roles and standardization. A successful transition of PwD to respite care facilities relies on the provision of relevant information, considering personal habits, before the day of transition. Furthermore, a timely preparation for discharge is important. The individual needs of the informal caregivers with regard to their support should be considered. Professionals who are responsible in handover processes should have solid communication competence in order to collect relevant information from informal caregivers, who have a strong individual care experience with the PwD.

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study

PubMed Central

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-01-01

Objectives To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. Methods A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. Results In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Conclusions Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. PMID:24670554

Core Outcome Domains for early phase clinical trials of sound-, psychology-, and pharmacology-based interventions to manage chronic subjective tinnitus in adults: the COMIT'ID study protocol for using a Delphi process and face-to-face meetings to establish consensus.

PubMed

Fackrell, Kathryn; Smith, Harriet; Colley, Veronica; Thacker, Brian; Horobin, Adele; Haider, Haúla F; Londero, Alain; Mazurek, Birgit; Hall, Deborah A

2017-08-23

The reporting of outcomes in clinical trials of subjective tinnitus indicates that many different tinnitus-related complaints are of interest to investigators, from perceptual attributes of the sound (e.g. loudness) to psychosocial impacts (e.g. quality of life). Even when considering one type of intervention strategy for subjective tinnitus, there is no agreement about what is critically important for deciding whether a treatment is effective. The main purpose of this observational study is, therefore to, develop Core Outcome Domain Sets for the three different intervention strategies (sound, psychological, and pharmacological) for adults with chronic subjective tinnitus that should be measured and reported in every clinical trial of these interventions. Secondary objectives are to identify the strengths and limitations of our study design for recruiting and reducing attrition of participants, and to explore uptake of the core outcomes. The 'Core Outcome Measures in Tinnitus: International Delphi' (COMIT'ID) study will use a mixed-methods approach that incorporates input from health care users at the pre-Delphi stage, a modified three-round Delphi survey and final consensus meetings (one for each intervention). The meetings will generate recommendations by stakeholder representatives on agreed Core Outcome Domain Sets specific to each intervention. A subsequent step will establish a common cross-cutting Core Outcome Domain Set by identifying the common outcome domains included in all three intervention-specific Core Outcome Domain Sets. To address the secondary objectives, we will gather feedback from participants about their experience of taking part in the Delphi process. We aspire to conduct an observational cohort study to evaluate uptake of the core outcomes in published studies at 7 years following Core Outcome Set publication. The COMIT'ID study aims to develop a Core Outcome Domain Set that is agreed as critically important for deciding whether a treatment for subjective tinnitus is effective. Such a recommendation would help to standardise future clinical trials worldwide and so we will determine if participation increases use of the Core Outcome Set in the long term. This project has been registered (November 2014) in the database of the Core Outcome Measures in Effectiveness Trials (COMET) initiative.

What Is Next for Functional Requirements for Bibliographic Records? A Delphi Study

ERIC Educational Resources Information Center

Zhang, Yin; Salaba, Athena

2009-01-01

This article reports on a Delphi study conducted to determine key issues and challenges facing Functional Requirements for Bibliographic Records (FRBR) research and practice. The Delphi panel consisted of thirty-three experts in the field who participated in a three-round issue-raising and consensus-building process via a Web-based survey…

A Consensus for Classification and Pathologic Reporting of Pseudomyxoma Peritonei and Associated Appendiceal Neoplasia: The Results of the Peritoneal Surface Oncology Group International (PSOGI) Modified Delphi Process.

PubMed

Carr, Norman J; Cecil, Thomas D; Mohamed, Faheez; Sobin, Leslie H; Sugarbaker, Paul H; González-Moreno, Santiago; Taflampas, Panos; Chapman, Sara; Moran, Brendan J

2016-01-01

Pseudomyxoma peritonei (PMP) is a complex disease with unique biological behavior that usually arises from appendiceal mucinous neoplasia. The classification of PMP and its primary appendiceal neoplasia is contentious, and an international modified Delphi consensus process was instigated to address terminology and definitions. A classification of mucinous appendiceal neoplasia was developed, and it was agreed that "mucinous adenocarcinoma" should be reserved for lesions with infiltrative invasion. The term "low-grade appendiceal mucinous neoplasm" was supported and it was agreed that "cystadenoma" should no longer be recommended. A new term of "high-grade appendiceal mucinous neoplasm" was proposed for lesions without infiltrative invasion but with high-grade cytologic atypia. Serrated polyp with or without dysplasia was preferred for tumors with serrated features confined to the mucosa with an intact muscularis mucosae. Consensus was achieved on the pathologic classification of PMP, defined as the intraperitoneal accumulation of mucus due to mucinous neoplasia characterized by the redistribution phenomenon. Three categories of PMP were agreed-low grade, high grade, and high grade with signet ring cells. Acellular mucin should be classified separately. It was agreed that low-grade and high-grade mucinous carcinoma peritonei should be considered synonymous with disseminated peritoneal adenomucinosis and peritoneal mucinous carcinomatosis, respectively. A checklist for the pathologic reporting of PMP and appendiceal mucinous neoplasms was also developed. By adopting the classifications and definitions that were agreed, different centers will be able to use uniform terminology that will allow meaningful comparison of their results.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology

PubMed Central

Boysen-Osborn, Megan; Cooney, Robert; Mitzman, Jennifer; Misra, Asit; Williams, Jennifer; Dulani, Tina; Gottlieb, Michael

2017-01-01

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology. The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy. The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach. The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development. PMID:29282445

Development of an evidence-based protocol for care of pilonidal sinus wounds healing by secondary intent using a modified reactive Delphi procedure. Part one: the literature review*.

PubMed

Harris, Connie L; Holloway, Samantha

2012-04-01

This article is in two parts. The overall aim of this section was to review the literature in relation to pilonidal sinus wounds (PSW) healing by secondary intent for a Master's of Science in Wound Healing and Tissue Repair thesis. The purpose of the literature review was to determine if an evidence-based guideline or consensus document existed for the care of these wounds, and if not, to determine the topics from which to develop items for the first round of a modified reactive Delphi questionnaire. Part two will describe the iterative process, the analysis and the results. The review found no best practice guidelines concerning PSW, and only one clinical pathway. Seventeen areas of interest were identified that may contribute to optimal healing conditions or to delayed healing. These included microbiology of infected PSW, signs and symptoms of localised or deeper (spreading) chronic wound infection, swab for c&s, role of topical antiseptics or antimicrobials, systemic antibiotics, local wound interventions, optimal positioning, wound cleansing, principles of moist wound healing/dressing selection, topical negative pressure (TNP) therapy, peri-wound skin decontamination and depilation, pain control, physical activities, optimal nutrition and patient education. © 2011 The Authors. © 2011 Blackwell Publishing Ltd and Medicalhelplines.com Inc.

Application of the Delphi technique in healthcare maintenance.

PubMed

Njuangang, Stanley; Liyanage, Champika; Akintoye, Akintola

2017-10-09

Purpose The purpose of this paper is to examine the research design, issues and considerations in the application of the Delphi technique to identify, refine and rate the critical success factors and performance measures in maintenance-associated infections. Design/methodology/approach In-depth literature review through the application of open and axial coding were applied to formulate the interview and research questions. These were used to conduct an exploratory case study of two healthcare maintenance managers, randomly selected from two National Health Service Foundation Trusts in England. The results of exploratory case study provided the rationale for the application of the Delphi technique in this research. The different processes in the application of the Delphi technique in healthcare research are examined thoroughly. Findings This research demonstrates the need to apply and integrate different research methods to enhance the validity of the Delphi technique. The rationale for the application of the Delphi technique in this research is because some healthcare maintenance managers lack knowledge about basic infection control (IC) principles to make hospitals safe for patient care. The result of first round of the Delphi exercise is a useful contribution in its own rights. It identified a number of salient issues and differences in the opinions of the Delphi participants, noticeably between healthcare maintenance managers and members of the infection control team. It also resulted in useful suggestions and comments to improve the quality and presentation of the second- and third-round Delphi instruments. Practical implications This research provides a research methodology that can be adopted by researchers investigating new and emerging issues in the healthcare sector. As this research demonstrates, the Delphi technique is relevant in soliciting expert knowledge and opinion to identify performance measures to control maintenance-associated infections in hospitals. The methodology provided here could be applied by other researchers elsewhere to probe, investigate and generate rich information about new and emerging healthcare research topics. Originality/value The authors demonstrate how different research methods can be integrated to enhance the validity of the Delphi technique. For example, the results of an exploratory case study provided the rationale for the application of the Delphi technique investigating the key performance measures in maintenance-associated infections. The different processes involved in the application of the Delphi technique are also carefully explored and discussed in depth.

A Screening Tool to Identify Spasticity in Need of Treatment

PubMed Central

Zorowitz, Richard D.; Wein, Theodore H.; Dunning, Kari; Deltombe, Thierry; Olver, John H.; Davé, Shashank J.; Dimyan, Michael A.; Kelemen, John; Pagan, Fernando L.; Evans, Christopher J.; Gillard, Patrick J.; Kissela, Brett M.

2017-01-01

Objective To develop a clinically useful patient-reported screening tool for health care providers to identify patients with spasticity in need of treatment regardless of etiology. Design Eleven spasticity experts participated in a modified Delphi panel and reviewed and revised 2 iterations of a screening tool designed to identify spasticity symptoms and impact on daily function and sleep. Spasticity expert panelists evaluated items pooled from existing questionnaires to gain consensus on the screening tool content. The study also included cognitive interviews of 20 patients with varying spasticity etiologies to determine if the draft screening tool was understandable and relevant to patients with spasticity. Results The Delphi panel reached an initial consensus on 21 of 47 items for the screening tool and determined that the tool should have no more than 11 to 15 items and a 1-month recall period for symptom and impact items. After 2 rounds of review, 13 items were selected and modified by the expert panelists. Most patients (n = 16 [80%]) completed the cognitive interview and interpreted the items as intended. Conclusions Through the use of a Delphi panel and patient interviews, a 13-item spasticity screening tool was developed that will be practical and easy to use in routine clinical practice. PMID:27552355

A hospital-based child protection programme evaluation instrument: a modified Delphi study.

PubMed

Wilson, Denise; Koziol-McLain, Jane; Garrett, Nick; Sharma, Pritika

2010-08-01

Refine instrument for auditing hospital-based child abuse and neglect violence intervention programmes prior to field-testing. A modified Delphi study to identify and rate items and domains indicative of an effective and quality child abuse and neglect intervention programme. Experts participated in four Delphi rounds: two surveys, a one-day workshop and the opportunity to comment on the penultimate instrument. New Zealand. Twenty-four experts in the field of care and protection of children. Items with panel agreement >or=85% and mean importance rating >or=4.0 (scale from 1 (not important) to 5 (very important)). There was high-level consensus on items across Rounds 1 and 2 (89% and 85%, respectively). In Round 3 an additional domain (safety and security) was agreed upon and cultural issues, alert systems for children at risk, and collaboration among primary care, community, non-government and government agencies were discussed. The final instrument included nine domains ('policies and procedures', 'safety and security', 'collaboration', 'cultural environment', 'training of providers', 'intervention services', 'documentation' 'evaluation' and 'physical environment') and 64 items. The refined instrument represents the hallmarks of an ideal child abuse and neglect programme given current knowledge and experience. The instrument enables rigorous evaluations of hospital-based child abuse and neglect intervention programmes for quality improvement and benchmarking with other programmes.

Guidelines for Graduate Medical Education in Geriatrics.

ERIC Educational Resources Information Center

Robbins, Alan S.; Beck, John C.

1982-01-01

Performance objectives, core content, training experiences, and clinical exposure and program evaluations are described for geriatric fellows and house staff members in internal medicine, family practice, neurology, and psychiatry. A modified Delphi study was used. (Author/MLW)

Derivation of a Performance Checklist for Ultrasound-Guided Arthrocentesis Using the Modified Delphi Method.

PubMed

Kunz, Derek; Pariyadath, Manoj; Wittler, Mary; Askew, Kim; Manthey, David; Hartman, Nicholas

2017-06-01

Arthrocentesis is an important skill for physicians in multiple specialties. Recent studies indicate a superior safety and performance profile for this procedure using ultrasound guidance for needle placement, and improving quality of care requires a valid measurement of competency using this modality. We endeavored to create a validated tool to assess the performance of this procedure using the modified Delphi technique and experts in multiple disciplines across the United States. We derived a 22-item checklist designed to assess competency for the completion of ultrasound-guided arthrocentesis, which demonstrated a Cronbach's alpha of 0.89, indicating an excellent degree of internal consistency. Although we were able to demonstrate content validity for this tool, further validity evidence should be acquired after the tool is used and studied in clinical and simulated contexts. © 2017 by the American Institute of Ultrasound in Medicine.

What should dental services for people with disabilities be like? Results of an Irish Delphi panel survey.

PubMed

Mac Giolla Phadraig, Caoimhin; Nunn, June; Dougall, Alison; O'Neill, Eunan; McLoughlin, Jacinta; Guerin, Suzanne

2014-01-01

This study aimed to generate prioritised goals for oral health services for people with disabilities as a first step in meeting the need for evidence based oral health services for people with disabilities in Ireland. The study used a three round modified e-Delphi method, involving dental service professionals and people with disabilities or their representatives, in Ireland. Three rounds were completed online using SurveyMonkey. Round 1 asked: "List what you think dental services for people with disabilities in Ireland should be like." Items for subsequent rounds were generated from responses to Round 1. Round 2 and Round 3 used 5 point Likert scales to rank these items by priority: from No Priority (1) to Top Priority (5). Consensus was achieved on each item where at least 80% of respondents considered an item either High or Top Priority. A consensus meeting concluded the process. Sixty-one panelists started and 48 completed the survey. The Delphi panel agreed on level of priority for 69 items and generated 16 consensus statements. These statements covered a range of topics such as access to care, availability of information and training, quality of care, dental treatment and cost. A recurrent theme relating to the appropriateness of care to individual need arose across topics suggesting a need to match service delivery according to the individual's needs, wants and expectations rather than the disability type/diagnosis based service which predominates today. This process produced a list of prioritised goals for dental services for people with disabilities. This creates a foundation for building evidence-based service models for people with disabilities in Ireland.

The ICNP-BaT--a multilingual web-based tool to support the collaborative translation of the International Classification for Nursing Practice (ICNP).

PubMed

Schrader, Ulrich; Tackenberg, Peter; Widmer, Rudolf; Portenier, Lucien; König, Peter

2007-01-01

To ease and speed up the translation of the ICNP version 1 into the German language a web service was developed to support the collaborative work of all Austrian, Swiss, and German translators and subsequently of the evaluators of the resultant translation. The web service does help to support a modified Delphi technique. Since the web service is multilingual by design it can facilitate the translation of the ICNP into other languages as well. The process chosen can be adopted by other projects involved in translating terminologies.

Curriculum development for a national cardiotocography education program: a Delphi survey to obtain consensus on learning objectives.

PubMed

Thellesen, Line; Hedegaard, Morten; Bergholt, Thomas; Colov, Nina P; Hoegh, Stinne; Sorensen, Jette L

2015-08-01

To define learning objectives for a national cardiotocography (CTG) education program based on expert consensus. A three-round Delphi survey. One midwife and one obstetrician from each maternity unit in Denmark were appointed based on CTG teaching experience and clinical obstetric experience. Following national and international guidelines, the research group determined six topics as important when using CTG: fetal physiology, equipment, indication, interpretation, clinical management, and communication/responsibility. In the first Delphi round, participants listed one to five learning objectives within the predefined topics. Responses were analyzed by a directed approach to content analysis. Phrasing was modified in accordance with Bloom's taxonomy. In the second and third Delphi rounds, participants rated each objective on a five-point relevance scale. Consensus was predefined as objectives with a mean rating value of ≥ 3. A prioritized list of CTG learning objectives. A total of 42 midwives and obstetricians from 21 maternity units were invited to participate, of whom 26 completed all three Delphi rounds, representing 18 maternity units. The final prioritized list included 40 objectives. The highest ranked objectives emphasized CTG interpretation and clinical management. The lowest ranked objectives emphasized fetal physiology. Mean ratings of relevance ranged from 3.15 to 5.00. National consensus on CTG learning objectives was achieved using the Delphi methodology. This was an initial step in developing a valid CTG education program. A prioritized list of objectives will clarify which topics to emphasize in a CTG education program. © 2015 Nordic Federation of Societies of Obstetrics and Gynecology.

Design and validation of key text messages (Tonsil-Text-To-Me) to improve parent and child perioperative tonsillectomy experience: A modified Delphi study.

PubMed

Song, Jin Soo A; Wozney, Lori; Chorney, Jill; Ishman, Stacey L; Hong, Paul

2017-11-01

Parents can struggle while providing perioperative tonsillectomy care for their children at home. Short message service (SMS) technology is an accessible and direct modality to communicate timely, evidence-based recommendations to parents across the perioperative period. This study focused on validating a SMS protocol, Tonsil-Text-To-Me (TTTM), for parents of children undergoing tonsillectomy. This study used a modified Delphi expert consensus method. Participants were an international sample of 27 clinicians/researchers. Participants rated level of agreement with recommendations across seven perioperative domains, derived systematically from scientific and lay literature. A priori consensus analysis was conducted using threshold criterion. A multidisciplinary team of local clinicians were also individually interviewed to consolidate text messages and implement recurrent suggestions. In the modified Delphi panel, 30 statements reached threshold agreement (>3.0 of 4.0); recommendations surrounding diet (3.87) and hygiene (3.83) had the highest level of consensus, while recommendations regarding activity (3.42) and non-pharmacologic pain management (3.55) had the lowest consensus. The 30 statements reconfigured into 12 concise text messages. After further interviews with local clinicians, 14 final text messages were included in the SMS protocol to be sent two weeks preoperatively to one week postoperatively. This study illustrates the development of TTTM which is designed to deliver key sequential text messages at the optimal time during the perioperative setting to parents caring for their children who are undergoing tonsillectomy. Copyright © 2017 Elsevier B.V. All rights reserved.

Core competencies for emergency medicine clerkships: results of a Canadian consensus initiative.

PubMed

Penciner, Rick; Woods, Robert A; McEwen, Jill; Lee, Richard; Langhan, Trevor; Bandiera, Glen

2013-01-01

There is no consensus on what constitutes the core competencies for emergency medicine (EM) clerkship rotations in Canada. Existing EM curricula have been developed through informal consensus and often focus on EM content to be known at the end of training rather than what is an appropriate focus for a time-limited rotation in EM. We sought to define the core competencies for EM clerkship in Canada through consensus among an expert panel of Canadian EM educators. We used a modified Delphi method and the CanMEDS 2005 Physician Competency Framework to develop a consensus among expert EM educators from across Canada. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). A complete list of competencies is provided. This study established a national consensus defining the core competencies for EM clerkship in Canada.

Development of a list of high-risk operations for patients 65 years and older.

PubMed

Schwarze, Margaret L; Barnato, Amber E; Rathouz, Paul J; Zhao, Qianqian; Neuman, Heather B; Winslow, Emily R; Kennedy, Gregory D; Hu, Yue-Yung; Dodgion, Christopher M; Kwok, Alvin C; Greenberg, Caprice C

2015-04-01

No consensus exists regarding the definition of high-risk surgery in older adults. An inclusive and precise definition of high-risk surgery may be useful for surgeons, patients, researchers, and hospitals. To develop a list of high-risk operations. Retrospective cohort study and modified Delphi procedure. The setting included all Pennsylvania acute care hospitals (Pennsylvania Health Care Cost Containment Council [PHC4] April 1, 2001, to December 31, 2007) and a nationally representative sample of US acute care hospitals (Nationwide Inpatient Sample [NIS], Healthcare Cost and Utilization Project, Agency for Healthcare Research and Quality January 1, 2001, to December 31, 2006). Patients included were those 65 years and older admitted to PHC4 hospitals and those 18 years and older admitted to NIS hospitals. We identified International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) procedure codes associated with at least 1% inpatient mortality in the PHC4. We used a modified Delphi procedure with 5 board-certified surgeons to further refine this list by excluding nonoperative procedures and operations that were unlikely to be the proximate cause of mortality and were instead a marker of critical illness (eg, tracheostomy). We then cross-validated this list of ICD-9-CM codes in the NIS. Modified Delphi procedure consensus of at least 4 of 5 panelists and proportion agreement in the NIS. Among 4,739,522 admissions of patients 65 years and older in the PHC4, a total of 2,569,589 involved a procedure, encompassing 2853 unique procedures. Of 1130 procedures associated with a crude inpatient mortality of at least 1%, 264 achieved consensus as high-risk operations by the modified Delphi procedure. The observed inpatient mortality in the NIS was at least 1% for 227 of 264 procedures (86%) in patients 65 years and older. The pooled inpatient mortality for these identified high-risk procedures performed on patients 65 years and older was double the pooled inpatient mortality for correspondingly identified high-risk operations for patients younger than 65 years (6% vs 3%). We developed a list of procedure codes to identify high-risk surgical procedures in claims data. This list of high-risk operations can be used to standardize the definition of high-risk surgery in quality and outcomes-based studies and to design targeted clinical interventions.

Exploring areas of consensus and conflict around values underpinning public involvement in health and social care research: a modified Delphi study

PubMed Central

Snape, D; Kirkham, J; Preston, J; Popay, J; Britten, N; Collins, M; Froggatt, K; Gibson, A; Lobban, F; Wyatt, K; Jacoby, A

2014-01-01

Objective There is growing interest in the potential benefits of public involvement (PI) in health and social care research. However, there has been little examination of values underpinning PI or how these values might differ for different groups with an interest in PI in the research process. We aimed to explore areas of consensus and conflict around normative, substantive and process-related values underpinning PI. Design Mixed method, three-phase, modified Delphi study, conducted as part of a larger multiphase project. Setting The UK health and social care research community. Participants Stakeholders in PI in research, defined as: clinical and non-clinical academics, members of the public, research managers, commissioners and funders; identified via research networks, online searches and a literature review. Results We identified high levels of consensus for many normative, substantive and process-related issues. However, there were also areas of conflict in relation to issues of bias and representativeness, and around whether the purpose of PI in health and social care research is to bring about service change or generate new knowledge. There were large differences by group in the percentages endorsing the ethical justification for PI and the argument that PI equalises power imbalances. With regard to practical implementation of PI, research support infrastructures were reported as lacking. Participants reported shortcomings in the uptake and practice of PI. Embedding PI practice and evaluation in research study designs was seen as fundamental to strengthening the evidence base. Conclusions Our findings highlight the extent to which PI is already embedded in research. However, they also highlight a need for ‘best practice’ standards to assist research teams to understand, implement and evaluate PI. These findings have been used in developing a Public Involvement Impact Assessment Framework (PiiAF), which offers guidance to researchers and members of the public involved in the PI process. PMID:24413356

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol.

PubMed

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-02-10

Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues-including conceptualisation, measurement and data analysis-that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Towards an Understanding of Instructional Design Heuristics: An Exploratory Delphi Study

ERIC Educational Resources Information Center

York, Cindy S.; Ertmer, Peggy A.

2011-01-01

Evidence suggests that experienced instructional designers often use heuristics and adapted models when engaged in the instructional design problem-solving process. This study used the Delphi technique to identify a core set of heuristics designers reported as being important to the success of the design process. The overarching purpose of the…

Determining e-Portfolio Elements in Learning Process Using Fuzzy Delphi Analysis

ERIC Educational Resources Information Center

Mohamad, Syamsul Nor Azlan; Embi, Mohamad Amin; Nordin, Norazah

2015-01-01

The present article introduces the Fuzzy Delphi method results obtained in the study on determining e-Portfolio elements in learning process for art and design context. This method bases on qualified experts that assure the validity of the collected information. In particular, the confirmation of elements is based on experts' opinion and…

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study.

PubMed

Sivell, Stephanie; Lidstone, Victoria; Taubert, Mark; Thompson, Catherine; Nelson, Annmarie

2015-09-01

To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions. A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3. In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics. Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

A medical school's organizational readiness for curriculum change (MORC): development and validation of a questionnaire.

PubMed

Jippes, Mariëlle; Driessen, Erik W; Broers, Nick J; Majoor, Gerard D; Gijselaers, Wim H; van der Vleuten, Cees P M

2013-09-01

Because successful change implementation depends on organizational readiness for change, the authors developed and assessed the validity of a questionnaire, based on a theoretical model of organizational readiness for change, designed to measure, specifically, a medical school's organizational readiness for curriculum change (MORC). In 2012, a panel of medical education experts judged and adapted a preliminary MORC questionnaire through a modified Delphi procedure. The authors administered the resulting questionnaire to medical school faculty involved in curriculum change and tested the psychometric properties using exploratory and confirmatory factor analysis, and generalizability analysis. The mean relevance score of the Delphi panel (n = 19) reached 4.2 on a five-point Likert-type scale (1 = not relevant and 5 = highly relevant) in the second round, meeting predefined criteria for completing the Delphi procedure. Faculty (n = 991) from 131 medical schools in 56 countries completed MORC. Exploratory factor analysis yielded three underlying factors-motivation, capability, and external pressure-in 12 subscales with 53 items. The scale structure suggested by exploratory factor analysis was confirmed by confirmatory factor analysis. Cronbach alpha ranged from 0.67 to 0.92 for the subscales. Generalizability analysis showed that the MORC results of 5 to 16 faculty members can reliably evaluate a school's organizational readiness for change. MORC is a valid, reliable questionnaire for measuring organizational readiness for curriculum change in medical schools. It can identify which elements in a change process require special attention so as to increase the chance of successful implementation.

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

The process of collecting and evaluating evidences for the development of Guidelines for the management of rheumatoid arthritis, Japan College of Rheumatology 2014: Utilization of GRADE approach.

PubMed

Kojima, Masayo; Nakayama, Takeo; Kawahito, Yutaka; Kaneko, Yuko; Kishimoto, Mitsumasa; Hirata, Shintaro; Seto, Yohei; Endo, Hirahito; Ito, Hiromu; Kojima, Toshihisa; Nishida, Keiichiro; Matsushita, Isao; Tsutani, Kiichiro; Igarashi, Ataru; Kamatani, Naoyuki; Hasegawa, Mieko; Miyasaka, Nobuyuki; Yamanaka, Hisashi

2016-01-01

To describe the process of collecting and evaluating evidence for treating rheumatoid arthritis (RA) for developing clinical practice guidelines (CPGs) for rheumatologists in Japan. The task force comprised rheumatologists, epidemiologists, health economists, and patients. First, the critical outcomes were determined according to a three-round Delphi method, and eight topics with 88 clinical questions (CQs) were formulated. A systematic review of CQs was conducted using the Cochran Database of Systematic Reviews, MEDLINE, and Japana Centra Revvo Medicina (2003-2012). A questionnaire survey and focus group interview were performed to capture the patients' values and preferences. Data from the National Health Insurance drug price list and product information provided by pharmaceutical companies were collected to evaluate drug cost and safety. The GRADE approach was used to describe the evidence quality and determine the strength of recommendations. Recommendations were developed using a modified Delphi method by a multidisciplinary panel including patients. Eight meetings and frequent e-mail communications were conducted to draft a quality assessment of evidence and recommendations. For 88 CQs, recommendation statements were determined. Using the GRADE approach, new CPGs successfully addressed important clinical issues for treating RA patients. Timely updating of recommendations should be routinely considered.

A proposed adaptation of the European Foundation for Quality Management Excellence Model to physical activity programmes for the elderly - development of a quality self-assessment tool using a modified Delphi process

PubMed Central

2011-01-01

Background There has been a growing concern in designing physical activity (PA) programmes for elderly people, since evidence suggests that such health promotion interventions may reduce the deleterious effects of the ageing process. Complete programme evaluations are a necessary prerequisite to continuous quality improvements. Being able to refine, adapt and create tools that are suited to the realities and contexts of PA programmes for the elderly in order to support its continuous improvement is, therefore, crucial. Thus, the aim of this study was to develop a self-assessment tool for PA programmes for the elderly. Methods A 3-round Delphi process was conducted via the Internet with 43 national experts in PA for the elderly, management and delivery of PA programmes for the elderly, sports management, quality management and gerontology, asking experts to identify the propositions that they considered relevant for inclusion in the self-assessment tool. Experts reviewed a list of proposed statements, based on the criteria and sub-criteria from the European Foundation for Quality Management Excellence Model (EFQM) and PA guidelines for older adults and rated each proposition from 1 to 8 (disagree to agree) and modified and/or added propositions. Propositions receiving either bottom or top scores of greater than 70% were considered to have achieved consensus to drop or retain, respectively. Results In round 1, of the 196 originally-proposed statements (best practice principles), the experts modified 41, added 1 and achieved consensus on 93. In round 2, a total of 104 propositions were presented, of which experts modified 39 and achieved consensus on 53. In the last round, of 51 proposed statements, the experts achieved consensus on 19. After 3 rounds of rating, experts had not achieved consensus on 32 propositions. The resulting tool consisted of 165 statements that assess nine management areas involved in the development of PA programmes for the elderly. Conclusion Based on experts' opinions, a self-assessment tool was found in order to access quality of PA programmes for the elderly. Information obtained with evaluations would be useful to organizations seeking to improve their services, customer satisfaction and, consequently, adherence to PA programmes, targeting the ageing population. PMID:21958203

Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement

ERIC Educational Resources Information Center

Hatcher, Tim; Colton, Sharon

2007-01-01

Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an…

Entry-to-practice public health nursing competencies: A Delphi method and knowledge translation strategy.

PubMed

Schofield, Ruth; Chircop, Andrea; Baker, Cynthia; Dietrich Leurer, Marie; Duncan, Susan; Wotton, Donalda

2018-06-01

Sustaining and strengthening nurses 'contributions to public and population health in the 21st century depends in part on nursing education. Clearly articulated entry-to-practice competencies will contribute to the capacity of undergraduate nursing education programs to prepare graduates to promote local, national and global population health. The Canadian Association of Schools of Nursing created the Public Health Task Force to develop consensus on core, national entry-to-practice competencies in public health nursing for undergraduate nursing students and to support these competencies with corresponding online teaching strategies. Delphi approach. Nurses with public health experience in education and practice, and representatives from other public health professional organizations across Canada. The three-phased competency development included: 1) an environmental scan; 2) an iterative process to draft competencies; and 3) a modified Delphi process to confirm the final competency framework using face to face consultations and a survey. The knowledge translation strategy involved soliciting submissions of teaching strategies for peer-review and subsequent inclusion in an interactive online resource. 242 public health educators and practitioners participated in the consensus consultation. The final document outlined five competency statements with 19 accompanying indicators. A total of 123 teaching strategies were submitted for the online resource, of which 50 were accepted as exemplary teaching strategies. This competency development process can provide guidance for the development of competencies in other countries, thus strengthening public health nursing education globally. The decision to intentionally level the competencies to entry-to-practice, as opposed to an advanced level, enhanced their application to undergraduate nursing education. The development of the additional inventory of teaching strategies created a sustainable innovative resource for public health nursing educators and practitioners world-wide to support the adoption of entry-to-practice public health nursing competencies. Crown Copyright © 2018. Published by Elsevier Ltd. All rights reserved.

Procedure competencies and job functions of the urologic advanced practice nurse.

PubMed

Kleier, Jo Ann

2009-01-01

A 2-round modified Delphi study recruited a panel urologic advanced practice nurse experts to identify the procedure competencies and job functions unique to the role of the advanced practice nurse specializing in the care of urology patients.

Creating Entrustable Professional Activities to Assess Internal Medicine Residents in Training: A Mixed-Methods Approach.

PubMed

Taylor, David R; Park, Yoon Soo; Smith, Christopher A; Karpinski, Jolanta; Coke, William; Tekian, Ara

2018-05-15

Competency-based medical education has not advanced residency training as much as many observers expected. Some medical educators now advocate reorienting competency-based approaches to focus on a resident's ability to do authentic clinical work. To develop descriptions of clinical work for which internal medicine residents must gain proficiency to deliver meaningful patient care (for example, "Admit and manage a medical inpatient with a new acute problem"). A modified Delphi process involving clinical experts followed by a conference of educational experts. The Royal College of Physicians and Surgeons of Canada. In phase 1 of the project, members of the Specialty Committee for Internal Medicine participated in a modified Delphi process to identify activities in internal medicine that represent the scope of the specialty. In phase 2 of the project, 5 experts who were scholars and leaders in competency-based medical education reviewed the results. Phase 1 identified important activities, revised descriptions to improve accuracy and avoid overlap, and assigned activities to stages of training. Phase 2 compared proposed activity descriptions with published guidelines for their development and application in medical education. The project identified 29 activities that qualify as entrustable professional activities. The project also produced a detailed description of each activity and guidelines for using them to assess residents. These activities reflect the practice patterns of the developers and may not fully represent internal medicine practice in Canada. Identification of these activities is expected to facilitate modification of training and assessment programs for medical residents so that programs focus less on isolated skills and more on integrated tasks. Southeastern Ontario Academic Medical Organization Endowed Scholarship and Education Fund and Queen's University Department of Medicine Innovation Fund.

Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology.

PubMed

Eubank, Breda H; Mohtadi, Nicholas G; Lafave, Mark R; Wiley, J Preston; Bois, Aaron J; Boorman, Richard S; Sheps, David M

2016-05-20

Patients presenting to the healthcare system with rotator cuff pathology do not always receive high quality care. High quality care occurs when a patient receives care that is accessible, appropriate, acceptable, effective, efficient, and safe. The aim of this study was twofold: 1) to develop a clinical pathway algorithm that sets forth a stepwise process for making decisions about the diagnosis and treatment of rotator cuff pathology presenting to primary, secondary, and tertiary healthcare settings; and 2) to establish clinical practice guidelines for the diagnosis and treatment of rotator cuff pathology to inform decision-making processes within the algorithm. A three-step modified Delphi method was used to establish consensus. Fourteen experts representing athletic therapy, physiotherapy, sport medicine, and orthopaedic surgery were invited to participate as the expert panel. In round 1, 123 best practice statements were distributed to the panel. Panel members were asked to mark "agree" or "disagree" beside each statement, and provide comments. The same voting method was again used for round 2. Round 3 consisted of a final face-to-face meeting. In round 1, statements were grouped and reduced to 44 statements that met consensus. In round 2, five statements reached consensus. In round 3, ten statements reached consensus. Consensus was reached for 59 statements representing five domains: screening, diagnosis, physical examination, investigations, and treatment. The final face-to-face meeting was also used to develop clinical pathway algorithms (i.e., clinical care pathways) for three types of rotator cuff pathology: acute, chronic, and acute-on-chronic. This consensus guideline will help to standardize care, provide guidance on the diagnosis and treatment of rotator cuff pathology, and assist in clinical decision-making for all healthcare professionals.

Ascertaining top evidence in emergency medicine: A modified Delphi study.

PubMed

Bazak, Stephanie J; Sherbino, Jonathan; Upadhye, Suneel; Chan, Teresa

2018-06-21

CLINICIAN'S CAPSULE What is known about the topic? EM is a specialty with a broad knowledge base making it daunting for a junior resident to know where to begin the acquisition of evidence-based knowledge. What did the study ask? What list of "top papers" was formulated in the field of EM using a national Canadian Delphi approach to achieve an expert consensus? What did the study find? A list was produced of top studies relevant for Canadian EM physicians in training. Why does this study matter to clinicians? The list produced can be used as an educational resource for junior residents.

Planning the content of a brief educational course in maxillofacial emergencies for staff in accident and emergency departments: a modified Delphi study.

PubMed

Elledge, Ross O C; McAleer, Sean

2015-02-01

It is well known that staff in accident and emergency (A&E) departments lack the knowledge and confidence needed to deal with maxillofacial emergencies, and that it is related to limited education at undergraduate and postgraduate levels. We therefore aimed to design a syllabus for a short course to educate staff about the most common emergencies. To find out which learning outcomes should be included and to reach a consensus, we did a 3-stage modified Delphi study of the opinions of members of the British Association of Oral and Maxillofacial Surgeons (BAOMS). Of a possible 890 members, 188 responded (21%) in the second round and 105 in the third (12%). Eighteen (37%) of the 49 proposed learning outcomes were rated very important and all of them were retained in the syllabus after the third round. Thirty (61%) items were retained with a consensus of 51% or above in the final round. The Delphi technique is a useful addition to the armamentarium of those involved in education, and has been used effectively in syllabus design. We achieved good consensus on the items to be included and the syllabus will be piloted locally. Copyright © 2014 The British Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Competency standards for newly graduated prosthetist/orthotists in Sweden.

PubMed

Ramstrand, Nerrolyn; Ramstrand, Simon

2018-05-01

There are currently no national competency standards upon which to develop educational objectives for prosthetist/orthotists in Sweden. While standards have been developed in other countries, they cannot be applied without confirming their relevance in a Swedish context. To describe and obtain consensus on core competencies required for newly graduated prosthetist/orthotists in Sweden. Modified Delphi process. A modified Delphi technique was carried out. Focus groups were initially used to identify core competency domains. Two consecutive questionnaires, containing a list of potential competency items, were sent to a group of stakeholders with ties to the prosthetic and orthotic profession. Stakeholders were requested to rate their level of agreement with each competency item and provide written comments. Finally, two focus groups were conducted to obtain feedback on the draft competency standards. Forty-four competency items, listed under five key domains of practice, were identified as essential for newly graduated prosthetist/orthotists in Sweden. Many similarities exist in core competency descriptions for prosthetist/orthotists in Sweden when compared to other countries. Regional differences do however exist, and it is important to confirm the relevance of core competency items at a national level before they are applied. Clinical relevance Competency standards developed in this study can be used to guide development of learning objectives within an undergraduate prosthetic and orthotic program, provide a framework for workforce development, assist professional organizations in understanding the needs of their members, and prepare for international accreditation.

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study.

PubMed

Blackwood, Bronagh; Ringrow, Suzanne; Clarke, Mike; Marshall, John; Rose, Louise; Williamson, Paula; McAuley, Danny

2015-08-20

Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children. We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes. The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

Physical Restraints: Consensus of a Research Definition Using a Modified Delphi Technique.

PubMed

Bleijlevens, Michel H C; Wagner, Laura M; Capezuti, Elizabeth; Hamers, Jan P H

2016-11-01

To develop an internationally accepted research definition of physical restraint. Comprehensive literature search followed by a web-based, three-round, modified Delphi technique comprising reviews and feedback. Clinical care settings. An international group of 48 experts consisting of researchers and clinicians from 14 countries who have made sustained contribution to research and clinical application in the field of physical restraint in clinical care. Data were collected using an online survey program and one in-person meeting. Results of the online survey and the in-person meeting were used for distribution in subsequent rounds until consensus on a definition was reached. Consensus was defined as 90% of the participating experts agreeing with the proposed definition of physical restraint. Thirty-four different definitions were identified during the literature search and served as a starting point for the modified Delphi technique. After three rounds, 45 (95.7%) of 47 remaining experts agreed with the newly proposed definition: "Physical restraint is defined as any action or procedure that prevents a person's free body movement to a position of choice and/or normal access to his/her body by the use of any method, attached or adjacent to a person's body that he/she cannot control or remove easily." A multidisciplinary, internationally representative panel of experts reached consensus on a research definition for physical restraints in older persons. This is a necessary step toward improved comparisons of the prevalence of physical restraint use across studies and countries. This definition can further guide research interventions aimed at reducing use of physical restraints. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

Identification of features of electronic prescribing systems to support quality and safety in primary care using a modified Delphi process.

PubMed

Sweidan, Michelle; Williamson, Margaret; Reeve, James F; Harvey, Ken; O'Neill, Jennifer A; Schattner, Peter; Snowdon, Teri

2010-04-15

Electronic prescribing is increasingly being used in primary care and in hospitals. Studies on the effects of e-prescribing systems have found evidence for both benefit and harm. The aim of this study was to identify features of e-prescribing software systems that support patient safety and quality of care and that are useful to the clinician and the patient, with a focus on improving the quality use of medicines. Software features were identified by a literature review, key informants and an expert group. A modified Delphi process was used with a 12-member multidisciplinary expert group to reach consensus on the expected impact of the features in four domains: patient safety, quality of care, usefulness to the clinician and usefulness to the patient. The setting was electronic prescribing in general practice in Australia. A list of 114 software features was developed. Most of the features relate to the recording and use of patient data, the medication selection process, prescribing decision support, monitoring drug therapy and clinical reports. The expert group rated 78 of the features (68%) as likely to have a high positive impact in at least one domain, 36 features (32%) as medium impact, and none as low or negative impact. Twenty seven features were rated as high positive impact across 3 or 4 domains including patient safety and quality of care. Ten features were considered "aspirational" because of a lack of agreed standards and/or suitable knowledge bases. This study defines features of e-prescribing software systems that are expected to support safety and quality, especially in relation to prescribing and use of medicines in general practice. The features could be used to develop software standards, and could be adapted if necessary for use in other settings and countries.

Identification of features of electronic prescribing systems to support quality and safety in primary care using a modified Delphi process

PubMed Central

2010-01-01

Background Electronic prescribing is increasingly being used in primary care and in hospitals. Studies on the effects of e-prescribing systems have found evidence for both benefit and harm. The aim of this study was to identify features of e-prescribing software systems that support patient safety and quality of care and that are useful to the clinician and the patient, with a focus on improving the quality use of medicines. Methods Software features were identified by a literature review, key informants and an expert group. A modified Delphi process was used with a 12-member multidisciplinary expert group to reach consensus on the expected impact of the features in four domains: patient safety, quality of care, usefulness to the clinician and usefulness to the patient. The setting was electronic prescribing in general practice in Australia. Results A list of 114 software features was developed. Most of the features relate to the recording and use of patient data, the medication selection process, prescribing decision support, monitoring drug therapy and clinical reports. The expert group rated 78 of the features (68%) as likely to have a high positive impact in at least one domain, 36 features (32%) as medium impact, and none as low or negative impact. Twenty seven features were rated as high positive impact across 3 or 4 domains including patient safety and quality of care. Ten features were considered "aspirational" because of a lack of agreed standards and/or suitable knowledge bases. Conclusions This study defines features of e-prescribing software systems that are expected to support safety and quality, especially in relation to prescribing and use of medicines in general practice. The features could be used to develop software standards, and could be adapted if necessary for use in other settings and countries. PMID:20398294

A modified Delphi translation strategy and challenges of International Classification for Nursing Practice (ICNP®).

PubMed

Hou, I-Ching; Chang, Polun; Chan, Hui-Ya; Dykes, Patricia C

2013-05-01

Standardized terminology is an important infrastructure component of the electronic health record. ICNP(®) is a systemic coding system that can support the development of nursing information systems. Translation of the standardized terminology preferred terms into local terms is an important first step in the translation process. The purpose of this case report is to describe the translation strategy used and challenges faced in translating ICNP(®) Version 2 preferred terms from English to traditional Chinese. A modified Delphi strategy using forward translation and expert consensus was conducted to facilitate semantic and cultural translation and validation of the ICNP(®) and to make the process generalizable. A nursing informatics expert completed the initial forward translation. Five nursing experts with rich clinical and academic experiences joined this process and validated the initial translation. The nursing experts' consensus was then used to finalize the traditional Chinese terms. A total of 1863 preferred terms from the ICNP(®) Version 2 were translated from English into traditional Chinese. Majority agreement from two or more nursing experts was achieved for 98.3% (n=1832) of the preferred term translations. Less than 2% (n=31) of terms had no majority agreement. Translation challenges include the following: (1) changes in code structure of preferred terms from the ICNP(®) β2 version to Verson 2, (2) inability to identify resources to complete the translation that fully met ICNP recommendations for terminology translators, (3) ambiguous preferred term descriptions, and (4) ambiguous preferred term names. Most of the ICNP(®) Version 2 preferred terms were translated from English into traditional Chinese with majority consensus. For the terms without consensus, we recommend that all synonyms be included in the ICNP(®) translation. In countries like Taiwan where nursing education occurs in English, it is recommended that English terms are displayed along with the translated official language to help nurses to interpret and use the terminology correctly. Crown Copyright © 2012. Published by Elsevier Ireland Ltd. All rights reserved.

Developing a primary care patient measure of safety (PC PMOS): a modified Delphi process and face validity testing.

PubMed

Hernan, Andrea L; Giles, Sally J; O'Hara, Jane K; Fuller, Jeffrey; Johnson, Julie K; Dunbar, James A

2016-04-01

Patients are a valuable source of information about ways to prevent harm in primary care and are in a unique position to provide feedback about the factors that contribute to safety incidents. Unlike in the hospital setting, there are currently no tools that allow the systematic capture of this information from patients. The aim of this study was to develop a quantitative primary care patient measure of safety (PC PMOS). A two-stage approach was undertaken to develop questionnaire domains and items. Stage 1 involved a modified Delphi process. An expert panel reached consensus on domains and items based on three sources of information (validated hospital PMOS, previous research conducted by our study team and literature on threats to patient safety). Stage 2 involved testing the face validity of the questionnaire developed during stage 1 with patients and primary care staff using the 'think aloud' method. Following this process, the questionnaire was revised accordingly. The PC PMOS was received positively by both patients and staff during face validity testing. Barriers to completion included the length, relevance and clarity of questions. The final PC PMOS consisted of 50 items across 15 domains. The contributory factors to safety incidents centred on communication, access to care, patient-related factors, organisation and care planning, task performance and information flow. This is the first tool specifically designed for primary care settings, which allows patients to provide feedback about factors contributing to potential safety incidents. The PC PMOS provides a way for primary care organisations to learn about safety from the patient perspective and make service improvements with the aim of reducing harm in this setting. Future research will explore the reliability and construct validity of the PC PMOS. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Constructing post-surgical discharge instructions through a Delphi consensus methodology.

PubMed

Scott, Aaron R; Sanderson, Cody J; Rush, Augustus J; Alore, Elizabeth A; Naik, Aanand D; Berger, David H; Suliburk, James W

2018-05-01

Patient education materials are a crucial part of physician-patient communication. We hypothesize that available discharge instructions are difficult to read and fail to address necessary topics. Our objective is to evaluate readability and content of surgical discharge instructions using thyroidectomy to develop standardized discharge materials. Thyroidectomy discharge materials were analyzed for readability and assessed for content. Fifteen endocrine surgeons participated in a modified Delphi consensus panel to select necessary topics. Using readability best practices, we created standardized discharge instructions which included all selected topics. The panel evaluated 40 topics, selected 23, deemed 4 inappropriate, consolidated 5, and did not reach consensus on 8 topics after 4 rounds. The evaluated instructions' reading levels ranged from grade 6.5 to 13.2; none contained all consensus topics. Current post surgical thyroidectomy discharge instructions are more difficult to read than recommended by literacy standards and omit consensus warning signs of major complications. Our easy-to-read discharge instructions cover pertinent topics and may enhance patient education. Delphi methodology is useful for developing post-surgical instructions. Patient education materials need appropriate readability levels and content. We recommend the Delphi method to select content using consensus expert opinion whenever higher level data is lacking. Copyright © 2017 Elsevier B.V. All rights reserved.

Delphi Method Validation of a Procedural Performance Checklist for Insertion of an Ultrasound-Guided Internal Jugular Central Line.

PubMed

Hartman, Nicholas; Wittler, Mary; Askew, Kim; Manthey, David

2016-01-01

Placement of ultrasound-guided central lines is a critical skill for physicians in several specialties. Improving the quality of care delivered surrounding this procedure demands rigorous measurement of competency, and validated tools to assess performance are essential. Using the iterative, modified Delphi technique and experts in multiple disciplines across the United States, the study team created a 30-item checklist designed to assess competency in the placement of ultrasound-guided internal jugular central lines. Cronbach α was .94, indicating an excellent degree of internal consistency. Further validation of this checklist will require its implementation in simulated and clinical environments. © The Author(s) 2014.

Search for one large extra dimension with the DELPHI detector at LEP

NASA Astrophysics Data System (ADS)

Abdallah, J.; Abreu, P.; Adam, W.; Adzic, P.; Albrecht, T.; Alemany-Fernandez, R.; Allmendinger, T.; Allport, P. P.; Amaldi, U.; Amapane, N.; Amato, S.; Anashkin, E.; Andreazza, A.; Andringa, S.; Anjos, N.; Antilogus, P.; Apel, W.-D.; Arnoud, Y.; Ask, S.; Asman, B.; Augustin, J. E.; Augustinus, A.; Baillon, P.; Ballestrero, A.; Bambade, P.; Barbier, R.; Bardin, D.; Barker, G. J.; Baroncelli, A.; Battaglia, M.; Baubillier, M.; Becks, K.-H.; Begalli, M.; Behrmann, A.; Ben-Haim, E.; Benekos, N.; Benvenuti, A.; Berat, C.; Berggren, M.; Bertrand, D.; Besancon, M.; Besson, N.; Bloch, D.; Blom, M.; Bluj, M.; Bonesini, M.; Boonekamp, M.; Booth, P. S. L.; Borisov, G.; Botner, O.; Bouquet, B.; Bowcock, T. J. V.; Boyko, I.; Bracko, M.; Brenner, R.; Brodet, E.; Bruckman, P.; Brunet, J. M.; Buschbeck, B.; Buschmann, P.; Calvi, M.; Camporesi, T.; Canale, V.; Carena, F.; Castro, N.; Cavallo, F.; Chapkin, M.; Charpentier, Ph.; Checchia, P.; Chierici, R.; Chliapnikov, P.; Chudoba, J.; Chung, S. U.; Cieslik, K.; Collins, P.; Contri, R.; Cosme, G.; Cossutti, F.; Costa, M. J.; Crennell, D.; Cuevas, J.; D'Hondt, J.; da Silva, T.; da Silva, W.; Della Ricca, G.; de Angelis, A.; de Boer, W.; de Clercq, C.; de Lotto, B.; de Maria, N.; de Min, A.; de Paula, L.; di Ciaccio, L.; di Simone, A.; Doroba, K.; Drees, J.; Eigen, G.; Ekelof, T.; Ellert, M.; Elsing, M.; Espirito Santo, M. C.; Fanourakis, G.; Fassouliotis, D.; Feindt, M.; Fernandez, J.; Ferrer, A.; Ferro, F.; Flagmeyer, U.; Foeth, H.; Fokitis, E.; Fulda-Quenzer, F.; Fuster, J.; Gandelman, M.; Garcia, C.; Gavillet, Ph.; Gazis, E.; Gokieli, R.; Golob, B.; Gomez-Ceballos, G.; Goncalves, P.; Graziani, E.; Grosdidier, G.; Grzelak, K.; Guy, J.; Haag, C.; Hallgren, A.; Hamacher, K.; Hamilton, K.; Haug, S.; Hauler, F.; Hedberg, V.; Hennecke, M.; Hoffman, J.; Holmgren, S.-O.; Holt, P. J.; Houlden, M. A.; Jackson, J. N.; Jarlskog, G.; Jarry, P.; Jeans, D.; Johansson, E. K.; Jonsson, P.; Joram, C.; Jungermann, L.; Kapusta, F.; Katsanevas, S.; Katsoufis, E.; Kernel, G.; Kersevan, B. P.; Kerzel, U.; King, B. T.; Kjaer, N. J.; Kluit, P.; Kokkinias, P.; Kourkoumelis, C.; Kouznetsov, O.; Krumstein, Z.; Kucharczyk, M.; Lamsa, J.; Leder, G.; Ledroit, F.; Leinonen, L.; Leitner, R.; Lemonne, J.; Lepeltier, V.; Lesiak, T.; Liebig, W.; Liko, D.; Lipniacka, A.; Lopes, J. H.; Lopez, J. M.; Loukas, D.; Lutz, P.; Lyons, L.; MacNaughton, J.; Malek, A.; Maltezos, S.; Mandl, F.; Marco, J.; Marco, R.; Marechal, B.; Margoni, M.; Marin, J.-C.; Mariotti, C.; Markou, A.; Martinez-Rivero, C.; Masik, J.; Mastroyiannopoulos, N.; Matorras, F.; Matteuzzi, C.; Mazzucato, F.; Mazzucato, M.; McNulty, R.; Meroni, C.; Migliore, E.; Mitaroff, W.; Mjoernmark, U.; Moa, T.; Moch, M.; Moenig, K.; Monge, R.; Montenegro, J.; Moraes, D.; Moreno, S.; Morettini, P.; Mueller, U.; Muenich, K.; Mulders, M.; Mundim, L.; Murray, W.; Muryn, B.; Myatt, G.; Myklebust, T.; Nassiakou, M.; Navarria, F.; Nawrocki, K.; Nemecek, S.; Nicolaidou, R.; Nikolenko, M.; Oblakowska-Mucha, A.; Obraztsov, V.; Olshevski, A.; Onofre, A.; Orava, R.; Osterberg, K.; Ouraou, A.; Oyanguren, A.; Paganoni, M.; Paiano, S.; Palacios, J. P.; Palka, H.; Papadopoulou, Th. D.; Pape, L.; Parkes, C.; Parodi, F.; Parzefall, U.; Passeri, A.; Passon, O.; Peralta, L.; Perepelitsa, V.; Perrotta, A.; Petrolini, A.; Piedra, J.; Pieri, L.; Pierre, F.; Pimenta, M.; Piotto, E.; Podobnik, T.; Poireau, V.; Pol, M. E.; Polok, G.; Pozdniakov, V.; Pukhaeva, N.; Pullia, A.; Radojicic, D.; Rebecchi, P.; Rehn, J.; Reid, D.; Reinhardt, R.; Renton, P.; Richard, F.; Ridky, J.; Rivero, M.; Rodriguez, D.; Romero, A.; Ronchese, P.; Roudeau, P.; Rovelli, T.; Ruhlmann-Kleider, V.; Ryabtchikov, D.; Sadovsky, A.; Salmi, L.; Salt, J.; Sander, C.; Savoy-Navarro, A.; Schwickerath, U.; Sekulin, R.; Siebel, M.; Sisakian, A.; Smadja, G.; Smirnova, O.; Sokolov, A.; Sopczak, A.; Sosnowski, R.; Spassov, T.; Stanitzki, M.; Stocchi, A.; Strauss, J.; Stugu, B.; Szczekowski, M.; Szeptycka, M.; Szumlak, T.; Tabarelli, T.; Tegenfeldt, F.; Timmermans, J.; Tkatchev, L.; Tobin, M.; Todorovova, S.; Tome, B.; Tonazzo, A.; Tortosa, P.; Travnicek, P.; Treille, D.; Tristram, G.; Trochimczuk, M.; Troncon, C.; Turluer, M.-L.; Tyapkin, I. A.; Tyapkin, P.; Tzamarias, S.; Uvarov, V.; Valenti, G.; van Dam, P.; van Eldik, J.; van Remortel, N.; van Vulpen, I.; Vegni, G.; Veloso, F.; Venus, W.; Verdier, P.; Verzi, V.; Vilanova, D.; Vitale, L.; Vrba, V.; Wahlen, H.; Washbrook, A. J.; Weiser, C.; Wicke, D.; Wickens, J.; Wilkinson, G.; Winter, M.; Witek, M.; Yushchenko, O.; Zalewska, A.; Zalewski, P.; Zavrtanik, D.; Zhuravlov, V.; Zimin, N. I.; Zintchenko, A.; Zupan, M.

2009-03-01

Single photons detected by the DELPHI experiment at LEP2 in the years 1997-2000 are reanalysed to investigate the existence of a single extra dimension in a modified ADD scenario with slightly warped large extra dimensions. The data collected at centre-of-mass energies between 180 and 209 GeV for an integrated luminosity of ˜650 pb-1 agree with the predictions of the Standard Model and allow a limit to be set on graviton emission in one large extra dimension. The limit obtained on the fundamental mass scale M D is 1.69 TeV/ c 2 at 95% CL, with an expected limit of 1.71 TeV/ c 2.

Assessing Consensus Between UK Renal Clinicians on Listing for Kidney Transplantation: A Modified Delphi Study.

PubMed

Tonkin-Crine, Sarah; Pruthi, Rishi; Taylor, Dominic M; Leydon, Geraldine M; Calestani, Melania; Oniscu, Gabriel C; Bradley, J Andrew; Tomson, Charles R; Bradley, Clare; Dudley, Christopher; Watson, Christopher J E; Draper, Heather; Johnson, Rachel J; Metcalfe, Wendy; Fogarty, Damian G; Ravanan, Rommel; Roderick, Paul

2018-05-01

It is well recognized that there is significant variation between centers in access to kidney transplantation. In the absence of high-grade evidence, it is unclear whether variation is due to patient case mix, other center factors, or individual clinician decisions. This study sought consensus between UK clinicians on factors that should influence access to kidney transplantation. As part of the Access to Transplantation and Transplant Outcome Measures project, consultant nephrologists and transplant surgeons in 71 centers were invited to participate in a Delphi study involving 2 rounds. During rounds 1 and 2, participants rated their agreement to 29 statements covering 8 topics regarding kidney transplantation. A stakeholder meeting was used to discuss statements of interest after the 2 rounds. In total, 122 nephrologists and 16 transplant surgeons from 45 units participated in rounds 1 and 2. After 2 rounds, 12 of 29 statements reached consensus. Fifty people participated in the stakeholder meeting. After the stakeholder meeting, a further 4 statements reached agreement. Of the 8 topics covered, consensus was reached in 6: use of a transplant protocol, patient age, body mass index, patient compliance with treatment, cardiac workup, and use of multidisciplinary meetings. Consensus was not reached on screening for malignancy and use of peripheral Doppler studies. The Delphi process identified factors upon which clinicians agreed and areas where consensus could not be achieved. The findings should inform national guidelines to support decision making in the absence of high quality evidence and to guide areas that warrant future research.

Consensus in controversy: The modified Delphi method applied to Gynecologic Oncology practice.

PubMed

Cohn, David E; Havrilesky, Laura J; Osann, Kathryn; Lipscomb, Joseph; Hsieh, Susie; Walker, Joan L; Wright, Alexi A; Alvarez, Ronald D; Karlan, Beth Y; Bristow, Robert E; DiSilvestro, Paul A; Wakabayashi, Mark T; Morgan, Robert; Mukamel, Dana B; Wenzel, Lari

2015-09-01

To determine the degree of consensus regarding the probabilities of outcomes associated with IP/IV and IV chemotherapy. A survey was administered to an expert panel using the Delphi method. Ten ovarian cancer experts were asked to estimate outcomes for patients receiving IP/IV or IV chemotherapy. The clinical estimates were: 1) probability of completing six cycles of chemotherapy, 2) probability of surviving five years, 3) median survival, and 4) probability of ER/hospital visits during treatment. Estimates for two patients, one with a low comorbidity index (patient 1) and the other with a moderate index (patient 2), were included. The survey was administered in three rounds, and panelists could revise their subsequent responses based on review of the anonymous opinions of their peers. The ranges were smaller for IV compared with IP/IV therapy. Ranges decreased with each round. Consensus converged around outcomes related to IP/IV chemotherapy for: 1) completion of 6 cycles of therapy (type 1 patient, 62%, type 2 patient, 43%); 2) percentage of patients surviving 5 years (type 1 patient, 66%, type 2 patient, 47%); and 3) median survival (type 1 patient, 83 months, type 2 patient, 58 months). The group required three rounds to achieve consensus on the probabilities of ER/hospital visits (type 1 patient, 24%, type 2 patient, 35%). Initial estimates of survival and adverse events associated with IP/IV chemotherapy differ among experts. The Delphi process works to build consensus and may be a pragmatic tool to inform patients of their expected outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

Assessing Consensus Between UK Renal Clinicians on Listing for Kidney Transplantation: A Modified Delphi Study

PubMed Central

Tonkin-Crine, Sarah; Pruthi, Rishi; Taylor, Dominic M.; Leydon, Geraldine M.; Calestani, Melania; Oniscu, Gabriel C.; Bradley, J. Andrew; Tomson, Charles R.; Bradley, Clare; Dudley, Christopher; Watson, Christopher J.E.; Draper, Heather; Johnson, Rachel J.; Metcalfe, Wendy; Fogarty, Damian G.; Ravanan, Rommel; Roderick, Paul

2018-01-01

Background It is well recognized that there is significant variation between centers in access to kidney transplantation. In the absence of high-grade evidence, it is unclear whether variation is due to patient case mix, other center factors, or individual clinician decisions. This study sought consensus between UK clinicians on factors that should influence access to kidney transplantation. Methods As part of the Access to Transplantation and Transplant Outcome Measures project, consultant nephrologists and transplant surgeons in 71 centers were invited to participate in a Delphi study involving 2 rounds. During rounds 1 and 2, participants rated their agreement to 29 statements covering 8 topics regarding kidney transplantation. A stakeholder meeting was used to discuss statements of interest after the 2 rounds. Results In total, 122 nephrologists and 16 transplant surgeons from 45 units participated in rounds 1 and 2. After 2 rounds, 12 of 29 statements reached consensus. Fifty people participated in the stakeholder meeting. After the stakeholder meeting, a further 4 statements reached agreement. Of the 8 topics covered, consensus was reached in 6: use of a transplant protocol, patient age, body mass index, patient compliance with treatment, cardiac workup, and use of multidisciplinary meetings. Consensus was not reached on screening for malignancy and use of peripheral Doppler studies. Conclusions The Delphi process identified factors upon which clinicians agreed and areas where consensus could not be achieved. The findings should inform national guidelines to support decision making in the absence of high quality evidence and to guide areas that warrant future research. PMID:29796414

Final Report of a Study To Assess the Validity and Reliability of the Standards of Eight Allied Health Professions.

ERIC Educational Resources Information Center

Lyons, Kevin J.; Greening, Shirley; Robeson, Mary

2000-01-01

A modified Delphi procedure assessed the content validity of accreditation standards for cardiovascular technologists, cytotechnologists, medical sonographers, electroneurodiagnostic technologists, medical assistants, perfusionists, physician assistants, and surgical technologists. Although validity and reliability were extremely high, some…

Curated Collections for Educators: Five Key Papers about Residents as Teachers Curriculum Development.

PubMed

Krzyzaniak, Sara M; Cherney, Alan; Messman, Anne; Natesan, Sreeja; Overbeck, Michael; Schnapp, Benjamin; Boysen-Osborn, Megan

2018-02-04

The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to prepare residents to teach and assess medical students and other learners. In order to achieve this, many programs develop formal residents as teachers (RAT) curricula. Medical educators may seek the guidance of previously published literature during the development of RAT programs at their institutions. The authors sought to identify key articles published on the subject of RAT programs over the last 10 years. The authors utilized a formal literature search with the help of a medical librarian and identified additional articles from virtual discussions among the author group and an open call for articles on Twitter using the hashtag #MedEd. Virtual discussions occurred within an online community of practice, the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. The lead author conducted a four-round modified Delphi process among the author group in order to narrow the broad article list to five key articles on RAT programs. The authors summarize each article and provide considerations for junior faculty as well as faculty developers. Curriculum development and program evaluation should utilize established frameworks and evidence-based approaches. The papers identified by this Delphi process will help faculty use best practices when creating or revising new RAT curriculum. In addition, faculty tasked with guiding junior faculty in this process or creating faculty development programs around curriculum development will find these articles to be a great resource for building content.

Curated Collections for Educators: Five Key Papers about Residents as Teachers Curriculum Development

PubMed Central

Cherney, Alan; Messman, Anne; Natesan, Sreeja; Overbeck, Michael; Schnapp, Benjamin; Boysen-Osborn, Megan

2018-01-01

The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to prepare residents to teach and assess medical students and other learners. In order to achieve this, many programs develop formal residents as teachers (RAT) curricula. Medical educators may seek the guidance of previously published literature during the development of RAT programs at their institutions. The authors sought to identify key articles published on the subject of RAT programs over the last 10 years. The authors utilized a formal literature search with the help of a medical librarian and identified additional articles from virtual discussions among the author group and an open call for articles on Twitter using the hashtag #MedEd. Virtual discussions occurred within an online community of practice, the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. The lead author conducted a four-round modified Delphi process among the author group in order to narrow the broad article list to five key articles on RAT programs. The authors summarize each article and provide considerations for junior faculty as well as faculty developers. Curriculum development and program evaluation should utilize established frameworks and evidence-based approaches. The papers identified by this Delphi process will help faculty use best practices when creating or revising new RAT curriculum. In addition, faculty tasked with guiding junior faculty in this process or creating faculty development programs around curriculum development will find these articles to be a great resource for building content. PMID:29637035

Chapter 1. Introduction. Recommendations and standard operating procedures for intensive care unit and hospital preparations for an influenza epidemic or mass disaster.

PubMed

Sprung, Charles L; Cohen, Robert; Adini, Bruria

2010-04-01

In December 2007, the European Society of Intensive Care Medicine established a Task Force to develop standard operating procedures (SOPs) for operating intensive care units (ICU) during an influenza epidemic or mass disaster. To provide direction for health care professionals in the preparation and management of emergency ICU situations during an influenza epidemic or mass disaster, standardize activities, and promote coordination and communication among the medical teams. Based on a literature review and contributions of content experts, a list of essential categories for managing emergency situations in the ICU were identified. Based on three cycles of a modified Delphi process, consensus was achieved regarding the categories. A primary author along with an expert group drafted SOPs for each category. Based on the Delphi cycles, the following key topics were found to be important for emergency preparedness: triage, infrastructure, essential equipment, manpower, protection of staff and patients, medical procedures, hospital policy, coordination and collaboration with interface units, registration and reporting, administrative policies and education. The draft SOPs serve as benchmarks for emergency preparedness and response of ICUs to emergencies or outbreak of pandemics.

Defining a Leader Role curriculum for radiation oncology: A global Delphi consensus study.

PubMed

Turner, Sandra; Seel, Matthew; Trotter, Theresa; Giuliani, Meredith; Benstead, Kim; Eriksen, Jesper G; Poortmans, Philip; Verfaillie, Christine; Westerveld, Henrike; Cross, Shamira; Chan, Ming-Ka; Shaw, Timothy

2017-05-01

The need for radiation oncologists and other radiation oncology (RO) professionals to lead quality improvement activities and contribute to shaping the future of our specialty is self-evident. Leadership knowledge, skills and behaviours, like other competencies, can be learned (Blumenthal et al., 2012). The objective of this study was to define a globally applicable competency set specific to radiation oncology for the CanMEDS Leader Role (Frank et al., 2015). A modified Delphi consensus process delivering two rounds of on-line surveys was used. Participants included trainees, radiation/clinical oncologists and other RO team members (radiation therapists, physicists, and nurses), professional educators and patients. 72 of 95 (76%) invitees from nine countries completed the Round 1 (R1) survey. Of the 72 respondents to RI, 70 completed Round 2 (R2) (97%). In R1, 35 items were deemed for 'inclusion' and 21 for 'exclusion', leaving 41 'undetermined'. After review of items, informed by participant comments, 14 competencies from the 'inclusion' group went into the final curriculum; 12 from the 'undetermined' group went to R2. In R2, 6 items reached consensus for inclusion. This process resulted in 20 RO Leader Role competencies with apparent global applicability. This is the first step towards developing learning, teaching and assessment tools for this important area of training. Copyright © 2017 Elsevier B.V. All rights reserved.

Multi-Stakeholder Informed Guidelines for Direct Admission of Children to Hospital.

PubMed

Leyenaar, JoAnna K; Shevenell, Megan; Rizzo, Paul A; Hill, Vanessa L; Lindenauer, Peter K

2018-04-25

To develop pediatric direct admission guidelines and prioritize outcomes to evaluate the safety and effectiveness of hospital admission processes. We conducted deliberative discussions at 1 children's hospital and 2 community hospitals, engaging parents of hospitalized children and inpatient, outpatient, and emergency department physicians and nurses to identify shared and dissenting perspectives regarding direct admission processes and outcomes. Discussions were audio-recorded, professionally transcribed, and analyzed using a general inductive approach. We then convened a national panel to prioritize guideline components and outcome measures using a RAND/UCLA Modified Delphi approach. Forty-eight stakeholders participated in 6 deliberative discussions. Emergent themes related to effective multistakeholder communication, resources needed for high quality direct admissions, written direct admission guidelines, including criteria to identify children appropriate for and inappropriate for direct admission, and families' needs. Building on these themes, Delphi panelists endorsed 71 guideline components as both appropriate and necessary at children's hospitals and community hospitals and 13 outcomes to evaluate hospital admission systems. Guideline components include (1) pre-admission communication, (2) written guidelines, (3) hospital resources to optimize direct admission processes, (4) special considerations for pediatric populations that may be at particular risk of nosocomial infection and/or stress in emergency departments, (5) communication with families referred for direct admission, and (6) quality reviews to evaluate admission systems. These direct admission guidelines can be adapted by hospitals and health systems to inform hospital admission policies and protocols. Multistakeholder engagement in evaluation of hospital admission processes may improve transitions of care and health system integration. Copyright © 2018 Elsevier Inc. All rights reserved.

Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel

PubMed Central

Boulkedid, Rym; Sibony, Olivier; Goffinet, François; Fauconnier, Arnaud; Branger, Bernard; Alberti, Corinne

2013-01-01

Objective Measuring the quality of inpatient obstetrical care using quality indicators is becoming increasingly important for both patients and healthcare providers. However, there is no consensus about which measures are optimal. We describe a modified Delphi method to identify a set of indicators for continuously monitoring the quality of maternity care by healthcare professionals. Methodology and Main Findings An international French-speaking multidisciplinary panel comprising 22 obstetricians-gynaecologists, 12 midwives, and 1 paediatrician assessed potential indicators extracted from a medical literature search, using a two-round Delphi procedure followed by a physical meeting. Each panellist rated each indicator based on validity and feasibility. In the first round, 35 panellists from 5 countries and 20 maternity units evaluated 26 indicators including 15 related to the management of the overall population of pregnant women, 3 to the management of women followed from the first trimester of pregnancy, 2 to the management of low-risk pregnant women, and 6 to the management of neonates. 25 quality indicators were kept for next step. In the second round, 27 (27/35: 77%) panellists selected 17 indicators; the remaining 8 indicators were discussed during a physical meeting. The final set comprised 18 indicators. Conclusion A multidisciplinary panel selected indicators that reflect the quality of obstetrical care. This set of indicators could be used to assess and monitor obstetrical care, with the goal of improving the quality of care in maternity units. PMID:23577143

Developing clinical practice guidelines for Chinese herbal treatment of polycystic ovary syndrome: A mixed-methods modified Delphi study.

PubMed

Lai, Lily; Flower, Andrew; Moore, Michael; Lewith, George

2015-06-01

Preliminary evidence suggests Chinese herbal medicine (CHM) could be a viable treatment option for polycystic ovary syndrome (PCOS). Prior to conducting a clinical trial it is important to consider the characteristics of good clinical practice. This study aims to use professional consensus to establish good clinical practice guidelines for the CHM treatment of PCOS. CHM practitioners participated in a mixed-methods modified Delphi study involving three rounds of structured group communication. Round 1 involved qualitative interviews with practitioners to generate statements regarding good clinical practice. In round 2, these statements were distributed online to the same practitioners to rate their agreement using a 7-point Likert scale, where group consensus was defined as a median rating of ≥5. Statements reaching consensus were accepted for consideration onto the guideline whilst those not reaching consensus were re-distributed for consideration in round 3. Statements presented in the guidelines were graded from A (strong consensus) to D (no consensus) determined by median score and interquartile range. 11 CHM practitioners in the UK were recruited. After three Delphi rounds, 91 statement items in total had been considered, of which 89 (97.8%) reached consensus and 2 (2.2%) did not. The concluding set of guidelines consists of 85 items representing key features of CHM prescribing for PCOS. These guidelines can be viewed as an initial framework that captures fundamental principles of good clinical practice for CHM. Copyright © 2015 Elsevier Ltd. All rights reserved.

Optimizing the assessment of pediatric injury severity in low-resource settings: Consensus generation through a modified Delphi analysis.

PubMed

St-Louis, Etienne; Deckelbaum, Dan Leon; Baird, Robert; Razek, Tarek

2017-06-01

Although a plethora of pediatric injury severity scoring systems is available, many of them present important challenges and limitations in the low resource setting. Our aim is to generate consensus among a group of experts regarding the optimal parameters, outcomes, and methods of estimating injury severity for pediatric trauma patients in low resource settings. A systematic review of the literature was conducted to identify and compare existing injury scores used in pediatric patients. Qualitative data was extracted from the systematic review, including scoring parameters, settings and outcomes. In order to establish consensus regarding which of these elements are most adapted to pediatric patients in low-resource settings, they were subjected to a modified Delphi survey for external validation. The Delphi process is a structured communication technique that relies on a panel of experts to develop a systematic, interactive consensus method. We invited a group of 38 experts, including adult and pediatric surgeons, emergency physicians and anesthesiologists trauma team leaders from a level 1 trauma center in Montreal, Canada, and a pediatric referral trauma hospital in Santiago, Chile to participate in two successive rounds of our survey. Consensus was reached regarding various features of an ideal pediatric trauma score. Specifically, our experts agreed pediatric trauma scoring tool should differ from its adult counterpart, that it can be derived from point of care data available at first assessment, that blood pressure is an important variable to include in a predictive model for pediatric trauma outcomes, that blood pressure is a late but specific marker of shock in pediatric patients, that pulse rate is a more sensitive marker of hemodynamic instability than blood pressure, that an assessment of airway status should be included as a predictive variable for pediatric trauma outcomes, that the AVPU classification of neurologic status is simple and reliable in the acute setting, and more so than GCS at all ages. Therefore, we conclude that an opportunity exists to develop a new pediatric trauma score, combining the above consensus-generating ideas, that would be best adapted for use in low-resource settings. Copyright © 2017 Elsevier Ltd. All rights reserved.

Toward an essential ethic for teaching science in the new millennium

NASA Astrophysics Data System (ADS)

Hays, Irene De La Bretonne

The purpose of this study was to identify and explore values and views that might underlie an essential ethic for teaching science in the new millennium. With such an ethic, teachers may be better able to prepare young people to form and fully participate in communities that restore and sustain Earth. Reviewed in the literature for this study were changing philosophies and theories from early indigenous cultures to the present on the nature of nature, the value of nature, and the human relationship with nature. These philosophies and theories were found to influence values that today underlie the work scientists do and the ways young people are educated in science. In the study, two groups of participants--Nature Writers and scientists--revealed the essence and meaning of their relationship with nature. A two-stage, modified Delphi method was used for collecting data. Stage One comprised the first "round" of the Delphi and involved content analysis of writings by a select group of U.S. Nature Writers from the early 1800s to the present. In Stage Two, comprising three rounds of the modified Delphi, perspectives of Nature Writers were imbedded in questionnaires and presented for response to a select group of scientists connected with research and education at National Laboratories across the country. Finally, results from each participant group were brought together in a recursive process, one with the other, to determine findings. Strong Earth-care values, including receptivity, responsibility, interdependence, respect, cooperation, love, and care, were found to be held in common by the Nature Writers and scientists in this study and could form the foundation for an essential ethic for teaching science. The strongest dissonance between Nature Writers and scientists was evident in emotional and spiritual domains--despite that many scientists revealed emotional and spiritual elements in stories told of their experiences with nature. Contrary to what might have been expected from scientists based on theories of science and practices of science education represented in the literature, few scientists revealed negative, utilitarian, or dominionistic affiliations with nature. In contrast, no Nature Writers revealed such affiliations.

Modified Delphi Investigation of Lesson Planning Concepts for Physical Education Teacher Education

ERIC Educational Resources Information Center

Sager, Jack W.

2012-01-01

Improving the methods of instructing future educators, through program evaluation and improvement, should be a goal of all teacher education programs. In physical education, the National Association for Sport & Physical Education created standards for initial preparation of physical education teachers. The six standards for preparation include…

Perceptions of College Students on Social Factors That Influence Student Matriculation

ERIC Educational Resources Information Center

Kelly, Jeremy L.; LaVergne, Douglas D.; Boone, Harry N., Jr.; Boone, Deborah A.

2012-01-01

This study analyzed undergraduate students' (n = 280) attitudes toward selected social factors that would influence and discourage student persistence at a four-year research university. Using a modified Delphi technique to construct the questionnaire, the researchers discovered that family encouragement, positive relationships with professors,…

Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies.

PubMed

Diamond, Ivan R; Grant, Robert C; Feldman, Brian M; Pencharz, Paul B; Ling, Simon C; Moore, Aideen M; Wales, Paul W

2014-04-01

To investigate how consensus is operationalized in Delphi studies and to explore the role of consensus in determining the results of these studies. Systematic review of a random sample of 100 English language Delphi studies, from two large multidisciplinary databases [ISI Web of Science (Thompson Reuters, New York, NY) and Scopus (Elsevier, Amsterdam, NL)], published between 2000 and 2009. About 98 of the Delphi studies purported to assess consensus, although a definition for consensus was only provided in 72 of the studies (64 a priori). The most common definition for consensus was percent agreement (25 studies), with 75% being the median threshold to define consensus. Although the authors concluded in 86 of the studies that consensus was achieved, consensus was only specified a priori (with a threshold value) in 42 of these studies. Achievement of consensus was related to the decision to stop the Delphi study in only 23 studies, with 70 studies terminating after a specified number of rounds. Although consensus generally is felt to be of primary importance to the Delphi process, definitions of consensus vary widely and are poorly reported. Improved criteria for reporting of methods of Delphi studies are required. Copyright © 2014 Elsevier Inc. All rights reserved.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas

PubMed Central

Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-01-01

Introduction The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. Methods and analysis We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. Ethics and dissemination We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. PMID:28780546

Determining the Criteria and Their Weights for Medical Schools' Ranking: A National Consensus.

PubMed

Mojtahedzadeh, Rita; Mohammadi, Aeen; Kohan, Noushin; Gharib, Mitra; Zolfaghari, Mitra

2016-06-01

Delphi as a consensus development technique enables anonymous, systematic refinement of expert opinion with the aim of arriving at a combined or consensual position. In this study, we determined the criteria and their weights for Iranian Medical Schools' ranking through a Delphi process. An expert committee devised 13 proposed criteria with 32 indicators with their weights, which were arranged hierarchically in the form of a tree diagram. We used the Delphi technique to reach a consensus on these criteria and weights among the deans of 38 public Iranian medical schools. For this purpose, we devised and sent a questionnaire to schools and asked them to suggest or correct the criteria and their weights. We repeated this process in two rounds till all the schools reached an acceptable consensus on them. All schools reached a consensus on the set of 13 criteria and 30 indicators and their weights in three main contexts of education, research and facilities, and equipment which were used for Medical Schools' ranking. Using Delphi technique for devising the criteria and their weights in evaluation processes such as ranking makes their results more acceptable among universities.

Identifying clinical features in primary care electronic health record studies: methods for codelist development.

PubMed

Watson, Jessica; Nicholson, Brian D; Hamilton, Willie; Price, Sarah

2017-11-22

Analysis of routinely collected electronic health record (EHR) data from primary care is reliant on the creation of codelists to define clinical features of interest. To improve scientific rigour, transparency and replicability, we describe and demonstrate a standardised reproducible methodology for clinical codelist development. We describe a three-stage process for developing clinical codelists. First, the clear definition a priori of the clinical feature of interest using reliable clinical resources. Second, development of a list of potential codes using statistical software to comprehensively search all available codes. Third, a modified Delphi process to reach consensus between primary care practitioners on the most relevant codes, including the generation of an 'uncertainty' variable to allow sensitivity analysis. These methods are illustrated by developing a codelist for shortness of breath in a primary care EHR sample, including modifiable syntax for commonly used statistical software. The codelist was used to estimate the frequency of shortness of breath in a cohort of 28 216 patients aged over 18 years who received an incident diagnosis of lung cancer between 1 January 2000 and 30 November 2016 in the Clinical Practice Research Datalink (CPRD). Of 78 candidate codes, 29 were excluded as inappropriate. Complete agreement was reached for 44 (90%) of the remaining codes, with partial disagreement over 5 (10%). 13 091 episodes of shortness of breath were identified in the cohort of 28 216 patients. Sensitivity analysis demonstrates that codes with the greatest uncertainty tend to be rarely used in clinical practice. Although initially time consuming, using a rigorous and reproducible method for codelist generation 'future-proofs' findings and an auditable, modifiable syntax for codelist generation enables sharing and replication of EHR studies. Published codelists should be badged by quality and report the methods of codelist generation including: definitions and justifications associated with each codelist; the syntax or search method; the number of candidate codes identified; and the categorisation of codes after Delphi review. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study

PubMed Central

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-01-01

Background The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. Objective This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. Design A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Results Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. Discussion and conclusions This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. PMID:27540101

Pharmacist provision of primary health care: a modified Delphi validation of pharmacists' competencies.

PubMed

Kennie-Kaulbach, Natalie; Farrell, Barbara; Ward, Natalie; Johnston, Sharon; Gubbels, Ashley; Eguale, Tewodros; Dolovich, Lisa; Jorgenson, Derek; Waite, Nancy; Winslade, Nancy

2012-03-28

Pharmacists have expanded their roles and responsibilities as a result of primary health care reform. There is currently no consensus on the core competencies for pharmacists working in these evolving practices. The aim of this study was to develop and validate competencies for pharmacists' effective performance in these roles, and in so doing, document the perceived contribution of pharmacists providing collaborative primary health care services. Using a modified Delphi process including assessing perception of the frequency and criticality of performing tasks, we validated competencies important to primary health care pharmacists practising across Canada. Ten key informants contributed to competency drafting; thirty-three expert pharmacists replied to a second round survey. The final primary health care pharmacist competencies consisted of 34 elements and 153 sub-elements organized in seven CanMeds-based domains. Highest importance rankings were allocated to the domains of care provider and professional, followed by communicator and collaborator, with the lower importance rankings relatively equally distributed across the manager, advocate and scholar domains. Expert pharmacists working in primary health care estimated their most important responsibilities to be related to direct patient care. Competencies that underlie and are required for successful fulfillment of these patient care responsibilities, such as those related to communication, collaboration and professionalism were also highly ranked. These ranked competencies can be used to help pharmacists understand their potential roles in these evolving practices, to help other health care professionals learn about pharmacists' contributions to primary health care, to establish standards and performance indicators, and to prioritize supports and education to maximize effectiveness in this role.

Pharmacist provision of primary health care: a modified Delphi validation of pharmacists' competencies

PubMed Central

2012-01-01

Background Pharmacists have expanded their roles and responsibilities as a result of primary health care reform. There is currently no consensus on the core competencies for pharmacists working in these evolving practices. The aim of this study was to develop and validate competencies for pharmacists' effective performance in these roles, and in so doing, document the perceived contribution of pharmacists providing collaborative primary health care services. Methods Using a modified Delphi process including assessing perception of the frequency and criticality of performing tasks, we validated competencies important to primary health care pharmacists practising across Canada. Results Ten key informants contributed to competency drafting; thirty-three expert pharmacists replied to a second round survey. The final primary health care pharmacist competencies consisted of 34 elements and 153 sub-elements organized in seven CanMeds-based domains. Highest importance rankings were allocated to the domains of care provider and professional, followed by communicator and collaborator, with the lower importance rankings relatively equally distributed across the manager, advocate and scholar domains. Conclusions Expert pharmacists working in primary health care estimated their most important responsibilities to be related to direct patient care. Competencies that underlie and are required for successful fulfillment of these patient care responsibilities, such as those related to communication, collaboration and professionalism were also highly ranked. These ranked competencies can be used to help pharmacists understand their potential roles in these evolving practices, to help other health care professionals learn about pharmacists' contributions to primary health care, to establish standards and performance indicators, and to prioritize supports and education to maximize effectiveness in this role. PMID:22455482

The hospital incident command system: modified model for hospitals in iran.

PubMed

Djalali, Ahmadreza; Hosseinijenab, Vahid; Peyravi, Mahmoudreza; Nekoei-Moghadam, Mahmood; Hosseini, Bashir; Schoenthal, Lisa; Koenig, Kristi L

2015-03-27

Effectiveness of hospital management of disasters requires a well-defined and rehearsed system. The Hospital Incident Command System (HICS), as a standardized method for command and control, was established in Iranian hospitals, but it has performed fairly during disaster exercises. This paper describes the process for, and modifications to HICS undertaken to optimize disaster management in hospitals in Iran. In 2013, a group of 11 subject matter experts participated in an expert consensus modified Delphi to develop modifications to the 2006 version of HICS. The following changes were recommended by the expert panel and subsequently implemented: 1) A Quality Control Officer was added to the Command group; 2) Security was defined as a new section; 3) Infrastructure and Business Continuity Branches were moved from the Operations Section to the Logistics and the Administration Sections, respectively; and 4) the Planning Section was merged within the Finance/Administration Section. An expert consensus group developed a modified HICS that is more feasible to implement given the managerial organization of hospitals in Iran. This new model may enhance hospital performance in managing disasters. Additional studies are needed to test the feasibility and efficacy of the modified HICS in Iran, both during simulations and actual disasters. This process may be a useful model for other countries desiring to improve disaster incident management systems for their hospitals.

Engaging communication experts in a Delphi process to identify patient behaviors that could enhance communication in medical encounters

PubMed Central

2010-01-01

Background The communication literature currently focuses primarily on improving physicians' verbal and non-verbal behaviors during the medical interview. The Four Habits Model is a teaching and research framework for physician communication that is based on evidence linking specific communication behaviors with processes and outcomes of care. The Model conceptualizes basic communication tasks as "Habits" and describes the sequence of physician communication behaviors during the clinical encounter associated with improved outcomes. Using the Four Habits Model as a starting point, we asked communication experts to identify the verbal communication behaviors of patients that are important in outpatient encounters. Methods We conducted a 4-round Delphi process with 17 international experts in communication research, medical education, and health care delivery. All rounds were conducted via the internet. In round 1, experts reviewed a list of proposed patient verbal communication behaviors within the Four Habits Model framework. The proposed patient verbal communication behaviors were identified based on a review of the communication literature. The experts could: approve the proposed list; add new behaviors; or modify behaviors. In rounds 2, 3, and 4, they rated each behavior for its fit (agree or disagree) with a particular habit. After each round, we calculated the percent agreement for each behavior and provided these data in the next round. Behaviors receiving more than 70% of experts' votes (either agree or disagree) were considered as achieving consensus. Results Of the 14 originally-proposed patient verbal communication behaviors, the experts modified all but 2, and they added 20 behaviors to the Model in round 1. In round 2, they were presented with 59 behaviors and 14 options to remove specific behaviors for rating. After 3 rounds of rating, the experts retained 22 behaviors. This set included behaviors such as asking questions, expressing preferences, and summarizing information. Conclusion The process identified communication tasks and verbal communication behaviors for patients similar to those outlined for physicians in the Four Habits Model. This represents an important step in building a single model that can be applied to teaching patients and physicians the communication skills associated with improved satisfaction and positive outcomes of care. PMID:20403173

Application of Delphi-AHP methods to select the priorities of WEEE for recycling in a waste management decision-making tool.

PubMed

Kim, Mincheol; Jang, Yong-Chul; Lee, Seunguk

2013-10-15

The management of waste electrical and electronic equipment (WEEE) or electronic waste (e-waste) has become a major issue of concern for solid waste communities due to the large volumes of waste being generated from the consumption of modern electrical and electronic products. In 2003, Korea introduced the extended producer responsibility (EPR) system to reduce the amount of electronic products to be disposed and to promote resource recovery from WEEE. The EPR currently regulates a total of 10 electrical and electronic products. This paper presents the results of the application of the Delphi method and analytical hierarchy process (AHP) modeling to the WEEE management tool in the policy-making process. Specifically, this paper focuses on the application of the Delphi-AHP technique to determine the WEEE priority to be included in the EPR system. Appropriate evaluation criteria were derived using the Delphi method to assess the potential selection and priority among electrical and electronic products that will be regulated by the EPR system. Quantitative weightings from the AHP model were calculated to identify the priorities of electrical and electronic products to be potentially regulated. After applying all the criteria using the AHP model, the results indicate that the top 10 target recycling products for the expansion of the WEEE list were found to be vacuum cleaners, electric fans, rice cookers, large freezers, microwave ovens, water purifiers, air purifiers, humidifiers, dryers, and telephones in order from the first to last. The proposed Delphi-AHP method can offer a more efficient means of selecting WEEE than subjective assessment methods that are often based on professional judgment or limited available data. By providing WEEE items to be regulated, the proposed Delphi-AHP method can eliminate uncertainty and subjective assessment and enable WEEE management policy-makers to identify the priority of potential WEEE. More generally, the work performed in this study is an example of how Delphi-AHP modeling can be used as a decision-making process tool in WEEE management. Crown Copyright © 2013. Published by Elsevier Ltd. All rights reserved.

Designing a balanced scorecard for a tertiary care hospital in Pakistan: a modified Delphi group exercise.

PubMed

Rabbani, Fauziah; Jafri, Syed M Wasim; Abbas, Farhat; Shah, Mairaj; Azam, Syed Iqbal; Shaikh, Babar Tasneem; Brommels, Mats; Tomson, Goran

2010-01-01

Balanced Scorecards (BSC) are being implemented in high income health settings linking organizational strategies with performance data. At this private university hospital in Pakistan an elaborate information system exists. This study aimed to make best use of available data for better performance management. Applying the modified Delphi technique an expert panel of clinicians and hospital managers reduced a long list of indicators to a manageable size. Indicators from existing documents were evaluated for their importance, scientific soundness, appropriateness to hospital's strategic plan, feasibility and modifiability. Panel members individually rated each indicator on a scale of 1-9 for the above criteria. Median scores were assigned. Of an initial set of 50 indicators, 20 were finally selected to be assigned to the four BSC quadrants. These were financial (n = 4), customer or patient (n = 4), internal business or quality of care (n = 7) and innovation/learning or employee perspectives (n = 5). A need for stringent definitions, international benchmarking and standardized measurement methods was identified. BSC compels individual clinicians and managers to jointly work towards improving performance. This scorecard is now ready to be implemented by this hospital as a performance management tool for monitoring indicators, addressing measurement issues and enabling comparisons with hospitals in other settings. Copyright 2010 John Wiley & Sons, Ltd.

The View of Principals on Standards Based Evaluation Systems and Their Role as Instructional Leaders

ERIC Educational Resources Information Center

Zoll, James Allen

2014-01-01

This study examined the implementation of standards based evaluation systems, specifically Georgia's Teacher Keys Effectiveness System, affects the principals' role of instructional leader. Using a modified Delphi study, principals from a large urban/suburban school system, gave feedback on three questions: how has their role changed; are they…

Identifying Characteristics of Technology and Engineering Teachers Striving for Excellence Using a Modified Delphi

ERIC Educational Resources Information Center

Rose, Mary Annette; Shumway, Steven; Carter, Vinson; Brown, Josh

2015-01-01

Preparing a technology and engineering (TE) teacher who strives for teaching excellence is a fundamental mission of TE teacher education programs in the United States. In 2012, the International Technology and Engineering Educators Association (ITEEA, formerly the International Technology Education Association, ITEA) Council on Technology and…

The Department Chairperson: The Confessions of a Researcher Turned Practitioner.

ERIC Educational Resources Information Center

Murray, John P.

A study was conducted to identify the expectations that faculty have of chairpersons. Previously, a study using a modified Delphi technique had revealed that the 50 participants believed that the chair should be responsible for a multitude of duties. However, the participants had a marked preference for shared or participatory leadership.…

Business Education University Supervisors' Perspectives of Mentor Teachers' Competencies

ERIC Educational Resources Information Center

Fletcher, Edward C., Jr.

2012-01-01

This study examined the perspectives of an expert panel of 31 business education university supervisors from the U.S. and Canada using a modified Delphi approach regarding the areas in which mentor teachers are typically most and least prepared. Findings indicated business education mentor teachers are most prepared in the areas of classroom…

Perceptions of Bachelor-Degree Graduates Regarding General Education Program Quality

ERIC Educational Resources Information Center

Bittinger, Sara-Beth

2017-01-01

This study was directed by a modified Delphi-methodology design to gain perspective of the perceptions of alumni regarding the value and applicability of the general education program. The expert-panel participants were 14 alumni of Frostburg State University from various majors, representative of all three colleges, who graduated between 2006 and…

Defining interdisciplinary competencies for audiological rehabilitation: findings from a modified Delphi study.

PubMed

Xue, Lina; Le Bot, Gaëlle; Van Petegem, Wim; van Wieringen, Astrid

2018-02-01

The aim of this study is to derive a consensus on an interdisciplinary competency framework regarding a holistic approach for audiological rehabilitation (AR), which includes disciplines from medicine, engineering, social sciences and humanities. We employed a modified Delphi method. In the first round survey, experts were asked to rate an initial list of 28 generic interdisciplinary competencies and to propose specific knowledge areas for AR. In the second round, experts were asked to reconsider their answers in light of the group answers of the first round. An international panel of 27 experts from different disciplines in AR completed the first round. Twenty-two of them completed the second round. We developed a competency framework consisting of 21 generic interdisciplinary competencies grouped in five domains and nine specific competencies (knowledge areas) in three clusters. Suggestions for the implementation of the generic competencies in interdisciplinary programmes were identified. This study reveals insights into the interdisciplinary competencies that are unique for AR. The framework will be useful for educators in developing interdisciplinary programmes as well as for professionals in considering their lifelong training needs in AR.

The Policy Delphi: A Method for Identifying Intended and Unintended Consequences of Educational Policy

ERIC Educational Resources Information Center

Manley, R. Adam

2013-01-01

This article highlights a rarely utilized but effective technique for identifying intended and unintended consequences of past or current policy or policy change. The author guides the reader through the process of identifying potential participants, contacting participants, developing the policy Delphi instrument, and analyzing the findings by…

The Delphi Process: Some Assumptions and Some Realities.

ERIC Educational Resources Information Center

Waldron, James S.

The effectiveness of the Delphi Technique is evaluated in terms of immediate and delayed controlled information feedback (feedback within 5 seconds as compared with a 24-hour delay); and the relationships that exist among measures of integrative complexity, estimations about the time of occurrence of future events, and time delay between task…

Which information on women's issues in epilepsy does a community pharmacist need to know? A Delphi consensus study.

PubMed

Shawahna, Ramzi

2017-12-01

The aim of this study was to develop and achieve consensus on a core list of important knowledge items that community pharmacists should know on women's issues in epilepsy. This was a consensual study using a modified Delphi technique. Knowledge items were collected from the literature and from nine key contacts who were interviewed on their views on what information community pharmacists should have on women's issues in epilepsy. More knowledge items were suggested by five researchers with interest in women's issues who were contacted to rate and comment on the knowledge items collected. Two iterative Delphi rounds were conducted among a panel of pharmacists (n=30) to achieve consensus on the knowledge items to be included in the core list. Ten panelists ranked the knowledge items by their importance using the Analytical Hierarchy Process (AHP). Consensus was achieved to include 68 knowledge under 13 categories in the final core list. Items ranked by their importance were related to the following: teratogenicity (10.3%), effect of pregnancy on epilepsy (7.4%), preconception counseling (10.3%), bone health (5.9%), catamenial epilepsy (7.4%), menopause and hormonal replacement therapy (2.9%), contraception (14.7%), menstrual disorders and infertility (8.8%), eclampsia (2.9%), breastfeeding (4.4%), folic acid and vitamin K (5.9%), counseling on general issues (14.7%), and sexuality (4.4%). Using consensual knowledge lists might promote congruence in educating and/or training community pharmacists on women's issues in epilepsy. Future studies are needed to investigate if such lists can improve health services provided to women with epilepsy (WWE). Copyright © 2017 Elsevier Inc. All rights reserved.

The Use of the Delphi and Other Consensus Group Methods in Medical Education Research: A Review.

PubMed

Humphrey-Murto, Susan; Varpio, Lara; Wood, Timothy J; Gonsalves, Carol; Ufholz, Lee-Anne; Mascioli, Kelly; Wang, Carol; Foth, Thomas

2017-10-01

Consensus group methods, such as the Delphi method and nominal group technique (NGT), are used to synthesize expert opinions when evidence is lacking. Despite their extensive use, these methods are inconsistently applied. Their use in medical education research has not been well studied. The authors set out to describe the use of consensus methods in medical education research and to assess the reporting quality of these methods and results. Using scoping review methods, the authors searched the Medline, Embase, PsycInfo, PubMed, Scopus, and ERIC databases for 2009-2016. Full-text articles that focused on medical education and the keywords Delphi, RAND, NGT, or other consensus group methods were included. A standardized extraction form was used to collect article demographic data and features reflecting methodological rigor. Of the articles reviewed, 257 met the inclusion criteria. The Modified Delphi (105/257; 40.8%), Delphi (91/257; 35.4%), and NGT (23/257; 8.9%) methods were most often used. The most common study purpose was curriculum development or reform (68/257; 26.5%), assessment tool development (55/257; 21.4%), and defining competencies (43/257; 16.7%). The reporting quality varied, with 70.0% (180/257) of articles reporting a literature review, 27.2% (70/257) reporting what background information was provided to participants, 66.1% (170/257) describing the number of participants, 40.1% (103/257) reporting if private decisions were collected, 37.7% (97/257) reporting if formal feedback of group ratings was shared, and 43.2% (111/257) defining consensus a priori. Consensus methods are poorly standardized and inconsistently used in medical education research. Improved criteria for reporting are needed.

Using the Delphi method to develop nursing-sensitive quality indicators for the NICU.

PubMed

Chen, Lin; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-02-01

To develop nursing-sensitive quality indicators consistent with current medical practices in Chinese neonatal intensive care units. The development of nursing-sensitive quality indicators has become a top priority in nursing management. To the best of our knowledge, there has been no objective, scientific and sensitive evaluation of the quality of neonatal intensive care unit nursing in China. A modified Delphi technique was used to seek opinions from experts about what should be used and prioritised as indicators of quality care in neonatal intensive care unit nursing. Based on a literature review, we identified 21 indicators of nursing-sensitive quality in the neonatal intensive care unit. Our group of 11 consultants chose 13 indicators to be discussed using the Delphi method. In October and November 2014, 39 neonatal intensive care unit experts in 18 tertiary hospitals spread across six provinces participated in two rounds of Delphi panels. Of the 13 indicators discussed, 11 were identified as indicators of nursing-sensitive quality in the neonatal intensive care unit: rate of nosocomial infections, rate of accidental endotracheal extubation, rate of errors in medication administration, rate of treatment for pain, rate of peripheral venous extravasation, rate of compliance with handwashing techniques, incidence of pressure ulcers, incidence of noise, the bed-to-care ratio, the proportion of nurses with greater than five years neonatal intensive care unit experience and incidence of retinopathy. The 11 neonatal intensive care unit nursing-sensitive indicators identified by the Delphi method integrated with basic Chinese practices provide a basis for nursing management and the monitoring of nursing quality. This study identified nursing-sensitive quality indicators for neonatal intensive care unit care that are suitable for current clinical practice in China. © 2016 John Wiley & Sons Ltd.

Integration of Health Protection and Health Promotion: Rationale, Indicators, and Metrics

PubMed Central

Sorensen, Glorian; McLellan, Deborah; Dennerlein, Jack T.; Pronk, Nicolaas P.; Allen, Jennifer D.; Boden, Leslie I.; Okechukwu, Cassandra A.; Hashimoto, Dean; Stoddard, Anne; Wagner, Gregory R

2014-01-01

Objective To offer a definition of an “integrated” approach to worker health and operationalize this definition using indicators of the extent to which integrated efforts are implemented in an organization. Methods Guided by the question, “How will we know it when we see it?” we reviewed relevant literature to identify available definitions and metrics, and used a modified-Delphi process to review and refine indicators and measures of integrated approaches. Results A definition of integrated approaches to worker health is proposed and accompanied by indicators and measures that may be used by researchers, employers and workers. Conclusions A shared understanding of what is meant by integrated approaches to protect and promote worker health has the potential to improve dialogue among researchers and facilitate the research-to-practice process. PMID:24284762

A modified Delphi study towards developing a guideline to inform policy on fetal alcohol spectrum disorders in South Africa: a study protocol

PubMed Central

Mukumbang, Ferdinand C; Okop, Kufre J; Beytell, Anna-Marie

2018-01-01

Introduction Maternal alcohol consumption during pregnancy can result in mental and physical birth defects in individuals. These birth defects are usually described as fetal alcohol spectrum disorders (FASDs). With an estimated 183–259 per 1000 children born with FASDs, South Africa is identified to have the highest prevalence of FASDs in the world. Nevertheless, there is a lack of appropriate policies, guidelines and interventions addressing the issues around FASDs. This protocol outlines a proposed process for developing a guideline to inform policies on FASDs. Methods and analysis This process will have three phases. Phase I will be carried out in three steps; we plan to conduct a document review of available policies on the prevention and management of FASDs and update the existing systematic review on FASDs interventions. The aim of the two reviews is to explore the availability and content of existing policies and global interventions on FASDs. In addition, we will conduct two exploratory qualitative studies to obtain the perspectives of various stakeholders on the existing or possible guidelines and policies for the management of FASDs and available interventions and services. In phase II, we will aggregate the findings of the previous phase to develop a prototype guideline. In phase III, using the developed prototype, we will apply the Delphi approach with experts on FASDs, soliciting their opinions on the nature and content of the proposed guidelines for policies. The information gathered will be used to modify the prototype to formulate a policy guideline on FASDs. The data will be analysed using thematic analysis and narrative synthesis. Ethics and dissemination Ethical clearance has been obtained from the ethics committee of the university and governmental departments. The findings will be disseminated through publications and the guideline will be submitted to relevant departments. PMID:29703853

Improving care standards for patients with spinal trauma combining a modified e-Delphi process and stakeholder interviews: a study protocol.

PubMed

Sharwood, Lisa N; Stanford, Ralph; Middleton, James W; Burns, Brian; Joseph, Anthony; Flower, Oliver; Rigby, Oran; Ball, Jonathon; Dhaliwal, Shelly

2017-01-19

Around 300 people sustain a new traumatic spinal cord injury (TSCI) in Australia each year; a relatively low incidence injury with extremely high long-term associated costs. Care standards are inconsistent nationally, lacking in consensus across important components of care such as prehospital spinal immobilisation, timing of surgery and timeliness of transfer to specialist services. This study aims to develop 'expertly defined' and agreed standards of care across the majority of disciplines involved for these patients. A modified e-Delphi process will be used to gain consensus for best practice across specific clinical early care areas for the patient with TSCI; invited participants will include clinicians across Australia with relevant and significant expertise. A rapid literature review will identify available evidence, including any current guidelines from 2005 to 2015. Level and strength of evidence identified, including areas of contention, will be used to formulate the first round survey questions and statements. Participants will undertake 2-3 online survey rounds, responding anonymously to questionnaires regarding care practices and indicating their agreement or otherwise with practice standard statements. Relevant key stakeholders, including patients, will also be interviewed face to face. Ethics approval for this study was obtained by the NSW Population & Health Services Research Ethics Committee on 14 January 2016 (HREC/12/CIPHS/74). Seeking comprehensive understanding of how the variation in early care pathways and treatment can be addressed to achieve optimal patient outcomes and economic costs; the overall aim is the agreement to a consistent approach to the triage, treatment, transport and definitive care of acute TSCI victims. The agreed practice standards of care will inform the development of a Clinical Pathway with practice change strategies for implementation. These standards will offer a benchmark for state-wide and potentially national policy. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

A consensus definition of running-related injury in recreational runners: a modified Delphi approach.

PubMed

Yamato, Tiê Parma; Saragiotto, Bruno Tirotti; Lopes, Alexandre Dias

2015-05-01

Delphi study. To reach a consensus definition of running-related injury in recreational runners through a modified Delphi approach. Many studies have suggested the need for a standardized definition of running-related injury to provide uniformity to injury surveillance in running. We invited 112 researchers from running-related injury studies identified in a previous systematic review to classify words and terms frequently used in definitions of running-related injury in an online form during 3 rounds of study. In the last round, participants were asked to approve or disapprove the consensus definition. We considered an agreement level of at least 75% to be a consensus. Thirty-eight participants agreed to participate in the study. The response rates were 94.7% (n = 36) for the first round, 83.3% (n = 30) for the second round, and 86.7% (n = 26) for the third round. A consensus definition of running-related injury was reached, with 80% of participants approving the following: "Running-related (training or competition) musculoskeletal pain in the lower limbs that causes a restriction on or stoppage of running (distance, speed, duration, or training) for at least 7 days or 3 consecutive scheduled training sessions, or that requires the runner to consult a physician or other health professional." The proposed standardized definition of running-related injury could assist in standardizing the definitions used in sport science research and facilitate between-study comparisons. Future studies testing the validity of the proposed consensus definition, as well as its accurate translation to other languages, are also needed.

A Delphi Investigation into Future Trends in E-Learning in Israel

ERIC Educational Resources Information Center

Aharony, Noa; Bronstein, Jenny

2014-01-01

The purpose of this study is to investigate the views and opinions of e-learning experts regarding future trends in the e-learning arena. The Delphi technique was chosen as a method of study. This technique is an efficient and effective group communication process designed to systematically elicit judgments from experts in their selected area of…

An Empirical Investigation of Entrepreneurship Intensity in Iranian State Universities

ERIC Educational Resources Information Center

Mazdeh, Mohammad Mahdavi; Razavi, Seyed-Mostafa; Hesamamiri, Roozbeh; Zahedi, Mohammad-Reza; Elahi, Behin

2013-01-01

The purpose of this study is to propose a framework to evaluate the entrepreneurship intensity (EI) of Iranian state universities. In order to determine EI, a hybrid multi-method framework consisting of Delphi, Analytic Network Process (ANP), and VIKOR is proposed. The Delphi method is used to localize and reduce the number of criteria extracted…

Identifying Threshold Concepts for Information Literacy: A Delphi Study

ERIC Educational Resources Information Center

Townsend, Lori; Hofer, Amy R.; Hanick, Silvia Lin; Brunetti, Korey

2016-01-01

This study used the Delphi method to engage expert practitioners on the topic of threshold concepts--core ideas and processes in a discipline that students need to grasp in order to progress in their learning, but that are often unspoken or unrecognized by expert practitioners--for information literacy. A panel of experts considered two questions:…

The Essential Components of Coach Training for Mental Health Professionals: A Delphi Study

ERIC Educational Resources Information Center

Moriarity, Marlene Therese

2010-01-01

Purpose. The purpose of this study was to discover how coach training experts define coaching and what they would identify to be the essential components of a coach training program for mental health professionals. Methods. A panel of nine experts, through an iterative Delphi process of responding to three rounds of questionnaires, provided…

Development of a mild traumatic brain injury-specific vision screening protocol: a Delphi study.

PubMed

Goodrich, Gregory L; Martinsen, Gary L; Flyg, Heidi M; Kirby, Jennine; Asch, Steven M; Brahm, Karen D; Brand, John M; Cajamarca, Diana; Cantrell, Jenette L; Chong, Theresa; Dziadul, John A; Hetrick, Barbara J; Huang, Michael A; Ihrig, Carolyn; Ingalla, Shanida P; Meltzer, Bradley R; Rakoczy, Chrystyna M; Rone, Ashley; Schwartz, Elliot; Shea, Jane E

2013-01-01

Although traumatic brain injury (TBI) can happen to anyone at any time, the wars in Iraq and Afghanistan have brought it renewed attention. Fortunately, most cases of TBI from the recent conflicts are mild TBI (mTBI). Still, many physical, psychological, and social problems are associated with mTBI. Among the difficulties encountered are oculomotor and vision problems, many of which can impede daily activities such as reading. Therefore, correct diagnosis and treatment of these mTBI-related vision problems is an important part of patient recovery. Numerous eye care providers in the Department of Veterans Affairs, in military settings, and in civilian practices specialize and are proficient in examining patients who have a history of TBI. However, many do not have this level of experience working with and treating patients with mTBI. Recognizing this, we used a modified Delphi method to derive expert opinions from a panel of 16 optometrists concerning visual examination of the patient with mTBI. This process resulted in a clinical tool containing 17 history questions and 7 examination procedures. This tool provides a set of clinical guidelines that can be used as desired by any eye care provider either as a screening tool or adjunct to a full eye examination when seeing a patient with a history of mTBI. The goal of this process was to provide optimal and uniform vision care for the patient with mTBI.

Developing a research agenda for the American Society of Colon and Rectal Surgeons: results of a delphi approach.

PubMed

Burt, Caroline G; Cima, Robert R; Koltun, Walter A; Littlejohn, Charles E; Ricciardi, Rocco; Temple, Larissa K; Rothenberger, David A; Baxter, Nancy N

2009-05-01

By use of a systematic approach, the aim of this project was to survey a group of colorectal specialists and reach a consensus on the research questions of highest importance in terms of clinical care. A modified Delphi process was performed. In Round 1 research questions were solicited from members of The American Society of Colon and Rectal Surgeons. A review group categorized the results, combined similar questions, and presented them to The American Society of Colon and Rectal Surgeons membership in Round 2 for prioritizing according to importance. In Round 3 the 50 questions with the highest scores in Round 2 were reranked by The American Society of Colon and Rectal Surgeons membership to produce the 20 highest-priority research questions. A total of 203 respondents in Round 1 submitted 746 questions. The review team reduced these to 105 individual questions encompassing 21 topics in colorectal surgical practice. In Rounds 2 and 3, 399 and 360 respondents, respectively, prioritized the questions presented. The final 20 items included 14 questions related to colorectal cancer, and 6 were on benign disease topics. The research agenda produced by this study reflects the clinical issues of greatest importance to colorectal surgeons. The results are of potential benefit to researchers, funding organizations, medical journals, and ultimately, patients.

International identification of research priorities for postgraduate theses in musculoskeletal physiotherapy using a modified Delphi technique.

PubMed

Rushton, Alison; Moore, Ann

2010-04-01

Research priorities are established to identify gaps and maximise opportunities in developing an evidence base. Numerous postgraduate research theses are undertaken each year within the specialist area of musculoskeletal physiotherapy, and although some are published, greater potential for influence exists. This paper identifies international research priorities for postgraduate theses developed using a consensual Delphi process. A purposive sample included course tutors and expert clinicians nominated by Member Organisations of the International Federation of Orthopaedic Manipulative Physical Therapists (N=91). Round 1 requested >10 priorities for theses, and content analysis identified research themes. Round 2 requested participants rank the importance of each theme on a 1-5 scale, and round 3 requested ranking the importance and feasibility of the research question areas within each agreed theme. Descriptive analysis and use of Kendall's coefficient of concordance enabled interpretation of consensus. The response rate of 68% was good, identifying 23 research themes in round 1. Round 2 identified 14 research themes as important. Participant rating of the importance and feasibility of research question areas in round 3 supported 43 agreed priorities demonstrating good measurement validity. Establishing priorities provides a vision of how postgraduate theses can contribute to the developing evidence base and offer a focus for international collaboration. Copyright 2009 Elsevier Ltd. All rights reserved.

Management of intrathecal baclofen therapy for severe acquired brain injury: consensus and recommendations for good clinical practice.

PubMed

De Tanti, Antonio; Scarponi, Federico; Bertoni, Michele; Gasperini, Giulio; Lanzillo, Bernardo; Molteni, Franco; Posteraro, Federico; Vitale, Dino Francesco; Zanpolini, Mauro

2017-08-01

Although widespread in the treatment of generalised spasticity due to severe acquired brain injury, clinical use of intrathecal baclofen administered through an implanted catheter is not yet supported by full scientific evidence. The aim of the study is to provide recommendations for good clinical practice regarding intrathecal baclofen therapy. We used a modified RAND Delphi method to develop consensus-based medical guidelines, involving clinicians who use intrathecal baclofen therapy throughout Italy. The clinicians were asked 38 questions grouped in six areas (patient selection, contraindications for implant, tests prior to implant, method of implant and management of therapy, efficacy evaluation and goal setting, and management of complications). To establish consensus, 75% agreement was required in answers to every question. Consensus was reached on the second round of the Delphi process on 27/38 questions (71%), specifically those regarding identification of objectives, efficacy evaluation, and method of implant and management of therapy, whereas management of complications and contraindications for implant remained critical areas. Despite the limits of our method, a set of recommendations was drawn up for clinical practice in this sector. The study also revealed residual critical areas and indicated future lines of research necessary to reach evidence-based consensus.

Potential Effects of the Electronic Health Record on the Small Physician Practice: A Delphi Study.

PubMed

Sines, Chad C; Griffin, Gerald R

2017-01-01

The Health Information Technology for Economic and Clinical Health (HITECH) Act established the requirement of all medical practices to have certified electronic health records (EHRs). Some primary concerns that have been delaying implementation are issues of cost, revenue impact, and the effect on the patient encounter. Small physician practices (one to four physicians) account for 46 percent of all physicians. The purpose of this qualitative study using a modified Delphi research design was to examine the potential effect of the adoption of the EHR on revenue, unintended costs or savings, and changes in the patient encounter. Fifteen expert panelists completed the three-round survey process. The expert panelists reached a consensus that EHRs would reduce the number of patients seen per day, thereby reducing their revenue. Although the panelists limited their discussion on the effect of patient outcomes, their most dominant concern was the loss of face-to-face time with the patient. They felt that the use of an EHR would reduce the focus on the patient and potentially cause physicians to miss medical conditions. The results of this study indicate an avenue for EHR vendors to develop educational avenues to teach physicians how to optimize the EHR as well as to share success stories that demonstrate improved financial impact.

Potential Effects of the Electronic Health Record on the Small Physician Practice: A Delphi Study

PubMed Central

Sines, Chad C.; Griffin, Gerald R.

2017-01-01

The Health Information Technology for Economic and Clinical Health (HITECH) Act established the requirement of all medical practices to have certified electronic health records (EHRs). Some primary concerns that have been delaying implementation are issues of cost, revenue impact, and the effect on the patient encounter. Small physician practices (one to four physicians) account for 46 percent of all physicians. The purpose of this qualitative study using a modified Delphi research design was to examine the potential effect of the adoption of the EHR on revenue, unintended costs or savings, and changes in the patient encounter. Fifteen expert panelists completed the three-round survey process. The expert panelists reached a consensus that EHRs would reduce the number of patients seen per day, thereby reducing their revenue. Although the panelists limited their discussion on the effect of patient outcomes, their most dominant concern was the loss of face-to-face time with the patient. They felt that the use of an EHR would reduce the focus on the patient and potentially cause physicians to miss medical conditions. The results of this study indicate an avenue for EHR vendors to develop educational avenues to teach physicians how to optimize the EHR as well as to share success stories that demonstrate improved financial impact. PMID:28566989

The Modified Delphi Method to Analyze the Application of Instructional Design Theory to Online Graduate Education

ERIC Educational Resources Information Center

Zeedick, Danielle Marie

2010-01-01

During the past several decades, the field of instructional design theory has experienced changes in what is mostly applied to traditional, on-ground education. While instructional design theory has been (and still is being) discussed, constructed, and deconstructed, there has been no agreement among prominent instructional design theory…

Service Quality Assessment Scale (SQAS): An Instrument for Evaluating Service Quality of Health-Fitness Clubs

ERIC Educational Resources Information Center

Lam, Eddie T. C.; Zhang, James J.; Jensen, Barbara E.

2005-01-01

This study was designed to develop the Service Quality Assessment Scale to evaluate the service quality of health-fitness clubs. Through a review of literature, field observations, interviews, modified application of the Delphi technique, and a pilot study, a preliminary scale with 46 items was formulated. The preliminary scale was administered to…

Entry-Level Technical Skills that Agricultural Industry Experts Expected Students to Learn through Their Supervised Agricultural Experiences: A Modified Delphi Study

ERIC Educational Resources Information Center

Ramsey, Jon W.; Edwards, M. Craig

2011-01-01

The National Research Council's (NRC) Report (1988), Understanding Agriculture: New Directions for Education, called on secondary agricultural education to shift its scope and purpose, including students' supervised agricultural experiences (SAEs). The NRC asserted that this shift should create opportunities for students to acquire supervised…

Identifying and Verifying Earthquake Engineering Concepts to Create a Knowledge Base in STEM Education: A Modified Delphi Study

ERIC Educational Resources Information Center

Cavlazoglu, Baki; Stuessy, Carol L.

2017-01-01

Stakeholders in STEM education have called for integrating engineering content knowledge into STEM-content classrooms. To answer the call, stakeholders in science education announced a new framework, Next Generation Science Standards, which focuses on the integration of science and engineering in K-12 science education. However, research indicates…

Modified Delphi Investigation of Motor Development and Learning in Physical Education Teacher Education

ERIC Educational Resources Information Center

Ross, Susan; Metcalf, Amanda; Bulger, Sean M.; Housner, Lynn D.

2014-01-01

Purpose: As the scope of motor development and learning knowledge has successfully broadened over the years, there is an increased need to identify the content and learning experiences that are essential in preparing preservice physical educators. The purpose of this study was to generate expert consensus regarding the most critical motor…

Engineering's Grand Challenges: Priorities and Integration Recommendations for Technology Education Curriculum Development

ERIC Educational Resources Information Center

Buelin, Jennifer; Clark, Aaron C.; Ernst, Jeremy V.

2016-01-01

In this study, the 14 Grand Challenges for Engineering in the 21st Century identified by the National Academy of Engineering were examined by a panel of experts in an effort to identify prospective curricular integration opportunities in the field of technology and engineering education. The study utilized a three-round modified Delphi methodology…

A Modified Delphi Study to Define "Ah Ha" Moments in Education Settings

ERIC Educational Resources Information Center

Pilcher, Jobeth

2015-01-01

Ah ha moments are often mentioned in education literature. These moments are suggested to be a powerful aspect of learning, yet limited research is present regarding this topic. Ah ha learning moments have also not been defined in the education literature, resulting in the likelihood that each educator and learner may have differing definitions.…

Delphi based consensus study into planning for chemical incidents.

PubMed

Crawford, I W F; Mackway-Jones, K; Russell, D R; Carley, S D

2004-01-01

To achieve consensus in all phases of chemical incident planning and response. A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required.

Delphi based consensus study into planning for chemical incidents

PubMed Central

Crawford, I; Mackway-Jones, K; Russell, D; Carley, S

2004-01-01

Objective: To achieve consensus in all phases of chemical incident planning and response. Design: A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. Results: A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. Conclusions: The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required. PMID:14734369

Association of Postoperative Readmissions With Surgical Quality Using a Delphi Consensus Process to Identify Relevant Diagnosis Codes.

PubMed

Mull, Hillary J; Graham, Laura A; Morris, Melanie S; Rosen, Amy K; Richman, Joshua S; Whittle, Jeffery; Burns, Edith; Wagner, Todd H; Copeland, Laurel A; Wahl, Tyler; Jones, Caroline; Hollis, Robert H; Itani, Kamal M F; Hawn, Mary T

2018-04-18

Postoperative readmission data are used to measure hospital performance, yet the extent to which these readmissions reflect surgical quality is unknown. To establish expert consensus on whether reasons for postoperative readmission are associated with the quality of surgery in the index admission. In a modified Delphi process, a panel of 14 experts in medical and surgical readmissions comprising physicians and nonphysicians from Veterans Affairs (VA) and private-sector institutions reviewed 30-day postoperative readmissions from fiscal years 2008 through 2014 associated with inpatient surgical procedures performed at a VA medical center between October 1, 2007, and September 30, 2014. The consensus process was conducted from January through May 2017. Reasons for readmission were grouped into categories based on International Classification of Diseases, Ninth Revision (ICD-9) diagnosis codes. Panelists were given the proportion of readmissions coded by each reason and median (interquartile range) days to readmission. They answered the question, "Does the readmission reason reflect possible surgical quality of care problems in the index admission?" on a scale of 1 (never related) to 5 (directly related) in 3 rounds of consensus building. The consensus process was completed in May 2017 and data were analyzed in June 2017. Consensus on proportion of ICD-9-coded readmission reasons that reflected quality of surgical procedure. In 3 Delphi rounds, the 14 panelists achieved consensus on 50 reasons for readmission; 12 panelists also completed group telephone calls between rounds 1 and 2. Readmissions with diagnoses of infection, sepsis, pneumonia, hemorrhage/hematoma, anemia, ostomy complications, acute renal failure, fluid/electrolyte disorders, or venous thromboembolism were considered associated with surgical quality and accounted for 25 521 of 39 664 readmissions (64% of readmissions; 7.5% of 340 858 index surgical procedures). The proportion of readmissions considered to be not associated with surgical quality varied by procedure, ranging from to 21% (613 of 2331) of readmissions after lower-extremity amputations to 47% (745 of 1598) of readmissions after cholecystectomy. One-third of postoperative readmissions are unlikely to reflect problems with surgical quality. Future studies should test whether restricting readmissions to those with specific ICD-9 codes might yield a more useful quality measure.

Engaging Patients and Caregivers Managing Rare Diseases to Improve the Methods of Clinical Guideline Development: A Research Protocol

PubMed Central

Kinnett, Kathi; Grant, Sean; Lucas, Ann; Martin, Ann; Denger, Brian; Peay, Holly; Coulter, Ian; Fink, Arlene

2017-01-01

Background Clinical guidelines provide systematically developed recommendations for deciding on appropriate health care options for specific conditions and clinical circumstances. Up until recently, patients and caregivers have rarely been included in the process of developing care guidelines. Objective This project will develop and test a new online method for including patients and their caregivers in this process using Duchenne muscular dystrophy (DMD) care guidelines as an example. The new method will mirror and complement the RAND/UCLA Appropriateness Method (RAM)—the gold standard approach for conducting clinical expert panels that uses a modified Delphi format. RAM is often used in clinical guideline development to determine care appropriateness and necessity in situations where existing clinical evidence is uncertain, weak, or unavailable. Methods To develop the new method for engaging patients and their caregivers in guideline development, we will first conduct interviews with experts on RAM, guideline development, patient engagement, and patient-centeredness and engage with Duchenne patients and caregivers to identify how RAM should be modified for the purposes of patient engagement and what rating criteria should patients and caregivers use to provide their input during the process of guideline development. Once the new method is piloted, we will test it by conducting two concurrently run patient/caregiver panels that will rate patient-centeredness of a subset of DMD care management recommendations already deemed clinically appropriate and necessary. The ExpertLens™ system—a previously evaluated online modified Delphi system that combines two rounds of rating with a round of feedback and moderated online discussions—will be used to conduct these panels. In addition to developing and testing the new engagement method, we will work with the members of our project’s Advisory Board to generate a list of best practices for enhancing the level of patient and caregiver involvement in the guideline development process. We will solicit input on these best practice from Duchenne patients, caregivers, and clinicians by conducting a series of round-table discussions and making a presentation at an annual conference on Duchenne. Results The study protocol was reviewed by RAND’s Human Subjects Protection Committee, which determined it to be exempt from review. Interviews with RAM experts have been completed. The projected study completion date is May 2020. Conclusions We expect that the new method will make it easier to engage large numbers of patients and caregivers in the process of guideline development in a rigorous and culturally appropriate manner that is consistent with the way clinicians participate in guideline development. Moreover, this project will develop best practices that could help involve patients and caregivers in the clinical guideline development process in other clinical areas, thereby facilitating the work of guideline developers. PMID:28455279

The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study

PubMed Central

Gagliardi, Diana; Rondinone, Bruna M; Mirabile, Marco; Buresti, Giuliana; Ellwood, Peter; Hery, Michel; Paszkiewicz, Peter; Valenti, Antonio; Iavicoli, Sergio

2017-01-01

Objectives This study, developed within the frame of the Partnership for European Research on Occupational Safety and Health joint research activities and based on the frame designed by the 2013 European Agency for Safety and Health at Work (EU-OSHA) study, is the first example of using the points of view of European occupational safety and health (OSH) researchers. The objective is to identify priorities for OSH research that may contribute to the achievement of present and future sustainable growth objectives set by the European strategies. Methods The study was carried out using a modified Delphi method with a two-round survey. Each round involved a panel of about 110 researchers representing the network member institutes was selected according to specific criteria, including the ownership of research expertise in at least one of the four macroareas identified by the reference report developed by EU-OSHA in 2013. Results The study identified some innovative research topics (for example, ‘Emerging technological devices’ and ‘OSH consequences of markets integration’) and research priorities (ie, crowdsourcing, e-work, zero-hours contracts) that are not reflected in previous studies of this nature. The absence of any reference to violence and harassment at work among the researchers’ proposals is a major difference from previous similar studies, while topics related to gender issues and electromagnetic fields show a lower importance. Conclusions The innovative design of a research priorities identification process, which takes advantage of a large, representative and qualified panel of European researchers allowed the definition of a number of research priorities able to support the inclusion of innovative OSH research issues in the scope of the next European research agenda. PMID:28645965

Design of a consensus-derived synoptic operative report for lung cancer surgery.

PubMed

Schneider, Laura; Shargall, Yaron; Schieman, Colin; Seely, Andrew J; Srinathan, Sadeesh; Malthaner, Richard A; Pierre, Andrew F; Safieddine, Najib; Vaillancourt, Rosaire; Plourde, Madelaine; Bond, James; Johnson, Scott; Smith, Shona E; Finley, Christian J

2014-04-01

For lung cancer surgery, a narrative operative report is the standard reporting procedure, whereas a synoptic-style report is increasingly utilized by healthcare professionals in various specialties with great success. A synoptic operative report more succinctly and accurately captures vital information and is rapidly generated with good intraobserver reliability. The objective of this study was to systematically develop a synoptic operative report for lung cancer surgery following a modified Delphi consensus model with the support of the Canadian thoracic surgery community. Using online survey software, thoracic surgeons and related physicians were asked to suggest and rate data elements for a synoptic report following the modified Delphi consensus model. The consensus exercise-derived template was forwarded to a small working group, who further refined the definition and priority designation of elements until the working group had reached a satisfactory consensus. In all, 139 physicians were invited to participate in the consensus exercise, with 36.7%, 44.6%, and 19.5% response rates, respectively, in the three rounds. Eighty-nine elements were agreed upon at the conclusion of the exercise, but 141 elements were forwarded to the working group. The working group agreed upon a final data set of 180 independently defined data elements, with 72 mandatory and 108 optional elements for implementation in the final report. This study demonstrates the process involved in developing a multidisciplinary, consensus-based synoptic lung cancer operative report. This novel report style is a quality improvement initiative to improve the capture, dissemination, readability, and potential utility of critical surgical information. Copyright © 2014 The Society of Thoracic Surgeons. Published by Elsevier Inc. All rights reserved.

Identifying Markers of Dignity-Conserving Care in Long-Term Care: A Modified Delphi Study

PubMed Central

Thompson, Genevieve N.; McArthur, Jennifer; Doupe, Malcolm

2016-01-01

Ensuring that people living in nursing homes (NHs) are afforded with dignity in their daily lives is an essential and humane concern. Promoting dignity-conserving care is fundamentally important. By nature, however, this care is all-encompassing and holistic, and from current knowledge it is challenging to create explicit strategies for measuring dignity-conserving care. In practice the majority of current NH indicators of quality care are derived from information that is routinely collected on NH residents using the RAI-Minimum Data Set (MDS). In this regard, issues that are more tangible to resident dignity such as being treated with respect, compassion, and having opportunities to engage with others are not adequately captured in current NH quality of care indicators. An initial set of markers was created by conducting an integrative literature review of existing markers and indicators of dignity in the NH setting. A modified Delphi process was used to prioritize essential dignity-conserving care markers for use by NH providers, based on factors such as the importance to fostering a culture of dignity, the impact it may have on the residents, and how achievable it is in practice. Through this consensus building technique, we were able to develop a comprehensive set of markers that capture the range and diversity of important dignity-conserving care strategies for use in NHs. The final 10 markers were judged as having high face validity by experts in the field and have explicit implications for enhancing the provision of daily dignified care to NH residents. These markers make an important addition to the traditional quality indicators used in the NH setting and as such, bridge an important gap in addressing the psychosocial and the less easily quantified needs of NH residents. PMID:27304853

The Cardiovascular Health in Ambulatory Care Research Team performance indicators for the primary prevention of cardiovascular disease: a modified Delphi panel study.

PubMed

Tu, Jack V; Maclagan, Laura C; Ko, Dennis T; Atzema, Clare L; Booth, Gillian L; Johnston, Sharon; Tu, Karen; Lee, Douglas S; Bierman, Arlene; Hall, Ruth; Bhatia, R Sacha; Gershon, Andrea S; Tobe, Sheldon W; Sanmartin, Claudia; Liu, Peter; Chu, Anna

2017-04-25

High-quality ambulatory care can reduce cardiovascular disease risk, but important gaps exist in the provision of cardiovascular preventive care. We sought to develop a set of key performance indicators that can be used to measure and improve cardiovascular care in the primary care setting. As part of the Cardiovascular Health in Ambulatory Care Research Team initiative, we established a 14-member multidisciplinary expert panel to develop a set of indicators for measuring primary prevention performance in ambulatory cardiovascular care. We used a 2-stage modified Delphi panel process to rate potential indicators, which were identified from the literature and national cardiovascular organizations. The top-rated indicators were pilot tested to determine their measurement feasibility with the use of data routinely collected in the Canadian health care system. A set of 28 indicators of primary prevention performance were identified, which were grouped into 5 domains: risk factor prevalence, screening, management, intermediate outcomes and long-term outcomes. The indicators reflect the major cardiovascular risk factors including smoking, obesity, hypertension, diabetes, dyslipidemia and atrial fibrillation. All indicators were determined to be amenable to measurement with the use of population-based administrative (physician claims, hospital admission, laboratory, medication), survey or electronic medical record databases. The Cardiovascular Health in Ambulatory Care Research Team indicators of primary prevention performance provide a framework for the measurement of cardiovascular primary prevention efforts in Canada. The indicators may be used by clinicians, researchers and policy-makers interested in measuring and improving the prevention of cardiovascular disease in ambulatory care settings. Copyright 2017, Joule Inc. or its licensors.

Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations.

PubMed

Timmings, Caitlyn; Khan, Sobia; Moore, Julia E; Marquez, Christine; Pyka, Kasha; Straus, Sharon E

2016-02-24

To address challenges related to selecting a valid, reliable, and appropriate readiness assessment measure in practice, we developed an online decision support tool to aid frontline implementers in healthcare settings in this process. The focus of this paper is to describe a multi-step, end-user driven approach to developing this tool for use during the planning stages of implementation. A multi-phase, end-user driven approach was used to develop and test the usability of a readiness decision support tool. First, readiness assessment measures that are valid, reliable, and appropriate for healthcare settings were identified from a systematic review. Second, a mapping exercise was performed to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a modified Delphi process was used to collect stakeholder ratings of the included measures on domains of feasibility, relevance, and likelihood to recommend. Fourth, two versions of a decision support tool prototype were developed and evaluated for usability. Nine valid and reliable readiness assessment measures were included in the decision support tool. The mapping exercise revealed that of the nine measures, most measures (78 %) focused on assessing readiness for change at the organizational versus the individual level, and that four measures (44 %) represented all constructs of organizational readiness. During the modified Delphi process, stakeholders rated most measures as feasible and relevant for use in practice, and reported that they would be likely to recommend use of most measures. Using data from the mapping exercise and stakeholder panel, an algorithm was developed to link users to a measure based on characteristics of their organizational setting and their readiness for change assessment priorities. Usability testing yielded recommendations that were used to refine the Ready, Set, Change! decision support tool . Ready, Set, Change! decision support tool is an implementation support that is designed to facilitate the routine incorporation of a readiness assessment as an early step in implementation. Use of this tool in practice may offer time and resource-saving implications for implementation.

The establishment of the evaluation model for pupil's lunch suppliers

NASA Astrophysics Data System (ADS)

Lo, Chih-Yao; Hou, Cheng-I.; Ma, Rosa

2011-10-01

The aim of this study is the establishment of the evaluation model for the government-controlled private suppliers for school lunches in the public middle and primary schools in Miao-Li County. After finishing the literature search and the integration of the opinions from anonymous experts by Modified Delphi Method, the grade forms from relevant schools in and outside the Miao-Li County will firstly be collected and the delaminated structures for evaluation be constructed. Then, the data analysis will be performed on those retrieved questionnaires designed in accordance with the Analytic Hierarchy Process (AHP). Finally, the evaluation form for the government-controlled private suppliers can be constructed and presented in the hope of benefiting the personnel in charge of school meal purchasing.

Cost estimation: An expert-opinion approach. [cost analysis of research projects using the Delphi method (forecasting)

NASA Technical Reports Server (NTRS)

Buffalano, C.; Fogleman, S.; Gielecki, M.

1976-01-01

A methodology is outlined which can be used to estimate the costs of research and development projects. The approach uses the Delphi technique a method developed by the Rand Corporation for systematically eliciting and evaluating group judgments in an objective manner. The use of the Delphi allows for the integration of expert opinion into the cost-estimating process in a consistent and rigorous fashion. This approach can also signal potential cost-problem areas. This result can be a useful tool in planning additional cost analysis or in estimating contingency funds. A Monte Carlo approach is also examined.

Expert opinion on "best practices" in the delivery of health care services to immigrants in Denmark.

PubMed

Jensen, Natasja Koitzsch; Nielsen, Signe Smith; Krasnik, Allan

2010-08-01

Delivery of health care to immigrants is an emerging field of interest. Immigrants are frequently characterised by health outcomes that are inferior to those of other groups with regard to morbidity and mortality. In addition, health professionals report difficulties associated with the encounter with immigrant patients. A Delphi process with eight Danish experts from the field of immigrant health was performed as part of an EU project. The objective of the Delphi process was to investigate expert opinion on "best practice in the delivery of healthcare to immigrants". Initially, 60 factors were suggested by the experts. Next, these factors were summarised into 32 factors that the experts were invited to rate and, if possible, agree on. The top 11 factors identified in the Delphi process were access to interpreters, quality of interpretation, ensuring medication compliance, having sufficient consultation time, coherence of offers, interdisciplinary collaboration, allocation of resources, the role of the practitioner, acknowledgement of the individual patient, education of health professionals and students and access to telephone interpretation to supplement other services. The Delphi process can be a valuable tool in the investigation of expert opinion and may thereby help to guide future policy directives. In the light of the importance experts placed on access to interpreters and on the quality of the interpretation services offered, it seems as an untenable strategy to introduce as from June 2011 self-payment for interpretation services provided to immigrants who have stayed in the country for more than seven years.

[Austrian guideline for palliative sedation therapy (long version) : Results of a Delphi process of the Austrian Palliative Society (OPG)].

PubMed

Weixler, Dietmar; Roider-Schur, Sophie; Likar, Rudolf; Bozzaro, Claudia; Daniczek, Thomas; Feichtner, Angelika; Gabl, Christoph; Hammerl-Ferrari, Bernhard; Kletecka-Pulker, Maria; Körtner, Ulrich H J; Kössler, Hilde; Meran, Johannes G; Miksovsky, Aurelia; Pusswald, Bettina; Wienerroither, Thomas; Watzke, Herbert

2017-02-01

Palliative sedation therapy (PST) is an important and ethically accepted therapy in the care of selected palliative care patients with otherwise unbearable suffering from refractory distress. PST is increasingly used in end-of-life care. Austria does not have a standardized ethical guideline for this exceptional practice near end of life, but there is evidence that practice varies throughout the country. The Austrian Palliative Society (OPG) nominated a multidisciplinary working group of 16 palliative care experts and ethicists who established the national guideline on the basis of recent review work with the aim to adhere to the Europeans Association of Palliative Care's (EAPC) framework on palliative sedation therapy respecting Austrians legal, structural and cultural background. Consensus was achieved by a four-step sequential Delphi process. The Delphi-process was strictly orientated to the recently published EUROIMPACT-sedation-study-checklist and to the AGREE-2-tool. Additionally national stakeholders participated in the reflection of the results. As a result of a rigorous consensus process the long version of the Austrian National Palliative Sedation Guideline contains 112 statements within eleven domains and is supplemented by a philosophers excursus on suffering. By establishing a national guideline for palliative sedation therapy using the Delphi technique for consensus and stakeholder involvement the Austrian Palliative Society aims to ensure nationwide good practice of palliative sedation therapy. Screening for the practicability and efficacy of this guideline will be a future task.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas.

PubMed

Hoekstra, Dyon; Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-08-04

The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Research priorities of the Canadian chiropractic profession: a consensus study using a modified Delphi technique.

PubMed

French, Simon D; Beliveau, Peter J H; Bruno, Paul; Passmore, Steven R; Hayden, Jill A; Srbely, John; Kawchuk, Greg N

2017-01-01

Research funds are limited and a healthcare profession that supports research activity should establish research priority areas. The study objective was to identify research priority areas for the Canadian chiropractic profession, and for stakeholders in the chiropractic profession to rank these in order of importance. We conducted a modified Delphi consensus study between August 2015 and May 2017 to determine the views of Canadian chiropractic organisations (e.g. Canadian Chiropractic Association; provincial associations) and stakeholder groups (e.g. chiropractic educational institutions; researchers). Participants completed three online Delphi survey rounds. In Round 1, participants suggested research areas within four broad research themes: 1) Basic science; 2) Clinical; 3) Health services; and 4) Population health. In Round 2, researchers created sub-themes by categorising the areas suggested in Round 1, and participants judged the importance of the research sub-themes. We defined consensus as at least 70% of participants agreeing that a research area was "essential" or "very important". In Round 3, results from Round 2 were presented to the participants to re-evaluate the importance of sub-themes. Finally, participants completed an online pairwise ranking activity to determine the rank order of the list of important research sub-themes. Fifty-seven participants, of 85 people invited, completed Round 1 (response rate 67%). Fifty-six participants completed Round 2, 55 completed Round 3, and 53 completed the ranking activity. After three Delphi rounds and the pairwise ranking activity was completed, the ranked list of research sub-themes considered important were: 1) Integration of chiropractic care into multidisciplinary settings; 2) Costs and cost-effectiveness of chiropractic care; 3) Effect of chiropractic care on reducing medical services; 4) Effects of chiropractic care; 5) Safety/side effects of chiropractic care; 6) Chiropractic care for older adults; 7) Neurophysiological mechanisms and effects of spinal manipulative therapy; 8) General mechanisms and effects of spinal manipulative therapy. This project identified research priority areas for the Canadian chiropractic profession. The top three priority areas were all in the area of health services research: 1) Integration of chiropractic care into multidisciplinary settings; 2) Costs and cost-effectiveness of chiropractic care; 3) Effect of chiropractic care on reducing medical services.

Framework of behavioral indicators evaluating TB health promotion outcomes: a modified Delphi study of TB policymakers and health workers.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Oren, Eyal; Cao, Jia

2015-12-15

Although TB health promotion directed at policy makers and healthcare workers (HCWs) is considered important to tuberculosis (TB) control, no indicators currently assess the impact of such promotional activities. This article is the second in a series of papers that seek to establish a framework of behavioral indicators for outcome evaluation of TB health promotion, using the Delphi method. In the first article, we sought to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. The objective of this second article is to present an indicator framework that can be used to assess behavioral outcomes of TB health promotion directed at policy makers and HCWs. A two-round, modified Delphi method was used to establish the indicators. Sixteen experts who were knowledgeable and experienced in the field of TB control were consulted in Delphi surveys. A questionnaire was developed following 4 steps, and involved ranking indicators on a five-point Likert scale. The consensus level was 70 %. Median, mode, and Coefficient of variation (CV) were used to describe expert responses. An authority coefficient (Cr) was used to assess the degree of each expert's authority. Consensus was achieved following the two survey rounds and several iterations among the experts. For TB health-promotion activities directed at policymakers, the experts reached consensus on 2 domains ("Resource inputs" and "Policymaking and monitoring behaviors"), 4 subdomains ("Human resources" among others), and 13 indicators ("Human resources per 100,000 person" among others). For TB health-promotion activities directed at HCWs, the experts reached consensus on 5 domains ("Self-protective behaviors" among others), 6 sub-domains ("Preventing infection" among others), and 15 indicators ("Average hours of daily workplace disinfection by ultraviolet radiation" among others). This study identified a conceptual framework of core behavioral indicators to evaluate TB health-promotion activities directed at policymakers and HCWs involved in TB control. Validation in other parts of the world could lead to global consensus on behavioral indicators to evaluate TB health promotion targeted at policymakers and HCWs.

Reaching consensus on the physiotherapeutic management of patients following upper abdominal surgery: a pragmatic approach to interpret equivocal evidence.

PubMed

Hanekom, Susan D; Brooks, Dina; Denehy, Linda; Fagevik-Olsén, Monika; Hardcastle, Timothy C; Manie, Shamila; Louw, Quinette

2012-02-06

Postoperative pulmonary complications remain the most significant cause of morbidity following open upper abdominal surgery despite advances in perioperative care. However, due to the poor quality primary research uncertainty surrounding the value of prophylactic physiotherapy intervention in the management of patients following abdominal surgery persists. The Delphi process has been proposed as a pragmatic methodology to guide clinical practice when evidence is equivocal. The objective was to develop a clinical management algorithm for the post operative management of abdominal surgery patients. Eleven draft algorithm statements extracted from the extant literature by the primary research team were verified and rated by scientist clinicians (n=5) in an electronic three round Delphi process. Algorithm statements which reached a priori defined consensus-semi-interquartile range (SIQR)<0.5-were collated into the algorithm. The five panelists allocated to the abdominal surgery Delphi panel were from Australia, Canada, Sweden, and South Africa. The 11 draft algorithm statements were edited and 5 additional statements were formulated. The panel reached consensus on the rating of all statements. Four statements were rated essential. An expert Delphi panel interpreted the equivocal evidence for the physiotherapeutic management of patients following upper abdominal surgery. Through a process of consensus a clinical management algorithm was formulated. This algorithm can now be used by clinicians to guide clinical practice in this population.

Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment.

PubMed

Hepworth, Lauren R; Rowe, Fiona J

2018-02-01

The aim of this study was to ascertain what items stroke survivors and stroke care professionals think are important when assessing quality of life for stroke survivors with visual impairment for inclusion in the new patient-reported outcome measure. A reactive Delphi process was used in a three-round electronic-based survey. The items presented consisted of 62 items originally sourced from a systematic review of existing vision-related quality of life instruments and stroke survivor interviews, reduced and refined following a ranking exercise and pilot with stroke survivors with visual impairment. Stakeholders (stroke survivors/clinicians) were invited to take part in the process. A consensus definition of ≥70% was decided a priori. Participants were asked to rank importance on a 9-point scale and categorize the items by relevance to types of visual impairment following stroke or not relevant. Analysis of consensus, stability, and agreement was conducted. In total, 113 participants registered for the Delphi survey of which 47 (41.6%) completed all three rounds. Response rates to the three rounds were 78/113 (69.0%), 61/76 (81.3%), and 49/64 (76.6%), respectively. The participants included orthoptists (45.4%), occupational therapists (44.3%), and stroke survivors (10.3%). Consensus was reached on 56.5% of items in the three-round process, all for inclusion. A consensus was reached for 83.8% in the categorization of items. The majority (82.6%) of consensus were for relevant to 'all visual impairment following stroke'; two items were deemed 'not relevant'. The lack of item reduction achieved by this Delphi process highlights the need for additional methods of item reduction in the development of a new PROM for visual impairment following stroke. These results will be considered alongside Rasch analysis to achieve further item reduction. However, the Delphi survey remains important as it provides clinical and patient insight into each item rather than purely relying on the psychometric data.

[A model for shared decision-making with frail older patients: consensus reached using Delphi technique].

PubMed

van de Pol, M H J; Fluit, C R M G; Lagro, J; Lagro-Janssen, A L M; Olde Rikkert, M G M

2017-01-01

To develop a model for shared decision-making with frail older patients. Online Delphi forum. We used a three-round Delphi technique to reach consensus on the structure of a model for shared decision-making with older patients. The expert panel consisted of 16 patients (round 1), and 59 professionals (rounds 1-3). In round 1, the panel of experts was asked about important steps in the process of shared decision-making and the draft model was introduced. Rounds 2 and 3 were used to adapt the model and test it for 'importance' and 'feasibility'. Consensus for the dynamic shared decision-making model as a whole was achieved for both importance (91% panel agreement) and feasibility (76% panel agreement). Shared decision-making with older patients is a dynamic process. It requires a continuous supportive dialogue between health care professional and patient.

Ten years of the International Patient Decision Aid Standards Collaboration: evolution of the core dimensions for assessing the quality of patient decision aids

PubMed Central

2013-01-01

In 2003, the International Patient Decision Aid Standards (IPDAS) Collaboration was established to enhance the quality and effectiveness of patient decision aids by establishing an evidence-informed framework for improving their content, development, implementation, and evaluation. Over this 10 year period, the Collaboration has established: a) the background document on 12 core dimensions to inform the original modified Delphi process to establish the IPDAS checklist (74 items); b) the valid and reliable IPDAS instrument (47 items); and c) the IPDAS qualifying (6 items), certifying (6 items + 4 items for screening), and quality criteria (28 items). The objective of this paper is to describe the evolution of the IPDAS Collaboration and discuss the standardized process used to update the background documents on the theoretical rationales, evidence and emerging issues underlying the 12 core dimensions for assessing the quality of patient decision aids. PMID:24624947

Improving Global Health Education: Development of a Global Health Competency Model

PubMed Central

Ablah, Elizabeth; Biberman, Dorothy A.; Weist, Elizabeth M.; Buekens, Pierre; Bentley, Margaret E.; Burke, Donald; Finnegan, John R.; Flahault, Antoine; Frenk, Julio; Gotsch, Audrey R.; Klag, Michael J.; Lopez, Mario Henry Rodriguez; Nasca, Philip; Shortell, Stephen; Spencer, Harrison C.

2014-01-01

Although global health is a recommended content area for the future of education in public health, no standardized global health competency model existed for master-level public health students. Without such a competency model, academic institutions are challenged to ensure that students are able to demonstrate the knowledge, skills, and attitudes (KSAs) needed for successful performance in today's global health workforce. The Association of Schools of Public Health (ASPH) sought to address this need by facilitating the development of a global health competency model through a multistage modified-Delphi process. Practitioners and academic global health experts provided leadership and guidance throughout the competency development process. The resulting product, the Global Health Competency Model 1.1, includes seven domains and 36 competencies. The Global Health Competency Model 1.1 provides a platform for engaging educators, students, and global health employers in discussion of the KSAs needed to improve human health on a global scale. PMID:24445206

Academic Primer Series: Key Papers About Competency-Based Medical Education.

PubMed

Cooney, Robert; Chan, Teresa M; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-06-01

Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Based on the online discussions of the 2016-2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs.

Competency-Based Framework and Continuing Education for Preparing a Skilled School Health Workforce for Asthma Care: The Colorado Experience

ERIC Educational Resources Information Center

Cicutto, Lisa; Gleason, Melanie; Haas-Howard, Christy; Jenkins-Nygren, Lynn; Labonde, Susan; Patrick, Kathy

2017-01-01

School health teams commonly address the needs of students with asthma, which requires specific knowledge and skills. To develop a skilled school health team, a competency-based framework for managing asthma in schools was developed. A modified Delphi with 31 panelists was completed. Consensus (=80% agreement) was reached for all 148 items…

What is a Baseline for Effective Information Technology Governance for Higher Education Institutions that are Members of Research University CIO Conclave in United States?

ERIC Educational Resources Information Center

Mohseni, Maryam

2012-01-01

This research study provides the findings of a modified Delphi methodology conducted to define components and baseline for effective information technology governance for higher education institutions member of the Research University CIO Conclave (RUCC) in United States. The participating experts are Chief Information Officers (CIOs) of…

Assessing the Animal Science Technical Skills Needed by Secondary Agricultural Education Graduates for Employment in the Animal Industries: A Modified Delphi Study

ERIC Educational Resources Information Center

Slusher, Wendy L.; Robinson, J. Shane; Edwards, M. Craig

2011-01-01

Career and technical education courses, such as agricultural education, exist, in part, to assist students in acquiring the competencies needed to achieve employability. However, whether the current secondary agricultural education curriculum meets the needs of industry leaders who employ high school graduates of agricultural education programs is…

A practical guideline for examining a uterine niche using ultrasonography in non-pregnant women: a modified Delphi method amongst European experts.

PubMed

Jordans, I P M; de Leeuw, R; Stegwee, S I; Amso, N N; Barri-Soldevila, P N; van den Bosch, T; Bourne, T; Brolmann, H A M; Donnez, O; Dueholm, M; Hehenkamp, W J K; Jastrow, N; Jurkovic, D; Mashiach, R; Naji, O; Streuli, I; Timmerman, D; Vd Voet, L F; Huirne, J A F

2018-03-14

To generate a uniform, internationally recognized guideline for detailed uterine niche evaluation by ultrasonography in non-pregnant women using a modified Delphi method amongst international experts. Fifteen international gynecological experts were recruited by their membership of the European niche taskforce group. All experts were physicians with extensive experience in niche evaluation in clinical practice and/or authors of niche studies. Relevant items for niche measurement were determined based on the results of a literature search and recommendations of a focus group. Two online questionnaires were sent to the expert panel and one group meeting was organized. Consensus was predefined as a consensus rate of at least 70%. In total 15 experts participated in this study. Consensus was reached for a total of 42 items on niche evaluation, including definitions, relevance, method of measurement and tips for visualization of the niche. All experts agreed on the proposed guideline for niche evaluation in non-pregnant women as presented in this paper. Consensus between niche experts was achieved on all items regarding ultrasonographic niche measurement. This article is protected by copyright. All rights reserved.

Unified treatment algorithm for the management of crotaline snakebite in the United States: results of an evidence-informed consensus workshop

PubMed Central

2011-01-01

Background Envenomation by crotaline snakes (rattlesnake, cottonmouth, copperhead) is a complex, potentially lethal condition affecting thousands of people in the United States each year. Treatment of crotaline envenomation is not standardized, and significant variation in practice exists. Methods A geographically diverse panel of experts was convened for the purpose of deriving an evidence-informed unified treatment algorithm. Research staff analyzed the extant medical literature and performed targeted analyses of existing databases to inform specific clinical decisions. A trained external facilitator used modified Delphi and structured consensus methodology to achieve consensus on the final treatment algorithm. Results A unified treatment algorithm was produced and endorsed by all nine expert panel members. This algorithm provides guidance about clinical and laboratory observations, indications for and dosing of antivenom, adjunctive therapies, post-stabilization care, and management of complications from envenomation and therapy. Conclusions Clinical manifestations and ideal treatment of crotaline snakebite differ greatly, and can result in severe complications. Using a modified Delphi method, we provide evidence-informed treatment guidelines in an attempt to reduce variation in care and possibly improve clinical outcomes. PMID:21291549

Reflections of Tomorrow: Lifelong Learning and the Public Library (A Delphi Study). Excerpts.

ERIC Educational Resources Information Center

Weingand, Darlene E.

This study focuses on the question of whether the public library can or will be one of the non-formal providers of lifelong learning in Minnesota, and uses the Delphi method to discover in what way the public library as it is perceived by various publics could become an active participant in this dimension of the educational process. Five groups…

Consolidated principles for screening based on a systematic review and consensus process.

PubMed

Dobrow, Mark J; Hagens, Victoria; Chafe, Roger; Sullivan, Terrence; Rabeneck, Linda

2018-04-09

In 1968, Wilson and Jungner published 10 principles of screening that often represent the de facto starting point for screening decisions today; 50 years on, are these principles still the right ones? Our objectives were to review published work that presents principles for population-based screening decisions since Wilson and Jungner's seminal publication, and to conduct a Delphi consensus process to assess the review results. We conducted a systematic review and modified Delphi consensus process. We searched multiple databases for articles published in English in 1968 or later that were intended to guide population-based screening decisions, described development and modification of principles, and presented principles as a set or list. Identified sets were compared for basic characteristics (e.g., number, categorization), a citation analysis was conducted, and principles were iteratively synthesized and consolidated into categories to assess evolution. Participants in the consensus process assessed the level of agreement with the importance and interpretability of the consolidated screening principles. We identified 41 sets and 367 unique principles. Each unique principle was coded to 12 consolidated decision principles that were further categorized as disease/condition, test/intervention or program/system principles. Program or system issues were the focus of 3 of Wilson and Jungner's 10 principles, but comprised almost half of all unique principles identified in the review. The 12 consolidated principles were assessed through 2 rounds of the consensus process, leading to specific refinements to improve their relevance and interpretability. No gaps or missing principles were identified. Wilson and Jungner's principles are remarkably enduring, but increasingly reflect a truncated version of contemporary thinking on screening that does not fully capture subsequent focus on program or system principles. Ultimately, this review and consensus process provides a comprehensive and iterative modernization of guidance to inform population-based screening decisions. © 2018 Joule Inc. or its licensors.

Consolidated principles for screening based on a systematic review and consensus process

PubMed Central

Hagens, Victoria; Chafe, Roger; Sullivan, Terrence; Rabeneck, Linda

2018-01-01

BACKGROUND: In 1968, Wilson and Jungner published 10 principles of screening that often represent the de facto starting point for screening decisions today; 50 years on, are these principles still the right ones? Our objectives were to review published work that presents principles for population-based screening decisions since Wilson and Jungner’s seminal publication, and to conduct a Delphi consensus process to assess the review results. METHODS: We conducted a systematic review and modified Delphi consensus process. We searched multiple databases for articles published in English in 1968 or later that were intended to guide population-based screening decisions, described development and modification of principles, and presented principles as a set or list. Identified sets were compared for basic characteristics (e.g., number, categorization), a citation analysis was conducted, and principles were iteratively synthesized and consolidated into categories to assess evolution. Participants in the consensus process assessed the level of agreement with the importance and interpretability of the consolidated screening principles. RESULTS: We identified 41 sets and 367 unique principles. Each unique principle was coded to 12 consolidated decision principles that were further categorized as disease/condition, test/intervention or program/system principles. Program or system issues were the focus of 3 of Wilson and Jungner’s 10 principles, but comprised almost half of all unique principles identified in the review. The 12 consolidated principles were assessed through 2 rounds of the consensus process, leading to specific refinements to improve their relevance and interpretability. No gaps or missing principles were identified. INTERPRETATION: Wilson and Jungner’s principles are remarkably enduring, but increasingly reflect a truncated version of contemporary thinking on screening that does not fully capture subsequent focus on program or system principles. Ultimately, this review and consensus process provides a comprehensive and iterative modernization of guidance to inform population-based screening decisions. PMID:29632037

High performance interactive graphics for shower reconstruction in HPC, the DELPHI barrel electromagnetic calorimeter

DOE Office of Scientific and Technical Information (OSTI.GOV)

Stanescu, C.

1990-08-01

Complex software for shower reconstruction in DELPHI barrel electromagnetic calorimeter which deals, for each event, with great amounts of information, due to the high spatial resolution of this detector, needs powerful verification tools. An interactive graphics program, running on high performance graphics display system Whizzard 7555 from Megatek, was developed to display the logical steps in showers and their axes reconstruction. The program allows both operations on the image in real-time (rotation, translation and zoom) and the use of non-geometrical criteria to modify it (as the use of energy) thresholds for the representation of the elements that compound the showersmore » (or of the associated lego plots). For this purpose graphics objects associated to user parameters were defined. Instancing and modelling features of the native graphics library were extensively used.« less

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people

PubMed Central

Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Background Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Methods Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Results Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Conclusion Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond. PMID:29155870

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people.

PubMed

Stewart, Derek; Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond.

Outcomes of Moral Case Deliberation - the development of an evaluation instrument for clinical ethics support (the Euro-MCD)

PubMed Central

2014-01-01

Background Clinical ethics support, in particular Moral Case Deliberation, aims to support health care providers to manage ethically difficult situations. However, there is a lack of evaluation instruments regarding outcomes of clinical ethics support in general and regarding Moral Case Deliberation (MCD) in particular. There also is a lack of clarity and consensuses regarding which MCD outcomes are beneficial. In addition, MCD outcomes might be context-sensitive. Against this background, there is a need for a standardised but flexible outcome evaluation instrument. The aim of this study was to develop a multi-contextual evaluation instrument measuring health care providers’ experiences and perceived importance of outcomes of Moral Case Deliberation. Methods A multi-item instrument for assessing outcomes of Moral Case Deliberation (MCD) was constructed through an iterative process, founded on a literature review and modified through a multistep review by ethicists and health care providers. The instrument measures perceived importance of outcomes before and after MCD, as well as experienced outcomes during MCD and in daily work. A purposeful sample of 86 European participants contributed to a Delphi panel and content validity testing. The Delphi panel (n = 13), consisting of ethicists and ethics researchers, participated in three Delphi-rounds. Health care providers (n = 73) participated in the content validity testing through ‘think-aloud’ interviews and a method using Content Validity Index. Results The development process resulted in the European Moral Case Deliberation Outcomes Instrument (Euro-MCD), which consists of two sections, one to be completed before a participant’s first MCD and the other after completing multiple MCDs. The instrument contains a few open-ended questions and 26 specific items with a corresponding rating/response scale representing various MCD outcomes. The items were categorised into the following six domains: Enhanced emotional support, Enhanced collaboration, Improved moral reflexivity, Improved moral attitude, Improvement on organizational level and Concrete results. Conclusions A tentative instrument has been developed that seems to cover main outcomes of Moral Case Deliberation. The next step will be to test the Euro-MCD in a field study. PMID:24712735

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study.

PubMed

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-08-18

The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Outcomes of moral case deliberation--the development of an evaluation instrument for clinical ethics support (the Euro-MCD).

PubMed

Svantesson, Mia; Karlsson, Jan; Boitte, Pierre; Schildman, Jan; Dauwerse, Linda; Widdershoven, Guy; Pedersen, Reidar; Huisman, Martijn; Molewijk, Bert

2014-04-08

Clinical ethics support, in particular Moral Case Deliberation, aims to support health care providers to manage ethically difficult situations. However, there is a lack of evaluation instruments regarding outcomes of clinical ethics support in general and regarding Moral Case Deliberation (MCD) in particular. There also is a lack of clarity and consensuses regarding which MCD outcomes are beneficial. In addition, MCD outcomes might be context-sensitive. Against this background, there is a need for a standardised but flexible outcome evaluation instrument. The aim of this study was to develop a multi-contextual evaluation instrument measuring health care providers' experiences and perceived importance of outcomes of Moral Case Deliberation. A multi-item instrument for assessing outcomes of Moral Case Deliberation (MCD) was constructed through an iterative process, founded on a literature review and modified through a multistep review by ethicists and health care providers. The instrument measures perceived importance of outcomes before and after MCD, as well as experienced outcomes during MCD and in daily work. A purposeful sample of 86 European participants contributed to a Delphi panel and content validity testing. The Delphi panel (n = 13), consisting of ethicists and ethics researchers, participated in three Delphi-rounds. Health care providers (n = 73) participated in the content validity testing through 'think-aloud' interviews and a method using Content Validity Index. The development process resulted in the European Moral Case Deliberation Outcomes Instrument (Euro-MCD), which consists of two sections, one to be completed before a participant's first MCD and the other after completing multiple MCDs. The instrument contains a few open-ended questions and 26 specific items with a corresponding rating/response scale representing various MCD outcomes. The items were categorised into the following six domains: Enhanced emotional support, Enhanced collaboration, Improved moral reflexivity, Improved moral attitude, Improvement on organizational level and Concrete results. A tentative instrument has been developed that seems to cover main outcomes of Moral Case Deliberation. The next step will be to test the Euro-MCD in a field study.

A Delphi approach to reach consensus on primary care guidelines regarding youth violence prevention.

PubMed

De Vos, Edward; Spivak, Howard; Hatmaker-Flanigan, Elizabeth; Sege, Robert D

2006-10-01

Anticipatory guidance is a cornerstone of modern pediatric practice. In recognition of its importance for child well being, injury prevention counseling is a standard element of that guidance. Over the last 20 years, there has been growing recognition that intentional injury or violence is one of the leading causes of morbidity and mortality among youth. The US Surgeon General identified youth violence as a major public health issue and a top priority. Yet, only recently has the scope of injury prevention counseling been expanded to include violence. Pediatric health care providers agree that youth violence-prevention counseling should be provided, yet the number of topics available, the already lengthy list of other anticipatory guidance topics to be covered, developmental considerations, and the evidence base make the selection of an agreed-on set a considerable challenge. The purpose of this study was to systematically identify and prioritize specific counseling topics in violence prevention that could be integrated into anticipatory guidance best practice. A modified electronic Delphi process was used to gain consensus among 50 national multidisciplinary violence-prevention experts. Participants were unaware of other participants' identities. The process consisted of 4 serial rounds of inquiry beginning with a broad open-ended format for the generation of anticipatory guidance and screening topics across 5 age groups (infant, toddler, school age, adolescent, and all ages). Each subsequent round narrowed the list of topics toward the development of a manageable set of essential topics for screening and counseling about positive youth development and violence prevention. Forty-seven unique topics were identified, spanning birth to age 21 years. Topics cover 4 broad categories (building blocks): physical safety, parent centered, child centered, and community connection. Participants placed topics into their developmentally appropriate visit-based schedule and made suggestions for an appropriate topic reinforcement schedule. The resulting schedule provides topics for introduction and reinforcement at each visit. The Delphi technique proved a useful approach for accessing expert opinion, for analyzing and synthesizing results, for achieving consensus, and for setting priorities among the numerous anticipatory guidance and assessment topics relevant for raising resilient, violence-free youth.

A core outcome set for localised prostate cancer effectiveness trials: protocol for a systematic review of the literature and stakeholder involvement through interviews and a Delphi survey.

PubMed

MacLennan, Steven; Bekema, Hendrika J; Williamson, Paula R; Campbell, Marion K; Stewart, Fiona; MacLennan, Sara J; N'Dow, James M O; Lam, Thomas B L

2015-03-04

Prostate cancer is a growing health problem worldwide. The management of localised prostate cancer is controversial. It is unclear which of several surgical, radiotherapeutic, ablative, and surveillance treatments is the most effective. All have cost, process and recovery, and morbidity implications which add to treatment decision-making complexity for patients and healthcare professionals. Evidence from randomised controlled trials (RCTs) is not optimal because of uncertainty as to what constitutes important outcomes. Another issue hampering evidence synthesis is heterogeneity of outcome definition, measurement, and reporting. This project aims to determine which outcomes are the most important to patients and healthcare professionals, and use these findings to recommend a standardised core outcome set for comparative effectiveness trials of treatments for localised prostate cancer, to optimise decision-making. The range of potentially important outcomes and measures will be identified through systematic reviews of the literature and semi-structured interviews with patients. A consultation exercise involving representatives from two key stakeholder groups (patients and healthcare professionals) will ratify the list of outcomes to be entered into a three round Delphi study. The Delphi process will refine and prioritise the list of identified outcomes. A methodological substudy (nested RCT design) will also be undertaken. Participants will be randomised after round one of the Delphi study to one of three feedback groups, based on different feedback strategies, in order to explore the potential impact of feedback strategies on participant responses. This may assist the design of a future core outcome set and Delphi studies. Following the Delphi study, a final consensus meeting attended by representatives from both stakeholder groups will determine the final recommended core outcome set. This study will inform clinical practice and future trials of interventions of localised prostate cancer by standardising a core outcome set which should be considered in comparative effectiveness studies for localised prostate cancer.

Priorities for research in child maltreatment, intimate partner violence and resilience to violence exposures: results of an international Delphi consensus development process.

PubMed

Wathen, C Nadine; MacGregor, Jennifer C D; Hammerton, Joanne; Coben, Jeffrey H; Herrman, Helen; Stewart, Donna E; MacMillan, Harriet L

2012-08-21

Intimate partner violence (IPV) and child maltreatment (CM) are major global public health problems. The Preventing Violence Across the Lifespan (PreVAiL) Research Network, an international group of over 60 researchers and national and international knowledge-user partners in CM and IPV, sought to identify evidence-based research priorities in IPV and CM, with a focus on resilience, using a modified Delphi consensus development process. Review of existing empirical evidence, PreVAiL documents and team discussion identified a starting list of 20 priorities in the following categories: resilience to violence exposure (RES), CM, and IPV, as well as priorities that cross-cut the content areas (CC), and others specific to research methodologies (RM) in violence research. PreVAiL members (N = 47) completed two online survey rounds, and one round of discussions via three teleconference calls to rate, rank and refine research priorities. Research priorities were: to examine key elements of promising or successful programmes in RES/CM/IPV to build intervention pilot work; CC: to integrate violence questions into national and international surveys, and RM: to investigate methods for collecting and collating datasets to link data and to conduct pooled, meta and sub-group analyses to identify promising interventions for particular groups. These evidence-based research priorities, developed by an international team of violence, gender and mental health researchers and knowledge-user partners, are of relevance for prevention and resilience-oriented research in the areas of IPV and CM.

Priorities for research in child maltreatment, intimate partner violence and resilience to violence exposures: results of an international Delphi consensus development process

PubMed Central

2012-01-01

Background Intimate partner violence (IPV) and child maltreatment (CM) are major global public health problems. The Preventing Violence Across the Lifespan (PreVAiL) Research Network, an international group of over 60 researchers and national and international knowledge-user partners in CM and IPV, sought to identify evidence-based research priorities in IPV and CM, with a focus on resilience, using a modified Delphi consensus development process. Methods Review of existing empirical evidence, PreVAiL documents and team discussion identified a starting list of 20 priorities in the following categories: resilience to violence exposure (RES), CM, and IPV, as well as priorities that cross-cut the content areas (CC), and others specific to research methodologies (RM) in violence research. PreVAiL members (N = 47) completed two online survey rounds, and one round of discussions via three teleconference calls to rate, rank and refine research priorities. Results Research priorities were: to examine key elements of promising or successful programmes in RES/CM/IPV to build intervention pilot work; CC: to integrate violence questions into national and international surveys, and RM: to investigate methods for collecting and collating datasets to link data and to conduct pooled, meta and sub-group analyses to identify promising interventions for particular groups. Conclusions These evidence-based research priorities, developed by an international team of violence, gender and mental health researchers and knowledge-user partners, are of relevance for prevention and resilience-oriented research in the areas of IPV and CM. PMID:22908894

The impact of the internet on community pharmacy practice: a comparison of a Delphi panel's forecast with emerging trends.

PubMed

Holmes, Erin R; Tipton, David J; Desselle, Shane P

2002-01-01

The purpose of this study was to forecast the impact of Internet pharmacy commerce on various stakeholders. A panel of experts assembled from a list of academicians in the social and administrative pharmaceutical sciences participated in a three-iteration Delphi procedure. Feedback from the aggregate responses of the panel was used to construct questionnaires employed in subsequent iterations of the Delphi. The panel converged to form a consensus upon a variety of issues. They forecasted the attainment of a 10-15% share in the market of prescription and over-the-counter pharmaceuticals through on-line purchases, the formation of strategic alliances among stakeholders in the drug distribution process, a shift in marketing strategies by brick-and-mortar stores, an increase in the prevalence of niching among pharmacy service providers and a subsequent growth in the implementation of cognitive services throughout the industry. With few exceptions, the forecast produced by the Delphi panel appears to be coming to fruition.

Developing a Consensus-Driven, Core Competency Model to Shape Future Audio Engineering Technology Curriculum: A Web-Based Modified Delphi Study

ERIC Educational Resources Information Center

Tough, David T.

2009-01-01

The purpose of this online study was to create a ranking of essential core competencies and technologies required by AET (audio engineering technology) programs 10 years in the future. The study was designed to facilitate curriculum development and improvement in the rapidly expanding number of small to medium sized audio engineering technology…

Competencies and Experiences Needed by Pre-Service Agricultural Educators to Teach Globalized Curricula: A Modified Delphi Study

ERIC Educational Resources Information Center

Conner, Nathan; Roberts, T. Grady

2013-01-01

The 21st century graduate must be able to interact with people from all over the world and must also be knowledgeable about the world (Longview Foundation, 2008). In order to produce graduates that are globally competent, The National Council for the Accreditation of Teachers (NCATE, 1982) has mandated that multi-cultural education be incorporated…

Technical College Instructors' Perceptions of the Impact of Online Readiness and of Student Support Services on Student Success in Online Courses

ERIC Educational Resources Information Center

Dowd, Nathan

2012-01-01

The purpose of this study is to determine how Wisconsin Technical College (WTCS) administrators and online instructors perceive the impact of online learner readiness and student support services to be on student success in online courses. The study used a modified three-round Delphi technique to determine to collect data. The results indicated…

Foreword: Proceedings From the First Annual Lumbar Total Disc Replacement Summit.

PubMed

Blumenthal, Scott; Buttermann, Glenn; Garcia, Rolando; Gornet, Matthew; Grunch, Betsy; Guyer, Richard; Janssen, Michael; Kimball, Brent; Lewis, Adam; Mesiwala, Ali; Miller, Lynn; Morreale, Joseph; Reed, William; Sandhu, Faheem; Shackleford, Ian; Yue, James; Zigler, Jack; OConnell, Brent; Ferko, Nicole; Hollmann, Sarah

2017-12-15

: This publication focuses on proceedings from the First Annual Lumbar Total Disc Replacement Summit, held October 25, 2016 in Boston, MA. The Summit brought together 17 thought leading surgeons who employed a modified-Delphi method to determine where consensus existed pertaining to the utilization of lumbar total disc replacement as a standard of care for a subpopulation of patients suffering from degenerative disc disease.

Development of an active behavioural physiotherapy intervention (ABPI) for acute whiplash-associated disorder (WAD) II management: a modified Delphi study.

PubMed

Wiangkham, Taweewat; Duda, Joan; Haque, M Sayeed; Rushton, Alison

2016-09-14

To develop an active behavioural physiotherapy intervention (ABPI) for managing acute whiplash-associated disorder (WAD) II using a modified Delphi method to develop consensus for the basic features of the ABPI. Modified Delphi study. Our systematic review and meta-analysis evaluating conservative management for acute WADII found that a combined ABPI may be a useful intervention to prevent patients progressing to chronicity. No previous research has considered a combined behavioural approach and active physiotherapy in the management of acute WADII patients. The ABPI was therefore developed using a rigorous consensus method using international research and local clinical whiplash experts. Descriptive statistics were used to assess consensus in each round. Online international survey. A purposive sample of 97 potential participants (aiming to recruit n=30) consisting of international research whiplash experts, UK private physiotherapists and UK postgraduate musculoskeletal physiotherapy students were invited to participate via electronic mail with an attached participant information sheet and consent form. 36 individuals signed and returned the consent form. In round 1, 32/36 participants (response rate=89%, mean age±SD=36.03±13.22 years) across 8 countries (Australia, Finland, Greece, India, Netherlands, Norway, Sweden and UK) contributed to round 1 questionnaire. Response rates were 78% and 75% for rounds 2 and 3, respectively. Following round 3, 12 underlying principles (eg, return to normal function as soon as possible, pain management, encouragement of self-management, reduce fear avoidance and anxiety) achieved consensus. The treatment components reaching consensus included behavioural (eg, education, reassurance, self-management) and physiotherapy components (eg, exercises for stability and mobility). No passive intervention achieved consensus. Experts suggested and agreed the underlying principles and treatment components of the ABPI for the management of acute WADII. The ABPI was underpinned by social cognitive theory focusing on self-efficacy enhancement prior to conducting a phase II trial. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

75 FR 16513 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-01

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8th, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture... location of Delphi Packard Electrical/Electronic Architecture, a subsidiary of Delphi Corporation. The...

The Anatomical Society core regional anatomy syllabus for undergraduate medicine.

PubMed

Smith, C F; Finn, G M; Stewart, J; Atkinson, M A; Davies, D C; Dyball, R; Morris, J; Ockleford, C; Parkin, I; Standring, S; Whiten, S; Wilton, J; McHanwell, S

2016-01-01

The Anatomical Society's core syllabus for anatomy (2003 and later refined in 2007) set out a series of learning outcomes that an individual medical student should achieve on graduation. The core syllabus, with 182 learning outcomes grouped in body regions, referenced in the General Medical Council's Teaching Tomorrow's Doctors, was open to criticism on the grounds that the learning outcomes were generated by a relatively small group of anatomists, albeit some of whom were clinically qualified. We have therefore used a modified Delphi technique to seek a wider consensus. A Delphi panel was constructed involving 'experts' (n = 39). The revised core syllabus of 156 learning outcomes presented here is applicable to all medical programmes and may be used by curriculum planners, teachers and students alike in addressing the perennial question: 'What do I need to know ?' © 2015 Anatomical Society.

National Delphi study to determine competencies for nursing leadership in public health.

PubMed

Misener, T R; Alexander, J W; Blaha, A J; Clarke, P N; Cover, C M; Felton, G M; Fuller, S G; Herman, J; Rodes, M M; Sharp, H F

1997-01-01

To identify competencies needed by nurse leaders in public health programs. Five-round national Delphi. Convenience sample of members of major public health nursing associations and nurse and non-nurse public health leaders in the USA. Mailed survey in 1994-1995 using a modified snowball technique based on a modification of the Pew Foundation health professions' competencies for Round 1. Four additional rounds produced consensus. Initially, 62 competencies were identified. Factor analysis resulted in four factors: political competencies, business acumen, program leadership, and management capabilities; 57 competencies were clustered in the four groupings and accounted for 91.4% of the variance. Graduate schools in nursing and public health must prepare students with broad-based competencies from a variety of disciplines. Findings of this national survey provide a database for curriculum development and evaluation of programs to prepare nurse leaders for roles in public health-based delivery systems.

Defining and identifying concepts of medication literacy: An international perspective.

PubMed

Pouliot, Annie; Vaillancourt, Régis; Stacey, Danielle; Suter, Philippe

2017-11-08

Multiple concepts to define health literacy in the context of medication use exist, such as medication literacy, pharmacotherapy literacy, pharmacy health literacy; however, no studies have looked at consensus among experts internationally. A Delphi process was used to achieve consensus on the statements about medication literacy. Experts for the Delphi were selected from a review of the literature and suggestions from an international survey conducted with members of the International Pharmaceutical Federation on medication literacy. The preliminary Delphi questionnaire was built using the statements about medication literacy found in the scientific literature. Responses and comments were analyzed using a pre-established method and communicated to the experts after each round of Delphi. Statements with an agreement of at least 80% were accepted and used to develop a definition of medication literacy. The Delphi process started with 21 experts and included 4 rounds. Overall, 30 statements regarding medication literacy were accepted and divided into 4 clusters representing: (1) type of information necessary for optimal and safe use of medication, (2) skills and abilities, (3) format of information, and (4) outcomes. These statements were used to propose 2 different definitions of medication literacy. One of the definitions was preferred by 75% of the expert panel, which provided further comments for improvements. Of the 11 experts who answered the final questionnaire, nine strongly agreed with the refined definition. Medication literacy is the degree to which individuals can obtain, comprehend, communicate, calculate and process patient-specific information about their medications to make informed medication and health decisions in order to safely and effectively use their medications, regardless of the mode by which the content is delivered (e.g. written, oral and visual). Future studies should focus on how this definition can be operationalized to support the role that pharmacists and other healthcare providers. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of a clinical definition for acute respiratory distress syndrome using the Delphi technique.

PubMed

Ferguson, Niall D; Davis, Aileen M; Slutsky, Arthur S; Stewart, Thomas E

2005-06-01

The objective of this study is to describe the implementation of formal consensus techniques in the development of a clinical definition for acute respiratory distress syndrome. A Delphi consensus process was conducted using e-mail. Sixteen panelists who were both researchers and opinion leaders were systematically recruited. The Delphi technique was performed over 4 rounds on the background of an explicit definition framework. Item generation was performed in round 1, item reduction in rounds 2 and 3, and definition evaluation in round 4. Explicit consensus thresholds were used throughout. Of the 16 panelists, 11 actually participated in developing a definition that met a priori consensus rules on the third iteration. New incorporations in the Delphi definition include the use of a standardized oxygenation assessment and the documentation of either a predisposing factor or decreased thoracic compliance. The panelists rated the Delphi definition as acceptable to highly acceptable (median score, 6; range, 5-7 on a 7-point Likert scale). We conclude that it is feasible to consider using formal consensus in the development of future definitions of acute respiratory distress syndrome. Testing of sensibility, reliability, and validity are needed for this preliminary definition; these test results should be incorporated into future iterations of this definition.

Developing Canadian oncology education goals and objectives for medical students: a national modified Delphi study.

PubMed

Tam, Vincent C; Ingledew, Paris-Ann; Berry, Scott; Verma, Sunil; Giuliani, Meredith E

2016-01-01

Studies have shown that there is a deficiency in focused oncology teaching during medical school in Canada. This study aimed to develop oncology education goals and objectives for medical students through consensus of oncology educators from across Canada. In 2014 we created a comprehensive list of oncology education objectives using existing resources. Experts in oncology education and undergraduate medical education from all 17 Canadian medical schools were invited to participate in a 3-round modified Delphi process. In round 1, the participants scored the objectives on a 9-point Likert scale according to the degree to which they agreed an objective should be taught to medical students. Objectives with a mean score of 7.0 or greater were retained, those with a mean score of 1.0-3.9 were excluded, and those with a mean score of 4.0-6.9 were discussed at a round 2 Web meeting. In round 3, the participants voted on inclusion and exclusion of the round 2 objectives. Thirty-four (92%) of the 37 invited oncology educators, representing 14 medical schools, participated in the study. They included oncologists, family physicians, members of undergraduate medical education curriculum committees and a psychologist. Of the 214 objectives reviewed in round 1, 146 received a mean score of 7.0 or greater, and 68 were scored 4.0-6.9; no objective received a mean score below 4.0. Nine new objectives were suggested. The main themes of participants' comments were to minimize the number of objectives and to aim objectives at the knowledge level required for family physicians. In round 2, the participants were able to combine 28 of the objectives with other existing objectives. In round 3, 7 of the 49 objectives received consensus of at least 75% for inclusion. The final Canadian Oncology Goals and Objectives for Medical Students contained 10 goals and 153 objectives. Through a systematic process, we created a comprehensive, consensus-based set of oncology goals and objectives to facilitate the design of undergraduate medical education curricula and improve oncology education for medical students.

Validation of the new diagnosis grouping system for pediatric emergency department visits using the International Classification of Diseases, 10th Revision.

PubMed

Lee, Jin Hee; Hong, Ki Jeong; Kim, Do Kyun; Kwak, Young Ho; Jang, Hye Young; Kim, Hahn Bom; Noh, Hyun; Park, Jungho; Song, Bongkyu; Jung, Jae Yun

2013-12-01

A clinically sensible diagnosis grouping system (DGS) is needed for describing pediatric emergency diagnoses for research, medical resource preparedness, and making national policy for pediatric emergency medical care. The Pediatric Emergency Care Applied Research Network (PECARN) developed the DGS successfully. We developed the modified PECARN DGS based on the different pediatric population of South Korea and validated the system to obtain the accurate and comparable epidemiologic data of pediatric emergent conditions of the selected population. The data source used to develop and validate the modified PECARN DGS was the National Emergency Department Information System of South Korea, which was coded by the International Classification of Diseases, 10th Revision (ICD-10) code system. To develop the modified DGS based on ICD-10 code, we matched the selected ICD-10 codes with those of the PECARN DGS by the General Equivalence Mappings (GEMs). After converting ICD-10 codes to ICD-9 codes by GEMs, we matched ICD-9 codes into PECARN DGS categories using the matrix developed by PECARN group. Lastly, we conducted the expert panel survey using Delphi method for the remaining diagnosis codes that were not matched. A total of 1879 ICD-10 codes were used in development of the modified DGS. After 1078 (57.4%) of 1879 ICD-10 codes were assigned to the modified DGS by GEM and PECARN conversion tools, investigators assigned each of the remaining 801 codes (42.6%) to DGS subgroups by 2 rounds of electronic Delphi surveys. And we assigned the remaining 29 codes (4%) into the modified DGS at the second expert consensus meeting. The modified DGS accounts for 98.7% and 95.2% of diagnoses of the 2008 and 2009 National Emergency Department Information System data set. This modified DGS also exhibited strong construct validity using the concepts of age, sex, site of care, and seasons. This also reflected the 2009 outbreak of H1N1 influenza in Korea. We developed and validated clinically feasible and sensible DGS system for describing pediatric emergent conditions in Korea. The modified PECARN DGS showed good comprehensiveness and demonstrated reliable construct validity. This modified DGS based on PECARN DGS framework may be effectively implemented for research, reporting, and resource planning in pediatric emergency system of South Korea.

Determinants of innovation within health care organizations: literature review and Delphi study.

PubMed

Fleuren, Margot; Wiefferink, Karin; Paulussen, Theo

2004-04-01

When introducing innovations to health care, it is important to gain insight into determinants that may facilitate or impede the introduction, in order to design an appropriate strategy for introducing the innovation. To obtain an overview of determinants of innovations in health care organizations, we carried out a literature review and a Delphi study. The Delphi study was intended to achieve consensus among a group of implementation experts on determinants identified from the literature review. We searched 11 databases for articles published between 1990 and 2000. The keywords varied according to the specific database. We also searched for free text. Forty-four implementation experts (implementation researchers, programme managers, and implementation consultants/advisors) participated in the Delphi study. The following studies were selected: (i) studies describing innovation processes, and determinants thereof, in health care organizations; (ii) studies where the aim of the innovations was to change the behaviour of health professionals; (iii) studies where the health care organizations provided direct patient care; and (iv) studies where only empirical studies were included. Two researchers independently selected the abstracts and analysed the articles. The determinants were divided into four categories: characteristics of the environment, characteristics of the organization, characteristics of the user (health professional), and characteristics of the innovation. When analysing the determinants, a distinction was made between systematically designed and non-systematically designed studies. In a systematic study, a determinant analysis was performed and the innovation strategy was adapted to these determinants. Furthermore, the determinants were associated with the degree of implementation, and both users and non-users of the innovation were asked about possible determinants. In the Delphi study, consensus was defined as agreement among 75% of the experts on both the influence of a determinant and the direction towards which that influence tended (i.e. facilitating, impeding, or neutral). From the initial 2239 abstracts, 57 studies were retrieved and 49 determinants were identified that affected (impeded or facilitated) the innovation process. The experts identified one other determinant. Seventeen studies had a more-or-less systematic design; the others did not. After three rounds, consensus was reached on the influence of 49 out of 50 determinants. The results of the literature review matched those found in the Delphi study, and 50 potentially relevant determinants of innovation processes were identified. Many of the innovation studies had several methodological flaws, such as not adjusting innovation strategies to relevant determinants of the innovation process, or that data on determinants were gathered only from non-users. Furthermore, the degree of implementation was evaluated in several ways, which made comparison difficult.

Building Face, Construct, and Content Validity through Use of a Modified Delphi: Adapting Grounded Theory to Build an Environmental Field Days Observation Tool

ERIC Educational Resources Information Center

Heimlich, Joe E.; Carlson, Stephan P.; Storksdieck, Martin

2011-01-01

Environmental field days offer a distinct opportunity to connect students with science and the environment. The literature on field days, informed by research on field trips, provides a framework for best practices. If there are best practices, however, then presence or lack of the practice should have a discernible impact on the outcomes of the…

Testing an Adapted Modified Delphi Method: Synthesizing Multiple Stakeholder Ratings of Health Care Service Effectiveness.

PubMed

Escaron, Anne L; Chang Weir, Rosy; Stanton, Petra; Vangala, Sitaram; Grogan, Tristan R; Clarke, Robin M

2016-03-01

The Affordable Care Act incentivizes health systems for better meeting patient needs, but often guidance about patient preferences for particular health services is limited. All too often vulnerable patient populations are excluded from these decision-making settings. A community-based participatory approach harnesses the in-depth knowledge of those experiencing barriers to health care. We made three modifications to the RAND-UCLA appropriateness method, a modified Delphi approach, involving patients, adding an advisory council group to characterize existing knowledge in this little studied area, and using effectiveness rather than "appropriateness" as the basis for rating. As a proof of concept, we tested this method by examining the broadly delivered but understudied nonmedical services that community health centers provide. This method created discrete, new knowledge about these services by defining 6 categories and 112 unique services and by prioritizing among these services based on effectiveness using a 9-point scale. Consistent with the appropriateness method, we found statistical convergence of ratings among the panelists. Challenges include time commitment and adherence to a clear definition of effectiveness of services. This diverse stakeholder engagement method efficiently addresses gaps in knowledge about the effectiveness of health care services to inform population health management. © 2015 Society for Public Health Education.

Devising a consensus definition and framework for non-technical skills in healthcare to support educational design: A modified Delphi study.

PubMed

Gordon, Morris; Baker, Paul; Catchpole, Ken; Darbyshire, Daniel; Schocken, Dawn

2015-01-01

Non-technical skills are a subset of human factors that focus on the individual and promote safety through teamwork and awareness. There is no widely adopted competency- or outcome-based framework for non-technical skills training in healthcare. The authors set out to devise such a framework using a modified Delphi approach. An exhaustive list of published and team suggested items was presented to the expert panel for ranking and to propose a definition. In the second round, a focused list was presented, as well as the proposed definition elements. The finalised framework was sent to the panel for review. Sixteen experts participated. The final framework consists of 16 competencies for all and eight specific competencies for team leaders. The consensus definition describes non-technical skills as "a set of social (communication and team work) and cognitive (analytical and personal behaviour) skills that support high quality, safe, effective and efficient inter-professional care within the complex healthcare system". The authors have produced a new competency framework, through the works of an International expert panel, which is not discipline specific that can be used by curriculum developers, educational innovators and clinical teachers to support developments in the field.

Developing a Physiotherapy-Specific Preliminary Clinical Decision-Making Tool for Oxygen Titration: A Modified Delphi Study

PubMed Central

Duong, Michelle; Bertin, Kendra; Henry, Renee; Singh, Deepti; Timmins, Nolla; Brooks, Dina; Mathur, Sunita

2014-01-01

ABSTRACT Purpose: To develop and evaluate a preliminary clinical decision-making tool (CDMT) to assist physiotherapists in titrating oxygen for acutely ill adults in Ontario. Methods: A panel of 14 experienced cardiorespiratory physiotherapists was recruited. Factors relating to oxygen titration were identified using a modified Delphi technique. Four rounds of questionnaires were conducted, during which the goals were to (1) generate factors, (2) reduce factors and debate contentious factors, (3) finalize factors and develop the preliminary CDMT, and (4) evaluate the usability of the tool in a clinical context. Results: The panel reached consensus on a total of 89 factors, which were compiled to create the preliminary CDMT. The global tool reached consensus for sensibility, receiving a mean score of 6/7 on a 7-point Likert-type scale (1=unacceptable; 7=excellent). Five of the nine individual components of evaluation of the tool achieved scores ≥6.0; the remaining four had mean scores between 5.4 and 5.9. Conclusion: This study produced a preliminary CDMT for oxygen titration, which the panel agreed was highly comprehensible and globally sensible. Further research is necessary to evaluate the sensibility and applicability of the tool in a clinical setting. PMID:25125782

Quality indicators for blogs and podcasts used in medical education: modified Delphi consensus recommendations by an international cohort of health professions educators.

PubMed

Lin, Michelle; Thoma, Brent; Trueger, N Seth; Ankel, Felix; Sherbino, Jonathan; Chan, Teresa

2015-10-01

Quality assurance concerns about social media platforms used for education have arisen within the medical education community. As more trainees and clinicians use resources such as blogs and podcasts for learning, we aimed to identify quality indicators for these resources. A previous study identified 151 potentially relevant quality indicators for these social media resources. To identify quality markers for blogs and podcasts using an international cohort of health professions educators. A self-selected group of 44 health professions educators at the 2014 International Conference on Residency Education participated in a Social Media Summit during which a modified Delphi consensus study was conducted to determine which of the 151 quality indicators met the a priori ≥90% inclusion threshold. Thirteen quality indicators classified into the domains of credibility (n=8), content (n=4) and design (n=1) met the inclusion threshold. The quality indicators that were identified may serve as a foundation for further research on quality indicators of social media-based medical education resources and prompt discussion of their legitimacy as a form of educational scholarship. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Development of a Logistics Support Framework for Defense Mapping Agency (DMA) Automated Systems

DTIC Science & Technology

1990-09-01

cycle of a particular system. This research identified principles of management , design or system life cycle processes, and ILS elements needed to...Delphi results gathered from DMA expert opinions. The principles of management , depicted in the Logistics Systems Management Matrix (LSMM) portrayed...review were used to form the Delphi survey questions in Chapter III. As shown in Figure 2, the LSMM is a three-dimensional model with thp principles of management on

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

PubMed

Bank, Ilana; Cheng, Adam; McLeod, Peter; Bhanji, Farhan

2015-11-01

By the end of residency training, pediatric emergency medicine (PEM) residents are expected to have developed the confidence and abilities required to manage acutely ill children. Acquisition of competence requires exposure and/or supplemental formal education for critical and noncritical medical clinical presentations. Simulation can provide experiential learning and can improve trainees' knowledge, skills, and attitudes. The primary objective of this project was to identify the content for a simulation-based national curriculum for PEM training. We recruited participants for the Delphi study by contacting current PEM program directors and immediate past program directors as well as simulation experts at all of the Canadian PEM fellowship sites. We determined the appropriate core content for the Delphi study by combining the PEM core content requirements of the Royal College of Physicians and Surgeons of Canada (RCPSC) and the American Board of Pediatrics (ABP). Using the Delphi method, we achieved consensus amongst the national group of PEM and simulation experts. The participants completed a three-round Delphi (using a four-point Likert scale). Response rates for the Delphi were 85% for the first round and 77% for second and third rounds. From the initial 224 topics, 53 were eliminated (scored <2). Eighty-five topics scored between 2 and 3, and 87 scored between 3 and 4. The 48 topics, which were scored between 3.5 and 4.0, were labeled as "key curriculum topics." We have iteratively identified a consensus for the content of a national simulation-based curriculum.

Intimate Partner Violence Programs in a Children's Hospital: Comprehensive Assessment Utilizing a Delphi Instrument.

PubMed

Randell, Kimberly A; Evans, Sarah E; O'Malley, Donna; Dowd, M Denise

2015-03-01

The purpose of this study was to conduct a baseline assessment of intimate partner violence (IPV) practices in a pediatric hospital system. The Delphi Instrument for Hospital-based Domestic Violence Programs was used to assess the structure and components of the hospital system's IPV practices. Through key stakeholder interviews, we also assessed IPV practices in individual patient care areas. Qualitative analysis of interview data used a grounded theory approach. The hospital scored 17 of 100 points on the Delphi instrument assessment. Key areas of weakness identified by the Delphi instrument and interviews included lack of coordinated provider training and evaluation of IPV-related processes and no standards for IPV screening, safety assessment, and documentation. Most interviewees supported addressing IPV; all identified barriers to IPV screening at individual provider and institutional levels. Institutional barriers included lack of a standardized response to IPV disclosure, need for individualized screening protocols for different patient care settings, lack of standardized provider training, concerns about overextending social work resources, and lack of resources for hospital staff experiencing vicarious trauma. Individual barriers included concern that screening may harm physician-patient-family relationships and the perception that physicians are unwilling to address psychosocial issues. The Delphi Instrument for Hospital-based Domestic Violence Programs identified weaknesses and key areas for improvement in IPV practices. Deficiencies revealed by the Delphi instrument were affirmed by individual interview results. Institutional and individual provider level barriers must be addressed to optimize IPV practices in a pediatric hospital system. Copyright © 2015 by the American Academy of Pediatrics.

What makes a competent clinical teacher?

PubMed Central

Wealthall, Stephen; Henning, Marcus

2012-01-01

Background Clinical teaching competency is a professional necessity ensuring that clinicians’ knowledge, skills and attitudes are effectively transmitted from experts to novices. The aim of this paper is to consider how clinical skills are transmitted from a historical and reflective perspective and to link these ideas with student and teacher perceptions of competence in clinical teaching. Methods The reflections are informed by a Delphi process and professional development survey designed to capture students’ and clinicians’ ideas about the attributes of a competent clinical teacher. In addition, the survey process obtained information on the importance and ‘teachability’ of these characteristics. Results Four key characteristics of the competent teacher emerged from the Delphi process: clinically competent, efficient organizer, group communicator and person–centred. In a subsequent survey, students were found to be more optimistic about the ‘teachability’ of these characteristics than clinicians and scored the attribute of person-centredness higher than clinicians. Clinicians, on the other hand, ascribed higher levels of importance to clinical competency, efficient organization and group communication than students. Conclusions The Delphi process created a non-threatening system for gathering student and clinician expectations of teachers and created a foundation for developing methods for evaluating clinical competency. This provided insights into differences between teachers’ and students’ expectations, their importance, and professional development. PMID:26451184

Development of key performance indicators for prehospital emergency care.

PubMed

Murphy, Adrian; Wakai, Abel; Walsh, Cathal; Cummins, Fergal; O'Sullivan, Ronan

2016-04-01

Key performance indicators (KPIs) are used to monitor and evaluate critical areas of clinical and support functions that influence patient outcome. Traditional prehospital emergency care performance monitoring has focused solely on response time metrics. The landscape of emergency care delivery in Ireland is in the process of significant national reconfiguration. The development of KPIs is therefore considered one of the key priorities in prehospital research. The aim of this study was to develop a suite of KPIs for prehospital emergency care in Ireland. A systematic literature review of prehospital care performance measurement was undertaken followed by a three-round Delphi consensus process facilitated by a broad-based multidisciplinary group of panellists. The consensus process was conducted between June 2012 and October 2013. Each candidate indicator on the Delphi survey questionnaire was rated using a 5-point Likert-type rating scale. Agreement was defined as at least 70% of responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using descriptive statistics. Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Of the 78 citations identified by the systematic review, 5 relevant publications were used to select candidate indicators for the Delphi round 1 questionnaire. Response rates in Delphi rounds 1 and 2 were 89% and 83%, respectively. Following the consensus development conference, 101 KPIs reached consensus. Based on the Donabedian framework for quality-of-care indicators, 7 of the KPIs which reached agreement were structure KPIs, 74 were process KPIs and 20 were outcome KPIs. The highest ranked indicator was a process KPI ('Direct transport of ST-elevation myocardial infarction patients to a primary percutaneous intervention (PCI)-capable facility for ECG to PCI time <90 min'). Improving the quality of prehospital care requires the development and implementation of performance measurement using scientifically valid and reliable KPIs. Employing a Delphi panel of key multidisciplinary Emergency Medical Service stakeholders, it was feasible to develop a suite of 101 KPIs for performance monitoring of prehospital emergency care in Ireland. This suite of KPIs may contribute to a framework for achieving safer, better care in the prehospital environment. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

A top-five list for emergency medicine: a pilot project to improve the value of emergency care.

PubMed

Schuur, Jeremiah D; Carney, Dylan P; Lyn, Everett T; Raja, Ali S; Michael, John A; Ross, Nicholas G; Venkatesh, Arjun K

2014-04-01

IMPORTANCE The mean cost of medical care in the United States is growing at an unsustainable rate; from 2003 through 2011, the cost for an emergency department (ED) visit rose 240%, from $560 to $1354. The diagnostic tests, treatments, and hospitalizations that emergency clinicians order result in significant costs. OBJECTIVE To create a "top-five" list of tests, treatments, and disposition decisions that are of little value, are amenable to standardization, and are actionable by emergency medicine clinicians. DESIGN, SETTING, AND PARTICIPANTS Modified Delphi consensus process and survey of 283 emergency medicine clinicians (physicians, physician assistants, and nurse practitioners) from 6 EDs. INTERVENTION We assembled a technical expert panel (TEP) and conducted a modified Delphi process to identify a top-five list using a 4-step process. In phase 1, we generated a list of low-value clinical decisions from TEP brainstorming and e-mail solicitation of clinicians. In phase 2, the TEP ranked items on contribution to cost, benefit to patients, and actionability by clinicians. In phase 3, we surveyed all ordering clinicians from the 6 EDs regarding distinct aspects of each item. In phase 4, the TEP voted for a final top-five list based on survey results and discussion. MAIN OUTCOMES AND MEASURES A top-five list for emergency medicine. The TEP ranked items on contribution to cost, benefit to patients, and actionability by clinicians. The survey asked clinicians to score items on the potential benefit or harm to patients and the provider actionability of each item. Voting and surveys used 5-point Likert scales. A Pearson interdomain correlation was used. RESULTS Phase 1 identified 64 low-value items. Phase 2 narrowed this list to 7 laboratory tests, 3 medications, 4 imaging studies, and 3 disposition decisions included in the phase 3 survey (71.0% response rate). All 17 items showed a significant positive correlation between benefit and actionability (r, 0.19-0.37 [P ≤ .01]). One item received unanimous TEP support, 4 received majority support, and 12 received at least 1 vote. CONCLUSIONS AND RELEVANCE Our TEP identified clinical actions that are of low value and within the control of ED health care providers. This method can be used to identify additional actionable targets of overuse in emergency medicine.

Manualization of Occupational Therapy Using Ayres Sensory Integration® for Autism.

PubMed

Hunt, Joanne; van Hooydonk, Elke; Faller, Patricia; Mailloux, Zoe; Schaaf, Roseann

2017-07-01

This article reports on the development of a Stage 3 manual (following pilot effectiveness study) for implementing occupational therapy using Ayres Sensory Integration® (OT/ASI) for children with autism spectrum disorders to enhance participation in daily occupations. Three stakeholder groups were surveyed to aid in translation of manual from research to practice (i.e., Stage 3 manual) and an expert consensus meeting was held to finalize recommendations. Data indicated that the manuals usability could be improved by including a section on frequently encountered problems and solutions, and by including video case examples. Also recommended were greater chapter uniformity, improved clarity of forms and charts, and inclusion of a glossary. Changes were made and subject to expert review and consensus using modified Delphi process. The Stage 3 manual has been rigorously vetted and is ready for practice and research replication.

Measuring Best Practices for Workplace Safety, Health, and Well-Being: The Workplace Integrated Safety and Health Assessment.

PubMed

Sorensen, Glorian; Sparer, Emily; Williams, Jessica A R; Gundersen, Daniel; Boden, Leslie I; Dennerlein, Jack T; Hashimoto, Dean; Katz, Jeffrey N; McLellan, Deborah L; Okechukwu, Cassandra A; Pronk, Nicolaas P; Revette, Anna; Wagner, Gregory R

2018-05-01

To present a measure of effective workplace organizational policies, programs, and practices that focuses on working conditions and organizational facilitators of worker safety, health and well-being: the workplace integrated safety and health (WISH) assessment. Development of this assessment used an iterative process involving a modified Delphi method, extensive literature reviews, and systematic cognitive testing. The assessment measures six core constructs identified as central to best practices for protecting and promoting worker safety, health and well-being: leadership commitment; participation; policies, programs, and practices that foster supportive working conditions; comprehensive and collaborative strategies; adherence to federal and state regulations and ethical norms; and data-driven change. The WISH Assessment holds promise as a tool that may inform organizational priority setting and guide research around causal pathways influencing implementation and outcomes related to these approaches.

75 FR 28655 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-21

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture, a.../Electronic Architecture, a subsidiary of Delphi Corporation, including on-site leased [[Page 28656

Follow-up intervals in patients with Cushing's disease: recommendations from a panel of experienced pituitary clinicians.

PubMed

Geer, Eliza B; Ayala, Alejandro; Bonert, Vivien; Carmichael, John D; Gordon, Murray B; Katznelson, Laurence; Manuylova, Ekaterina; Shafiq, Ismat; Surampudi, Vijaya; Swerdloff, Ronald S; Broder, Michael S; Cherepanov, Dasha; Eagan, Marianne; Lee, Jackie; Said, Qayyim; Neary, Maureen P; Biller, Beverly M K

2017-08-01

Follow-up guidelines are needed to assess quality of care and to ensure best long-term outcomes for patients with Cushing's disease (CD). The purpose of this study was to assess agreement by experts on recommended follow-up intervals for CD patients at different phases in their treatment course. The RAND/UCLA modified Delphi process was used to assess expert consensus. Eleven clinicians who regularly manage CD patients rated 79 hypothetical patient scenarios before and after ("second round") an in-person panel discussion to clarify definitions. Scenarios described CD patients at various time points after treatment. For each scenario, panelists recommended follow-up intervals in weeks. Panel consensus was assigned as follows: "agreement" if no more than two responses were outside a 2 week window around the median response; "disagreement" if more than two responses were outside a 2 week window around the median response. Recommendations were developed based on second round results. Panel agreement was 65.9% before and 88.6% after the in-person discussion. The panel recommended follow-up within 8 weeks for patients in remission on glucocorticoid replacement and within 1 year of surgery; within 4 weeks for patients with uncontrolled persistent or recurrent disease; within 8-24 weeks in post-radiotherapy patients controlled on medical therapy; and within 24 weeks in asymptomatic patients with stable plasma ACTH concentrations after bilateral adrenalectomy. With a high level of consensus using the Delphi process, panelists recommended regular follow-up in most patient scenarios for this chronic condition. These recommendations may be useful for assessment of CD care both in research and clinical practice.

Standards for UNiversal reporting of patient Decision Aid Evaluation studies: the development of SUNDAE Checklist.

PubMed

Sepucha, Karen R; Abhyankar, Purva; Hoffman, Aubri S; Bekker, Hilary L; LeBlanc, Annie; Levin, Carrie A; Ropka, Mary; Shaffer, Victoria A; Sheridan, Stacey L; Stacey, Dawn; Stalmeier, Peep; Vo, Ha; Wills, Celia E; Thomson, Richard

2018-05-01

Patient decision aids (PDAs) are evidence-based tools designed to help patients make specific and deliberated choices among healthcare options. The International Patient Decision Aid Standards (IPDAS) Collaboration review papers and Cochrane systematic review of PDAs have found significant gaps in the reporting of evaluations of PDAs, including poor or limited reporting of PDA content, development methods and delivery. This study sought to develop and reach consensus on reporting guidelines to improve the quality of publications evaluating PDAs. An international workgroup, consisting of members from IPDAS Collaboration, followed established methods to develop reporting guidelines for PDA evaluation studies. This paper describes the results from three completed phases: (1) planning, (2) drafting and (3) consensus, which included a modified, two-stage, online international Delphi process. The work was conducted over 2 years with bimonthly conference calls and three in-person meetings. The workgroup used input from these phases to produce a final set of recommended items in the form of a checklist. The SUNDAE Checklist (Standards for UNiversal reporting of patient Decision Aid Evaluations) includes 26 items recommended for studies reporting evaluations of PDAs. In the two-stage Delphi process, 117/143 (82%) experts from 14 countries completed round 1 and 96/117 (82%) completed round 2. Respondents reached a high level of consensus on the importance of the items and indicated strong willingness to use the items when reporting PDA studies. The SUNDAE Checklist will help ensure that reports of PDA evaluation studies are understandable, transparent and of high quality. A separate Explanation and Elaboration publication provides additional details to support use of the checklist. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Fuzzy Multicriteria Ranking of Aluminium Coating Methods

NASA Astrophysics Data System (ADS)

Batzias, A. F.

2007-12-01

This work deals with multicriteria ranking of aluminium coating methods. The alternatives used are: sulfuric acid anodization, A1; oxalic acid anodization, A2; chromic acid anodization, A3; phosphoric acid anodization, A4; integral color anodizing, A5; chemical conversion coating, A6; electrostatic powder deposition, A7. The criteria used are: cost of production, f1; environmental friendliness of production process, f2; appearance (texture), f3; reflectivity, f4; response to coloring, f5; corrosion resistance, f6; abrasion resistance, f7; fatigue resistance, f8. Five experts coming from relevant industrial units set grades to the criteria vector and the preference matrix according to a properly modified Delphi method. Sensitivity analysis of the ranked first alternative A1 against the `second best', which was A3 at low and A7 at high resolution levels proved that the solution is robust. The dependence of anodized products quality on upstream processes is presented and the impact of energy price increase on industrial cost is discussed.

Identifying opportunities for nature engagement in cancer care practice and design: protocol for four-round modified electronic Delphi.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-03-08

Opportunities to engage with nature have shown relevance in experiences of health and recovery of patients with cancer and are attracting interest in cancer care practice and design. Such healthcare innovations can widen the horizon of possible supportive care solutions but require deliberate and rigorous investigation to ensure responsible action is taken and wastage avoided. This protocol outlines a study designed to solicit knowledge from relevant experts drawn from a range of healthcare practitioners, management representatives, designers and researchers to explore levels of opinion consensus for determining opportunities for, and barriers to, providing helpful nature engagement in cancer care settings. A 4-round modified electronic Delphi methodology will be used to conduct a structured, iterative feedback process for querying and synthesising expert opinion. Round 1 administers an open-ended questionnaire to a panel of selected, relevant experts who will consider the own recommendations of patients with cancer for nature engagement (drawn from a preceding investigation) before contributing salient issues (items) with relevance to the topic. Round 2 circulates anonymised summaries of responses back to the experts who verify and, if they wish, reconsider their own responses. Rounds 3 and 4 determine and rank experts' top 10 items using a 10-point Likert-type scale. Descriptive statistics (median and mean scores) will be calculated to indicate the items' relative importance. Levels of consensus will be explored with consensus defined as 75% agreement. Ethics approval for this study was obtained from the Institution's Human Research Ethics Committee (blinded for review). It is anticipated that the results will be published in peer-reviewed journals and presented in a variety of forums. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study.

PubMed

Gagliardi, Diana; Rondinone, Bruna M; Mirabile, Marco; Buresti, Giuliana; Ellwood, Peter; Hery, Michel; Paszkiewicz, Peter; Valenti, Antonio; Iavicoli, Sergio

2017-06-23

This study, developed within the frame of the Partnership for European Research on Occupational Safety and Health joint research activities and based on the frame designed by the 2013 European Agency for Safety and Health at Work (EU-OSHA) study, is the first example of using the points of view of European occupational safety and health (OSH) researchers.The objective is to identify priorities for OSH research that may contribute to the achievement of present and future sustainable growth objectives set by the European strategies. The study was carried out using a modified Delphi method with a two-round survey. Each round involved a panel of about 110 researchers representing the network member institutes was selected according to specific criteria, including the ownership of research expertise in at least one of the four macroareas identified by the reference report developed by EU-OSHA in 2013. The study identified some innovative research topics (for example, 'Emerging technological devices' and 'OSH consequences of markets integration') and research priorities (ie, crowdsourcing, e-work, zero-hours contract s ) that are not reflected in previous studies of this nature.The absence of any reference to violence and harassment at work among the researchers' proposals is a major difference from previous similar studies, while topics related to gender issues and electromagnetic fields show a lower importance. The innovative design of a research priorities identification process, which takes advantage of a large, representative and qualified panel of European researchers allowed the definition of a number of research priorities able to support the inclusion of innovative OSH research issues in the scope of the next European research agenda. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Acceptability and Perceived Benefits and Risks of Public and Patient Involvement in Health Care Policy: A Delphi Survey in Belgian Stakeholders.

PubMed

Cleemput, Irina; Christiaens, Wendy; Kohn, Laurence; Léonard, Christian; Daue, François; Denis, Alain

2015-06-01

In systems with public health insurance, coverage decisions should reflect social values. Deliberation among stakeholders could achieve this goal, but rarely involves patients and citizens directly. This study aimed at evaluating the acceptability, and the perceived benefits and risks, of public and patient involvement (PPI) in coverage decision making to Belgian stakeholders. A two-round Delphi survey was conducted among all stakeholder groups. The survey was constructed on the basis of interviews with 10 key stakeholders and a review of the literature on participation models. Consensus was defined as 65% or more of the respondents agreeing with a statement and less than 15% disagreeing. Eighty stakeholders participated in both rounds. They were defined as the Delphi panel. Belgian stakeholders are open toward PPI in coverage decision processes. Benefits are expected to exceed risks. The preferred model for involvement is to consult citizens or patients, within the existing decision-making structures and at specific milestones in the process. Consulting citizens and patients is a higher level of involvement than merely informing them and a lower level than letting them participate actively. Consultation involves asking nonbinding advice on (parts of) the decision problem. According to the Delphi panel, the benefits of PPI could be increasing awareness among members of the general public and patients about the challenges and costs of health care, and enriched decision processes with expertise by experience from patients. Potential risks include subjectivity, insufficient resources to participate and weigh on the process, difficulties in finding effective ways to express a collective opinion, the risk of manipulation, and lobbying or power games of other stakeholders. PPI in coverage decision-making processes is acceptable to Belgian stakeholders, be it in different ways for different types of decisions. Benefits are expected to outweigh risks. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

International and Interdisciplinary Identification of Health Care Transition Outcomes.

PubMed

Fair, Cynthia; Cuttance, Jessica; Sharma, Niraj; Maslow, Gary; Wiener, Lori; Betz, Cecily; Porter, Jerlym; McLaughlin, Suzanne; Gilleland-Marchak, Jordan; Renwick, Amy; Naranjo, Diana; Jan, Sophia; Javalkar, Karina; Ferris, Maria

2016-03-01

There is a lack of agreement on what constitutes successful outcomes for the process of health care transition (HCT) among adolescent and young adults with special health care needs. To present HCT outcomes identified by a Delphi process with an interdisciplinary group of participants. A Delphi method involving 3 stages was deployed to refine a list of HCT outcomes. This 18-month study (from January 5, 2013, of stage 1 to July 3, 2014, of stage 3) included an initial literature search, expert interviews, and then 2 waves of a web-based survey. On this survey, 93 participants from outpatient, community-based, and primary care clinics rated the importance of the top HCT outcomes identified by the Delphi process. Analyses were performed from July 5, 2014, to December 5, 2014. Health care transition outcomes of adolescents and young adults with special health care needs. Importance ratings of identified HCT outcomes rated on a Likert scale from 1 (not important) to 9 (very important). The 2 waves of surveys included 117 and 93 participants as the list of outcomes was refined. Transition outcomes were refined by the 3 waves of the Delphi process, with quality of life being the highest-rated outcome with broad agreement. The 10 final outcomes identified included individual outcomes (quality of life, understanding the characteristics of conditions and complications, knowledge of medication, self-management, adherence to medication, and understanding health insurance), health services outcomes (attending medical appointments, having a medical home, and avoidance of unnecessary hospitalization), and a social outcome (having a social network). Participants indicated that different outcomes were likely needed for individuals with cognitive disabilities. Quality of life is an important construct relevant to HCT. Future research should identify valid measures associated with each outcome and further explore the role that quality of life plays in the HCT process. Achieving consensus is a critical step toward the development of reliable and objective comparisons of HCT outcomes across clinical conditions and care delivery locations.

A core outcome set for evaluating self-management interventions in people with comorbid diabetes and severe mental illness: study protocol for a modified Delphi study and systematic review.

PubMed

Taylor, Johanna; Böhnke, Jan R; Wright, Judy; Kellar, Ian; Alderson, Sarah L; Hughes, Tom; Holt, Richard I G; Siddiqi, Najma

2017-02-14

People with diabetes and comorbid severe mental illness (SMI) form a growing population at risk of increased mortality and morbidity compared to those with diabetes or SMI alone. There is increasing interest in interventions that target diabetes in SMI in order to help to improve physical health and reduce the associated health inequalities. However, there is a lack of consensus about which outcomes are important for this comorbid population, with trials differing in their focus on physical and mental health. A core outcome set, which includes outcomes across both conditions that are relevant to patients and other key stakeholders, is needed. This study protocol describes methods to develop a core outcome set for use in effectiveness trials of self-management interventions for adults with comorbid type-2 diabetes and SMI. We will use a modified Delphi method to identify, rank, and agree core outcomes. This will comprise a two-round online survey and multistakeholder workshops involving patients and carers, health and social care professionals, health care commissioners, and other experts (e.g. academic researchers and third sector organisations). We will also select appropriate measurement tools for each outcome in the proposed core set and identify gaps in measures, where these exist. The proposed core outcome set will provide clear guidance about what outcomes should be measured, as a minimum, in trials of interventions for people with coexisting type-2 diabetes and SMI, and improve future synthesis of trial evidence in this area. We will also explore the challenges of using online Delphi methods for this hard-to-reach population, and examine differences in opinion about which outcomes matter to diverse stakeholder groups. COMET registration: http://www.comet-initiative.org/studies/details/911 . Registered on 1 July 2016.

Academic Primer Series: Key Papers About Competency-Based Medical Education

PubMed Central

Cooney, Robert; Chan, Teresa M.; Gottlieb, Michael; Abraham, Michael; Alden, Sylvia; Mongelluzzo, Jillian; Pasirstein, Michael; Sherbino, Jonathan

2017-01-01

Introduction Competency-based medical education (CBME) presents a paradigm shift in medical training. This outcome-based education movement has triggered substantive changes across the globe. Since this transition is only beginning, many faculty members may not have experience with CBME nor a solid foundation in the grounding literature. We identify and summarize key papers to help faculty members learn more about CBME. Methods Based on the online discussions of the 2016–2017 ALiEM Faculty Incubator program, a series of papers on the topic of CBME was developed. Augmenting this list with suggestions by a guest expert and by an open call on Twitter for other important papers, we were able to generate a list of 21 papers in total. Subsequently, we used a modified Delphi study methodology to narrow the list to key papers that describe the importance and significance for educators interested in learning about CBME. To determine the most impactful papers, the mixed junior and senior faculty authorship group used three-round voting methodology based upon the Delphi method. Results Summaries of the five most highly rated papers on the topic of CBME, as determined by this modified Delphi approach, are presented in this paper. Major themes include a definition of core CBME themes, CBME principles to consider in the design of curricula, a history of the development of the CBME movement, and a rationale for changes to accreditation with CBME. The application of the study findings to junior faculty and faculty developers is discussed. Conclusion We present five key papers on CBME that junior faculty members and faculty experts identified as essential to faculty development. These papers are a mix of foundational and explanatory papers that may provide a basis from which junior faculty members may build upon as they help to implement CBME programs. PMID:28611893

Evaluation of the Walking Index for Spinal Cord Injury II (WISCI-II) in children with Spinal Cord Injury (SCI).

PubMed

Calhoun Thielen, C; Sadowsky, C; Vogel, L C; Taylor, H; Davidson, L; Bultman, J; Gaughan, J; Mulcahey, M J

2017-05-01

Mixed methods were used in this study. The appropriateness of the levels of the Walking Index for Spinal Cord Injury II (WISCI-II) for application in children was critically reviewed by physical therapists using the Modified Delphi Technique, and the inter- and intra-rater reliability of the WISCI-II in children was evaluated. To examine the construct validity, and to establish reliability of the WISCI-II related to its use in children with spinal cord injury (SCI). United States of America. Using a Modified Delphi Technique, physical therapists critically reviewed the WISCI-II levels for pediatric utilization. Concurrently, ambulatory children under age 18 years with SCI were evaluated using the WISCI-II on two occasions by the same therapist to establish intra-rater reliability. One trial was photographed and de-identified. Each photograph was reviewed by four different physical therapists who gave WISCI-II scores to establish inter-rater reliability. Summary and descriptive statistics were used to calculate the frequency of yes/no responses for each WISCI-II level question and to determine the percent agreement for each question. Inter- and intra-rater reliability was calculated using interclass correlation coefficients (ICCs) with 95% confidence intervals (CI). Construct validity was confirmed after one Delphi round during which at least 80% agreement was established by 51 physical therapists on the appropriateness of the WISCI-II levels for children. Fifty-two children with SCI aged 2-17 years completed repeated WISCI-II assessments and 40 de-identified photographs were scored by four physical therapists. Intra- and inter-rater reliability was high (ICC=0.997, CI=0.995-0.998 and ICC=0.97, CI=0.95-0.98, respectively). This study demonstrates support for the use of the WISCI-II in ambulatory children with SCI. This study was funded by the Craig H Neilsen Foundation, Spinal Cord Injury Research on the Translation Spectrum, Senior Research Award #282592 (Mulcahey, PI).

Cardiovascular–renal axis disorders in the domestic dog and cat: a veterinary consensus statement

PubMed Central

Pouchelon, J L; Atkins, C E; Bussadori, C; Oyama, M A; Vaden, S L; Bonagura, J D; Chetboul, V; Cowgill, L D; Elliot, J; Francey, T; Grauer, G F; Luis Fuentes, V; Sydney Moise, N; Polzin, D J; Van Dongen, A M; Van Israël, N

2015-01-01

OBJECTIVES There is a growing understanding of the complexity of interplay between renal and cardiovascular systems in both health and disease. The medical profession has adopted the term “cardiorenal syndrome” (CRS) to describe the pathophysiological relationship between the kidney and heart in disease. CRS has yet to be formally defined and described by the veterinary profession and its existence and importance in dogs and cats warrant investigation. The CRS Consensus Group, comprising nine veterinary cardiologists and seven nephrologists from Europe and North America, sought to achieve consensus around the definition, pathophysiology, diagnosis and management of dogs and cats with “cardiovascular-renal disorders” (CvRD). To this end, the Delphi formal methodology for defining/building consensus and defining guidelines was utilised. METHODS Following a literature review, 13 candidate statements regarding CvRD in dogs and cats were tested for consensus, using a modified Delphi method. As a new area of interest, well-designed studies, specific to CRS/CvRD, are lacking, particularly in dogs and cats. Hence, while scientific justification of all the recommendations was sought and used when available, recommendations were largely reliant on theory, expert opinion, small clinical studies and extrapolation from data derived from other species. RESULTS Of the 13 statements, 11 achieved consensus and 2 did not. The modified Delphi approach worked well to achieve consensus in an objective manner and to develop initial guidelines for CvRD. DISCUSSION The resultant manuscript describes consensus statements for the definition, classification, diagnosis and management strategies for veterinary patients with CvRD, with an emphasis on the pathological interplay between the two organ systems. By formulating consensus statements regarding CvRD in veterinary medicine, the authors hope to stimulate interest in and advancement of the understanding and management of CvRD in dogs and cats. The use of a formalised method for consensus and guideline development should be considered for other topics in veterinary medicine. PMID:26331869

Modified Policy-Delphi study for exploring obesity prevention priorities

PubMed Central

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-01-01

Introduction Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of ‘intrusiveness’ has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. Methods and analysis The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethics and dissemination Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. PMID:27601495

Modified Policy-Delphi study for exploring obesity prevention priorities.

PubMed

Haynes, Emily; Palermo, Claire; Reidlinger, Dianne P

2016-09-06

Until now, industry and government stakeholders have dominated public discourse about policy options for obesity. While consumer involvement in health service delivery and research has been embraced, methods which engage consumers in health policy development are lacking. Conflicting priorities have generated ethical concern around obesity policy. The concept of 'intrusiveness' has been applied to policy decisions in the UK, whereby ethical implications are considered through level of intrusiveness to choice; however, the concept has also been used to avert government regulation to address obesity. The concept of intrusiveness has not been explored from a stakeholder's perspective. The aim is to investigate the relevance of intrusiveness and autonomy to health policy development, and to explore consensus on obesity policy priorities of under-represented stakeholders. The Policy-Delphi technique will be modified using the James Lind Alliance approach to collaborative priority setting. A total of 60 participants will be recruited to represent three stakeholder groups in the Australian context: consumers, public health practitioners and policymakers. A three-round online Policy-Delphi survey will be undertaken. Participants will prioritise options informed by submissions to the 2009 Australian Government Inquiry into Obesity, and rate the intrusiveness of those proposed. An additional round will use qualitative methods in a face-to-face discussion group to explore stakeholder perceptions of the intrusiveness of options. The novelty of this methodology will redress the balance by bringing the consumer voice forward to identify ethically acceptable obesity policy options. Ethical approval was granted by the Bond University Health Research Ethics Committee. The findings will inform development of a conceptual framework for analysing and prioritising obesity policy options, which will be relevant internationally and to ethical considerations of wider public health issues. The findings will be disseminated through peer-reviewed publications, conference presentations and collaborative platforms of policy and science. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Practical Considerations for Conducting Delphi Studies: The Oracle Enters a New Age.

ERIC Educational Resources Information Center

Eggers, Renee M.; Jones, Charles M.

1998-01-01

In addition to giving an overview of Delphi methodology and describing the methodology used by the researchers in two Delphi studies, the authors provide information about electronic communication in Delphi studies. Also provided are suggestions that can be used in a Delphi study involving any form of communication. (SLD)

Validation of virtual learning object to support the teaching of nursing care systematization.

PubMed

Salvador, Pétala Tuani Candido de Oliveira; Mariz, Camila Maria Dos Santos; Vítor, Allyne Fortes; Ferreira Júnior, Marcos Antônio; Fernandes, Maria Isabel Domingues; Martins, José Carlos Amado; Santos, Viviane Euzébia Pereira

2018-01-01

to describe the content validation process of a Virtual Learning Object to support the teaching of nursing care systematization to nursing professionals. methodological study, with quantitative approach, developed according to the methodological reference of Pasquali's psychometry and conducted from March to July 2016, from two-stage Delphi procedure. in the Delphi 1 stage, eight judges evaluated the Virtual Object; in Delphi 2 stage, seven judges evaluated it. The seven screens of the Virtual Object were analyzed as to the suitability of its contents. The Virtual Learning Object to support the teaching of nursing care systematization was considered valid in its content, with a Total Content Validity Coefficient of 0.96. it is expected that the Virtual Object can support the teaching of nursing care systematization in light of appropriate and effective pedagogical approaches.

Identifying seminal papers in the Australasian Journal on Ageing 1982-2011: a Delphi consensus approach.

PubMed

Parkinson, Lynne; Richardson, Kristy; Sims, Jane; Wells, Yvonne; Naganathan, Vasi; Brooke, Elizabeth; Lindley, Richard

2013-10-01

The aim of this study was to identify seminal Australasian Journal on Ageing papers published over 30 years through a Delphi consensus process. The main data collection was a three-round Delphi consensus study with 38 past and current members of the Australasian Journal on Ageing Editorial Board, Editorial Team and Management Committee. Three papers were agreed as top-ranking. One of the top-ranking articles was also highly cited. One article was published in the 1990 s, two in 2001. While it is difficult to judge how well the top-ranking papers represent seminal papers arising over 30 years, these papers do represent three different research strengths in Australasia, they do span three different disciplines, and they do reflect some of the diversity that characterises ageing research in Australasia over 30 years. © 2013 ACOTA.

Defining Malaysian Knowledge Society: Results from the Delphi Technique

NASA Astrophysics Data System (ADS)

Hamid, Norsiah Abdul; Zaman, Halimah Badioze

This paper outlines the findings of research where the central idea is to define the term Knowledge Society (KS) in Malaysian context. The research focuses on three important dimensions, namely knowledge, ICT and human capital. This study adopts a modified Delphi technique to seek the important dimensions that can contribute to the development of Malaysian's KS. The Delphi technique involved ten experts in a five-round iterative and controlled feedback procedure to obtain consensus on the important dimensions and to verify the proposed definition of KS. The finding shows that all three dimensions proposed initially scored high and moderate consensus. Round One (R1) proposed an initial definition of KS and required comments and inputs from the panel. These inputs were then used to develop items for a R2 questionnaire. In R2, 56 out of 73 items scored high consensus and in R3, 63 out of 90 items scored high. R4 was conducted to re-rate the new items, in which 8 out of 17 items scored high. Other items scored moderate consensus and no item scored low or no consensus in all rounds. The final round (R5) was employed to verify the final definition of KS. Findings and discovery of this study are significant to the definition of KS and the development of a framework in the Malaysian context.

Development of quality indicators to evaluate antibiotic treatment of patients with community-acquired pneumonia in Indonesia.

PubMed

Farida, Helmia; Rondags, Angelique; Gasem, M Hussein; Leong, Katharina; Adityana, A; van den Broek, Peterhans J; Keuter, Monique; Natsch, Stephanie

2015-04-01

To develop an instrument for evaluating the quality of antibiotic management of patients with community-acquired pneumonia (CAP) applicable in a middle-income developing country. A previous study and Indonesian guidelines were reviewed to derive potential quality of care indicators (QIs). An expert panel performed a two-round Delphi consensus procedure on the QI's relevance to patient recovery, reduction of antimicrobial resistance and cost containment. Applicability in practice, including reliability, feasibility and opportunity for improvement, was determined in a data set of 128 patients hospitalised with CAP in Semarang, Indonesia. Fifteen QIs were selected by the consensus procedure. Five QIs did not pass feasibility criteria, because of inappropriate documentation, inefficient laboratory services or patient factors. Three QIs provided minor opportunity for improvement. Two QIs contradicted each other; one of these was considered not valid and excluded. A final set of six QIs was defined for use in the Indonesian setting. Using the Delphi method, we defined a list of QIs for assessing the quality of care, in particular antibiotic treatment, for CAP in Indonesia. For further improvement, a modified Delphi method that includes discussion, a sound medical documentation system, improvement of microbiology laboratory services, and multi-center applicability tests are needed to develop a valid and applicable QI list for the Indonesian setting. © 2014 John Wiley & Sons Ltd.

Curriculum Mapping of the Master's Program in Pharmacy in Slovenia with the PHAR-QA Competency Framework.

PubMed

Gmeiner, Tanja; Horvat, Nejc; Kos, Mitja; Obreza, Aleš; Vovk, Tomaž; Grabnar, Iztok; Božič, Borut

2017-05-02

This article presents the results of mapping the Slovenian pharmacy curriculum to evaluate the adequacy of the recently developed and validated European Pharmacy Competences Framework (EPCF). The mapping was carried out and evaluated progressively by seven members of the teaching staff at the University of Ljubljana's Faculty of Pharmacy. Consensus was achieved by using a two-round modified Delphi technique to evaluate the coverage of competences in the current curriculum. The preliminary results of the curriculum mapping showed that all of the competences as defined by the EPCF are covered in Ljubljana's academic program. However, because most EPCF competences cover healthcare-oriented pharmacy practice, a lack of competences was observed for the drug development and production perspectives. Both of these perspectives are important because a pharmacist is (or should be) responsible for the entire process, from the development and production of medicines to pharmaceutical care in contact with patients. Nevertheless, Ljubljana's graduates are employed in both of these pharmaceutical professions in comparable proportions. The Delphi study revealed that the majority of differences in scoring arise from different perspectives on the pharmacy profession (e.g., community, hospital, industrial, etc.). Nevertheless, it can be concluded that curriculum mapping using the EPCF is very useful for evaluating and recognizing weak and strong points of the curriculum. However, the competences of the framework should address various fields of the pharmacist's profession in a more balanced way.

Resident Wellness and Social Support: Development and Cognitive Validation of a Resident Social Capital Assessment Tool.

PubMed

Kaplan, Stephen J; Seabott, Heather M; Cunningham, Erika B; Helman, James D; Calderon, Alvin; Thirlby, Richard C; Schenarts, Kimberly D

The purpose of this study is to develop and generate validity evidence for an instrument to measure social capital in residents. Mixed-methods, phased approach utilizing a modified Delphi technique, focus groups, and cognitive interviews. Four residency training institutions in Washington state between February 2016 and March 2017. General surgery, anesthesia, and internal medicine residents ranging from PGY-1 to PGY-6. The initial resident-focused instrument underwent revision via Delphi process with 6 experts; 100% expert consensus was achieved after 4 cycles. Three focus groups were conducted with 19 total residents. Focus groups identified 6 of 11 instrument items with mean quality ratings ≤4.0 on a 1-5 scale. The composite instrument rating of the draft version was 4.1 ± 0.5. After refining the instrument, cognitive interviews with the final version were completed with 22 residents. All items in the final version had quality ratings >4.0; the composite instrument rating was 4.8 ± 0.1. Social capital may be an important factor in resident wellness as residents rely upon each other and external social support to withstand fatigue, burnout, and other negative sequelae of rigorous training. This instrument for assessment of social capital in residents may provide an avenue for data collection and potentially, identification of residents at-risk for wellness degradation. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Curriculum Mapping of the Master’s Program in Pharmacy in Slovenia with the PHAR-QA Competency Framework

PubMed Central

Gmeiner, Tanja; Horvat, Nejc; Kos, Mitja; Obreza, Aleš; Vovk, Tomaž; Grabnar, Iztok; Božič, Borut

2017-01-01

This article presents the results of mapping the Slovenian pharmacy curriculum to evaluate the adequacy of the recently developed and validated European Pharmacy Competences Framework (EPCF). The mapping was carried out and evaluated progressively by seven members of the teaching staff at the University of Ljubljana’s Faculty of Pharmacy. Consensus was achieved by using a two-round modified Delphi technique to evaluate the coverage of competences in the current curriculum. The preliminary results of the curriculum mapping showed that all of the competences as defined by the EPCF are covered in Ljubljana’s academic program. However, because most EPCF competences cover healthcare-oriented pharmacy practice, a lack of competences was observed for the drug development and production perspectives. Both of these perspectives are important because a pharmacist is (or should be) responsible for the entire process, from the development and production of medicines to pharmaceutical care in contact with patients. Nevertheless, Ljubljana’s graduates are employed in both of these pharmaceutical professions in comparable proportions. The Delphi study revealed that the majority of differences in scoring arise from different perspectives on the pharmacy profession (e.g., community, hospital, industrial, etc.). Nevertheless, it can be concluded that curriculum mapping using the EPCF is very useful for evaluating and recognizing weak and strong points of the curriculum. However, the competences of the framework should address various fields of the pharmacist’s profession in a more balanced way. PMID:28970436

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method.

PubMed

Yeh, James S; Van Hoof, Thomas J; Fischer, Michael A

2016-02-01

Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process.

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method

PubMed Central

Yeh, James S.; Van Hoof, Thomas J.; Fischer, Michael A.

2016-01-01

Background Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. Objective To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. Methods This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. Results The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Conclusion Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process. PMID:27066195

Developing Resident-Sensitive Quality Measures: A Model From Pediatric Emergency Medicine.

PubMed

Schumacher, Daniel J; Holmboe, Eric S; van der Vleuten, Cees; Busari, Jamiu O; Carraccio, Carol

2017-12-05

To begin closing the gap with respect to quality measures available for use among residents, the authors sought to identify and develop resident-sensitive quality measures (RSQMs) for use in the pediatric emergency department (PED) setting. In May 2016, the authors reviewed National Quality Measures Clearinghouse (NQMC) measures to identify resident-sensitive measures. To create additional measures focused on common, acute illnesses (acute asthma exacerbation, bronchiolitis, closed head injury [CHI]) in the PED, the authors used a nominal group technique (NGT) and Delphi process from September to December 2016. To achieve a local focus for developing these measures, all NGT and Delphi participants were from Cincinnati Children's Hospital Medical Center. Delphi participants rated measures developed through the NGT in two areas: importance of measure to quality care and likelihood that measure represents the work of a resident. The review of NQMC measures identified 28 of 183 as being potentially resident-sensitive. The NGT produced 67 measures for asthma, 46 for bronchiolitis, and 48 for CHI. These were used in the first round of the Delphi process. After two rounds, 18 measures for asthma, 21 for bronchiolitis, and 22 for CHI met automatic inclusion criteria. In round three, participants categorized the potential final measures by their top 10 and next 5. This study describes a template for identifying and developing RSQMs that may promote high-quality care delivery during and following training. Next steps should include implementing and seeking validity evidence for the locally developed measures.

From the Medical Board of the National Psoriasis Foundation: Treatment targets for plaque psoriasis.

PubMed

Armstrong, April W; Siegel, Michael P; Bagel, Jerry; Boh, Erin E; Buell, Megan; Cooper, Kevin D; Callis Duffin, Kristina; Eichenfield, Lawrence F; Garg, Amit; Gelfand, Joel M; Gottlieb, Alice B; Koo, John Y M; Korman, Neil J; Krueger, Gerald G; Lebwohl, Mark G; Leonardi, Craig L; Mandelin, Arthur M; Menter, M Alan; Merola, Joseph F; Pariser, David M; Prussick, Ronald B; Ryan, Caitriona; Shah, Kara N; Weinberg, Jeffrey M; Williams, MaryJane O U; Wu, Jashin J; Yamauchi, Paul S; Van Voorhees, Abby S

2017-02-01

An urgent need exists in the United States to establish treatment goals in psoriasis. We aim to establish defined treatment targets toward which clinicians and patients with psoriasis can strive to inform treatment decisions, reduce disease burden, and improve outcomes in practice. The National Psoriasis Foundation conducted a consensus-building study among psoriasis experts using the Delphi method. The process consisted of: (1) literature review, (2) pre-Delphi question selection and input from general dermatologists and patients, and (3) 4 Delphi rounds. A total of 25 psoriasis experts participated in the Delphi process. The most preferred instrument was body surface area (BSA). The most preferred time for evaluating patient response after starting new therapies was at 3 months. The acceptable response at 3 months postinitiation was either BSA 3% or less or BSA improvement 75% or more from baseline. The target response at 3 months postinitiation was BSA 1% or less. During the maintenance period, evaluation every 6 months was most preferred. The target response at every 6 months maintenance evaluation is BSA 1% or less. Although BSA is feasible in practice, it does not encompass health-related quality of life, costs, and risks of side effects. With defined treatment targets, clinicians and patients can regularly evaluate treatment responses and perform benefit-risk assessments of therapeutic options individualized to the patient. Copyright © 2016 American Academy of Dermatology, Inc. Published by Elsevier Inc. All rights reserved.

Control Strategies for HCCI Mixed-Mode Combustion

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wagner, Robert M; Edwards, Kevin Dean

2010-03-01

Delphi Automotive Systems and ORNL established this CRADA to expand the operational range of Homogenous Charge Compression Ignition (HCCI) mixed-mode combustion for gasoline en-gines. ORNL has extensive experience in the analysis, interpretation, and control of dynamic engine phenomena, and Delphi has extensive knowledge and experience in powertrain compo-nents and subsystems. The partnership of these knowledge bases was important to address criti-cal barriers associated with the realistic implementation of HCCI and enabling clean, efficient operation for the next generation of transportation engines. The foundation of this CRADA was established through the analysis of spark-assisted HCCI data from a single-cylinder research engine.more » This data was used to (1) establish a conceptual kinetic model to better understand and predict the development of combustion instabilities, (2) develop a low-order model framework suitable for real-time controls, and (3) provide guidance in the initial definition of engine valve strategies for achieving HCCI operation. The next phase focused on the development of a new combustion metric for real-time characterization of the combustion process. Rapid feedback on the state of the combustion process is critical to high-speed decision making for predictive control. Simultaneous to the modeling/analysis studies, Delphi was focused on the development of engine hardware and the engine management system. This included custom Delphi hardware and control systems allowing for flexible control of the valvetrain sys-tem to enable HCCI operation. The final phase of this CRADA included the demonstration of conventional and spark assisted HCCI on the multi-cylinder engine as well as the characterization of combustion instabilities, which govern the operational boundaries of this mode of combustion. ORNL and Delphi maintained strong collaboration throughout this project. Meetings were held on a bi-weekly basis with additional reports, presentation, and meetings as necessary to maintain progress. Delphi provided substantial support through modeling, hardware, data exchange, and technical consultation. This CRADA was also successful at establishing important next steps to further expanding the use of an HCCI engine for improved fuel efficiency and emissions. These topics will be address in a follow-on CRADA. The objectives are: (1) Improve fundamental understanding of the development of combustion instabilities with HCCI operation through modeling and experiments; (2) Develop low-order model and feedback combustion metrics which are well suited to real-time predictive controls; and (3) Construct multi-cylinder engine system with advanced Delphi technologies and charac-terize HCCI behavior to better understand limitations and opportunities for expanded high-efficiency operation.« less

Web-based dynamic Delphi: a new survey instrument

NASA Astrophysics Data System (ADS)

Yao, JingTao; Liu, Wei-Ning

2006-04-01

We present a mathematical model for a dynamic Delphi survey method which takes advantages of Web technology. A comparative study on the performance of the conventional Delphi method and the dynamic Delphi instrument is conducted. It is suggested that a dynamic Delphi survey may form a consensus quickly. However, the result may not be robust due to the judgement leaking issues.

Defining palliative care in cystic fibrosis: A Delphi study.

PubMed

Dellon, E P; Goggin, J; Chen, E; Sabadosa, K; Hempstead, S E; Faro, A; Homa, K

2018-05-01

The goal of palliative care is to improve quality of life for people with serious illness. We aimed to create a cystic fibrosis (CF)-specific definition of palliative care. A working group of 36 CF care providers, researchers, palliative care providers, quality improvement experts, individuals with CF, and CF caregivers completed a series of questionnaires to rate the value of each of 22 attributes of palliative care, rank top attributes to construct definitions of palliative care, and then rate proposed definitions. An average of 28 participants completed each of four questionnaires, with consistent distribution of stakeholder roles across questionnaires. Many identified overlaps in routine CF care and palliative care and highlighted the importance of a definition that feels relevant across the lifespan. Modified Delphi methodology was used to define palliative care in CF. The definition will be used as the foundation for development of CF-specific palliative care guidelines. Copyright © 2017 European Cystic Fibrosis Society. Published by Elsevier B.V. All rights reserved.

Considerations when conducting e-Delphi research: a case study.

PubMed

Toronto, Coleen

2017-06-22

Background E-Delphi is a way to access a geographically dispersed group of experts. It is similar to other Delphi methods but conducted online. E-research methodologies, such as the e-Delphi method, have yet to undergo significant critical discussion. Aim To highlight some of the challenges nurse researchers may wish to consider when using e-Delphi in their research. Discussion This paper provides details about the author's approach to conducting an e-Delphi study in which a group of health literacy nurse experts (n=41) used an online survey platform to identify and prioritise essential health literacy competencies for registered nurses. Conclusion This paper advances methodological discourse about e-Delphi by critically assessing an e-Delphi case study. The online survey platform used in this study was advantageous for the researcher and the experts: the experts could participate at any time and place where the internet was available; the researcher could efficiently access a national group of experts, track responses and analyse data in each round. Implications for practice E-Delphi studies create opportunities for nurse researchers to conduct research nationally and internationally. Before conducting an e-Delphi study, researchers should carefully consider the design and methods for collecting data, to avoid challenges that could potentially compromise the quality of the findings. Researchers are encouraged to publish details about their approaches to e-Delphi studies, to advance the state of the science.

The expert's guide to mealtime interventions - A Delphi method survey.

PubMed

Conchin, Simone; Carey, Sharon

2017-09-27

Prevalence of malnutrition and a myriad of barriers to adequate oral diet in hospitalised patients warrants further investment to improve the patient mealtime experience. The aim of this study was to explore barriers and enablers to implementing effective mealtime interventions and develop a process framework to guide clinicians and researchers in the area. Potential experts in the area of hospital mealtime intervention were identified as having published in this field of work within the Australasian setting. Further information was sought by email and telephone communication on professional background; research experience; interest; and capacity to participate. Recruited participants were surveyed using a modified Delphi method to establish opinion and experience in the area of mealtime interventions. Results were collated and content was coded using a thematic analysis approach by the primary researcher and two additional reviewers. Thirty-two Australian authors in the area of mealtime interventions within the hospital environment were identified from publication. Twenty-one participants were able to be contacted and nineteen of these consented to enrol in the study. Participants included those from a dietetic (n = 14), nursing (n = 4) and medical (n = 1) background. Participants were deemed to have expert knowledge if they had significant involvement in the published research and demonstrated a deep level of understanding of hospital mealtime interventions. All participants provided key insights into barriers to oral intake in the hospital environment and suggestions for interventions to address these barriers. From the survey, an eight step framework to guide mealtime interventions was developed. Hospital mealtime interventions are complex processes. Interventions should be implemented after careful consideration of the local context and baseline data; and tailored to address barriers. Roles and responsibilities for nutrition care should be clear and consistent. Implementation planning is recommended to ensure that an ongoing process is in place to engage executive support and staff involvement, foster project team resilience and ensure sustainability of interventions. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Defining the role of a forensic hospital registered nurse using the Delphi method.

PubMed

Newman, Claire; Patterson, Karen; Eason, Michelle; Short, Ben

2016-11-01

A Delphi survey was undertaken to refine the position description of a registered nurse working in a forensic hospital, in New South Wales, Australia. Prior to commencing operation in 2008, position descriptions were developed from a review of legislation, as well as policies and procedures used by existing forensic mental health services in Australia. With an established workforce and an evolving model of care, a review of the initial registered nurse position description was required. An online Delphi survey was undertaken. Eight executive (88.9%) and 12 (58.3%) senior nursing staff participated in the first survey round. A total of four survey rounds were completed. At the final round, there was consensus (70%) that the revised position description was either very or somewhat suitable. There were a total of nine statements, from 31 originally produced in round 1, that did not reach consensus. The Delphi survey enabled a process for refining the Forensic Hospital registered nurse position description. Methods that facilitate executive and senior nursing staff consensus in the development and review of position descriptions should be considered in nursing management. © 2016 John Wiley & Sons Ltd.

Indicators for evaluating European population health: a Delphi selection process.

PubMed

Freitas, Ângela; Santana, Paula; Oliveira, Mónica D; Almendra, Ricardo; Bana E Costa, João C; Bana E Costa, Carlos A

2018-04-27

Indicators are essential instruments for monitoring and evaluating population health. The selection of a multidimensional set of indicators should not only reflect the scientific evidence on health outcomes and health determinants, but also the views of health experts and stakeholders. The aim of this study is to describe the Delphi selection process designed to promote agreement on indicators considered relevant to evaluate population health at the European regional level. Indicators were selected in a Delphi survey conducted using a web-platform designed to implement and monitor participatory processes. It involved a panel of 51 experts and 30 stakeholders from different areas of knowledge and geographies. In three consecutive rounds the panel indicated their level of agreement or disagreement with indicator's relevance for evaluating population health in Europe. Inferential statistics were applied to draw conclusions on observed level of agreement (Scott's Pi interrater reliability coefficient) and opinion change (McNemar Chi-square test). Multivariate analysis of variance was conducted to check if the field of expertise influenced the panellist responses (Wilk's Lambda test). The panel participated extensively in the study (overall response rate: 80%). Eighty indicators reached group agreement for selection in the areas of: economic and social environment (12); demographic change (5); lifestyle and health behaviours (8); physical environment (6); built environment (12); healthcare services (11) and health outcomes (26). Higher convergence of group opinion towards agreement on the relevance of indicators was seen for lifestyle and health behaviours, healthcare services, and health outcomes. The panellists' field of expertise influenced responses: statistically significant differences were found for economic and social environment (p < 0.05 in round 1 and 2), physical environment (p < 0.01 in round 1) and health outcomes (p < 0.01 in round 3). The high levels of participation observed in this study, by involving experts and stakeholders and ascertaining their views, underpinned the added value of using a transparent Web-Delphi process to promote agreement on what indicators are relevant to appraise population health.

Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature.

PubMed

Moreira, Danilo Gomes; Costello, Joseph T; Brito, Ciro J; Adamczyk, Jakub G; Ammer, Kurt; Bach, Aaron J E; Costa, Carlos M A; Eglin, Clare; Fernandes, Alex A; Fernández-Cuevas, Ismael; Ferreira, José J A; Formenti, Damiano; Fournet, Damien; Havenith, George; Howell, Kevin; Jung, Anna; Kenny, Glen P; Kolosovas-Machuca, Eleazar S; Maley, Matthew J; Merla, Arcangelo; Pascoe, David D; Priego Quesada, Jose I; Schwartz, Robert G; Seixas, Adérito R D; Selfe, James; Vainer, Boris G; Sillero-Quintana, Manuel

2017-10-01

The importance of using infrared thermography (IRT) to assess skin temperature (t sk ) is increasing in clinical settings. Recently, its use has been increasing in sports and exercise medicine; however, no consensus guideline exists to address the methods for collecting data in such situations. The aim of this study was to develop a checklist for the collection of t sk using IRT in sports and exercise medicine. We carried out a Delphi study to set a checklist based on consensus agreement from leading experts in the field. Panelists (n = 24) representing the areas of sport science (n = 8; 33%), physiology (n = 7; 29%), physiotherapy (n = 3; 13%) and medicine (n = 6; 25%), from 13 different countries completed the Delphi process. An initial list of 16 points was proposed which was rated and commented on by panelists in three rounds of anonymous surveys following a standard Delphi procedure. The panel reached consensus on 15 items which encompassed the participants' demographic information, camera/room or environment setup and recording/analysis of t sk using IRT. The results of the Delphi produced the checklist entitled "Thermographic Imaging in Sports and Exercise Medicine (TISEM)" which is a proposal to standardize the collection and analysis of t sk data using IRT. It is intended that the TISEM can also be applied to evaluate bias in thermographic studies and to guide practitioners in the use of this technique. Copyright © 2017 Elsevier Ltd. All rights reserved.

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

A model for making project funding decisions at the National Cancer Institute.

PubMed

Hall, N G; Hershey, J C; Kessler, L G; Stotts, R C

1992-01-01

This paper describes the development of a model for making project funding decisions at The National Cancer Institute (NCI). The American Stop Smoking Intervention Study (ASSIST) is a multiple-year, multiple-site demonstration project, aimed at reducing smoking prevalence. The initial request for ASSIST proposals was answered by about twice as many states as could be funded. Scientific peer review of the proposals was the primary criterion used for funding decisions. However, a modified Delphi process made explicit several criteria of secondary importance. A structured questionnaire identified the relative importance of these secondary criteria, some of which we incorporated into a composite preference function. We modeled the proposal funding decision as a zero-one program, and adjusted the preference function and available budget parametrically to generate many suitable outcomes. The actual funding decision, identified by our model, offers significant advantages over manually generated solutions found by experts at NCI.

A consensus definition and core competencies for being an advocate for pharmacy.

PubMed

Bzowyckyj, Andrew S; Janke, Kristin K

2013-03-12

To develop a consensus definition for "advocacy for the profession of pharmacy" and core competencies for doctor of pharmacy (PharmD) graduates to be effective advocates for the profession. A 3-round modified Delphi process was conducted using a panel of 9 experts. Participants revised a definition for "advocacy for the profession" and ultimately rated their agreement using a 5-point Likert scale. Competency statements were developed and subsequently rated for importance for being an advocate and importance to address in PharmD curricula. A consensus-derived definition was developed. Two competency statements achieved consensus for both measures of importance. Four competency statements achieved consensus for only 1 measure and another 4 did not reach consensus for either measure. A consensus-derived definition was developed describing advocacy for the profession of pharmacy and began laying the groundwork for the knowledge and skills necessary to be an effective advocate for the profession of pharmacy.

Internet-Based Delphi Research: Case Based Discussion

PubMed Central

Donohoe, Holly M.; Stellefson, Michael L.

2013-01-01

The interactive capacity of the Internet offers benefits that are intimately linked with contemporary research innovation in the natural resource and environmental studies domains. However, e-research methodologies, such as the e-Delphi technique, have yet to undergo critical review. This study advances methodological discourse on the e-Delphi technique by critically assessing an e-Delphi case study. The analysis suggests that the benefits of using e-Delphi are noteworthy but the authors acknowledge that researchers are likely to face challenges that could potentially compromise research validity and reliability. To ensure that these issues are sufficiently considered when planning and designing an e-Delphi, important facets of the technique are discussed and recommendations are offered to help the environmental researcher avoid potential pitfalls associated with coordinating e-Delphi research. PMID:23288149

The Delphi Method Online: Medical Expert Consensus Via the Internet

PubMed Central

Cam, Kenneth M.; McKnight, Patrick E.; Doctor, Jason N.

2002-01-01

Delphi is an expert consensus method. The theory behind the Delphi method is that the interaction of experts may lead to a reduction in individual bias. We have developed software that carries out all aspects of the Delphi method via the Internet. The Delphi method online consists of three components: 1) authorship, 2) interactive polling, and 3) reporting/results. We hope that researchers use this tool in future medical expert systems.

Development of key indicators of hospital resilience: a modified Delphi study.

PubMed

Zhong, Shuang; Clark, Michele; Hou, Xiang-Yu; Zang, Yuli; FitzGerald, Gerard

2015-04-01

Hospital resilience is an emerging concept, which can be defined as 'a hospital's ability to resist, absorb, and respond to the shock of disasters while maintaining its critical health care functions, and then recover to its original state or adapt to a new one'. Our aim was to develop a comprehensive framework of key indicators of hospital resilience. A panel of 33 Chinese experts was invited to participate in a three-round, modified Delphi study to develop a set of potential measures previously derived from a literature review. In the first round, these potential measures were modified to cover the comprehensive domains of hospital resilience. The importance of proposed measures was scored by experts on a five-point Likert scale. Subsequently, the experts reconsidered their voting in light of the previous aggregated results. Agreement on measures was defined as at least 70% of the responders agreeing or strongly agreeing to the inclusion of a measure. A large proportion of preliminary measures (89.5%) were identified as having good potential for assessing hospital resilience. These measures were categorized into eight domains, 17 subdomains, and 43 indicators. The highest rated indicators (mean score) were: equipment for on-site rescue (4.7), plan initiation (4.6), equipment for referral of patients with complex care needs (4.5), the plan execution (4.4), medication management strategies (4.4), emergency medical treatment conditions (4.4), disaster committee (4.4), stock types and quantities for essential medications (4.4), surge capacity of emergency beds (4.4), and mass-casualty triage protocols (4.4). This framework identifies a comprehensive set of indicators of hospital resilience. It can be used for hospital assessment, as well as informing priority practices to address future disasters better. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Medication administration errors from a nursing viewpoint: a formal consensus of definition and scenarios using a Delphi technique.

PubMed

Shawahna, Ramzi; Masri, Dina; Al-Gharabeh, Rawan; Deek, Rawan; Al-Thayba, Lama; Halaweh, Masa

2016-02-01

To develop and achieve formal consensus on a definition of medication administration errors and scenarios that should or should not be considered as medication administration errors in hospitalised patient settings. Medication administration errors occur frequently in hospitalised patient settings. Currently, there is no formal consensus on a definition of medication administration errors or scenarios that should or should not be considered as medication administration errors. This was a descriptive study using Delphi technique. A panel of experts (n = 50) recruited from major hospitals, nursing schools and universities in Palestine took part in the study. Three Delphi rounds were followed to achieve consensus on a proposed definition of medication administration errors and a series of 61 scenarios representing potential medication administration error situations formulated into a questionnaire. In the first Delphi round, key contact nurses' views on medication administration errors were explored. In the second Delphi round, consensus was achieved to accept the proposed definition of medication administration errors and to include 36 (59%) scenarios and exclude 1 (1·6%) as medication administration errors. In the third Delphi round, consensus was achieved to consider further 14 (23%) and exclude 2 (3·3%) as medication administration errors while the remaining eight (13·1%) were considered equivocal. Of the 61 scenarios included in the Delphi process, experts decided to include 50 scenarios as medication administration errors, exclude three scenarios and include or exclude eight scenarios depending on the individual clinical situation. Consensus on a definition and scenarios representing medication administration errors can be achieved using formal consensus techniques. Researchers should be aware that using different definitions of medication administration errors, inclusion or exclusion of medication administration error situations could significantly affect the rate of medication administration errors reported in their studies. Consensual definitions and medication administration error situations can be used in future epidemiology studies investigating medication administration errors in hospitalised patient settings which may permit and promote direct comparisons of different studies. © 2015 John Wiley & Sons Ltd.

A Delphi approach to developing a core competency framework for family practice registered nurses in Ontario.

PubMed

Moaveni, Azadeh; Gallinaro, Anna; Conn, Lesley Gotlib; Callahan, Sheilagh; Hammond, Melanie; Oandasan, Ivy

2010-12-01

This paper describes the results of a Delphi panel process to gain consensus on a role description and competency framework for family practice registered nurses (FP-RNs) in Ontario. Based on the findings from interviews and focus groups with family practice registered nurses and their inter-professional colleagues throughout Ontario, a core competency framework for FP-RNs emerged consisting of six distinct roles - Professional, Expert, Communicator, Synergist, Health Educator and Lifelong Learner - with accompanying enabling competency statements. This framework was refined and validated by a panel of experts from various nursing and family medicine associations and organizations through a Delphi consensus process. This core competency framework for FP-RNs was developed as a stepping stone for clarifying this very important and poorly understood role in family practice. As a result of this research, we expect a greater acknowledgement of the contributions and expertise of the FP-RN as well as the need to celebrate and profile this role. This work has already led to the establishment of a network of stakeholders from nursing organizations in Ontario who are considering opportunities to move the development and use of the competency framework forward.

Defining the activities of publicness for Korea's public community hospitals using the Delphi method.

PubMed

Lee, Kunsei; Kim, Hyun Joo; You, Myoungsoon; Lee, Jin-Seok; Eun, Sang Jun; Jeong, Hyoseon; Ahn, Hye Mi; Lee, Jin Yong

2017-03-01

This study aims to identify which activities of a public community hospital (PHC) should be included in their definition of publicness and tries to achieve a consensus among experts using the Delphi method. We conduct 2 rounds of the Delphi process with 17 panel members using a developed draft of tentative activities for publicness including 5 main categories covering 27 items. The questions remain the same in both rounds and the applicability of each of the 27 items to publicness is measured on a 9-point scale. If the participants believe government funding is needed, we ask how much they think the government should support each item on a 0% to 100% scale. After conducting 2 rounds of the Delphi process, 22 out of the 27 items reached a consensus as activities defining the publicness of the PHCs. Among the 5 major categories, in category C, activities preventing market failure, all 10 items were considered activities of publicness. Nine of these were evaluated as items that should be compensated at 100% of total financial loss by the Korean government. Throughout results, we were able to define the activities of the PCH that encompassed its publicness and confirm that there are "good deficits" in the context of the PCHs. Thus, some PCH deficits are unavoidable and not wasted as these monies support a necessary role and function in providing public health. The Korean government should therefore consider taking actions such as exempting such "good deficits" or providing additional financial aid to reimburse the PHCs for "good deficits."

Development of quality metrics for ambulatory care in pediatric patients with tetralogy of Fallot.

PubMed

Villafane, Juan; Edwards, Thomas C; Diab, Karim A; Satou, Gary M; Saarel, Elizabeth; Lai, Wyman W; Serwer, Gerald A; Karpawich, Peter P; Cross, Russell; Schiff, Russell; Chowdhury, Devyani; Hougen, Thomas J

2017-12-01

The objective of this study was to develop quality metrics (QMs) relating to the ambulatory care of children after complete repair of tetralogy of Fallot (TOF). A workgroup team (WT) of pediatric cardiologists with expertise in all aspects of ambulatory cardiac management was formed at the request of the American College of Cardiology (ACC) and the Adult Congenital and Pediatric Cardiology Council (ACPC), to review published guidelines and consensus data relating to the ambulatory care of repaired TOF patients under the age of 18 years. A set of quality metrics (QMs) was proposed by the WT. The metrics went through a two-step evaluation process. In the first step, the RAND-UCLA modified Delphi methodology was employed and the metrics were voted on feasibility and validity by an expert panel. In the second step, QMs were put through an "open comments" process where feedback was provided by the ACPC members. The final QMs were approved by the ACPC council. The TOF WT formulated 9 QMs of which only 6 were submitted to the expert panel; 3 QMs passed the modified RAND-UCLA and went through the "open comments" process. Based on the feedback through the open comment process, only 1 metric was finally approved by the ACPC council. The ACPC Council was able to develop QM for ambulatory care of children with repaired TOF. These patients should have documented genetic testing for 22q11.2 deletion. However, lack of evidence in the literature made it a challenge to formulate other evidence-based QMs. © 2017 Wiley Periodicals, Inc.

Developing a measure of provider adherence to improve the implementation of behavioral health services in primary care: a Delphi study

PubMed Central

2013-01-01

Background The integration of behavioral health services into primary care is increasingly popular, yet fidelity of implementation in this area has been infrequently assessed due to the few measurement tools available. A sentinel indicator of fidelity of implementation is provider adherence, or utilization of prescribed procedures and engagement in model-specific behaviors. This study aimed to develop the first self-report measure of behavioral health provider adherence for co-located, collaborative care, a commonly adopted model of behavioral health service delivery in primary care. Methods A preliminary 56-item measure was developed by the research team to represent critical components of adherence among behavioral health providers. To ensure the content validity of the measure, a modified Delphi study was conducted using a panel of co-located, collaborative care model experts. During three rounds of emailed surveys, panel members provided qualitative feedback regarding item content while rating each item’s relevance for behavioral health provider practice. Items with consensus ratings of 80% or greater were included in the final adherence measure. Results The panel consisted of 25 experts representing the Department of Veterans Affairs, the Department of Defense, and academic and community health centers (total study response rate of 76%). During the Delphi process, two new items were added to the measure, four items were eliminated, and a high level of consensus was achieved on the remaining 54 items. Experts identified 38 items essential for model adherence, six items compatible (although not essential) for model adherence, and 10 items that represented prohibited behaviors. Item content addressed several domains, but primarily focused on behaviors related to employing a time-limited, brief treatment model, the scope of patient concerns addressed, and interventions used by providers. Conclusions This study yielded the first content valid self-report measure of critical components of collaborative care adherence for use by behavioral health providers in primary care. Although additional psychometric evaluation is necessary, this measure may assist implementation researchers in clarifying how provider behaviors contribute to clinical outcomes. This measure may also assist clinical stakeholders in monitoring implementation and identifying ways to support frontline providers in delivering high quality services. PMID:23406425

Development of a clinical feeding assessment scale for very young infants in South Africa

PubMed Central

2016-01-01

Background There is a need for validated neonatal feeding assessment instruments in South Africa. A locally developed instrument may contribute to standardised evaluation procedures of high-risk neonates and address needs in resource constrained developing settings. Objective The aim of the study was to develop and validate the content of a clinical feeding assessment scale to diagnose oropharyngeal dysphagia (OPD) in neonates. Method The Neonatal Feeding Assessment Scale (NFAS) was developed using the Delphi method. Five international and South African speech-language therapists (SLTs) formed the expert panel, participating in two rounds of electronic questionnaires to develop and validate the content of the NFAS. Results All participants agreed on the need for the development of a valid clinical feeding assessment instrument to use with the neonatal population. The initial NFAS consisted of 240 items across 8 sections, and after the Delphi process was implemented, the final format was reduced to 211 items across 6 sections. The final format of the NFAS is scored using a binary scoring system guiding the clinician to diagnose the presence or absence of OPD. All members agreed on the format, the scoring system and the feeding constructs addressed in the revised final format of the NFAS. Conclusion The Delphi method and the diverse clinical and research experience of participants could be integrated to develop the NFAS which may be used in clinical practice in South Africa or similar developing contexts. Because of demographically different work settings marked by developed versus developing contexts, participants did not have the same expectations of a clinical dysphagia assessment. The international participants contributed to evidence-based content development. Local participants considered the contextual challenges of South African SLTs entering the field with basic competencies in neonatal dysphagia management, thereby justifying a comprehensive clinical instrument. The NFAS is aimed at clinicians working in Neonatal Intensive Care Units where they manage large caseloads of high-risk neonates. Further validation of the NFAS is recommended to determine its criterion validity in comparison with a widely accepted standard such as the modified barium swallow study. PMID:27796101

Developing the E-Delphi System: A Web-Based Forecasting Tool for Educational Research.

ERIC Educational Resources Information Center

Chou, Chien

2002-01-01

Discusses use of the Delphi technique and describes the development of an electronic version, called e-Delphi, in which questionnaire construction and communication with panel members was accomplished using the Web. Explains system function and interface and discusses evaluation of the e-Delphi system. (Author/LRW)

Validation of the process criteria for assessment of a hospital nursing service.

PubMed

Feldman, Liliane Bauer; Cunha, Isabel Cristina Kowal Olm; D'Innocenzo, Maria

2013-01-01

to validate an instrument containing process criteria for assessment of a hospital nursing service based on the National Accreditation Organization program. a descriptive, quantitative methodological study performed in stages. An instrument constructed with 69 process criteria was assessed by 49 nurses from accredited hospitals in 2009, according to a Likert scale, and validated by 16 judges through Delphi rounds in 2010. the original instrument assessed by nurses with 69 process criteria was judged by the degree of importance, and changed to 39 criteria. In the first Delphi round, the 39 criteria reached consensus among the 19 judges, with a medium reliability by Cronbach's alpha. In the second round, 40 converging criteria were validated by 16 judges, with high reliability. The criteria addressed management, costs, teaching, education, indicators, protocols, human resources, communication, among others. the 40 process criteria formed a validated instrument to assess the hospital nursing service which, when measured, can better direct interventions by nurses in reaching and strengthening outcomes.

The Norwegian General Practice--Nursing Home criteria (NORGEP-NH) for potentially inappropriate medication use: A web-based Delphi study.

PubMed

Nyborg, Gunhild; Straand, Jørund; Klovning, Atle; Brekke, Mette

2015-06-01

To develop a set of explicit criteria for pharmacologically inappropriate medication use in nursing homes. In an expert panel, a three-round Delphi consensus process was conducted via survey software. Norway. Altogether 80 participants - specialists in geriatrics or clinical pharmacology, physicians in nursing homes and experienced pharmacists - agreed to participate in the survey. Of these, 62 completed the first round, and 49 panellists completed all three rounds (75.4% of those ultimately entering the survey). The authors developed a list of 27 criteria based on the Norwegian General Practice (NORGEP) criteria, literature, and clinical experience. The main outcome measure was the panellists' evaluation of the clinical relevance of each suggested criterion on a digital Likert scale from 1 (no clinical relevance) to 10. In the first round panellists could also suggest new criteria to be included in the process. For each criterion, degree of consensus was based on the average Likert score and corresponding standard deviation (SD). A list of 34 explicit criteria for potentially inappropriate medication use in nursing homes was developed through a three-round web-based Delphi consensus process. Degree of consensus increased with each round. No criterion was voted out. Suggestions from the panel led to the inclusion of seven additional criteria in round two. The NORGEP-NH list may serve as a tool in the prescribing process and in medication list reviews and may also be used in quality assessment and for research purposes.

Identifying the features of an exercise addiction: A Delphi study

PubMed Central

Macfarlane, Lucy; Owens, Glynn; Cruz, Borja del Pozo

2016-01-01

Objectives There remains limited consensus regarding the definition and conceptual basis of exercise addiction. An understanding of the factors motivating maintenance of addictive exercise behavior is important for appropriately targeting intervention. The aims of this study were twofold: first, to establish consensus on features of an exercise addiction using Delphi methodology and second, to identify whether these features are congruous with a conceptual model of exercise addiction adapted from the Work Craving Model. Methods A three-round Delphi process explored the views of participants regarding the features of an exercise addiction. The participants were selected from sport and exercise relevant domains, including physicians, physiotherapists, coaches, trainers, and athletes. Suggestions meeting consensus were considered with regard to the proposed conceptual model. Results and discussion Sixty-three items reached consensus. There was concordance of opinion that exercising excessively is an addiction, and therefore it was appropriate to consider the suggestions in light of the addiction-based conceptual model. Statements reaching consensus were consistent with all three components of the model: learned (negative perfectionism), behavioral (obsessive–compulsive drive), and hedonic (self-worth compensation and reduction of negative affect and withdrawal). Conclusions Delphi methodology allowed consensus to be reached regarding the features of an exercise addiction, and these features were consistent with our hypothesized conceptual model of exercise addiction. This study is the first to have applied Delphi methodology to the exercise addiction field, and therefore introduces a novel approach to exercise addiction research that can be used as a template to stimulate future examination using this technique. PMID:27554504

Preliminary identification of key clinical domains for outcome evaluation in fibromyalgia using the Delphi method: the Italian experience.

PubMed

Salaffi, F; Ciapetti, A; Sarzi Puttini, P; Atzeni, F; Iannuccelli, C; Di Franco, M; Cazzola, M; Bazzichi, L

2012-03-19

Fibromyalgia (FM) is a complex syndrome that, in Italy, affects at least 2% of the adult population. It is characterized by chronic widespread musculoskeletal pain often accompanied by multiple other symptoms. The aim of this study was to identify a set of clinical domains for FM considered relevant by both clinicians and patients using a consensus process. Consensus was achieved using the Delphi method based on questionnaires and systematic, controlled opinion feedback. The Delphi exercise involved a panel of 252 rheumatologists and 86 patients with FM as defined by the American College of Rheumatology criteria. All of the patients and clinicians were asked to rank the relative different domains of FM in order of priority. The content validity index (CVI) was used to establish the percentage agreement. The importance of each item was ranked on a 0-3 Likert scale. The frequency, mean relevance scores, and frequency importance product were also calculated. The Delphi exercise showed that the domains ranked highest by patients were similar to those of the clinicians, with the exception of tender point intensity (considered relevant by the clinicians but not by the patients) and environmental sensitivity (considered important by the patients but not by the clinicians). A final 8-item model was developed which was considered to demonstrate adequate validity. The Delphi exercises identified and ranked relevant key clinical domains that need to be assessed in FM research. On the basis of these results, a new patient-reported composite outcome index can be developed and used in clinical trials.

Simulation Of Wave Function And Probability Density Of Modified Poschl Teller Potential Derived Using Supersymmetric Quantum Mechanics

NASA Astrophysics Data System (ADS)

Angraini, Lily Maysari; Suparmi, Variani, Viska Inda

2010-12-01

SUSY quantum mechanics can be applied to solve Schrodinger equation for high dimensional system that can be reduced into one dimensional system and represented in lowering and raising operators. Lowering and raising operators can be obtained using relationship between original Hamiltonian equation and the (super) potential equation. In this paper SUSY quantum mechanics is used as a method to obtain the wave function and the energy level of the Modified Poschl Teller potential. The graph of wave function equation and probability density is simulated by using Delphi 7.0 programming language. Finally, the expectation value of quantum mechanics operator could be calculated analytically using integral form or probability density graph resulted by the programming.

The use of advanced web-based survey design in Delphi research.

PubMed

Helms, Christopher; Gardner, Anne; McInnes, Elizabeth

2017-12-01

A discussion of the application of metadata, paradata and embedded data in web-based survey research, using two completed Delphi surveys as examples. Metadata, paradata and embedded data use in web-based Delphi surveys has not been described in the literature. The rapid evolution and widespread use of online survey methods imply that paper-based Delphi methods will likely become obsolete. Commercially available web-based survey tools offer a convenient and affordable means of conducting Delphi research. Researchers and ethics committees may be unaware of the benefits and risks of using metadata in web-based surveys. Discussion paper. Two web-based, three-round Delphi surveys were conducted sequentially between August 2014 - January 2015 and April - May 2016. Their aims were to validate the Australian nurse practitioner metaspecialties and their respective clinical practice standards. Our discussion paper is supported by researcher experience and data obtained from conducting both web-based Delphi surveys. Researchers and ethics committees should consider the benefits and risks of metadata use in web-based survey methods. Web-based Delphi research using paradata and embedded data may introduce efficiencies that improve individual participant survey experiences and reduce attrition across iterations. Use of embedded data allows the efficient conduct of multiple simultaneous Delphi surveys across a shorter timeframe than traditional survey methods. The use of metadata, paradata and embedded data appears to improve response rates, identify bias and give possible explanation for apparent outlier responses, providing an efficient method of conducting web-based Delphi surveys. © 2017 John Wiley & Sons Ltd.

Active faulting at Delphi, Greece: Seismotectonic remarks and a hypothesis for the geologic environment of a myth

NASA Astrophysics Data System (ADS)

Piccardi, Luigi

2000-07-01

Historical data are fundamental to the understanding of the seismic history of an area. At the same time, knowledge of the active tectonic processes allows us to understand how earthquakes have been perceived by past cultures. Delphi is one of the principal archaeological sites of Greece, the main oracle of Apollo. It was by far the most venerated oracle of the Greek ancient world. According to tradition, the mantic proprieties of the oracle were obtained from an open chasm in the earth. Delphi is directly above one of the main antithetic active faults of the Gulf of Corinth Rift, which bounds Mount Parnassus to the south. The geometry of the fault and slip-parallel lineations on the main fault plane indicate normal movement, with minor right-lateral slip component. Combining tectonic data, archaeological evidence, historical sources, and a reexamination of myths, it appears that the Helice earthquake of 373 B.C. ruptured not only the master fault of the Gulf of Corinth Rift at Helice, but also the antithetic fault at Delphi, similarly to the Corinth earthquake of 1981. Moreover, the presence of an active fault directly below the temples of the oldest sanctuary suggests that the mythological oracular chasm might well have been an ancient tectonic surface rupture.

Healthcare Quality Indicators for Physiotherapy Management in Hip and Knee Osteoarthritis and Rheumatoid Arthritis: A Delphi Study.

PubMed

Peter, W F; Hurkmans, E J; van der Wees, P J; Hendriks, E J M; van Bodegom-Vos, L; Vliet Vlieland, T P M

2016-12-01

The aim of the present study was to develop healthcare quality indicators (HCQIs) for the physiotherapy (PT) management of patients with hip or knee osteoarthritis (HKOA) or rheumatoid arthritis (RA) in the Netherlands. Two multidisciplinary expert panels, including patients, were instituted. A draft HCQI set was derived from recommendations included in two existing Dutch PT guidelines for HKOA and RA. The panels suggested additional topics, after which a Delphi procedure was performed. All propositions were scored for their potential to represent good-quality PT care (score range 0-9). Based on predefined rules, the Delphi panel HCQIs were discussed and selected. Lastly, every indicator was rephrased, resulting in its output consisting of a numerator and denominator, to facilitate comparisons within and among practices. After two Delphi rounds, two final sets of 17 HCQI - one for HKOA and one for RA - were composed, both containing 16 process indicators (regarding initial assessment, treatment and evaluation) and one outcome indicator. Two sets of HCQIs for PT management in HKOA and RA were developed for measuring the quality of PT care in daily clinical practice. Each indicator was formulated in a measurable way. Future research should focus on the feasibility of both indicator sets for daily clinical practice. Copyright © 2016 John Wiley & Sons, Ltd.

Consensus on the management of intracranial germ-cell tumours.

PubMed

Murray, Matthew J; Bartels, Ute; Nishikawa, Ryo; Fangusaro, Jason; Matsutani, Masao; Nicholson, James C

2015-09-01

The management of intracranial germ-cell tumours is complex because of varied clinical presentations, tumour sites, treatments and outcomes, and the need for multidisciplinary input. Participants of the 2013 Third International CNS Germ Cell Tumour Symposium (Cambridge, UK) agreed to undertake a multidisciplinary Delphi process to identify consensus in the clinical management of intracranial germ-cell tumours. 77 delegates from the symposium were selected as suitable experts in the field and were invited to participate in the Delphi survey, of which 64 (83%) responded to the invitation. Invited participants represented multiple disciplines from Asia, Australasia, Europe, and the Americas. 38 consensus statements encompassing aspects of intracranial germ-cell tumour work-up, staging, treatment, and follow-up were prepared. To achieve consensus, statements required at least 70% agreement from at least 60% of respondents. Overall, 34 (89%) of 38 statements met consensus criteria. This international Delphi approach has defined key areas of consensus that will help guide and streamline clinical management of patients with intracranial germ-cell tumours. Additionally, the Delphi approach identified areas of different understanding and clinical practice internationally in the management of these tumours, areas which should be the focus of future collaborative studies. Such efforts should translate into improved patient outcomes. Copyright © 2015 Elsevier Ltd. All rights reserved.

An opportunity in difficulty: Japan-Korea-Taiwan expert Delphi consensus on surgical difficulty during laparoscopic cholecystectomy.

PubMed

Iwashita, Yukio; Hibi, Taizo; Ohyama, Tetsuji; Honda, Goro; Yoshida, Masahiro; Miura, Fumihiko; Takada, Tadahiro; Han, Ho-Seong; Hwang, Tsann-Long; Shinya, Satoshi; Suzuki, Kenji; Umezawa, Akiko; Yoon, Yoo-Seok; Choi, In-Seok; Huang, Wayne Shih-Wei; Chen, Kuo-Hsin; Watanabe, Manabu; Abe, Yuta; Misawa, Takeyuki; Nagakawa, Yuichi; Yoon, Dong-Sup; Jang, Jin-Young; Yu, Hee Chul; Ahn, Keun Soo; Kim, Song Cheol; Song, In Sang; Kim, Ji Hoon; Yun, Sung Su; Choi, Seong Ho; Jan, Yi-Yin; Shan, Yan-Shen; Ker, Chen-Guo; Chan, De-Chuan; Wu, Cheng-Chung; Lee, King-Teh; Toyota, Naoyuki; Higuchi, Ryota; Nakamura, Yoshiharu; Mizuguchi, Yoshiaki; Takeda, Yutaka; Ito, Masahiro; Norimizu, Shinji; Yamada, Shigetoshi; Matsumura, Naoki; Shindoh, Junichi; Sunagawa, Hiroki; Gocho, Takeshi; Hasegawa, Hiroshi; Rikiyama, Toshiki; Sata, Naohiro; Kano, Nobuyasu; Kitano, Seigo; Tokumura, Hiromi; Yamashita, Yuichi; Watanabe, Goro; Nakagawa, Kunitoshi; Kimura, Taizo; Yamakawa, Tatsuo; Wakabayashi, Go; Mori, Rintaro; Endo, Itaru; Miyazaki, Masaru; Yamamoto, Masakazu

2017-04-01

We previously identified 25 intraoperative findings during laparoscopic cholecystectomy (LC) as potential indicators of surgical difficulty per nominal group technique. This study aimed to build a consensus among expert LC surgeons on the impact of each item on surgical difficulty. Surgeons from Japan, Korea, and Taiwan (n = 554) participated in a Delphi process and graded the 25 items on a seven-stage scale (range, 0-6). Consensus was defined as (1) the interquartile range (IQR) of overall responses ≤2 and (2) ≥66% of the responses concentrated within a median ± 1 after stratification by workplace and LC experience level. Response rates for the first and the second-round Delphi were 92.6% and 90.3%, respectively. Final consensus was reached for all the 25 items. 'Diffuse scarring in the Calot's triangle area' in the 'Factors related to inflammation of the gallbladder' category had the strongest impact on surgical difficulty (median, 5; IQR, 1). Surgeons agreed that the surgical difficulty increases as more fibrotic change and scarring develop. The median point for each item was set as the difficulty score. A Delphi consensus was reached among expert LC surgeons on the impact of intraoperative findings on surgical difficulty. © 2017 Japanese Society of Hepato-Biliary-Pancreatic Surgery.

[A Delphi Method Survey of the Core Competences of Post-Acute-Care Nurses in Caring for Acute Stroke Patients].

PubMed

Chi, Shu-Ching; Yeh, Lily; Lu, Meei-Shiow; Lin, Pei-Yu

2015-12-01

Post-acute care (PAC) service is becoming increasingly important in Taiwan as a core focus of government policies that are designed to ensure continuity of care. In order to improve PAC nursing education and quality of care, the present study applies a modified Delphi method to identify the core competences of nurses who provide PAC services to acute stroke patients. We surveyed 18 experts in post-acute care and long-term care anonymously using a 29-question questionnaire in order to identify the essential professional skills that are required to perform PAC effectively. The results of this survey indicate that the core competences of PAC may be divided into two categories: Case Management and Care Management. Case Management includes Direct Care, Communication, Health Care Education, Nursing Consulting, and Family Assessment & Health Care. Care Management includes Interdisciplinary Teamwork, Patient Care Management, and Resource Integration. The importance and practicality of each item was evaluated using a 7-point Likert scale. The experts required 2 rounds to reach a consensus about the importance and 3 rounds to determine the practicality of PAC core competences. This process highlighted the differing points of view that are held by professionals in the realms of nursing, medicine, and national health policy. The PAC in-job training program in its current form inadequately cul-tivates core competence in Care Management. The results of the present study may be used to inform the development of PAC nurse orientation training programs and continuing education courses.

Major incident triage: A consensus based definition of the essential life-saving interventions during the definitive care phase of a major incident.

PubMed

Vassallo, James; Smith, Jason E; Bruijns, Stevan R; Wallis, Lee A

2016-09-01

Triage is a key principle in the effective management of major incidents. The process currently relies on algorithms assigning patients to specific triage categories; there is, however, little guidance as to what these categories represent. Previously, these algorithms were validated against injury severity scores, but it is accepted now that the need for life-saving intervention is a more important outcome. However, the definition of a life-saving intervention is unclear. The aim of this study was to define what constitutes a life-saving intervention, in order to facilitate the definition of an adult priority one patient during the definitive care phase of a major incident. We conducted a modified Delphi study, using a panel of subject matter experts drawn from the United Kingdom and Republic of South Africa with a background in Emergency Care or Major Incident Management. The study was conducted using an online survey tool, over three rounds between July and December 2013. A four point Likert scale was used to seek consensus for 50 possible interventions, with a consensus level set at 70%. 24 participants completed all three rounds of the Delphi, with 32 life-saving interventions reaching consensus. This study provides a consensus definition of what constitutes a life-saving intervention in the context of an adult, priority one patient during the definitive care phase of a major incident. The definition will contribute to further research into major incident triage, specifically in terms of validation of an adult major incident triage tool. Copyright © 2016 Elsevier Ltd. All rights reserved.

Selective mutism: a consensus based care pathway of good practice.

PubMed

Keen, D V; Fonseca, S; Wintgens, A

2008-10-01

Selective mutism (SM) now acknowledged as an anxiety condition, tends to be a poorly understood, highly complex and vastly under-recognised clinical entity. Children with SM are a vulnerable group as the condition is not the remit of any one professional group. This inevitably leads to delay in formal diagnosis and management. There is a lack of systematic research on which to base guidelines for management. To develop, agree and validate key principles underlying the management of SM through a consensus process involving international experts, in order to create a local care pathway. A local multi-agency consultation process developed 11 statements, which were felt to be the key principles underpinning a potential care pathway for managing SM. Thirteen recognised experts from North America, Europe and Australia participated in a modified Delphi process involving two rounds using a Likert-scale and free commentary. Both quantitative and qualitative analyses were used in the validation or revision of the statements at each stage. Response rates were 100% for Round 1 and 84.6% for Round 2. Despite the differing professional backgrounds and service contexts, by successive revision and/or revalidation of statements, it was possible to arrive at a consensus about key principles relating to early recognition, assessment and intervention. The agreed key principles are presented together with the resulting local care pathway. Through a Delphi process, agreement was reached by a multidisciplinary group of professionals, on key principles that underpin the timely identification, assessment and management of children with SM. These include the potential for staff in school/preschool settings to identify SM and that intervention programmes should generally be based in these settings. Children with SM should receive assessment for possible coexisting disorders, whether developmental, emotional or behavioural and additional specific intervention given for these. Agreement was reached as to what constitutes clinical progress, intervals for monitoring progress, criteria for referral onwards for multidisciplinary specialist assessment and the role of selective serotonin reuptake inhibitor (SSRI) medication. A consensus methodology has been successfully used to compensate for the lack of evidence base and harness the expertise of a relatively small number of experienced professionals in order to provide a basis for the future development of services.

Defining competency-based evaluation objectives in family medicine

PubMed Central

Lawrence, Kathrine; Allen, Tim; Brailovsky, Carlos; Crichton, Tom; Bethune, Cheri; Donoff, Michel; Laughlin, Tom; Wetmore, Stephen; Carpentier, Marie-Pierre; Visser, Shaun

2011-01-01

Abstract Objective To develop key features for priority topics previously identified by the College of Family Physicians of Canada that, together with skill dimensions and phases of the clinical encounter, broadly describe competence in family medicine. Design Modified nominal group methodology, which was used to develop key features for each priority topic through an iterative process. Setting The College of Family Physicians of Canada. Participants An expert group of 7 family physicians and 1 educational consultant, all of whom had experience in assessing competence in family medicine. Group members represented the Canadian family medicine context with respect to region, sex, language, community type, and experience. Methods The group used a modified Delphi process to derive a detailed operational definition of competence, using multiple iterations until consensus was achieved for the items under discussion. The group met 3 to 4 times a year from 2000 to 2007. Main findings The group analyzed 99 topics and generated 773 key features. There were 2 to 20 (average 7.8) key features per topic; 63% of the key features focused on the diagnostic phase of the clinical encounter. Conclusion This project expands previous descriptions of the process of generating key features for assessment, and removes this process from the context of written examinations. A key-features analysis of topics focuses on higher-order cognitive processes of clinical competence. The project did not define all the skill dimensions of competence to the same degree, but it clearly identified those requiring further definition. This work generates part of a discipline-specific, competency-based definition of family medicine for assessment purposes. It limits the domain for assessment purposes, which is an advantage for the teaching and assessment of learners. A validation study on the content of this work would ensure that it truly reflects competence in family medicine. PMID:21998245

Geriatric Assessment-Guided Care Processes for Older Adults: A Delphi Consensus of Geriatric Oncology Experts.

PubMed

Mohile, Supriya Gupta; Velarde, Carla; Hurria, Arti; Magnuson, Allison; Lowenstein, Lisa; Pandya, Chintan; O'Donovan, Anita; Gorawara-Bhat, Rita; Dale, William

2015-09-01

Structured care processes that provide a framework for how oncologists can incorporate geriatric assessment (GA) into clinical practice could improve outcomes for vulnerable older adults with cancer, a growing population at high risk of toxicity from cancer treatment. We sought to obtain consensus from an expert panel on the use of GA in clinical practice and to develop algorithms of GA-guided care processes. The Delphi technique, a well-recognized structured and reiterative process to reach consensus, was used. Participants were geriatric oncology experts who attended NIH-funded U13 or Cancer and Aging Research Group conferences. Consensus was defined as an interquartile range of 2 or more units, or 66.7% or greater, selecting a utility/helpfulness rating of 7 or greater on a 10-point Likert scale. For nominal data, consensus was defined as agreement among 66.7% or more of the group. From 33 invited, 30 participants completed all 3 rounds. Most experts (75%) used GA in clinical care, and the remainder were involved in geriatric oncology research. The panel met consensus that "all patients aged 75 years or older and those who are younger with age-related health concerns" should undergo GA and that all domains (function, physical performance, comorbidity/polypharmacy, cognition, nutrition, psychological status, and social support) should be included. Consensus was met for how GA could guide nononcologic interventions and cancer treatment decisions. Algorithms for GA-guided care processes were developed. This Delphi investigation of geriatric oncology experts demonstrated that GA should be performed for older patients with cancer to guide care processes. Copyright © 2015 by the National Comprehensive Cancer Network.

Validation of consensus panel diagnosis in dementia.

PubMed

Gabel, Matthew J; Foster, Norman L; Heidebrink, Judith L; Higdon, Roger; Aizenstein, Howard J; Arnold, Steven E; Barbas, Nancy R; Boeve, Bradley F; Burke, James R; Clark, Christopher M; Dekosky, Steven T; Farlow, Martin R; Jagust, William J; Kawas, Claudia H; Koeppe, Robert A; Leverenz, James B; Lipton, Anne M; Peskind, Elaine R; Turner, R Scott; Womack, Kyle B; Zamrini, Edward Y

2010-12-01

The clinical diagnosis of dementing diseases largely depends on the subjective interpretation of patient symptoms. Consensus panels are frequently used in research to determine diagnoses when definitive pathologic findings are unavailable. Nevertheless, research on group decision making indicates that many factors can adversely affect panel performance. To determine conditions that improve consensus panel diagnosis. Comparison of neuropathologic diagnoses with individual and consensus panel diagnoses based on clinical scenarios only, fludeoxyglucose F 18 positron emission tomography images only, and scenarios plus images. Expert and trainee individual and consensus panel deliberations using a modified Delphi method in a pilot research study of the diagnostic utility of fludeoxyglucose F 18 positron emission tomography. Forty-five patients with pathologically confirmed Alzheimer disease or frontotemporal dementia. Statistical measures of diagnostic accuracy, agreement, and confidence for individual raters and panelists before and after consensus deliberations. The consensus protocol using trainees and experts surpassed the accuracy of individual expert diagnoses when clinical information elicited diverse judgments. In these situations, consensus was 3.5 times more likely to produce positive rather than negative changes in the accuracy and diagnostic certainty of individual panelists. A rule that forced group consensus was at least as accurate as majority and unanimity rules. Using a modified Delphi protocol to arrive at a consensus diagnosis is a reasonable substitute for pathologic information. This protocol improves diagnostic accuracy and certainty when panelist judgments differ and is easily adapted to other research and clinical settings while avoiding the potential pitfalls of group decision making.

Use of a modified Delphi panel to identify and weight criteria for prioritization of zoonotic diseases in Switzerland.

PubMed

Stebler, N; Schuepbach-Regula, G; Braam, P; Falzon, L C

2015-09-01

Zoonotic diseases have a significant impact on public health globally. To prevent or reduce future zoonotic outbreaks, there is a constant need to invest in research and surveillance programs while updating risk management strategies. However, given the limited resources available, disease prioritization based on the need for their control and surveillance is important. This study was performed to identify and weight disease criteria for the prioritization of zoonotic diseases in Switzerland using a semi-quantitative research method based on expert opinion. Twenty-eight criteria relevant for disease control and surveillance, classified under five domains, were selected following a thorough literature review, and these were evaluated and weighted by seven experts from the Swiss Federal Veterinary Office using a modified Delphi panel. The median scores assigned to each criterion were then used to rank 16 notifiable and/or emerging zoonoses in Switzerland. The experts weighted the majority of the criteria similarly, and the top three criteria were Severity of disease in humans, incidence and prevalence of the disease in humans and treatment in humans. Based on these weightings, the three highest ranked diseases were Avian Influenza, Bovine Spongiform Encephalitis, and Bovine Tuberculosis. Overall, this study provided a preliminary list of criteria relevant for disease prioritization in Switzerland. These were further evaluated in a companion study which involved a quantitative prioritization method and multiple stakeholders. Copyright © 2015 Elsevier B.V. All rights reserved.

Adaptation of a difficult-to-manage asthma programme for implementation in the Dutch context: a modified e-Delphi.

PubMed

Honkoop, Persijn J; Pinnock, Hilary; Kievits-Smeets, Regien M M; Sterk, Peter J; Dekhuijzen, P N Richard; In 't Veen, Johannes C C M

2017-02-09

Patients with difficult-to-manage asthma represent a heterogeneous subgroup of asthma patients who require extensive assessment and tailored management. The International Primary Care Respiratory Group approach emphasises the importance of differentiating patients with asthma that is difficult to manage from those with severe disease. Local adaptation of this approach, however, is required to ensure an appropriate strategy for implementation in the Dutch context. We used a modified three-round e-Delphi approach to assess the opinion of all relevant stakeholders (general practitioners, pulmonologists, practice nurses, pulmonary nurses and people with asthma). In the first round, the participants were asked to provide potentially relevant items for a difficult-to-manage asthma programme, which resulted in 67 items. In the second round, we asked participants to rate the relevance of specific items on a seven-point Likert scale, and 46 items were selected as relevant. In the third round, the selected items were categorised and items were ranked within the categories according to relevance. Finally, we created the alphabet acronym for the categories 'the A-I of difficult-to-manage asthma' to resonate with an established Dutch 'A-E acronym for determining asthma control'. This should facilitate implementation of this programme within the existing structure of educational material on asthma and chronic obstructive pulmonary disease (COPD) in primary care, with potential for improving management of difficult-to-manage asthma. Other countries could use a similar approach to create a locally adapted version of such a programme.

A pushing chronic care forward in Abu Dhabi by identifying priorities and addressing barriers: a modified Delphi technique

PubMed Central

Loney, Tom; Lapão, Luis V

2018-01-01

Objective This study aimed to elucidate the top five key priorities and barriers to chronic care in the health system of Abu Dhabi, United Arab Emirates (UAE). Design A modified Delphi study was performed to reach consensus on priority areas and barriers to the development of the Chronic Care Model in the health system of Abu Dhabi. Individual wireless audience response devices (keypads) linked to a computer were used to reduce 28 priorities and 20 barriers to the top five during three iterative rounds over three consecutive days. Setting Chronic care services for patients with diabetes, cardiovascular diseases and cancer, in both private and publicly funded healthcare services in the emirate of Abu Dhabi. Participants A purposive sample of 20 health systems’ experts were recruited. They were front-line healthcare workers from the public and private sector working in the delivery of care for patients with diabetes, cardiovascular diseases and cancer. Results The ‘overall organizational leadership in chronic illness care’ was ranked as the most important priority to address (26.3%) and ‘patient compliance’ was ranked as the most important barrier (36.8%) to the development of the Chronic Care Model. Conclusions This study has identified the current priorities and barriers to improving chronic care within Abu Dhabi’s healthcare system. Our paper addresses the UAE’s 2021 Agenda of achieving a world-class healthcare system, and findings may help inform strategic changes required to achieve this mission. PMID:29866724

Emerging Technologies Program Integration Report. Volume 2. Background, Delphi and Workshop Data. Appendices

DTIC Science & Technology

1987-05-04

FTIILE COP’ AD-A196 840 EMERGING TECHNOLOGIES PROGRAM INTEGRATION REPORT VOLUME II BACKGROUND, DELPHI AND WORKSHOP DATA, APPENDICES . -- PREPARED...Security Classification) Emerging Technologies Program Integration Report Volume II: Background, Delphi and Workshop Data; Appendices (U) 12 PERSONAL...volumes of this integration report assess and synthesize information gathered through a Delphi survey, defense needs prioritization workshops, and

DelPhi Web Server: A comprehensive online suite for electrostatic calculations of biological macromolecules and their complexes

PubMed Central

Sarkar, Subhra; Witham, Shawn; Zhang, Jie; Zhenirovskyy, Maxim; Rocchia, Walter; Alexov, Emil

2011-01-01

Here we report a web server, the DelPhi web server, which utilizes DelPhi program to calculate electrostatic energies and the corresponding electrostatic potential and ionic distributions, and dielectric map. The server provides extra services to fix structural defects, as missing atoms in the structural file and allows for generation of missing hydrogen atoms. The hydrogen placement and the corresponding DelPhi calculations can be done with user selected force field parameters being either Charmm22, Amber98 or OPLS. Upon completion of the calculations, the user is given option to download fixed and protonated structural file, together with the parameter and Delphi output files for further analysis. Utilizing Jmol viewer, the user can see the corresponding structural file, to manipulate it and to change the presentation. In addition, if the potential map is requested to be calculated, the potential can be mapped onto the molecule surface. The DelPhi web server is available from http://compbio.clemson.edu/delphi_webserver. PMID:24683424

The process of development of a prioritization tool for a clinical decision support build within a computerized provider order entry system: Experiences from St Luke's Health System.

PubMed

Wolf, Matthew; Miller, Suzanne; DeJong, Doug; House, John A; Dirks, Carl; Beasley, Brent

2016-09-01

To establish a process for the development of a prioritization tool for a clinical decision support build within a computerized provider order entry system and concurrently to prioritize alerts for Saint Luke's Health System. The process of prioritizing clinical decision support alerts included (a) consensus sessions to establish a prioritization process and identify clinical decision support alerts through a modified Delphi process and (b) a clinical decision support survey to validate the results. All members of our health system's physician quality organization, Saint Luke's Care as well as clinicians, administrators, and pharmacy staff throughout Saint Luke's Health System, were invited to participate in this confidential survey. The consensus sessions yielded a prioritization process through alert contextualization and associated Likert-type scales. Utilizing this process, the clinical decision support survey polled the opinions of 850 clinicians with a 64.7 percent response rate. Three of the top rated alerts were approved for the pre-implementation build at Saint Luke's Health System: Acute Myocardial Infarction Core Measure Sets, Deep Vein Thrombosis Prophylaxis within 4 h, and Criteria for Sepsis. This study establishes a process for developing a prioritization tool for a clinical decision support build within a computerized provider order entry system that may be applicable to similar institutions. © The Author(s) 2015.

Research priorities for multi-institutional collaborative research in surgical education.

PubMed

Stefanidis, Dimitrios; Cochran, Amalia; Sevdalis, Nick; Mellinger, John; Phitayakorn, Roy; Sullivan, Maura; Barney, Linda

2015-01-01

Research in surgical education has seen unprecedented growth but originates from single institutions and remains uncoordinated; this study aimed to generate a list of research priorities in surgical educational topics. The membership of the Association for Surgical Education was asked to submit up to 5 research questions concerned with multi-institutional collaborative surgical education research and to identify challenges faced by surgical education researchers. A modified Delphi methodology was used to create the research agenda based on these responses. Surgical educators responded to 3 survey rounds. Categories of submitted questions included teaching methods and curriculum development; assessment and competency; simulation; medical student preparation and selection; impact of work hour restrictions; and faculty development. Participants cited institutional culture and practice variability and lack of institutional review board coordination as common barriers to collaborative research, while identifying extensive planning, frequent communication, and availability of dedicated research coordinators as the most important facilitators. Using a Delphi methodology, a prioritized agenda for multi-institutional surgical education research was developed that may help advance surgeon education. Copyright © 2015 Elsevier Inc. All rights reserved.

Expert consensus on facilitators and barriers to return-to-work following surgery for non-traumatic upper extremity conditions: a Delphi study.

PubMed

Peters, S E; Johnston, V; Ross, M; Coppieters, M W

2017-02-01

This Delphi study aimed to reach consensus on important facilitators and barriers for return-to-work following surgery for non-traumatic upper extremity conditions. In Round 1, experts ( n = 42) listed 134 factors, which were appraised in Rounds 2 and 3. Consensus (⩾85% agreement) was achieved for 13 facilitators (high motivation to return-to-work; high self-efficacy for return-to-work and recovery; availability of modified/alternative duties; flexible return-to-work arrangements; positive coping skills; limited heavy work exertion; supportive return-to-work policies; supportive supervisor/management; no catastrophic thinking; no fear avoidance to return-to-work; no fear avoidance to pain/activity; return to meaningful work duties; high job satisfaction) and six barriers (mood disorder diagnosis; pain/symptoms at more than one musculoskeletal site; heavy upper extremity exertions at work; lack of flexible return-to-work arrangements; lack of support from supervisor/management; high level of pain catastrophizing). Future prognostic studies are required to validate these biopsychosocial factors to further improve return-to-work outcomes. V.

Developing an industry-oriented safety curriculum using the Delphi technique.

PubMed

Chen, Der-Fa; Wu, Tsung-Chih; Chen, Chi-Hsiang; Chang, Shu-Hsuan; Yao, Kai-Chao; Liao, Chin-Wen

2016-09-01

In this study, we examined the development of industry-oriented safety degree curricula at a college level. Based on a review of literature on the practices and study of the development of safety curricula, we classified occupational safety and health curricula into the following three domains: safety engineering, health engineering, and safety and health management. We invited 44 safety professionals to complete a four-round survey that was designed using a modified Delphi technique. We used Chi-square statistics to test the panel experts' consensus on the significance of the items in the three domains and employed descriptive statistics to rank the participants' rating of each item. The results showed that the top three items for each of the three domains were Risk Assessment, Dangerous Machinery and Equipment, and Fire and Explosion Prevention for safety engineering; Ergonomics, Industrial Toxicology, and Health Risk Assessment for health engineering; and Industrial Safety and Health Regulations, Accident Investigation and Analysis, and Emergency Response for safety and health management. Only graduates from safety programmes who possess practical industry-oriented abilities can satisfy industry demands and provide value to the existence of college safety programmes.

[Application of Delphi method in traditional Chinese medicine clinical research].

PubMed

Bi, Ying-fei; Mao, Jing-yuan

2012-03-01

In recent years, Delphi method has been widely applied in traditional Chinese medicine (TCM) clinical research. This article analyzed the present application situation of Delphi method in TCM clinical research, and discussed some problems presented in the choice of evaluation method, classification of observation indexes and selection of survey items. On the basis of present application of Delphi method, the author analyzed the method on questionnaire making, selection of experts, evaluation of observation indexes and selection of survey items. Furthermore, the author summarized the steps of application of Delphi method in TCM clinical research.

Exploring perceived barriers, drivers, impacts and the need for evaluation of public involvement in health and social care research: a modified Delphi study

PubMed Central

Snape, D; Kirkham, J; Britten, N; Froggatt, K; Gradinger, F; Lobban, F; Popay, Jennie; Wyatt, K; Jacoby, Ann

2014-01-01

Objective To explore areas of consensus and conflict in relation to perceived public involvement (PI) barriers and drivers, perceived impacts of PI and ways of evaluating PI approaches in health and social care research. Background Internationally and within the UK the recognition of potential benefits of PI in health and social care research is gathering momentum and PI is increasingly identified by organisations as a prerequisite for funding. However, there is relatively little examination of the impacts of PI and how those impacts might be measured. Design Mixed method, three-phase, modified Delphi technique, conducted as part of a larger MRC multiphase project. Sample Clinical and non-clinical academics, members of the public, research managers, commissioners and funders. Findings This study found high levels of consensus about the most important barriers and drivers to PI. There was acknowledgement that tokenism was common in relation to PI; and strong support for the view that demonstrating the impacts and value of PI was made more difficult by tokenistic practice. PI was seen as having intrinsic value; nonetheless, there was clear support for the importance of evaluating its impact. Research team cohesion and appropriate resources were considered essential to effective PI implementation. Panellists agreed that PI can be challenging, but can be facilitated by clear guidance, together with models of good practice and measurable standards. Conclusions This study is the first to present empirical evidence of the opinions voiced by key stakeholders on areas of consensus and conflict in relation to perceived PI barriers and drivers, perceived impacts of PI and the need to evaluate PI. As such it further contributes to debate around best practice in PI, the potential for tokenism and how best to evaluate the impacts of PI. These findings have been used in the development of the Public Involvement Impact Assessment Framework (PiiAF), an online resource which offers guidance to researchers and members of the public involved in the PI process. PMID:24939808

Standardised method for reporting exercise programmes: protocol for a modified Delphi study.

PubMed

Slade, Susan C; Dionne, Clermont E; Underwood, Martin; Buchbinder, Rachelle

2014-12-30

Exercise is integral to health across the lifespan and important for people with chronic health conditions. A systematic review of exercise trials for chronic conditions reported suboptimal descriptions of the evaluated interventions and concluded that this hinders interpretation and replication. The aim of this project is to develop a standardised method for reporting essential exercise programme details being evaluated in clinical trials. A modified Delphi technique will be used to gain consensus among international exercise experts. We will use three sequential rounds of anonymous online questionnaires to refine a standardised checklist. A draft checklist of potentially relevant items was developed based on the results of a systematic review of exercise systematic reviews. An international panel of experts was identified by exercise systematic review authorship, established international profile in exercise research and practice and by peer referral. In round 1, the international panel of experts will be asked to rate the importance of each draft item and provide additional suggestions for revisions or new items. Consensus will be considered reached if at least 70% of the panel strongly agree/disagree that an item should be included or excluded. Where agreement is not reached or there are suggestions for altered or new items, these will be taken to round 2 together with an aggregated summary of round 1 responses. Following the second round, a ranking of item importance will be made to rationalise the number of items. The final template will be distributed to panel members for approval. Ethics approval was received from The Cabrini Institute Ethics Committee, Melbourne, Australia (HREC 02-07-04-14). We plan to use a stepwise process to develop and refine a standardised and internationally agreed template for explicit reporting of exercise programmes. The template will be generalisable across all types of exercise interventions. The findings will be disseminated through peer-reviewed publications and conference presentations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Methodology: care of the critically ill and injured during pandemics and disasters: CHEST consensus statement.

PubMed

Ornelas, Joe; Dichter, Jeffrey R; Devereaux, Asha V; Kissoon, Niranjan; Livinski, Alicia; Christian, Michael D

2014-10-01

Natural disasters, industrial accidents, terrorism attacks, and pandemics all have the capacity to result in large numbers of critically ill or injured patients. This supplement provides suggestions for all those involved in a disaster or pandemic with multiple critically ill patients, including front-line clinicians, hospital administrators, professional societies, and public health or government officials. The field of disaster medicine does not have the required body of evidence needed to undergo a traditional guideline development process. In result, consensus statement-development methodology was used to capture the highest-caliber expert opinion in a structured, scientific approach. Task Force Executive Committee members identified core topic areas regarding the provision of care to critically ill or injured patients from pandemics or disasters and subsequently assembled an international panel for each identified area. International disaster medicine experts were brought together to identify key questions (in a population, intervention, comparator, outcome [PICO]-based format) within each of the core topic areas. Comprehensive literature searches were then conducted to identify studies upon which evidence-based recommendations could be made. No studies of sufficient quality were identified. Therefore, the panel developed expert opinion-based suggestions that are presented in this supplement using a modified Delphi process. A total of 315 suggestions were drafted across all topic groups. After two rounds of a Delphi consensus-development process, 267 suggestions were chosen by the panel to include in the document and published in a total of 12 manuscripts composing the core chapters of this supplement. Draft manuscripts were prepared by the topic editor and members of the working groups for each of the topics, producing a total of 11 papers. Once the preliminary drafts were received, the Executive Committee (Writing Committee) then met to review, edit, and promote alignment of all of the primary drafts of the manuscripts prepared by the topic editors and their groups. The topic editors then revised their manuscripts based on the Executive Committee's edits and comments. The Writing Committee subsequently reviewed the updated drafts and prepared the final manuscripts for submission to the Guidelines Oversight Committee (GOC). The manuscripts subsequently underwent review by the GOC, including external review as well as peer review for the journal publication. The Writing Committee received the feedback from the reviewers and modified the manuscripts as required. Based on a robust and transparent process, this project used rigorous methodology to produce clinically relevant, trustworthy consensus statements, with the aim to provide needed guidance on treatment and procedures for practitioners, hospital administrators, and public health and government officials when addressing the care of critically ill or injured patients in disasters or pandemics.

The Canadian Assessment of Physical Literacy: Development of a Model of Children's Capacity for a Healthy, Active Lifestyle Through a Delphi Process.

PubMed

Francis, Claire E; Longmuir, Patricia E; Boyer, Charles; Andersen, Lars Bo; Barnes, Joel D; Boiarskaia, Elena; Cairney, John; Faigenbaum, Avery D; Faulkner, Guy; Hands, Beth P; Hay, John A; Janssen, Ian; Katzmarzyk, Peter T; Kemper, Han C; Knudson, Duane; Lloyd, Meghann; McKenzie, Thomas L; Olds, Tim S; Sacheck, Jennifer M; Shephard, Roy J; Zhu, Weimo; Tremblay, Mark S

2016-02-01

The Canadian Assessment of Physical Literacy (CAPL) was conceptualized as a tool to monitor children's physical literacy. The original model (fitness, activity behavior, knowledge, motor skill) required revision and relative weights for calculating/interpreting scores were required. Nineteen childhood physical activity/fitness experts completed a 3-round Delphi process. Round 1 was open-ended questions. Subsequent rounds rated statements using a 5-point Likert scale. Recommendations were sought regarding protocol inclusion, relative importance within composite scores and score interpretation. Delphi participant consensus was achieved for 64% (47/73) of statement topics, including a revised conceptual model, specific assessment protocols, the importance of longitudinal tracking, and the relative importance of individual protocols and composite scores. Divergent opinions remained regarding the inclusion of sleep time, assessment/ scoring of the obstacle course assessment of motor skill, and the need for an overall physical literacy classification. The revised CAPL model (overlapping domains of physical competence, motivation, and knowledge, encompassed by daily behavior) is appropriate for monitoring the physical literacy of children aged 8 to 12 years. Objectively measured domains (daily behavior, physical competence) have higher relative importance. The interpretation of CAPL results should be reevaluated as more data become available.

Teacher Resistance to the Response to Intervention Process: A Delphi Study

ERIC Educational Resources Information Center

Raines, Kerrie Lynn

2010-01-01

There has been a growing concern amongst educational stakeholders concerning the over identification of students with specific learning disabilities. The reauthorization of the Individuals with Disabilities Education improvement ACT in 2004 launched a response to intervention (RTI) process mandated early interventions for struggling students…

A behaviourally anchored rating scale for evaluating the use of the WHO surgical safety checklist: development and initial evaluation of the WHOBARS.

PubMed

Devcich, Daniel A; Weller, Jennifer; Mitchell, Simon J; McLaughlin, Scott; Barker, Lauren; Rudolph, Jenny W; Raemer, Daniel B; Zammert, Martin; Singer, Sara J; Torrie, Jane; Frampton, Chris Ma; Merry, Alan F

2016-10-01

Realising the full potential of the WHO Surgical Safety Checklist (SSC) to reduce perioperative harm requires the constructive engagement of all operating room (OR) team members during its administration. To facilitate research on SSC implementation, a valid and reliable instrument is needed for measuring OR team behaviours during its administration. We developed a behaviourally anchored rating scale (BARS) for this purpose. We used a modified Delphi process, involving 16 subject matter experts, to compile a BARS with behavioural domains applicable to all three phases of the SSC. We evaluated the instrument in 80 adult OR cases and 30 simulated cases using two medical student raters and seven expert raters, respectively. Intraclass correlation coefficients were calculated to assess inter-rater reliability. Internal consistency and instrument discrimination were explored. Sample size estimates for potential study designs using the instrument were calculated. The Delphi process resulted in a BARS instrument (the WHOBARS) with five behavioural domains. Intraclass correlation coefficients calculated from the OR cases exceeded 0.80 for 80% of the instrument's domains across the SSC phases. The WHOBARS showed high internal consistency across the three phases of the SSC and ability to discriminate among surgical cases in both clinical and simulated settings. Fewer than 20 cases per group would be required to show a difference of 1 point between groups in studies of the SSC, where α=0.05 and β=0.8. We have developed a generic instrument for comprehensively rating the administration of the SSC and informing initiatives to realise its full potential. We have provided data supporting its capacity for discrimination, internal consistency and inter-rater reliability. Further psychometric evaluation is warranted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

A protocol for the development of a critical thinking assessment tool for nurses using a Delphi technique.

PubMed

Jacob, Elisabeth; Duffield, Christine; Jacob, Darren

2017-08-01

The aim of this study was to develop an assessment tool to measure the critical thinking ability of nurses. As an increasing number of complex patients are admitted to hospitals, the importance of nurses recognizing changes in health status and picking up on deterioration is more important. To detect early signs of complication requires critical thinking skills. Registered Nurses are expected to commence their clinical careers with the necessary critical thinking skills to ensure safe nursing practice. Currently, there is no published tool to assess critical thinking skills which is context specific to Australian nurses. A modified Delphi study will be used for the project. This study will develop a series of unfolding case scenarios using national health data with multiple-choice questions to assess critical thinking. Face validity of the scenarios will be determined by an expert reference group of clinical and academic nurses. A Delphi study will determine the answers to scenario questions. Panel members will be expert clinicians and educators from two states in Australia. Rasch analysis of the questionnaire will assess validity and reliability of the tool. Funding for the study and Research Ethics Committee approval were obtained in March and November 2016, respectively. Patient outcomes and safety are directly linked to nurses' critical thinking skills. This study will develop an assessment tool to provide a standardized method of measuring nurses' critical thinking skills across Australia. This will provide healthcare providers with greater confidence in the critical thinking level of graduate Registered Nurses. © 2017 John Wiley & Sons Ltd.

Development of a tool to support holistic generic assessment of clinical procedure skills.

PubMed

McKinley, Robert K; Strand, Janice; Gray, Tracey; Schuwirth, Lambert; Alun-Jones, Tom; Miller, Helen

2008-06-01

The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff. Results In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station. This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).

Quality pharmacy services and key performance indicators in Polish NICUs: a Delphi approach.

PubMed

Krzyżaniak, Natalia; Pawłowska, Iga; Bajorek, Beata

2018-03-31

Background Currently, there is no literature describing what a quality level of practice entails in Polish neonatal intensive care units (NICUs), nor are there any means of currently measuring the quality of pharmaceutical care provided to NICU patients. Objective To identify a set of essential pharmacist roles and pharmacy-relevant key performance indicators (KPI's) suitable for Polish neonatal intensive units (NICUs). Setting Polish hospital pharmacies and NICUs. Method Using a modified Delphi technique, potential KPI's structured along Donabedian's domains as well as pharmacy services were presented to an expert panel of stakeholders. Two online, consecutive Delphi rounds, were completed by panellists between August and September 2017. Main outcome measure To identify the minimum level of pharmacy services that should be consistently provided to NICU patients. Results A total of 16 panellists contributed to the expert panel. Overall, consensus of 75% was reached for 23 indicators and for 28 roles. When considering pharmacy services for the NICU, the experts were found to highly value traditional pharmacy roles, such as dispensing and extemporaneous compounding, however, they were still eager for roles in the other domains, such as educational and clinical services, to be listed as essential for NICU practice. Panellists were found to positively value the list of indicators presented, and excluded only 9 out of the total list. Conclusion There is a need for future research to establish a minimum standard of practice for Polish pharmacists to encourage the progression and standardisation of hospital pharmacy services to meet the level of practice seen in NICUs worldwide.

School Improvement Goal Setting: A Collaborative Model.

ERIC Educational Resources Information Center

Snyder, Karolyn J.; And Others

1983-01-01

Describes the successful use of the Delphi Dialog Technique (a goal-setting process) at East High School, Anchorage, Alaska, where it was used to obtain consensus among staff members about school-growth targets. (JW)

Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology.

PubMed

Melchiors, Jacob; Henriksen, Mikael Johannes Vuokko; Dikkers, Frederik G; Gavilán, Javier; Noordzij, J Pieter; Fried, Marvin P; Novakovic, Daniel; Fagan, Johannes; Charabi, Birgitte W; Konge, Lars; von Buchwald, Christian

2018-05-01

Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis. We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool. FIFTY PANELISTS COMPLETED THE DELPHI PROCESS. THE MEDIAN AGE OF THE PANELISTS WAS 44 YEARS (RANGE 33-64 YEARS). MEDIAN EXPERIENCE IN OTORHINOLARYNGOLOGY WAS 15 YEARS (RANGE 6-35 YEARS). TWENTY-FIVE WERE SPECIALIZED IN LARYNGOLOGY, 16 WERE HEAD AND NECK SURGEONS, AND NINE WERE GENERAL OTORHINOLARYNGOLOGISTS. AN ASSESSMENT TOOL WAS CREATED CONSISTING OF TWELVE DISTINCT ITEMS.: Conclusion The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.

After 10 Years: A Vision Forward for Progress in Community Health Partnerships.

PubMed

Grieb, Suzanne Dolwick; Pichon, Latrice; Kwon, Simona; Yeary, Karen Kim; Tandon, Darius

In 2007 the journal Progress in Community Health Partnerships was launched to advance the field of community-engaged research and the journal's editors engaged in a Delphi process to identify priorities for the journal and field. Ten years later, the increased adoption of community-engaged research continues to improve public health. The purpose of this manuscrip t is to i dentify community-engaged research priorities for the next 10 years. The study engaged leaders in community-engaged research using a two-round Delphi process, whereby leaders in the field were asked to identify and then rank order topics in community-engaged research that needed to be prioritized for the next decade. In stage 1, 41 respondents generated 441 priorities across 8 categories (e.g., theory, epidemiology, intervention science) that were collapsed into 90 priority topics, ranging from 8 to 15 per category. In stage 2, 73 respondents ranked five prioritized items for each category. The prioritized items are provided, with the following themes present across all categories: 1) improvements to equity among partners, 2) partnership sustainability, and 3) increased efforts to translate community-engaged research into policy change. We compare the findings from this Delphi process with the priorities identified in 2007 to reflect on how the field has progressed. It is our hope that community and academic stakeholders will be able to use these priorities as a guide to their community-engaged research in the coming years.

Multi-criteria development and incorporation into decision tools for health technology adoption.

PubMed

Poulin, Paule; Austen, Lea; Scott, Catherine M; Waddell, Cameron D; Dixon, Elijah; Poulin, Michelle; Lafrenière, René

2013-01-01

When introducing new health technologies, decision makers must integrate research evidence with local operational management information to guide decisions about whether and under what conditions the technology will be used. Multi-criteria decision analysis can support the adoption or prioritization of health interventions by using criteria to explicitly articulate the health organization's needs, limitations, and values in addition to evaluating evidence for safety and effectiveness. This paper seeks to describe the development of a framework to create agreed-upon criteria and decision tools to enhance a pre-existing local health technology assessment (HTA) decision support program. The authors compiled a list of published criteria from the literature, consulted with experts to refine the criteria list, and used a modified Delphi process with a group of key stakeholders to review, modify, and validate each criterion. In a workshop setting, the criteria were used to create decision tools. A set of user-validated criteria for new health technology evaluation and adoption was developed and integrated into the local HTA decision support program. Technology evaluation and decision guideline tools were created using these criteria to ensure that the decision process is systematic, consistent, and transparent. This framework can be used by others to develop decision-making criteria and tools to enhance similar technology adoption programs. The development of clear, user-validated criteria for evaluating new technologies adds a critical element to improve decision-making on technology adoption, and the decision tools ensure consistency, transparency, and real-world relevance.

A Strategic Planning Process Model for Distance Education

ERIC Educational Resources Information Center

Pisel, Kenneth P.

2008-01-01

As more institutions seek to implement or expand distance learning programs, it becomes critical to integrate distance learning programs into broader strategic visions and plans. Using the informed opinion from a panel of peer-nominated experts via iterative Delphi questionnaires, a 10-phased strategic planning process model for distance education…

A Fifteen-Year Forecast of Information-Processing Technology. Final Report.

ERIC Educational Resources Information Center

Bernstein, George B.

This study developed a variation of the DELPHI approach, a polling technique for systematically soliciting opinions from experts, to produce a technological forecast of developments in the information-processing industry. SEER (System for Event Evaluation and Review) combines the more desirable elements of existing techniques: (1) intuitive…

DelPhi web server v2: incorporating atomic-style geometrical figures into the computational protocol.

PubMed

Smith, Nicholas; Witham, Shawn; Sarkar, Subhra; Zhang, Jie; Li, Lin; Li, Chuan; Alexov, Emil

2012-06-15

A new edition of the DelPhi web server, DelPhi web server v2, is released to include atomic presentation of geometrical figures. These geometrical objects can be used to model nano-size objects together with real biological macromolecules. The position and size of the object can be manipulated by the user in real time until desired results are achieved. The server fixes structural defects, adds hydrogen atoms and calculates electrostatic energies and the corresponding electrostatic potential and ionic distributions. The web server follows a client-server architecture built on PHP and HTML and utilizes DelPhi software. The computation is carried out on supercomputer cluster and results are given back to the user via http protocol, including the ability to visualize the structure and corresponding electrostatic potential via Jmol implementation. The DelPhi web server is available from http://compbio.clemson.edu/delphi_webserver.

Improving Quality of Shoe Soles Product using Six Sigma

NASA Astrophysics Data System (ADS)

Jesslyn Wijaya, Athalia; Trusaji, Wildan; Akbar, Muhammad; Ma’ruf, Anas; Irianto, Dradjad

2018-03-01

A manufacture in Bandung produce kind of rubber-based product i.e. trim, rice rollers, shoe soles, etc. After penetrating the shoe soles market, the manufacture has met customer with tight quality control. Based on the past data, defect level of this product was 18.08% that caused the manufacture’s loss of time and money. Quality improvement effort was done using six sigma method that included phases of define, measure, analyse, improve, and control (DMAIC). In the design phase, the object’s problem and definition were defined. Delphi method was also used in this phase to identify critical factors. In the measure phase, the existing process stability and sigma quality level were measured. Fishbone diagram and failure mode and effect analysis (FMEA) were used in the next phase to analyse the root cause and determine the priority issues. Improve phase was done by designing alternative improvement strategy using 5W1H method. Some improvement efforts were identified, i.e. (i) modifying design of the hanging rack, (ii) create pantone colour book and check sheet, (iii) provide pedestrian line at compound department, (iv) buying stop watch, and (v) modifying shoe soles dies. Some control strategies for continuous improvement were proposed such as SOP or reward and punishment system.

Remediation System Evaluation, Delphi Corporation Site in Vandalia, Ohio

EPA Pesticide Factsheets

This RSE pertains to aspects of the corrective action underway at two neighboring plants, the Delphi Energy and Chassis Systems Plant and Delphi Safety and Interior Systems Plant, collectively referred to as the “facility” in this report.

Global priorities for research and the relative importance of different research outcomes: an international Delphi survey of malaria research experts.

PubMed

Mulligan, Jo-Ann; Conteh, Lesong

2016-12-06

As global research investment increases, attention inevitably turns to assessing and measuring the outcomes and impact from research programmes. Research can have many different outcomes such as producing advances in scientific knowledge, building research capacity and, ultimately, health and broader societal benefits. The aim of this study was to test the use of a Delphi methodology as a way of gathering views from malaria research experts on research priorities and eliciting relative valuations of the different types of health research impact. An international Delphi survey of 60 malaria research experts was used to understand views on research outcomes and priorities within malaria and across global health more widely. The study demonstrated the application of the Delphi technique to eliciting views on malaria specific research priorities, wider global health research priorities and the values assigned to different types of research impact. In terms of the most important past research successes, the development of new anti-malarial drugs and insecticide-treated bed nets were rated as the most important. When asked about research priorities for future funding, respondents ranked tackling emerging drug and insecticide resistance the highest. With respect to research impact, the panel valued research that focuses on health and health sector benefits and informing policy and product development. Contributions to scientific knowledge, although highly valued, came lower down the ranking, suggesting that efforts to move research discoveries to health products and services are valued more highly than pure advances in scientific knowledge. Although the Delphi technique has been used to elicit views on research questions in global health this was the first time it has been used to assess how a group of research experts value or rank different types of research impact. The results suggest it is feasible to inject the views of a key stakeholder group into the research prioritization process and the Delphi approach is a useful tool for eliciting views on the value or importance of research impact. Future work will explore other methods for assessing and valuing research impact and test the feasibility of developing a composite tool for measuring research outcomes weighted by the values of different stakeholders.

The use of qualitative methods to inform Delphi surveys in core outcome set development.

PubMed

Keeley, T; Williamson, P; Callery, P; Jones, L L; Mathers, J; Jones, J; Young, B; Calvert, M

2016-05-04

Core outcome sets (COS) help to minimise bias in trials and facilitate evidence synthesis. Delphi surveys are increasingly being used as part of a wider process to reach consensus about what outcomes should be included in a COS. Qualitative research can be used to inform the development of Delphi surveys. This is an advance in the field of COS development and one which is potentially valuable; however, little guidance exists for COS developers on how best to use qualitative methods and what the challenges are. This paper aims to provide early guidance on the potential role and contribution of qualitative research in this area. We hope the ideas we present will be challenged, critiqued and built upon by others exploring the role of qualitative research in COS development. This paper draws upon the experiences of using qualitative methods in the pre-Delphi stage of the development of three different COS. Using these studies as examples, we identify some of the ways that qualitative research might contribute to COS development, the challenges in using such methods and areas where future research is required. Qualitative research can help to identify what outcomes are important to stakeholders; facilitate understanding of why some outcomes may be more important than others, determine the scope of outcomes; identify appropriate language for use in the Delphi survey and inform comparisons between stakeholder data and other sources, such as systematic reviews. Developers need to consider a number of methodological points when using qualitative research: specifically, which stakeholders to involve, how to sample participants, which data collection methods are most appropriate, how to consider outcomes with stakeholders and how to analyse these data. A number of areas for future research are identified. Qualitative research has the potential to increase the research community's confidence in COS, although this will be dependent upon using rigorous and appropriate methodology. We have begun to identify some issues for COS developers to consider in using qualitative methods to inform the development of Delphi surveys in this article.

Beyond knowledge and skills: the use of a Delphi study to develop a technology-mediated teaching strategy.

PubMed

Rowe, Michael; Frantz, Jose; Bozalek, Vivienne

2013-04-10

While there is evidence to suggest that teaching practices in clinical education should include activities that more accurately reflect the real world, many educators base their teaching on transmission models that encourage the rote learning of knowledge and technical skills. Technology-mediated instruction may facilitate the development of professional attributes that go beyond "having" knowledge and skills, but there is limited evidence for how to integrate technology into these innovative teaching approaches. This study used a modified Delphi method to help identify the professional attributes of capable practitioners, the approaches to teaching that may facilitate the development of these attributes, and finally, how technology could be integrated with those teaching strategies in order to develop capable practitioners. Open-ended questions were used to gather data from three different expert panels, and results were thematically analysed. Clinical educators should not view knowledge, skills and attitudes as a set of products of learning, but rather as a set of attributes that are developed during a learning process. Participants highlighted the importance of continuing personal and professional development that emphasised the role of values and emotional response to the clinical context. To develop these attributes, clinical educators should use teaching activities that are learner-centred, interactive, integrated, reflective and that promote engagement. When technology-mediated teaching activities are considered, they should promote the discussion of clinical encounters, facilitate the sharing of resources and experiences, encourage reflection on the learning process and be used to access content outside the classroom. In addition, educational outcomes must drive the integration of technology into teaching practice, rather than the features of the technology. There is a need for a cultural change in clinical education, in which those involved with the professional training of healthcare professionals perceive teaching as more than the transmission of knowledge and technical skills. Process-oriented teaching practices that integrate technology as part of a carefully designed curriculum may have the potential to facilitate the development of capable healthcare graduates who are able to navigate the complexity of health systems and patient management in ways that go beyond the application of knowledge and skills.

Beyond knowledge and skills: the use of a Delphi study to develop a technology-mediated teaching strategy

PubMed Central

2013-01-01

Background While there is evidence to suggest that teaching practices in clinical education should include activities that more accurately reflect the real world, many educators base their teaching on transmission models that encourage the rote learning of knowledge and technical skills. Technology-mediated instruction may facilitate the development of professional attributes that go beyond “having” knowledge and skills, but there is limited evidence for how to integrate technology into these innovative teaching approaches. Methods This study used a modified Delphi method to help identify the professional attributes of capable practitioners, the approaches to teaching that may facilitate the development of these attributes, and finally, how technology could be integrated with those teaching strategies in order to develop capable practitioners. Open-ended questions were used to gather data from three different expert panels, and results were thematically analysed. Results Clinical educators should not view knowledge, skills and attitudes as a set of products of learning, but rather as a set of attributes that are developed during a learning process. Participants highlighted the importance of continuing personal and professional development that emphasised the role of values and emotional response to the clinical context. To develop these attributes, clinical educators should use teaching activities that are learner-centred, interactive, integrated, reflective and that promote engagement. When technology-mediated teaching activities are considered, they should promote the discussion of clinical encounters, facilitate the sharing of resources and experiences, encourage reflection on the learning process and be used to access content outside the classroom. In addition, educational outcomes must drive the integration of technology into teaching practice, rather than the features of the technology. Conclusions There is a need for a cultural change in clinical education, in which those involved with the professional training of healthcare professionals perceive teaching as more than the transmission of knowledge and technical skills. Process-oriented teaching practices that integrate technology as part of a carefully designed curriculum may have the potential to facilitate the development of capable healthcare graduates who are able to navigate the complexity of health systems and patient management in ways that go beyond the application of knowledge and skills. PMID:23574731

Three nested randomized controlled trials of peer-only or multiple stakeholder group feedback within Delphi surveys during core outcome and information set development.

PubMed

Brookes, Sara T; Macefield, Rhiannon C; Williamson, Paula R; McNair, Angus G; Potter, Shelley; Blencowe, Natalie S; Strong, Sean; Blazeby, Jane M

2016-08-17

Methods for developing a core outcome or information set require involvement of key stakeholders to prioritise many items and achieve agreement as to the core set. The Delphi technique requires participants to rate the importance of items in sequential questionnaires (or rounds) with feedback provided in each subsequent round such that participants are able to consider the views of others. This study examines the impact of receiving feedback from different stakeholder groups, on the subsequent rating of items and the level of agreement between stakeholders. Randomized controlled trials were nested within the development of three core sets each including a Delphi process with two rounds of questionnaires, completed by patients and health professionals. Participants rated items from 1 (not essential) to 9 (absolutely essential). For round 2, participants were randomized to receive feedback from their peer stakeholder group only (peer) or both stakeholder groups separately (multiple). Decisions as to which items to retain following each round were determined by pre-specified criteria. Whilst type of feedback did not impact on the percentage of items for which a participant subsequently changed their rating, or the magnitude of change, it did impact on items retained at the end of round 2. Each core set contained discordant items retained by one feedback group but not the other (3-22 % discordant items). Consensus between patients and professionals in items to retain was greater amongst those receiving multiple group feedback in each core set (65-82 % agreement for peer-only feedback versus 74-94 % for multiple feedback). In addition, differences in round 2 scores were smaller between stakeholder groups receiving multiple feedback than between those receiving peer group feedback only. Variability in item scores across stakeholders was reduced following any feedback but this reduction was consistently greater amongst the multiple feedback group. In the development of a core outcome or information set, providing feedback within Delphi questionnaires from all stakeholder groups separately may influence the final core set and improve consensus between the groups. Further work is needed to better understand how participants rate and re-rate items within a Delphi process. The three randomized controlled trials reported here were each nested within the development of a core information or outcome set to investigate processes in core outcome and information set development. Outcomes were not health-related and therefore trial registration was not applicable.

Competency-Based Framework and Continuing Education for Preparing a Skilled School Health Workforce for Asthma Care: The Colorado Experience.

PubMed

Cicutto, Lisa; Gleason, Melanie; Haas-Howard, Christy; Jenkins-Nygren, Lynn; Labonde, Susan; Patrick, Kathy

2017-08-01

School health teams commonly address the needs of students with asthma, which requires specific knowledge and skills. To develop a skilled school health team, a competency-based framework for managing asthma in schools was developed. A modified Delphi with 31 panelists was completed. Consensus (≥80% agreement) was reached for all 148 items regarding the appropriateness as a minimum competency for asthma care in schools. The resultant Colorado Competency Framework for Asthma Care in Schools guided the development and pilot testing of a continuing education curriculum for school nurses. Pre- and postassessments demonstrated significant improvements in knowledge and self-confidence related to asthma care in schools and inhaler technique skills. This work is the first to use a consensus process to identify a framework of minimum competencies for providing asthma care in schools. This framework informed a continuing education curriculum that resulted in improved knowledge, confidence, and skills for school nurses.

A framework for solving ill-structured community problems

NASA Astrophysics Data System (ADS)

Keller, William Cotesworth

A multifaceted protocol for solving ill-structured community problems has been developed. It embodies the lessons learned from the past by refining and extending features of previous models from the systems thinkers, and the fields of behavioral decision making and creative problem solving. The protocol also embraces additional features needed to address the unique aspects of community decision situations. The essential elements of the protocol are participants from the community, a problem-solving process, a systems picture, a facilitator, a modified Delphi method of communications, and technical expertise. This interdisciplinary framework has been tested by a quasi experiment with a real world community problem (the high cost of electrical power on Long Island, NY). Results indicate the protocol can enable members of the community to understand a complicated, ill-structured problem and guide them to action to solve the issue. However, the framework takes time (over one year in the test case) and will be inappropriate for crises where quick action is needed.

The Berlin 2016 process: a summary of methodology for the 5th International Consensus Conference on Concussion in Sport.

PubMed

Meeuwisse, Willem H; Schneider, Kathryn J; Dvořák, Jiří; Omu, Onutobor Tobi; Finch, Caroline F; Hayden, K Alix; McCrory, Paul

2017-06-01

The purpose of this paper is to summarise the methodology for the 5th International Consensus Conference on Concussion in Sport. The 18 months of preparation included engagement of a scientific committee, an expert panel of 33 individuals in the field of concussion and a modified Delphi technique to determine the primary questions to be answered. The methodology also involved the writing of 12 systematic reviews to inform the consensus conference and submission and review of scientific abstracts. The meeting itself followed a 2-day open format, a 1-day closed expert panel meeting and two additional half day meetings to develop the Concussion Recognition Tool 5 (Pocket CRT5), Sport Concussion Assessment Tool 5 (SCAT5) and Child SCAT5. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development of the SAFE Checklist Tool for Assessing Site-Level Threats to Child Protection: Use of Delphi Methods and Application to Two Sites in India

PubMed Central

Betancourt, Theresa S.; Zuilkowski, Stephanie S.; Ravichandran, Arathi; Einhorn, Honora; Arora, Nikita; Bhattacharya Chakravarty, Aruna; Brennan, Robert T.

2015-01-01

Background The child protection community is increasingly focused on developing tools to assess threats to child protection and the basic security needs and rights of children and families living in adverse circumstances. Although tremendous advances have been made to improve measurement of individual child health status or household functioning for use in low-resource settings, little attention has been paid to a more diverse array of settings in which many children in adversity spend time and how context contributes to threats to child protection. The SAFE model posits that insecurity in any of the following fundamental domains threatens security in the others: Safety/freedom from harm; Access to basic physiological needs and healthcare; Family and connection to others; Education and economic security. Site-level tools are needed in order to monitor the conditions that can dramatically undermine or support healthy child growth, development and emotional and behavioral health. From refugee camps and orphanages to schools and housing complexes, site-level threats exist that are not well captured by commonly used measures of child health and well-being or assessments of single households (e.g., SDQ, HOME). Methods The present study presents a methodology and the development of a scale for assessing site-level child protection threats in various settings of adversity. A modified Delphi panel process was enhanced with two stages of expert review in core content areas as well as review by experts in instrument development, and field pilot testing. Results Field testing in two diverse sites in India—a construction site and a railway station—revealed that the resulting SAFE instrument was sensitive to the differences between the sites from the standpoint of core child protection issues. PMID:26540159

A multi-disciplinary consensus statement concerning surgical approaches to low-grade, high-grade astrocytomas and diffuse intrinsic pontine gliomas in childhood (CPN Paris 2011) using the Delphi method.

PubMed

Walker, David A; Liu, JoFen; Kieran, Mark; Jabado, Nada; Picton, Susan; Packer, Roger; St Rose, Christian

2013-04-01

Astrocytic tumors account for 42% of childhood brain tumors, arising in all anatomical regions and associated with neurofibromatosis type 1 (NF1) in 15%. Anatomical site determines the degree and risk of resectability; the more complete resection, the better the survival rates. New biological markers and modern radiotherapy techniques are altering the risk assessments of clinical decisions for tumor resection and biopsy. The increasingly distinct pediatric neuro-oncology multidisciplinary team (PNMDT) is developing a distinct evidence base. A multidisciplinary consensus conference on pediatric neurosurgery was held in February 2011, where 92 invited participants reviewed evidence for clinical management of hypothalamic chiasmatic glioma (HCLGG), diffuse intrinsic pontine glioma (DIPG), and high-grade glioma (HGG). Twenty-seven statements were drafted and subjected to online Delphi consensus voting by participants, seeking >70% agreement from >60% of respondents; where <70% consensus occurred, the statement was modified and resubmitted for voting. Twenty-seven statements meeting consensus criteria are reported. For HCLGG, statements describing overall therapeutic purpose and indications for biopsy, observation, or treatment aimed at limiting the risk of visual damage and the need for on-going clinical trials were made. Primary surgical resection was not recommended. For DIPG, biopsy was recommended to ascertain biological characteristics to enhance understanding and targeting of treatments, especially in clinical trials. For HGG, biopsy is essential, the World Health Organization classification was recommended; selection of surgical strategy to achieve gross total resection in a single or multistep process should be discussed with the PNMDT and integrated with trials based drug strategies for adjuvant therapies.

Development of a Quality and Safety Competency Curriculum for Radiation Oncology Residency: An International Delphi Study.

PubMed

Adleman, Jenna; Gillan, Caitlin; Caissie, Amanda; Davis, Carol-Anne; Liszewski, Brian; McNiven, Andrea; Giuliani, Meredith

2017-06-01

To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through web conference discussion and reranked in Round 2. An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of a Quality and Safety Competency Curriculum for Radiation Oncology Residency: An International Delphi Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Adleman, Jenna; Gillan, Caitlin; Radiation Medicine Program, Princess Margaret Cancer Centre, Toronto, Ontario

Purpose: To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. Methods and Materials: A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through webmore » conference discussion and reranked in Round 2. Results: An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. Conclusions: This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs.« less

The challenge of the definition of early symptomatic knee osteoarthritis: a proposal of criteria and red flags from an international initiative promoted by the Italian Society for Rheumatology.

PubMed

Migliore, Alberto; Scirè, Carlo Alberto; Carmona, Loreto; Herrero-Beaumont, Gabriel; Bizzi, Emanuele; Branco, Jaime; Carrara, Greta; Chevalier, Xavier; Collaku, Ledio; Aslanidis, Spiros; Denisov, Lev; Di Matteo, Luigi; Bianchi, Gerolamo; Diracoglu, Demirhan; Frediani, Bruno; Maheu, Emmanuel; Martusevich, Natalia; Bagnato, Gian Filippo; Scarpellini, Magda; Minisola, Giovanni; Akkoc, Nurullah; Ramonda, Roberta; Barskova, Tatiana; Babic-Naglic, Durda; Muelas, Jose Vicente Moreno; Ionescu, Ruxandra; Rashkov, Rasho; Damjanov, Nemanja; Cerinic, Marco Matucci

2017-08-01

The aim of this study was to establish consensus for potential early symptomatic knee osteoarthritis (ESKOA) clinical definition and referral criteria from primary care to rheumatologists, based on available data from literature and a qualitative approach, in order to perform studies on patients fulfilling such criteria and to validate the obtained ESKOA definition. A complex methodological approach was followed including: (1) three focus groups (FG), including expert clinicians, researchers and patients; (2) a systematic literature review (SLR); (3) two discussion groups followed by a Delphi survey. FG and SLR were performed in parallel to inform discussion groups in order to identify relevant constructs to be included in the modified Delphi survey. ESKOA is defined in the presence of: (a) two mandatory symptoms (knee pain in the absence of any recent trauma or injury and very short joint stiffness, lasting for less than 10 min, when starting movement) even in the absence of risk factors, or (b) knee pain, and 1 or 2 risk factors or (c) three or more risk factors in the presence of at least one mandatory symptom, with symptoms lasting less than 6 months. These criteria are applicable in the absence of active inflammatory arthritis, generalized pain, Kellgren-Lawrence grade >0, any recent knee trauma or injury, and age lower than 40 years. Knee pain in the absence of any recent trauma lasting for less than 6 months was considered as the referral criterion to the rheumatologist for the suspicion of ESKOA. This consensus process has identified provisional clinical definition of ESKOA and defined potential referral criterion to rheumatologist, in order to test ESKOA obtained definition in prospective validation studies.

Development of the SAFE Checklist Tool for Assessing Site-Level Threats to Child Protection: Use of Delphi Methods and Application to Two Sites in India.

PubMed

Betancourt, Theresa S; Zuilkowski, Stephanie S; Ravichandran, Arathi; Einhorn, Honora; Arora, Nikita; Bhattacharya Chakravarty, Aruna; Brennan, Robert T

2015-01-01

The child protection community is increasingly focused on developing tools to assess threats to child protection and the basic security needs and rights of children and families living in adverse circumstances. Although tremendous advances have been made to improve measurement of individual child health status or household functioning for use in low-resource settings, little attention has been paid to a more diverse array of settings in which many children in adversity spend time and how context contributes to threats to child protection. The SAFE model posits that insecurity in any of the following fundamental domains threatens security in the others: Safety/freedom from harm; Access to basic physiological needs and healthcare; Family and connection to others; Education and economic security. Site-level tools are needed in order to monitor the conditions that can dramatically undermine or support healthy child growth, development and emotional and behavioral health. From refugee camps and orphanages to schools and housing complexes, site-level threats exist that are not well captured by commonly used measures of child health and well-being or assessments of single households (e.g., SDQ, HOME). The present study presents a methodology and the development of a scale for assessing site-level child protection threats in various settings of adversity. A modified Delphi panel process was enhanced with two stages of expert review in core content areas as well as review by experts in instrument development, and field pilot testing. Field testing in two diverse sites in India-a construction site and a railway station-revealed that the resulting SAFE instrument was sensitive to the differences between the sites from the standpoint of core child protection issues.

Defining competency-based evaluation objectives in family medicine

PubMed Central

Allen, Tim; Brailovsky, Carlos; Rainsberry, Paul; Lawrence, Katherine; Crichton, Tom; Carpentier, Marie-Pierre; Visser, Shaun

2011-01-01

Abstract Objective To develop a definition of competence in family medicine sufficient to guide a review of Certification examinations by the Board of Examiners of the College of Family Physicians of Canada. Design Delphi analysis of responses to a 4-question postal survey. Setting Canadian family practice. Participants A total of 302 family physicians who have served as examiners for the College of Family Physicians of Canada’s Certification examination. Methods A survey comprising 4 short-answer questions was mailed to the 302 participating family physicians asking them to list elements that define competence in family medicine among newly certified family physicians beginning independent practice. Two expert groups used a modified Delphi consensus process to analyze responses and generate 2 basic components of this definition of competence: first, the problems that a newly practising family physician should be competent to handle; second, the qualities, behaviour, and skills that characterize competence at the start of independent practice. Main findings Response rate was 54%; total number of elements among all responses was 5077, for an average 31 per respondent. Of the elements, 2676 were topics or clinical situations to be dealt with; the other 2401 were skills, behaviour patterns, or qualities, without reference to a specific clinical problem. The expert groups identified 6 essential skills, the phases of the clinical encounter, and 99 priority topics as the descriptors used by the respondents. More than 20% of respondents cited 30 of the topics. Conclusion Family physicians define the domain of competence in family medicine in terms of 6 essential skills, the phases of the clinical encounter, and priority topics. This survey represents the first level of definition of evaluation objectives in family medicine. Definition of the interactions among these elements will permit these objectives to become detailed enough to effectively guide assessment. PMID:21918130

Mammographic image quality in relation to positioning of the breast: A multicentre international evaluation of the assessment systems currently used, to provide an evidence base for establishing a standardised method of assessment.

PubMed

Taylor, K; Parashar, D; Bouverat, G; Poulos, A; Gullien, R; Stewart, E; Aarre, R; Crystal, P; Wallis, M

2017-11-01

Optimum mammography positioning technique is necessary to maximise cancer detection. Current criteria for mammography appraisal lack reliability and validity with a need to develop a more objective system. We aimed to establish current international practice in assessing image quality (IQ), of screening mammograms then develop and validate a reproducible assessment tool. A questionnaire sent to centres in countries undertaking population screening identified practice, participants for an expert panel (EP) of radiologists/radiographers and a testing panel (TP) of radiographers. The EP developed category criteria and descriptors using a modified Delphi process to agree definitions. The EP scored 12 screening mammograms to test agreement then a main set of 178 cases. Weighted scores were derived for each descriptor enabling calculation of numerical parameters for each new category. The TP then scored the main set. Statistical analysis included ANOVA, t-tests and Kendall's coefficient. 11 centres in 8 countries responded forming an EP of 7 members and TP of 44 members. The EP showed moderate agreement when the scoring the mini test set W = 0.50 p < 0.001 and the main set W = 0.55 p < 0.001, 'posterior nipple line' being the most difficult descriptor. The weighted total scores differentiated the 4 new categories Perfect, Good, Adequate and Inadequate (p < 0.001). We have developed an assessment tool by Delphi consensus and weighted consensus criteria. We have successfully tabulated a range of numerical scores for each new category providing the first validated and reproducible mammography IQ scoring system. Copyright © 2017 The College of Radiographers. Published by Elsevier Ltd. All rights reserved.

ESPEN guidelines on definitions and terminology of clinical nutrition.

PubMed

Cederholm, T; Barazzoni, R; Austin, P; Ballmer, P; Biolo, G; Bischoff, S C; Compher, C; Correia, I; Higashiguchi, T; Holst, M; Jensen, G L; Malone, A; Muscaritoli, M; Nyulasi, I; Pirlich, M; Rothenberg, E; Schindler, K; Schneider, S M; de van der Schueren, M A E; Sieber, C; Valentini, L; Yu, J C; Van Gossum, A; Singer, P

2017-02-01

A lack of agreement on definitions and terminology used for nutrition-related concepts and procedures limits the development of clinical nutrition practice and research. This initiative aimed to reach a consensus for terminology for core nutritional concepts and procedures. The European Society of Clinical Nutrition and Metabolism (ESPEN) appointed a consensus group of clinical scientists to perform a modified Delphi process that encompassed e-mail communication, face-to-face meetings, in-group ballots and an electronic ESPEN membership Delphi round. Five key areas related to clinical nutrition were identified: concepts; procedures; organisation; delivery; and products. One core concept of clinical nutrition is malnutrition/undernutrition, which includes disease-related malnutrition (DRM) with (eq. cachexia) and without inflammation, and malnutrition/undernutrition without disease, e.g. hunger-related malnutrition. Over-nutrition (overweight and obesity) is another core concept. Sarcopenia and frailty were agreed to be separate conditions often associated with malnutrition. Examples of nutritional procedures identified include screening for subjects at nutritional risk followed by a complete nutritional assessment. Hospital and care facility catering are the basic organizational forms for providing nutrition. Oral nutritional supplementation is the preferred way of nutrition therapy but if inadequate then other forms of medical nutrition therapy, i.e. enteral tube feeding and parenteral (intravenous) nutrition, becomes the major way of nutrient delivery. An agreement of basic nutritional terminology to be used in clinical practice, research, and the ESPEN guideline developments has been established. This terminology consensus may help to support future global consensus efforts and updates of classification systems such as the International Classification of Disease (ICD). The continuous growth of knowledge in all areas addressed in this statement will provide the foundation for future revisions. Copyright © 2016 European Society for Clinical Nutrition and Metabolism. Published by Elsevier Ltd.. All rights reserved.

Development and validation of a mass casualty conceptual model.

PubMed

Culley, Joan M; Effken, Judith A

2010-03-01

To develop and validate a conceptual model that provides a framework for the development and evaluation of information systems for mass casualty events. The model was designed based on extant literature and existing theoretical models. A purposeful sample of 18 experts validated the model. Open-ended questions, as well as a 7-point Likert scale, were used to measure expert consensus on the importance of each construct and its relationship in the model and the usefulness of the model to future research. Computer-mediated applications were used to facilitate a modified Delphi technique through which a panel of experts provided validation for the conceptual model. Rounds of questions continued until consensus was reached, as measured by an interquartile range (no more than 1 scale point for each item); stability (change in the distribution of responses less than 15% between rounds); and percent agreement (70% or greater) for indicator questions. Two rounds of the Delphi process were needed to satisfy the criteria for consensus or stability related to the constructs, relationships, and indicators in the model. The panel reached consensus or sufficient stability to retain all 10 constructs, 9 relationships, and 39 of 44 indicators. Experts viewed the model as useful (mean of 5.3 on a 7-point scale). Validation of the model provides the first step in understanding the context in which mass casualty events take place and identifying variables that impact outcomes of care. This study provides a foundation for understanding the complexity of mass casualty care, the roles that nurses play in mass casualty events, and factors that must be considered in designing and evaluating information-communication systems to support effective triage under these conditions.

Content Validity of a Psychotherapeutic Intervention Model in Nursing: A Modified e-Delphi Study.

PubMed

Sampaio, Francisco Miguel Correia; Sequeira, Carlos; Lluch Canut, Teresa

2017-04-01

To estimate the content validity of a psychotherapeutic intervention model in nursing. Mental health nurses encounter great extrinsic difficulties when it comes to providing psychotherapeutic interventions due to the fact that they are not allowed to perform such practice in some countries. In this light, the pursuit of a psychotherapeutic intervention model in nursing seems germane to guide the professionals' psychotherapeutic practice, contributing hereof to increase mental health nurses' professional autonomy. Modified e-Delphi. Data were collected from October 2015 to January 2016 by means of three rounds of online questionnaires. The initial questionnaire was structured into five sections: general structure of the model, patients' exclusion criteria, assessment framework, nursing diagnoses, and nursing psychotherapeutic interventions. From the 42 experts invited, at least twenty (20) participated in each round. The experts achieved consensus with regard to the conclusion that nursing psychotherapeutic interventions should always seek to address a nursing diagnosis. These defined furthermore that a psychotherapeutic intervention model in nursing should be exercised by means of 3 to 12 sessions using Nursing Interventions Classification (NIC) as a resource. Finally, experts deemed that the model should follow the principles of integrative psychotherapy, so that techniques from different schools of psychotherapy could therefore be used in conjunction to promote the resolution of a nursing diagnosis. Achieving consensus about the structure of a psychotherapeutic intervention model in nursing is imperative to guide nurses in the provision of nursing psychotherapeutic interventions and to enable an effective evaluation of the health gains associated with its implementation. Copyright © 2016 Elsevier Inc. All rights reserved.

Development of quality indicators for transition from pediatric to adult care in sickle cell disease: A modified Delphi survey of adult providers.

PubMed

Sobota, Amy E; Shah, Nishita; Mack, Jennifer W

2017-06-01

Transition from pediatric to adult care is a vulnerable time for young adults with sickle cell disease (SCD); however, improvements in transition are limited by a lack of quality indicators. The purpose of this study was to establish quality indicators for transition in SCD and to determine the optimal timing between the final pediatric visit and the first adult provider visit. We conducted a modified Delphi survey to reach a consensus on which quality indicators are most important for a successful transition. Our expert panel consisted of members of the Sickle Cell Adult Provider Network. In the first round, the participants ranked a list of quality indicators by importance. In the second round, the participants chose their "top 5" quality indicators in terms of importance and also ranked them on feasibility. The response rates for the two rounds were 68 and 96%, respectively. Nine quality indicators were chosen as "top 5" by a majority of respondents, including communication between pediatric and adult providers, timing of first adult visit, patient self-efficacy, quality of life, and trust with their adult provider. Based on the comments from round 1, respondents were also asked for the optimal timing between leaving pediatric care and entering adult care. Most recommended a first adult visit within 2 months of the final pediatric visit. By using these quality indicators chosen by the majority of respondents, we can better develop and evaluate transition programs for young adults with SCD and improve health outcomes for these vulnerable patients. © 2016 Wiley Periodicals, Inc.

Developing a tool for nurses to assess risk of infection in pediatric oncology patients in China: a modified Delphi study.

PubMed

Zhou, Yufeng; Cui, Yan; Wang, Hong; Wang, Fang; Lu, Chao; Shen, Yan

2016-09-01

Infections are identified as the most common preventable cause of death in pediatric oncology patients. Assessing and stratifying risk of infections are essential to prevent infection in these patients. To date, no tool can fulfill this demand in China. This study aimed to develop a nursing work-based and Chinese-specific tool for pediatric nurses to assess risk of infection in oncology patients. This research was a modified Delphi study. Based on a literature review, a 37-item questionnaire rating on a 0-5 scale was developed. Twenty-four experts from 8 hospitals in 6 provinces of China were consulted for three rounds. Consensus for each item in the first round was defined as: the rating mean was>3 and the coefficient of variation (CV) was<0.5. Consensus for each item in the second round was defined as CV<0.3. Consensus among experts was defined as: P value of Kendall's coefficient of concordance ( W )<0.05. After three rounds of consultation, a two-part tool was developed: the Immune Status Scale (ISS) and the Checklist of Risk Factors of Infection (CRFI). There were 5 items in the ISS and 14 in the CRFI. Based on the ISS score, nurses could stratify children into the low-risk and high-risk groups. For high-risk children, nurses should screen risk factors of infection every day by the CRFI, and twice weekly for low-risk children. Further study is needed to verify this tool's efficacy. © 2016 the Journal of Biomedical Research. All rights reserved.

Adaptation of a difficult-to-manage asthma programme for implementation in the Dutch context: a modified e-Delphi

PubMed Central

Honkoop, Persijn J; Pinnock, Hilary; Kievits-Smeets, Regien M M; Sterk, Peter J; Dekhuijzen, P N Richard; in ’t Veen, Johannes C C M

2017-01-01

Patients with difficult-to-manage asthma represent a heterogeneous subgroup of asthma patients who require extensive assessment and tailored management. The International Primary Care Respiratory Group approach emphasises the importance of differentiating patients with asthma that is difficult to manage from those with severe disease. Local adaptation of this approach, however, is required to ensure an appropriate strategy for implementation in the Dutch context. We used a modified three-round e-Delphi approach to assess the opinion of all relevant stakeholders (general practitioners, pulmonologists, practice nurses, pulmonary nurses and people with asthma). In the first round, the participants were asked to provide potentially relevant items for a difficult-to-manage asthma programme, which resulted in 67 items. In the second round, we asked participants to rate the relevance of specific items on a seven-point Likert scale, and 46 items were selected as relevant. In the third round, the selected items were categorised and items were ranked within the categories according to relevance. Finally, we created the alphabet acronym for the categories ‘the A–I of difficult-to-manage asthma’ to resonate with an established Dutch ‘A–E acronym for determining asthma control’. This should facilitate implementation of this programme within the existing structure of educational material on asthma and chronic obstructive pulmonary disease (COPD) in primary care, with potential for improving management of difficult-to-manage asthma. Other countries could use a similar approach to create a locally adapted version of such a programme. PMID:28184039

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

Insufficiently studied factors related to burnout in nursing: Results from an e-Delphi study

PubMed Central

2017-01-01

Objective This study aimed to identify potentially important factors in explaining burnout in nursing that have been insufficiently studied or ignored. Methods A three-round Delphi study via e-mail correspondence was conducted, with a group of 40 European experts. The e-Delphi questionnaire consisted of 52 factors identified from a literature review. Experts rated and scored the importance of factors in the occurrence of burnout and the degree of attention given by researchers to each of the variables listed, on a six-point Likert scale. We used the agreement percentage (>80%) to measure the level of consensus between experts. Furthermore, to confirm the level of consensus, we also calculated mean scores and modes. Regardless of the degree of consensus reached by the experts, we have calculated the mean of the stability of the answers for each expert (individual's qualitative stability) and the mean of the stability percentages of the experts (qualitative group stability). Results The response rate in the three rounds was 93.02% (n = 40). Eight new factors were suggested in the first round. After modified, the e-Delphi questionnaire in the second and third rounds had 60 factors. All the factors reached the third round with a consensus level above 80% in terms of the attention that researchers gave them in their studies. Moreover, the data show a total mean qualitative group stability of 96.21%. In the third round 9 factors were classified by experts as ‘studied very little’, 17 as ‘studied little’ and 34 as 'well studied' Conclusion Findings show that not all the factors that may influence nursing burnout have received the same attention from researchers. The panel of experts has identified factors that, although important in explaining burnout, have been poorly studied or even forgotten. Our results suggest that further study into factors such as a lack of recognition of part of the tasks that nurses perform, feminine stereotype or excessive bureaucracy is needed for a better understanding of this syndrome and improve the quality of life in nurses. PMID:28388660

Communication and social competencies in medical education in German-speaking countries: the Basel consensus statement. Results of a Delphi survey.

PubMed

Kiessling, Claudia; Dieterich, Anja; Fabry, Götz; Hölzer, Henrike; Langewitz, Wolf; Mühlinghaus, Isabel; Pruskil, Susanne; Scheffer, Simone; Schubert, Sebastian

2010-11-01

To propose a comprehensive set of competencies and educational objectives for communication and social competencies in undergraduate medical education and to support the nationwide implementation of these issues in all medical schools. Thirty experts from different medical and psychosocial disciplines participated in a 2-day workshop using the Nominal Group Technique (NGT) to develop an initial set of educational objectives. These were refined, structured, and rated according to their importance by means of a two-step Delphi Survey involving additional experts in medical education. The initial workshop resulted in 188 educational objectives assigned to 26 different topics. After the Delphi Survey, 131 objectives remained, assigned to 19 different topics. Some objectives that could be assigned to more than one topic were subsumed under a new more general category. The described consensus process proved successful as one method to develop a set of educational objectives. The Basel consensus statement can be used to orientate curriculum reform and development in medical education. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Development of quality indicators for low-risk labor care provided by midwives using a RAND-modified Delphi method.

PubMed

Ueda, Kayo; Ohtera, Shosuke; Kaso, Misato; Nakayama, Takeo

2017-09-22

In childbirth, most deliveries are low-risk, defined as spontaneous labor at full term without special high-risk facts or complications, especially in high-resource countries where maternal and perinatal mortality rates are very low. Indeed, the majority of mothers and infants have no serious conditions during labor. However, the quality of care provided is not assured, and performance may vary by birthing facility and provider. The overuse of technology in childbirth in some parts of the world is almost certainly based on assumptions like, "something can go wrong at any minute." There is a need to assess the quality of care provided for mothers and infants in low-risk labor. We aimed to develop specific quality indicators for low-risk labor care provided primarily by midwives in Japan. We used a RAND-modified Delphi method, which integrates evidence review with expert consensus development. The procedure comprises five steps: (1) literature review, including clinical practice guidelines, to extract and develop quality indicator candidates; (2) formation of a multidisciplinary panel; (3) independent panel ratings (Round 1); (4) panel meeting and independent panel ratings (Round 2); and (5) independent panel ratings (Round 3). The three independent panel ratings (Rounds 1-3) were held between July and December 2012. The assembled multidisciplinary panel comprised eight clinicians (two pediatricians, three obstetricians, and three midwives) and three mothers who were nonclinicians. Evidentiary review extracted 166 key recommendations from 32 clinical practice guidelines, and 31 existing quality indicators were added. After excluding duplicate recommendations and quality indicators, the panel discussed 25 candidate indicators. Of these, 18 were adopted, one was modified, six were not adopted, and four were added during the meeting, respectively. We established 23 quality indicators for low-risk labor care provided by midwives in labor units in Japan.

Using a Delphi process to define priorities for prison health research in Canada

PubMed Central

Kouyoumdjian, Fiona G; Schuler, Andrée; McIsaac, Kathryn E; Pivnick, Lucie; Matheson, Flora I; Brown, Glenn; Kiefer, Lori; Silva, Diego; Hwang, Stephen W

2016-01-01

Objectives A large number of Canadians spend time in correctional facilities each year, and they are likely to have poor health compared to the general population. Relatively little health research has been conducted in Canada with a focus on people who experience detention or incarceration. We aimed to conduct a Delphi process with key stakeholders to define priorities for research in prison health in Canada for the next 10 years. Setting We conducted a Delphi process using an online survey with two rounds in 2014 and 2015. Participants We invited key stakeholders in prison health research in Canada to participate, which we defined as persons who had published research on prison health in Canada since 1994 and persons in the investigators’ professional networks. We invited 143 persons to participate in the first round and 59 participated. We invited 137 persons to participate in the second round and 67 participated. Primary and secondary outcome measures Participants suggested topics in the first round, and these topics were collated by investigators. We measured the level of agreement among participants that each collated topic was a priority for prison health research in Canada for the next 10 years, and defined priorities based on the level of agreement. Results In the first round, participants suggested 71 topics. In the second round, consensus was achieved that a large number of suggested topics were research priorities. Top priorities were diversion and alternatives to incarceration, social and community re-integration, creating healthy environments in prisons, healthcare in custody, continuity of healthcare, substance use disorders and the health of Aboriginal persons in custody. Conclusions Generated in an inclusive and systematic process, these findings should inform future research efforts to improve the health and healthcare of people who experience detention and incarceration in Canada. PMID:26769790

Development and pilot test of a process to identify research needs from a systematic review.

PubMed

Saldanha, Ian J; Wilson, Lisa M; Bennett, Wendy L; Nicholson, Wanda K; Robinson, Karen A

2013-05-01

To ensure appropriate allocation of research funds, we need methods for identifying high-priority research needs. We developed and pilot tested a process to identify needs for primary clinical research using a systematic review in gestational diabetes mellitus. We conducted eight steps: abstract research gaps from a systematic review using the Population, Intervention, Comparison, Outcomes, and Settings (PICOS) framework; solicit feedback from the review authors; translate gaps into researchable questions using the PICOS framework; solicit feedback from multidisciplinary stakeholders at our institution; establish consensus among multidisciplinary external stakeholders on the importance of the research questions using the Delphi method; prioritize outcomes; develop conceptual models to highlight research needs; and evaluate the process. We identified 19 research questions. During the Delphi method, external stakeholders established consensus for 16 of these 19 questions (15 with "high" and 1 with "medium" clinical benefit/importance). We pilot tested an eight-step process to identify clinically important research needs. Before wider application of this process, it should be tested using systematic reviews of other diseases. Further evaluation should include assessment of the usefulness of the research needs generated using this process for primary researchers and funders. Copyright © 2013 Elsevier Inc. All rights reserved.

From control to causation: Validating a 'complex systems model' of running-related injury development and prevention.

PubMed

Hulme, A; Salmon, P M; Nielsen, R O; Read, G J M; Finch, C F

2017-11-01

There is a need for an ecological and complex systems approach for better understanding the development and prevention of running-related injury (RRI). In a previous article, we proposed a prototype model of the Australian recreational distance running system which was based on the Systems Theoretic Accident Mapping and Processes (STAMP) method. That model included the influence of political, organisational, managerial, and sociocultural determinants alongside individual-level factors in relation to RRI development. The purpose of this study was to validate that prototype model by drawing on the expertise of both systems thinking and distance running experts. This study used a modified Delphi technique involving a series of online surveys (December 2016- March 2017). The initial survey was divided into four sections containing a total of seven questions pertaining to different features associated with the prototype model. Consensus in opinion about the validity of the prototype model was reached when the number of experts who agreed or disagreed with survey statement was ≥75% of the total number of respondents. A total of two Delphi rounds was needed to validate the prototype model. Out of a total of 51 experts who were initially contacted, 50.9% (n = 26) completed the first round of the Delphi, and 92.3% (n = 24) of those in the first round participated in the second. Most of the 24 full participants considered themselves to be a running expert (66.7%), and approximately a third indicated their expertise as a systems thinker (33.3%). After the second round, 91.7% of the experts agreed that the prototype model was a valid description of the Australian distance running system. This is the first study to formally examine the development and prevention of RRI from an ecological and complex systems perspective. The validated model of the Australian distance running system facilitates theoretical advancement in terms of identifying practical system-wide opportunities for the implementation of sustainable RRI prevention interventions. This 'big picture' perspective represents the first step required when thinking about the range of contributory causal factors that affect other system elements, as well as runners' behaviours in relation to RRI risk. Copyright © 2017 Elsevier Ltd. All rights reserved.

Using the Delphi expert consensus method in mental health research.

PubMed

Jorm, Anthony F

2015-10-01

The article gives an introductory overview of the use of the Delphi expert consensus method in mental health research. It explains the rationale for using the method, examines the range of uses to which it has been put in mental health research, and describes the stages of carrying out a Delphi study using examples from the literature. To ascertain the range of uses, a systematic search was carried out in PubMed. The article also examines the implications of 'wisdom of crowds' research for how to conduct Delphi studies. The Delphi method is a systematic way of determining expert consensus that is useful for answering questions that are not amenable to experimental and epidemiological methods. The validity of the approach is supported by 'wisdom of crowds' research showing that groups can make good judgements under certain conditions. In mental health research, the Delphi method has been used for making estimations where there is incomplete evidence (e.g. What is the global prevalence of dementia?), making predictions (e.g. What types of interactions with a person who is suicidal will reduce their chance of suicide?), determining collective values (e.g. What areas of research should be given greatest priority?) and defining foundational concepts (e.g. How should we define 'relapse'?). A range of experts have been used in Delphi research, including clinicians, researchers, consumers and caregivers. The Delphi method has a wide range of potential uses in mental health research. © The Royal Australian and New Zealand College of Psychiatrists 2015.

Moving Forward Through Consensus: A Modified Delphi Approach to Determine the Top Research Priorities in Orthopaedic Oncology.

PubMed

Schneider, Patricia Jacqueline; Evaniew, Nathan; McKay, Paula; Ghert, Michelle

2017-12-01

Several challenges presently impede the conduct of prospective clinical studies in orthopaedic oncology, including limited financial resources to support their associated costs and inadequate patient volume at most single institutions. This study was conducted to prioritize research questions within the field so that the Musculoskeletal Tumor Society (MSTS), and other relevant professional societies, can direct the limited human and fiscal resources available to address the priorities that the stakeholders involved believe will have the most meaningful impact on orthopaedic oncology patient care. The purpose of this study was to use a formal consensus-based approach involving clinician-scientists and other stakeholders to identify the top priority research questions for future international prospective clinical studies in orthopaedic oncology. A three-step modified Delphi process involving multiple stakeholder groups (including orthopaedic oncologists, research personnel, funding agency representation, and patient representation) was conducted. First, we sent an electronic questionnaire to all participants to solicit clinically relevant research questions (61 participants; 54% of the original 114 individuals invited to participate returned the questionnaires). Then, participants rated the candidate research questions using a 5-point Likert scale for five criteria (60 participants; 53% of the original group participated in this portion of the process). Research questions that met a priori consensus thresholds progressed for consideration to an in-person consensus meeting, which was attended by 44 participants (39% of the original group; 12 countries were represented at this meeting). After the consensus panel's discussion, members individually assigned scores to each question using a 9-point Likert scale. Research questions that met preset criteria advanced to final ranking, and panel members individually ranked their top three priority research questions, resulting in a final overall ranking of research priorities. A total of 73 candidate research questions advanced to the consensus meeting. In the end, the consensus panel identified four research priorities: (1) Does less intensive surveillance of patients with sarcoma affect survival? (2) What are the survival outcomes over time for orthopaedic oncology implants? (3) Does resection versus stabilization improve oncologic and functional outcomes in oligometastatic bone disease? (4) What is the natural history of untreated fibromatosis? The results of this study will assist in developing a long-term research strategy for the MSTS and, possibly, the orthopaedic oncology field as a whole. Furthermore, the results of this study can assist researchers in guiding their research efforts and in providing a justified rationale to funding agencies when requesting the resources necessary to support future collaborative research studies that address the identified orthopaedic oncology priorities.

Finding common ground in implementation: towards a theory of gradual commonality.

PubMed

Ter Haar, Marian; Aarts, Noelle; Verhoeven, Piet

2016-03-01

This article reports on an empirical study that aimed to design a practice-based theory about collaboration on the local implementation of a nationally developed health-promoting intervention. The study's objective is to better understand the dynamic process of complex collaboration. The research is based on a Delphi study among some 100 individuals in local and regional networks, in which various professionals work together to implement the BeweegKuur, which translates as 'course of exercise'. The BeweegKuur is a combined lifestyle intervention aimed at promoting sufficient physical exercise and a healthy diet among people in the Netherlands who are overweight and at risk of diabetes. The Delphi study in three rounds systematically and interactively constructs a common perspective on implementation, reflecting stakeholders' ideas about the collaboration and providing an insight into how these ideas are influenced by the context of the implementation. The statistical and qualitative analyses of the responses to the feedback in the Delphi study form the basis for this practice-based theory on complex collaboration, called the theory of gradual commonality. During interaction, consensus gradually emerges about co-creation as a collaboration strategy. Co-creation leaves room for various ways of achieving the ambitions of the BeweegKuur. This article discusses the importance of this practice-based theory and the value of the Delphi research strategy for promoting health. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

A Delphi Consensus of the Crucial Steps in Gastric Bypass and Sleeve Gastrectomy Procedures in the Netherlands.

PubMed

Kaijser, Mirjam A; van Ramshorst, Gabrielle H; Emous, Marloes; Veeger, Nic J G M; van Wagensveld, Bart A; Pierie, Jean-Pierre E N

2018-04-09

Bariatric procedures are technically complex and skill demanding. In order to standardize the procedures for research and training, a Delphi analysis was performed to reach consensus on the practice of the laparoscopic gastric bypass and sleeve gastrectomy in the Netherlands. After a pre-round identifying all possible steps from literature and expert opinion within our study group, questionnaires were send to 68 registered Dutch bariatric surgeons, with 73 steps for bypass surgery and 51 steps for sleeve gastrectomy. Statistical analysis was performed to identify steps with and without consensus. This process was repeated to reach consensus of all necessary steps. Thirty-eight participants (56%) responded in the first round and 32 participants (47%) in the second round. After the first Delphi round, 19 steps for gastric bypass (26%) and 14 for sleeve gastrectomy (27%) gained full consensus. After the second round, an additional amount of 10 and 12 sub-steps was confirmed as key steps, respectively. Thirteen steps in the gastric bypass and seven in the gastric sleeve were deemed advisable. Our expert panel showed a high level of consensus expressed in a Cronbach's alpha of 0.82 for the gastric bypass and 0.87 for the sleeve gastrectomy. The Delphi consensus defined 29 steps for gastric bypass and 26 for sleeve gastrectomy as being crucial for correct performance of these procedures to the standards of our expert panel. These results offer a clear framework for the technical execution of these procedures.

Acne severity grading: determining essential clinical components and features using a Delphi consensus.

PubMed

Tan, Jerry; Wolfe, Barat; Weiss, Jonathan; Stein-Gold, Linda; Bikowski, Joseph; Del Rosso, James; Webster, Guy F; Lucky, Anne; Thiboutot, Diane; Wilkin, Jonathan; Leyden, James; Chren, Mary-Margaret

2012-08-01

There are multiple global scales for acne severity grading but no singular standard. Our objective was to determine the essential clinical components (content items) and features (property-related items) for an acne global grading scale for use in research and clinical practice using an iterative method, the Delphi process. Ten acne experts were invited to participate in a Web-based Delphi survey comprising 3 iterative rounds of questions. In round 1, the experts identified the following clinical components (primary acne lesions, number of lesions, extent, regional involvement, secondary lesions, and patient experiences) and features (clinimetric properties, ease of use, categorization of severity based on photographs or text, and acceptance by all stakeholders). In round 2, consensus for inclusion in the scale was established for primary lesions, number, sites, and extent; as well as clinimetric properties and ease of use. In round 3, consensus for inclusion was further established for categorization and acceptance. Patient experiences were excluded and no consensus was achieved for secondary lesions. The Delphi panel consisted solely of the United States (U.S.)-based acne experts. Using an established method for achieving consensus, experts in acne vulgaris concluded that an ideal acne global grading scale would comprise the essential clinical components of primary acne lesions, their quantity, extent, and facial and extrafacial sites of involvement; with features of clinimetric properties, categorization, efficiency, and acceptance. Copyright © 2011 American Academy of Dermatology, Inc. Published by Mosby, Inc. All rights reserved.

Clinical reasoning in unimodal interventions in patients with non-specific neck pain in daily physiotherapy practice, a Delphi study.

PubMed

Maissan, Francois; Pool, Jan; Stutterheim, Eric; Wittink, Harriet; Ostelo, Raymond

2018-06-02

Neck pain is the fourth major cause of disability worldwide but sufficient evidence regarding treatment is not available. This study is a first exploratory attempt to gain insight into and consensus on the clinical reasoning of experts in patients with non-specific neck pain. First, we aimed to inventory expert opinions regarding the indication for physiotherapy when, other than neck pain, no positive signs and symptoms and no positive diagnostic tests are present. Secondly, we aimed to determine which measurement instruments are being used and when they are used to support and objectify the clinical reasoning process. Finally, we wanted to establish consensus among experts regarding the use of unimodal interventions in patients with non-specific neck pain, i.e. their sequential linear clinical reasoning. A Delphi study. A Web-based Delphi study was conducted. Fifteen experts (teachers and researchers) participated. Pain alone was deemed not be an indication for physiotherapy treatment. PROMs are mainly used for evaluative purposes and physical tests for diagnostic and evaluative purposes. Eighteen different variants of sequential linear clinical reasoning were investigated within our Delphi study. Only 6 out of 18 variants of sequential linear clinical reasoning reached more than 50% consensus. Pain alone is not an indication for physiotherapy. Insight has been obtained into which measurement instruments are used and when they are used. Consensus about sequential linear lines of clinical reasoning was poor. Copyright © 2018 Elsevier Ltd. All rights reserved.

Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

PubMed

Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

2016-07-01

To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

Quality Metrics in Neonatal and Pediatric Critical Care Transport: A National Delphi Project.

PubMed

Schwartz, Hamilton P; Bigham, Michael T; Schoettker, Pamela J; Meyer, Keith; Trautman, Michael S; Insoft, Robert M

2015-10-01

The transport of neonatal and pediatric patients to tertiary care facilities for specialized care demands monitoring the quality of care delivered during transport and its impact on patient outcomes. In 2011, pediatric transport teams in Ohio met to identify quality indicators permitting comparisons among programs. However, no set of national consensus quality metrics exists for benchmarking transport teams. The aim of this project was to achieve national consensus on appropriate neonatal and pediatric transport quality metrics. Modified Delphi technique. The first round of consensus determination was via electronic mail survey, followed by rounds of consensus determination in-person at the American Academy of Pediatrics Section on Transport Medicine's 2012 Quality Metrics Summit. All attendees of the American Academy of Pediatrics Section on Transport Medicine Quality Metrics Summit, conducted on October 21-23, 2012, in New Orleans, LA, were eligible to participate. Candidate quality metrics were identified through literature review and those metrics currently tracked by participating programs. Participants were asked in a series of rounds to identify "very important" quality metrics for transport. It was determined a priori that consensus on a metric's importance was achieved when at least 70% of respondents were in agreement. This is consistent with other Delphi studies. Eighty-two candidate metrics were considered initially. Ultimately, 12 metrics achieved consensus as "very important" to transport. These include metrics related to airway management, team mobilization time, patient and crew injuries, and adverse patient care events. Definitions were assigned to the 12 metrics to facilitate uniform data tracking among programs. The authors succeeded in achieving consensus among a diverse group of national transport experts on 12 core neonatal and pediatric transport quality metrics. We propose that transport teams across the country use these metrics to benchmark and guide their quality improvement activities.

Measuring adverse events in helicopter emergency medical services: establishing content validity.

PubMed

Patterson, P Daniel; Lave, Judith R; Martin-Gill, Christian; Weaver, Matthew D; Wadas, Richard J; Arnold, Robert M; Roth, Ronald N; Mosesso, Vincent N; Guyette, Francis X; Rittenberger, Jon C; Yealy, Donald M

2014-01-01

We sought to create a valid framework for detecting adverse events (AEs) in the high-risk setting of helicopter emergency medical services (HEMS). We assembled a panel of 10 expert clinicians (n = 6 emergency medicine physicians and n = 4 prehospital nurses and flight paramedics) affiliated with a large multistate HEMS organization in the Northeast US. We used a modified Delphi technique to develop a framework for detecting AEs associated with the treatment of critically ill or injured patients. We used a widely applied measure, the content validity index (CVI), to quantify the validity of the framework's content. The expert panel of 10 clinicians reached consensus on a common AE definition and four-step protocol/process for AE detection in HEMS. The consensus-based framework is composed of three main components: (1) a trigger tool, (2) a method for rating proximal cause, and (3) a method for rating AE severity. The CVI findings isolate components of the framework considered content valid. We demonstrate a standardized process for the development of a content-valid framework for AE detection. The framework is a model for the development of a method for AE identification in other settings, including ground-based EMS.

Research priorities for respiratory nursing: a UK-wide Delphi study.

PubMed

Kelly, Carol Ann; Kirkcaldy, Andrew J; Pilkington, Melissa; Hodson, Matthew; Welch, Lindsay; Yorke, Janelle; Knighting, Katherine

2018-04-01

Respiratory nurses make a significant contribution to the delivery of respiratory healthcare, but there is a dearth of nurse-led, practice-focused, published research. Using a modified three-round Delphi, this study sought to identify research priorities for respiratory nursing to inform a national research strategy. Study information and the survey link were sent electronically to members of UK professional respiratory organisations. Round 1 had 78 items across 16 topics, informed by a systematic literature review. Respondents suggested additional items which were content analysed to inform Round 2. Respondents rated all items and ranked the topics in all rounds. To ensure rigour, rounds had an explicit focus with pre-determined criteria for consensus (70%). In total, 363 responses were received across Rounds 1, 2 and 3 (n=183, 95 and 85, respectively). The top five research priorities were: 1) "Patient understanding of asthma control"; 2) "The clinical and cost-effectiveness of respiratory nurse interventions"; 3) "The impact of nurse-led clinics on patient care"; 4) "Inhaler technique"; and 5) two topics jointly scored: "Prevention of exacerbations" and "Symptom management". With potential international significance, this is the first UK study to identify research priorities for respiratory nursing, providing direction for those planning or undertaking research.

Corruption and oil exploration: expert agreement about the prevention of HIV/AIDS in the Niger Delta of Nigeria.

PubMed

Udoh, Isidore A; Stammen, Ronald M; Mantell, Joanne E

2008-08-01

The Niger Delta, according to the Nigerian Ministry of Health, has a disproportionately high HIV infection rate, which is double the national average. The United Nations Development Program attributes the spiraling HIV infection rate in the region to poverty, migration and gender inequality. This paper examines two complementary suppositions: Is the high prevalence of HIV in the Niger Delta related to incompetent leadership and corruption? Is it related to the negative effects of oil exploration in the region? Currently, there is a dearth of research on the effectiveness of government programs or the role of the oil industry on the impact of AIDS in Nigeria. To address this gap, we conducted a survey with 27 internationally renowned experts from diverse disciplines using a three-round modified Delphi to formulate consensus about the impact of weak governance and oil corruption on AIDS in the Niger Delta. Results from the Delphi suggest that these factors and others have exacerbated the transmission of HIV in the region. To mitigate the impact of AIDS in the region, efforts to engage oil companies in implementing HIV prevention programs as part of their corporate environmental responsibility to the community are urgently needed.

78 FR 48468 - Delphi Corporation, Electronics and Safety Division, Including On-Site Leased Workers From...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-08

..., Electronics and Safety Division, Including On-Site Leased Workers From Securitas, Bartech, Flint Janitorial... Adjustment Assistance on May 20, 2013, applicable to workers of Delphi Corporation, Electronics and Safety... on- site at the Flint, Michigan location of Delphi Corporation, Electronics and Safety Division. The...

Delphi: An Overview, An Application, Some Lessons.

ERIC Educational Resources Information Center

Moore, Carl M.; Coke, James G.

This paper discusses Delphi-a method of utilizing individuals' knowledge, judgment, and opinions to address complex questions and applies the method to a community planning project in Stow, Ohio. There are four phases of any Delphi: (1) exploring the subject under discussion, with each individual contributing pertinent information, (2) reaching an…

75 FR 20383 - Delphi Thermal Systems Currently Known as General Motors Components Holdings LLC, Lockport...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-19

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-63,818] Delphi Thermal Systems... 25, 2008, applicable to workers of Delphi Thermal Systems, Lockport Operations, Lockport, New York... workers are engaged in activities related to the production of automotive heat exchanger products and HVAC...

Specialty Training's Organizational Readiness for curriculum Change (STORC): development of a questionnaire in a Delphi study.

PubMed

Bank, Lindsay; Jippes, Mariëlle; van Luijk, Scheltus; den Rooyen, Corry; Scherpbier, Albert; Scheele, Fedde

2015-08-05

In postgraduate medical education (PGME), programs have been restructured according to competency-based frameworks. The scale and implications of these adjustments justify a comprehensive implementation plan. Organizational Readiness for Change (ORC) is seen as a critical precursor for a successful implementation of change initiatives. Though, ORC in health care settings is mostly assessed in small scale settings and in relation to new policies and practices rather than educational change. Therefore our aim with this work was to develop an instrument to asses Specialty Training's Organizational Readiness for curriculum Change (STORC). A Delphi procedure was conducted to examine the applicability of a preliminary questionnaire in PGME, which was based on existing instruments designed for business and health care organizations. The 41 panellists (19 trainees and 22 supervisors from 6 specialties) from four different countries who were confronted with an apparent curriculum change, or would be in the near future, were asked to rate the relevance of a 89-item web-based questionnaire with regard to changes in specialty training on a 5-point Likert scale. Furthermore, they were invited to make qualitative comments on the items. In two rounds the 89-item preliminary questionnaire was reduced to 44 items. Items were either removed, kept, adapted or added based on individual item scores and qualitative comments. In the absence of a gold standard, this Delphi procedure was considered complete when the overall questionnaire rating exceeded 4.0 (scale 0-5). The overall item score reached 4.1 in the second round, meeting our criteria for completion of this Delphi procedure. This Delphi study describes the initial validating step in the development of an instrument to asses Specialty Training's Organisational Readiness for curriculum Change (STORC). Since ORC is measured on various subscales and presented as such, its strength lies in analysing these subscales. The latter makes it possible for educational leaders to identify and anticipate on hurdles in the implementation process and subsequently optimize efforts for successful curriculum change.

Consensus Guidelines into the Management of Epilepsy in Adults with an Intellectual Disability

ERIC Educational Resources Information Center

Kerr, M.; Scheepers, M.; Arvio, M.; Beavis, J.; Brandt, C.; Brown, S.; Huber, B.; Iivanainen, M.; Louisse, A. C.; Martin, P.; Marson, A. G.; Prasher, V.; Singh, B. K.; Veendrick, M.; Wallace, R. A.

2009-01-01

Background: Epilepsy has a pervasive impact on the lives of people with intellectual disability and their carers. The delivery of high-quality care is impacted on by the complexity and diversity of epilepsy in this population. This article presents the results of a consensus clinical guideline process. Results: A Delphi process identified a list…

The Delphi Predictions of Pathology Chairmen: A Six-Year Retrospective View.

ERIC Educational Resources Information Center

Hill, Rolla B.; Goodale, Fairfield

1981-01-01

A retrospective review is reported of progress in academic pathology since 1974, when the Association of Pathology Chairmen undertook a Delphi study of pathology chairmen's expectations and desires for the future. The Delphi study was useful in alerting academic pathologists to opportunities and in coalescing activities toward achievement of…

The Delphi Method for Graduate Research

ERIC Educational Resources Information Center

Skulmoski, Gregory J.; Hartman, Francis T.; Krahn, Jennifer

2007-01-01

The Delphi method is an attractive method for graduate students completing masters and PhD level research. It is a flexible research technique that has been successfully used in our program at the University of Calgary to explore new concepts within and outside of the information systems body of knowledge. The Delphi method is an iterative process…

Exploration to Identify Professional Dispositions of School Librarians: A Delphi Study

ERIC Educational Resources Information Center

Bush, Gail; Jones, Jami L.

2010-01-01

This article reports the findings of an exploratory study to identify professional dispositions of school librarians. The authors employed the Delphi method, a qualitative research method that emphasizes expert knowledge and consensus within a particular field. The Delphi panel consisted of members of the editorial boards of nationally recognized…

Terminating Sequential Delphi Survey Data Collection

ERIC Educational Resources Information Center

Kalaian, Sema A.; Kasim, Rafa M.

2012-01-01

The Delphi survey technique is an iterative mail or electronic (e-mail or web-based) survey method used to obtain agreement or consensus among a group of experts in a specific field on a particular issue through a well-designed and systematic multiple sequential rounds of survey administrations. Each of the multiple rounds of the Delphi survey…

Summary of evidence-based guideline update: Evaluation and management of concussion in sports

PubMed Central

Giza, Christopher C.; Kutcher, Jeffrey S.; Ashwal, Stephen; Barth, Jeffrey; Getchius, Thomas S.D.; Gioia, Gerard A.; Gronseth, Gary S.; Guskiewicz, Kevin; Mandel, Steven; Manley, Geoffrey; McKeag, Douglas B.; Thurman, David J.; Zafonte, Ross

2013-01-01

Objective: To update the 1997 American Academy of Neurology (AAN) practice parameter regarding sports concussion, focusing on 4 questions: 1) What factors increase/decrease concussion risk? 2) What diagnostic tools identify those with concussion and those at increased risk for severe/prolonged early impairments, neurologic catastrophe, or chronic neurobehavioral impairment? 3) What clinical factors identify those at increased risk for severe/prolonged early postconcussion impairments, neurologic catastrophe, recurrent concussions, or chronic neurobehavioral impairment? 4) What interventions enhance recovery, reduce recurrent concussion risk, or diminish long-term sequelae? The complete guideline on which this summary is based is available as an online data supplement to this article. Methods: We systematically reviewed the literature from 1955 to June 2012 for pertinent evidence. We assessed evidence for quality and synthesized into conclusions using a modified Grading of Recommendations Assessment, Development and Evaluation process. We used a modified Delphi process to develop recommendations. Results: Specific risk factors can increase or decrease concussion risk. Diagnostic tools to help identify individuals with concussion include graded symptom checklists, the Standardized Assessment of Concussion, neuropsychological assessments, and the Balance Error Scoring System. Ongoing clinical symptoms, concussion history, and younger age identify those at risk for postconcussion impairments. Risk factors for recurrent concussion include history of multiple concussions, particularly within 10 days after initial concussion. Risk factors for chronic neurobehavioral impairment include concussion exposure and APOE ε4 genotype. Data are insufficient to show that any intervention enhances recovery or diminishes long-term sequelae postconcussion. Practice recommendations are presented for preparticipation counseling, management of suspected concussion, and management of diagnosed concussion. PMID:23508730

76 FR 46852 - Workers From Kelly Services, Working On-Site at Delphi Automotive Systems, LLC, Powertrain...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-03

... Services, Working On-Site at Delphi Automotive Systems, LLC, Powertrain Division, El Paso, TX; Amended..., 2011, applicable to leased workers from Kelly Services working on-site at Delphi Automotive Systems... automotive components. The notice will be published soon in the Federal Register. At the request of the State...

Lessons Learned from Teaching Scratch as an Introduction to Object-Oriented Programming in Delphi

ERIC Educational Resources Information Center

van Zyl, Sukie; Mentz, Elsa; Havenga, Marietjie

2016-01-01

As part of curriculum changes in South Africa, an introductory programming language, Scratch, must first be taught before switching to the well-established teaching of Delphi. The nature of programming in Scratch is considerably different from that in Delphi. It was assumed that the teaching of Scratch as introductory programming language could…

Reference Materials in LIS Instruction: A Delphi Study

ERIC Educational Resources Information Center

Rabina, Debbie

2013-01-01

This paper presents the results of a Delphi study conducted over a two-month period in 2011. The purpose of the study was to identify reference sources that should be covered in basic reference courses taught in LIS programs in the United States. The Delphi method was selected for its appropriateness in soliciting expert opinions and assessing the…

A Delphi Study: Exploring Faculty Perceptions of the Best Practices Influencing Student Persistence in Blended Courses

ERIC Educational Resources Information Center

Manning, Kim Elise

2010-01-01

This Delphi study explored the instructional practices of community college faculty who were teaching blended or Web-assisted courses and how these practices influenced student persistence. The Delphi method provided qualitative data in the form of expert advice through consensus building on the instructional practices most likely to influence…

Career and Technical Education at a Crossroads: A Delphi Study

ERIC Educational Resources Information Center

Cutright, Michael W.

2011-01-01

Career and technical education in the United States has reached a critical juncture. A three round Delphi method was used to determine a consensus on the future events of career and technical education to better inform educational decision makers. Forty-one individual experts in the field were invited to serve as panelists for the Delphi study and…

Advantages and Limitations of the e-Delphi Technique: Implications for Health Education Researchers

ERIC Educational Resources Information Center

Donohoe, Holly; Stellefson, Michael; Tennant, Bethany

2012-01-01

In the last 30 years, the application of the Delphi technique has been increasing. With the recent availability and established popularity of Internet-based research tools, the Internet has been identified as a means for mitigating Delphi limitations, maximizing its advantages, and expanding the breadth of its application. The discourse on the…

A Delphi Study on Staff Bereavement Training in the Intellectual and Developmental Disabilities Field

ERIC Educational Resources Information Center

Gray, Jennifer A.; Truesdale, Jesslyn

2015-01-01

The Delphi technique was used to obtain expert panel consensus to prioritize content areas and delivery methods for developing staff grief and bereavement curriculum training in the intellectual and developmental disabilities (IDD) field. The Delphi technique was conducted with a panel of 18 experts from formal and informal disability caregiving,…

75 FR 41521 - Delphi Corporation, Automotive Holding Group, Plant 6, Currently Known as General Motors...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-16

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-62,069; TA-W-62,069A] Delphi Corporation, Automotive Holding Group, Plant 6, Currently Known as General Motors Corporation Including On-Site Leased Workers From Securitas, EDS, Bartech, Mays Chemicals, Interim Physicians, LLC and HSS Material Management, Flint, MI; Delphi...

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists

PubMed Central

2017-01-01

Purpose This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. Methods A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects’ responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Results Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Conclusion Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience. PMID:28900069

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists.

PubMed

Hwang, Yoon-Sook; Kang, Hyun-Sook; Kim, Soo-Hwa; Moon, Hee-Jung; Lee, Sun-Mi; Jung, Jae-Yeon; Hwang, Su-Jeong; Ha, Jung-Eun

2017-01-01

This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects' responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience.

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach.

PubMed

Skela-Savič, Brigita; Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-06-01

There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and 'change making' should become an intrinsic part of everyone's job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: 'Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.' The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science.

Lifelong learning in nursing: a Delphi study.

PubMed

Davis, Lisa; Taylor, Heidi; Reyes, Helen

2014-03-01

In order to foster a culture of lifelong learning in nursing, it is important to identify what the concept means in the nursing profession as well as the characteristics of a lifelong learner. The purpose of this Delphi study was to conceptualize lifelong learning from the perspective of nursing, and to identify characteristics and essential elements of lifelong learning. A Delphi Study technique in three phases was completed using an online survey tool. Data were analyzed for conceptual description, ratings of characteristics and attributes, and expert consensus in these three phases. An online survey tool was used in this study. Recognized experts in nursing education, administration and public policy participated in this study. Lifelong learning in nursing is defined as a dynamic process, which encompasses both personal and professional life. This learning process is also both formal and informal. Lifelong learning involves seeking and appreciating new worlds or ideas in order to gain a new perspective as well as questioning one's environment, knowledge, skills and interactions. The most essential characteristics of a lifelong learner are reflection, questioning, enjoying learning, understanding the dynamic nature of knowledge, and engaging in learning by actively seeking learning opportunities. Keeping the mind active is essential to both lifelong learning and being able to translate knowledge into the capacity to deliver high quality nursing care. It is hoped that a clearer understanding of lifelong learning in nursing will foster more discussion and research about intentional, active inclusion of lifelong learning behaviors in nursing curricula. Copyright © 2013 Elsevier Ltd. All rights reserved.

Identification of relevant functional issues for the care of patients with acute arthritis by health professionals, using the ICF framework and a multi-disciplinary focus group approach.

PubMed

Zochling, J; Grill, E; Alten, R; Ernst, J; Stucki, G; Braun, J

2007-01-01

To identify the most relevant problems to be addressed in the multi-disciplinary care of patients with acute arthritis using focus groups of health professionals followed by a Delphi process. Focus group and Delphi methodology were applied. The focus groups were conducted at three specialist rheumatology hospital clinics in Germany, each group comprising rheumatologists, nurses, physiotherapists, occupational therapists, psychologists and social workers. The participants were asked to decide which categories of the International Classification of Functioning, Disability and Health (ICF) are relevant to the care of patients with acute inflammatory arthritis. The results from the focus groups were then followed by an anonymous Delphi process. Twenty-six health professionals participated in the 3 focus groups. 167 of the second-level ICF categories (63% of all second-level categories) were considered as relevant by the rheumatology health professionals. Items from all four components, Body Functions, Body Structures, Activities and Participation and Environmental Factors were represented. Agreement between focus groups and between different health professional groups was substantial for all components with the exception of Environmental Factors (Cohen's kappa 0.23). The involvement of experts from different health professions is a valuable tool to identify typical patient characteristics, expressed as distinct ICF categories, to aid in patient care in the acute rheumatology setting. Acute patient care cannot and should not be separated from ongoing long-term management.

Clinical assessment of acute lateral ankle sprain injuries (ROAST): 2019 consensus statement and recommendations of the International Ankle Consortium.

PubMed

Delahunt, Eamonn; Bleakley, Chris M; Bossard, Daniela S; Caulfield, Brian M; Docherty, Carrie L; Doherty, Cailbhe; Fourchet, François; Fong, Daniel T; Hertel, Jay; Hiller, Claire E; Kaminski, Thomas W; McKeon, Patrick O; Refshauge, Kathryn M; Remus, Alexandria; Verhagen, Evert; Vicenzino, Bill T; Wikstrom, Erik A; Gribble, Phillip A

2018-06-09

Lateral ankle sprain injury is the most common musculoskeletal injury incurred by individuals who participate in sports and recreational physical activities. Following initial injury, a high proportion of individuals develop long-term injury-associated symptoms and chronic ankle instability. The development of chronic ankle instability is consequent on the interaction of mechanical and sensorimotor insufficiencies/impairments that manifest following acute lateral ankle sprain injury. To reduce the propensity for developing chronic ankle instability, clinical assessments should evaluate whether patients in the acute phase following lateral ankle sprain injury exhibit any mechanical and/or sensorimotor impairments. This modified Delphi study was undertaken under the auspices of the executive committee of the International Ankle Consortium. The primary aim was to develop recommendations, based on expert (n=14) consensus, for structured clinical assessment of acute lateral ankle sprain injuries. After two modified Delphi rounds, consensus was achieved on the clinical assessment of acute lateral ankle sprain injuries. Consensus was reached on a minimum standard clinical diagnostic assessment. Key components of this clinical diagnostic assessment include: establishing the mechanism of injury, as well as the assessment of ankle joint bones and ligaments. Through consensus, the expert panel also developed the International Ankle Consortium Rehabilitation-Oriented ASsessmenT (ROAST). The International Ankle Consortium ROAST will help clinicians identify mechanical and/or sensorimotor impairments that are associated with chronic ankle instability. This consensus statement from the International Ankle Consortium aims to be a key resource for clinicians who regularly assess individuals with acute lateral ankle sprain injuries. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development and Measurement of Guidelines-Based Quality Indicators of Caesarean Section Care in the Netherlands: A RAND-Modified Delphi Procedure and Retrospective Medical Chart Review

PubMed Central

de Boer, Karin; Burggraaf, Henriëtte; Derks, Jan B.; van Dijk, Det; van Dillen, Jeroen; Dirksen, Carmen D.; Duvekot, Johannes J.; Franx, Arie; Hasaart, Tom H. M.; Huisjes, Anjoke J. M.; Kolkman, Diny; Kwee, Anneke; Mol, Ben W.; van Pampus, Mariëlle G.; de Roon-Immerzeel, Alieke; van Roosmalen, Jos J. M.; Roumen, Frans J. M. E.; Smid-Koopman, Ellen; Spaans, Wilbert A.; Visser, Harry; van Wijngaarden, Wim J.; Willekes, Christine; Wouters, Maurice G. A. J.

2016-01-01

Background There is an ongoing discussion on the rising CS rate worldwide. Suboptimal guideline adherence may be an important contributor to this rise. Before improvement of care can be established, optimal CS care in different settings has to be defined. This study aimed to develop and measure quality indicators to determine guideline adherence and identify target groups for improvement of care with direct effect on caesarean section (CS) rates. Method Eighteen obstetricians and midwives participated in an expert panel for systematic CS quality indicator development according to the RAND-modified Delphi method. A multi-center study was performed and medical charts of 1024 women with a CS and a stratified and weighted randomly selected group of 1036 women with a vaginal delivery were analysed. Quality indicator frequency and adherence were scored in 2060 women with a CS or vaginal delivery. Results The expert panel developed 16 indicators on planned CS and 11 indicators on unplanned CS. Indicator adherence was calculated, defined as the number of women in a specific obstetrical situation in which care was performed as recommended in both planned and unplanned CS settings. The most frequently occurring obstetrical situations with low indicator adherence were: 1) suspected fetal distress (frequency 17%, adherence 46%), 2) non-progressive labour (frequency 12%, CS performed too early in over 75%), 3) continuous support during labour (frequency 88%, adherence 37%) and 4) previous CS (frequency 12%), with adequate counselling in 15%. Conclusions We identified four concrete target groups for improvement of obstetrical care, which can be used as a starting point to reduce CS rates worldwide. PMID:26783742

International definition of a point-of-care test in family practice: a modified e-Delphi procedure.

PubMed

Schols, Angel M R; Dinant, Geert-Jan; Hopstaken, Rogier; Price, Christopher P; Kusters, Ron; Cals, Jochen W L

2018-01-29

The use of point-of-care tests (POCTs) in family practice is increasing, and the term POCT is often used in medical literature and clinical practice. Yet, no widely supported definition by several professional fields exists. To reach consensus on an international definition of a POCT in family practice. We performed a modified international e-Delphi procedure of four rounds among expert panel members from different professional backgrounds-family practitioners, laboratory specialists, policymakers, researchers and manufacturers. Of 27 panel members from seven different countries, 26 participated in all rounds. Most panel members were active in POCT research or policymaking and 70% worked in family medicine. After choosing important components, structuring of answers and feedback, the following definition was chosen as the best or second best definition by 81% of panel members: a point-of-care test in family practice is a test to support clinical decision making, which is performed by a qualified member of the practice staff nearby the patient and on any part of the patient's body or its derivatives, during or very close to the time of consultation, to help the patient and physician to decide upon the best suited approach, and of which the results should be known at the time of the clinical decision making. The definition emerging from this study can inform family practitioners, laboratory specialists, policymakers and manufacturers on the most widely supported and recognized definition and could act as a clear starting point for the organization and execution of professional point-of-care testing in family practice worldwide. © The Author(s) 2018. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

International perspective on common core competencies for occupational physicians: a modified Delphi study.

PubMed

Lalloo, Drushca; Demou, Evangelia; Kiran, Sibel; Cloeren, Marianne; Mendes, René; Macdonald, Ewan B

2016-07-01

The competencies required of occupational physicians (OPs) have been the subject of peer-reviewed research in Europe and individual countries around the world. In the European Union (EU), there has been development of guidance on training and common competencies, but little research has extended beyond this. The aim of this study was to obtain consensus on and identify the common core competencies required of OPs around the world. A modified Delphi study was carried out among representative organisations and networks of OPs in a range of countries around the world. It was conducted in 2 rounds using a questionnaire based on the specialist training syllabus of a number of countries, expert panel reviews and conference discussions. Responses were received from 51 countries around the world, with the majority from Europe (60%; 59%) and North and South America (24%; 32%) in rounds 1 and 2, respectively. General principles of assessment and management of occupational hazards to health and good clinical care were jointly considered most important in ranking when compared with the other topic areas. Assessment of disability and fitness for work, communication skills and legal and ethical issues completed the top five. In both rounds, research methods and teaching and educational supervision were considered least important. This study has established the current priorities among OPs across 51 countries of the common competencies required for occupational health (OH) practice. These findings can serve as a platform for the development of common core competencies/qualifications within specific geographical regions or internationally. This is particularly pertinent with globalisation of commerce and free movement within the EU. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

[Applying the Modified Delphi Technique to Develop the Role of HIV Case Managers and Essential Nursing Competencies in HIV Care].

PubMed

Ko, Nai-Ying; Hsieh, Chia-Yin; Chen, Yen-Chin; Tsai, Chen-Hsi; Liu, Hsiao-Ying; Liu, Li-Fang

2015-08-01

Since 2005, the Taiwan Centers for Disease Control (Taiwan CDC) initiated an HIV case management program in AIDS-designated hospitals to provide integrative services and risk-reduction counseling for HIV-infected individuals. In light of the increasingly complex and highly specialized nature of clinical care, expanding and improving competency-based professional education is important to enhance the quality of HIV/AIDS care. The aim of this study was to develop the essential competency framework for HIV care for HIV case managers in Taiwan. We reviewed essential competencies of HIV care from Canada, the United Kingdom, and several African countries and devised descriptions of the roles of case managers and of the associated core competencies for HIV care in Taiwan. The modified Delphi technique was used to evaluate the draft framework of these roles and core competencies. A total of 15 HIV care experts were invited to join the expert panel to review and rank the draft framework. The final framework consisted of 7 roles and 27 competencies for HIV case managers. In Round 1, only 3 items did not receive consensus approval from the experts. After modification based on opinions of the experts, 7 roles and 27 competencies received 97.06% consensus approval in Round 2 and were organized into the final framework for HIV case managers. These roles and associated core competencies were: HIV Care Expert (9 competencies), Communicator (1 competency), Collaborator (4 competencies), Navigator (2 competencies), Manager (4 competencies), Advocate (2 competencies), and Professional (5 competencies). The authors developed an essential competency framework for HIV care using the consensus of a multidisciplinary expert panel. Curriculum developers and advanced nurses and practitioners may use this framework to support developments and to ensure a high quality of HIV care.

Reporting Guidelines for Clinical Pharmacokinetic Studies: The ClinPK Statement.

PubMed

Kanji, Salmaan; Hayes, Meghan; Ling, Adam; Shamseer, Larissa; Chant, Clarence; Edwards, David J; Edwards, Scott; Ensom, Mary H H; Foster, David R; Hardy, Brian; Kiser, Tyree H; la Porte, Charles; Roberts, Jason A; Shulman, Rob; Walker, Scott; Zelenitsky, Sheryl; Moher, David

2015-07-01

Transparent reporting of all research is essential for assessing the validity of any study. Reporting guidelines are available and endorsed for many types of research but are lacking for clinical pharmacokinetic studies. Such tools promote the consistent reporting of a minimal set of information for end users, and facilitate knowledge translation of research. The objective of this study was to create a guideline to assist in the transparent and complete reporting of clinical pharmacokinetic studies. Preliminary content to be considered was identified from a systematic search of the literature and regulatory documents. Stakeholders were identified to participate in a modified Delphi exercise and a virtual meeting to generate consensus for items considered essential in the reporting of clinical pharmacokinetic studies. The proposed checklist was pilot tested on 100 recently published clinical pharmacokinetic studies. Overall and itemized compliance with the proposed guidance was determined for each study. Sixty-eight stakeholders from nine countries consented to participate. Four rounds of a modified Delphi survey and a series of small virtual meetings were required to generate consensus for a 24-item checklist considered to be essential to the reporting of clinical pharmacokinetic studies. When applied to the 100 most recently published clinical pharmacokinetic studies, 45 were determined to be compliant with at least 80 % of the checklist items. Explanatory text was prepared using examples of compliant reporting from these and other relevant studies. The reader's ability to judge the validity of pharmacokinetic research can be greatly compromised by the incomplete reporting of study information. Using consensus methods, we have developed a tool to guide transparent and accurate reporting of clinical pharmacokinetic studies. Endorsement and implementation of these guidelines by researchers, clinicians and journals would promote more consistent reporting of these studies and allow for better assessment of utility for clinical applications.

The Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE): Construct and Content Validation Using a Modified Delphi Method.

PubMed

Paquette-Warren, Jann; Tyler, Marie; Fournie, Meghan; Harris, Stewart B

2017-06-01

In order to scale-up successful innovations, more evidence is needed to evaluate programs that attempt to address the rising prevalence of diabetes and the associated burdens on patients and the healthcare system. This study aimed to assess the construct and content validity of the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE), a tool developed to guide the evaluation, design and implementation with built-in knowledge translation principles. A modified Delphi method, including 3 individual rounds (questionnaire with 7-point agreement/importance Likert scales and/or open-ended questions) and 1 group round (open discussion) were conducted. Twelve experts in diabetes, research, knowledge translation, evaluation and policy from Canada (Ontario, Quebec and British Columbia) and Australia participated. Quantitative consensus criteria were an interquartile range of ≤1. Qualitative data were analyzed thematically and confirmed by participants. An importance scale was used to determine a priority multi-level indicator set. Items rated very or extremely important by 80% or more of the experts were reviewed in the final group round to build the final set. Participants reached consensus on the content and construct validity of DEFINE, including its title, overall goal, 5-step evaluation approach, medical and nonmedical determinants of health schematics, full list of indicators and associated measurement tools, priority multi-level indicator set and next steps in DEFINE's development. Validated by experts, DEFINE has the right theoretic components to evaluate comprehensively diabetes prevention and management programs and to support acquisition of evidence that could influence the knowledge translation of innovations to reduce the burden of diabetes. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Evacuation performance evaluation tool.

PubMed

Farra, Sharon; Miller, Elaine T; Gneuhs, Matthew; Timm, Nathan; Li, Gengxin; Simon, Ashley; Brady, Whittney

2016-01-01

Hospitals conduct evacuation exercises to improve performance during emergency events. An essential aspect in this process is the creation of reliable and valid evaluation tools. The objective of this article is to describe the development and implications of a disaster evacuation performance tool that measures one portion of the very complex process of evacuation. Through the application of the Delphi technique and DeVellis's framework, disaster and neonatal experts provided input in developing this performance evaluation tool. Following development, content validity and reliability of this tool were assessed. Large pediatric hospital and medical center in the Midwest. The tool was pilot tested with an administrative, medical, and nursing leadership group and then implemented with a group of 68 healthcare workers during a disaster exercise of a neonatal intensive care unit (NICU). The tool has demonstrated high content validity with a scale validity index of 0.979 and inter-rater reliability G coefficient (0.984, 95% CI: 0.948-0.9952). The Delphi process based on the conceptual framework of DeVellis yielded a psychometrically sound evacuation performance evaluation tool for a NICU.

Community Engagement in the CTSA Program: Stakeholder Responses from a National Delphi Process

PubMed Central

Seifer, Sarena D.; Stupak, Matthew; Martinez, Linda Sprague

2014-01-01

Abstract In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community‐Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. PMID:24841362

Community engagement in the CTSA program: stakeholder responses from a national Delphi process.

PubMed

Freeman, Elmer; Seifer, Sarena D; Stupak, Matthew; Martinez, Linda Sprague

2014-06-01

In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community-Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. © 2014 Wiley Periodicals, Inc.

TCM Pattern Questionnaire for Lateral Elbow Pain: Development of an Instrument via a Delphi Process

PubMed Central

Bian, Zhao-Xiang

2016-01-01

Individualized acupuncture treatment has been practiced for pain therapy. This study used acupuncture treatment for lateral elbow pain (LEP) as an example to study the diagnostic practice of individualized acupuncture treatment. A provisional version of LEP pattern questionnaire was developed based on a recent systematic review on TCM pattern diagnosis for LEP. A Delphi panel of 33 clinical experts from seven different countries was formed, and the Delphi survey was conducted in Chinese and English language for two rounds. Consensus was achieved from all 26 panelists who responded to the second round on 243 items of the instrument, which included a 72-question-long questionnaire. The mean level of expert consensus on the items of the final questionnaire was 85%. Consensus was found on four TCM patterns that could underlie LEP, namely, the wind-cold-dampness pattern, the qi stagnation and blood stasis pattern, the dual deficiency of qi and blood pattern, and the retained dampness-heat pattern. A list of signs and symptoms indicating one of the four TCM patterns and a list of preferred treatment modalities for each pattern were also generated. Our instrument shows considerable content validity. Further validity and reliability studies are under way. PMID:27525024

Development of the Comprehensive Cervical Dystonia Rating Scale: Methodology

PubMed Central

Comella, Cynthia L.; Fox, Susan H.; Bhatia, Kailash P.; Perlmutter, Joel S.; Jinnah, Hyder A.; Zurowski, Mateusz; McDonald, William M.; Marsh, Laura; Rosen, Ami R.; Waliczek, Tracy; Wright, Laura J.; Galpern, Wendy R.; Stebbins, Glenn T.

2016-01-01

We present the methodology utilized for development and clinimetric testing of the Comprehensive Cervical Dystonia (CD) Rating scale, or CCDRS. The CCDRS includes a revision of the Toronto Western Spasmodic Torticollis Rating Scale (TWSTRS-2), a newly developed psychiatric screening tool (TWSTRS-PSYCH), and the previously validated Cervical Dystonia Impact Profile (CDIP-58). For the revision of the TWSTRS, the original TWSTRS was examined by a committee of dystonia experts at a dystonia rating scales workshop organized by the Dystonia Medical Research Foundation. During this workshop, deficiencies in the standard TWSTRS were identified and recommendations for revision of the severity and pain subscales were incorporated into the TWSTRS-2. Given that no scale currently evaluates the psychiatric features of cervical dystonia (CD), we used a modified Delphi methodology and a reiterative process of item selection to develop the TWSTRS-PSYCH. We also included the CDIP-58 to capture the impact of CD on quality of life. The three scales (TWSTRS2, TWSTRS-PSYCH, and CDIP-58) were combined to construct the CCDRS. Clinimetric testing of reliability and validity of the CCDRS are described. The CCDRS was designed to be used in a modular fashion that can measure the full spectrum of CD. This scale will provide rigorous assessment for studies of natural history as well as novel symptom-based or disease-modifying therapies. PMID:27088112

Development of the Comprehensive Cervical Dystonia Rating Scale: Methodology.

PubMed

Comella, Cynthia L; Fox, Susan H; Bhatia, Kailash P; Perlmutter, Joel S; Jinnah, Hyder A; Zurowski, Mateusz; McDonald, William M; Marsh, Laura; Rosen, Ami R; Waliczek, Tracy; Wright, Laura J; Galpern, Wendy R; Stebbins, Glenn T

2015-06-01

We present the methodology utilized for development and clinimetric testing of the Comprehensive Cervical Dystonia (CD) Rating scale, or CCDRS. The CCDRS includes a revision of the Toronto Western Spasmodic Torticollis Rating Scale (TWSTRS-2), a newly developed psychiatric screening tool (TWSTRS-PSYCH), and the previously validated Cervical Dystonia Impact Profile (CDIP-58). For the revision of the TWSTRS, the original TWSTRS was examined by a committee of dystonia experts at a dystonia rating scales workshop organized by the Dystonia Medical Research Foundation. During this workshop, deficiencies in the standard TWSTRS were identified and recommendations for revision of the severity and pain subscales were incorporated into the TWSTRS-2. Given that no scale currently evaluates the psychiatric features of cervical dystonia (CD), we used a modified Delphi methodology and a reiterative process of item selection to develop the TWSTRS-PSYCH. We also included the CDIP-58 to capture the impact of CD on quality of life. The three scales (TWSTRS2, TWSTRS-PSYCH, and CDIP-58) were combined to construct the CCDRS. Clinimetric testing of reliability and validity of the CCDRS are described. The CCDRS was designed to be used in a modular fashion that can measure the full spectrum of CD. This scale will provide rigorous assessment for studies of natural history as well as novel symptom-based or disease-modifying therapies.

Survey of diagnostic and treatment practices for multiple sclerosis in Europe.

PubMed

Fernández, O; Delvecchio, M; Edan, G; Fredrikson, S; Gionvannoni, G; Hartung, H-P; Havrdova, E; Kappos, L; Pozzilli, C; Soerensen, P S; Tackenberg, B; Vermersch, P; Comi, G

2017-03-01

Up-to-date information is needed on the extent to which neurologists treating multiple sclerosis (MS) in Europe are integrating rapidly evolving diagnostic criteria, disease-modifying therapies and recommendations for monitoring disease activity into their clinical practice. A steering committee of MS neurologists used a modified Delphi process to develop case- and practice-based questions for two sequential surveys distributed to MS neurologists throughout Europe. Case-based questions were developed for radiologically isolated syndrome (RIS), clinically isolated syndrome (CIS), relapsing-remitting MS (RRMS) and RRMS with breakthrough disease. Multiple sclerosis neurologists from 11 European countries responded to survey 1 (n = 233) and survey 2 (n = 171). Respondents agreed that they would not treat the patients in the RIS or CIS cases but would treat a patient with a relatively mild form of RRMS. Choice of treatment was evenly distributed among first-line injectables and oral treatments for mild RRMS, and moved to second-line treatment as the RRMS case increased in severity. Additional results on RRMS with breakthrough disease are presented. Although there was general agreement on some aspects of treatment, responses to other management and clinical practice questions varied considerably. These results, which reflect current clinical practice patterns, highlight the need for additional MS treatment education and awareness and may help inform the development of MS practice guidelines in Europe. © 2017 EAN.

Development of a standardized training course for laparoscopic procedures using Delphi methodology.

PubMed

Bethlehem, Martijn S; Kramp, Kelvin H; van Det, Marc J; ten Cate Hoedemaker, Henk O; Veeger, Nicolaas J G M; Pierie, Jean Pierre E N

2014-01-01

Content, evaluation, and certification of laparoscopic skills and procedure training lack uniformity among different hospitals in The Netherlands. Within the process of developing a new regional laparoscopic training curriculum, a uniform and transferrable curriculum was constructed for a series of laparoscopic procedures. The aim of this study was to determine regional expert consensus regarding the key steps for laparoscopic appendectomy and cholecystectomy using Delphi methodology. Lists of suggested key steps for laparoscopic appendectomy and cholecystectomy were created using surgical textbooks, available guidelines, and local practice. A total of 22 experts, working for teaching hospitals throughout the region, were asked to rate the suggested key steps for both procedures on a Likert scale from 1-5. Consensus was reached with Crohnbach's α ≥ 0.90. Of the 22 experts, 21 completed and returned the survey (95%). Data analysis already showed consensus after the first round of Delphi on the key steps for laparoscopic appendectomy (Crohnbach's α = 0.92) and laparoscopic cholecystectomy (Crohnbach's α = 0.90). After the second round, 15 proposed key steps for laparoscopic appendectomy and 30 proposed key steps for laparoscopic cholecystectomy were rated as important (≥4 by at least 80% of the expert panel). These key steps were used for the further development of the training curriculum. By using the Delphi methodology, regional consensus was reached on the key steps for laparoscopic appendectomy and cholecystectomy. These key steps are going to be used for standardized training and evaluation purposes in a new regional laparoscopic curriculum. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Designing Excellence and Quality Model for Training Centers of Primary Health Care: A Delphi Method Study.

PubMed

Tabrizi, Jafar-Sadegh; Farahbakhsh, Mostafa; Shahgoli, Javad; Rahbar, Mohammad Reza; Naghavi-Behzad, Mohammad; Ahadi, Hamid-Reza; Azami-Aghdash, Saber

2015-10-01

Excellence and quality models are comprehensive methods for improving the quality of healthcare. The aim of this study was to design excellence and quality model for training centers of primary health care using Delphi method. In this study, Delphi method was used. First, comprehensive information were collected using literature review. In extracted references, 39 models were identified from 34 countries and related sub-criteria and standards were extracted from 34 models (from primary 39 models). Then primary pattern including 8 criteria, 55 sub-criteria, and 236 standards was developed as a Delphi questionnaire and evaluated in four stages by 9 specialists of health care system in Tabriz and 50 specialists from all around the country. Designed primary model (8 criteria, 55 sub-criteria, and 236 standards) were concluded with 8 criteria, 45 sub-criteria, and 192 standards after 4 stages of evaluations by specialists. Major criteria of the model are leadership, strategic and operational planning, resource management, information analysis, human resources management, process management, costumer results, and functional results, where the top score was assigned as 1000 by specialists. Functional results had the maximum score of 195 whereas planning had the minimum score of 60. Furthermore the most and the least sub-criteria was for leadership with 10 sub-criteria and strategic planning with 3 sub-criteria, respectively. The model that introduced in this research has been designed following 34 reference models of the world. This model could provide a proper frame for managers of health system in improving quality.

Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS)

PubMed Central

Downes, Martin J; Brennan, Marnie L; Williams, Hywel C; Dean, Rachel S

2016-01-01

Objectives The aim of this study was to develop a critical appraisal (CA) tool that addressed study design and reporting quality as well as the risk of bias in cross-sectional studies (CSSs). In addition, the aim was to produce a help document to guide the non-expert user through the tool. Design An initial scoping review of the published literature and key epidemiological texts was undertaken prior to the formation of a Delphi panel to establish key components for a CA tool for CSSs. A consensus of 80% was required from the Delphi panel for any component to be included in the final tool. Results An initial list of 39 components was identified through examination of existing resources. An international Delphi panel of 18 medical and veterinary experts was established. After 3 rounds of the Delphi process, the Appraisal tool for Cross-Sectional Studies (AXIS tool) was developed by consensus and consisted of 20 components. A detailed explanatory document was also developed with the tool, giving expanded explanation of each question and providing simple interpretations and examples of the epidemiological concepts being examined in each question to aid non-expert users. Conclusions CA of the literature is a vital step in evidence synthesis and therefore evidence-based decision-making in a number of different disciplines. The AXIS tool is therefore unique and was developed in a way that it can be used across disciplines to aid the inclusion of CSSs in systematic reviews, guidelines and clinical decision-making. PMID:27932337

[Prioritization and Consentation of Criteria for the Appraisal, Funding and Evaluation of Projects from the German Innovationsfonds: A multi-perspective Delphi study].

PubMed

Schmitt, J; Petzold, T; Nellessen-Martens, G; Pfaff, H

2015-09-01

The German Innovationsfonds provides the chance for evidence-based developments of the German healthcare system. Prioritization of recommendations for an effective, efficient, fair, transparent, and sustainable granting of funds through a transparent, evidence-driven consensus-process involving all relevant stakeholder groups. Representatives from health and research policy, payers, patient representatives, healthcare providers, and scientists were invited to nominate participants for an electronic 3 round iterative Delphi-study to prioritize the thematic focus, requirements concerning study methods, the team of applicants, evaluation, utilization of study results, and for the selection of reviewers. Criteria considered as relevant by at least 60% of the panel (consensus definition) in the first 2 Delphi rounds were rated as facultative, preferable, or obligatory criteria for project funding. Data were analyzed descriptively. ( Datenbank Versorgungsforschung Deutschland VfD_15_003561). All invited stakeholder groups except payers participated. 34 (85%) of 40 nominated representatives participated in the Delphi-study. A total of 64 criteria were consented as relevant for project review and funding concerning the thematic focus (n=28), methodological requirements (n=13), requirements for applicants (n=4), for the evaluation (n=4), utilization (n=6), and selection of peer reviewers (n=9). It is the collective responsibility of all stakeholders to spend the designated funds as efficient and sustainable as possible. The consented recommendations shall serve decision makers as a resource for the granting of funds and the evaluation of the Innovationsfonds. © Georg Thieme Verlag KG Stuttgart · New York.

Nursing process decision support system for urology ward.

PubMed

Hao, Angelica Te-Hui; Wu, Lee-Pin; Kumar, Ajit; Jian, Wen-Shan; Huang, Li-Fang; Kao, Ching-Chiu; Hsu, Chien-Yeh

2013-07-01

We developed a nursing process decision support system (NPDSS) based on three clinical pathways, including benign prostatic hypertrophy, inguinal hernia, and urinary tract stone. NPDSS included six major nursing diagnoses - acute pain, impaired urinary elimination, impaired skin integrity, anxiety, infection risk, and risk of falling. This paper aims to describe the design, development and validation process of the NPDSS. We deployed the Delphi method to reach consensus for decision support rules of NPDSS. A team of nine-member expert nurses from a medical center in Taiwan was involved in Delphi method. The Cronbach's α method was used for examining the reliability of the questionnaire used in the Delphi method. The Visual Basic 6.0 as front-end and Microsoft Access 2003 as back-end was used to develop the system. A team of six nursing experts was asked to evaluate the usability of the developed systems. A 5-point Likert scale questionnaire was used for the evaluation. The sensitivity and specificity of NPDSS were validated using 150 nursing chart. The study showed a consistency between the diagnoses of the developed system (NPDSS) and the nursing charts. The sensitivities of the nursing diagnoses including acute pain, impaired urinary elimination, risk of infection, and risk of falling were 96.9%, 98.1%, 94.9%, and 89.9% respectively; and the specificities were 88%, 49.5%, 62%, and 88% respectively. We did not calculate the sensitivity and specificity of impaired skin integrity and anxiety due to non-availability of enough sample size. NPDSS can help nurses in decision making of nursing diagnoses. Besides, it can help them to generate nursing diagnoses based on patient-specific data, individualized care plans, and implementation within their usual nursing workflow. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Developing a set of consensus indicators to support maternity service quality improvement: using Core Outcome Set methodology including a Delphi process.

PubMed

Bunch, K J; Allin, B; Jolly, M; Hardie, T; Knight, M

2018-05-16

To develop a core metric set to monitor the quality of maternity care. Delphi process followed by a face-to-face consensus meeting. English maternity units. Three representative expert panels: service designers, providers and users. Maternity care metrics judged important by participants. Participants were asked to complete a two-phase Delphi process, scoring metrics from existing local maternity dashboards. A consensus meeting discussed the results and re-scored the metrics. In all, 125 distinct metrics across six domains were identified from existing dashboards. Following the consensus meeting, 14 metrics met the inclusion criteria for the final core set: smoking rate at booking; rate of birth without intervention; caesarean section delivery rate in Robson group 1 women; caesarean section delivery rate in Robson group 2 women; caesarean section delivery rate in Robson group 5 women; third- and fourth-degree tear rate among women delivering vaginally; rate of postpartum haemorrhage of ≥1500 ml; rate of successful vaginal birth after a single previous caesarean section; smoking rate at delivery; proportion of babies born at term with an Apgar score <7 at 5 minutes; proportion of babies born at term admitted to the neonatal intensive care unit; proportion of babies readmitted to hospital at <30 days of age; breastfeeding initiation rate; and breastfeeding rate at 6-8 weeks. Core outcome set methodology can be used to incorporate the views of key stakeholders in developing a core metric set to monitor the quality of care in maternity units, thus enabling improvement. Achieving consensus on core metrics for monitoring the quality of maternity care. © 2018 The Authors. BJOG: An International Journal of Obstetrics and Gynaecology published by John Wiley & Sons Ltd on behalf of Royal College of Obstetricians and Gynaecologists.

Consensus Statements for Management of Barrett’s Dysplasia and Early-Stage Esophageal Adenocarcinoma, Based on a Delphi Process

PubMed Central

BENNETT, CATHY; VAKIL, NIMISH; BERGMAN, JACQUES; HARRISON, REBECCA; ODZE, ROBERT; VIETH, MICHAEL; SANDERS, SCOTT; GAY, LAURA; PECH, OLIVER; LONGCROFT–WHEATON, GAIUS; ROMERO, YVONNE; INADOMI, JOHN; TACK, JAN; CORLEY, DOUGLAS A.; MANNER, HENDRIK; GREEN, SUSI; DULAIMI, DAVID AL; ALI, HAYTHEM; ALLUM, BILL; ANDERSON, MARK; CURTIS, HOWARD; FALK, GARY; FENNERTY, M. BRIAN; FULLARTON, GRANT; KRISHNADATH, KAUSILIA; MELTZER, STEPHEN J.; ARMSTRONG, DAVID; GANZ, ROBERT; CENGIA, GIANPAOLO; GOING, JAMES J.; GOLDBLUM, JOHN; GORDON, CHARLES; GRABSCH, HEIKE; HAIGH, CHRIS; HONGO, MICHIO; JOHNSTON, DAVID; FORBES–YOUNG, RICKY; KAY, ELAINE; KAYE, PHILIP; LERUT, TONI; LOVAT, LAURENCE B.; LUNDELL, LARS; MAIRS, PHILIP; SHIMODA, TADAKUZA; SPECHLER, STUART; SONTAG, STEPHEN; MALFERTHEINER, PETER; MURRAY, IAIN; NANJI, MANOJ; POLLER, DAVID; RAGUNATH, KRISH; REGULA, JAROSLAW; CESTARI, RENZO; SHEPHERD, NEIL; SINGH, RAJVINDER; STEIN, HUBERT J.; TALLEY, NICHOLAS J.; GALMICHE, JEAN–PAUL; THAM, TONY C. K.; WATSON, PETER; YERIAN, LISA; RUGGE, MASSIMO; RICE, THOMAS W.; HART, JOHN; GITTENS, STUART; HEWIN, DAVID; HOCHBERGER, JUERGEN; KAHRILAS, PETER; PRESTON, SEAN; SAMPLINER, RICHARD; SHARMA, PRATEEK; STUART, ROBERT; WANG, KENNETH; WAXMAN, IRVING; ABLEY, CHRIS; LOFT, DUNCAN; PENMAN, IAN; SHAHEEN, NICHOLAS J.; CHAK, AMITABH; DAVIES, GARETH; DUNN, LORNA; FALCK–YTTER, YNGVE; DECAESTECKER, JOHN; BHANDARI, PRADEEP; ELL, CHRISTIAN; GRIFFIN, S. MICHAEL; ATTWOOD, STEPHEN; BARR, HUGH; ALLEN, JOHN; FERGUSON, MARK K.; MOAYYEDI, PAUL; JANKOWSKI, JANUSZ A. Z.

2017-01-01

BACKGROUND & AIMS Esophageal adenocarcinoma (EA) is increasingly common among patients with Barrett’s esophagus (BE). We aimed to provide consensus recommendations based on the medical literature that clinicians could use to manage patients with BE and low-grade dysplasia, high-grade dysplasia (HGD), or early-stage EA. METHODS We performed an international, multidisciplinary, systematic, evidence-based review of different management strategies for patients with BE and dysplasia or early-stage EA. We used a Delphi process to develop consensus statements. The results of literature searches were screened using a unique, interactive, Web-based data-sifting platform; we used 11,904 papers to inform the choice of statements selected. An a priori threshold of 80% agreement was used to establish consensus for each statement. RESULTS Eighty-one of the 91 statements achieved consensus despite generally low quality of evidence, including 8 clinical statements: (1) specimens from endoscopic resection are better than biopsies for staging lesions, (2) it is important to carefully map the size of the dysplastic areas, (3) patients that receive ablative or surgical therapy require endoscopic follow-up, (4) high-resolution endoscopy is necessary for accurate diagnosis, (5) endoscopic therapy for HGD is preferred to surveillance, (6) endoscopic therapy for HGD is preferred to surgery, (7) the combination of endoscopic resection and radiofrequency ablation is the most effective therapy, and (8) after endoscopic removal of lesions from patients with HGD, all areas of BE should be ablated. CONCLUSIONS We developed a data-sifting platform and used the Delphi process to create evidence-based consensus statements for the management of patients with BE and early-stage EA. This approach identified important clinical features of the diseases and areas for future studies. PMID:22537613

The Development of a Clinical Screening Instrument For Tumour Predisposition Syndromes In Childhood Cancer Patients

PubMed Central

Hopman, Saskia M. J.; Merks, Johannes H. M.; de Borgie, Corianne A. J. M.; Aalfs, C. M.; Biesecker, Leslie G.; Cole, Trevor; Eng, Charis; Legius, Eric; Maher, Eamonn R.; van Noesel, Max M.; Verloes, Alain; Viskochil, David H.; Wagner, Anja; Weksberg, Rosanna; Caron, Huib N.; Hennekam, Raoul C. M.

2014-01-01

Background Identification of tumour predisposition syndromes in patients who have cancer in childhood is paramount for optimal care. A screening instrument that can help to identify such patients will facilitate physicians caring for children with cancer. The complete screening instrument should consist of a standardized series of pictures and a screening form for manifestations not visible in the pictures. Here we describe the development of such a screening form based on an international two-stage Delphi process and an initial validation of the complete instrument. Patients and Methods We identified manifestations that may contribute to the diagnosis of a tumour predisposition syndrome through the Winter-Baraitser Dysmorphology Database and the textbook “Gorlin's Syndromes of the Head and Neck”. In a two-round Delphi process, eight international content-experts scored the contribution of each of these manifestations. We performed a clinical validation of the instrument in a selected cohort of ten paediatric cancer patients from another centre. Results In total, 49 manifestations were found to contribute to the diagnosis of a tumour predisposition syndrome and were included in the screening form. The pilot validation study showed that patients suspect for having a tumour predisposition syndrome were recognized. Excellent correlation for indication for referral of a patient between the screening instrument and the reference standard (personal evaluation by an experienced clinical geneticist) was found.). Conclusions The Delphi process performed by international specialists with a function as opinion leaders in their field of expertise has led to a screening form and instrument with which those childhood cancer patients can be identified who may have a tumour predisposition syndrome and thus have an indication to be referred for further genetic analysis. PMID:23855994

Reducing Energy Cost and Greenhouse Gas Emission in the Corporate Sector, a Delphi Study

ERIC Educational Resources Information Center

Kramer, Maxim L.

2013-01-01

The study is titled "Reducing energy cost and GreenHouse Gas emission in the corporate sector, A Delphi Study". The study applied the Delphi methodology and focused on the Green IT solutions that can help the modern corporate organizations with less than 1000 employees to decrease their energy costs and GHG emissions. The study presents…

Examining the Roles of Blended Learning Approaches in Computer-Supported Collaborative Learning (CSCL) Environments: A Delphi Study

ERIC Educational Resources Information Center

So, Hyo-Jeong; Bonk, Curtis J.

2010-01-01

In this study, a Delphi method was used to identify and predict the roles of blended learning approaches in computer-supported collaborative learning (CSCL) environments. The Delphi panel consisted of experts in online learning from different geographic regions of the world. This study discusses findings related to (a) pros and cons of blended…

Setting the Scope of Concept Inventories for Introductory Computing Subjects

ERIC Educational Resources Information Center

Goldman, Ken; Gross, Paul; Heeren, Cinda; Herman, Geoffrey L.; Kaczmarczyk, Lisa; Loui, Michael C.; Zilles, Craig

2010-01-01

A concept inventory is a standardized assessment tool intended to evaluate a student's understanding of the core concepts of a topic. In order to create a concept inventory it is necessary to accurately identify these core concepts. A Delphi process is a structured multi-step process that uses a group of experts to achieve a consensus opinion. We…

Investigating Instructional Design Management and Leadership Competencies--A Delphi Study

ERIC Educational Resources Information Center

Gardner, Joel; Chongwony, Lewis; Washington, Tawana

2018-01-01

Research in instructional design and educational technology journals typically focuses on the theories, technologies, and processes related to practice of instructional design. There is little research emphasis, however, on leadership and management of instructional design in higher education. Investigating the competencies associated with…

Preschool Principal's Curriculum Leadership Indicators: A Taiwan Perspective

ERIC Educational Resources Information Center

Lin, Chia-Fen; Lee, John Chi-Kin

2013-01-01

The role of a principal's curriculum leadership has become an educational issue in Taiwan's early childhood education. This study represents a pioneering attempt in adopting a target school interview, fuzzy Delphi, and analytic hierarchy process for constructing preschool principal's curriculum leadership indicators. Fifteen experts and…

Recovery in Psychosis: A Delphi Study With Experts by Experience

PubMed Central

Law, Heather; Morrison, Anthony P.

2014-01-01

This study aimed to establish consensus about the meaning of recovery among individuals with experience of psychosis. A Delphi approach was utilized to allow a large sample of service users to be anonymously consulted about their views on recovery. Service users were invited to take part in a 3-stage consultation process. A total of 381 participants gave their views on recovery in the main stage of this study, with 100 of these taking part in the final review stage. The final list of statements about recovery included 94 items, which were rated as essential or important by >80% of respondents. These statements covered items which define recovery, factors which help recovery, factors which hinder recovery, and factors which show that someone is recovering. As far as we are aware, it is the first study to identify areas of consensus in relation to definitions of recovery from a service user perspective, which are typically reported to be an idiosyncratic process. Implications and recommendations for clinical practice and future research are discussed. PMID:24727194

The comparative evaluation of expanded national immunization policies in Korea using an analytic hierarchy process.

PubMed

Shin, Taeksoo; Kim, Chun-Bae; Ahn, Yang-Heui; Kim, Hyo-Youl; Cha, Byung Ho; Uh, Young; Lee, Joo-Heon; Hyun, Sook-Jung; Lee, Dong-Han; Go, Un-Yeong

2009-01-29

The purpose of this paper is to propose new evaluation criteria and an analytic hierarchy process (AHP) model to assess the expanded national immunization programs (ENIPs) and to evaluate two alternative health care policies. One of the alternative policies is that private clinics and hospitals would offer free vaccination services to children and the other of them is that public health centers would offer these free vaccination services. Our model to evaluate the ENIPs was developed using brainstorming, Delphi techniques, and the AHP model. We first used the brainstorming and Delphi techniques, as well as literature reviews, to determine 25 criteria with which to evaluate the national immunization policy; we then proposed a hierarchical structure of the AHP model to assess ENIPs. By applying the proposed AHP model to the assessment of ENIPs for Korean immunization policies, we show that free vaccination services should be provided by private clinics and hospitals rather than public health centers.

The International Society for the Study of Women's Sexual Health Process of Care for Management of Hypoactive Sexual Desire Disorder in Women.

PubMed

Clayton, Anita H; Goldstein, Irwin; Kim, Noel N; Althof, Stanley E; Faubion, Stephanie S; Faught, Brooke M; Parish, Sharon J; Simon, James A; Vignozzi, Linda; Christiansen, Kristin; Davis, Susan R; Freedman, Murray A; Kingsberg, Sheryl A; Kirana, Paraskevi-Sofia; Larkin, Lisa; McCabe, Marita; Sadovsky, Richard

2018-04-01

The International Society for the Study of Women's Sexual Health process of care (POC) for management of hypoactive sexual desire disorder (HSDD) algorithm was developed to provide evidence-based guidelines for diagnosis and treatment of HSDD in women by health care professionals. Affecting 10% of adult females, HSDD is associated with negative emotional and psychological states and medical conditions including depression. The algorithm was developed using a modified Delphi method to reach consensus among the 17 international panelists representing multiple disciplines. The POC starts with the health care professional asking about sexual concerns, focusing on issues related to low sexual desire/interest. Diagnosis includes distinguishing between generalized acquired HSDD and other forms of low sexual interest. Biopsychosocial assessment of potentially modifiable factors facilitates initiation of treatment with education, modification of potentially modifiable factors, and, if needed, additional therapeutic intervention: sex therapy, central nervous system agents, and hormonal therapy, guided in part by menopausal status. Sex therapy includes behavior therapy, cognitive behavior therapy, and mindfulness. The only central nervous system agent currently approved by the US Food and Drug Administration (FDA) for HSDD is flibanserin in premenopausal women; use of flibanserin in postmenopausal women with HSDD is supported by data but is not FDA approved. Hormonal therapy includes off-label use of testosterone in postmenopausal women with HSDD, which is supported by data but not FDA approved. The POC incorporates monitoring the progress of therapy. In conclusion, the International Society for the Study of Women's Sexual Health POC for the management of women with HSDD provides a rational, evidence-based guideline for health care professionals to manage patients with appropriate assessments and individualized treatments. Copyright © 2017 Mayo Foundation for Medical Education and Research. Published by Elsevier Inc. All rights reserved.

Too Fit To Fracture: outcomes of a Delphi consensus process on physical activity and exercise recommendations for adults with osteoporosis with or without vertebral fractures.

PubMed

Giangregorio, L M; McGill, S; Wark, J D; Laprade, J; Heinonen, A; Ashe, M C; MacIntyre, N J; Cheung, A M; Shipp, K; Keller, H; Jain, R; Papaioannou, A

2015-03-01

An international consensus process resulted in exercise and physical activity recommendations for individuals with osteoporosis. Emphasis was placed on strength, balance, and postural alignment. Rather than providing generic restrictions, activity should be encouraged while considering impairments, fracture risk, activity history, and preference, and guidance on spine sparing techniques should be provided. The objectives of this study were to establish expert consensus on key questions posed by patients or health care providers regarding recommended assessment domains to inform exercise prescription, therapeutic goals of exercise, and physical activity and exercise recommendations for individuals with osteoporosis or osteoporotic vertebral fracture. The Too Fit To Fracture expert panel identified researchers and clinicians with expertise in exercise and osteoporosis and stakeholder groups. We delivered a modified online Delphi survey (two rounds) to establish consensus on assessment, exercise, and physical activities for three cases with varying risk (osteoporosis based on bone mineral density; 1 spine fracture and osteoporosis; multiple spine fractures, osteoporosis, hyperkyphosis, and pain). Duplicate content analyses of free text responses were performed. Response rates were 52% (39/75) and 69% (48/70) for each round. Key consensus points are the following: (a) Current physical activity guidelines are appropriate for individuals with osteoporosis without spine fracture, but not for those with spine fracture; (b) after spine fracture, physical activity of moderate intensity is preferred to vigorous; (c) daily balance training and endurance training for spinal extensor muscles are recommended for all; (d) providing guidance on spine-sparing techniques (e.g., hip hinge) during activities of daily living or leisure, considering impairments, fracture risk, activity history, and preference, is recommended rather than providing generic restrictions (e.g., lifting <10 lbs, no twisting), but for those with vertebral fracture, especially in the presence of pain, multiple fractures, or hyperkyphosis, the risks of many activities may outweigh the benefits-physical therapist consultation is recommended. Examples of spine-sparing techniques and exercise prescription elements are provided. Our recommendations guide health care providers on assessment, exercise prescription, and safe movement for individuals with osteoporosis.