Identifying Psychological Contract Breaches to Guide Improvements in Faculty Recruitment, Retention, and Development

PubMed Central

Desselle, Shane P.; Draugalis, JoLaine R.; Spies, Alan R.; Davis, Tamra S.; Bolino, Mark

2012-01-01

Objective. To identify pharmacy faculty members’ perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. Methods. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Results. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. Conclusion. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development. PMID:22919084

Identifying psychological contract breaches to guide improvements in faculty recruitment, retention, and development.

PubMed

Peirce, Gretchen L; Desselle, Shane P; Draugalis, JoLaine R; Spies, Alan R; Davis, Tamra S; Bolino, Mark

2012-08-10

To identify pharmacy faculty members' perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development.

A modified Delphi method toward multidisciplinary consensus on functional convalescence recommendations after abdominal surgery.

PubMed

van Vliet, Daphne C R; van der Meij, Eva; Bouwsma, Esther V A; Vonk Noordegraaf, Antonie; van den Heuvel, Baukje; Meijerink, Wilhelmus J H J; van Baal, W Marchien; Huirne, Judith A F; Anema, Johannes R

2016-12-01

Evidence-based information on the resumption of daily activities following uncomplicated abdominal surgery is scarce and not yet standardized in medical guidelines. As a consequence, convalescence recommendations are generally not provided after surgery, leading to patients' insecurity, needlessly delayed recovery and prolonged sick leave. The aim of this study was to generate consensus-based multidisciplinary convalescence recommendations, including advice on return to work, applicable for both patients and physicians. Using a modified Delphi method among a multidisciplinary panel of 13 experts consisting of surgeons, occupational physicians and general practitioners, detailed recommendations were developed for graded resumption of 34 activities after uncomplicated laparoscopic cholecystectomy, laparoscopic and open appendectomy, laparoscopic and open colectomy and laparoscopic and open inguinal hernia repair. A sample of occupational physicians, general practitioners and surgeons assessed the recommendations on feasibility in daily practice. The response of this group of care providers was discussed with the experts in the final Delphi questionnaire round. Out of initially 56 activities, the expert panel selected 34 relevant activities for which convalescence recommendations were developed. After four Delphi rounds, consensus was reached for all of the 34 activities for all the surgical procedures. A sample of occupational physicians, general practitioners and surgeons regarded the recommendations as feasible in daily practice. Multidisciplinary convalescence recommendations regarding uncomplicated laparoscopic cholecystectomy, appendectomy (laparoscopic, open), colectomy (laparoscopic, open) and inguinal hernia repair (laparoscopic, open) were developed by a modified Delphi procedure. Further research is required to evaluate whether these recommendations are realistic and effective in daily practice.

Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS)

PubMed Central

Downes, Martin J; Brennan, Marnie L; Williams, Hywel C; Dean, Rachel S

2016-01-01

Objectives The aim of this study was to develop a critical appraisal (CA) tool that addressed study design and reporting quality as well as the risk of bias in cross-sectional studies (CSSs). In addition, the aim was to produce a help document to guide the non-expert user through the tool. Design An initial scoping review of the published literature and key epidemiological texts was undertaken prior to the formation of a Delphi panel to establish key components for a CA tool for CSSs. A consensus of 80% was required from the Delphi panel for any component to be included in the final tool. Results An initial list of 39 components was identified through examination of existing resources. An international Delphi panel of 18 medical and veterinary experts was established. After 3 rounds of the Delphi process, the Appraisal tool for Cross-Sectional Studies (AXIS tool) was developed by consensus and consisted of 20 components. A detailed explanatory document was also developed with the tool, giving expanded explanation of each question and providing simple interpretations and examples of the epidemiological concepts being examined in each question to aid non-expert users. Conclusions CA of the literature is a vital step in evidence synthesis and therefore evidence-based decision-making in a number of different disciplines. The AXIS tool is therefore unique and was developed in a way that it can be used across disciplines to aid the inclusion of CSSs in systematic reviews, guidelines and clinical decision-making. PMID:27932337

Developing the E-Delphi System: A Web-Based Forecasting Tool for Educational Research.

ERIC Educational Resources Information Center

Chou, Chien

2002-01-01

Discusses use of the Delphi technique and describes the development of an electronic version, called e-Delphi, in which questionnaire construction and communication with panel members was accomplished using the Web. Explains system function and interface and discusses evaluation of the e-Delphi system. (Author/LRW)

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.

PubMed

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

The development of a core syllabus for the teaching of oral anatomy, histology, and embryology to dental students via an international 'Delphi Panel'.

PubMed

Moxham, Bernard John; McHanwell, Stephen; Berkovitz, Barry

2018-03-01

The formulation of core syllabuses for the biomedical sciences within medical and dental courses is partially driven by the need to cope with decreased time allocations for these subjects as a result of major curricular changes taking place worldwide. There is also a requirement to deal with the request for increased clinical relevance. In response to such demands, the International Federation of Associations of Anatomists (IFAA) is devising core syllabuses for the anatomical sciences relating to the education and training of both scientific and clinical professions. The process initially involves using Delphi Panels consisting of a team of anatomists, scientists, and clinicians who evaluate syllabus content in detail and accord each element/topic 'essential,' 'important,' 'acceptable,' or 'not required' status. Their conjectures, published on the IFAA website, provide merely a framework to enable other stakeholders to comment. The approach is international in scope, is conceptually 'democratic,' and is developmentally fluid in being readily available for amendment. The aim is to set internationally recognized standards and thus to provide guidelines concerning anatomical knowledge when engaged in course development. This article presents the deliberations of an IFAA Delphi Panel into a core syllabus for oral anatomy, histology, and embryology within the dental curriculum. Clin. Anat. 31:231-249, 2018. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology.

PubMed

Melchiors, Jacob; Henriksen, Mikael Johannes Vuokko; Dikkers, Frederik G; Gavilán, Javier; Noordzij, J Pieter; Fried, Marvin P; Novakovic, Daniel; Fagan, Johannes; Charabi, Birgitte W; Konge, Lars; von Buchwald, Christian

2018-05-01

Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis. We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool. FIFTY PANELISTS COMPLETED THE DELPHI PROCESS. THE MEDIAN AGE OF THE PANELISTS WAS 44 YEARS (RANGE 33-64 YEARS). MEDIAN EXPERIENCE IN OTORHINOLARYNGOLOGY WAS 15 YEARS (RANGE 6-35 YEARS). TWENTY-FIVE WERE SPECIALIZED IN LARYNGOLOGY, 16 WERE HEAD AND NECK SURGEONS, AND NINE WERE GENERAL OTORHINOLARYNGOLOGISTS. AN ASSESSMENT TOOL WAS CREATED CONSISTING OF TWELVE DISTINCT ITEMS.: Conclusion The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.

Competency-based tool for evaluation of community-based training in undergraduate medical education in India - a Delphi approach.

PubMed

Shewade, Hemant Deepak; Jeyashree, Kathiresan; Kalaiselvi, Selvaraj; Palanivel, Chinnakali; Panigrahi, Krishna Chandra

2017-01-01

A community-based training (CBT) program, where teaching and training are carried out in the community outside of the teaching hospital, is a vital part of undergraduate medical education. Worldwide, there is a shift to competency-based training, and CBT is no exception. We attempted to develop a tool that uses a competency-based approach for assessment of CBT. Based on a review on competencies, we prepared a preliminary list of major domains with items under each domain. We used the Delphi technique to arrive at a consensus on this assessment tool. The Delphi panel consisted of eight purposively selected experts from the field of community medicine. The panel rated each item for its relevance, sensitivity, specificity, and understandability on a scale of 0-4. Median ratings were calculated at the end of each round and shared with the panel. Consensus was predefined as when 70% of the experts gave a rating of 3 or above for an item under relevance, sensitivity, and specificity. If an item failed to achieve consensus after being rated in 2 consecutive rounds, it was excluded. Anonymity of responses was maintained. The panel arrived at a consensus at the end of 3 rounds. The final version of the self-assessment tool consisted of 7 domains and 74 items. The domains (number of items) were Public health - epidemiology and research methodology (13), Public health - biostatistics (6), Public health administration at primary health center level (17), Family medicine (24), Cultural competencies (3), Community development and advocacy (2), and Generic competence (9). Each item was given a maximum score of 5 and minimum score of 1. This is the first study worldwide to develop a tool for competency-based evaluation of CBT in undergraduate medical education. The competencies identified in the 74-item questionnaire may provide the base for development of authentic curricula for CBT.

Contemporary management of paraesophaegeal hernias: establishing a European expert consensus.

PubMed

Bonrath, E M; Grantcharov, T P

2015-08-01

The surgical treatment of paraesophageal hernias remains a challenge due to the lack of consensus regarding principles of operative treatment. The objectives of this study were to achieve consensus on key topics through expert opinion using a Delphi methodology. A Delphi survey combined with a face-to-face meeting was conducted. A panel of European experts in foregut surgery from high-volume centres generated items in the first survey round. In subsequent rounds, the panel rated agreement with statements on a 5-point Likert-type scale. Internal consistency (consensus) was predefined as Cronbach's α > .80. Items that >70 % of the panel either rated as irrelevant/unimportant, or relevant/important were selected as consensus items, while topics that did not reach this cut-off were termed "undecided/controversial". Three survey rounds were completed: 19 experts from 10 countries completed round one, 18 continued through rounds two and three. Internal consistency was high in rounds two and three (α > .90). Fifty-eight additional/revised items derived from comments and free-text entries were included in round three. In total, 118 items were rated; consensus agreement was achieved for 70 of these. Examples of consensus topics are the relevance of the disease profile for assessing surgical urgency and complexity, the role of clinical history as the mainstay of patient follow-up, indications for revision surgery, and training and credentialing recommendations. Topics with the most "undecided/controversial" items were follow-up, postoperative care and surgical technique. This Delphi study achieved expert consensus on key topics in the operative management of paraesophageal hernias, providing an overview of the current opinion among European foregut surgeons. Moreover, areas with substantial variability in opinions were identified reflecting the current lack of empirical evidence and opportunities for future research.

A Delphi approach to developing a core competency framework for family practice registered nurses in Ontario.

PubMed

Moaveni, Azadeh; Gallinaro, Anna; Conn, Lesley Gotlib; Callahan, Sheilagh; Hammond, Melanie; Oandasan, Ivy

2010-12-01

This paper describes the results of a Delphi panel process to gain consensus on a role description and competency framework for family practice registered nurses (FP-RNs) in Ontario. Based on the findings from interviews and focus groups with family practice registered nurses and their inter-professional colleagues throughout Ontario, a core competency framework for FP-RNs emerged consisting of six distinct roles - Professional, Expert, Communicator, Synergist, Health Educator and Lifelong Learner - with accompanying enabling competency statements. This framework was refined and validated by a panel of experts from various nursing and family medicine associations and organizations through a Delphi consensus process. This core competency framework for FP-RNs was developed as a stepping stone for clarifying this very important and poorly understood role in family practice. As a result of this research, we expect a greater acknowledgement of the contributions and expertise of the FP-RN as well as the need to celebrate and profile this role. This work has already led to the establishment of a network of stakeholders from nursing organizations in Ontario who are considering opportunities to move the development and use of the competency framework forward.

Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure

PubMed Central

2013-01-01

Background The quantity and quality of studies in child and adolescent physical activity and sedentary behaviour have rapidly increased, but research directions are often pursued in a reactive and uncoordinated manner. Aim To arrive at an international consensus on research priorities in the area of child and adolescent physical activity and sedentary behaviour. Methods Two independent panels, each consisting of 12 experts, undertook three rounds of a Delphi methodology. The Delphi methodology required experts to anonymously answer questions put forward by the researchers with feedback provided between each round. Results The primary outcome of the study was a ranked set of 29 research priorities that aimed to be applicable for the next 10 years. The top three ranked priorities were: developing effective and sustainable interventions to increase children’s physical activity long-term; policy and/or environmental change and their influence on children’s physical activity and sedentary behaviour; and prospective, longitudinal studies of the independent effects of physical activity and sedentary behaviour on health. Conclusions These research priorities can help to guide decisions on future research directions. PMID:24228891

Application of Delphi expert panel in joint venture projects

NASA Astrophysics Data System (ADS)

Adnan, H.; Rosman, M. R.; Rashid, Z. Z. Ahmad; Mohamad Yusuwan, N.; Bakhary, N. A.

2018-02-01

This study was conducted with the aim to identify the application of the Delphi Technique in validating findings obtained from questionnaire surveys and interviews done in- depth on the subject of joint venture projects in Malaysia. The Delphi technique aims to achieve a consensus of opinion amongst expert panellist that were selected on the primary factors in JV projects. To achieve research objectives, a progressive series of questions was designed where a selected panel of expert to confirm and validate the final findings. The rationale, benefits, limitations and recommendations for the use of Delphi were given in this study. From the literature review done, twenty-one factors were identified as critical factors to the making any joint venture project successful. Detail information from contractors were obtained by using the questionnaire survey method and forty-three in-depth interviews were carried out. Trust between partners, mutual understanding, partner selection criteria, agreement of contract, objective compatibility, conflict, and commitment were confirmed by the Delphi panel to be the critical success factors besides another fourteen factors which were found to be the Failure Reduction Criteria. Delphi techniques has proven to successfully assist in recognising the main factors and would be beneficial in supplementing the success of joint venture arrangements application for construction projects in Malaysia.

Issues and Needs in Rural Early Childhood Special Education Services in Florida: A Delphi Study.

ERIC Educational Resources Information Center

Weiss, Keith E.; Correa, Vivian I.

A Delphi Technique was used to examine the problems of early childhood special education programs in rural Florida. Two rounds of questionnaires were completed by a panel of early childhood special education administrators and teachers from 14 of Florida's 27 rural counties. In response to the questionnaires, the panel developed 51 problem-related…

STOPP/START Medication Criteria Modified for US Nursing Home Setting

PubMed Central

Khodyakov, Dmitry; Ochoa, Aileen; Olivieri-Mui, Brianne L.; Bouwmeester, Carla; Zarowitz, Barbara J.; Patel, Meenakshi; Ching, Diana; Briesacher, Becky

2016-01-01

STRUCTURED ABSTRACT BACKGROUND/OBJECTIVES A barrier to assessing the quality of prescribing in nursing homes (NH) is the lack of explicit criteria for this setting. Our objective was to develop a set of prescribing indicators measurable with available data from electronic nursing home databases by adapting the European-based 2014 STOPP/START criteria of potentially inappropriate and underused medications for the US setting. DESIGN A two-stage expert panel process. In first stage, investigator team reviewed 114 criteria for compatibility and measurability. In second stage, we convened an online modified e-Delphi (OMD) panel to rate the validity of criteria and two webinars to identify criteria with highest relevance to US NHs. PARTICIPANTS Seventeen experts with recognized reputations in NH care participated in the e-Delphi panel and 12 in the webinar. MEASUREMENTS Compatibility and measurability were assessed by comparing criteria to US terminology/setting standards and data elements in NH databases. Validity was rated with a 9-point Likert-type scale (1=not valid at all, 9=highly valid). Mean, median, interpercentile ranges, and agreement were determined for each criterion score. Relevance was determined by ranking the mean panel ratings on criteria that reached agreement; half of the criteria with the highest mean values were reviewed and approved by the webinar participants. RESULTS Fifty-three STOPP/START criteria were deemed as compatible with US setting and measurable using data from electronic NH databases. E-Delphi panelists rated 48 criteria as valid for US NHs. Twenty-four criteria were deemed as most relevant, consisting of 22 measures of potentially inappropriate medications and 2 measures of underused medications. CONCLUSION This study created the first explicit criteria for assessing the quality of prescribing in US NHs. PMID:28008599

The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study.

PubMed

Mokkink, Lidwine B; Terwee, Caroline B; Patrick, Donald L; Alonso, Jordi; Stratford, Paul W; Knol, Dirk L; Bouter, Lex M; de Vet, Henrica C W

2010-05-01

Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement properties. We present the COSMIN checklist and the agreement of the panel on the items of the checklist. A four-round Delphi study was performed with international experts (psychologists, epidemiologists, statisticians and clinicians). Of the 91 invited experts, 57 agreed to participate (63%). Panel members were asked to rate their (dis)agreement with each proposal on a five-point scale. Consensus was considered to be reached when at least 67% of the panel members indicated 'agree' or 'strongly agree'. Consensus was reached on the inclusion of the following measurement properties: internal consistency, reliability, measurement error, content validity (including face validity), construct validity (including structural validity, hypotheses testing and cross-cultural validity), criterion validity, responsiveness, and interpretability. The latter was not considered a measurement property. The panel also reached consensus on how these properties should be assessed. The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational purposes.

African American Faculty Expressing Concerns: Breaking the Silence at Predominantly White Research Oriented Universities

ERIC Educational Resources Information Center

Ross, Henry H.; Edwards, Willie J.

2016-01-01

A Delphi method was used with a panel of 24 African American faculty employed at 43 predominantly white doctoral extensive universities to arrive at a group consensus on a list of concerns that African American faculty in general experienced or held. Using the Delphi method a panel of African American faculty initially worked from a list of eight…

A Modified Delphi to Identify the Significant Works Pertaining to the Understanding of Reading Comprehension and Content Analysis of the Identified Works

ERIC Educational Resources Information Center

Zunker, Norma D.; Pearce, Daniel L.

2012-01-01

The first part of this study explored the significant works pertaining to the understanding of reading comprehension using a Modified Delphi Method. A panel of reading comprehension experts identified 19 works they considered to be significant to the understanding of reading comprehension. The panel of experts identified the reasons they…

Evaluation Criteria for Interactive E-Books for Open and Distance Learning

ERIC Educational Resources Information Center

Bozkurt, Aras; Bozkaya, Mujgan

2015-01-01

The aim of this mixed method study is to identify evaluation criteria for interactive e-books. To find answers for the research questions of the study, both quantitative and qualitative data were collected through a four-round Delphi study with a panel consisting of 30 experts. After that, a total of 20 interactive e-books were examined with…

Defining the Key Competencies in Radiation Protection for Endovascular Procedures: A Multispecialty Delphi Consensus Study.

PubMed

Doyen, Bart; Maurel, Blandine; Cole, Jonathan; Maertens, Heidi; Mastracci, Tara; Van Herzeele, Isabelle

2018-02-01

Radiation protection training courses currently focus on broad knowledge topics which may not always be relevant in daily practice. The goal of this study was to determine the key competencies in radiation protection that every endovascular team member should possess and apply routinely, through multispecialty clinical content expert consensus. Consensus was obtained through a two round modified Delphi methodology. The expert panel consisted of European vascular surgeons, interventional radiologists, and interventional cardiologists/angiologists experienced in endovascular procedures. An initial list of statements, covering knowledge skills, technical skills and attitudes was created, based on a literature search. Additional statements could be suggested by the experts in the first Delphi round. Each of the statements had to be rated on a 5- point Likert scale. A statement was considered to be a key competency when the internal consistency was greater than alpha = 0.80 and at least 80% of the experts agreed (rating 4/5) or strongly agreed (rating 5/5) with the statement. Questionnaires were emailed to panel members using the Surveymonkey service. Forty-one of 65 (63.1%) invited experts agreed to participate in the study. The response rates were 36 out of 41 (87.8%): overall 38 out of 41(92.6%) in the first round and 36 out of 38 (94.7%) in the second round. The 71 primary statements were supplemented with nine items suggested by the panel. The results showed excellent consensus among responders (Cronbach's alpha = 0.937 first round; 0.958 s round). Experts achieved a consensus that 30 of 33 knowledge skills (90.9%), 23 of 27 technical skills (82.1%), and 15 of 20 attitudes (75.0%) should be considered as key competencies. A multispecialty European endovascular expert panel reached consensus about the key competencies in radiation protection. These results may serve to create practical and relevant radiation protection training courses in the future, enhancing radiation safety for both patients and the entire endovascular team. Copyright © 2017 European Society for Vascular Surgery. All rights reserved.

How do stakeholder groups vary in a Delphi technique about primary mental health care and what factors influence their ratings?

PubMed

Campbell, S M; Shield, T; Rogers, A; Gask, L

2004-12-01

While mental health is a core part of primary care, there are few validated quality measures and little relevant internationally published research. Consensus panel methods are a useful means of developing quality measures where evidence is sparse and/or opinions are diverse. However, little is known about the dynamics of consensus techniques and the factors that influence the judgements and ratings of panels and individual panelists. (1) To describe differences in panel ratings on the quality of primary mental health care services by patient, carer, professional and managerial panels within a Delphi procedure; and (2) to explore why different panels and panelists rate quality indicators of primary mental health care differently. Two round postal Delphi technique and exploratory semi-structured interviews. 115 panelists across 11 panels. Eleven panelists were subsequently interviewed. 87 of 334 indicators (26%) were rated face valid by all 11 panels. There was little disagreement within panel ratings but significant differences between panels. The GP panel rated the least number of indicators valid (n = 138, 41%) and carers the most (n = 304, 91%). The way in which panelists interpreted and conceptualised the indicators and their definition of quality of mental health care affected the way in which participants made their ratings. Stakeholders in primary mental health care have diverse views of quality of care and these differences translate into how they rate quality indicators. Exploratory interviews suggest that ratings are influenced by past experience, expectations, definitions of quality of care, and perceived power relationships between stakeholders.

Anatomical Society core regional anatomy syllabus for undergraduate medicine: the Delphi process.

PubMed

Smith, C F; Finn, G M; Stewart, J; McHanwell, S

2016-01-01

A modified Delphi method was employed to seek consensus when revising the UK and Ireland's core syllabus for regional anatomy in undergraduate medicine. A Delphi panel was constructed involving 'expert' (individuals with at least 5 years' experience in teaching medical students anatomy at the level required for graduation). The panel (n = 39) was selected and nominated by members of Council and/or the Education Committee of the Anatomical Society and included a range of specialists including surgeons, radiologists and anatomists. The experts were asked in two stages to 'accept', 'reject' or 'modify' (first stage only) each learning outcome. A third stage, which was not part of the Delphi method, then allowed the original authors of the syllabus to make changes either to correct any anatomical errors or to make minor syntax changes. From the original syllabus of 182 learning outcomes, removing the neuroanatomy component (163), 23 learning outcomes (15%) remained unchanged, seven learning outcomes were removed and two new learning outcomes added. The remaining 133 learning outcomes were modified. All learning outcomes on the new core syllabus achieved over 90% acceptance by the panel. © 2015 Anatomical Society.

Concepts and Contexts in Engineering and Technology Education: An International and Interdisciplinary Delphi Study

ERIC Educational Resources Information Center

Rossouw, Ammeret; Hacker, Michael; de Vries, Marc J.

2011-01-01

Inspired by a similar study by Osborne et al. we have conducted a Delphi study among experts to identify key concepts to be taught in engineering and technology education and relevant and meaningful contexts through which these concepts can be taught and learnt. By submitting the outcomes of the Delphi study to a panel of experts in a two-day…

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

Habitat suitability index curves for paddlefish, developed by the delphi technique

USGS Publications Warehouse

Crance, John H.

1987-01-01

A Delphi exercise conducted with a panel of 11 experts on paddlefish (Polyodon spathula) and an evaluator resulted in 14 riverine habitat suitability index curves associating various life stages or activities of paddlefish with four variables: velocity, depth, substrate type, and temperature. The panel reached a consensus on six of the curves and eight to 10 panelists agreed on the others. Several panelists reported that they found the Delphi exercise to be a good learning experience, and they believed the technique is an appropriate interim method for developing suitability index curves when available data are inadequate for more conventional statistical analyses. Documentation of good paddlefish spawning habitat was the data need most commonly identified by the panelists.

Considerations for Domestic Law Enforcement Implementation of a UAS Program in the Proposed FAA Regulatory Environment of Integration into the National Airspace System

DTIC Science & Technology

2015-12-01

institutional review board (IRB)-approved sequence was established for Delphi panel participants. The collection of data from the Delphi panel...The following year, the Office of the Inspector General Audit Division within the U.S. Department of Justice (DOJ) released an interim report on the...iacp_uaguidelines.pdf 11 Department of Justice, Office of the Inspector General, Audit Division, Interim Report on the Department of Justice’s Use and Support of

Devising a consensus definition and framework for non-technical skills in healthcare to support educational design: A modified Delphi study.

PubMed

Gordon, Morris; Baker, Paul; Catchpole, Ken; Darbyshire, Daniel; Schocken, Dawn

2015-01-01

Non-technical skills are a subset of human factors that focus on the individual and promote safety through teamwork and awareness. There is no widely adopted competency- or outcome-based framework for non-technical skills training in healthcare. The authors set out to devise such a framework using a modified Delphi approach. An exhaustive list of published and team suggested items was presented to the expert panel for ranking and to propose a definition. In the second round, a focused list was presented, as well as the proposed definition elements. The finalised framework was sent to the panel for review. Sixteen experts participated. The final framework consists of 16 competencies for all and eight specific competencies for team leaders. The consensus definition describes non-technical skills as "a set of social (communication and team work) and cognitive (analytical and personal behaviour) skills that support high quality, safe, effective and efficient inter-professional care within the complex healthcare system". The authors have produced a new competency framework, through the works of an International expert panel, which is not discipline specific that can be used by curriculum developers, educational innovators and clinical teachers to support developments in the field.

Assessing risk factors for early hip osteoarthritis in activity-related hip pain: a Delphi study

PubMed Central

Jackson, K A; Glyn-Jones, S; Batt, M E; Arden, N K; Newton, J L

2015-01-01

Objective Hip pain and injury as a result of activity can lead to the development of early hip osteoarthritis (OA) in susceptible individuals. Our understanding of the factors that increase susceptibility continues to evolve. The ability to clearly identify individuals (and cohorts) with activity-related hip pain who are at risk of early hip OA is currently lacking. The purpose of this study was to gain expert consensus on which key clinical measures might help predict the risk of early hip OA in individuals presenting with activity-related hip pain. The agreed measures would constitute a standardised approach to initial clinical assessment to help identify these individuals. Methods This Dephi study used online surveys to gain concordance of expert opinion in a structured process of ‘rounds’. In this study, we asked ‘What outcome measures are useful in predicting hip OA in activity-related hip pain?’ The Delphi panel consisted of experts from sport and exercise medicine, orthopaedics, rheumatology, physiotherapy and OA research. Results The study identified key clinical measures in the history, examination and investigations (plain anteroposterior radiograph and femoroacetabular impingement views) that the panel agreed would be useful in predicting future risk of hip OA when assessing activity-related hip pain. The panel also agreed that certain investigations and tests (eg, MR angiography) did not currently have a role in routine assessment. There was a lack of consensus regarding the role of MRI, patient-reported outcome measures (PROMs) and certain biomechanical and functional assessments. Conclusions We provide a standardised approach to the clinical assessment of patients with activity-related hip pain. Assessment measures rejected by the Delphi panel were newer, more expensive investigations that currently lack evidence. Assessment measures that did not reach consensus include MRI and PROMs. Their role remains ambiguous and would benefit from further research. PMID:26419679

Supporting the Evaluation and Implementation of Musculoskeletal Models of Care: A Globally Informed Framework for Judging Readiness and Success.

PubMed

Briggs, Andrew M; Jordan, Joanne E; Jennings, Matthew; Speerin, Robyn; Bragge, Peter; Chua, Jason; Woolf, Anthony D; Slater, Helen

2017-04-01

To develop a globally informed framework to evaluate readiness for implementation and success after implementation of musculoskeletal models of care (MOCs). Three phases were undertaken: 1) a qualitative study with 27 Australian subject matter experts (SMEs) to develop a draft framework; 2) an eDelphi study with an international panel of 93 SMEs across 30 nations to evaluate face validity, and refine and establish consensus on the framework components; and 3) translation of the framework into a user-focused resource and evaluation of its acceptability with the eDelphi panel. A comprehensive evaluation framework was developed for judging the readiness and success of musculoskeletal MOCs. The framework consists of 9 domains, with each domain containing a number of themes underpinned by detailed elements. In the first Delphi round, scores of "partly agree" or "completely agree" with the draft framework ranged 96.7%-100%. In the second round, "essential" scores ranged 58.6%-98.9%, resulting in 14 of 34 themes being classified as essential. SMEs strongly agreed or agreed that the final framework was useful (98.8%), usable (95.1%), credible (100%) and appealing (93.9%). Overall, 96.3% strongly supported or supported the final structure of the framework as it was presented, while 100%, 96.3%, and 100% strongly supported or supported the content within the readiness, initiating implementation, and success streams, respectively. An empirically derived framework to evaluate the readiness and success of musculoskeletal MOCs was strongly supported by an international panel of SMEs. The framework provides an important internationally applicable benchmark for the development, implementation, and evaluation of musculoskeletal MOCs. © 2016, American College of Rheumatology.

A core syllabus for the teaching of neuroanatomy to medical students.

PubMed

Moxham, Bernard; McHanwell, Stephen; Plaisant, Odile; Pais, Diogo

2015-09-01

There is increasingly a call for clinical relevance in the teaching of biomedical sciences within all health care courses. However, this presupposes that there is a clear understanding of what can be considered core material within the curricula. To date, the anatomical sciences have been relatively poorly served by the development of core syllabuses, particularly for specialized core syllabuses such as neuroanatomy. One of the aims of the International Federation of Associations of Anatomists (IFAA) and of the European Federation for Experimental Morphology (EFEM) is to formulate, on an international scale, core syllabuses for all branches of the anatomical sciences using Delphi Panels consisting of anatomists, scientists, and clinicians to initially evaluate syllabus content. In this article, the findings of a Delphi Panel for neuroanatomy are provided. These findings will subsequently be published on the IFAA website to enable anatomical (and other cognate learned) societies and individual anatomists, clinicians, and students to freely comment upon, and elaborate and amend, the syllabuses. The aim is to set internationally recognized standards and thus to provide guidelines concerning neuroanatomical knowledge when engaged in course development. © 2015 Wiley Periodicals, Inc.

Core competencies for emergency medicine clerkships: results of a Canadian consensus initiative.

PubMed

Penciner, Rick; Woods, Robert A; McEwen, Jill; Lee, Richard; Langhan, Trevor; Bandiera, Glen

2013-01-01

There is no consensus on what constitutes the core competencies for emergency medicine (EM) clerkship rotations in Canada. Existing EM curricula have been developed through informal consensus and often focus on EM content to be known at the end of training rather than what is an appropriate focus for a time-limited rotation in EM. We sought to define the core competencies for EM clerkship in Canada through consensus among an expert panel of Canadian EM educators. We used a modified Delphi method and the CanMEDS 2005 Physician Competency Framework to develop a consensus among expert EM educators from across Canada. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). A complete list of competencies is provided. This study established a national consensus defining the core competencies for EM clerkship in Canada.

Curricular priorities for business ethics in medical practice and research: recommendations from Delphi consensus panels.

PubMed

DuBois, James M; Kraus, Elena M; Gursahani, Kamal; Mikulec, Anthony; Bakanas, Erin

2014-11-15

No published curricula in the area of medical business ethics exist. This is surprising given that physicians wrestle daily with business decisions and that professional associations, the Institute of Medicine, Health and Human Services, Congress, and industry have issued related guidelines over the past 5 years. To fill this gap, the authors aimed (1) to identify the full range of medical business ethics topics that experts consider important to teach, and (2) to establish curricular priorities through expert consensus. In spring 2012, the authors conducted an online Delphi survey with two heterogeneous panels of experts recruited in the United States. One panel focused on business ethics in medical practice (n = 14), and 1 focused on business ethics in medical research (n = 12). Panel 1 generated an initial list of 14 major topics related to business ethics in medical practice, and subsequently rated 6 topics as very important or essential to teach. Panel 2 generated an initial list of 10 major topics related to business ethics in medical research, and subsequently rated 5 as very important or essential. In both domains, the panel strongly recommended addressing problems that conflicts of interest can cause, legal guidelines, and the goals or ideals of the profession. The Bander Center for Medical Business Ethics at Saint Louis University will use the results of the Delphi panel to develop online curricular resources for each of the highest rated topics.

Risk for suicide and risk for violence: a case for separating the current violence diagnoses.

PubMed

Smith, J E; Early, J A; Green, P T; Lauck, D L; Oblaczynski, C; Smochek, M R; Wright, G

1997-01-01

To identify accurate descriptive terms for risk for violence and risk for suicide and to provide operational definitions for these terms The Delphi technique, with two rounds, was used to differentiate the operational definitions that represent risk for suicide from those that represent risk for violence. The expert panel consisted of 23 healthcare professionals with a minimum of a master's degree. In addition to the expert panel, a control group (N = 11) participated to assess content validity. Thirty-six definitions were agreed upon for suicide, 39 for violence. These definitions represent the basic distinctions between the two behavioral manifestations.

Development of post-disaster psychosocial evaluation and intervention for children: Results of a South Korean delphi panel survey

PubMed Central

Lee, Mi-Sun; Hwang, Jun-Won; Lee, Cheol-Soon; Kim, Ji-Youn; Lee, Ju-Hyun; Kim, Eunji; Chang, Hyoung Yoon; Bae, SeungMin; Park, Jang-Ho

2018-01-01

Objective This study aimed to administer a Delphi panel survey and provide evidence for the development of a psychological intervention protocol for use after disasters in South Korea. Method A three-round Delphi survey was conducted. In all rounds, respondents answered open- or closed-ended questions regarding their views on i) the concept of disaster, ii) evaluation, iii) intervention, and iv) considerations in a disaster. Data from Round 1 were subjected to content analysis. In Round 2, items with content validity ratios (CVRs) greater than 0.49 were included, and in Round 3, items with a CVR≥0.38 were accepted. Results The response rates for the Delphi survey were high: 83% (n = 15, Round 1), 80% (n = 16, Round 2), and 86% (n = 24, Round 3). The data collected during this survey showed a need for a support system for children; for preventive strategies, including disaster readiness plans; for the protection of children's safety; and for the development of post-disaster psychosocial care. Conclusions The panel experts reached a consensus regarding the steps they considered critical in post-disaster evaluation and intervention. The findings suggest a unified model for advancing the development of the Korean version of an intervention protocol for children and adolescents exposed to traumatic events. PMID:29596483

Identifying Critical Issues and Problems in Technology Education Using a Modified-Delphi Technique.

ERIC Educational Resources Information Center

Wicklein, Robert C.

1993-01-01

Critical issues for technology education (TE) identified by a 25-member Delphi panel were identification of the knowledge base, curriculum development approaches, interdisciplinary approaches, and teacher education reform. Problems identified included inadequate marketing/public relations, teacher shortage, lack of content consensus, and…

Legislative priorities for transportation safety in Virginia : a pilot application of a modified delphi technique : final report.

DOT National Transportation Integrated Search

1985-01-01

Using a modified version of the Delphi technique, a panel of transportation safety experts developed the following list of legislative priorities for submission to the Department of Motor Vehicles (DMV) Legislative Package for the 1986 session of the...

Competencies for Leaders of Volunteers During the Next Decade: A National Delphi Study.

ERIC Educational Resources Information Center

Boyd, Barry L.

Using the Delphi technique, a nationwide panel of experts identified 33 competencies that volunteer administrators (VAs) will need during the next decade and categorized them into these five constructs: organizational leadership; systems leadership; organizational culture; personal skills; and management skills. Twelve barriers to acquiring the…

Updating the School Counseling Research Agenda: A Delphi Study

ERIC Educational Resources Information Center

Villares, Elizabeth; Dimmitt, Carey

2017-01-01

The authors updated an earlier Delphi study identifying the research priorities for school counseling (Dimmitt et al., 2005). A 29-member expert panel selected research questions from the prior study, generated new questions, and rank ordered the combined set. The results provide guidance for prioritizing dissertation topics, targeting future…

Identifying Competencies for Volunteer Administrators for the Coming Decade: A National Delphi Study.

ERIC Educational Resources Information Center

Boyd, Barry L.

2003-01-01

A Delphi panel of 13 experts categorized 33 competencies for volunteer administration into 5 constructs: organizational leadership, systems leadership, organizational culture, personal skills, and management skills. Twelve barriers to acquiring competencies and 21 methods to address them were identified. (Contains 24 references.) (SK)

A Delphi Study and Initial Validation of Counselor Supervision Competencies

ERIC Educational Resources Information Center

Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

2016-01-01

The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

Effective self-management strategies for bipolar disorder: A community-engaged Delphi Consensus Consultation study.

PubMed

Michalak, Erin E; Suto, Melinda J; Barnes, Steven J; Hou, Sharon; Lapsley, Sara; Scott, Mike W; Murray, Greg; Austin, Jehannine; Elliott, Nusha Balram; Berk, Lesley; Crest Bd

2016-12-01

Self-management represents an important complement to psychosocial treatments for bipolar disorder (BD), but research is limited. Specifically, little is known about self-management approaches for elevated mood states; this study investigated self-management strategies for: (1) maintaining balance in mood, and (2) stopping progression into hypomania/mania. To identify the common components of BD self-management, Delphi Consensus Consultation methods were combined with a Community-Based Participatory Research (CBPR) approach across five study phases: (1) Qualitative dataset content analysis; (2) Academic/grey literature reviews; (3) Content analysis; (4) Two Delphi rounds (rating strategies on a 5-point Likert scale, Very Unhelpful-Very Helpful), and; (5) Quantitative analysis and interpretation. Participants were people with BD and healthcare providers. Phases 1 and 2 identified 262 and 3940 candidate strategies, respectively; 3709 were discarded as duplicates/unintelligible. The remaining 493 were assessed via Delphi methods in Phase 4: 101 people with BD and 52 healthcare providers participated in Round 1; 83 of the BD panel (82%) and 43 of the healthcare provider panel (83%) participated in Round 2-exploratory factor analysis (EFA) was conducted on Round 2 results. EFA was underpowered and sample was not ethnically diverse, limiting generalizability. High concordance was observed in ratings of strategy effectiveness between the two panels. Future research could usefully investigate the provisional discovery here of underlying factors which link individual strategies. For example, 'maintaining hope' underpinned strategies for maintaining balance, and 'decreasing use of stimulants' underpinned strategies to interrupt hypo/manic ascent. There is merit in combining CBPR and Delphi methods. Copyright © 2016 Elsevier B.V. All rights reserved.

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists

PubMed Central

2017-01-01

Purpose This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. Methods A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects’ responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Results Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Conclusion Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience. PMID:28900069

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists.

PubMed

Hwang, Yoon-Sook; Kang, Hyun-Sook; Kim, Soo-Hwa; Moon, Hee-Jung; Lee, Sun-Mi; Jung, Jae-Yeon; Hwang, Su-Jeong; Ha, Jung-Eun

2017-01-01

This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects' responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience.

Reaching consensus on the physiotherapeutic management of patients following upper abdominal surgery: a pragmatic approach to interpret equivocal evidence.

PubMed

Hanekom, Susan D; Brooks, Dina; Denehy, Linda; Fagevik-Olsén, Monika; Hardcastle, Timothy C; Manie, Shamila; Louw, Quinette

2012-02-06

Postoperative pulmonary complications remain the most significant cause of morbidity following open upper abdominal surgery despite advances in perioperative care. However, due to the poor quality primary research uncertainty surrounding the value of prophylactic physiotherapy intervention in the management of patients following abdominal surgery persists. The Delphi process has been proposed as a pragmatic methodology to guide clinical practice when evidence is equivocal. The objective was to develop a clinical management algorithm for the post operative management of abdominal surgery patients. Eleven draft algorithm statements extracted from the extant literature by the primary research team were verified and rated by scientist clinicians (n=5) in an electronic three round Delphi process. Algorithm statements which reached a priori defined consensus-semi-interquartile range (SIQR)<0.5-were collated into the algorithm. The five panelists allocated to the abdominal surgery Delphi panel were from Australia, Canada, Sweden, and South Africa. The 11 draft algorithm statements were edited and 5 additional statements were formulated. The panel reached consensus on the rating of all statements. Four statements were rated essential. An expert Delphi panel interpreted the equivocal evidence for the physiotherapeutic management of patients following upper abdominal surgery. Through a process of consensus a clinical management algorithm was formulated. This algorithm can now be used by clinicians to guide clinical practice in this population.

Current and Emerging Ethical Issues in Counseling: A Delphi Study of Expert Opinions

ERIC Educational Resources Information Center

Herlihy, Barbara; Dufrene, Roxane L.

2011-01-01

A Delphi study was conducted to ascertain the opinions of panel experts regarding the most important current and emerging ethical issues facing the counseling profession. Expert opinions on ethical issues in counselor preparation also were sought. Eighteen panelists responded to 3 rounds of data collection interspersed with feedback. Themes that…

Supervising Counsellors and Psychotherapists Who Work with Trauma: A Delphi Study

ERIC Educational Resources Information Center

West, Angela

2010-01-01

In this study the Delphi technique was used to identify the main supervision issues that require attention and consideration when supervising counsellors and psychotherapists working with trauma. A panel of supervisors, who were additionally experienced in working with trauma in adulthood, completed a series of three questionnaires comprising two…

Developing standards for the development of glaucoma virtual clinics using a modified Delphi approach.

PubMed

Kotecha, Aachal; Longstaff, Simon; Azuara-Blanco, Augusto; Kirwan, James F; Morgan, James Edwards; Spencer, Anne Fiona; Foster, Paul J

2018-04-01

To obtain consensus opinion for the development of a standards framework for the development and implementation of virtual clinics for glaucoma monitoring in the UK using a modified Delphi methodology. A modified Delphi technique was used that involved sampling members of the UK Glaucoma and Eire Society (UKEGS). The first round scored the strength of agreement to a series of standards statements using a 9-point Likert scale. The revised standards were subjected to a second round of scoring and free-text comment. The final standards were discussed and agreed by an expert panel consisting of seven glaucoma subspecialists from across the UK. A version of the standards was submitted to external stakeholders for a 3-month consultation. There was a 44% response rate of UKEGS members to rounds 1 and 2, consisting largely of consultant ophthalmologists with a specialist interest in glaucoma. The final version of the standards document was validated by stakeholder consultation and contains four sections pertaining to the patient groups, testing methods, staffing requirements and governance structure of NHS secondary care glaucoma virtual clinic models. Use of a modified Delphi approach has provided consensus agreement for the standards required for the development of virtual clinics to monitor glaucoma in the UK. It is anticipated that this document will be useful as a guide for those implementing this model of service delivery. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development of mental health first aid guidelines for suicidal ideation and behaviour: A Delphi study

PubMed Central

Kelly, Claire M; Jorm, Anthony F; Kitchener, Betty A; Langlands, Robyn L

2008-01-01

Background Suicide is a statistically rare event, but devastating to those left behind and one of the worst possible outcomes associated with mental illness. Although a friend, family member or co-worker may be the first person to notice that a person is highly distressed, few have the knowledge and skills required to assist. Simple guidelines may help such a person to encourage a suicidal individual to seek professional help or decide against suicide. Methods This research was conducted using the Delphi methodology, a method of reaching consensus in a panel of experts. Experts recruited to the panels included 22 professionals, 10 people who had been suicidal in the past and 6 carers of people who had been suicidal in the past. Statements about how to assist someone who is thinking about suicide were sourced through a systematic search of both professional and lay literature. The guidelines were written using the items most consistently endorsed by all three panels. Results Of 114 statements presented to the panels, 30 were accepted. These statements were used to develop the guidelines appended to this paper. Conclusion There are a number of actions which are considered to be useful for members of the public when they encounter someone who is experiencing suicidal thoughts or engaging in suicidal behaviour. These guidelines will be useful in revision of curricula of mental health first aid and suicide intervention training programs. They can also be used by members of the public who want immediate information about how to assist a suicidal person. PMID:18366657

Medication dispensing errors in Palestinian community pharmacy practice: a formal consensus using the Delphi technique.

PubMed

Shawahna, Ramzi; Haddad, Aseel; Khawaja, Baraa; Raie, Rand; Zaneen, Sireen; Edais, Tasneem

2016-10-01

Background Medication dispensing errors (MDEs) are frequent in community pharmacy practice. A definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice were not previously approached using formal consensus techniques. Objective This study was conducted to achieve consensus on a definition of MDEs and a wide range of scenarios that should or should not be considered as MDEs in Palestinian community pharmacy practice by a panel of community pharmacists. Setting Community pharmacy practice in Palestine. Method This was a descriptive study using the Delphi technique. A panel of fifty community pharmacists was recruited from different geographical locations of the West Bank of Palestine. A three round Delphi technique was followed to achieve consensus on a proposed definition of MDEs and 83 different scenarios representing potential MDEs using a nine-point scale. Main outcome measure Agreement or disagreement of a panel of community pharmacists on a proposed definition of MDEs and a series of scenarios representing potential MDEs. Results In the first Delphi round, views of key contact community pharmacists on MDEs were explored and situations representing potential MDEs were collected. In the second Delphi round, consensus was achieved to accept the proposed definition and to include 49 (59 %) of the 83 proposed scenarios as MDEs. In the third Delphi round, consensus was achieved to include further 13 (15.7 %) scenarios as MDEs, exclude 9 (10.8 %) scenarios and the rest of 12 (14.5 %) scenarios were considered equivocal based on the opinions of the panelists. Conclusion Consensus on a definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice was achieved using a formal consensus technique. The use of consensual definitions and scenarios representing MDE situations in community pharmacy practice might minimize methodological variations and their significant effects on the number and rate of MDEs reported in different studies.

Developing consensus-based policy solutions for medicines adherence for Europe: a delphi study

PubMed Central

2012-01-01

Background Non-adherence to prescribed medication is a pervasive problem that can incur serious effects on patients’ health outcomes and well-being, and the availability of resources in healthcare systems. This study aimed to develop practical consensus-based policy solutions to address medicines non-adherence for Europe. Methods A four-round Delphi study was conducted. The Delphi Expert Panel comprised 50 participants from 14 countries and was representative of: patient/carers organisations; healthcare providers and professionals; commissioners and policy makers; academics; and industry representatives. Participants engaged in the study remotely, anonymously and electronically. Participants were invited to respond to open questions about the causes, consequences and solutions to medicines non-adherence. Subsequent rounds refined responses, and sought ratings of the relative importance, and operational and political feasibility of each potential solution to medicines non-adherence. Feedback of individual and group responses was provided to participants after each round. Members of the Delphi Expert Panel and members of the research group participated in a consensus meeting upon completion of the Delphi study to discuss and further refine the proposed policy solutions. Results 43 separate policy solutions to medication non-adherence were agreed by the Panel. 25 policy solutions were prioritised based on composite scores for importance, and operational and political feasibility. Prioritised policy solutions focused on interventions for patients, training for healthcare professionals, and actions to support partnership between patients and healthcare professionals. Few solutions concerned actions by governments, healthcare commissioners, or interventions at the system level. Conclusions Consensus about practical actions necessary to address non-adherence to medicines has been developed for Europe. These actions are also applicable to other regions. Prioritised policy solutions for medicines non-adherence offer a benefit to policymakers and healthcare providers seeking to address this multifaceted, complex problem. PMID:23176439

Phase 2 of CATALISE: a multinational and multidisciplinary Delphi consensus study of problems with language development: Terminology.

PubMed

Bishop, Dorothy V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2017-10-01

Lack of agreement about criteria and terminology for children's language problems affects access to services as well as hindering research and practice. We report the second phase of a study using an online Delphi method to address these issues. In the first phase, we focused on criteria for language disorder. Here we consider terminology. The Delphi method is an iterative process in which an initial set of statements is rated by a panel of experts, who then have the opportunity to view anonymised ratings from other panel members. On this basis they can either revise their views or make a case for their position. The statements are then revised based on panel feedback, and again rated by and commented on by the panel. In this study, feedback from a second round was used to prepare a final set of statements in narrative form. The panel included 57 individuals representing a range of professions and nationalities. We achieved at least 78% agreement for 19 of 21 statements within two rounds of ratings. These were collapsed into 12 statements for the final consensus reported here. The term 'Language Disorder' is recommended to refer to a profile of difficulties that causes functional impairment in everyday life and is associated with poor prognosis. The term, 'Developmental Language Disorder' (DLD) was endorsed for use when the language disorder was not associated with a known biomedical aetiology. It was also agreed that (a) presence of risk factors (neurobiological or environmental) does not preclude a diagnosis of DLD, (b) DLD can co-occur with other neurodevelopmental disorders (e.g. ADHD) and (c) DLD does not require a mismatch between verbal and nonverbal ability. This Delphi exercise highlights reasons for disagreements about terminology for language disorders and proposes standard definitions and nomenclature. © 2017 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

Identifying Threshold Concepts for Information Literacy: A Delphi Study

ERIC Educational Resources Information Center

Townsend, Lori; Hofer, Amy R.; Hanick, Silvia Lin; Brunetti, Korey

2016-01-01

This study used the Delphi method to engage expert practitioners on the topic of threshold concepts--core ideas and processes in a discipline that students need to grasp in order to progress in their learning, but that are often unspoken or unrecognized by expert practitioners--for information literacy. A panel of experts considered two questions:…

Trends that FCS Education Should Address: A Delphi Study Reveals Top 16

ERIC Educational Resources Information Center

Alexander, Karen L.; Davis, Kimberlee

2011-01-01

This study used the Delphi method to identify trends of importance to family and consumer sciences (FCS) education. A panel of 21 FCS education experts identified 16 trends and evaluated them by importance, desirability, feasibility, and confidence in validity of the trend. Nutrition appeared as a top priority, followed by consumer economics. The…

Delphi in Criminal Justice Policy: A Case Study on Judgmental Forecasting

ERIC Educational Resources Information Center

Loyens, Kim; Maesschalck, Jeroen; Bouckaert, Geert

2011-01-01

This article provides an in-depth case study analysis of a pilot project organized by the section "Strategic Analysis" of the Belgian Federal Police. Using the Delphi method, which is a judgmental forecasting technique, a panel of experts was questioned about future developments of crime, based on their expertise in criminal or social…

The Essential Components of Coach Training for Mental Health Professionals: A Delphi Study

ERIC Educational Resources Information Center

Moriarity, Marlene Therese

2010-01-01

Purpose. The purpose of this study was to discover how coach training experts define coaching and what they would identify to be the essential components of a coach training program for mental health professionals. Methods. A panel of nine experts, through an iterative Delphi process of responding to three rounds of questionnaires, provided…

Critical Guidelines for U.S.-Based Counselor Educators When Working Transnationally: A Delphi Study

ERIC Educational Resources Information Center

Smith, Paul H.; Benshoff, James M.; Gonzalez, Laura M.

2018-01-01

U.S.-based counselor education faculty increasingly are participating in transnational experiences, such as global research and study abroad. The purpose of this study was to develop guidelines for U.S.-based counselor educators when working transnationally. Using Delphi methodology, 69 consensus guidelines were developed from an expert panel.…

Issues Facing Urban Agriscience Teachers: A Delphi Study

ERIC Educational Resources Information Center

Warner, Wendy J.; Washburn, Shannon G.

2009-01-01

This national study used the Delphi technique to identify the issues facing urban agriscience teachers. The first round of the study used a questionnaire with one open-ended question to generate responses from the expert panel. In the second round, respondents were asked to rate their level of agreement with 72 issues identified in round one using…

Quality pharmacy services and key performance indicators in Polish NICUs: a Delphi approach.

PubMed

Krzyżaniak, Natalia; Pawłowska, Iga; Bajorek, Beata

2018-03-31

Background Currently, there is no literature describing what a quality level of practice entails in Polish neonatal intensive care units (NICUs), nor are there any means of currently measuring the quality of pharmaceutical care provided to NICU patients. Objective To identify a set of essential pharmacist roles and pharmacy-relevant key performance indicators (KPI's) suitable for Polish neonatal intensive units (NICUs). Setting Polish hospital pharmacies and NICUs. Method Using a modified Delphi technique, potential KPI's structured along Donabedian's domains as well as pharmacy services were presented to an expert panel of stakeholders. Two online, consecutive Delphi rounds, were completed by panellists between August and September 2017. Main outcome measure To identify the minimum level of pharmacy services that should be consistently provided to NICU patients. Results A total of 16 panellists contributed to the expert panel. Overall, consensus of 75% was reached for 23 indicators and for 28 roles. When considering pharmacy services for the NICU, the experts were found to highly value traditional pharmacy roles, such as dispensing and extemporaneous compounding, however, they were still eager for roles in the other domains, such as educational and clinical services, to be listed as essential for NICU practice. Panellists were found to positively value the list of indicators presented, and excluded only 9 out of the total list. Conclusion There is a need for future research to establish a minimum standard of practice for Polish pharmacists to encourage the progression and standardisation of hospital pharmacy services to meet the level of practice seen in NICUs worldwide.

Protocol—the RAMESES II study: developing guidance and reporting standards for realist evaluation

PubMed Central

Greenhalgh, Trisha; Wong, Geoff; Jagosh, Justin; Greenhalgh, Joanne; Manzano, Ana; Westhorp, Gill; Pawson, Ray

2015-01-01

Introduction Realist evaluation is an increasingly popular methodology in health services research. For realist evaluations (RE) this project aims to: develop quality and reporting standards and training materials; build capacity for undertaking and critically evaluating them; produce resources and training materials for lay participants, and those seeking to involve them. Methods To achieve our aims, we will: (1) Establish management and governance infrastructure; (2) Recruit an interdisciplinary Delphi panel of 35 participants with diverse relevant experience of RE; (3) Summarise current literature and expert opinion on best practice in RE; (4) Run an online Delphi panel to generate and refine items for quality and reporting standards; (5) Capture ‘real world’ experiences and challenges of RE—for example, by providing ongoing support to realist evaluations, hosting the RAMESES JISCmail list on realist research, and feeding problems and insights from these into the deliberations of the Delphi panel; (6) Produce quality and reporting standards; (7) Collate examples of the learning and training needs of researchers, students, reviewers and lay members in relation to RE; (8) Develop, deliver and evaluate training materials for RE and deliver training workshops; and (9) Develop and evaluate information and resources for patients and other lay participants in RE (eg, draft template information sheets and model consent forms) and; (10) Disseminate training materials and other resources. Planned outputs: (1) Quality and reporting standards and training materials for RE. (2) Methodological support for RE. (3) Increase in capacity to support and evaluate RE. (4) Accessible, plain-English resources for patients and the public participating in RE. Discussion The realist evaluation is a relatively new approach to evaluation and its overall place in the is not yet fully established. As with all primary research approaches, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency. PMID:26238395

NETS1HD: study protocol for development of a core outcome set for use in determining the overall success of Hirschsprung's disease treatment.

PubMed

Allin, Benjamin; Bradnock, Timothy; Kenny, Simon; Walker, Gregor; Knight, Marian

2016-12-07

Use of core outcome sets in research has been proposed as a method for countering the problems caused by heterogeneity of outcome measure reporting. Heterogeneity of outcome measure reporting occurs in Hirschsprung's disease (HD) research and is limiting the development of a robust evidence base to support clinical practice. Candidate outcome measures have been identified through a systematic review. These outcome measures will form the starting point for a three-phase online Delphi process to be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel; panel 2 is a non-neonatal panel; and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1 to 9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's HD. In round 2, experts will be presented with the same list of outcome measures and graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure, taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels, which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. Results of the Delphi process will be discussed, and outcomes will be re-scored. Outcome measures where >70% of participants at the meeting scored it 7-9 and <15% scored it 1-3 will form the core outcome set. Development of a core outcome set will help to reduce heterogeneity of outcome measure reporting in HD. This will increase the quality of research taking place and ultimately improve care provided to infants with HD.

European undergraduate curriculum in geriatric medicine developed using an international modified Delphi technique

PubMed Central

Masud, Tahir; Blundell, Adrian; Gordon, Adam Lee; Mulpeter, Ken; Roller, Regina; Singler, Katrin; Goeldlin, Adrian; Stuck, Andreas

2014-01-01

Introduction: the rise in the number of older, frail adults necessitates that future doctors are adequately trained in the skills of geriatric medicine. Few countries have dedicated curricula in geriatric medicine at the undergraduate level. The aim of this project was to develop a consensus among geriatricians on a curriculum with the minimal requirements that a medical student should achieve by the end of medical school. Methods: a modified Delphi process was used. First, educational experts and geriatricians proposed a set of learning objectives based on a literature review. Second, three Delphi rounds involving a panel with 49 experts representing 29 countries affiliated to the European Union of Medical Specialists (UEMS) was used to gain consensus for a final curriculum. Results: the number of disagreements following Delphi Rounds 1 and 2 were 81 and 53, respectively. Complete agreement was reached following the third round. The final curriculum consisted of detailed objectives grouped under 10 overarching learning outcomes. Discussion: a consensus on the minimum requirements of geriatric learning objectives for medical students has been agreed by European geriatricians. Major efforts will be needed to implement these requirements, given the large variation in the quality of geriatric teaching in medical schools. This curriculum is a first step to help improve teaching of geriatrics in medical schools, and will also serve as a basis for advancing postgraduate training in geriatrics across Europe. PMID:24603283

Identification of the Competencies Needed to Apply Social Marketing to Extension Programming: Results of a Delphi Study

ERIC Educational Resources Information Center

Warner, Laura A.; Stubbs, Eric; Murphrey, Theresa Pesl; Huynh, Phuong

2016-01-01

The purpose of this study was to identify the specific competencies needed to apply social marketing, a promising approach to behavior change, to Extension programming. A modified Delphi study was used to achieve group consensus among a panel of experts on the skills, characteristics, and knowledge needed to successfully apply this behavior change…

Future of the Korea national parks: a preliminary Delphi study of key experts

Treesearch

Byung-kyu Lee; Wilbur F. LaPage

2002-01-01

A preliminary Delphi survey of a panel of key experts who are very knowledgeable of Korean national parks was conducted between February and March in 2001. Park professionals, environmental NGO directors, interested citizens, and retirees identified issues facing the Korean park system (Wave1). Findings from wave I of the survey provided the baseline for a series of...

USING THE DELPHI TECHNIQUE TO DEVELOP EFFECTIVENESS INDICATORS FOR SOCIAL MARKETING COMMUNICATION TO REDUCE HEALTH-RISK BEHAVIORS AMONG YOUTH.

PubMed

Vantamay, Nottakrit

2015-09-01

This study aimed to develop effectiveness indicators for social marketing communication to reduce health-risk behaviors among Thai youth by using the Delphi technique. The Delphi technique is a research approach used to gain consensus through a series of two or more rounds of questionnaire surveys where information and results are fed back to panel members between each round and it has been extensively used to generate many indicators relevant to health behaviors. The Delphi technique was conducted in 3 rounds by consulting a panel of 15 experts in the field of social marketing communication for public health campaigns in Thailand. We found forty-nine effectiveness indicators in eight core components reached consensus. These components were: 1) attitude about health-risk behavior reduction, 2) subjective norms, 3) perceived behavioral control, 4) intention to reduce health-risk behaviors, 5) practices for reducing health-risk behaviors, 6) knowledge about the dangers and impact of health-risk behaviors, 7) campaign brand equity, and 8) communication networks. These effectiveness indicators could be applied by health promotion organizations for evaluating the effectiveness of social marketing communication to effectively reduce health-risk behaviors among youth.

Multidisciplinary Delphi Development of a Scale to Evaluate Team Function in Obstetric Emergencies: The PETRA Scale.

PubMed

Balki, Mrinalini; Hoppe, David; Monks, David; Cooke, Mary Ellen; Sharples, Lynn; Windrim, Rory

2017-06-01

The objective of this study was to develop a new interdisciplinary teamwork scale, the Perinatal Emergency: Team Response Assessment (PETRA), for the management of obstetric crises, through consensus agreement of obstetric caregivers. This prospective study was performed using expert consensus, based on a Delphi method. The study investigators developed a new PETRA tool, specifically related to obstetric crisis management, based on the existing literature and discussions among themselves. The scale was distributed to a selected panel of experts in the field for the Delphi process. After each round of Delphi, every component of the scale was analyzed quantitatively by the percentage of agreement ratings and each comment reviewed by the blinded investigators. The assessment scale was then modified, with components of less than 80% agreement removed from the scale. The process was repeated on three occasions to reach a consensus and final PETRA scale. Fourteen of 24 invited experts participated in the Delphi process. The original PETRA scale included six categories and 48 items, one global scale item, and a 3-point rubric for rating. The overall percentage agreement by experts in the first, second, and third rounds was 95.0%, 93.2%, and 98.5%, respectively. The final scale after the third round of Delphi consisted of the following seven categories: shared mental model, communication, situational awareness, leadership, followership, workload management, and positive/effective behaviours and attitudes. There were 34 individual items within these categories, each with a 5-point rating rubric (1 = unacceptable to 5 = perfect). Using a structured Delphi method, we established the face and content validity of this assessment scale that focuses on important aspects of interdisciplinary teamwork in the management of obstetric crises. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Research Priorities for NCD Prevention and Climate Change: An International Delphi Survey.

PubMed

Colagiuri, Ruth; Boylan, Sinead; Morrice, Emily

2015-10-16

Climate change and non-communicable diseases (NCDs) are arguably the greatest global challenges of the 21st Century. However, the confluence between them remains under-examined and there is little evidence of a comprehensive, systematic approach to identifying research priorities to mitigate their joint impact. Consequently, we: (i) convened a workshop of academics (n = 25) from the Worldwide Universities Network to identify priority areas at the interface between NCDs and climate change; (ii) conducted a Delphi survey of international opinion leaders in public health and relevant other disciplines; and (iii) convened an expert panel to review and advise on final priorities. Three research areas (water security; transport; conceptualising NCD harms to support policy formation) were listed among the top 10 priorities by >90% of Delphi respondents, and ranked among the top 12 priorities by >60% of respondents who ranked the order of priority. A fourth area (reducing the carbon footprint of cities) was ranked highest by the same >60% of respondents. Our results are consistent with existing frameworks on health and climate change, and extends them by focusing specifically on NCDs. Researching these priorities could progress understanding of climate change and NCDs, and inform global and national policy decisions for mitigating associated harms.

Assessing the Trends and Challenges of Teaching Marketing Abroad: A Delphi Approach

ERIC Educational Resources Information Center

Kelley, Craig A.

2007-01-01

The past 20 years have seen a growth in the teaching of marketing in business schools around the world. This article reports the trends and challenges that will face U.S. marketing educators teaching abroad over the next 10 years. Predictions are from a Delphi panel of U.S. marketing educators experienced in teaching marketing abroad to non-U.S.…

Future scenarios of Korea national parks: Delphi survey of Korean parks of experts

Treesearch

Byung-kyu Lee; Wilbur F. LaPage

2003-01-01

A three-wave Delphi survey of a panel of 40 key experts very knowledgeable of Korean national parks was conducted between February 2001 and March in 2002. In Wave 1, park professionals, environmental Nongovernmental Organizations (NGOs) managers, and a retiree identified the issues the Korean park system is facing. Findings from Wave 1 of the survey were analyzed and...

Consulting Stakeholders in the Development of an Environmental Policy Implementation Plan: A Delphi Study at Dalhousie University

ERIC Educational Resources Information Center

Wright, Tarah Sharon Alexandra

2004-01-01

This paper reports on a Delphi Study undertaken at Dalhousie University in which a multi-stakeholder panel was consulted in order to generate ideas that could be incorporated into an Implementation Plan for the University Environmental Policy (UEP). The objectives of the study were twofold. First, the study endeavored to develop ideas as to the…

Expert Opinion Is Necessary: Delphi Panel Methodology Facilitates a Scientific Approach to Consensus.

PubMed

Hohmann, Erik; Brand, Jefferson C; Rossi, Michael J; Lubowitz, James H

2018-02-01

Our current trend and focus on evidence-based medicine is biased in favor of randomized controlled trials, which are ranked highest in the hierarchy of evidence while devaluing expert opinion, which is ranked lowest in the hierarchy. However, randomized controlled trials have weaknesses as well as strengths, and no research method is flawless. Moreover, stringent application of scientific research techniques, such as the Delphi Panel methodology, allows survey of experts in a high quality and scientific manner. Level V evidence (expert opinion) remains a necessary component in the armamentarium used to determine the answer to a clinical question. Copyright © 2017 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Using a web-based survey tool to undertake a Delphi study: application for nurse education research.

PubMed

Gill, Fenella J; Leslie, Gavin D; Grech, Carol; Latour, Jos M

2013-11-01

The Internet is increasingly being used as a data collection medium to access research participants. This paper reports on the experience and value of using web-survey software to conduct an eDelphi study to develop Australian critical care course graduate practice standards. The eDelphi technique used involved the iterative process of administering three rounds of surveys to a national expert panel. The survey was developed online using SurveyMonkey. Panel members responded to statements using one rating scale for round one and two scales for rounds two and three. Text boxes for panel comments were provided. For each round, the SurveyMonkey's email tool was used to distribute an individualized email invitation containing the survey web link. The distribution of panel responses, individual responses and a summary of comments were emailed to panel members. Stacked bar charts representing the distribution of responses were generated using the SurveyMonkey software. Panel response rates remained greater than 85% over all rounds. An online survey provided numerous advantages over traditional survey approaches including high quality data collection, ease and speed of survey administration, direct communication with the panel and rapid collation of feedback allowing data collection to be undertaken in 12 weeks. Only minor challenges were experienced using the technology. Ethical issues, specific to using the Internet to conduct research and external hosting of web-based software, lacked formal guidance. High response rates and an increased level of data quality were achieved in this study using web-survey software and the process was efficient and user-friendly. However, when considering online survey software, it is important to match the research design with the computer capabilities of participants and recognize that ethical review guidelines and processes have not yet kept pace with online research practices. Copyright © 2013 Elsevier Ltd. All rights reserved.

A Screening Tool to Identify Spasticity in Need of Treatment

PubMed Central

Zorowitz, Richard D.; Wein, Theodore H.; Dunning, Kari; Deltombe, Thierry; Olver, John H.; Davé, Shashank J.; Dimyan, Michael A.; Kelemen, John; Pagan, Fernando L.; Evans, Christopher J.; Gillard, Patrick J.; Kissela, Brett M.

2017-01-01

Objective To develop a clinically useful patient-reported screening tool for health care providers to identify patients with spasticity in need of treatment regardless of etiology. Design Eleven spasticity experts participated in a modified Delphi panel and reviewed and revised 2 iterations of a screening tool designed to identify spasticity symptoms and impact on daily function and sleep. Spasticity expert panelists evaluated items pooled from existing questionnaires to gain consensus on the screening tool content. The study also included cognitive interviews of 20 patients with varying spasticity etiologies to determine if the draft screening tool was understandable and relevant to patients with spasticity. Results The Delphi panel reached an initial consensus on 21 of 47 items for the screening tool and determined that the tool should have no more than 11 to 15 items and a 1-month recall period for symptom and impact items. After 2 rounds of review, 13 items were selected and modified by the expert panelists. Most patients (n = 16 [80%]) completed the cognitive interview and interpreted the items as intended. Conclusions Through the use of a Delphi panel and patient interviews, a 13-item spasticity screening tool was developed that will be practical and easy to use in routine clinical practice. PMID:27552355

Assessment of Competence in EVAR Procedures: A Novel Rating Scale Developed by the Delphi Technique.

PubMed

Strøm, M; Lönn, L; Bech, B; Schroeder, T V; Konge, L

2017-07-01

To develop a procedure specific global rating scale for assessment of operator competence in endovascular aortic repair (EVAR). A Delphi approach was used to achieve expert consensus. A panel of 32 international experts (median 300 EVAR procedures, range 200-3000) from vascular surgery (n = 21) and radiology (n = 11) was established. The first Delphi round was based on a review of endovascular skills assessment papers, stent graft instructions for use, and structured interviews. It led to a primary pool of 83 items that were formulated as global rating scale items with tentative anchors. Iterative Delphi rounds were executed. The panellists rated the importance of each item on a 5 point Likert scale. Consensus was defined as 80% of the panel rating an item 4 or 5 in the primary round and 90% in subsequent rounds. Consensus on the final assessment tool was defined as Cronbach's alpha > .8 after a minimum of three rounds. Thirty-two of 35 invited experts participated. Three rounds of surveys were completed with a completion rate of 100% in the first two rounds and 91% in round three. The 83 primary assessment items were supplemented with five items suggested by the panel and reduced to seven pivotal assessment items that reached consensus, Cronbach's alpha = 0.82. The seven item rating scale covers key elements of competence in EVAR stent placement and deployment. Each item has well defined grades with explicit anchors at unacceptable, acceptable, and superior performance on a 5 point Likert scale. The Delphi methodology allowed for international consensus on a new procedure specific global rating scale for assessment of competence in EVAR. The resulting scale, EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), represents key elements in the procedure. EVARATE constitutes an assessment tool for providing structured feedback to endovascular operators in training. Copyright © 2017 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study.

PubMed

Blackwood, Bronagh; Ringrow, Suzanne; Clarke, Mike; Marshall, John; Rose, Louise; Williamson, Paula; McAuley, Danny

2015-08-20

Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children. We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes. The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

STEM integration in middle school career and technical education programs: A Delphi design study

NASA Astrophysics Data System (ADS)

Wu-Rorrer, Billy Ray

The purpose of this qualitative method study with a Delphi research design sought to determine how STEM programs can be effectively integrated into middle school career and technical education programs by local, state, and national educators, administrators, directors, specialists, and curriculum writers. The significance of the study is to provide leaders in CTE with a greater awareness, insight, and strategies about how CTE programs can more effectively integrate academics into career and technical education programs through STEM-related programming. The findings will increase the limited amount of available literature providing best practice strategies for the integration of STEM curriculum into middle school CTE programs. One basic question has guided this research: How can STEM programs be effectively integrated into middle school career and technical education programs? A total of twelve strategies were identified. The strategies of real-world applications and administrative buy-in were the two predominant strategies consistently addressed throughout the review of literature and all three sub-questions in the research study. The Delphi design study consisted of pilot round and three rounds of data collection on barriers, strategies, and professional development for STEM integration in middle school career and technical education programs. Four panelists participated in the pilot round, and 16 panel members not involved in the pilot round participated in the three rounds of questioning and consensus building. In the future, more comprehensive studies can build upon this foundational investigation of middle school CTE programs.

Gaining consensus on family carer needs when caring for someone dying at home to develop the Carers' Alert Thermometer (CAT): a modified Delphi study.

PubMed

Knighting, Katherine; O'Brien, Mary R; Roe, Brenda; Gandy, Rob; Lloyd-Williams, Mari; Nolan, Mike; Jack, Barbara A

2016-01-01

To report a multi-phase modified Delphi study conducted with carers and professionals to identify the priority areas for inclusion in an alert screening tool for carers providing support to someone dying at home. Internationally, there is a growing emphasis on increasing choice for patients who wish to die at home which relies heavily on care provided by the unpaid family carers. Family carers can have high levels of unmet needs comprising their psychological and physical health and their ability to provide effective care and support. Development of an alert tool to identify carers' needs in everyday practice required identification and consensus of the priority areas of need for inclusion. Multi-phase modified Delphi study and instrument development. Qualitative and quantitative data collection took place between 2011-2013 with 111 carers and 93 professionals to identify carers' needs and gain consensus on the priority areas for inclusion in the alert tool. An expert panel stage and final evidence review post-Delphi were used. The Delphi panels had high levels of agreement and consensus. Ten areas of carer need across two themes of 'the current caring situation' and 'the carer's own health and well-being' were prioritized for inclusion in the alert tool. An optional end-of-life planning question was included following the final stages. The results provide evidence of carers' needs to be assessed, areas for consideration in the education of those who support carers and someone dying at home and targeting of services, while demonstrating the usefulness and adaptability of the Delphi method. © 2015 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Constructing post-surgical discharge instructions through a Delphi consensus methodology.

PubMed

Scott, Aaron R; Sanderson, Cody J; Rush, Augustus J; Alore, Elizabeth A; Naik, Aanand D; Berger, David H; Suliburk, James W

2018-05-01

Patient education materials are a crucial part of physician-patient communication. We hypothesize that available discharge instructions are difficult to read and fail to address necessary topics. Our objective is to evaluate readability and content of surgical discharge instructions using thyroidectomy to develop standardized discharge materials. Thyroidectomy discharge materials were analyzed for readability and assessed for content. Fifteen endocrine surgeons participated in a modified Delphi consensus panel to select necessary topics. Using readability best practices, we created standardized discharge instructions which included all selected topics. The panel evaluated 40 topics, selected 23, deemed 4 inappropriate, consolidated 5, and did not reach consensus on 8 topics after 4 rounds. The evaluated instructions' reading levels ranged from grade 6.5 to 13.2; none contained all consensus topics. Current post surgical thyroidectomy discharge instructions are more difficult to read than recommended by literacy standards and omit consensus warning signs of major complications. Our easy-to-read discharge instructions cover pertinent topics and may enhance patient education. Delphi methodology is useful for developing post-surgical instructions. Patient education materials need appropriate readability levels and content. We recommend the Delphi method to select content using consensus expert opinion whenever higher level data is lacking. Copyright © 2017 Elsevier B.V. All rights reserved.

Development of a core outcome set for use in determining the overall success of gastroschisis treatment.

PubMed

Allin, Benjamin; Ross, Andrew; Marven, Sean; J Hall, Nigel; Knight, Marian

2016-07-27

Gastroschisis research is limited in quality by the presence of significant heterogeneity in outcome measure reporting (PloS One 10(1):e0116908, 2015). Using core outcome sets in research is one proposed method for addressing this problem (Trials 13:103, 2012; Clin Rheumatol 33(9):1313-1322, 2014; Health Serv Res Policy 17(1):1-2, 2012). Ultimately, standardising outcome measure reporting will improve research quality and translate into improvements in patient care. Candidate outcome measures have been identified through systematic reviews. These outcome measures will form the starting point for an online, three-phase Delphi process that will be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel, panel 2 is a non-neonatal panel and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1-9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's gastroschisis treatment. In round 2, experts will be presented with the same list of outcome measures and with graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. The results of the Delphi process will be discussed, and outcomes re-scored. Outcome measures where > 70 % of the participants at the meeting scored them as 7-9 and < 15 % scored them as 1-3 will form the core outcome set. Development of a core outcome set will help to reduce the heterogeneity of the outcome measure reporting in gastroschisis. This will increase the quality of research taking place and ultimately improve care provided to infants with gastroschisis.

Acne severity grading: determining essential clinical components and features using a Delphi consensus.

PubMed

Tan, Jerry; Wolfe, Barat; Weiss, Jonathan; Stein-Gold, Linda; Bikowski, Joseph; Del Rosso, James; Webster, Guy F; Lucky, Anne; Thiboutot, Diane; Wilkin, Jonathan; Leyden, James; Chren, Mary-Margaret

2012-08-01

There are multiple global scales for acne severity grading but no singular standard. Our objective was to determine the essential clinical components (content items) and features (property-related items) for an acne global grading scale for use in research and clinical practice using an iterative method, the Delphi process. Ten acne experts were invited to participate in a Web-based Delphi survey comprising 3 iterative rounds of questions. In round 1, the experts identified the following clinical components (primary acne lesions, number of lesions, extent, regional involvement, secondary lesions, and patient experiences) and features (clinimetric properties, ease of use, categorization of severity based on photographs or text, and acceptance by all stakeholders). In round 2, consensus for inclusion in the scale was established for primary lesions, number, sites, and extent; as well as clinimetric properties and ease of use. In round 3, consensus for inclusion was further established for categorization and acceptance. Patient experiences were excluded and no consensus was achieved for secondary lesions. The Delphi panel consisted solely of the United States (U.S.)-based acne experts. Using an established method for achieving consensus, experts in acne vulgaris concluded that an ideal acne global grading scale would comprise the essential clinical components of primary acne lesions, their quantity, extent, and facial and extrafacial sites of involvement; with features of clinimetric properties, categorization, efficiency, and acceptance. Copyright © 2011 American Academy of Dermatology, Inc. Published by Mosby, Inc. All rights reserved.

[The application of Delphi method in improving the score table for the hygienic quantifying and classification of hotels].

PubMed

Wang, Zi-yun; Liu, Yong-quan; Wang, Hong-bo; Zheng, Yang; Wu, Qi; Yang, Xia; Wu, Yong-wei; Zhao, Yi-ming

2009-04-01

By means of Delphi method and expert panel consultations, to choose suitable indicators and improve the score table for classifying the hygienic condition of hotels so that it can be widely used at nationwide. A two-round Delphi consultation was held to choose suitable indicators among 78 experts from 18 provinces, municipalities and autonomous regions. The suitable indicators were selected according to the importance recognized by experts. The average length of service in public health of the experts was (21.08 +/- 5.78) years and the average coefficient of experts' authorities C(r) was 0.89 +/- 0.07. The response rates of the two-round consultation were 98.72% (77/78) and 100.00% (77/77). The average feedback time were (8.49 +/- 4.48) d, (5.86 +/- 2.28) d, and the difference between two rounds was statistically significant (t = 4.60, P < 0.01). Kendall's coefficient were 0.26 (chi(2) = 723.63, P < 0.01), 0.32 (chi(2) = 635.65, P < 0.01) and opinions among experts became consistent. The score table for the hygienic quantifying and classification of hotels was composed of three first-class indicators (hygienic management, hygienic facilities and hygienic practices) and 36 second-class indicators. The weight coefficients of the three first-class indicators were 0.35, 0.34, 0.31. Delphi method might be used in a large-scale consultation among experts and be propitious to improve the score table for the hygienic quantifying and classification.

Development of mental health first aid guidelines on how a member of the public can support a person affected by a traumatic event: a Delphi study

PubMed Central

2010-01-01

Background People who experience traumatic events have an increased risk of developing a range of mental disorders. Appropriate early support from a member of the public, whether a friend, family member, co-worker or volunteer, may help to prevent the onset of a mental disorder or may minimise its severity. However, few people have the knowledge and skills required to assist. Simple guidelines may help members of the public to offer appropriate support when it is needed. Methods Guidelines were developed using the Delphi method to reach consensus in a panel of experts. Experts recruited to the panels included 37 professionals writing, planning or working clinically in the trauma area, and 17 consumer or carer advocates who had been affected by traumatic events. As input for the panels to consider, statements about how to assist someone who has experienced a traumatic event were sourced through a systematic search of both professional and lay literature. These statements were used to develop separate questionnaires about possible ways to assist adults and to assist children, and panel members answered either one questionnaire or both, depending on experience and expertise. The guidelines were written using the items most consistently endorsed by the panels across the three Delphi rounds. Results There were 180 items relating to helping adults, of which 65 were accepted, and 155 items relating to helping children, of which 71 were accepted. These statements were used to develop the two sets of guidelines appended to this paper. Conclusions There are a number of actions which may be useful for members of the public when they encounter someone who has experienced a traumatic event, and it is possible that these actions may help prevent the development of some mental health problems in the future. Positive social support, a strong theme in these guidelines, has some evidence for effectiveness in developing mental health problems in people who have experienced traumatic events, but the degree to which it helps has not yet been adequately demonstrated. An evaluation of the effectiveness of these guidelines would be useful in determining their value. These guidelines may be useful to organisations who wish to develop or revise curricula of mental health first aid and trauma intervention training programs and policies. They may also be useful for members of the public who want immediate information about how to assist someone who has experienced a potentially traumatic event. PMID:20565918

Using the Delphi method to develop nursing-sensitive quality indicators for the NICU.

PubMed

Chen, Lin; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-02-01

To develop nursing-sensitive quality indicators consistent with current medical practices in Chinese neonatal intensive care units. The development of nursing-sensitive quality indicators has become a top priority in nursing management. To the best of our knowledge, there has been no objective, scientific and sensitive evaluation of the quality of neonatal intensive care unit nursing in China. A modified Delphi technique was used to seek opinions from experts about what should be used and prioritised as indicators of quality care in neonatal intensive care unit nursing. Based on a literature review, we identified 21 indicators of nursing-sensitive quality in the neonatal intensive care unit. Our group of 11 consultants chose 13 indicators to be discussed using the Delphi method. In October and November 2014, 39 neonatal intensive care unit experts in 18 tertiary hospitals spread across six provinces participated in two rounds of Delphi panels. Of the 13 indicators discussed, 11 were identified as indicators of nursing-sensitive quality in the neonatal intensive care unit: rate of nosocomial infections, rate of accidental endotracheal extubation, rate of errors in medication administration, rate of treatment for pain, rate of peripheral venous extravasation, rate of compliance with handwashing techniques, incidence of pressure ulcers, incidence of noise, the bed-to-care ratio, the proportion of nurses with greater than five years neonatal intensive care unit experience and incidence of retinopathy. The 11 neonatal intensive care unit nursing-sensitive indicators identified by the Delphi method integrated with basic Chinese practices provide a basis for nursing management and the monitoring of nursing quality. This study identified nursing-sensitive quality indicators for neonatal intensive care unit care that are suitable for current clinical practice in China. © 2016 John Wiley & Sons Ltd.

Development of mental health first aid guidelines for panic attacks: a Delphi study.

PubMed

Kelly, Claire M; Jorm, Anthony F; Kitchener, Betty A

2009-08-10

Panic attacks are common, and while they are not life-threatening events, they can lead to the development of panic disorder and agoraphobia. Appropriate help at the time that a panic attack occurs may decrease the fear associated with the attack and reduce the risk of developing an anxiety disorder. However, few people have the knowledge and skills required to assist. Simple first aid guidelines may help members of the public to offer help to people who experience panic attacks. The Delphi method was used to reach consensus in a panel of experts. Experts included 50 professionals and 6 people who had experience of panic attacks and were active in mental health advocacy. Statements about how to assist someone who is having a panic attack were sourced through a systematic search of both professional and lay literature. These statements were rated for importance as first aid guidelines by the expert and consumer panels and guidelines were written using the items most consistently endorsed. Of 144 statements presented to the panels, 27 were accepted. These statements were used to develop the guidelines appended to this paper. There are a number of actions which are considered to be useful for members of the public to do if they encounter someone who is having a panic attack. These guidelines will be useful in revision of curricula of mental health first aid programs. They can also be used by members of the public who want immediate information about how to assist someone who is experiencing panic attacks.

AdViSHE: A Validation-Assessment Tool of Health-Economic Models for Decision Makers and Model Users.

PubMed

Vemer, P; Corro Ramos, I; van Voorn, G A K; Al, M J; Feenstra, T L

2016-04-01

A trade-off exists between building confidence in health-economic (HE) decision models and the use of scarce resources. We aimed to create a practical tool providing model users with a structured view into the validation status of HE decision models, to address this trade-off. A Delphi panel was organized, and was completed by a workshop during an international conference. The proposed tool was constructed iteratively based on comments from, and the discussion amongst, panellists. During the Delphi process, comments were solicited on the importance and feasibility of possible validation techniques for modellers, their relevance for decision makers, and the overall structure and formulation in the tool. The panel consisted of 47 experts in HE modelling and HE decision making from various professional and international backgrounds. In addition, 50 discussants actively engaged in the discussion at the conference workshop and returned 19 questionnaires with additional comments. The final version consists of 13 items covering all relevant aspects of HE decision models: the conceptual model, the input data, the implemented software program, and the model outcomes. Assessment of the Validation Status of Health-Economic decision models (AdViSHE) is a validation-assessment tool in which model developers report in a systematic way both on validation efforts performed and on their outcomes. Subsequently, model users can establish whether confidence in the model is justified or whether additional validation efforts should be undertaken. In this way, AdViSHE enhances transparency of the validation status of HE models and supports efficient model validation.

Suicide first aid guidelines for Sri Lanka: a Delphi consensus study.

PubMed

De Silva, Saranga A; Colucci, Erminia; Mendis, Jayan; Kelly, Claire M; Jorm, Anthony F; Minas, Harry

2016-01-01

Sri Lanka has one of the highest suicide rates in the world. Gatekeeper programs aimed at specific target groups could be a promising suicide prevention strategy in the country. The aim of this study was to develop guidelines that help members of the public to provide first aid to persons in Sri Lanka who are at risk of suicide. The Delphi method was used to elicit consensus on potential helping statements to include in the guidelines. These statements describe information members of the public should have and actions they can take to help a person who is experiencing suicidal thoughts. An expert panel, comprised of mental health and suicide experts in Sri Lanka, rated each statement. The panellists were encouraged to suggest any additional action that was not included in the original questionnaire and, in particular, to include items that were culturally appropriate or gender specific. Responses to open-ended questions were used to generate new items. These items were included in the subsequent Delphi rounds. Three Delphi rounds were carried out. Statements were accepted for inclusion in the guidelines if they were endorsed (rated as essential or important) by at least 80 % of the panel. Statements endorsed by 70-79 % of the panel were re-rated in the following round. Statements with less than 70 % endorsement, or re-rated items that did not receive 80 % or higher endorsement were rejected. The output from the Delphi process was a set of endorsed statements. In the first round questionnaire 473 statements were presented to the panel and 58 new items were generated from responses to the open-ended questions. Of the total 531 statements presented, 304 were endorsed. These statements were used to develop the suicide first aid guidelines for Sri Lanka. By engaging Sri Lankans who are experts in the field of mental health or suicide this research developed culturally appropriate guidelines for providing mental health first aid to a person at risk of suicide in Sri Lanka. The guidelines may serve as a basis for developing training for members of the public to provide mental health first aid to persons at risk of suicide as part of Sri Lanka's suicide prevention strategy.

A Delphi study and ranking exercise to support commissioning services: future delivery of Thrombectomy services in England.

PubMed

Halvorsrud, Kristoffer; Flynn, Darren; Ford, Gary A; McMeekin, Peter; Bhalla, Ajay; Balami, Joyce; Craig, Dawn; White, Phil

2018-02-22

Intra-arterial thrombectomy is the gold standard treatment for large artery occlusive stroke. However, the evidence of its benefits is almost entirely based on trials delivered by experienced neurointerventionists working in established teams in neuroscience centres. Those responsible for the design and prospective reconfiguration of services need access to a comprehensive and complementary array of information on which to base their decisions. This will help to ensure the demonstrated effects from trials may be realised in practice and account for regional/local variations in resources and skill-sets. One approach to elucidate the implementation preferences and considerations of key experts is a Delphi survey. In order to support commissioning decisions, we aimed using an electronic Delphi survey to establish consensus on the options for future organisation of thrombectomy services among physicians with clinical experience in managing large artery occlusive stroke. A Delphi survey was developed with 12 options for future organisation of thrombectomy services in England. A purposive sampling strategy established an expert panel of stroke physicians from the British Association of Stroke Physicians (BASP) Clinical Standards and/or Executive Membership that deliver 24/7 intravenous thrombolysis. Options with aggregate scores falling within the lowest quartile were removed from the subsequent Delphi round. Options reaching consensus following the two Delphi rounds were then ranked in a final exercise by both the wider BASP membership and the British Society of Neuroradiologists (BSNR). Eleven stroke physicians from BASP completed the initial two Delphi rounds. Three options achieved consensus, with subsequently wider BASP (97%, n = 43) and BSNR members (86%, n = 21) assigning the highest approval rankings in the final exercise for transferring large artery occlusive stroke patients to nearest neuroscience centre for thrombectomy based on local CT/CT Angiography. The initial Delphi rounds ensured optimal reduction of options by an expert panel of stroke physicians, while subsequent ranking exercises allowed remaining options to be ranked by a wider group of experts within stroke to reach consensus. The preferred implementation option for thrombectomy is investigating suspected acute stroke patients by CT/CT Angiography and secondary transfer of large artery occlusive stroke patients to the nearest neuroscience (thrombectomy) centre.

Use of cultural consensus analysis to evaluate expert feedback of median safety.

PubMed

Kim, Tae-Gyu; Donnell, Eric T; Lee, Dongmin

2008-07-01

Cultural consensus analysis is a statistical method that can be used to assess participant responses to survey questions. The technique concurrently estimates the knowledge of each survey participant and estimates the culturally correct answer to each question asked, based on the existence of consensus among survey participants. The main objectives of this paper are to present the cultural consensus methodology and apply it to a set of median design and safety survey data that were collected using the Delphi method. A total of 21 Delphi survey participants were asked to answer research questions related to cross-median crashes. It was found that the Delphi panel had agreeable opinions with respect to the association of average daily traffic (ADT) and heavy vehicle percentage combination on the risk of cross-median crashes; relative importance of additional factors, other than ADT, median width, and crash history that may contribute to cross-median crashes; and, the relative importance of geometric factors that may be associated with the likelihood of cross-median crashes. Therefore, the findings from the cultural consensus analysis indicate that the expert panel selected to participate in the Delphi survey shared a common knowledge pool relative to the association between median design and safety. There were, however, diverse opinions regarding median barrier type and its preferred placement location. The panel showed a higher level of knowledge on the relative importance regarding the association of geometric factors on cross-median crashes likelihood than on other issues considered. The results of the cultural consensus analysis of the present median design and safety survey data could be used to design a focused field study of median safety.

Developing a measure of provider adherence to improve the implementation of behavioral health services in primary care: a Delphi study

PubMed Central

2013-01-01

Background The integration of behavioral health services into primary care is increasingly popular, yet fidelity of implementation in this area has been infrequently assessed due to the few measurement tools available. A sentinel indicator of fidelity of implementation is provider adherence, or utilization of prescribed procedures and engagement in model-specific behaviors. This study aimed to develop the first self-report measure of behavioral health provider adherence for co-located, collaborative care, a commonly adopted model of behavioral health service delivery in primary care. Methods A preliminary 56-item measure was developed by the research team to represent critical components of adherence among behavioral health providers. To ensure the content validity of the measure, a modified Delphi study was conducted using a panel of co-located, collaborative care model experts. During three rounds of emailed surveys, panel members provided qualitative feedback regarding item content while rating each item’s relevance for behavioral health provider practice. Items with consensus ratings of 80% or greater were included in the final adherence measure. Results The panel consisted of 25 experts representing the Department of Veterans Affairs, the Department of Defense, and academic and community health centers (total study response rate of 76%). During the Delphi process, two new items were added to the measure, four items were eliminated, and a high level of consensus was achieved on the remaining 54 items. Experts identified 38 items essential for model adherence, six items compatible (although not essential) for model adherence, and 10 items that represented prohibited behaviors. Item content addressed several domains, but primarily focused on behaviors related to employing a time-limited, brief treatment model, the scope of patient concerns addressed, and interventions used by providers. Conclusions This study yielded the first content valid self-report measure of critical components of collaborative care adherence for use by behavioral health providers in primary care. Although additional psychometric evaluation is necessary, this measure may assist implementation researchers in clarifying how provider behaviors contribute to clinical outcomes. This measure may also assist clinical stakeholders in monitoring implementation and identifying ways to support frontline providers in delivering high quality services. PMID:23406425

Current opinion and consensus statement regarding the diagnosis, prognosis, and treatment of patients with essential thrombocythemia: a survey of the Spanish Group of Ph-negative Myeloproliferative Neoplasms (GEMFIN) using the Delphi method.

PubMed

Besses, C; Hernández-Boluda, J C; Pérez Encinas, M; Raya, J M; Hernández-Rivas, J M; Jiménez Velasco, A; Martínez Lopez, J; Vicente, V; Burgaleta, C

2016-04-01

The current consensus on the diagnosis, prognosis, and treatment of essential thrombocythemia (ET) is based on experts' recommendations. However, several aspects of the diagnosis of, prognosis of, and therapy for ET are still controversial. The Delphi method was employed with an expert panel of members of the Spanish Group of Ph-negative Myeloproliferative Neoplasms in order to identify the degree of agreement on the diagnosis, prognosis, and treatment of ET. Nine leading experts selected a total of 41 clinical hematologists with well-known expertise in ET. An electronic questionnaire was used to collect the questions rated in a four-step scale. The questions were grouped into four blocks: diagnosis, risk stratification, goals of therapy, and treatment strategy. After the first round consisting of 80 questions, a second round including 14 additional questions focused on the recommendations advocated by experts of the European LeukemiaNet in 2011 was analyzed. The median and mean values for the first and second rounds were calculated. A summary of the conclusions considered as the most representative of each block of questions is presented. The Delphi method is a powerful instrument to address the current approaches and controversies surrounding ET.

Research Priorities for NCD Prevention and Climate Change: An International Delphi Survey

PubMed Central

Colagiuri, Ruth; Boylan, Sinead; Morrice, Emily

2015-01-01

Climate change and non-communicable diseases (NCDs) are arguably the greatest global challenges of the 21st Century. However, the confluence between them remains under-examined and there is little evidence of a comprehensive, systematic approach to identifying research priorities to mitigate their joint impact. Consequently, we: (i) convened a workshop of academics (n = 25) from the Worldwide Universities Network to identify priority areas at the interface between NCDs and climate change; (ii) conducted a Delphi survey of international opinion leaders in public health and relevant other disciplines; and (iii) convened an expert panel to review and advise on final priorities. Three research areas (water security; transport; conceptualising NCD harms to support policy formation) were listed among the top 10 priorities by >90% of Delphi respondents, and ranked among the top 12 priorities by >60% of respondents who ranked the order of priority. A fourth area (reducing the carbon footprint of cities) was ranked highest by the same >60% of respondents. Our results are consistent with existing frameworks on health and climate change, and extends them by focusing specifically on NCDs. Researching these priorities could progress understanding of climate change and NCDs, and inform global and national policy decisions for mitigating associated harms. PMID:26501301

Japanese Clinical Guidelines for Endoscopic Treatment of Pancreatolithiasis.

PubMed

Inui, Kazuo; Igarashi, Yoshinori; Irisawa, Atsushi; Ohara, Hirotaka; Tazuma, Susumu; Hirooka, Yoshiki; Fujita, Naotaka; Miyakawa, Hiroyuki; Sata, Naohiro; Shimosegawa, Tooru; Tanaka, Masao; Shiratori, Keiko; Sugiyama, Masanori; Takeyama, Yoshifumi

2015-10-01

In addition to surgery, procedures for patients with pancreatolithiasis are developing; therefore, establishing practical guidelines for the management of pancreatolithiasis is required. Three committees (the professional committee for asking clinical questions (CQs) and statements by Japanese endoscopists, the expert panel committee for rating statements by the modified Delphi method, and the evaluating committee by moderators) were organized. Eight endoscopists and a surgeon for pancreatolithiasis made the CQs and statements from a total of 694 reports of published literature by PubMed search (from 1983 to 2012). The expert panelists individually rated these clinical statements using a modified Delphi approach, in which a clinical statement receiving a median score greater than 7 on a 9-point scale from the panel was regarded as valid. The professional committee made 3, 7, and 10 CQs and statements for the concept and pathogenesis, diagnosis, and treatment, respectively. The expert panelists regarded them as valid after a 2-round modified Delphi approach. After evaluation by the moderators, the Japanese clinical guidelines for pancreatolithiasis were established. Further discussions and studies for international guidelines are needed.

Outcomes of Moral Case Deliberation - the development of an evaluation instrument for clinical ethics support (the Euro-MCD)

PubMed Central

2014-01-01

Background Clinical ethics support, in particular Moral Case Deliberation, aims to support health care providers to manage ethically difficult situations. However, there is a lack of evaluation instruments regarding outcomes of clinical ethics support in general and regarding Moral Case Deliberation (MCD) in particular. There also is a lack of clarity and consensuses regarding which MCD outcomes are beneficial. In addition, MCD outcomes might be context-sensitive. Against this background, there is a need for a standardised but flexible outcome evaluation instrument. The aim of this study was to develop a multi-contextual evaluation instrument measuring health care providers’ experiences and perceived importance of outcomes of Moral Case Deliberation. Methods A multi-item instrument for assessing outcomes of Moral Case Deliberation (MCD) was constructed through an iterative process, founded on a literature review and modified through a multistep review by ethicists and health care providers. The instrument measures perceived importance of outcomes before and after MCD, as well as experienced outcomes during MCD and in daily work. A purposeful sample of 86 European participants contributed to a Delphi panel and content validity testing. The Delphi panel (n = 13), consisting of ethicists and ethics researchers, participated in three Delphi-rounds. Health care providers (n = 73) participated in the content validity testing through ‘think-aloud’ interviews and a method using Content Validity Index. Results The development process resulted in the European Moral Case Deliberation Outcomes Instrument (Euro-MCD), which consists of two sections, one to be completed before a participant’s first MCD and the other after completing multiple MCDs. The instrument contains a few open-ended questions and 26 specific items with a corresponding rating/response scale representing various MCD outcomes. The items were categorised into the following six domains: Enhanced emotional support, Enhanced collaboration, Improved moral reflexivity, Improved moral attitude, Improvement on organizational level and Concrete results. Conclusions A tentative instrument has been developed that seems to cover main outcomes of Moral Case Deliberation. The next step will be to test the Euro-MCD in a field study. PMID:24712735

Outcomes of moral case deliberation--the development of an evaluation instrument for clinical ethics support (the Euro-MCD).

PubMed

Svantesson, Mia; Karlsson, Jan; Boitte, Pierre; Schildman, Jan; Dauwerse, Linda; Widdershoven, Guy; Pedersen, Reidar; Huisman, Martijn; Molewijk, Bert

2014-04-08

Clinical ethics support, in particular Moral Case Deliberation, aims to support health care providers to manage ethically difficult situations. However, there is a lack of evaluation instruments regarding outcomes of clinical ethics support in general and regarding Moral Case Deliberation (MCD) in particular. There also is a lack of clarity and consensuses regarding which MCD outcomes are beneficial. In addition, MCD outcomes might be context-sensitive. Against this background, there is a need for a standardised but flexible outcome evaluation instrument. The aim of this study was to develop a multi-contextual evaluation instrument measuring health care providers' experiences and perceived importance of outcomes of Moral Case Deliberation. A multi-item instrument for assessing outcomes of Moral Case Deliberation (MCD) was constructed through an iterative process, founded on a literature review and modified through a multistep review by ethicists and health care providers. The instrument measures perceived importance of outcomes before and after MCD, as well as experienced outcomes during MCD and in daily work. A purposeful sample of 86 European participants contributed to a Delphi panel and content validity testing. The Delphi panel (n = 13), consisting of ethicists and ethics researchers, participated in three Delphi-rounds. Health care providers (n = 73) participated in the content validity testing through 'think-aloud' interviews and a method using Content Validity Index. The development process resulted in the European Moral Case Deliberation Outcomes Instrument (Euro-MCD), which consists of two sections, one to be completed before a participant's first MCD and the other after completing multiple MCDs. The instrument contains a few open-ended questions and 26 specific items with a corresponding rating/response scale representing various MCD outcomes. The items were categorised into the following six domains: Enhanced emotional support, Enhanced collaboration, Improved moral reflexivity, Improved moral attitude, Improvement on organizational level and Concrete results. A tentative instrument has been developed that seems to cover main outcomes of Moral Case Deliberation. The next step will be to test the Euro-MCD in a field study.

What do adolescents and young adults want from cancer resources? Insights from a Delphi panel of AYA patients.

PubMed

Cheung, Christabel K; Zebrack, Brad

2017-01-01

Cancer treatment programs and community-based support organizations are increasingly producing information and support resources geared to adolescent and young adult patients (AYAs); however, systematically-derived knowledge about user preferences for these resources is lacking. The primary purpose of this study was to generate findings from informed AYA cancer patients that resource developers can use to create products consistent with AYAs' expressed preferences for information and support. Utilizing a modified Delphi technique, AYA cancer patients identified barriers to optimal AYA cancer care, cancer resources that address their needs, and specific characteristics of cancer resources they find helpful. The Delphi panel consisted of a convenience sample of 21 patients aged 18-39 years, who were diagnosed with cancer between ages 15-39 and were no more than 8 years out from cancer treatment at the time of the study. Survey data were collected in three consecutive and iterative rounds over the course of 6 months in 2015. Findings indicated that AYA patients prefer resources that reduce feelings of loneliness, create a sense of community or belonging, and provide opportunities to meet other AYA patients. Among the top barriers to optimal cancer care, AYAs identified a lack of cancer care providers specializing in AYA care, a lack of connection to an AYA patient community, and their own lack of ability to navigate the health system. Participants also described aspects of cancer information and supportive care resources that they believe address AYAs' concerns. Information derived from this study will help developers of cancer information and support resources to better reach their intended audience. From the point of view of AYA cancer patients, optimal cancer care and utilization of information and support resources requires that cancer support programs foster meaningful connections among AYA patients. Results also suggest that patient resources should equip AYAs with practical knowledge and skills necessary to navigate the health system and advocate for themselves. Given patient interest in social media, future research should further investigate optimizing online resources to serve the AYA cancer population.

Development of a Quality of Meals and Meal Service Set of Indicators for Residential Facilities for Elderly.

PubMed

Van Damme, N; Buijck, B; Van Hecke, A; Verhaeghe, S; Goossens, E; Beeckman, D

2016-01-01

To develop a content validated set of indicators to evaluate the quality of meals and meal service in residential facilities for elderly. Inadequate food intake is an important risk factor for malnutrition in residential facilities for elderly. Through better meeting the needs and preferences of residents and optimization of meals and meal service, residents' food intake can improve. No indicators were available which could help to guide strategies to improve the quality of meals and meal service. The indicator set was developed according to the Indicator Development Manual of the Dutch Institute for Health Care Improvement (CBO). The working group consisted of three nurse researchers and one expert in gastrology and had expertise in elderly care, malnutrition, indicator development, and food quality. A preliminary list of potential indicators was compiled using the literature and the working group's expertise. Criteria necessary to measure the indicator in practice were developed for each potential indicator. In a double Delphi procedure, the list of potential indicators and respective criteria were analyzed for content validity, using a multidisciplinary expert panel of 11 experts in elderly meal care. A preliminary list of 20 quality indicators, including 45 criteria, was submitted to the expert panel in a double Delphi procedure. After the second Delphi round, 13 indicators and 25 criteria were accepted as having content validity. The content validity index (CVI) ranged from 0.83 to 1. The indicator set consisted of six structural, four result, and three outcome indicators covering the quality domains food, service and choice, as well as nutritional screening. The criteria measure diverse aspects of meal care which are part of the responsibility of kitchen staff and health care professionals. The 'quality of meals and meal service' set of indicators is a resource to map meal quality in residential facilities for elderly. As soon as feasibility tests in practice are completed, the indicator set can be used to guide meal and meal service quality improvement projects in collaboration with kitchen staff and health care professionals. These improvement projects will help to improve food intake and reduce the risk of malnutrition among elders living in residential facilities.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

In search for a public health leadership competency framework to support leadership curriculum-a consensus study.

PubMed

Czabanowska, Katarzyna; Smith, Tony; Könings, Karen D; Sumskas, Linas; Otok, Robert; Bjegovic-Mikanovic, Vesna; Brand, Helmut

2014-10-01

Competency-based education is increasingly popular, especially in the area of continuing professional development. Many competency frameworks have been developed; however, few address leadership competencies for European public health professionals. The aim of this study was to develop a public health leadership competency framework to inform a leadership curriculum for public health professionals. The framework was developed as part of the Leaders for European Public Health project-supported by the EU Lifelong Learning Programme. The study was carried out in three phases: a literature review, consensus development panel and Delphi survey. The public health leadership competency framework was initially developed from a literature review. A preliminary list of competencies was submitted to a panel of experts. Two consensus development panels were held to evaluate and make changes to the initial draft competency framework. Then two rounds of a Delphi survey were carried out in an effort to reach consensus. Both surveys were presented through Survey Monkey to members of the Association of the Schools of Public Health in the European Region Working Group on Innovation in Public Health Teaching and Education. The framework was developed consisting of 52 competencies organized into eight domains: Systems Thinking; Political Leadership; Collaborative Leadership: Building and Leading Interdisciplinary Teams; Leadership and Communication; Leading Change; Emotional Intelligence and Leadership in Team-based Organizations; Leadership, Organizational Learning and Development and Ethics and Professionalism. The framework can serve as a useful tool in identifying gaps in knowledge and skills, and shaping competency-based continuing professional development leadership curricula for public health professionals in Europe. © The Author 2013. Published by Oxford University Press on behalf of the European Public Health Association. All rights reserved.

Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology.

PubMed

Eubank, Breda H; Mohtadi, Nicholas G; Lafave, Mark R; Wiley, J Preston; Bois, Aaron J; Boorman, Richard S; Sheps, David M

2016-05-20

Patients presenting to the healthcare system with rotator cuff pathology do not always receive high quality care. High quality care occurs when a patient receives care that is accessible, appropriate, acceptable, effective, efficient, and safe. The aim of this study was twofold: 1) to develop a clinical pathway algorithm that sets forth a stepwise process for making decisions about the diagnosis and treatment of rotator cuff pathology presenting to primary, secondary, and tertiary healthcare settings; and 2) to establish clinical practice guidelines for the diagnosis and treatment of rotator cuff pathology to inform decision-making processes within the algorithm. A three-step modified Delphi method was used to establish consensus. Fourteen experts representing athletic therapy, physiotherapy, sport medicine, and orthopaedic surgery were invited to participate as the expert panel. In round 1, 123 best practice statements were distributed to the panel. Panel members were asked to mark "agree" or "disagree" beside each statement, and provide comments. The same voting method was again used for round 2. Round 3 consisted of a final face-to-face meeting. In round 1, statements were grouped and reduced to 44 statements that met consensus. In round 2, five statements reached consensus. In round 3, ten statements reached consensus. Consensus was reached for 59 statements representing five domains: screening, diagnosis, physical examination, investigations, and treatment. The final face-to-face meeting was also used to develop clinical pathway algorithms (i.e., clinical care pathways) for three types of rotator cuff pathology: acute, chronic, and acute-on-chronic. This consensus guideline will help to standardize care, provide guidance on the diagnosis and treatment of rotator cuff pathology, and assist in clinical decision-making for all healthcare professionals.

Establishing cross-discipline consensus on contraception, pregnancy and breast feeding-related educational messages and clinical practices to support women with rheumatoid arthritis: an Australian Delphi study

PubMed Central

Jordan, Joanne E; Ackerman, Ilana N; Van Doornum, Sharon

2016-01-01

Objective Recognising the need for a best-practice and consistent approach in providing care to women with rheumatoid arthritis (RA) in relation to (1) general health, (2) contraception, (3) conception and pregnancy, (4) breast feeding and (5) early parenting, we sought to achieve cross-discipline, clinical consensus on key messages and clinical practice behaviours in these 5 areas. Design 3-round eDelphi study. In round 1, panellists provided free-text responses to open-ended questions about care for women with RA across the 5 areas. Subsequently, panellists refined and scored the synthesised responses, presented as metathemes, themes and detailed elements. Where ≥5% of panellists did not support a theme in a given round, it was removed. Setting Panel of practicing Australian rheumatologists (n=22), obstetricians/obstetric medicine physicians (n=9) and pharmacists (n=5). Results 34 (94.4%) panellists participated in all 3 rounds. The panel supported 18 themes across the 5 areas (support/strongly support: 88.2–100%) underpinned by 5 metathemes. Metathemes focused on coordination in information delivery, the mode and timing of information delivery, evidence underpinning information, engagement of the right health professionals at the right time and a non-judgemental approach to infant feeding. Themes included practices for primary prevention of chronic disease and their sequelae, the importance of contraception and planning pregnancy and breast feeding, close monitoring of medications, supporting mental well-being, managing disease activity and providing practical support for early parenting. Conclusions A cross-disciplinary clinical panel highly supported key information and clinical practices in the care for women with RA across the continuum of contraception to early parenting within a whole-person, chronic disease management approach. PMID:27633637

A Comparative Study of the Perceptions of Professional Staff on Their Contribution to Student Outcomes

ERIC Educational Resources Information Center

Regan, Julie-Anne; Dollard, Emma; Banks, Nicci

2014-01-01

This study examined the perceptions of professional staff on their contribution to student outcomes. An online Delphi survey method was used to collect data from two expert panels: professional staff based in faculties and professional staff based in central university departments. The aim of this method is for the panels to reach consensus. The…

Global health resource utilization associated with pacemaker complications.

PubMed

Waweru, Catherine; Steenrod, Anna; Wolff, Claudia; Eggington, Simon; Wright, David Jay; Wyrwich, Kathleen W

2017-07-01

To estimate health resource utilization (HRU) associated with the management of pacemaker complications in various healthcare systems. Electrophysiologists (EPs) from four geographical regions (Western Europe, Australia, Japan, and North America) were invited to participate. Survey questions focused on HRU in the management of three chronic pacemaker complications (i.e. pacemaker infections requiring extraction, lead fractures/insulation breaches requiring replacement, and upper extremity deep venous thrombosis [DVT]). Panelists completed a maximum of two web-based surveys (iterative rounds). Mean, median values, and interquartile ranges were calculated and used to establish consensus. Overall, 32 and 29 panelists participated in the first and second rounds of the Delphi panel, respectively. Consensus was reached on treatment and HRU associated with a typical pacemaker implantation and complications. HRU was similar across regions, except for Japan, where panelists reported the longest duration of hospital stay in all scenarios. Infections were the most resource-intensive complications and were characterized by intravenous antibiotics days of 9.6?13.5 days and 21.3?29.2 days for pocket and lead infections respectively; laboratory and diagnostic tests, and system extraction and replacement procedures. DVT, on the other hand, was the least resource intensive complication. The results of the panel represent the views of the respondents who participated and may not be generalizable outside of this panel. The surveys were limited in scope and, therefore, did not include questions on management of acute complications (e.g. hematoma, pneumothorax). The Delphi technique provided a reliable and efficient approach to estimating resource utilization associated with chronic pacemaker complications. Estimates from the Delphi panel can be used to generate costs of pacemaker complications in various regions.

Youth injury prevention in Canada: use of the Delphi method to develop recommendations.

PubMed

Pike, Ian; Piedt, Shannon; Davison, Colleen M; Russell, Kelly; Macpherson, Alison K; Pickett, William

2015-12-22

The Health Behaviour in School-aged Children Survey is one of very few cross-national health surveys that includes information on injury occurrence and prevention within adolescent populations. A collaboration to develop a Canadian youth injury report using these data resulted in, Injury among Young Canadians: A national study of contextual determinants. The objective of this study was to develop specific evidence-based, policy-oriented recommendations arising from the national report, using a modified-Delphi process with a panel of expert stakeholders. Eight injury prevention experts and a 3-person youth advisory team associated with a Canadian injury prevention organization (Parachute Canada) reviewed, edited and commented on report recommendations through a three-stage iterative modified-Delphi process. From an initial list of 27 draft recommendations, the modified-Delphi process resulted in a final list of 19 specific recommendations, worded to resonate with the group(s) responsible to lead or take the recommended action. Two recommendations were rated as "extremely important" or "very important" by 100 % of the expert panel, two were deleted, a further two recommendations were deleted but the content included as text in the report, and four were merged with other existing recommendations. The modified-Delphi process was an appropriate method to achieve agreement on 19 specific evidence-based, policy-oriented recommendations to complement the national youth injury report. In providing their input, it is noted that the injury stakeholders each acted as individual experts, unattached to any organizational position or policy. These recommendations will require multidisciplinary collaborations in order to support the proposed policy development, additional research, programming and clear decision-making for youth injury prevention.

Evaluating the construct of triage acuity against a set of reference vignettes developed via modified Delphi method.

PubMed

Twomey, Michèle; Wallis, Lee A; Myers, Jonathan E

2014-07-01

To evaluate the construct of triage acuity as measured by the South African Triage Scale (SATS) against a set of reference vignettes. A modified Delphi method was used to develop a set of reference vignettes. Delphi participants completed a 2-round consensus-building process, and independently assigned triage acuity ratings to 100 written vignettes unaware of the ratings given by others. Triage acuity ratings were summarised for all vignettes, and only those that reached 80% consensus during round 2 were included in the reference set. Triage ratings for the reference vignettes given by two independent experts using the SATS were compared with the ratings given by the international Delphi panel. Measures of sensitivity, specificity, associated percentages for over-triage/under-triage were used to evaluate the construct of triage acuity (as measured by the SATS) by examining the association between the ratings by the two experts and the international panel. On completion of the Delphi process, 42 of the 100 vignettes reached 80% consensus on their acuity rating and made up the reference set. On average, over all acuity levels, sensitivity was 74% (CI 64% to 82%), specificity 92% (CI 87% to 94%), under-triage occurred 14% (CI 8% to 23%) and over-triage 12% (CI 8% to 23%) of the time. The results of this study provide an alternative to evaluating triage scales against the construct of acuity as measured with the SATS. This method of using 80% consensus vignettes may, however, systematically bias the validity estimate towards better performance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

A European Competence Framework for Industrial Pharmacy Practice in Biotechnology.

PubMed

Atkinson, Jeffrey; Crowley, Pat; De Paepe, Kristien; Gennery, Brian; Koster, Andries; Martini, Luigi; Moffat, Vivien; Nicholson, Jane; Pauwels, Gunther; Ronsisvalle, Giuseppe; Sousa, Vitor; van Schravendijk, Chris; Wilson, Keith

2015-07-29

The PHAR-IN (" Competences for industrial pharmacy practice in biotechnology ") looked at whether there is a difference in how industrial employees and academics rank competences for practice in the biotechnological industry. A small expert panel consisting of the authors of this paper produced a biotechnology competence framework by drawing up an initial list of competences then ranking them in importance using a three-stage Delphi process. The framework was next evaluated and validated by a large expert panel of academics ( n = 37) and industrial employees ( n = 154). Results show that priorities for industrial employees and academics were similar. The competences for biotechnology practice that received the highest scores were mainly in: "Research and Development", '"Upstream" and "Downstream" Processing', "Product development and formulation", "Aseptic processing", "Analytical methodology", "Product stability", and "Regulation". The main area of disagreement was in the category "Ethics and drug safety" where academics ranked competences higher than did industrial employees.

Chiropractic management of low back disorders: report from a consensus process.

PubMed

Globe, Gary A; Morris, Craig E; Whalen, Wayne M; Farabaugh, Ronald J; Hawk, Cheryl

2008-01-01

Although a number of guidelines addressing manipulation, an important component of chiropractic professional care, exist, none to date have incorporated a broad-based consensus of chiropractic research and clinical experts representing mainstream chiropractic practice into a practical document designed to provide standardized parameters of care. The purpose of this project was to develop such a document. Development of the document began with seed materials, from which seed statements were distilled. These were circulated electronically to the Delphi panel until consensus was reached, which was considered to be present when there was agreement by at least 80% of the panelists. The panel consisted of 40 clinically experienced doctors of chiropractic, representing 15 chiropractic colleges and 16 states, as well as both the American Chiropractic Association and the International Chiropractic Association. The panel reached 80% consensus of the 27 seed statements after 2 rounds. Specific recommendations regarding treatment frequency and duration, as well as outcome assessment and contraindications for manipulation were agreed upon by the panel. A broad-based panel of experienced chiropractors was able to reach a high level (80%) of consensus regarding specific aspects of the chiropractic approach to care for patients with low back pain, based on both the scientific evidence and their clinical experience.

Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel

PubMed Central

Boulkedid, Rym; Sibony, Olivier; Goffinet, François; Fauconnier, Arnaud; Branger, Bernard; Alberti, Corinne

2013-01-01

Objective Measuring the quality of inpatient obstetrical care using quality indicators is becoming increasingly important for both patients and healthcare providers. However, there is no consensus about which measures are optimal. We describe a modified Delphi method to identify a set of indicators for continuously monitoring the quality of maternity care by healthcare professionals. Methodology and Main Findings An international French-speaking multidisciplinary panel comprising 22 obstetricians-gynaecologists, 12 midwives, and 1 paediatrician assessed potential indicators extracted from a medical literature search, using a two-round Delphi procedure followed by a physical meeting. Each panellist rated each indicator based on validity and feasibility. In the first round, 35 panellists from 5 countries and 20 maternity units evaluated 26 indicators including 15 related to the management of the overall population of pregnant women, 3 to the management of women followed from the first trimester of pregnancy, 2 to the management of low-risk pregnant women, and 6 to the management of neonates. 25 quality indicators were kept for next step. In the second round, 27 (27/35: 77%) panellists selected 17 indicators; the remaining 8 indicators were discussed during a physical meeting. The final set comprised 18 indicators. Conclusion A multidisciplinary panel selected indicators that reflect the quality of obstetrical care. This set of indicators could be used to assess and monitor obstetrical care, with the goal of improving the quality of care in maternity units. PMID:23577143

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Developing tools for identifying employer and employee satisfaction of nursing new graduates in China.

PubMed

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study.

Using a Delphi Method to Identify Human Factors Contributing to Nursing Errors.

PubMed

Roth, Cheryl; Brewer, Melanie; Wieck, K Lynn

2017-07-01

The purpose of this study was to identify human factors associated with nursing errors. Using a Delphi technique, this study used feedback from a panel of nurse experts (n = 25) on an initial qualitative survey questionnaire followed by summarizing the results with feedback and confirmation. Synthesized factors regarding causes of errors were incorporated into a quantitative Likert-type scale, and the original expert panel participants were queried a second time to validate responses. The list identified 24 items as most common causes of nursing errors, including swamping and errors made by others that nurses are expected to recognize and fix. The responses provided a consensus top 10 errors list based on means with heavy workload and fatigue at the top of the list. The use of the Delphi survey established consensus and developed a platform upon which future study of nursing errors can evolve as a link to future solutions. This list of human factors in nursing errors should serve to stimulate dialogue among nurses about how to prevent errors and improve outcomes. Human and system failures have been the subject of an abundance of research, yet nursing errors continue to occur. © 2016 Wiley Periodicals, Inc.

Delphi based consensus study into planning for chemical incidents.

PubMed

Crawford, I W F; Mackway-Jones, K; Russell, D R; Carley, S D

2004-01-01

To achieve consensus in all phases of chemical incident planning and response. A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required.

Delphi based consensus study into planning for chemical incidents

PubMed Central

Crawford, I; Mackway-Jones, K; Russell, D; Carley, S

2004-01-01

Objective: To achieve consensus in all phases of chemical incident planning and response. Design: A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. Results: A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. Conclusions: The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required. PMID:14734369

Clinical Decision-Making Tool for Safe and Effective Prescription of Exercise in Acute Exacerbations of Chronic Obstructive Pulmonary Disease: Results From an Interdisciplinary Delphi Survey and Focus Groups.

PubMed

Camp, Pat G; Reid, W Darlene; Chung, Frank; Kirkham, Ashley; Brooks, Dina; Goodridge, Donna; Marciniuk, Darcy D; Hoens, Alison M

2015-10-01

Exercise is recommended for people with an acute exacerbation of chronic obstructive pulmonary disease (AECOPD), yet there is little information to guide safe and effective mobilization and exercise for these patients. The purpose of this study was to develop a clinical decision-making tool to guide health care professionals in the assessment, prescription, monitoring, and progression of mobilization and therapeutic exercise for patients with AECOPD. A 3-round interdisciplinary Delphi panel identified and selected items based on a preselected consensus of 80%. These items were summarized in a paper-based tool titled Mobilization in Acute Exacerbations of Chronic Obstructive Pulmonary Disease (AECOPD-Mob). Focus groups and questionnaires were subsequently used to conduct a sensibility evaluation of the tool. Nine researchers, 13 clinicians, and 7 individuals with COPD identified and approved 110 parameters for safe and effective exercise in AECOPD. These parameters were grouped into 5 categories: (1) "What to Assess Prior to Mobilization," (2) "When to Consider Not Mobilizing or to Discontinue Mobilization," (3) "What to Monitor During Mobilization for Patient Safety," (4) "How to Progress Mobilization to Enhance Effectiveness," and (5) "What to Confirm Prior to Discharge." The tool was evaluated in 4 focus groups of 18 health care professionals, 90% of whom reported the tool was easy to use, was concise, and would guide a health care professional who is new to the acute care setting and working with patients with AECOPD. The tool was developed based on published evidence and expert opinion, so the applicability of the items to patients in all settings cannot be guaranteed. The Delphi panel consisted of health care professionals from Canada, so items may not be generalizable to other jurisdictions. The AECOPD-Mob provides practical and concise information on safe and effective exercise for the AECOPD population for use by the new graduate or novice acute care practitioner. © 2015 American Physical Therapy Association.

Building a Privacy, Ethics, and Data Access Framework for Real World Computerised Medical Record System Data: A Delphi Study. Contribution of the Primary Health Care Informatics Working Group.

PubMed

Liyanage, H; Liaw, S-T; Di Iorio, C T; Kuziemsky, C; Schreiber, R; Terry, A L; de Lusignan, S

2016-11-10

Privacy, ethics, and data access issues pose significant challenges to the timely delivery of health research. Whilst the fundamental drivers to ensure that data access is ethical and satisfies privacy requirements are similar, they are often dealt with in varying ways by different approval processes. To achieve a consensus across an international panel of health care and informatics professionals on an integrated set of privacy and ethics principles that could accelerate health data access in data-driven health research projects. A three-round consensus development process was used. In round one, we developed a baseline framework for privacy, ethics, and data access based on a review of existing literature in the health, informatics, and policy domains. This was further developed using a two-round Delphi consensus building process involving 20 experts who were members of the International Medical Informatics Association (IMIA) and European Federation of Medical Informatics (EFMI) Primary Health Care Informatics Working Groups. To achieve consensus we required an extended Delphi process. The first round involved feedback on and development of the baseline framework. This consisted of four components: (1) ethical principles, (2) ethical guidance questions, (3) privacy and data access principles, and (4) privacy and data access guidance questions. Round two developed consensus in key areas of the revised framework, allowing the building of a newly, more detailed and descriptive framework. In the final round panel experts expressed their opinions, either as agreements or disagreements, on the ethics and privacy statements of the framework finding some of the previous round disagreements to be surprising in view of established ethical principles. This study develops a framework for an integrated approach to ethics and privacy. Privacy breech risk should not be considered in isolation but instead balanced by potential ethical benefit.

A Delphi Consensus of the Crucial Steps in Gastric Bypass and Sleeve Gastrectomy Procedures in the Netherlands.

PubMed

Kaijser, Mirjam A; van Ramshorst, Gabrielle H; Emous, Marloes; Veeger, Nic J G M; van Wagensveld, Bart A; Pierie, Jean-Pierre E N

2018-04-09

Bariatric procedures are technically complex and skill demanding. In order to standardize the procedures for research and training, a Delphi analysis was performed to reach consensus on the practice of the laparoscopic gastric bypass and sleeve gastrectomy in the Netherlands. After a pre-round identifying all possible steps from literature and expert opinion within our study group, questionnaires were send to 68 registered Dutch bariatric surgeons, with 73 steps for bypass surgery and 51 steps for sleeve gastrectomy. Statistical analysis was performed to identify steps with and without consensus. This process was repeated to reach consensus of all necessary steps. Thirty-eight participants (56%) responded in the first round and 32 participants (47%) in the second round. After the first Delphi round, 19 steps for gastric bypass (26%) and 14 for sleeve gastrectomy (27%) gained full consensus. After the second round, an additional amount of 10 and 12 sub-steps was confirmed as key steps, respectively. Thirteen steps in the gastric bypass and seven in the gastric sleeve were deemed advisable. Our expert panel showed a high level of consensus expressed in a Cronbach's alpha of 0.82 for the gastric bypass and 0.87 for the sleeve gastrectomy. The Delphi consensus defined 29 steps for gastric bypass and 26 for sleeve gastrectomy as being crucial for correct performance of these procedures to the standards of our expert panel. These results offer a clear framework for the technical execution of these procedures.

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration

PubMed Central

Chan, David; Lawrence, Ben; Pavlakis, Nick; Kennecke, Hagen F.; Jackson, Christopher; Law, Calvin; Singh, Simron

2017-01-01

Purpose Neuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan. Methods A three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan. Results The Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established. Conclusion This modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field. PMID:28831446

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration.

PubMed

Segelov, Eva; Chan, David; Lawrence, Ben; Pavlakis, Nick; Kennecke, Hagen F; Jackson, Christopher; Law, Calvin; Singh, Simron

2017-08-01

Neuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan. A three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan. The Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established. This modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field.

Indicators for evaluating European population health: a Delphi selection process.

PubMed

Freitas, Ângela; Santana, Paula; Oliveira, Mónica D; Almendra, Ricardo; Bana E Costa, João C; Bana E Costa, Carlos A

2018-04-27

Indicators are essential instruments for monitoring and evaluating population health. The selection of a multidimensional set of indicators should not only reflect the scientific evidence on health outcomes and health determinants, but also the views of health experts and stakeholders. The aim of this study is to describe the Delphi selection process designed to promote agreement on indicators considered relevant to evaluate population health at the European regional level. Indicators were selected in a Delphi survey conducted using a web-platform designed to implement and monitor participatory processes. It involved a panel of 51 experts and 30 stakeholders from different areas of knowledge and geographies. In three consecutive rounds the panel indicated their level of agreement or disagreement with indicator's relevance for evaluating population health in Europe. Inferential statistics were applied to draw conclusions on observed level of agreement (Scott's Pi interrater reliability coefficient) and opinion change (McNemar Chi-square test). Multivariate analysis of variance was conducted to check if the field of expertise influenced the panellist responses (Wilk's Lambda test). The panel participated extensively in the study (overall response rate: 80%). Eighty indicators reached group agreement for selection in the areas of: economic and social environment (12); demographic change (5); lifestyle and health behaviours (8); physical environment (6); built environment (12); healthcare services (11) and health outcomes (26). Higher convergence of group opinion towards agreement on the relevance of indicators was seen for lifestyle and health behaviours, healthcare services, and health outcomes. The panellists' field of expertise influenced responses: statistically significant differences were found for economic and social environment (p < 0.05 in round 1 and 2), physical environment (p < 0.01 in round 1) and health outcomes (p < 0.01 in round 3). The high levels of participation observed in this study, by involving experts and stakeholders and ascertaining their views, underpinned the added value of using a transparent Web-Delphi process to promote agreement on what indicators are relevant to appraise population health.

Validation of consensus panel diagnosis in dementia.

PubMed

Gabel, Matthew J; Foster, Norman L; Heidebrink, Judith L; Higdon, Roger; Aizenstein, Howard J; Arnold, Steven E; Barbas, Nancy R; Boeve, Bradley F; Burke, James R; Clark, Christopher M; Dekosky, Steven T; Farlow, Martin R; Jagust, William J; Kawas, Claudia H; Koeppe, Robert A; Leverenz, James B; Lipton, Anne M; Peskind, Elaine R; Turner, R Scott; Womack, Kyle B; Zamrini, Edward Y

2010-12-01

The clinical diagnosis of dementing diseases largely depends on the subjective interpretation of patient symptoms. Consensus panels are frequently used in research to determine diagnoses when definitive pathologic findings are unavailable. Nevertheless, research on group decision making indicates that many factors can adversely affect panel performance. To determine conditions that improve consensus panel diagnosis. Comparison of neuropathologic diagnoses with individual and consensus panel diagnoses based on clinical scenarios only, fludeoxyglucose F 18 positron emission tomography images only, and scenarios plus images. Expert and trainee individual and consensus panel deliberations using a modified Delphi method in a pilot research study of the diagnostic utility of fludeoxyglucose F 18 positron emission tomography. Forty-five patients with pathologically confirmed Alzheimer disease or frontotemporal dementia. Statistical measures of diagnostic accuracy, agreement, and confidence for individual raters and panelists before and after consensus deliberations. The consensus protocol using trainees and experts surpassed the accuracy of individual expert diagnoses when clinical information elicited diverse judgments. In these situations, consensus was 3.5 times more likely to produce positive rather than negative changes in the accuracy and diagnostic certainty of individual panelists. A rule that forced group consensus was at least as accurate as majority and unanimity rules. Using a modified Delphi protocol to arrive at a consensus diagnosis is a reasonable substitute for pathologic information. This protocol improves diagnostic accuracy and certainty when panelist judgments differ and is easily adapted to other research and clinical settings while avoiding the potential pitfalls of group decision making.

Re-development of mental health first aid guidelines for suicidal ideation and behaviour: a Delphi study.

PubMed

Ross, Anna M; Kelly, Claire M; Jorm, Anthony F

2014-09-13

Suicide continues to be a leading cause of death globally. Friends and family are considered best positioned to provide initial assistance if someone is suicidal. Expert consensus guidelines on how to do this were published in 2008. Re-developing these guidelines is necessary to ensure they contain the most current recommended helping actions and remain consistent with the suicide prevention literature. The Delphi consensus method was used to determine the importance of including helping statements in the guidelines. These statements describe helping actions a member of the public can take, and information they should have, to help someone who is experiencing suicidal thoughts. Systematic searches of the available suicide prevention literature were carried out to find helping statements. Two expert panels, comprising 41 suicide prevention professionals and 35 consumer advocates respectively, rated each statement. Statements were accepted for inclusion in the guidelines if they were endorsed by at least 80% of each panel. Out of 436 statements, 164 were endorsed as appropriate helping actions in providing assistance to someone experiencing suicidal thoughts or engaging in suicidal behaviour. These statements were used to form the re-developed guidelines. The re-development of the guidelines has resulted in more comprehensive guidance than the earlier version, with the endorsement of 164 helping actions, compared to 30 previously. These guidelines will form the basis of a suicide prevention course aimed at educating members of the public on providing first aid to someone who is experiencing suicidal thoughts.

Defining interdisciplinary competencies for audiological rehabilitation: findings from a modified Delphi study.

PubMed

Xue, Lina; Le Bot, Gaëlle; Van Petegem, Wim; van Wieringen, Astrid

2018-02-01

The aim of this study is to derive a consensus on an interdisciplinary competency framework regarding a holistic approach for audiological rehabilitation (AR), which includes disciplines from medicine, engineering, social sciences and humanities. We employed a modified Delphi method. In the first round survey, experts were asked to rate an initial list of 28 generic interdisciplinary competencies and to propose specific knowledge areas for AR. In the second round, experts were asked to reconsider their answers in light of the group answers of the first round. An international panel of 27 experts from different disciplines in AR completed the first round. Twenty-two of them completed the second round. We developed a competency framework consisting of 21 generic interdisciplinary competencies grouped in five domains and nine specific competencies (knowledge areas) in three clusters. Suggestions for the implementation of the generic competencies in interdisciplinary programmes were identified. This study reveals insights into the interdisciplinary competencies that are unique for AR. The framework will be useful for educators in developing interdisciplinary programmes as well as for professionals in considering their lifelong training needs in AR.

Competency model for dentists in China: Results of a Delphi study

PubMed Central

Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

Objective With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Methods Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Results Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. Conclusion In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China. PMID:29566048

[University studies plan in geriatric medicine developed using a modified Delphi technique].

PubMed

Vilches-Moraga, Arturo; Ariño-Blasco, Sergio; Verdejo-Bravo, Carlos; Mateos-Nozal, Jesús

2015-01-01

The increase in the number of frail elderly people has led to the necessity that all doctors of the future acquire sufficient knowledge on human ageing and the skills in the management of the patient of advanced age, as well as the diseases associated with ageing. Few countries offer geriatric medicine within undergraduate training. The purpose of the present project was to obtain a consensus between European geriatricians on the minimum requirements that medical students must achieve at the end of their university degree course. A modified Delphi process was used. Firstly, experts in education and geriatrics proposed a set of learning objectives based on a review of the literature. Three Delphi rounds were then performed, in which a panel of 49 experts representing 29 countries affiliated to the European Union of Medical Specialists took part. This enabled them to reach a consensus on a definitive study plan. The number of disagreements after the Delphi rounds 1 and 2 were 81 and 53, respectively. Full agreement was reached after the third round. The definitive study plan consisted of detailed objectives grouped under 10 general training objectives. A consensus has been reached between European geriatricians that sets specific training objectives for medical students. Great efforts will be required for the introduction of these requirements, given the variability there is in the quality of teaching in geriatrics. This study plan is a first step in helping to improve geriatrics teaching in faculties of medicine, and will also serve as a basis to make advances in the training in post-graduate geriatrics throughout Europe. Copyright © 2014 SEGG. Published by Elsevier Espana. All rights reserved.

Competency model for dentists in China: Results of a Delphi study.

PubMed

Geng, Yunxia; Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China.

The Delphi Method Online: Medical Expert Consensus Via the Internet

PubMed Central

Cam, Kenneth M.; McKnight, Patrick E.; Doctor, Jason N.

2002-01-01

Delphi is an expert consensus method. The theory behind the Delphi method is that the interaction of experts may lead to a reduction in individual bias. We have developed software that carries out all aspects of the Delphi method via the Internet. The Delphi method online consists of three components: 1) authorship, 2) interactive polling, and 3) reporting/results. We hope that researchers use this tool in future medical expert systems.

The Stammering Information Programme: a Delphi study.

PubMed

Berquez, Ali E; Cook, Frances M; Millard, Sharon K; Jarvis, Effie

2011-09-01

To find out what information children, parents and education staff feel would be important to know to support a child who stutters in the educational environment, in order to develop appropriate resources. A Delphi study was carried out to seek the opinions of experts about the information to include. A structured six stage process was completed in order to gain consensus within four expert panels: children who stutter (CWS) aged 7-11 (n=25); young people who stutter aged 12-18 (n=27); parents of children and young people who stutter aged 2-18 (n=67); and members of the education workforce (n=35). In response to the questions, 538 statements were generated across the four expert panels, categorised and reduced to 276. Of the 154 rating questionnaires sent out, 99 were returned (64.2% response rate). The top 32 statements, which were those most highly rated and with the greatest consensus, were retained to inform the resources. This study demonstrates the value of including service users when devising materials aimed for the benefit of CWS. The methodology employed ensured that ideas, perceptions and needs were representative of a range of people who experience stuttering from different perspectives. The results indicated that each expert panel had different priorities of what should be included. The resulting resources may therefore be considered to have high content validity and would be predicted to meet the needs of those who require them. The reader will be able to (1) define the Delphi Approach (2) discuss the development of a user led resource for raising awareness about stuttering. Copyright © 2011 Elsevier Inc. All rights reserved.

Defining a Bobath clinical framework - A modified e-Delphi study.

PubMed

Vaughan-Graham, Julie; Cott, Cheryl

2016-11-01

To gain consensus within the expert International Bobath Instructors Training Association (IBITA) on a Bobath clinical framework on which future efficacy studies can be based. A three-round modified e-Delphi approach was used with 204 full members of the IBITA. Twenty-one initial statements were generated from the literature. Consensus was defined a priori as at least 80% of the respondents with a level of agreement on a Likert scale of 4 or 5. The Delphi questionnaire for each round was available online for two weeks. Summary reports and subsequent questionnaires were posted within four weeks. Ninety-four IBITA members responded, forming the Delphi panel, of which 68 and 66 responded to Rounds Two and Three, respectively. The 21 initial statements were revised to 17 statements and five new statements in Round Two in which eight statements were accepted and two statements were eliminated. Round Three presented 12 revised statements, all reaching consensus. The Delphi was successful in gaining consensus on a Bobath clinical framework in a geographically diverse expert association, identifying the unique components of Bobath clinical practice. Discussion throughout all three Rounds revolved primarily around the terminology of atypical and compensatory motor behavior and balance.

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

The setting of standards for agricultural nitrogen emissions: a case study of the Delphi technique.

PubMed

Angus, A J; Hodge, I D; McNally, S; Sutton, M A

2003-12-01

The Delphi technique is a means of aggregating the judgement of a panel of experts in order to improve the quality of decision-making. This paper provides a case study of the technique by undertaking a three-round Delphi study to determine a package of best available techniques to reduce nitrogen emissions from a poultry unit under the Integrated Pollution Prevention and Control Directive (IPPC). Forms of nitrogen addressed included ammonia (NH3), nitrous oxide (N2O) nitrogen oxides (NOx), dusts and nitrate (NO3-), with the study providing a means to prioritise the pollution concerns on different spatial scales. The priority pollutant issues were the contribution of NH3 to eutrophication, the global cooling effect of NH4+ aerosol, the role of NH4+ as a vector for atmospheric transport of NOx and SO2, the contribution of N2O to global warming, and NO3- leaching. Reduced nitrogen (NHx) was rated as a priority on all scales, while N2O and NO3- were rated as priorities only on global and local scales, respectively. The study indicated the need for abatement techniques at each stage of poultry rearing and waste management, with particular attention to reduce NH3 emissions, reflecting the priority pollutant concerns. Measures identified by the panel include maintenance of dry litter, low emission removal of litter from housing and storage of litter under cover. Once the litter has left the farm, this should either be used as a biofuel for electricity generation or rapidly incorporated into agricultural soils. The amounts and timing of manure application should be tuned to crop needs. Uncertainties in the Delphi technique limit its suitability as a stand-alone decision making tool. However, the Delphi technique proved useful in identifying priority pollutant issues, areas of agreement, disagreement and where information is lacking. This demonstrates its use when dealing with the complex issues of prioritising pollution issues and abatement approaches.

Procedure competencies and job functions of the urologic advanced practice nurse.

PubMed

Kleier, Jo Ann

2009-01-01

A 2-round modified Delphi study recruited a panel urologic advanced practice nurse experts to identify the procedure competencies and job functions unique to the role of the advanced practice nurse specializing in the care of urology patients.

The impact of new and emerging technologies in the commercial aviation maintenance, repair, and overhaul industry a Delphi study

NASA Astrophysics Data System (ADS)

Gray, Janet

Purpose. The purpose of this study was to identify new or emerging technological trends and events that are likely to occur between now and 2017 that will have an impact on the commercial aviation maintenance, repair, and overhaul (MRO) industry. Further, it was the purpose of this study to examine those technological trends and events believed to provide the greatest impact and, given the experts' analysis, identify the feasibility of implementation. Methodology. This descriptive study utilized the Delphi method with a panel of twenty-four experts comprised of practitioners, theorists, and futurists. A priority matrix was utilized to determine the impact and feasibility of trend and events. Findings. The experts identified fifty-three trends and events that will impact the commercial aviation maintenance, repair, and overhaul (MRO) industry. Analysis of the priority matrix revealed eighteen trends and events were of high priority and high feasibility. Conclusions. The responses from the expert panel were examined and the findings analyzed. The following are the conclusions constructed from the data provided by the Delphi panel of experts: (1) the need to respond to the demands of the maintenance, repair, and overhaul (MRO) industry such as down time, efficiency, cost, and environmental concerns by implementing new technology, (2) the demand to integrate and implement new technology as indicative of the priority matrix scoring high importance/high feasibility, (3) to proactively address the inadequate professional development in new technologies, and (4) the consensus reached by the panel of experts of importance and feasibility of implementation of new technologies encompass eighteen trends and events. Implications and recommendations for action. The implementation of new and emerging technological advances in the commercial aviation maintenance, repair, and overhaul (MRO) industry between now and 2017 will be dependent on the technologies' capacity to reduce downtime and increase efficiency. In order to maintain America's global leadership in aviation, integration of innovated technology is key.

Mental Health First Aid guidelines for helping a suicidal person: a Delphi consensus study in the Philippines

PubMed Central

2010-01-01

Background This study aimed to develop guidelines for how a member of the Filipino public should provide mental health first aid to a person who is suicidal. Methods The guidelines were produced by developing a questionnaire containing possible first aid actions and asking an expert panel of 34 Filipino mental health clinicians to rate whether each action should be included in the guidelines. The content of the questionnaire was based on a systematic search of the relevant evidence and claims made by authors of consumer and carer guides and websites. The panel members were asked to complete the questionnaire by web survey. Three rounds of the rating were carried and, at the end of each round, items that reached the consensus criterion were selected for inclusion in the guidelines. During the first round, panel members were also asked to suggest any additional actions that were not covered in the original questionnaire (to include items that are relevant to local cultural circumstances, values, and social norms). Responses to these open-ended questions were used to generate new items. Results The output from the Delphi process was a set of agreed upon action statements. The Delphi process started with 138 statements, 48 new items were written based on suggestions from panel members and, of these 186 items, 102 met the consensus criterion. These statements were used to develop the guidelines appended to this paper. The guidelines are currently being translated into local languages. Conclusions There are a number of actions that are considered to be useful for members of the public when they encounter someone who is experiencing suicidal thoughts or engaging in suicidal behaviour. Although the guidelines are designed for members of the public, they may also be helpful to non-mental health professionals working in health and welfare settings. PMID:21167076

Pharmacy executives: leadership issues and associated skills, knowledge, and abilities in the U.S. Department of Defense.

PubMed

Meadows, Andrew B; Finstuen, Kenn; Hudak, Ronald P

2003-01-01

To identify the issues or problems that current and aspiring U.S. Department of Defense (DoD) pharmacy executives will face in the future and to define the skills, knowledge, and abilities (SKAs) required to successfully address these issues. Delphi method for executive decision making. DoD. Ninety-three pharmacists serving in the military grades of lieutenant colonel/commander and colonel/captain, as well as pharmacists selected for promotion to those grades. iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants identified five major issues believed to be of greatest importance to pharmacy executives and reported specific SKAs that might be needed to successfully manage those issues. An expert panel sorted these issues into meaningful domains, then provided an appropriate title for each domain. Round 2--on a 7-point scale, respondents rated the SKA items according to their assessment of how much a future DoD pharmacy executive would need each SKA. Response rates were 44.1% and 46.2% for Delphi rounds 1 and 2, respectively. The first round generated 62 unique issues facing pharmacy executives. The expert panel reviewed and sorted the issues into eight domains and selected an appropriate title for each domain. The domains identified by the panel were human resources, pharmacy operations/business practices, information management and technology, financial resources, formulary management, drug therapy management, pharmacy benefit management, and leadership. During round 2, 73.3% of the top 15 rated SKAs came from the drug therapy management, leadership, and formulary management domains. The three highest-rated SKAs were "ability to see the big picture," "ability to build strong relations with medical staffs," and "skills in both writing and verbal communication." The issues facing future DoD pharmacy executives will require them to expand their clinical abilities as well as their ability to collaborate and communicate with other professionals.

Mental Health First Aid guidelines for helping a suicidal person: a Delphi consensus study in Japan

PubMed Central

2011-01-01

Background This study aimed to develop guidelines for how a member of the Japanese public should provide mental health first aid to a person who is suicidal. Methods The guidelines were produced by developing a questionnaire containing possible first aid actions and asking an expert panel of 32 Japanese mental health professionals to rate whether each action should be included in the guidelines. The content of the questionnaire was based on a systematic search of the relevant evidence and claims made by authors of consumer and carer guides and websites. The panel members were asked to complete the questionnaire by web survey. Three rounds of the rating were carried and, at the end of each round, items that reached the consensus criterion were selected for inclusion in the guidelines. During the first round, panel members were also asked to suggest any additional actions that were not covered in the original questionnaire (to include items that are relevant to local cultural circumstances, values, and social norms). Responses to these open-ended questions were used to generate new items. Results The output from the Delphi process was a set of agreed upon action statements. The Delphi process started with 138 statements, 38 new items were written based on suggestions from panel members and, of these 176 items, 56 met the consensus criterion. These statements were used to develop the guidelines appended to this article. Conclusions There are a number of actions that are considered to be useful for members of the Japanese public when they encounter someone who is experiencing suicidal thoughts or engaging in suicidal behaviour. Although the guidelines are designed for members of the public, they may also be helpful to health professionals working in health and welfare settings who do not have clinical mental health training. PMID:21592409

Identification of competencies for patient education in physiotherapy using a Delphi approach.

PubMed

Forbes, Roma; Mandrusiak, Allison; Smith, Michelle; Russell, Trevor

2018-06-01

Patient education is a critical part of physiotherapy practice however an empirically derived set of competencies for its use does not exist. This study aimed to generate a set of competencies for patient education in physiotherapy using a consensus approach. A Delphi study with two rounds using a panel of expert physiotherapists within Australia was undertaken. In the first round, the panel of 12 specialist physiotherapists identified competencies required for patient education in the physiotherapy setting. Framework analysis was applied to develop a set of competencies that were assessed in the second round where ≥80% agreement of importance from the panel indicated consensus. Response rates of specialist physiotherapists agreeing to participate were 67% for the first round and 100% for the second round. Analysis following the first round produced 25 competencies. The second round resulted in agreement on a final set of 22 competencies. This study developed a concise list of competencies for patient education with a high level of expert agreement. By identifying the key competencies in this area, there is potential to benchmark patient education training and assessment of physiotherapists for improved educational and professional outcomes. Copyright © 2017 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Exploring the boundary of a specialist service for adults with intellectual disabilities using a Delphi study: a quantification of stakeholder participation.

PubMed

Hempe, Eva-Maria; Morrison, Cecily; Holland, Anthony

2015-10-01

There are arguments that a specialist service for adults with intellectual disabilities is needed to address the health inequalities that this group experiences. The boundary of such a specialist service however is unclear, and definition is difficult, given the varying experiences of the multiple stakeholder groups. The study reported here quantitatively investigates divergence in stakeholders' views of what constitutes a good specialist service for people with intellectual disabilities. It is the first step of a larger project that aims to investigate the purpose, function and design of such a specialist service. The results are intended to support policy and service development. A Delphi study was carried out to elicit the requirements of this new specialist service from stakeholder groups. It consisted of three panels (carers, frontline health professionals, researchers and policymakers) and had three rounds. The quantification of stakeholder participation covers the number of unique ideas per panel, the value of these ideas as determined by the other panels and the level of agreement within and between panels. There is some overlap of ideas about of what should constitute this specialist service, but both carers and frontline health professionals contributed unique ideas. Many of these were valued by the researchers and policymakers. Interestingly, carers generated more ideas regarding how to deliver services than what services to deliver. Regarding whether ideas are considered appropriate, the variation both within and between groups is small. On the other hand, the feasibility of solutions is much more contested, with large variations among carers. This study provides a quantified representation of the diversity of ideas among stakeholder groups regarding where the boundary of a specialist service for adults with learning disabilities should sit. The results can be used as a starting point for the design process. The study also offers one way to measure the impact of participation for those interested in participation as a mechanism for service improvement. © 2013 The Authors Health Expectations Published by John Wiley & Sons Ltd.

A European Competence Framework for Industrial Pharmacy Practice in Biotechnology

PubMed Central

Atkinson, Jeffrey; Crowley, Pat; De Paepe, Kristien; Gennery, Brian; Koster, Andries; Martini, Luigi; Moffat, Vivien; Nicholson, Jane; Pauwels, Gunther; Ronsisvalle, Giuseppe; Sousa, Vitor; van Schravendijk, Chris; Wilson, Keith

2015-01-01

The PHAR-IN (“Competences for industrial pharmacy practice in biotechnology”) looked at whether there is a difference in how industrial employees and academics rank competences for practice in the biotechnological industry. A small expert panel consisting of the authors of this paper produced a biotechnology competence framework by drawing up an initial list of competences then ranking them in importance using a three-stage Delphi process. The framework was next evaluated and validated by a large expert panel of academics (n = 37) and industrial employees (n = 154). Results show that priorities for industrial employees and academics were similar. The competences for biotechnology practice that received the highest scores were mainly in: “Research and Development”,‘“Upstream” and “Downstream” Processing’, “Product development and formulation”,“Aseptic processing”, “Analytical methodology”, “Product stability”, and “Regulation”. The main area of disagreement was in the category “Ethics and drug safety” where academics ranked competences higher than did industrial employees. PMID:28975907

Sexual Dysfunction Management and Expectations Assessment in Multiple Sclerosis-Female (SEA-MS-F): creation and validation of a specific questionnaire.

PubMed

Bisseriex, Hélène; Guinet-Lacoste, Amandine; Chevret-Méasson, Marie; Costa, Pierre; Sheikh Ismael, Samer; Rousseau, Alexandra; Amarenco, Gerard

2014-12-01

Until now, no questionnaire has been developed to study specific expectations concerning sexual dysfunction management and the availability of information on sexuality in the female population affected by multiple sclerosis (MS). Understanding and meeting the patient's expectations is an issue of considerable importance in the evaluation of medical care. We present the development and validation of a specific questionnaire designed for women with MS in order to assess their expectations in terms of sexual dysfunction management: the SEA-MS-F (Sexual Dysfunction Management and Expectations Assessment in Multiple Sclerosis-Female). This questionnaire was created and validated by an expert panel, using the Delphi method. The psychometric evaluation was obtained with a sample of 40 female MS patients. Cronbach's alpha index and principal component analysis were used to measure the questionnaire's internal consistency. A consensus on the questionnaire was reached with the Delphi method. The SEA-MS-F is fully compliant with the criteria for psychometric validation among female MS patients, and its internal consistency is excellent (Cronbach's alpha 0.948). The SEA-MS-F appears to be a useful tool that could be used either in routine medical situations or in prospective studies of MS in order to ascertain women's expectations concerning the management of their sexual dysfunction. © 2014 International Society for Sexual Medicine.

Identifying educational priorities for occupational therapy students to prepare for mental health practice in Australia and New Zealand: Opinions of practising occupational therapists.

PubMed

Scanlan, Justin Newton; Pépin, Geneviève; Haracz, Kirsti; Ennals, Priscilla; Webster, Jayne S; Meredith, Pamela J; Batten, Rachel; Bowman, Siann; Bonassi, Marianne; Bruce, Rosie

2015-10-01

The effective preparation of occupational therapy students for mental health practice is critical to facilitate positive consumer outcomes, underpin optimal practice and support new graduates' professional identity. This project was established to determine a set of 'educational priorities' for occupational therapy students to prepare them for current (and future) entry-level practice in mental health, from the perspective of mental health occupational therapists in Australia and New Zealand. The study included two phases. In Phase One, participants identified what they considered to be important educational priorities for occupational therapy students to prepare them for practice in mental health. For Phase Two, an 'expert panel' was assembled to review and rank these using a Policy Delphi approach. Eighty-five participants provided educational priorities in Phase One. These were grouped into a total of 149 educational themes. In Phase Two, the expert panel (consisting of 37 occupational therapists from diverse locations and practice settings) prioritised these themes across three Delphi rounds. A final priority list was generated dividing educational themes into three prioritised categories: 29 'Essential', 25 'Important' and 44 'Optional' priorities. Highest-ranked priorities were: clinical reasoning, client-centred practice, therapeutic use of self, functional implications of mental illness, therapeutic use of occupation and mental health fieldwork experience. The priority list developed as part of this project provides additional information to support the review of occupational therapy curricula across Australia and New Zealand to ensure that new graduates are optimally prepared for mental health practice. © 2015 Occupational Therapy Australia.

Determination of Tasks Required by Graduates of Manufacturing Engineering Technology Programs.

ERIC Educational Resources Information Center

Zirbel, Jay H.

1993-01-01

A Delphi panel of 14 experts identified 37 tasks performed by/qualities needed by manufacturing engineering technologists. Most important were work ethic, performance quality, communication skills, teamwork, computer applications, manufacturing basics, materials knowledge, troubleshooting, supervision, and global issues. (SK)

Moving forward through consensus: protocol for a modified Delphi approach to determine the top research priorities in the field of orthopaedic oncology.

PubMed

Schneider, Patricia; Evaniew, Nathan; Rendon, Juan Sebastian; McKay, Paula; Randall, R Lor; Turcotte, Robert; Vélez, Roberto; Bhandari, Mohit; Ghert, Michelle

2016-05-24

Orthopaedic oncology researchers face several obstacles in the design and execution of randomised controlled trials, including finite fiscal resources to support the rising costs of clinical research and insufficient patient volume at individual sites. As a result, high-quality research to guide clinical practice has lagged behind other surgical subspecialties. A focused approach is imperative to design a research programme that is economical, streamlined and addresses clinically relevant endpoints. The primary objective of this study will be to use a consensus-based approach to identify research priorities for international clinical trials in orthopaedic oncology. We will conduct a 3-phase modified Delphi method consisting of 2 sequential rounds of anonymous web-based questionnaires (phases I and II), and an in-person consensus meeting (phase III). Participants will suggest research questions that they believe are of particular importance to the field (phase I), and individually rate each proposed question on 5 criteria (phase II). Research questions that meet predetermined consensus thresholds will be brought forward to the consensus meeting (phase III) for discussion by an expert panel. Following these discussions, the expert panel will be asked to assign scores for each research question, and research questions meeting predetermined criteria will be brought forward for final ranking. The expert panel will then be asked to rank the top 3 research questions, and these 3 research questions will be distributed to the initial group of participants for validation. An ethics application is currently under review with the Hamilton Integrated Research Ethics Board in Hamilton, Ontario, Canada. The results of this initiative will be disseminated through peer-reviewed publications and conference presentations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Pharmacy executive leadership issues and associated skills, knowledge, and abilities.

PubMed

Meadows, Andrew B; Maine, Lucinda L; Keyes, Elizabeth K; Pearson, Kathy; Finstuen, Kenn

2005-01-01

To identify challenges that current and future pharmacy executives are facing or will face in the future and to define what skills, knowledge, and abilities (SKAs) are required to successfully negotiate these challenges. Delphi method for executive decision making. Civilian pharmacy profession. 110 pharmacists who graduated from the GlaxoSmithKline Executive Management Program for Pharmacy Leaders. Two iterations of the Delphi method for executive decision making separated by an expert panel content analysis. Round 1--participants were asked to identify five major issues they believed to be of greatest importance to pharmacy leaders in the next 5-10 years and name specific SKAs that might be needed by future leaders to successfully deal with those issues. An expert panel reviewed the issues, classified issues into specific domains, and titled each domain. Round 2-participants rated the SKAs on a 7-point scale according to their individual assessment of importance in each domain. For Delphi rounds 1 and 2, response rates were 21.8% and 18.2%, respectively. More than 100 total issue statements were identified. The expert panel sorted the issues into five domains: management and development of the pharmacy workforce, pharmacy finance, total quality management of work-flow systems, influences on the practice of pharmacy, and professional pharmacy leadership. Five of the top 15 SKAs-and all four highest ranked items--came from the professional pharmacy leadership domain, including ability to see the big picture, ability to demonstrate the value of pharmacy services, ability to lead and manage in an ethical manner, and skills for influencing an organization's senior leadership. Through successful integration of communication skills, critical thinking, and problem solving techniques, future public-sector pharmacy executives will be better equipped to effectively position their organizations and the profession for the challenges that lie ahead.

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study

PubMed Central

2017-01-01

Background Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. Objective The aim of this study was to develop and prioritize measures of digital patient engagement based on patients’ use of the US Department of Veterans Affairs (VA)’s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. Methods We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. Results All 12 experts completed the study’s three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian’s three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). Conclusions This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients’ use of VA’s My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. PMID:28550008

The development of ethical guidelines for nurses' collegiality using the Delphi method.

PubMed

Kangasniemi, Mari; Arala, Katariina; Becker, Eve; Suutarla, Anna; Haapa, Toni; Korhonen, Anne

2017-08-01

Nurses' collegiality is topical because patient care is complicated, requiring shared knowledge and working methods. Nurses' collaboration has been supported by a number of different working models, but there has been less focus on ethics. This study aimed to develop nurses' collegiality guidelines using the Delphi method. Two online panels of Finnish experts, with 35 and 40 members, used the four-step Delphi method in December 2013 and January 2014. They reformulated the items of nurses' collegiality identified by the literature and rated based on validity and importance. Content analysis and descriptive statistical methods were used to analyze the data, and the nurses' collegiality guidelines were formulated. Ethical considerations: Organizational approval was received, and an informed consent was obtained from all participants. Information about the voluntary nature of participation was provided. During the first Delphi panel round, a number of items were reformulated and added, resulting in 32 reformulated items. As a result of the second round, 8 of the 32 items scored an agreement rate of more than 75%, with the most rated item being collegiality means that professionals respect each other. The item with second highest rating was collegiality has a common objective: what is best for patients, followed by the third highest which was professional ethics is the basis of collegiality. Nurses' collegiality and its content are well recognized in clinical practice but seldom studied. Collegiality can be supported by guidelines, and nurses working in clinical practice, together with teachers and managers, have shared responsibilities to support and develop it. More research in different nursing environments is needed to improve understanding of the content and practice of nursing collegiality.

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study.

PubMed

Garvin, Lynn A; Simon, Steven R

2017-05-26

Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. The aim of this study was to develop and prioritize measures of digital patient engagement based on patients' use of the US Department of Veterans Affairs (VA)'s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. All 12 experts completed the study's three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian's three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients' use of VA's My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. ©Lynn A Garvin, Steven R Simon. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.05.2017.

Family Medicine Global Health Fellowship Competencies: A Modified Delphi Study.

PubMed

Rayess, Fadya El; Filip, Anna; Doubeni, Anna; Wilson, Calvin; Haq, Cynthia; Debay, Marc; Anandarajah, Gowri; Heffron, Warren; Jayasekera, Neil; Larson, Paul; Dahlman, Bruce; Valdman, Olga; Hunt, Vince

2017-02-01

Many US medical schools and family medicine departments have responded to a growing interest in global health by developing global health fellowships. However, there are no guidelines or consensus statements outlining competencies for global health fellows. Our objective was to develop a mission and core competencies for Family Medicine Global Health Fellowships. A modified Delphi technique was used to develop consensus on fellowship competencies. A panel, comprised of 13 members with dual expertise in global health and medical education, undertook an iterative consensus process, followed by peer review, from April to December 2014. The panel developed a mission statement and identified six domains for family medicine global health fellowships: patient care, medical knowledge, professionalism, communication and leadership, teaching, and scholarship. Each domain includes a set of core and program-specific competencies. The family medicine global health competencies are intended to serve as an educational framework for the design, implementation, and evaluation of individual family medicine global health fellowship programs.

Development of quality indicators for low-risk labor care provided by midwives using a RAND-modified Delphi method.

PubMed

Ueda, Kayo; Ohtera, Shosuke; Kaso, Misato; Nakayama, Takeo

2017-09-22

In childbirth, most deliveries are low-risk, defined as spontaneous labor at full term without special high-risk facts or complications, especially in high-resource countries where maternal and perinatal mortality rates are very low. Indeed, the majority of mothers and infants have no serious conditions during labor. However, the quality of care provided is not assured, and performance may vary by birthing facility and provider. The overuse of technology in childbirth in some parts of the world is almost certainly based on assumptions like, "something can go wrong at any minute." There is a need to assess the quality of care provided for mothers and infants in low-risk labor. We aimed to develop specific quality indicators for low-risk labor care provided primarily by midwives in Japan. We used a RAND-modified Delphi method, which integrates evidence review with expert consensus development. The procedure comprises five steps: (1) literature review, including clinical practice guidelines, to extract and develop quality indicator candidates; (2) formation of a multidisciplinary panel; (3) independent panel ratings (Round 1); (4) panel meeting and independent panel ratings (Round 2); and (5) independent panel ratings (Round 3). The three independent panel ratings (Rounds 1-3) were held between July and December 2012. The assembled multidisciplinary panel comprised eight clinicians (two pediatricians, three obstetricians, and three midwives) and three mothers who were nonclinicians. Evidentiary review extracted 166 key recommendations from 32 clinical practice guidelines, and 31 existing quality indicators were added. After excluding duplicate recommendations and quality indicators, the panel discussed 25 candidate indicators. Of these, 18 were adopted, one was modified, six were not adopted, and four were added during the meeting, respectively. We established 23 quality indicators for low-risk labor care provided by midwives in labor units in Japan.

Important clinical descriptors to include in the examination and assessment of patients with femoroacetabular impingement syndrome: an international and multi-disciplinary Delphi survey.

PubMed

Reiman, M P; Thorborg, K; Covington, K; Cook, C E; Hölmich, P

2017-06-01

Determine which examination findings are key clinical descriptors of femoroacetabular impingement syndrome (FAIS) through use of an international, multi-disciplinary expert panel. A three-round Delphi survey utilizing an international, multi-disciplinary expert panel operationally defined from international publications and presentations was utilized. All six domains (subjective examination, patient-reported outcome measures, physical examination, special tests, physical performance measures, and diagnostic imaging) had at least one descriptor with 75% consensus agreement for diagnosis and assessment of FAIS. Diagnostic imaging was the domain with the highest level of agreement. Domains such as patient-reported outcome measures (PRO's) and physical examination were identified as non-diagnostic measures (rather as assessments of disease impact). Although it also had the greatest level of variability in description of examination domains, diagnostic imaging continues to be the preeminent diagnostic measure for FAIS. No single domain should be utilized as the sole diagnostic or assessment parameter for FAIS. While not all investigated domains provide diagnostic capability for FAIS, those that do not are able to serve purpose as a measure of disease impact (e.g., impairments and activity limitations). The clinical relevance of this Delphi survey is the understanding that a comprehensive assessment measuring both diagnostic capability and disease impact most accurately reflects the patient with FAIS. V.

HIV and Alcohol Research Priorities of City, State, and Federal Policymakers: Results of a Delphi Study

PubMed Central

Li, Lingfeng; Braithwaite, Ronald Scott

2015-01-01

We identified the research areas related to HIV and alcohol consumption that were of highest priority to city, state, and federal policymakers. From June to July 2014, we conducted a 3-round Delphi study to elicit from experts a list of alcohol- and HIV-related clinical trial research questions that were important to fund and rank order the list to identify questions of highest priority. Translating evidence into practice must be improved because some questions that have been extensively studied with results published in peer-reviewed journals were identified by the panel as areas needing additional research. PMID:26180968

HIV and Alcohol Research Priorities of City, State, and Federal Policymakers: Results of a Delphi Study.

PubMed

Uyei, Jennifer; Li, Lingfeng; Braithwaite, Ronald Scott

2015-09-01

We identified the research areas related to HIV and alcohol consumption that were of highest priority to city, state, and federal policymakers. From June to July 2014, we conducted a 3-round Delphi study to elicit from experts a list of alcohol- and HIV-related clinical trial research questions that were important to fund and rank order the list to identify questions of highest priority. Translating evidence into practice must be improved because some questions that have been extensively studied with results published in peer-reviewed journals were identified by the panel as areas needing additional research.

Towards an operational definition of pharmacy clinical competency

NASA Astrophysics Data System (ADS)

Douglas, Charles Allen

The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.

PubMed

Birko, Stanislav; Dove, Edward S; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts' variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions. PMID:26270647

Mapping the Demand for Serious Games in Postgraduate Medical Education Using the Entrustable Professional Activities Framework.

PubMed

Graafland, Maurits; Ten Cate, Olle; van Seventer, Jan-Pieter; Schraagen, Jan Maarten C; Schijven, Marlies P

2015-10-01

Serious games are potentially powerful tools for residency training and increasingly attract attention from medical educators. At present, serious games have little evidence-based relations with competency-based medical education, which may impede their incorporation into residency training programs. The aim of this study was to identify highly valued entrustable professional activities (EPAs) to support designers in the development of new, serious games built on a valid needs-assessment. All 149 licensed medical specialists from seven specialties in one academic hospital participated in seven different Delphi expert panels. They filled out a two-round Delphi survey, aimed at identifying the most valuable EPAs in their respective curricula. Specialists were asked to name the most highly valued EPA in their area in the first Delphi round. In the second round, the generated responses were presented and ranked according to priority by the medical specialists. Sixty-two EPAs were identified as valuable training subjects throughout five specialties. Eleven EPAs--"management of trauma patient," "chest tube placement," "laparoscopic cholecystectomy," "assessment of vital signs," "airway management," "induction of general anesthesia," "assessment of suicidal patient," "psychiatric assessment," "gastroscopy," "colonoscopy," and "resuscitation of emergency patients"--were consistently given a high score. The future medical specialist is an active learner, comfortable with digital techniques and learning strategies such as serious gaming. In order to maximize the impact and acceptance of new serious games, it is vital to select the most relevant training subjects. Although some serious games have already targeted top-priority EPAs, plenty of opportunities remain.

DARE Train-the-Trainer Pedagogy Development Using 2-Round Delphi Methodology

PubMed Central

Kua, Phek Hui Jade; Soon, Swee Sung

2016-01-01

The Dispatcher-Assisted first REsponder programme aims to equip the public with skills to perform hands-only cardiopulmonary resuscitation (CPR) and to use an automated external defibrillator (AED). By familiarising them with instructions given by a medical dispatcher during an out-of-hospital cardiac arrest call, they will be prepared and empowered to react in an emergency. We aim to formalise curriculum and standardise the way information is conveyed to the participants. A panel of 20 experts were chosen. Using Delphi methodology, selected issues were classified into open-ended and close-ended questions. Consensus for an item was established at a 70% agreement rate within the panel. Questions that had 60%–69% agreement were edited and sent to the panel for another round of voting. After 2 rounds of voting, 70 consensus statements were agreed upon. These covered the following: focus of CPR; qualities and qualifications of trainers; recognition of agonal breathing; head-tilt-chin lift; landmark for chest compression; performance of CPR when injuries are present; trainers' involvement in training lay people; modesty of female patients during CPR; AED usage; content of trainer's manual; addressing of questions and answers; updates-dissemination to trainers and attendance of refresher courses. Recommendations for pedagogy for trainers of dispatcher-assisted CPR programmes were developed. PMID:27660757

Developing a Physiotherapy-Specific Preliminary Clinical Decision-Making Tool for Oxygen Titration: A Modified Delphi Study

PubMed Central

Duong, Michelle; Bertin, Kendra; Henry, Renee; Singh, Deepti; Timmins, Nolla; Brooks, Dina; Mathur, Sunita

2014-01-01

ABSTRACT Purpose: To develop and evaluate a preliminary clinical decision-making tool (CDMT) to assist physiotherapists in titrating oxygen for acutely ill adults in Ontario. Methods: A panel of 14 experienced cardiorespiratory physiotherapists was recruited. Factors relating to oxygen titration were identified using a modified Delphi technique. Four rounds of questionnaires were conducted, during which the goals were to (1) generate factors, (2) reduce factors and debate contentious factors, (3) finalize factors and develop the preliminary CDMT, and (4) evaluate the usability of the tool in a clinical context. Results: The panel reached consensus on a total of 89 factors, which were compiled to create the preliminary CDMT. The global tool reached consensus for sensibility, receiving a mean score of 6/7 on a 7-point Likert-type scale (1=unacceptable; 7=excellent). Five of the nine individual components of evaluation of the tool achieved scores ≥6.0; the remaining four had mean scores between 5.4 and 5.9. Conclusion: This study produced a preliminary CDMT for oxygen titration, which the panel agreed was highly comprehensible and globally sensible. Further research is necessary to evaluate the sensibility and applicability of the tool in a clinical setting. PMID:25125782

A Strategic Planning Process Model for Distance Education

ERIC Educational Resources Information Center

Pisel, Kenneth P.

2008-01-01

As more institutions seek to implement or expand distance learning programs, it becomes critical to integrate distance learning programs into broader strategic visions and plans. Using the informed opinion from a panel of peer-nominated experts via iterative Delphi questionnaires, a 10-phased strategic planning process model for distance education…

Forecasting an Inclusive Future: School Counseling Strategies to Deconstruct Educational Heteronormativity

ERIC Educational Resources Information Center

Strear, Molly M.

2017-01-01

This Delphi study engaged a panel of 14 school counselor educators and school counselors in a critical discourse to generate school counseling strategies to deconstruct educational heteronormativity. This study resulted in 51 school counseling strategies that school counselors can employ to deconstruct educational heteronormativity. This article…

Fast, Flexible, and Digital: Forecasts for Occupational and Workplace Education.

ERIC Educational Resources Information Center

Ausburn, Lynna J.

2002-01-01

Three Delphi panels of occupational educators (n=16, 9, 12) forecast scenarios for the future of workplace education, which were compared with results of a literature review. Results indicated increasing alignment of practitioners' forecasts for dramatically transformed workplace education with major trends identified in the literature. (Contains…

Establishing a Taxonometric Structure for the Study of Biotechnology in Secondary School Technology Education.

ERIC Educational Resources Information Center

Wells, John G.

1994-01-01

A Delphi panel of 19 experts identified 8 main knowledge areas of biotechnology: bioprocessing, foundations, genetic engineering, agriculture, biochemistry, medicine, environment, and bioethics. Round 2 elicited 84 subdivisions and round 3 adjusted the ratings. The resulting classification suggests a different context and focus for technology…

77 FR 74859 - Proposed Flood Hazard Determinations

Federal Register 2010, 2011, 2012, 2013, 2014

2012-12-18

... resolution process. SRPs are independent panels of experts in hydrology, hydraulics, and other pertinent...://www.in.gov/dnr/water/6401.htm City of Delphi Carroll County Area Plan Commission, Carroll County... Inspection Online at: http://www.in.gov/dnr/water/7339.htm Town of Cumberland Municipal Building, 11501 East...

Nurses' Empowerment Scale for ICU patients' families: an instrument development study.

PubMed

Li, Hong; Liu, Ya-Lan; Qiu, Li; Chen, Qiao-Ling; Wu, Jing-Bing; Chen, Li-Li; Li, Na

2016-09-01

Family members provide essential support for ICU patients, contributing to their mental and physical recovery. Empowering ICU patients' families may help them overcome inadequacies and meet their own and patients' acknowledged needs. Nursing should understand and address patients' families' empowerment status. To develop a tool, the Nurses' Empowerment Scale for Intensive Care Unit (ICU) Patients' Families (NESIPF), to help ICU nursing staff assess the empowerment status of patients' families. Four-phase instrument development study. A 19-item instrument was initially generated based on literature review and interviews with family members of ICU patients. The Delphi research method was applied to gain expert opinion and consensus via rounds of questionnaires. A panel of 27 experts experienced in critical care medicine, nursing and psychology participated in two Delphi rounds and their input helped formulate an 18-item pretest instrument. Families of 20 patients were recruited to examine instrument readability. After a 2-week interval, another 20 patients' families were recruited to examine test-retest reliability. Two hundred questionnaires were then administered and analysed to examine the instrument's construct validity, criterion-related validity and internal consistency. Expert authority coefficients of two Delphi rounds reached 0·89 and 0·91. Kendall' W coefficients of 0·113 (P < 0·001) in round 1 and 0·220 (P < 0·001) in round 2 indicated slight to fair agreement among experts. Content validity index (CVI) reached 1·0 for 12 items; the CVI for item 13 was <0·7 so it was excluded. Cronbach's α coefficient was 0·92, indicating acceptable internal consistency reliability. The coefficient of internal consistency of each dimension was 0·717-0·921. The Pearson correlation coefficient >0·9 (P < 0·05) showed an acceptable test-retest reliability. The instrument has acceptable reliability and validity and can assess the empowerment status of families of critically ill patients. Knowledge of families' empowerment status may help to address their psychological needs and their ability to provide family support. © 2014 British Association of Critical Care Nurses.

[Applying the Modified Delphi Technique to Develop the Role of HIV Case Managers and Essential Nursing Competencies in HIV Care].

PubMed

Ko, Nai-Ying; Hsieh, Chia-Yin; Chen, Yen-Chin; Tsai, Chen-Hsi; Liu, Hsiao-Ying; Liu, Li-Fang

2015-08-01

Since 2005, the Taiwan Centers for Disease Control (Taiwan CDC) initiated an HIV case management program in AIDS-designated hospitals to provide integrative services and risk-reduction counseling for HIV-infected individuals. In light of the increasingly complex and highly specialized nature of clinical care, expanding and improving competency-based professional education is important to enhance the quality of HIV/AIDS care. The aim of this study was to develop the essential competency framework for HIV care for HIV case managers in Taiwan. We reviewed essential competencies of HIV care from Canada, the United Kingdom, and several African countries and devised descriptions of the roles of case managers and of the associated core competencies for HIV care in Taiwan. The modified Delphi technique was used to evaluate the draft framework of these roles and core competencies. A total of 15 HIV care experts were invited to join the expert panel to review and rank the draft framework. The final framework consisted of 7 roles and 27 competencies for HIV case managers. In Round 1, only 3 items did not receive consensus approval from the experts. After modification based on opinions of the experts, 7 roles and 27 competencies received 97.06% consensus approval in Round 2 and were organized into the final framework for HIV case managers. These roles and associated core competencies were: HIV Care Expert (9 competencies), Communicator (1 competency), Collaborator (4 competencies), Navigator (2 competencies), Manager (4 competencies), Advocate (2 competencies), and Professional (5 competencies). The authors developed an essential competency framework for HIV care using the consensus of a multidisciplinary expert panel. Curriculum developers and advanced nurses and practitioners may use this framework to support developments and to ensure a high quality of HIV care.

Follow-up intervals in patients with Cushing's disease: recommendations from a panel of experienced pituitary clinicians.

PubMed

Geer, Eliza B; Ayala, Alejandro; Bonert, Vivien; Carmichael, John D; Gordon, Murray B; Katznelson, Laurence; Manuylova, Ekaterina; Shafiq, Ismat; Surampudi, Vijaya; Swerdloff, Ronald S; Broder, Michael S; Cherepanov, Dasha; Eagan, Marianne; Lee, Jackie; Said, Qayyim; Neary, Maureen P; Biller, Beverly M K

2017-08-01

Follow-up guidelines are needed to assess quality of care and to ensure best long-term outcomes for patients with Cushing's disease (CD). The purpose of this study was to assess agreement by experts on recommended follow-up intervals for CD patients at different phases in their treatment course. The RAND/UCLA modified Delphi process was used to assess expert consensus. Eleven clinicians who regularly manage CD patients rated 79 hypothetical patient scenarios before and after ("second round") an in-person panel discussion to clarify definitions. Scenarios described CD patients at various time points after treatment. For each scenario, panelists recommended follow-up intervals in weeks. Panel consensus was assigned as follows: "agreement" if no more than two responses were outside a 2 week window around the median response; "disagreement" if more than two responses were outside a 2 week window around the median response. Recommendations were developed based on second round results. Panel agreement was 65.9% before and 88.6% after the in-person discussion. The panel recommended follow-up within 8 weeks for patients in remission on glucocorticoid replacement and within 1 year of surgery; within 4 weeks for patients with uncontrolled persistent or recurrent disease; within 8-24 weeks in post-radiotherapy patients controlled on medical therapy; and within 24 weeks in asymptomatic patients with stable plasma ACTH concentrations after bilateral adrenalectomy. With a high level of consensus using the Delphi process, panelists recommended regular follow-up in most patient scenarios for this chronic condition. These recommendations may be useful for assessment of CD care both in research and clinical practice.

Rethinking clinical governance: healthcare professionals' views: a Delphi study.

PubMed

Veenstra, Gepke L; Ahaus, Kees; Welker, Gera A; Heineman, Erik; van der Laan, Maarten J; Muntinghe, Friso L H

2017-01-12

Although the guiding principle of clinical governance states that healthcare professionals are the leading contributors to quality and safety in healthcare, little is known about what healthcare professionals perceive as important for clinical governance. The aim of this study is to clarify this by exploring healthcare professionals' views on clinical governance. Based on a literature search, a list of 99 elements related to clinical governance was constructed. This list was refined, extended and restricted during a three-round Delphi study. The panel of experts was formed of 24 healthcare professionals from an academic hospital that is seen as a leader in terms of its clinical governance expertise in the Netherlands. Rated importance of each element on a four-point scale. The 50 elements that the panel perceived as most important related to adopting a bottom-up approach to clinical governance, ownership, teamwork, learning from mistakes and feedback. The panel did not reach a consensus concerning elements that referred to patient involvement. Elements that referred to a managerial approach to clinical governance and standardisation of work were rejected by the panel. In the views of the panel of experts, clinical governance is a practice-based, value-driven approach that has the goal of delivering the highest possible quality care and ensuring the safety of patients. Bottom-up approaches and effective teamwork are seen as crucial for high quality and safe healthcare. Striving for high quality and safe healthcare is underpinned by continuous learning, shared responsibility and good relationships and collaboration between healthcare professionals, managers and patients. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Classification of drugs with different risk profiles.

PubMed

Saedder, Eva Aggerholm; Brock, Birgitte; Nielsen, Lars Peter; Bonnerup, Dorthe Krogsgaard; Lisby, Marianne

2015-08-01

A risk stratification approach is needed to identify patients at high risk of medication errors and a resulting high need of medication review. The aim of this study was to perform risk stratification (distinguishing between low-risk, medium-risk and high-risk drugs) for drugs found to cause serious adverse reactions due to medication errors. The study employed a modified Delphi technique. Drugs from a systematic literature search were included into two rounds of a Delphi process. A panel of experts was asked to evaluate each identified drug's potential for harm and for clinically relevant drug-drug interactions on a scale from 1 (low risk) to 9 (high risk). A total of 36 experts were appointed to serve on the panel. Consensus was reached for 29/57 (51%) drugs or drug classes that cause harm, and for 32/57 (56%) of the drugs or drug classes that cause interactions. For the remaining drugs, a decision was made based on the median score. Two lists, one stating the drugs' potential for causing harm and the other stating clinically relevant drug-drug interactions, were stratified into low-risk, medium-risk and high-risk drugs. Based on a modified Delphi technique, we created two lists of drugs stratified into a low-risk, a medium-risk and a high-risk group of clinically relevant interactions or risk of harm to patients. The lists could be incorporated into a risk-scoring tool that stratifies the performance of medication reviews according to patients' risk of experiencing adverse reactions. none. not relevant.

Ingredientes Farmacéuticos Activos Potencialmente Inapropiados en Adultos Mayores: Lista IFAsPIAM: Panel de Consenso Argentino.

PubMed

Marzi, Marta M; Pires, Miryam S; Quaglia, Nora B

2018-04-18

To perform a list agreed by Argentinean experts and adapted to the local context containing potentially inappropriate (PI) medications in old people (OP) usingthe Delphi consensus technique optimized for this subject. A preliminary list of potentially inappropriate medications (PIM) was drawn up based on foreign PIM lists and a selective search in the scientific literature. The iterative Delphi process was used to submit the active pharmaceutical ingredients (APIs) of the preliminary PIM list to the panel of Argentinean experts. The analysis of theanswers to determine the arrival to the consensus was carried out applying three criteria specially defined for this purpose. After two Delphi rounds, it was not reached agreement about 12 APIs. The List of explicit criteria for PIAPIs for use in OP (IFAsPIAM List) was finally constituted by 128 APIs corresponding to 9 groups of the ATC classification system to which they were organized. In addition to each API, information justifying the unfavorable benefit/risk profile and therapeutic alternatives or recommendations/precautions was recorded. The group with the most PI APIs was N (NervousSystem) (60; 47%) followed by groups C (Cardiovascular) and M (Musculoskeletal). This study presents the first Latin American list of PIM in OP developed using an expert consensus technique. The IFAs PIAM List would contribute to the rational use of drugs in elderly population, constituting a valuable tool in Argentinean public health. Copyright © 2018. Published by Elsevier Inc.

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach.

PubMed

Skela-Savič, Brigita; Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-06-01

There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and 'change making' should become an intrinsic part of everyone's job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: 'Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.' The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science.

The Norwegian General Practice--Nursing Home criteria (NORGEP-NH) for potentially inappropriate medication use: A web-based Delphi study.

PubMed

Nyborg, Gunhild; Straand, Jørund; Klovning, Atle; Brekke, Mette

2015-06-01

To develop a set of explicit criteria for pharmacologically inappropriate medication use in nursing homes. In an expert panel, a three-round Delphi consensus process was conducted via survey software. Norway. Altogether 80 participants - specialists in geriatrics or clinical pharmacology, physicians in nursing homes and experienced pharmacists - agreed to participate in the survey. Of these, 62 completed the first round, and 49 panellists completed all three rounds (75.4% of those ultimately entering the survey). The authors developed a list of 27 criteria based on the Norwegian General Practice (NORGEP) criteria, literature, and clinical experience. The main outcome measure was the panellists' evaluation of the clinical relevance of each suggested criterion on a digital Likert scale from 1 (no clinical relevance) to 10. In the first round panellists could also suggest new criteria to be included in the process. For each criterion, degree of consensus was based on the average Likert score and corresponding standard deviation (SD). A list of 34 explicit criteria for potentially inappropriate medication use in nursing homes was developed through a three-round web-based Delphi consensus process. Degree of consensus increased with each round. No criterion was voted out. Suggestions from the panel led to the inclusion of seven additional criteria in round two. The NORGEP-NH list may serve as a tool in the prescribing process and in medication list reviews and may also be used in quality assessment and for research purposes.

A medical school's organizational readiness for curriculum change (MORC): development and validation of a questionnaire.

PubMed

Jippes, Mariëlle; Driessen, Erik W; Broers, Nick J; Majoor, Gerard D; Gijselaers, Wim H; van der Vleuten, Cees P M

2013-09-01

Because successful change implementation depends on organizational readiness for change, the authors developed and assessed the validity of a questionnaire, based on a theoretical model of organizational readiness for change, designed to measure, specifically, a medical school's organizational readiness for curriculum change (MORC). In 2012, a panel of medical education experts judged and adapted a preliminary MORC questionnaire through a modified Delphi procedure. The authors administered the resulting questionnaire to medical school faculty involved in curriculum change and tested the psychometric properties using exploratory and confirmatory factor analysis, and generalizability analysis. The mean relevance score of the Delphi panel (n = 19) reached 4.2 on a five-point Likert-type scale (1 = not relevant and 5 = highly relevant) in the second round, meeting predefined criteria for completing the Delphi procedure. Faculty (n = 991) from 131 medical schools in 56 countries completed MORC. Exploratory factor analysis yielded three underlying factors-motivation, capability, and external pressure-in 12 subscales with 53 items. The scale structure suggested by exploratory factor analysis was confirmed by confirmatory factor analysis. Cronbach alpha ranged from 0.67 to 0.92 for the subscales. Generalizability analysis showed that the MORC results of 5 to 16 faculty members can reliably evaluate a school's organizational readiness for change. MORC is a valid, reliable questionnaire for measuring organizational readiness for curriculum change in medical schools. It can identify which elements in a change process require special attention so as to increase the chance of successful implementation.

Core Practices for Teaching History: The Results of a Delphi Panel Survey

ERIC Educational Resources Information Center

Fogo, Bradley

2014-01-01

Recent education literature and research has focused on identifying effective core teaching practices to inform and help shape teacher education and professional development. Although a rich literature on the teaching and learning of history has continued to develop over the past decade, core practice research has largely overlooked…

Teaching and Assessing the Responsible Conduct of Research: A Delphi Consensus Panel Report

ERIC Educational Resources Information Center

DuBois, James M.; Dueker, Jeffrey M.

2009-01-01

In an effort to foster research integrity, the National Institutes of Health and the National Science Foundation mandate education of all trainees in the responsible conduct of research (RCR). Nevertheless, recent studies suggest that rates of questionable research practices and scientific misconduct are both high and considerably underreported.…

Presidents as Transformational or Transactional Leaders in Higher Education

ERIC Educational Resources Information Center

Basham, Lloyd M.

2010-01-01

Purpose of study. The purpose of the study was primarily concerned with exploring the major issues that are confronting presidents of higher education and if transformational or transactional leadership practices and concepts are warranted in addressing their issues. Procedure. A Delphi technique was used with a broad-based panel of 52 experts…

The Definition of Basic Skills in Manufacturing Industries.

ERIC Educational Resources Information Center

Jones, Charles M.

1996-01-01

Survey responses from 186 of 250 trainers/human resource managers and a Delphi panel of 21 rated companies' basic skills training provisions and the importance of basic skills. Although most stated their companies provide basic skills training, results show most are reluctant to hire, train, or retain workers with low basic skills. (SK)

The Theory and Practice of Structural and Strategic Family Therapies: A Delphi Study.

ERIC Educational Resources Information Center

Fish, Linda Stone; Piercy, Fred P.

1987-01-01

Examined the similarities and differences in the theory and practice of structural and strategic family therapy. A national panel of structural and strategic therapists identified items they thought important to a profile of either structural or strategic family therapy. Mental Research Institute, Haley/Madanes, and Milan/Ackerman approaches to…

Assessment of Farmer-Oriented Agricultural Extension Intervention in Iran

ERIC Educational Resources Information Center

Mohammadzadeh, Latif; Sadighi, Hassan; Abbasi, Enayat

2017-01-01

Purpose: The main purpose of this study was to determine the characteristics of farmer-oriented policies as regards the Iranian agricultural extension system. Methodology: To fulfill this objective, a Delphi technique was utilized. The study used a series of three steps, engaging a panel of experts on farmer-oriented policies of agricultural…

Formulating Independent School K-12 Quality Physical Education Program Guidelines

ERIC Educational Resources Information Center

Currie, Stuart M.; Phillips, Michael B.; Jubenville, Colby B.

2012-01-01

The purpose of this study was to formulate Tennessee independent school K-12 quality physical education program guidelines. A panel of 18 physical education representatives from Tennessee independent schools K-12 participated in a three-phase Delphi study and completed three opinionnaires via e-mail. In Phase One, Opinionnaire One solicited panel…

Business Education University Supervisors' Perspectives of Mentor Teachers' Competencies

ERIC Educational Resources Information Center

Fletcher, Edward C., Jr.

2012-01-01

This study examined the perspectives of an expert panel of 31 business education university supervisors from the U.S. and Canada using a modified Delphi approach regarding the areas in which mentor teachers are typically most and least prepared. Findings indicated business education mentor teachers are most prepared in the areas of classroom…

Congruency in Defining Critical Thinking by Nurse Educators and Non-nurse Scholars.

ERIC Educational Resources Information Center

Gordon, Joanne M.

2000-01-01

Nurse educators (n=201) identified their concept of critical thinking and agreement with nonnurse experts (a Delphi panel of academic scholars) on critical thinking items. They agreed on skills and dispositions, but nurse educators were more likely to consider research, problem solving, decision making, and planning as critical thinking…

Perceptions of Bachelor-Degree Graduates Regarding General Education Program Quality

ERIC Educational Resources Information Center

Bittinger, Sara-Beth

2017-01-01

This study was directed by a modified Delphi-methodology design to gain perspective of the perceptions of alumni regarding the value and applicability of the general education program. The expert-panel participants were 14 alumni of Frostburg State University from various majors, representative of all three colleges, who graduated between 2006 and…

Identifying a Core Set of Science Teaching Practices: A Delphi Expert Panel Approach

ERIC Educational Resources Information Center

Kloser, Matthew

2014-01-01

The "Framework for K-12 Science Education" details ambitious goals for students' learning of science content and practices. However, this document provides science teachers little guidance about instructional practices that are central to helping students achieve these goals. Research indicates that a teacher's instructional…

What do we mean by "socialization to the model"? A Delphi study.

PubMed

Roos, Jo; Wearden, Alison

2009-05-01

The term "socialization to the model" is frequently used in the Cognitive Behavioural Therapy (CBT) literature, but it is unclear exactly what constitutes socialization to the model and there is a paucity of research in this area. This study aimed to develop a working definition of "socialization to the model". A three-round electronic Delphi technique was used to generate data and to achieve a consensus agreement amongst a panel of experts (N = 9) in response to two questions pertaining to what constitutes "socialization to the model". All elements generated in response to the primary question at the first round were retained throughout and scored an IQR of

Contents of a core library in continuing medical education: a Delphi study.

PubMed

Olson, Curtis A; Tooman, Tricia R; Leist, James C

2005-01-01

In developing their professional competence, those who are interested in the practice of continuing medical education (CME) should recognize the knowledge base that defines their field. This study systematically identifies and organizes a list of books and journals comprising a core library (100 books/15 journals) for CME professionals. The Delphi method was applied to elicit and combine the judgments of a fifty member panel considered knowledgeable about the CME field. The panelists participated in three iterations of the survey to first identify and then rank order nominated works. Separate ranked lists were created for books and journals. Forty-four participants completed the study (88% response rate). 268 books and 34 journals were identified. Mean ratings ranged from 4.78 (high) to 1.50 (low). The results of the study reflect the panel's judgment. The list is not definitive; instead, it describes what a select group of individuals knowledgeable about the CME field considered important. The list should therefore be seen as a general guide and a resource to facilitate decision-making, not as a prescription for creating a library.

Acceptability and Perceived Benefits and Risks of Public and Patient Involvement in Health Care Policy: A Delphi Survey in Belgian Stakeholders.

PubMed

Cleemput, Irina; Christiaens, Wendy; Kohn, Laurence; Léonard, Christian; Daue, François; Denis, Alain

2015-06-01

In systems with public health insurance, coverage decisions should reflect social values. Deliberation among stakeholders could achieve this goal, but rarely involves patients and citizens directly. This study aimed at evaluating the acceptability, and the perceived benefits and risks, of public and patient involvement (PPI) in coverage decision making to Belgian stakeholders. A two-round Delphi survey was conducted among all stakeholder groups. The survey was constructed on the basis of interviews with 10 key stakeholders and a review of the literature on participation models. Consensus was defined as 65% or more of the respondents agreeing with a statement and less than 15% disagreeing. Eighty stakeholders participated in both rounds. They were defined as the Delphi panel. Belgian stakeholders are open toward PPI in coverage decision processes. Benefits are expected to exceed risks. The preferred model for involvement is to consult citizens or patients, within the existing decision-making structures and at specific milestones in the process. Consulting citizens and patients is a higher level of involvement than merely informing them and a lower level than letting them participate actively. Consultation involves asking nonbinding advice on (parts of) the decision problem. According to the Delphi panel, the benefits of PPI could be increasing awareness among members of the general public and patients about the challenges and costs of health care, and enriched decision processes with expertise by experience from patients. Potential risks include subjectivity, insufficient resources to participate and weigh on the process, difficulties in finding effective ways to express a collective opinion, the risk of manipulation, and lobbying or power games of other stakeholders. PPI in coverage decision-making processes is acceptable to Belgian stakeholders, be it in different ways for different types of decisions. Benefits are expected to outweigh risks. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Physical Restraints: Consensus of a Research Definition Using a Modified Delphi Technique.

PubMed

Bleijlevens, Michel H C; Wagner, Laura M; Capezuti, Elizabeth; Hamers, Jan P H

2016-11-01

To develop an internationally accepted research definition of physical restraint. Comprehensive literature search followed by a web-based, three-round, modified Delphi technique comprising reviews and feedback. Clinical care settings. An international group of 48 experts consisting of researchers and clinicians from 14 countries who have made sustained contribution to research and clinical application in the field of physical restraint in clinical care. Data were collected using an online survey program and one in-person meeting. Results of the online survey and the in-person meeting were used for distribution in subsequent rounds until consensus on a definition was reached. Consensus was defined as 90% of the participating experts agreeing with the proposed definition of physical restraint. Thirty-four different definitions were identified during the literature search and served as a starting point for the modified Delphi technique. After three rounds, 45 (95.7%) of 47 remaining experts agreed with the newly proposed definition: "Physical restraint is defined as any action or procedure that prevents a person's free body movement to a position of choice and/or normal access to his/her body by the use of any method, attached or adjacent to a person's body that he/she cannot control or remove easily." A multidisciplinary, internationally representative panel of experts reached consensus on a research definition for physical restraints in older persons. This is a necessary step toward improved comparisons of the prevalence of physical restraint use across studies and countries. This definition can further guide research interventions aimed at reducing use of physical restraints. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Reaching Consensus on Essential Biomedical Science Learning Objectives in a Dental Curriculum.

PubMed

Best, Leandra; Walton, Joanne N; Walker, Judith; von Bergmann, HsingChi

2016-04-01

This article describes how the University of British Columbia Faculty of Dentistry reached consensus on essential basic biomedical science objectives for DMD students and applied the information to the renewal of its DMD curriculum. The Delphi Method was used to build consensus among dental faculty members and students regarding the relevance of over 1,500 existing biomedical science objectives. Volunteer panels of at least three faculty members (a basic scientist, a general dentist, and a dental specialist) and a fourth-year dental student were formed for each of 13 biomedical courses in the first two years of the program. Panel members worked independently and anonymously, rating each course objective as "need to know," "nice to know," "irrelevant," or "don't know." Panel members were advised after each round which objectives had not yet achieved a 75% consensus and were asked to reconsider their ratings. After a maximum of three rounds to reach consensus, a second group of faculty experts reviewed and refined the results to establish the biomedical science objectives for the renewed curriculum. There was consensus on 46% of the learning objectives after round one, 80% after round two, and 95% after round three. The second expert group addressed any remaining objectives as part of its review process. Only 47% of previous biomedical science course objectives were judged to be essential or "need to know" for the general dentist. The consensus reached by participants in the Delphi Method panels and a second group of faculty experts led to a streamlined, better integrated DMD curriculum to prepare graduates for future practice.

Developing performance indicators for clinical governance in dimensions of risk management and clinical effectiveness.

PubMed

Azami-Aghdash, Saber; Tabrizi, Jafar Sadegh; Sadeghi-Bazargani, Homayoun; Hajebrahimi, Sakineh; Naghavi-Behzad, Mohammad

2015-04-01

This study has been designed and conducted to develop domestic indicators for evaluating the performance of clinical governance in dimensions of risk management and clinical effectiveness. This study implemented a 5-stage process including conducting a comprehensive literature review, expert panel (∼ 1000 h per person per session, 11 experts), semi-structured interviews, a 2-round Delphi study (33 experts were in attendance) and a final expert panel (8 experts were in attendance). East Azerbaijan-Iran Province. Fifty-six specialists and experts in different fields of medical sciences. Importance and applicability of indicators. Using a thorough literature review, 361 indicators (129 risk management indicators in 4 dimensions and 232 clinical effectiveness indicators in 18 dimensions) were found. After conducting expert panels and interviews, the number of indicators decreased to 168 cases (65 risk management indicators in 4 dimensions and 103 clinical effectiveness indicators in 12 dimensions). Two rounds of Delphi identified four indicators that were omitted. The members of the final expert panel agreed on 113 indicators (43 risk management indicators in 4 dimensions and 70 clinical effectiveness indicators in 11 dimensions). In this study, indicators for assessing clinical governance in domains of risk management and clinical effectiveness were designed that can be used by policy-makers and other authorities for improving the quality of services and evaluating the performance of clinical governance. Those indicators can be used with slight modifications in other countries having healthcare systems similar to that of Iran. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi consensus approach.

PubMed

Wakai, Abel; O'Sullivan, Ronan; Staunton, Paul; Walsh, Cathal; Hickey, Fergal; Plunkett, Patrick K

2013-04-01

The objective of this study was to develop a consensus among emergency medicine (EM) specialists working in Ireland for emergency department (ED) key performance indicators (KPIs). The method employed was a three-round electronic modified-Delphi process. An online questionnaire with 54 potential KPIs was set up for round 1 of the Delphi process. The Delphi panel consisted of all registered EM specialists in Ireland. Each indicator on the questionnaire was rated using a five-point Likert-type rating scale. Agreement was defined as at least 70% of the responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using standard descriptive statistics. Data were also analysed as the mean of the Likert rating with 95% confidence intervals (95% CIs). Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Statistical analyses were carried out using SPSS version 16.0. The response rates in rounds 1, 2 and 3 were 86, 88 and 88%, respectively. Ninety-seven potential indicators reached agreement after the three rounds. In the context of the Donabedian structure-process-outcome framework of performance indicators, 41 (42%) of the agreed indicators were structure indicators, 52 (54%) were process indicators and four (4%) were outcome indicators. Overall, the top-three highest rated indicators were: presence of a dedicated ED clinical information system (4.7; 95% CI 4.6-4.9), ED compliance with minimum design standards (4.7; 95% CI 4.5-4.8) and time from ED arrival to first ECG in suspected cardiac chest pain (4.7; 95% CI 4.5-4.9). The top-three highest rated indicators specific to clinical care of children in EDs were: time to administration of antibiotics in children with suspected bacterial meningitis (4.6; 95% CI 4.5-4.8), separate area available within EDs (seeing both adults and children) to assess children (4.4; 95% CI 4.2-4.6) and time to administration of analgesia in children with forearm fractures (4.4; 95% CI 4.2-4.7). Employing a Delphi consensus process, it was possible to reach a consensus among EM specialists in Ireland on a suite of 97 KPIs for EDs.

EURECCA colorectal: multidisciplinary management: European consensus conference colon & rectum.

PubMed

van de Velde, Cornelis J H; Boelens, Petra G; Borras, Josep M; Coebergh, Jan-Willem; Cervantes, Andres; Blomqvist, Lennart; Beets-Tan, Regina G H; van den Broek, Colette B M; Brown, Gina; Van Cutsem, Eric; Espin, Eloy; Haustermans, Karin; Glimelius, Bengt; Iversen, Lene H; van Krieken, J Han; Marijnen, Corrie A M; Henning, Geoffrey; Gore-Booth, Jola; Meldolesi, Elisa; Mroczkowski, Pawel; Nagtegaal, Iris; Naredi, Peter; Ortiz, Hector; Påhlman, Lars; Quirke, Philip; Rödel, Claus; Roth, Arnaud; Rutten, Harm; Schmoll, Hans J; Smith, Jason J; Tanis, Pieter J; Taylor, Claire; Wibe, Arne; Wiggers, Theo; Gambacorta, Maria A; Aristei, Cynthia; Valentini, Vincenzo

2014-01-01

Care for patients with colon and rectal cancer has improved in the last 20years; however considerable variation still exists in cancer management and outcome between European countries. Large variation is also apparent between national guidelines and patterns of cancer care in Europe. Therefore, EURECCA, which is the acronym of European Registration of Cancer Care, is aiming at defining core treatment strategies and developing a European audit structure in order to improve the quality of care for all patients with colon and rectal cancer. In December 2012, the first multidisciplinary consensus conference about cancer of the colon and rectum was held. The expert panel consisted of representatives of European scientific organisations involved in cancer care of patients with colon and rectal cancer and representatives of national colorectal registries. The expert panel had delegates of the European Society of Surgical Oncology (ESSO), European Society for Radiotherapy & Oncology (ESTRO), European Society of Pathology (ESP), European Society for Medical Oncology (ESMO), European Society of Radiology (ESR), European Society of Coloproctology (ESCP), European CanCer Organisation (ECCO), European Oncology Nursing Society (EONS) and the European Colorectal Cancer Patient Organisation (EuropaColon), as well as delegates from national registries or audits. Consensus was achieved using the Delphi method. For the Delphi process, multidisciplinary experts were invited to comment and vote three web-based online voting rounds and to lecture on the subjects during the meeting (13th-15th December 2012). The sentences in the consensus document were available during the meeting and a televoting round during the conference by all participants was performed. This manuscript covers all sentences of the consensus document with the result of the voting. The consensus document represents sections on diagnostics, pathology, surgery, medical oncology, radiotherapy, and follow-up where applicable for treatment of colon cancer, rectal cancer and metastatic colorectal disease separately. Moreover, evidence based algorithms for diagnostics and treatment were composed which were also submitted to the Delphi process. The total number of the voted sentences was 465. All chapters were voted on by at least 75% of the experts. Of the 465 sentences, 84% achieved large consensus, 6% achieved moderate consensus, and 7% resulted in minimum consensus. Only 3% was disagreed by more than 50% of the members. Multidisciplinary consensus on key diagnostic and treatment issues for colon and rectal cancer management using the Delphi method was successful. This consensus document embodies the expertise of professionals from all disciplines involved in the care for patients with colon and rectal cancer. Diagnostic and treatment algorithms were developed to implement the current evidence and to define core treatment guidance for multidisciplinary team management of colon and rectal cancer throughout Europe. Copyright © 2013 Elsevier Ltd. All rights reserved.

Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature.

PubMed

Moreira, Danilo Gomes; Costello, Joseph T; Brito, Ciro J; Adamczyk, Jakub G; Ammer, Kurt; Bach, Aaron J E; Costa, Carlos M A; Eglin, Clare; Fernandes, Alex A; Fernández-Cuevas, Ismael; Ferreira, José J A; Formenti, Damiano; Fournet, Damien; Havenith, George; Howell, Kevin; Jung, Anna; Kenny, Glen P; Kolosovas-Machuca, Eleazar S; Maley, Matthew J; Merla, Arcangelo; Pascoe, David D; Priego Quesada, Jose I; Schwartz, Robert G; Seixas, Adérito R D; Selfe, James; Vainer, Boris G; Sillero-Quintana, Manuel

2017-10-01

The importance of using infrared thermography (IRT) to assess skin temperature (t sk ) is increasing in clinical settings. Recently, its use has been increasing in sports and exercise medicine; however, no consensus guideline exists to address the methods for collecting data in such situations. The aim of this study was to develop a checklist for the collection of t sk using IRT in sports and exercise medicine. We carried out a Delphi study to set a checklist based on consensus agreement from leading experts in the field. Panelists (n = 24) representing the areas of sport science (n = 8; 33%), physiology (n = 7; 29%), physiotherapy (n = 3; 13%) and medicine (n = 6; 25%), from 13 different countries completed the Delphi process. An initial list of 16 points was proposed which was rated and commented on by panelists in three rounds of anonymous surveys following a standard Delphi procedure. The panel reached consensus on 15 items which encompassed the participants' demographic information, camera/room or environment setup and recording/analysis of t sk using IRT. The results of the Delphi produced the checklist entitled "Thermographic Imaging in Sports and Exercise Medicine (TISEM)" which is a proposal to standardize the collection and analysis of t sk data using IRT. It is intended that the TISEM can also be applied to evaluate bias in thermographic studies and to guide practitioners in the use of this technique. Copyright © 2017 Elsevier Ltd. All rights reserved.

BCQ+: a body constitution questionnaire to assess Yang-Xu. Part I: establishment of a first final version through a Delphi process.

PubMed

Su, Yi-Chang; Chen, Li-Li; Lin, Jun-Dai; Lin, Jui-Shan; Huang, Yi-Chia; Lai, Jim-Shoung

2008-12-01

Assessing an individual's level of Yang deficiency (Yang-Xu) by its manifestations is a frequent issue in traditional Chinese medicine (TCM) clinical trials. To this end, an objective, reliable and rigorous diagnostic tool is required. This study aimed to develop a first final version of the Yang-Xu Constitution Questionnaire. We conducted 3 steps to develop such an objective measurement tool: 1) the research team was formed and a panel of 26 experts was selected for the Delphi process; 2) items for the questionnaire were generated by literature review and a Delphi process; items were reworded into colloquial questions; face and content validity of the items were evaluated through a Delphi process again; 3) the difficulty of the questionnaire was evaluated in a pilot study with 81 subjects aged 20-60 years. The literature review retrieved 35 relevant items which matched the definition of 'constitution' and 'Yang-Xu'. After a first Delphi process, 22 items were retained and translated into colloquial questions. According to the second part of the Delphi process, the content validity index of each of the 22 questions ranged between 0.85-1. These 22 questions were evaluated by 81 subjects, 2 questions that were hard to tell the difference were combined; 3 questions were modified after the research team had discussed the participants' feedback. Finally, the questionnaire was established with 21 questions. This first final version of a questionnaire to assess Yang-Xu constitution with considerable face and content validity may serve as a basis to develop an advanced Yang-Xu questionnaire. 2008 S. Karger AG, Basel.

Quality of care for cancer patients on home parenteral nutrition: development of key interventions and outcome indicators using a two-round Delphi approach.

PubMed

Dreesen, Mira; Foulon, Veerle; Hiele, Martin; Vanhaecht, Kris; De Pourcq, Lutgart; Pironi, Loris; Van Gossum, André; Arends, Jann; Cuerda, Cristina; Thul, Paul; Bozzetti, Frederico; Willems, Ludo

2013-05-01

Clear recommendations on how to guide patients with cancer on home parenteral nutrition (HPN) are lacking as the use of HPN in this population remains a controversial issue. Therefore, the aims of this study were to rank treatment recommendations and main outcome indicators to ensure high-quality care and to indicate differences in care concerning benign versus malignant patients. Treatment recommendations, identified from published guidelines, were used as a starting point for a two-round Delphi approach. Comments and additional interventions proposed in the first round were reevaluated in the second round. Ordinal logistic regression with SPSS 2.0 was used to identify differences in care concerning benign versus malignant patients. Twenty-seven experts from five European countries completed two Delphi rounds. After the second Delphi round, the top three most important outcome indicators were (1) quality of life (QoL), (2) incidence of hospital readmission and (3) incidence of catheter-related infections. Forty-two interventions were considered as important for quality of care (28/42 based on published guidelines; 14/42 newly suggested by Delphi panel). The topics 'Liver disease' and 'Metabolic bone disease' were considered less important for cancer patients, together with use of infusion pumps (p = 0.004) and monitoring of vitamins and trace elements (p = 0.000). Monitoring of QoL is considered more important for cancer patients (p = 0.03). Using a two-round Delphi approach, we developed a minimal set of 42 interventions that may be used to determine quality of care in HPN patients with malignancies. This set of interventions differs from a similar set developed for benign patients.

Study plan to identify long term national telecommunications need and priorities applying Delphi techniques (handbook). [technological forecasting - United States of America

NASA Technical Reports Server (NTRS)

1974-01-01

A handbook that explains the basic Delphi methodology and discusses modified Delphi techniques is presented. The selection of communications experts to participate in a study, the construction of questionnaires on potential communications developments, and requisite technology is treated. No two modified Delphi studies were the same, which reflects the flexibility and adaptability of the technique. Each study must be specifically tailored to a particular case, and consists of seeking a consensus of opinion among experts about a particular subject and attendant conditions that may prevail in the future.

Digital Skills Acquisition: Future Trends among Older Adults

ERIC Educational Resources Information Center

Gilliam, Brian K.

2011-01-01

Purpose: The purpose of this study was to identify future trends and barriers that will either facilitate or impede the narrowing of the digital skills divide among older adults during the next 10 years. Methodology: To address the research questions, this study used a modified version of the Delphi process using a panel of experts who…

HUMAN HEALTH DAMAGES FROM MOBILE SOURCE AIR POLLUTION: ADDITIONAL DELPHI DATA ANALYSIS. VOLUME II

EPA Science Inventory

The report contains the results of additional analyses of the data generated by a panel of medical experts for a study of Human Health Damages from Mobile Source Air Pollution (hereafter referred to as HHD) conducted by the California Air Resources Board in 1973-75 for the U.S. E...

"A Prophecy for the Arts" in Higher Education

ERIC Educational Resources Information Center

Merrion, Margaret

2009-01-01

This article presents a Delphi study that captured a myriad of predictions that represent the best thinking of a panel of creative minds, experts in a variety of arts and with many years of experience as arts leaders. Predictions provide a set of interlinked challenges and opportunities. In this study, the experts forecast changes in students that…

Engineering's Grand Challenges: Priorities and Integration Recommendations for Technology Education Curriculum Development

ERIC Educational Resources Information Center

Buelin, Jennifer; Clark, Aaron C.; Ernst, Jeremy V.

2016-01-01

In this study, the 14 Grand Challenges for Engineering in the 21st Century identified by the National Academy of Engineering were examined by a panel of experts in an effort to identify prospective curricular integration opportunities in the field of technology and engineering education. The study utilized a three-round modified Delphi methodology…

Graduate Introductory Educational Research Courses: A Look at What Is Required.

ERIC Educational Resources Information Center

Todd, Robert F.; Reece, Carol Carter

A diversity of practices exists with regard to the actual content taught in graduate-level courses in introduction to educational research. In a recent Delphi study, a national panel of 21 experts in educational research generated a list of 114 skills and knowledge areas they considered worthy objectives in an introductory course. What remained…

Pesticide applicators questionnaire content validation: A fuzzy delphi method.

PubMed

Manakandan, S K; Rosnah, I; Mohd Ridhuan, J; Priya, R

2017-08-01

The most crucial step in forming a set of survey questionnaire is deciding the appropriate items in a construct. Retaining irrelevant items and removing important items will certainly mislead the direction of a particular study. This article demonstrates Fuzzy Delphi method as one of the scientific analysis technique to consolidate consensus agreement within a panel of experts pertaining to each item's appropriateness. This method reduces the ambiguity, diversity, and discrepancy of the opinions among the experts hence enhances the quality of the selected items. The main purpose of this study was to obtain experts' consensus on the suitability of the preselected items on the questionnaire. The panel consists of sixteen experts from the Occupational and Environmental Health Unit of Ministry of Health, Vector-borne Disease Control Unit of Ministry of Health and Occupational and Safety Health Unit of both public and private universities. A set of questionnaires related to noise and chemical exposure were compiled based on the literature search. There was a total of six constructs with 60 items in which three constructs for knowledge, attitude, and practice of noise exposure and three constructs for knowledge, attitude, and practice of chemical exposure. The validation process replicated recent Fuzzy Delphi method that using a concept of Triangular Fuzzy Numbers and Defuzzification process. A 100% response rate was obtained from all the sixteen experts with an average Likert scoring of four to five. Post FDM analysis, the first prerequisite was fulfilled with a threshold value (d) ≤ 0.2, hence all the six constructs were accepted. For the second prerequisite, three items (21%) from noise-attitude construct and four items (40%) from chemical-practice construct had expert consensus lesser than 75%, which giving rise to about 12% from the total items in the questionnaire. The third prerequisite was used to rank the items within the constructs by calculating the average fuzzy numbers. The seven items which did not fulfill the second prerequisite similarly had lower ranks during the analysis, therefore those items were discarded from the final draft. Post FDM analysis, the experts' consensus on the suitability of the pre-selected items on the questionnaire set were obtained, hence it is now ready for further construct validation process.

A proposed minimum data set for international primary care optometry: a modified Delphi study.

PubMed

Davey, Christopher J; Slade, Sarah V; Shickle, Darren

2017-07-01

To identify a minimum list of metrics of international relevance to public health, research and service development which can be extracted from practice management systems and electronic patient records in primary optometric practice. A two stage modified Delphi technique was used. Stage 1 categorised metrics that may be recorded as being part of a primary eye examination by their importance to research using the results from a previous survey of 40 vision science and public health academics. Delphi stage 2 then gauged the opinion of a panel of seven vision science academics and achieved consensus on contentious metrics and methods of grading/classification. A consensus regarding inclusion and response categories was achieved for nearly all metrics. A recommendation was made of 53 metrics which would be appropriate in a minimum data set. This minimum data set should be easily integrated into clinical practice yet allow vital data to be collected internationally from primary care optometry. It should not be mistaken for a clinical guideline and should not add workload to the optometrist. A pilot study incorporating an additional Delphi stage prior to implementation is advisable to refine some response categories. © 2017 The Authors. Ophthalmic and Physiological Optics published by John Wiley & Sons Ltd on behalf of College of Optometrists.

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach

PubMed Central

Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-01-01

Abstract Introduction There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and ‘change making’ should become an intrinsic part of everyone’s job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. Methods This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. Results A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: ‘Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.’ Conclusions The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science. PMID:28289467

End points for validating early warning scores in the context of rapid response systems: a Delphi consensus study.

PubMed

Pedersen, N E; Oestergaard, D; Lippert, A

2016-05-01

When investigating early warning scores and similar physiology-based risk stratification tools, death, cardiac arrest and intensive care unit admission are traditionally used as end points. A large proportion of the patients identified by these end points cannot be saved, even with optimal treatment. This could pose a limitation to studies using these end points. We studied current expert opinion on end points for validating tools for the identification of patients in hospital wards at risk of imminent critical illness. The Delphi consensus methodology was used. We identified 22 experts based on objective criteria; 17 participated in the study. Each expert panel member's suggestions for end points were collected and distributed to the entire expert panel in anonymised form. The experts reviewed, rated and commented the suggested end points through the rounds in the Delphi process, and the experts' combined rating of the usefulness of each suggestion was established. A gross list of 86 suggestions for end points, relating to 13 themes, was produced. No items were uniformly recognised as ideal. The themes cardiac arrest, death, and level of care contained the items receiving highest ratings. End points relating to death, cardiac arrest and intensive care unit admission currently comprise the most obvious compromises for investigating early warning scores and similar risk stratification tools. Additional end points from the gross list of suggested end points could become feasible with the increased availability of large data sets with a multitude of recorded parameters. © 2015 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Developing an instrument to measure emotional behaviour abilities of meaningful learning through the Delphi technique.

PubMed

Cadorin, Lucia; Bagnasco, Annamaria; Tolotti, Angela; Pagnucci, Nicola; Sasso, Loredana

2017-09-01

To identify items for a new instrument that measures emotional behaviour abilities of meaningful learning, according to Fink's Taxonomy. Meaningful learning is an active process that promotes a wider and deeper understanding of concepts. It is the result of an interaction between new and previous knowledge and produces a long-term change of knowledge and skills. To measure meaningful learning capability, it is very important in the education of health professionals to identify problems or special learning needs. For this reason, it is necessary to create valid instruments. A Delphi Study technique was implemented in four phases by means of e-mail. The study was conducted from April-September 2015. An expert panel consisting of ten researchers with experience in Fink's Taxonomy was established to identify the items of the instrument. Data were analysed for conceptual description and item characteristics and attributes were rated. Expert consensus was sought in each of these phases. An 87·5% consensus cut-off was established. After four rounds, consensus was obtained for validation of the content of the instrument 'Assessment of Meaningful learning Behavioural and Emotional Abilities'. This instrument consists of 56 items evaluated on a 6-point Likert-type scale. Foundational Knowledge, Application, Integration, Human Dimension, Caring and Learning How to Learn were the six major categories explored. This content validated tool can help educators (teachers, trainers and tutors) to identify and improve the strategies to support students' learning capability, which could increase their awareness of and/or responsibility in the learning process. © 2017 John Wiley & Sons Ltd.

Which potential harms and benefits of using ginger in the management of nausea and vomiting of pregnancy should be addressed? a consensual study among pregnant women and gynecologists.

PubMed

Shawahna, Ramzi; Taha, Assim

2017-04-08

Nausea and vomiting of pregnancy (NVP) affect approximately 80-90% of the pregnant women. Ginger (Zingiber officinale Roscoe) is the most widely used herbal therapy in the management of NVP. Like conventional therapies, herbal therapies have potential harms and benefits that patients need to be informed about in order to develop their therapy preferences. The aim of this study was to achieve consensus among women who suffered NVP and physicians often consulted by pregnant women on a core list of potential harms and benefits of using ginger to manage NVP to be addressed during clinical consultations. In this study, the Delphi technique was used to achieve consensus on a core list of important harms and benefits of using ginger in the management of NVP to be addressed during the clinical consultation. A Delphi process was followed in two panels in parallel sessions. One panel was composed of 50 gynecologists and other physicians who are often consulted by pregnant women suffering NVP and the other panel was composed of 50 women who suffered NVP. Consensus was achieved on 21 (75%) of the 28 potential harms presented to the panelists. Panelists agreed that potential harms of the anticoagulant effects of ginger, risk with other co-morbidities, and risk of potential allergic reactions are important to address during the clinical consultation. Of the 14 potential benefits presented to the panelists in both panels, consensus was achieved on 13 (92.9%). Partial consensus on 7 potential harms and 1 potential benefit was achieved in both panels. Addressing important potential harms and benefits of using ginger for the management of NVP during the clinical consultations is important in promoting congruence and reducing patient dissatisfaction in clinical practice. Consensus was achieved on a core list of important harms and benefits of using ginger for the management of NVP to be addressed during the clinical consultations by a panel of women and a panel of physicians. Further studies are still needed to investigate what is being addressed during clinical consultations.

Elder-friendly emergency services in Brazil: necessary conditions for care.

PubMed

Santos, Mariana Timmers Dos; Lima, Maria Alice Dias da Silva; Zucatti, Paula Buchs

2016-01-01

To identify and analyze the aspects necessary to provide an elder-friendly emergency service (ES) from the perspective of nurses. This is a descriptive, quantitative study using the Delphi technique in three rounds. Nurses with professional experience in the ES and/or researchers with publications and/or conducting research in the study area were selected. The first round of the Delphi panel had 72 participants, the second 49, and the third 44. An online questionnaire was used based on a review of the scientific literature with questions organized into the central dimensions of elder-friendly hospitals. A five-point Likert scale was used for each question and a 70% consensus level was established. There were 38 aspects identified as necessary for elderly care that were organized into central dimensions. The study's results are consistent with the findings in scientific literature and suggest indicators for quality of care and training for an elder-friendly ES. Identificar e analisar aspectos necessários para um atendimento amigo do idoso nos serviços de emergência (SE), na perspectiva de enfermeiros. Estudo descritivo, quantitativo, com utilização da Técnica Delphi, em três rodadas. Foram selecionados enfermeiros com experiência profissional em SE e/ou pesquisadores com publicações e/ou desenvolvendo pesquisas na área de estudo. A primeira rodada do painel Delphi contou com 72 participantes, a segunda com 49 e a terceira com 44. Foi utilizado questionário on-line, baseado na revisão da literatura científica, com questões organizadas em dimensões centrais de hospitais amigos do idoso. Foi utilizada uma escala de Likert de 5 pontos para cada questão e estabelecido nível de consenso de 70%. Foram identificados 38 aspectos necessários para o atendimento ao idoso, organizados em dimensões centrais. Os resultados do estudo são consistentes com os achados na literatura científica e sugerem indicadores para qualidade do cuidado e para formação de SE amigos do idoso.

Nature-based care opportunities and barriers in oncology contexts: a modified international e-Delphi survey.

PubMed

Blaschke, Sarah; O'Callaghan, Clare C; Schofield, Penelope

2017-10-16

To develop recommendations regarding opportunities and barriers for nature-based care in oncology contexts using a structured knowledge generation process involving relevant healthcare and design experts. Four-round modified electronic Delphi study. Oncology patients' nature-based recommendations, uncovered in preceding qualitative investigation, were included in the first round for the expert participants' consideration. Key items (opportunities and barriers) were developed using data aggregation and synthesis, followed by item prioritisation and 10-point Likert scale ranking (1=not important, 10=very important). Descriptive statistics were calculated to assess items of highest importance representing expert recommendations. Online Delphi process constituting an electronic international survey. A purposive sample of 200 potential panellists (recruitment target n=40) comprising healthcare practitioners, managers, designers, architects and researchers were invited to participate; experts were identified via research networks, snowballing and systematic literature review. 38 experts across seven countries (Australia, USA, UK, New Zealand, Canada, Denmark and Sweden) returned questionnaire 1, which determined consent and acceptance for participation. Initial response rate was 19%, and subsequent response rates were 84%, 82% and 84% for rounds 2, 3 and 4, respectively. The Delphi panel developed recommendations consisting of 10 opportunities and 10 barriers. The following opportunities were rated to be of highest importance: window views from clinical areas onto nature; outdoor settings, gardens and courtyards with easy and effortless access; and nature-based physical exercise adapted to patient requirements. Highest-rated barriers for nature-based oncology care included lack of knowledge and awareness about benefits of nature engagement and inaccessibility, not considering access requirements for the very sick and frail. Experts suggested and agreed on a set of recommendations, which represent critical considerations for the safe adoption of nature-based oncology opportunities. These findings fill a gap in understanding about helpful nature-based oncology care and may translate into oncology design and innovation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Insufficiently studied factors related to burnout in nursing: Results from an e-Delphi study

PubMed Central

2017-01-01

Objective This study aimed to identify potentially important factors in explaining burnout in nursing that have been insufficiently studied or ignored. Methods A three-round Delphi study via e-mail correspondence was conducted, with a group of 40 European experts. The e-Delphi questionnaire consisted of 52 factors identified from a literature review. Experts rated and scored the importance of factors in the occurrence of burnout and the degree of attention given by researchers to each of the variables listed, on a six-point Likert scale. We used the agreement percentage (>80%) to measure the level of consensus between experts. Furthermore, to confirm the level of consensus, we also calculated mean scores and modes. Regardless of the degree of consensus reached by the experts, we have calculated the mean of the stability of the answers for each expert (individual's qualitative stability) and the mean of the stability percentages of the experts (qualitative group stability). Results The response rate in the three rounds was 93.02% (n = 40). Eight new factors were suggested in the first round. After modified, the e-Delphi questionnaire in the second and third rounds had 60 factors. All the factors reached the third round with a consensus level above 80% in terms of the attention that researchers gave them in their studies. Moreover, the data show a total mean qualitative group stability of 96.21%. In the third round 9 factors were classified by experts as ‘studied very little’, 17 as ‘studied little’ and 34 as 'well studied' Conclusion Findings show that not all the factors that may influence nursing burnout have received the same attention from researchers. The panel of experts has identified factors that, although important in explaining burnout, have been poorly studied or even forgotten. Our results suggest that further study into factors such as a lack of recognition of part of the tasks that nurses perform, feminine stereotype or excessive bureaucracy is needed for a better understanding of this syndrome and improve the quality of life in nurses. PMID:28388660

Assessing the Measures of and Defining Community College Institutional Effectiveness: A President's Perspective Delphi Study

ERIC Educational Resources Information Center

Laughlin, Juliet Adair

2016-01-01

The purpose of this study included two main goals. The first was to provide a common definition for community college institutional effectiveness through a review of the literature and from the personal definitions of a panel of community colleges presidents leading notably effective community colleges. The second purpose was to review the…

Why Is It So Hard to Reach Agreement on Terminology? The Case of Developmental Language Disorder (DLD)

ERIC Educational Resources Information Center

Bishop, Dorothy V. M.

2017-01-01

A recent project entitled CATALISE used the Delphi method to reach a consensus on terminology for unexplained language problems in children. "Developmental language disorder" (DLD) was the term agreed by a panel of 57 experts. Here I reflect on points of difficulty that arose when attempting to reach a consensus, using qualitative…

Instructional Competencies Needed to Develop Instructional Strategies for Mobile Learning in Fields of Agricultural Education

ERIC Educational Resources Information Center

Irby, Travis; Strong, Robert

2015-01-01

Mobile learning is an evolving form of technology-based learning. The novelty of mobile learning gives educators a new tool for evaluating how to develop effective instruction for this new medium. A Delphi study was conducted using a 30-member panel comprised of experts across 20 states. The purpose was to determine the competencies needed to…

Grading of parameters for urban tree inventories by city officials, arborists, and academics using the delphi method.

PubMed

Östberg, Johan; Delshammar, Tim; Wiström, Björn; Nielsen, Anders Busse

2013-03-01

Tree inventories are expensive to conduct and update, so every inventory carried out must be maximized. However, increasing the number of constituent parameters increases the cost of performing and updating the inventory, illustrating the need for careful parameter selection. This article reports the results of a systematic expert rating of tree inventories aiming to quantify the relative importance of each parameter. Using the Delphi method, panels comprising city officials, arborists, and academics rated a total of 148 parameters. The total mean score, the top ranking parameters, which can serve as a guide for decision-making at practical level and for standardization of tree inventories, were: Scientific name of the tree species and genera, Vitality, Coordinates, Hazard class, and Identification number. The study also examined whether the different responsibilities and usage of urban tree databases among organizations and people engaged in urban tree inventories affected their prioritization. The results revealed noticeable dissimilarities in the ranking of parameters between the panels, underlining the need for collaboration between the research community and those commissioning, administrating, and conducting inventories. Only by applying such a transdisciplinary approach to parameter selection can urban tree inventories be strengthened and made more relevant.

Peru and its new challenge in higher education: Towards a research university.

PubMed

Lavalle, Carlos; de Nicolas, Victor Luis

2017-01-01

The paradigm of research universities linked to the emergence of university rankings has unified and universalized the criteria relating to the quality of higher education. This situation has led to multiple responses across global society, which has started rating the quality of higher education systems through these rankings, supported by a series of indicators aligned to the characteristics of research universities. Given that the quality of a country's higher education is one of the fundamental pillars of its development, many countries have started to take government action in this respect. In the case of Peru this has not taken long, with the approval of Law 30220 in 2014. This aims to regulate the quality of higher education through a series of specific conditions governed by a newly created body known as SUNEDU. This article uses a Delphi panel to analyze the existing relationship between the conditions imposed by SUNEDU and the research universities' intrinsic characteristics. During the Delphi panel a consensus was reached through an acceptable and stable level of responses, resulting in confirmation that there is alignment between the conditions imposed by SUNEDU and the intrinsic characteristics of research universities.

Grading of Parameters for Urban Tree Inventories by City Officials, Arborists, and Academics Using the Delphi Method

NASA Astrophysics Data System (ADS)

Östberg, Johan; Delshammar, Tim; Wiström, Björn; Nielsen, Anders Busse

2013-03-01

Tree inventories are expensive to conduct and update, so every inventory carried out must be maximized. However, increasing the number of constituent parameters increases the cost of performing and updating the inventory, illustrating the need for careful parameter selection. This article reports the results of a systematic expert rating of tree inventories aiming to quantify the relative importance of each parameter. Using the Delphi method, panels comprising city officials, arborists, and academics rated a total of 148 parameters. The total mean score, the top ranking parameters, which can serve as a guide for decision-making at practical level and for standardization of tree inventories, were: Scientific name of the tree species and genera, Vitality, Coordinates, Hazard class, and Identification number. The study also examined whether the different responsibilities and usage of urban tree databases among organizations and people engaged in urban tree inventories affected their prioritization. The results revealed noticeable dissimilarities in the ranking of parameters between the panels, underlining the need for collaboration between the research community and those commissioning, administrating, and conducting inventories. Only by applying such a transdisciplinary approach to parameter selection can urban tree inventories be strengthened and made more relevant.

Unified treatment algorithm for the management of crotaline snakebite in the United States: results of an evidence-informed consensus workshop

PubMed Central

2011-01-01

Background Envenomation by crotaline snakes (rattlesnake, cottonmouth, copperhead) is a complex, potentially lethal condition affecting thousands of people in the United States each year. Treatment of crotaline envenomation is not standardized, and significant variation in practice exists. Methods A geographically diverse panel of experts was convened for the purpose of deriving an evidence-informed unified treatment algorithm. Research staff analyzed the extant medical literature and performed targeted analyses of existing databases to inform specific clinical decisions. A trained external facilitator used modified Delphi and structured consensus methodology to achieve consensus on the final treatment algorithm. Results A unified treatment algorithm was produced and endorsed by all nine expert panel members. This algorithm provides guidance about clinical and laboratory observations, indications for and dosing of antivenom, adjunctive therapies, post-stabilization care, and management of complications from envenomation and therapy. Conclusions Clinical manifestations and ideal treatment of crotaline snakebite differ greatly, and can result in severe complications. Using a modified Delphi method, we provide evidence-informed treatment guidelines in an attempt to reduce variation in care and possibly improve clinical outcomes. PMID:21291549

Peru and its new challenge in higher education: Towards a research university

PubMed Central

2017-01-01

The paradigm of research universities linked to the emergence of university rankings has unified and universalized the criteria relating to the quality of higher education. This situation has led to multiple responses across global society, which has started rating the quality of higher education systems through these rankings, supported by a series of indicators aligned to the characteristics of research universities. Given that the quality of a country’s higher education is one of the fundamental pillars of its development, many countries have started to take government action in this respect. In the case of Peru this has not taken long, with the approval of Law 30220 in 2014. This aims to regulate the quality of higher education through a series of specific conditions governed by a newly created body known as SUNEDU. This article uses a Delphi panel to analyze the existing relationship between the conditions imposed by SUNEDU and the research universities’ intrinsic characteristics. During the Delphi panel a consensus was reached through an acceptable and stable level of responses, resulting in confirmation that there is alignment between the conditions imposed by SUNEDU and the intrinsic characteristics of research universities. PMID:28787463

A core syllabus for the teaching of embryology and teratology to medical students.

PubMed

Fakoya, Francis A; Emmanouil-Nikoloussi, Elpida; Sharma, Deepak; Moxham, Bernard J

2017-03-01

Clinical relevance in the teaching of biomedical sciences within health care courses presupposes that there is internationally agreed core material within the curricula. However, with the exception of a syllabus for neuroanatomy and gross anatomy of the head and neck for medical students, core syllabuses within many of the specialized anatomical sciences have yet to be developed. The International Federation of Associations of Anatomists aims to formulate internationally accepted core syllabuses for all anatomical sciences disciplines initially using Delphi Panels that comprise anatomists, scientists, and clinicians who evaluate syllabus content. Here, the suggestions of a Delphi Panel for embryology and teratology are presented prior to their publication on the website of the International Federation of Associations of Anatomists. Hence, to obtain a more definitive syllabus, it is required that anatomical and embryological/teratological societies, as well as individual anatomists, embryologists and clinicians, freely comment upon, elaborate and amend, this draft syllabus. The goal is to set internationally recognized standards and thereby provide guidelines concerning embryological and teratological knowledge when involved with course development. Clin. Anat. 30:159-167, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Economic instruments for obesity prevention: results of a scoping review and modified Delphi survey.

PubMed

Faulkner, Guy E J; Grootendorst, Paul; Nguyen, Van Hai; Andreyeva, Tatiana; Arbour-Nicitopoulos, Kelly; Auld, M Christopher; Cash, Sean B; Cawley, John; Donnelly, Peter; Drewnowski, Adam; Dubé, Laurette; Ferrence, Roberta; Janssen, Ian; Lafrance, Jeffrey; Lakdawalla, Darius; Mendelsen, Rena; Powell, Lisa M; Traill, W Bruce; Windmeijer, Frank

2011-10-06

Comprehensive, multi-level approaches are required to address obesity. One important target for intervention is the economic domain. The purpose of this study was to synthesize existing evidence regarding the impact of economic policies targeting obesity and its causal behaviours (diet, physical activity), and to make specific recommendations for the Canadian context. Arksey and O'Malley's (2005) methodological framework for conducting scoping reviews was adopted for this study and this consisted of two phases: 1) a structured literature search and review, and 2) consultation with experts in the research field through a Delphi survey and an in-person expert panel meeting in April 2010. Two key findings from the scoping review included 1) consistent evidence that weight outcomes are responsive to food and beverage prices. The debate on the use of food taxes and subsidies to address obesity should now shift to how best to address practical issues in designing such policies; and 2) very few studies have examined the impact of economic instruments to promote physical activity and clear policy recommendations cannot be made at this time. Delphi survey findings emphasised the relatively modest impact any specific economic instrument would have on obesity independently. Based on empirical evidence and expert opinion, three recommendations were supported. First, to create and implement an effective health filter to review new and current agricultural polices to reduce the possibility that such policies have a deleterious impact on population rates of obesity. Second, to implement a caloric sweetened beverage tax. Third, to examine how to implement fruit and vegetable subsidies targeted at children and low income households. In terms of economic interventions, shifting from empirical evidence to policy recommendation remains challenging. Overall, the evidence is not sufficiently strong to provide clear policy direction. Additionally, the nature of the experiments needed to provide definitive evidence supporting certain policy directions is likely to be complex and potentially unfeasible. However, these are not reasons to take no action. It is likely that policies need to be implemented in the face of an incomplete evidence base.

Economic instruments for obesity prevention: results of a scoping review and modified delphi survey

PubMed Central

2011-01-01

Background Comprehensive, multi-level approaches are required to address obesity. One important target for intervention is the economic domain. The purpose of this study was to synthesize existing evidence regarding the impact of economic policies targeting obesity and its causal behaviours (diet, physical activity), and to make specific recommendations for the Canadian context. Methods Arksey and O'Malley's (2005) methodological framework for conducting scoping reviews was adopted for this study and this consisted of two phases: 1) a structured literature search and review, and 2) consultation with experts in the research field through a Delphi survey and an in-person expert panel meeting in April 2010. Results Two key findings from the scoping review included 1) consistent evidence that weight outcomes are responsive to food and beverage prices. The debate on the use of food taxes and subsidies to address obesity should now shift to how best to address practical issues in designing such policies; and 2) very few studies have examined the impact of economic instruments to promote physical activity and clear policy recommendations cannot be made at this time. Delphi survey findings emphasised the relatively modest impact any specific economic instrument would have on obesity independently. Based on empirical evidence and expert opinion, three recommendations were supported. First, to create and implement an effective health filter to review new and current agricultural polices to reduce the possibility that such policies have a deleterious impact on population rates of obesity. Second, to implement a caloric sweetened beverage tax. Third, to examine how to implement fruit and vegetable subsidies targeted at children and low income households. Conclusions In terms of economic interventions, shifting from empirical evidence to policy recommendation remains challenging. Overall, the evidence is not sufficiently strong to provide clear policy direction. Additionally, the nature of the experiments needed to provide definitive evidence supporting certain policy directions is likely to be complex and potentially unfeasible. However, these are not reasons to take no action. It is likely that policies need to be implemented in the face of an incomplete evidence base. PMID:21978599

[Identification of the scope of practice for dental nurses with Delphi method].

PubMed

Li, Yu-Hong; Lu, Yue-Cen; Huang, Yao; Ruan, Hong; Wu, Zheng-Yi

2016-10-01

To identify the practice scope of dental nurses under the new situations. The draft of scope of practice for dental nurses was based on theoretical analysis, literature review and consultation of advisory panel, and the final scope of practice for dental nurses was established by using the Delphi method. Statistical analysis was implemented using coefficient of variation, Kendall W with SPSS 17.0 software package. Thirty experts were consulted twice by using the Delphi method. The effective rates of two rounds of questionnaire were 100% and 73.3%, respectively. The authority coefficient was 0.837, and the P value of expert coordination coefficients W was less than 0.05. There were totally 116 suggestions from the experts, and 96 were accepted. The scope of practice for dental nurses was finally established, including 4 primary indexes and 25 secondary indexes. The scope of practice for dental nurses under the new situations is established in China through scientific methods. It is favorable for position management of dental nurses and may promote the development of nurse specialists in dental clinic.

International definition of a point-of-care test in family practice: a modified e-Delphi procedure.

PubMed

Schols, Angel M R; Dinant, Geert-Jan; Hopstaken, Rogier; Price, Christopher P; Kusters, Ron; Cals, Jochen W L

2018-01-29

The use of point-of-care tests (POCTs) in family practice is increasing, and the term POCT is often used in medical literature and clinical practice. Yet, no widely supported definition by several professional fields exists. To reach consensus on an international definition of a POCT in family practice. We performed a modified international e-Delphi procedure of four rounds among expert panel members from different professional backgrounds-family practitioners, laboratory specialists, policymakers, researchers and manufacturers. Of 27 panel members from seven different countries, 26 participated in all rounds. Most panel members were active in POCT research or policymaking and 70% worked in family medicine. After choosing important components, structuring of answers and feedback, the following definition was chosen as the best or second best definition by 81% of panel members: a point-of-care test in family practice is a test to support clinical decision making, which is performed by a qualified member of the practice staff nearby the patient and on any part of the patient's body or its derivatives, during or very close to the time of consultation, to help the patient and physician to decide upon the best suited approach, and of which the results should be known at the time of the clinical decision making. The definition emerging from this study can inform family practitioners, laboratory specialists, policymakers and manufacturers on the most widely supported and recognized definition and could act as a clear starting point for the organization and execution of professional point-of-care testing in family practice worldwide. © The Author(s) 2018. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study.

PubMed

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D

2017-01-01

As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Panelist's responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. Copyright® by the International Brazilian Journal of Urology.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study

PubMed Central

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D.

2017-01-01

ABSTRACT Introduction As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. Materials and methods We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Results Panelist’s responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Conclusions Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. PMID:28379668

Preliminary identification of key clinical domains for outcome evaluation in fibromyalgia using the Delphi method: the Italian experience.

PubMed

Salaffi, F; Ciapetti, A; Sarzi Puttini, P; Atzeni, F; Iannuccelli, C; Di Franco, M; Cazzola, M; Bazzichi, L

2012-03-19

Fibromyalgia (FM) is a complex syndrome that, in Italy, affects at least 2% of the adult population. It is characterized by chronic widespread musculoskeletal pain often accompanied by multiple other symptoms. The aim of this study was to identify a set of clinical domains for FM considered relevant by both clinicians and patients using a consensus process. Consensus was achieved using the Delphi method based on questionnaires and systematic, controlled opinion feedback. The Delphi exercise involved a panel of 252 rheumatologists and 86 patients with FM as defined by the American College of Rheumatology criteria. All of the patients and clinicians were asked to rank the relative different domains of FM in order of priority. The content validity index (CVI) was used to establish the percentage agreement. The importance of each item was ranked on a 0-3 Likert scale. The frequency, mean relevance scores, and frequency importance product were also calculated. The Delphi exercise showed that the domains ranked highest by patients were similar to those of the clinicians, with the exception of tender point intensity (considered relevant by the clinicians but not by the patients) and environmental sensitivity (considered important by the patients but not by the clinicians). A final 8-item model was developed which was considered to demonstrate adequate validity. The Delphi exercises identified and ranked relevant key clinical domains that need to be assessed in FM research. On the basis of these results, a new patient-reported composite outcome index can be developed and used in clinical trials.

Development of guidelines for giving community presentations about eating disorders: a Delphi study.

PubMed

Doley, Joanna Rachel; Hart, Laura Merilyn; Stukas, Arthur Anthony; Morgan, Amy Joanna; Rowlands, Danielle Lisa; Paxton, Susan Jessica

2017-01-01

Concerns exist around how to talk about eating disorders (EDs) due to evidence that suggests discussing ED symptoms and behaviours may cause or worsen symptoms in vulnerable people. Using expert consensus, we developed a set of guidelines for giving safe community presentations about EDs. Participants with professional ED expertise, and people with lived experience of an ED, were recruited for a Delphi study. N  = 26 panel members rated 367 statements for both a) inclusion in guidelines, and b) their potential to be helpful (increase knowledge, reduce stigma) or harmful (increase stigma, cause/worsen ED symptoms). After each round of the study, statements were classified as endorsed, re-rate, or not endorsed. 208 statements were endorsed by the panel over three rounds. 13 statements were strongly endorsed in the first round, with both people with lived experience and professionals agreeing it is important for presentations to include information on etiology of EDs and to promote help-seeking. Several statements had a high level of disagreement between those with lived experience and professionals, including the idea that presentations should suggest dieting is likely to result in weight gain. The experts were able to develop consensus on a wide range of issues. Panel members, particularly people with lived experience, were sensitive to aspects of presentations that may be harmful to an audience. The guidelines fill an important gap in the literature and provide guidance to those educating the public about EDs; they should, however, be further evaluated to test their efficacy.

International consensus criteria for the diagnosis of Raynaud's phenomenon.

PubMed

Maverakis, Emanual; Patel, Forum; Kronenberg, Daniel G; Chung, Lorinda; Fiorentino, David; Allanore, Yannick; Guiducci, Serena; Hesselstrand, Roger; Hummers, Laura K; Duong, Chris; Kahaleh, Bashar; Macgregor, Alexander; Matucci-Cerinic, Marco; Wollheim, Frank A; Mayes, Maureen D; Gershwin, M Eric

2014-01-01

Vasoconstriction accompanied by changes in skin color is a normal physiologic response to cold. The distinction between this normal physiology and Raynaud's phenomenon (RP) has yet to be well characterized. In anticipation of the 9th International Congress on Autoimmunity, a panel of 12 RP experts from 9 different institutes and four different countries were assembled for a Delphi exercise to establish new diagnostic criteria for RP. Relevant investigators with highly cited manuscripts in Raynaud's-related research were identified using the Web of Science and invited to participate. Surveys at each stage were administered to participants via the on-line SurveyMonkey software tool. The participants evaluated the level of appropriateness of statements using a scale of 1 (extremely inappropriate) through 9 (extremely appropriate). In the second stage, panel participants were asked to rank rewritten items from the first round that were scored as "uncertain" for the diagnosis of RP, items with significant disagreement (Disagreement Index > 1), and new items suggested by the panel. Results were analyzed using the Interpercentile Range Adjusted for Symmetry (IPRAS) method. A 3-Step Approach to diagnose RP was then developed using items the panelists "agreed" were "appropriate" diagnostic criteria. In the final stage, the panel was presented with the newly developed diagnostic criteria and asked to rate them against previous models. Following the first two iterations of the Delphi exercise, the panel of 12 experts agreed that 36 of the items were "appropriate", 12 items had "uncertain" appropriateness, and 13 items were "inappropriate" to use in the diagnostic criteria of RP. Using an expert committee, we developed a 3-Step Approach for the diagnosis of RP and 5 additional criteria for the diagnosis of primary RP. The committee came to an agreement that the proposed criteria were "appropriate and accurate" for use by physicians to diagnose patients with RP. Published by Elsevier Ltd.

International Consensus Criteria for the Diagnosis of Raynaud’s Phenomenon

PubMed Central

Maverakis, Emanual; Patel, Forum; Kronenberg, Daniel; Chung, Lori; Fiorentino, David; Allanore, Yannick; Guiducci, Serena; Hesselstrand, Roger; Hummers, Laura; Duong, Chris; Kahaleh, Bashar; Macgregor, Alexander; Matucci-Cerinic, Marco; Wollheim, Frank; Mayes, Maureen; Gershwin, M. Eric

2014-01-01

Vasoconstriction accompanied by changes in skin color is a normal physiologic response to cold. The distinction between this normal physiology and Raynaud’s phenomenon (RP) has yet to be well characterized. In anticipation of the 9th International Congress on Autoimmunity, a panel of 12 RP experts from 9 different institutes and four different countries were assembled for a Delphi exercise to establish new diagnostic criteria for RP. Relevant investigators with highly cited manuscripts in Raynaud’s-related research were identified using the Web of Science and invited to participate. Surveys at each stage were administered to participants via the on-line SurveyMonkey software tool. The participants evaluated the level of appropriateness of statements using a scale of 1 (extremely inappropriate) through 9 (extremely appropriate). In the second stage, panel participants were asked to rank rewritten items from the first round that were scored as “uncertain” for the diagnosis of RP, items with significant disagreement (Disagreement Index > 1), and new items suggested by the panel. Results were analyzed using the Interpercentile Range Adjusted for Symmetry (IPRAS) method. A 3-Step Approach to diagnose RP was then developed using items the panelists “agreed” were “appropriate” diagnostic criteria. In the final stage, the panel was presented with the newly developed diagnostic criteria and asked to rate them against previous models. Following the first two iterations of the Delphi exercise, the panel of 12 experts agreed that 36 of the items were “appropriate,” 12 items had “uncertain” appropriateness, and 13 items were “inappropriate” to use in the diagnostic criteria of RP. Using an expert committee, we developed a 3-Step Approach for the diagnosis of RP and 5 additional criteria for the diagnosis of primary RP. The committee came to an agreement that the proposed criteria were “appropriate and accurate” for use by physicians to diagnose patients with RP. PMID:24491823

Developing a framework of, and quality indicators for, general practice management in Europe.

PubMed

Engels, Yvonne; Campbell, Stephen; Dautzenberg, Maaike; van den Hombergh, Pieter; Brinkmann, Henrik; Szécsényi, Joachim; Falcoff, Hector; Seuntjens, Luc; Kuenzi, Beat; Grol, Richard

2005-04-01

To develop a framework for general practice management made up of quality indicators shared by six European countries. Two-round postal Delphi questionnaire in the setting of general practice in Belgium, France, Germany, The Netherlands, Switzerland and the United Kingdom. Six national expert panels, each consisting of 10 members, primarily primary care practitioners and experts in the field of quality in primary care participated in the study. The main outcome measures were: (a) a European framework with indicators for the organization of primary care; and (b) ratings of the face validity of the usefulness of the indicators by expert panels in six countries. Agreement was reached about a definition of practice management across five domains (infrastructure, staff, information, finance, and quality and safety), and a common set of indicators for the organization of general practice. The panellist response rate was 95%. Sixty-two indicators (37%) were rated face valid by all six panels. Examples include out of hours service, accessibility, the content of doctors' bags and staff involvement in quality improvement. No indicators were rated invalid by all six panels. It proved to be possible to develop a European set of indicators for assessing the quality of practice management, despite the differences in health care systems and cultures in the six different countries. These indicators will now be used in a quality assessment procedure of practice management in nine European countries. While organizational indicators are part of the new GMS contract in the UK, this research shows that many practice management issues within primary care are also of relevance in other European countries.

The Safety of Appropriate Use of Over-the-Counter Proton Pump Inhibitors: An Evidence-Based Review and Delphi Consensus.

PubMed

Johnson, David A; Katz, Philip O; Armstrong, David; Cohen, Henry; Delaney, Brendan C; Howden, Colin W; Katelaris, Peter; Tutuian, Radu I; Castell, Donald O

2017-04-01

The availability of over-the-counter (OTC) proton pump inhibitors (PPIs) for the short-term (2 weeks) management of frequent heartburn (≥2 days/week) has increased markedly, yet evidence-based recommendations have not been developed. A panel of nine international experts in gastroesophageal reflux disease developed consensus statements regarding the risks and benefits of OTC PPIs using a modified Delphi process. Consensus (based on ≥80% approval) was reached through multiple rounds of remote voting and a final round of live voting. To identify relevant data, the available literature was searched and summarized. Grading of Recommendations, Assessment, Development and Evaluation (GRADE) system terminology was used to rate the quality of evidence and strength of recommendations; consensus was based on ≥2/3 agreement. After 4 rounds of review, consensus was achieved for 18 statements. Notably, the available data did not directly reflect OTC use, but instead, prescription use; therefore, extrapolations to the OTC setting were often necessary. This limitation is regrettable, but it justifies performing this exercise to provide evidence-based expert opinion on a widely used class of drugs. The panel determined that using OTC PPIs according to label instructions is unlikely to mask the symptoms of esophageal or gastric cancer or adversely impact the natural history of related precursor conditions. OTC PPIs are not expected to substantially affect micronutrient absorption or bone mineral density or cause community-acquired pneumonia, Clostridium difficile infection, or cardiovascular adverse events. However, OTC PPI use may be associated with slightly increased risks for infectious diarrhea, certain idiosyncratic reactions, and cirrhosis-related spontaneous bacterial peritonitis. The available evidence does not suggest that OTC PPI use consistent with label instructions is associated with substantial health risks. To minimize potential risks, healthcare professionals and consumers must actively participate in decision making when managing reflux-related symptoms in the self-care setting.

The development and psychometric properties of a measure of clinicians' attitudes to depression: the revised Depression Attitude Questionnaire (R-DAQ).

PubMed

Haddad, Mark; Menchetti, Marco; McKeown, Eamonn; Tylee, André; Mann, Anthony

2015-02-05

Depression is a common mental disorder associated with substantial disability. It is inadequately recognised and managed, and clinicians' attitudes to this condition and its treatment may play a part in this. Most research in this area has used the Depression Attitude Questionnaire (DAQ), but analyses have shown this measure to exhibit problems in psychometric properties and suitability for the health professionals and settings where depression recognition may occur. We revised the DAQ using a pooled review of findings from studies using this measure, together with a Delphi study which sought the opinions of a panel of relevant experts based in the UK, USA, Australia, and European countries (n = 24) using 3 rounds of questioning to consider attitude dimensions, content, and item wording. After item generation, revision and consensus (agreement >70%) using the Delphi panel, the revised DAQ (R-DAQ) was tested with 1193 health care providers to determine its psychometric properties. Finally the test-retest reliability of the R-DAQ was examined with 38 participants. The 22-item R-DAQ scale showed good internal consistency: Cronbach's alpha coefficient was 0.84; and satisfactory test-retest reliability: intraclass correlation coefficient was 0.62 (95% C.I. 0.37 to 0.78). Exploratory factor analysis favoured a three-factor structure (professional confidence, therapeutic optimism/pessimism, and a generalist perspective), which accounted for 45.3% of the variance. The R-DAQ provides a revised tool for examining clinicians' views and understanding of depression. It addresses important weaknesses in the original measure whilst retaining items and dimensions that appeared valid. This revised scale is likely to be useful in examining attitudes across the health professional workforce and beyond the confines of the UK, and may be valuable for the purpose of evaluating training that aims to address clinicians' attitudes to depression. It incorporates key dimensions of attitudes with a modest number of items making it applicable to use in busy clinical settings.

Geriatric Assessment-Guided Care Processes for Older Adults: A Delphi Consensus of Geriatric Oncology Experts.

PubMed

Mohile, Supriya Gupta; Velarde, Carla; Hurria, Arti; Magnuson, Allison; Lowenstein, Lisa; Pandya, Chintan; O'Donovan, Anita; Gorawara-Bhat, Rita; Dale, William

2015-09-01

Structured care processes that provide a framework for how oncologists can incorporate geriatric assessment (GA) into clinical practice could improve outcomes for vulnerable older adults with cancer, a growing population at high risk of toxicity from cancer treatment. We sought to obtain consensus from an expert panel on the use of GA in clinical practice and to develop algorithms of GA-guided care processes. The Delphi technique, a well-recognized structured and reiterative process to reach consensus, was used. Participants were geriatric oncology experts who attended NIH-funded U13 or Cancer and Aging Research Group conferences. Consensus was defined as an interquartile range of 2 or more units, or 66.7% or greater, selecting a utility/helpfulness rating of 7 or greater on a 10-point Likert scale. For nominal data, consensus was defined as agreement among 66.7% or more of the group. From 33 invited, 30 participants completed all 3 rounds. Most experts (75%) used GA in clinical care, and the remainder were involved in geriatric oncology research. The panel met consensus that "all patients aged 75 years or older and those who are younger with age-related health concerns" should undergo GA and that all domains (function, physical performance, comorbidity/polypharmacy, cognition, nutrition, psychological status, and social support) should be included. Consensus was met for how GA could guide nononcologic interventions and cancer treatment decisions. Algorithms for GA-guided care processes were developed. This Delphi investigation of geriatric oncology experts demonstrated that GA should be performed for older patients with cancer to guide care processes. Copyright © 2015 by the National Comprehensive Cancer Network.

What should dental services for people with disabilities be like? Results of an Irish Delphi panel survey.

PubMed

Mac Giolla Phadraig, Caoimhin; Nunn, June; Dougall, Alison; O'Neill, Eunan; McLoughlin, Jacinta; Guerin, Suzanne

2014-01-01

This study aimed to generate prioritised goals for oral health services for people with disabilities as a first step in meeting the need for evidence based oral health services for people with disabilities in Ireland. The study used a three round modified e-Delphi method, involving dental service professionals and people with disabilities or their representatives, in Ireland. Three rounds were completed online using SurveyMonkey. Round 1 asked: "List what you think dental services for people with disabilities in Ireland should be like." Items for subsequent rounds were generated from responses to Round 1. Round 2 and Round 3 used 5 point Likert scales to rank these items by priority: from No Priority (1) to Top Priority (5). Consensus was achieved on each item where at least 80% of respondents considered an item either High or Top Priority. A consensus meeting concluded the process. Sixty-one panelists started and 48 completed the survey. The Delphi panel agreed on level of priority for 69 items and generated 16 consensus statements. These statements covered a range of topics such as access to care, availability of information and training, quality of care, dental treatment and cost. A recurrent theme relating to the appropriateness of care to individual need arose across topics suggesting a need to match service delivery according to the individual's needs, wants and expectations rather than the disability type/diagnosis based service which predominates today. This process produced a list of prioritised goals for dental services for people with disabilities. This creates a foundation for building evidence-based service models for people with disabilities in Ireland.

Achieving high quality standards in laparoscopic colon resection for cancer: A Delphi consensus-based position paper.

PubMed

Lorenzon, Laura; Biondi, Alberto; Carus, Thomas; Dziki, Adam; Espin, Eloy; Figueiredo, Nuno; Ruiz, Marcos Gomez; Mersich, Tamas; Montroni, Isacco; Tanis, Pieter J; Benz, Stefan Rolf; Bianchi, Paolo Pietro; Biebl, Matthias; Broeders, Ivo; De Luca, Raffaele; Delrio, Paolo; D'Hondt, Mathieu; Fürst, Alois; Grosek, Jan; Guimaraes Videira, Jose Flavio; Herbst, Friedrich; Jayne, David; Lázár, György; Miskovic, Danilo; Muratore, Andrea; Helmer Sjo, Ole; Scheinin, Tom; Tomazic, Ales; Türler, Andreas; Van de Velde, Cornelius; Wexner, Steven D; Wullstein, Christoph; Zegarski, Wojciech; D'Ugo, Domenico

2018-04-01

To investigate the rate of laparoscopic colectomies for colon cancer using registries and population-based studies. To provide a position paper on mini-invasive (MIS) colon cancer surgery based on the opinion of experts leader in this field. A systematic review of the literature was conducted using PRISMA guidelines for the rate of laparoscopy in colon cancer. Moreover, Delphi methodology was used to reach consensus among 35 international experts in four study rounds. Consensus was defined as an agreement ≥75.0%. Domains of interest included nosology, essential technical/oncological requirements, outcomes and MIS training. Forty-four studies from 42 articles were reviewed. Although it is still sub-optimal, the rate of MIS for colon cancer increased over the years and it is currently >50% in Korea, Netherlands, UK and Australia. The remaining European countries are un-investigated and presented lower rates with highest variations, ranging 7-35%. Using Delphi methodology, a laparoscopic colectomy was defined as a "colon resection performed using key-hole surgery independently from the type of anastomosis". The panel defined also the oncological requirements recognized essential for the procedure and agreed that when performed by experienced surgeons, it should be marked as best practice in guidelines, given the principles of oncologic surgery be respected (R0 procedure, vessel ligation and mesocolon integrity). The rate of MIS colectomies for cancer in Europe should be further investigated. A panel of leaders in this field defined laparoscopic colectomy as a best practice procedure when performed by an experienced surgeon respecting the standards of surgical oncology. Copyright © 2018 Elsevier Ltd, BASO ~ The Association for Cancer Surgery, and the European Society of Surgical Oncology. All rights reserved.

Expert Recommended Strategies for Classroom Management for Beginning Teachers Placed in Hard-to-Staff Schools in Urban School Districts

ERIC Educational Resources Information Center

Alexis, Chelly C.

2014-01-01

Purpose: The purpose of this study was to get the opinion of a panel of experts as to which classroom management strategies should be implemented in urban school district mentoring programs to help beginning teachers who are placed in hard-to-staff schools in Los Angeles County, California. Methodology: This Delphi study included 20 expert mentors…

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people

PubMed Central

Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Background Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Methods Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Results Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Conclusion Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond. PMID:29155870

A modified Delphi study to determine the level of consensus across the European Union on the structures, processes and desired outcomes of the management of polypharmacy in older people.

PubMed

Stewart, Derek; Gibson-Smith, Kathrine; MacLure, Katie; Mair, Alpana; Alonso, Albert; Codina, Carles; Cittadini, Antonio; Fernandez-Llimos, Fernando; Fleming, Glenda; Gennimata, Dimitra; Gillespie, Ulrika; Harrison, Cathy; Junius-Walker, Ulrike; Kardas, Przemysław; Kempen, Thomas; Kinnear, Moira; Lewek, Pawel; Malva, Joao; McIntosh, Jennifer; Scullin, Claire; Wiese, Birgitt

2017-01-01

Inappropriate use of multiple medicines (inappropriate polypharmacy) is a major challenge in older people with consequences of increased prevalence and severity of adverse drug reactions and interactions, and reduced medicines adherence. The aim of this study was to determine the levels of consensus amongst key stakeholders in the European Union (EU) in relation to aspects of the management of polypharmacy in older people. Forty-six statements were developed on aspects of healthcare structures, processes and desired outcomes, with consensus defined at ≥ 80% agreement. Panel members were strategists (e.g. directors, leading clinicians and commissioners) from each of the 28 EU member states, with a target recruitment of five per member state. Three Delphi rounds were conducted via email, with panel members being provided with summative results and collated, anonymised comments at the commencement of Rounds 2 and 3. Ninety panel members were recruited (64.3% of target), with high participation levels throughout the three Delphi rounds (91.1%, 83.3%, 72.2%). During Round 1, consensus was obtained for 27/46 statements (58.7%), with an additional two statements in Round 2 and none in Round 3. Consensus was obtained for statements relating to: potential gain arising from polypharmacy management (3/4 statements); strategic development (7/7); change management (5/7) indicator measures (4/6); legislation (0/3); awareness raising (5/5); polypharmacy reviews (5/7); and EU vision (0/7). Analysis of free text comments indicated that the vision statements were too ambitious and not achievable by the specified timeframe of 2025. Consensus was obtained amongst key EU strategists around many aspects of polypharmacy management in older people. Notably, no consensus was achieved in relation to statements relating to the need to alter legislation in areas of healthcare delivery, remuneration and practitioner scope of practice. While the vision for the EU by 2025 was considered rather ambitious, there is great potential and clear opportunity to advance polypharmacy management throughout the EU and beyond.

Establishing nursing-sensitive quality indicators for the operating room: A cross-sectional Delphi survey conducted in China.

PubMed

Wu, Qi; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-01-01

Nursing-sensitive quality indicators comprise principles, procedures, and assessments to quantify the level of nursing quality in hospital departments. Although studies have demonstrated that quality indicators are essential for monitoring nursing practice in the operating room (OR), nursing quality in China is highly subjective and localised OR nursing-sensitive quality indicators are lacking. This study aimed to establish scientific, objective and comprehensive nursing-sensitive quality indicators for the OR to evaluate and monitor OR nursing care quality in China. Literature search for relevant evidence-based studies was performed using Cochrane, Medline, PubMed, Embase, and other databases, followed by literature review and group discussion by the expert panel. Two successive rounds of Delphi surveys were conducted using questionnaires completed by the expert panel to reach consensus and define nursing-sensitive quality indicators for the OR. Two rounds of Delphi surveys each had 100% questionnaire retrieval rate, with Kendall W coordination coefficients ranging from 0.096 to 0.263 (P<0.001). In round 1 of expert evaluation of 26 indicators, Kendall's W was 0.263 for importance, 0.126 for rationality, and 0.125 for feasibility of data collection (all P<0.001). After round 2, 23 items were established as OR nursing-sensitive quality indicators, including rates of work time wastage, surgery start-time delay, OR turnover time between surgeries, same-day surgery cancellation, and number of monthly surgeries in each OR; checking surgical patients, surgery site marking, allergy history, and antibiotics use 60min before incision; and also assessing expected surgical time, sterilisation indicator results, availability of surgical instruments and materials, and instrument count. Scientific, practical, and reliable OR nursing-sensitive quality indicators can be established based on evidence-based studies and expert consensus using the Delphi method. The quality indicators developed in this study may provide an objective and quantitative reference for evaluating nursing quality in Chinese ORs. Copyright © 2016 Australian College of Critical Care Nurses Ltd. Published by Elsevier Ltd. All rights reserved.

A Delphi-Based Framework for systems architecting of in-orbit exploration infrastructure for human exploration beyond Low Earth Orbit

NASA Astrophysics Data System (ADS)

Aliakbargolkar, Alessandro; Crawley, Edward F.

2014-01-01

The current debate in the U.S. Human Spaceflight Program focuses on the development of the next generation of man-rated heavy lift launch vehicles. While launch vehicle systems are of critical importance for future exploration, a comprehensive analysis of the entire exploration infrastructure is required to avoid costly pitfalls at early stages of the design process. This paper addresses this need by presenting a Delphi-Based Systems Architecting Framework for integrated architectural analysis of future in-orbit infrastructure for human space exploration beyond Low Earth Orbit. The paper is structured in two parts. The first part consists of an expert elicitation study to identify objectives for the in-space transportation infrastructure. The study was conducted between November 2011 and January 2012 with 15 senior experts involved in human spaceflight in the United States and Europe. The elicitation study included the formation of three expert panels representing exploration, science, and policy stakeholders engaged in a 3-round Delphi study. The rationale behind the Delphi approach, as imported from social science research, is discussed. Finally, a novel version of the Delphi method is presented and applied to technical decision-making and systems architecting in the context of human space exploration. The second part of the paper describes a tradespace exploration study of in-orbit infrastructure coupled with a requirements definition exercise informed by expert elicitation. The uncertainties associated with technical requirements and stakeholder goals are explicitly considered in the analysis. The outcome of the expert elicitation process portrays an integrated view of perceived stakeholder needs within the human spaceflight community. Needs are subsequently converted into requirements and coupled to the system architectures of interest to analyze the correlation between exploration, science, and policy goals. Pareto analysis is used to identify architectures of interest for further consideration by decision-makers. The paper closes with a summary of insights and develops a strategy for evolutionary development of the exploration infrastructure of the incoming decades. The most important result produced by this analysis is the identification of a critical irreducible ambiguity undermining value delivery for the in-space transportation infrastructure of the next three decades: destination choice. Consensus on destination is far from being reached by the community at large, with particular reference to exploration and policy stakeholders. The realization of this ambiguity is a call for NASA to promote an open forum on this topic, and to develop a strong case for policy makers to incentivize investments in the human spaceflight industry in the next decades.

Medication administration errors from a nursing viewpoint: a formal consensus of definition and scenarios using a Delphi technique.

PubMed

Shawahna, Ramzi; Masri, Dina; Al-Gharabeh, Rawan; Deek, Rawan; Al-Thayba, Lama; Halaweh, Masa

2016-02-01

To develop and achieve formal consensus on a definition of medication administration errors and scenarios that should or should not be considered as medication administration errors in hospitalised patient settings. Medication administration errors occur frequently in hospitalised patient settings. Currently, there is no formal consensus on a definition of medication administration errors or scenarios that should or should not be considered as medication administration errors. This was a descriptive study using Delphi technique. A panel of experts (n = 50) recruited from major hospitals, nursing schools and universities in Palestine took part in the study. Three Delphi rounds were followed to achieve consensus on a proposed definition of medication administration errors and a series of 61 scenarios representing potential medication administration error situations formulated into a questionnaire. In the first Delphi round, key contact nurses' views on medication administration errors were explored. In the second Delphi round, consensus was achieved to accept the proposed definition of medication administration errors and to include 36 (59%) scenarios and exclude 1 (1·6%) as medication administration errors. In the third Delphi round, consensus was achieved to consider further 14 (23%) and exclude 2 (3·3%) as medication administration errors while the remaining eight (13·1%) were considered equivocal. Of the 61 scenarios included in the Delphi process, experts decided to include 50 scenarios as medication administration errors, exclude three scenarios and include or exclude eight scenarios depending on the individual clinical situation. Consensus on a definition and scenarios representing medication administration errors can be achieved using formal consensus techniques. Researchers should be aware that using different definitions of medication administration errors, inclusion or exclusion of medication administration error situations could significantly affect the rate of medication administration errors reported in their studies. Consensual definitions and medication administration error situations can be used in future epidemiology studies investigating medication administration errors in hospitalised patient settings which may permit and promote direct comparisons of different studies. © 2015 John Wiley & Sons Ltd.

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study.

PubMed

Mascherek, Anna C; Schwappach, David L B

2016-08-05

Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study

PubMed Central

Mascherek, Anna C

2016-01-01

Objective Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. Design As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Results Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Conclusions Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. PMID:27496233

Development of clinical pharmacy key performance indicators for hospital pharmacists using a modified Delphi approach.

PubMed

Fernandes, Olavo; Gorman, Sean K; Slavik, Richard S; Semchuk, William M; Shalansky, Steve; Bussières, Jean-François; Doucette, Douglas; Bannerman, Heather; Lo, Jennifer; Shukla, Simone; Chan, Winnie W Y; Benninger, Natalie; MacKinnon, Neil J; Bell, Chaim M; Slobodan, Jeremy; Lyder, Catherine; Zed, Peter J; Toombs, Kent

2015-06-01

Key performance indicators (KPIs) are quantifiable measures of quality. There are no published, systematically derived clinical pharmacy KPIs (cpKPIs). A group of hospital pharmacists aimed to develop national cpKPIs to advance clinical pharmacy practice and improve patient care. A cpKPI working group established a cpKPI definition, 8 evidence-derived cpKPI critical activity areas, 26 candidate cpKPIs, and 11 cpKPI ideal attributes in addition to 1 overall consensus criterion. Twenty-six clinical pharmacists and hospital pharmacy leaders participated in an internet-based 3-round modified Delphi survey. Panelists rated 26 candidate cpKPIs using 11 cpKPI ideal attributes and 1 overall consensus criterion on a 9-point Likert scale. A meeting was facilitated between rounds 2 and 3 to debate the merits and wording of candidate cpKPIs. Consensus was reached if 75% or more of panelists assigned a score of 7 to 9 on the consensus criterion during the third Delphi round. All panelists completed the 3 Delphi rounds, and 25/26 (96%) attended the meeting. Eight candidate cpKPIs met the consensus definition: (1) performing admission medication reconciliation (including best-possible medication history), (2) participating in interprofessional patient care rounds, (3) completing pharmaceutical care plans, (4) resolving drug therapy problems, (5) providing in-person disease and medication education to patients, (6) providing discharge patient medication education, (7) performing discharge medication reconciliation, and (8) providing bundled, proactive direct patient care activities. A Delphi panel of hospital pharmacists was successful in determining 8 consensus cpKPIs. Measurement and assessment of these cpKPIs will serve to advance clinical pharmacy practice and improve patient care. © The Author(s) 2015.

Health care administration in the year 2000: practitioners' views of future issues and job requirements.

PubMed

Hudak, R P; Brooke, P P; Finstuen, K; Riley, P

1993-01-01

This research identifies the most important domains in health care administration (HCA) from now to the year 2000 and differentiates job skill, knowledge, and ability requirements necessary for successful management. Fellows of the American College of Healthcare Executives from about half of the United States responded to two iterations of a Delphi mail inquiry. Fellows identified 102 issues that were content-analyzed into nine domains by an HCA expert panel. Domains, in order of ranked importance, were cost/finance, leadership, professional staff interactions, health care delivery concepts, accessibility, ethics, quality/risk management, technology, and marketing. In the second Delphi iteration, Fellows reviewed domain results and rated job requirements on required job importance. Results indicated that while a business orientation is needed for organizational survival, an equal emphasis on person-oriented skills, knowledge, and abilities is required.

Core competency model for the family planning public health nurse.

PubMed

Hewitt, Caroline M; Roye, Carol; Gebbie, Kristine M

2014-01-01

A core competency model for family planning public health nurses has been developed, using a three stage Delphi Method with an expert panel of 40 family planning senior administrators, community/public health nursing faculty and seasoned family planning public health nurses. The initial survey was developed from the 2011 Title X Family Planning program priorities. The 32-item survey was distributed electronically via SurveyMonkey(®). Panelist attrition was low, and participation robust resulting in the final 28-item model, suggesting that the Delphi Method was a successful technique through which to achieve consensus. Competencies with at least 75% consensus were included in the model and those competencies were primarily related to education/counseling and administration of medications and contraceptives. The competencies identified have implications for education/training, certification and workplace performance. © 2014 Wiley Periodicals, Inc.

Designing a balanced scorecard for a tertiary care hospital in Pakistan: a modified Delphi group exercise.

PubMed

Rabbani, Fauziah; Jafri, Syed M Wasim; Abbas, Farhat; Shah, Mairaj; Azam, Syed Iqbal; Shaikh, Babar Tasneem; Brommels, Mats; Tomson, Goran

2010-01-01

Balanced Scorecards (BSC) are being implemented in high income health settings linking organizational strategies with performance data. At this private university hospital in Pakistan an elaborate information system exists. This study aimed to make best use of available data for better performance management. Applying the modified Delphi technique an expert panel of clinicians and hospital managers reduced a long list of indicators to a manageable size. Indicators from existing documents were evaluated for their importance, scientific soundness, appropriateness to hospital's strategic plan, feasibility and modifiability. Panel members individually rated each indicator on a scale of 1-9 for the above criteria. Median scores were assigned. Of an initial set of 50 indicators, 20 were finally selected to be assigned to the four BSC quadrants. These were financial (n = 4), customer or patient (n = 4), internal business or quality of care (n = 7) and innovation/learning or employee perspectives (n = 5). A need for stringent definitions, international benchmarking and standardized measurement methods was identified. BSC compels individual clinicians and managers to jointly work towards improving performance. This scorecard is now ready to be implemented by this hospital as a performance management tool for monitoring indicators, addressing measurement issues and enabling comparisons with hospitals in other settings. Copyright 2010 John Wiley & Sons, Ltd.

Clinical utility of FDG-PET in amyotrophic lateral sclerosis and Huntington's disease.

PubMed

Agosta, Federica; Altomare, Daniele; Festari, Cristina; Orini, Stefania; Gandolfo, Federica; Boccardi, Marina; Arbizu, Javier; Bouwman, Femke; Drzezga, Alexander; Nestor, Peter; Nobili, Flavio; Walker, Zuzana; Pagani, Marco

2018-05-01

To evaluate the incremental value of FDG-PET over clinical tests in: (i) diagnosis of amyotrophic lateral sclerosis (ALS); (ii) picking early signs of neurodegeneration in patients with a genetic risk of Huntington's disease (HD); and detecting metabolic changes related to cognitive impairment in (iii) ALS and (iv) HD patients. Four comprehensive literature searches were conducted using the PICO model to extract evidence from relevant studies. An expert panel then voted using the Delphi method on these four diagnostic scenarios. The availability of evidence was good for FDG-PET utility to support the diagnosis of ALS, poor for identifying presymptomatic subjects carrying HD mutation who will convert to HD, and lacking for identifying cognitive-related metabolic changes in both ALS and HD. After the Delphi consensual procedure, the panel did not support the clinical use of FDG-PET for any of the four scenarios. Relative to other neurodegenerative diseases, the clinical use of FDG-PET in ALS and HD is still in its infancy. Once validated by disease-control studies, FDG-PET might represent a potentially useful biomarker for ALS diagnosis. FDG-PET is presently not justified as a routine investigation to predict conversion to HD, nor to detect evidence of brain dysfunction justifying cognitive decline in ALS and HD.

Recommendations for the Use of Serious Games in Neurodegenerative Disorders: 2016 Delphi Panel.

PubMed

Manera, Valeria; Ben-Sadoun, Grégory; Aalbers, Teun; Agopyan, Hovannes; Askenazy, Florence; Benoit, Michel; Bensamoun, David; Bourgeois, Jérémy; Bredin, Jonathan; Bremond, Francois; Crispim-Junior, Carlos; David, Renaud; De Schutter, Bob; Ettore, Eric; Fairchild, Jennifer; Foulon, Pierre; Gazzaley, Adam; Gros, Auriane; Hun, Stéphanie; Knoefel, Frank; Olde Rikkert, Marcel; Phan Tran, Minh K; Politis, Antonios; Rigaud, Anne S; Sacco, Guillaume; Serret, Sylvie; Thümmler, Susanne; Welter, Marie L; Robert, Philippe

2017-01-01

The use of Serious Games (SG) in the health domain is expanding. In the field of neurodegenerative disorders (ND) such as Alzheimer's disease, SG are currently employed both to support and improve the assessment of different functional and cognitive abilities, and to provide alternative solutions for patients' treatment, stimulation, and rehabilitation. As the field is quite young, recommendations on the use of SG in people with ND are still rare. In 2014 we proposed some initial recommendations (Robert et al., 2014). The aim of the present work was to update them, thanks to opinions gathered by experts in the field during an expert Delphi panel. Results confirmed that SG are adapted to elderly people with mild cognitive impairment (MCI) and dementia, and can be employed for several purposes, including assessment, stimulation, and improving wellbeing, with some differences depending on the population (e.g., physical stimulation may be better suited for people with MCI). SG are more adapted for use with trained caregivers (both at home and in clinical settings), with a frequency ranging from 2 to 4 times a week. Importantly, the target of SG, their frequency of use and the context in which they are played depend on the SG typology (e.g., Exergame, cognitive game), and should be personalized with the help of a clinician.

Teen problem pregnancies: peer counselors' perceptions about community concerns and solutions. approach and limitations.

PubMed

David, H P; Johnson, R L

1980-01-01

This paper summarizes the methodology and major recommendations of a study of peer counselors' perceptions concerning the determinants of adolescent sexuality, contraceptive use, and pregnancy resolution. 55 adolescent peer counselors were queried by use of a modified Delphi technique in panels of 9 or fewer members about their observations regarding the sexual behavior of Districk of Columbia high school students. Questioning focused on identification of the major determinants of unwanted adolescent pregnancy and of effective countermeasures to reduce the importance of these determinants. On the basis of the Delphi panels and subsequent discussions with peer counselors, the research team made 3 major recommendations. 1st, it was suggested that school sex education programs could be improved by placing greater emphasis on women's needs, assertiveness training, and communication problems with males. The 2nd recommendation was for rap sessions where adolescents can discuss their questions about sex with parents of other teenagers (not their own parents) and where parents can hear the views of teenagers who are not their own children. The 3rd recommendation concerned contraceptive distribution and the development and marketing of a safe, effective nonprescription method acceptable to teenagers. Adolescents are currently denied access to a health care system oriented to their needs, perceptions, and time frames.

How a concerned family member, friend or member of the public can help someone with gambling problems: a Delphi consensus study.

PubMed

Bond, Kathy S; Jorm, Anthony F; Miller, Helen E; Rodda, Simone N; Reavley, Nicola J; Kelly, Claire M; Kitchener, Betty A

2016-02-03

Gambling is an enjoyable recreational pursuit for many people. However, for some it can lead to significant harms. The Delphi expert consensus method was used to develop guidelines for how a concerned family member, friend or member of the public can recognise the signs of gambling problems and support a person to change their gambling. A systematic review of websites, books and journal articles was conducted to develop a questionnaire containing items about the knowledge, skills and actions needed for supporting a person with gambling problems. These items were rated over three rounds by two international expert panels comprising people with a lived experience of gambling problems and professionals who treat people with gambling problems or research gambling problems. A total of 66 experts (34 with lived experience and 32 professionals) rated 412 helping statements according to whether they thought the statements should be included in these guidelines. There were 234 helping statements that were endorsed by at least 80 % of members of both of the expert panels. These endorsed statements were used to develop the guidelines. Two groups of experts were able to reach substantial consensus on how someone can recognise the signs of gambling problems and support a person to change.

Community Engagement in the CTSA Program: Stakeholder Responses from a National Delphi Process

PubMed Central

Seifer, Sarena D.; Stupak, Matthew; Martinez, Linda Sprague

2014-01-01

Abstract In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community‐Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. PMID:24841362

Community engagement in the CTSA program: stakeholder responses from a national Delphi process.

PubMed

Freeman, Elmer; Seifer, Sarena D; Stupak, Matthew; Martinez, Linda Sprague

2014-06-01

In response to the Institute of Medicine (IOM) Committee's December 2012 public request for stakeholder input on the Clinical and Translational Science Award (CTSA) program, two nonprofit organizations, the Center for Community Health Education Research and Service, Inc. (CCHERS) and Community-Campus Partnerships for Health (CCPH), solicited feedback from CTSA stakeholders using the Delphi method. Academic and community stakeholders were invited to participate in the Delphi, which is an exploratory method used for group consensus building. Six questions posed by the IOM Committee to an invited panel on community engagement were electronically sent to stakeholders. In Round 1 stakeholder responses were coded thematically and then tallied. Round 2 asked stakeholders to state their level of agreement with each of the themes using a Likert scale. Finally, in Round 3 the group was asked to rank the Round 2 based on potential impact for the CTSA program and implementation feasibility. The benefits of community engagement in clinical and translational research as well as the need to integrate community engagement across all components of the CTSA program were common themes. Respondents expressed skepticism as to the feasibility of strengthening CTSA community engagement. © 2014 Wiley Periodicals, Inc.

TCM Pattern Questionnaire for Lateral Elbow Pain: Development of an Instrument via a Delphi Process

PubMed Central

Bian, Zhao-Xiang

2016-01-01

Individualized acupuncture treatment has been practiced for pain therapy. This study used acupuncture treatment for lateral elbow pain (LEP) as an example to study the diagnostic practice of individualized acupuncture treatment. A provisional version of LEP pattern questionnaire was developed based on a recent systematic review on TCM pattern diagnosis for LEP. A Delphi panel of 33 clinical experts from seven different countries was formed, and the Delphi survey was conducted in Chinese and English language for two rounds. Consensus was achieved from all 26 panelists who responded to the second round on 243 items of the instrument, which included a 72-question-long questionnaire. The mean level of expert consensus on the items of the final questionnaire was 85%. Consensus was found on four TCM patterns that could underlie LEP, namely, the wind-cold-dampness pattern, the qi stagnation and blood stasis pattern, the dual deficiency of qi and blood pattern, and the retained dampness-heat pattern. A list of signs and symptoms indicating one of the four TCM patterns and a list of preferred treatment modalities for each pattern were also generated. Our instrument shows considerable content validity. Further validity and reliability studies are under way. PMID:27525024

Patients’ and Clinicians’ Views of the Psychological Components of Tinnitus Treatment That Could Inform Audiologists’ Usual Care: A Delphi Survey

PubMed Central

Taylor, John; Hall, Deborah A.; Walker, Dawn-Marie; McMurran, Mary; Casey, Amanda; Stockdale, David; Featherstone, Debbie; Hoare, Derek J.

2018-01-01

Objectives: The aim of this study was to determine which components of psychological therapies are most important and appropriate to inform audiologists’ usual care for people with tinnitus. Design: A 39-member panel of patients, audiologists, hearing therapists, and psychologists completed a three-round Delphi survey to reach consensus on essential components of audiologist-delivered psychologically informed care for tinnitus. Results: Consensus (≥80% agreement) was reached on including 76 of 160 components. No components reached consensus for exclusion. The components reaching consensus were predominantly common therapeutic skills such as Socratic questioning and active listening, rather than specific techniques, for example, graded exposure therapy or cognitive restructuring. Consensus on educational components to include largely concerned psychological models of tinnitus rather than neurophysiological information. Conclusions: The results of this Delphi survey provide a tool to develop audiologists’ usual tinnitus care using components that both patients and clinicians agree are important and appropriate to be delivered by an audiologist for adults with tinnitus-related distress. Research is now necessary to test the added effects of these components when delivered by audiologists. PMID:28930785

A True Delphi Approach: Developing a Tailored Curriculum in Response to Local Agriscience Need

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rubenstein, Eric; Thoron, Andrew; Burleson, Sarah

2012-02-07

The Delphi approach is a structured communication technique, developed as a systematic, interactive forecasting method which relies on a panel of experts. In this specific case experts from Industry, Education and Extension fields addressed needs for educational programs in a traditional agriculturally-based community, environmentally conscious practices in order to restore environmental integrity and multi-disciplinary approach to solve sustainability problems facing the agricultural industry. The experts were divided into two main groups, (A) Secondary and (B) Post-secondary, and answered questionnaires in three rounds: • 1st Round – Participants generated a list of knowledge, skills, and competencies followed • 2nd Round –more » Panelists rated each item • 3rd Round – Panelists were given the opportunity to combine and add additional items As a result, top six items from both groups were not found similar, secondary panelists centralized around employment skills and post-secondary panelists focused on content areas. Implications include a need for content-based curriculum for post-secondary graduates, utilization of true-Delphi technique for future curriculum development research and further examination of students that complete secondary and post-secondary programs in biofuels/sustainable agriculture.« less

Multi-criteria decision analysis of breast cancer control in low- and middle- income countries: development of a rating tool for policy makers.

PubMed

Venhorst, Kristie; Zelle, Sten G; Tromp, Noor; Lauer, Jeremy A

2014-01-01

The objective of this study was to develop a rating tool for policy makers to prioritize breast cancer interventions in low- and middle- income countries (LMICs), based on a simple multi-criteria decision analysis (MCDA) approach. The definition and identification of criteria play a key role in MCDA, and our rating tool could be used as part of a broader priority setting exercise in a local setting. This tool may contribute to a more transparent priority-setting process and fairer decision-making in future breast cancer policy development. First, an expert panel (n = 5) discussed key considerations for tool development. A literature review followed to inventory all relevant criteria and construct an initial set of criteria. A Delphi study was then performed and questionnaires used to discuss a final list of criteria with clear definitions and potential scoring scales. For this Delphi study, multiple breast cancer policy and priority-setting experts from different LMICs were selected and invited by the World Health Organization. Fifteen international experts participated in all three Delphi rounds to assess and evaluate each criterion. This study resulted in a preliminary rating tool for assessing breast cancer interventions in LMICs. The tool consists of 10 carefully crafted criteria (effectiveness, quality of the evidence, magnitude of individual health impact, acceptability, cost-effectiveness, technical complexity, affordability, safety, geographical coverage, and accessibility), with clear definitions and potential scoring scales. This study describes the development of a rating tool to assess breast cancer interventions in LMICs. Our tool can offer supporting knowledge for the use or development of rating tools as part of a broader (MCDA based) priority setting exercise in local settings. Further steps for improving the tool are proposed and should lead to its useful adoption in LMICs.

Defining a framework for medical teachers' competencies to teach ethnic and cultural diversity: Results of a European Delphi study.

PubMed

Hordijk, Rowan; Hendrickx, Kristin; Lanting, Katja; MacFarlane, Anne; Muntinga, Maaike; Suurmond, Jeanine

2018-02-28

Medical students need to be trained in delivering diversity-responsive health care but unknown is what competencies teachers need. The aim of this study was to devise a framework of competencies for diversity teaching. An open-ended questionnaire about essential diversity teaching competencies was sent to a panel. This resulted in a list of 74 teaching competencies, which was sent in a second round to the panel for rating. The final framework of competencies was approved by the panel. Thirty-four experts participated. The final framework consisted of 10 competencies that were seen as essential for all medical teachers: (1) ability to critically reflect on own values and beliefs; (2) ability to communicate about individuals in a nondiscriminatory, nonstereotyping way; (3) empathy for patients regardless of ethnicity, race or nationality; (4) awareness of intersectionality; (5) awareness of own ethnic and cultural background; (6) knowledge of ethnic and social determinants of physical and mental health of migrants; (7) ability to reflect with students on the social or cultural context of the patient relevant to the medical encounter; (8) awareness that teachers are role models in the way they talk about patients from different ethnic, cultural and social backgrounds; (9) empathy for students of diverse ethnic, cultural and social background; (10) ability to engage, motivate and let all students participate. This framework of teaching competencies can be used in faculty development programs to adequately train all medical teachers.

Recommendations for the use of ultrasound and magnetic resonance in patients with rheumatoid arthritis.

PubMed

Möller, Ingrid; Loza, Estibaliz; Uson, Jacqueline; Acebes, Carlos; Andreu, Jose Luis; Batlle, Enrique; Bueno, Ángel; Collado, Paz; Fernández-Gallardo, Juan Manuel; González, Carlos; Jiménez Palop, Mercedes; Lisbona, María Pilar; Macarrón, Pilar; Maymó, Joan; Narváez, Jose Antonio; Navarro-Compán, Victoria; Sanz, Jesús; Rosario, M Piedad; Vicente, Esther; Naredo, Esperanza

To develop evidence-based recommendations on the use of ultrasound (US) and magnetic resonance imaging (MRI) in patients with rheumatoid arthritis (RA). Recommendations were generated following a nominal group technique. A panel of experts, consisting of 15 rheumatologists and 3 radiologists, was established in the first panel meeting to define the scope and purpose of the consensus document, as well as chapters, potential recommendations and systematic literature reviews (we used and updated those from previous EULAR documents). A first draft of recommendations and text was generated. Then, an electronic Delphi process (2 rounds) was carried out. Recommendations were voted from 1 (total disagreement) to 10 (total agreement). We defined agreement if at least 70% of experts voted ≥7. The level of evidence and grade or recommendation was assessed using the Oxford Centre for Evidence-based Medicine Levels of Evidence. The full text was circulated and reviewed by the panel. The consensus was coordinated by an expert methodologist. A total of 20 recommendations were proposed. They include the validity of US and MRI regarding inflammation and damage detection, diagnosis, prediction (structural damage progression, flare, treatment response, etc.), monitoring and the use of US guided injections/biopsies. These recommendations will help clinicians use US and MRI in RA patients. Copyright © 2016 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Reaching national consensus on the core clinical skill outcomes for family medicine postgraduate training programmes in South Africa.

PubMed

Akoojee, Yusuf; Mash, Robert

2017-05-26

Family physicians play a significant role in the district health system and need to be equipped with a broad range of clinical skills in order to meet the needs and expectations of the communities they serve. A previous study in 2007 reached national consensus on the clinical skills that should be taught in postgraduate family medicine training prior to the introduction of the new speciality. Since then, family physicians have been trained, employed and have gained experience of working in the district health services. The national Education and Training Committee of the South African Academy of Family Physicians, therefore, requested a review of the national consensus on clinical skills for family medicine training. A Delphi technique was used to reach national consensus in a panel of 17 experts: family physicians responsible for training, experienced family physicians in practice and managers responsible for employing family physicians. Consensus was reached on 242 skills from which the panel decided on 211 core skills, 28 elective skills and 3 skills to be deleted from the previous list. The panel was unable to reach consensus on 11 skills. The findings will guide training programmes on the skills to be addressed and ensure consistency across training programmes nationally. The consensus will also guide formative assessment as documented in the national portfolio of learning and summative assessment in the national exit examination. The consensus will be of interest to other countries in the region where training programmes in family medicine are developing.

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique.

PubMed

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method.

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique

PubMed Central

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method. PMID:25948132

Identification of translational dermatology research priorities in the U.K.: results of an electronic Delphi exercise.

PubMed

Healy, E; Brown, S J; Langan, S M; Nicholls, S G; Shams, K; Reynolds, N J

2015-11-01

Translational research is the direct application of basic and applied research to patient care. It is estimated that there are at least 2000 different skin diseases; thus, there are considerable challenges in seeking to undertake research on each of these disorders. This electronic Delphi (e-Delphi) exercise was conducted in order to generate a list of translational dermatology research questions that are regarded as a priority for further investigations. During the first phase of the e-Delphi exercise, 228 research questions were generated by an expert panel that included clinical academic dermatologists, clinical dermatologists, nonclinical scientists, dermatology trainees and representatives from patient support groups. Following completion of the second and third phases, 40 questions on inflammatory skin disease, 20 questions on structural skin disorders/genodermatoses, 37 questions on skin cancer and eight miscellaneous questions were designated as priority translational dermatology research questions (PRQs). In addition to PRQs on a variety of disease areas (including multiple PRQs on psoriasis, eczema, squamous cell carcinoma and melanoma), there were a number of cross-cutting themes that identified a need to investigate mechanisms/pathogenesis of disease and the necessity to improve treatments for patients with skin disease. It is predicted that this list of PRQs will help to provide a strategic direction for translational dermatology research in the U.K. and that addressing this list of questions will ultimately provide clinical benefit for substantial numbers of patients with skin disorders. © 2015 British Association of Dermatologists.

An Empirical Investigation of Entrepreneurship Intensity in Iranian State Universities

ERIC Educational Resources Information Center

Mazdeh, Mohammad Mahdavi; Razavi, Seyed-Mostafa; Hesamamiri, Roozbeh; Zahedi, Mohammad-Reza; Elahi, Behin

2013-01-01

The purpose of this study is to propose a framework to evaluate the entrepreneurship intensity (EI) of Iranian state universities. In order to determine EI, a hybrid multi-method framework consisting of Delphi, Analytic Network Process (ANP), and VIKOR is proposed. The Delphi method is used to localize and reduce the number of criteria extracted…

The Underutilization of Information and Communication Technology-Assisted Collaborative Project-Based Learning among International Educators: A Delphi Study

ERIC Educational Resources Information Center

Kramer, Barry S.; Walker, Andrew E.; Brill, Jennifer M.

2007-01-01

This study explores the barriers associated with teachers implementing information and communication technology-assisted collaborative project-based learning (ICTCPrjBL) as a classroom teaching methodology with students. We used a Web-based Delphi method to engage experienced educators in anonymous consensus building consisting of three rounds of…

The Future of Clinical Education: Using the Delphi Technique to Study Allied Health Deans' Perspectives on Definitions and Goals.

PubMed

Romig, Barbara D; Tucker, Ann W; Hewitt, Anne M; O'Sullivan Maillet, Julie

2016-01-01

Allied health (AH) clinical education provides future health professionals with the experiences necessary to develop the healthcare competencies required for success in their individual fields. There is limited information and consensus on the purposes of clinical education, including its definition and goals, and its comprehensive role in AH clinical training. This study explored whether consensus could be achieved in the definition, goals, and factors impacting AH clinical education. An expert panel consisting of 61 AH deans (54.9% of the population) whose institutions were 2013 members of the Association of Schools of Allied Health Professions (ASAHP) participated in a three-round Delphi study. From July 2013 to March 2014, the deans expressed opinions about clinical education and its purposes. Responses were collected, summarized, and refined, and responses were accepted and re-rated until agreement was achieved or the study concluded. The hypothesis that AH deans would agree upon the definition and goals of clinical education was supported by this study's findings. Over 90% of deans "strongly agreed" or "agreed" on the definition of clinical education. A majority (90.2% to 92.7%) agreed with the goals. High agreement was achieved on the purposes of clinical education, resulting in a comprehensive definition of and goals for AH clinical education. The definition and goals of clinical education can be added in the healthcare literature and used in support of AH education.

The Mini-OAKHQOL for knee and hip osteoarthritis quality of life was obtained following recent shortening guidelines.

PubMed

Guillemin, Francis; Rat, Anne-Christine; Goetz, Christophe; Spitz, Elisabeth; Pouchot, Jacques; Coste, Joël

2016-01-01

To develop a short form of the knee and hip osteoarthritis quality of life questionnaire, the Mini-OAKHQOL, preserving the conceptual model and, as far as possible, the content and the psychometric properties of the original instrument. A two-step shortening procedure was used: (1) a consensus Delphi method, with a panel of patients and another of professionals independently asked to select items and (2) a nominal group, where patients, professionals, and methodologists reached consensus on the final selection of items, using information from the panels and from modern measurement and classical test theory analyses. The psychometric properties of the Mini-OAKHQOL were assessed in an independent population-based sample of 581 subjects with knee or hip osteoarthritis. The two-step shortening procedure resulted in a 20-item questionnaire. Confirmatory factor analysis showed preservation of the original five-dimensional structure. Rasch analyses showed the unidimensionality and invariance by sex, age, and joint of the main dimensions. Convergent validity, reproducibility, and internal consistency were similar to or better than those of the original OAKHQOL. The 20-item Mini-OAKHQOL has good psychometric properties and can be used for the measurement of quality of life in subjects with osteoarthritis of the lower limbs. Copyright © 2016 Elsevier Inc. All rights reserved.

Identifying the relevant features of the National Digital Cadastral Database (NDCDB) for spatial analysis by using the Delphi Technique

NASA Astrophysics Data System (ADS)

Halim, N. Z. A.; Sulaiman, S. A.; Talib, K.; Ng, E. G.

2018-02-01

This paper explains the process carried out in identifying the relevant features of the National Digital Cadastral Database (NDCDB) for spatial analysis. The research was initially a part of a larger research exercise to identify the significance of NDCDB from the legal, technical, role and land-based analysis perspectives. The research methodology of applying the Delphi technique is substantially discussed in this paper. A heterogeneous panel of 14 experts was created to determine the importance of NDCDB from the technical relevance standpoint. Three statements describing the relevant features of NDCDB for spatial analysis were established after three rounds of consensus building. It highlighted the NDCDB’s characteristics such as its spatial accuracy, functions, and criteria as a facilitating tool for spatial analysis. By recognising the relevant features of NDCDB for spatial analysis in this study, practical application of NDCDB for various analysis and purpose can be widely implemented.

The Anatomical Society core regional anatomy syllabus for undergraduate medicine.

PubMed

Smith, C F; Finn, G M; Stewart, J; Atkinson, M A; Davies, D C; Dyball, R; Morris, J; Ockleford, C; Parkin, I; Standring, S; Whiten, S; Wilton, J; McHanwell, S

2016-01-01

The Anatomical Society's core syllabus for anatomy (2003 and later refined in 2007) set out a series of learning outcomes that an individual medical student should achieve on graduation. The core syllabus, with 182 learning outcomes grouped in body regions, referenced in the General Medical Council's Teaching Tomorrow's Doctors, was open to criticism on the grounds that the learning outcomes were generated by a relatively small group of anatomists, albeit some of whom were clinically qualified. We have therefore used a modified Delphi technique to seek a wider consensus. A Delphi panel was constructed involving 'experts' (n = 39). The revised core syllabus of 156 learning outcomes presented here is applicable to all medical programmes and may be used by curriculum planners, teachers and students alike in addressing the perennial question: 'What do I need to know ?' © 2015 Anatomical Society.

Development and pilot testing of an informed consent video for patients with limb trauma prior to debridement surgery using a modified Delphi technique.

PubMed

Lin, Yen-Ko; Chen, Chao-Wen; Lee, Wei-Che; Lin, Tsung-Ying; Kuo, Liang-Chi; Lin, Chia-Ju; Shi, Leiyu; Tien, Yin-Chun; Cheng, Yuan-Chia

2017-11-29

Ensuring adequate informed consent for surgery in a trauma setting is challenging. We developed and pilot tested an educational video containing information regarding the informed consent process for surgery in trauma patients and a knowledge measure instrument and evaluated whether the audiovisual presentation improved the patients' knowledge regarding their procedure and aftercare and their satisfaction with the informed consent process. A modified Delphi technique in which a panel of experts participated in successive rounds of shared scoring of items to forecast outcomes was applied to reach a consensus among the experts. The resulting consensus was used to develop the video content and questions for measuring the understanding of the informed consent for debridement surgery in limb trauma patients. The expert panel included experienced patients. The participants in this pilot study were enrolled as a convenience sample of adult trauma patients scheduled to receive surgery. The modified Delphi technique comprised three rounds over a 4-month period. The items given higher scores by the experts in several categories were chosen for the subsequent rounds until consensus was reached. The experts reached a consensus on each item after the three-round process. The final knowledge measure comprising 10 questions was developed and validated. Thirty eligible trauma patients presenting to the Emergency Department (ED) were approached and completed the questionnaires in this pilot study. The participants exhibited significantly higher mean knowledge and satisfaction scores after watching the educational video than before watching the video. Our process is promising for developing procedure-specific informed consent and audiovisual aids in medical and surgical specialties. The educational video was developed using a scientific method that integrated the opinions of different stakeholders, particularly patients. This video is a useful tool for improving the knowledge and satisfaction of trauma patients in the ED. The modified Delphi technique is an effective method for collecting experts' opinions and reaching a consensus on the content of educational materials for informed consent. Institutions should prioritize patient-centered health care and develop a structured informed consent process to improve the quality of care. The ClinicalTrials.gov Identifier is NCT01338480 . The date of registration was April 18, 2011 (retrospectively registered).

Cost estimation: An expert-opinion approach. [cost analysis of research projects using the Delphi method (forecasting)

NASA Technical Reports Server (NTRS)

Buffalano, C.; Fogleman, S.; Gielecki, M.

1976-01-01

A methodology is outlined which can be used to estimate the costs of research and development projects. The approach uses the Delphi technique a method developed by the Rand Corporation for systematically eliciting and evaluating group judgments in an objective manner. The use of the Delphi allows for the integration of expert opinion into the cost-estimating process in a consistent and rigorous fashion. This approach can also signal potential cost-problem areas. This result can be a useful tool in planning additional cost analysis or in estimating contingency funds. A Monte Carlo approach is also examined.

Assisting Australians with mental health problems and financial difficulties: a Delphi study to develop guidelines for financial counsellors, financial institution staff, mental health professionals and carers.

PubMed

Bond, Kathy S; Chalmers, Kathryn J; Jorm, Anthony F; Kitchener, Betty A; Reavley, Nicola J

2015-06-03

There is a strong association between mental health problems and financial difficulties. Therefore, people who work with those who have financial difficulties (financial counsellors and financial institution staff) need to have knowledge and helping skills relevant to mental health problems. Conversely, people who support those with mental health problems (mental health professionals and carers) may need to have knowledge and helping skills relevant to financial difficulties. The Delphi expert consensus method was used to develop guidelines for people who work with or support those with mental health problems and financial difficulties. A systematic review of websites, books and journal articles was conducted to develop a questionnaire containing items about the knowledge, skills and actions relevant to working with or supporting someone with mental health problems and financial difficulties. These items were rated over three rounds by five Australian expert panels comprising of financial counsellors (n = 33), financial institution staff (n = 54), mental health professionals (n = 31), consumers (n = 20) and carers (n = 24). A total of 897 items were rated, with 462 items endorsed by at least 80 % of members of each of the expert panels. These endorsed statements were used to develop a set of guidelines for financial counsellors, financial institution staff, mental health professionals and carers about how to assist someone with mental health problems and financial difficulties. A diverse group of expert panel members were able to reach substantial consensus on the knowledge, skills and actions needed to work with and support people with mental health problems and financial difficulties. These guidelines can be used to inform policy and practice in the financial and mental health sectors.

CATALISE: A Multinational and Multidisciplinary Delphi Consensus Study. Identifying Language Impairments in Children.

PubMed

Bishop, D V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2016-01-01

Delayed or impaired language development is a common developmental concern, yet there is little agreement about the criteria used to identify and classify language impairments in children. Children's language difficulties are at the interface between education, medicine and the allied professions, who may all adopt different approaches to conceptualising them. Our goal in this study was to use an online Delphi technique to see whether it was possible to achieve consensus among professionals on appropriate criteria for identifying children who might benefit from specialist services. We recruited a panel of 59 experts representing ten disciplines (including education, psychology, speech-language therapy/pathology, paediatrics and child psychiatry) from English-speaking countries (Australia, Canada, Ireland, New Zealand, United Kingdom and USA). The starting point for round 1 was a set of 46 statements based on articles and commentaries in a special issue of a journal focusing on this topic. Panel members rated each statement for both relevance and validity on a seven-point scale, and added free text comments. These responses were synthesised by the first two authors, who then removed, combined or modified items with a view to improving consensus. The resulting set of statements was returned to the panel for a second evaluation (round 2). Consensus (percentage reporting 'agree' or 'strongly agree') was at least 80 percent for 24 of 27 round 2 statements, though many respondents qualified their response with written comments. These were again synthesised by the first two authors. The resulting consensus statement is reported here, with additional summary of relevant evidence, and a concluding commentary on residual disagreements and gaps in the evidence base.

Management of Helicobacter pylori infection in Latin America: A Delphi technique-based consensus

PubMed Central

Rollan, Antonio; Arab, Juan Pablo; Camargo, M Constanza; Candia, Roberto; Harris, Paul; Ferreccio, Catterina; Rabkin, Charles S; Gana, Juan Cristóbal; Cortés, Pablo; Herrero, Rolando; Durán, Luisa; García, Apolinaria; Toledo, Claudio; Espino, Alberto; Lustig, Nicole; Sarfatis, Alberto; Figueroa, Catalina; Torres, Javier; Riquelme, Arnoldo

2014-01-01

AIM: To optimize diagnosis and treatment guidelines for this geographic region, a panel of gastroenterologists, epidemiologists, and basic scientists carried out a structured evaluation of available literature. METHODS: Relevant questions were distributed among the experts, who generated draft statements for consideration by the entire panel. A modified three-round Delphi technique method was used to reach consensus. Critical input was also obtained from representatives of the concerned medical community. The quality of the evidence and level of recommendation supporting each statement was graded according to United States Preventive Services Task Force criteria. RESULTS: A group of ten experts was established. The survey included 15 open-ended questions that were distributed among the experts, who assessed the articles associated with each question. The levels of agreement achieved by the panel were 50% in the first round, 73.3% in the second round and 100% in the third round. Main consensus recommendations included: (1) when available, urea breath and stool antigen test (HpSA) should be used for non-invasive diagnosis; (2) detect and eradicate Helicobacter pylori (H. pylori) in all gastroscopy patients to decrease risk of peptic ulcer disease, prevent o retard progression in patients with preneoplastic lesions, and to prevent recurrence in patients treated for gastric cancer; (3) further investigate implementation issues and health outcomes of H. pylori eradication for primary prevention of gastric cancer in high-risk populations; (4) prescribe standard 14-d triple therapy or sequential therapy for first-line treatment; (5) routinely assess eradication success post-treatment in clinical settings; and (6) select second- and third-line therapies according to antibiotic susceptibility testing. CONCLUSION: These achievable steps toward better region-specific management can be expected to improve clinical health outcomes. PMID:25152601

The Cardiovascular Health in Ambulatory Care Research Team performance indicators for the primary prevention of cardiovascular disease: a modified Delphi panel study.

PubMed

Tu, Jack V; Maclagan, Laura C; Ko, Dennis T; Atzema, Clare L; Booth, Gillian L; Johnston, Sharon; Tu, Karen; Lee, Douglas S; Bierman, Arlene; Hall, Ruth; Bhatia, R Sacha; Gershon, Andrea S; Tobe, Sheldon W; Sanmartin, Claudia; Liu, Peter; Chu, Anna

2017-04-25

High-quality ambulatory care can reduce cardiovascular disease risk, but important gaps exist in the provision of cardiovascular preventive care. We sought to develop a set of key performance indicators that can be used to measure and improve cardiovascular care in the primary care setting. As part of the Cardiovascular Health in Ambulatory Care Research Team initiative, we established a 14-member multidisciplinary expert panel to develop a set of indicators for measuring primary prevention performance in ambulatory cardiovascular care. We used a 2-stage modified Delphi panel process to rate potential indicators, which were identified from the literature and national cardiovascular organizations. The top-rated indicators were pilot tested to determine their measurement feasibility with the use of data routinely collected in the Canadian health care system. A set of 28 indicators of primary prevention performance were identified, which were grouped into 5 domains: risk factor prevalence, screening, management, intermediate outcomes and long-term outcomes. The indicators reflect the major cardiovascular risk factors including smoking, obesity, hypertension, diabetes, dyslipidemia and atrial fibrillation. All indicators were determined to be amenable to measurement with the use of population-based administrative (physician claims, hospital admission, laboratory, medication), survey or electronic medical record databases. The Cardiovascular Health in Ambulatory Care Research Team indicators of primary prevention performance provide a framework for the measurement of cardiovascular primary prevention efforts in Canada. The indicators may be used by clinicians, researchers and policy-makers interested in measuring and improving the prevention of cardiovascular disease in ambulatory care settings. Copyright 2017, Joule Inc. or its licensors.

Global priorities for research and the relative importance of different research outcomes: an international Delphi survey of malaria research experts.

PubMed

Mulligan, Jo-Ann; Conteh, Lesong

2016-12-06

As global research investment increases, attention inevitably turns to assessing and measuring the outcomes and impact from research programmes. Research can have many different outcomes such as producing advances in scientific knowledge, building research capacity and, ultimately, health and broader societal benefits. The aim of this study was to test the use of a Delphi methodology as a way of gathering views from malaria research experts on research priorities and eliciting relative valuations of the different types of health research impact. An international Delphi survey of 60 malaria research experts was used to understand views on research outcomes and priorities within malaria and across global health more widely. The study demonstrated the application of the Delphi technique to eliciting views on malaria specific research priorities, wider global health research priorities and the values assigned to different types of research impact. In terms of the most important past research successes, the development of new anti-malarial drugs and insecticide-treated bed nets were rated as the most important. When asked about research priorities for future funding, respondents ranked tackling emerging drug and insecticide resistance the highest. With respect to research impact, the panel valued research that focuses on health and health sector benefits and informing policy and product development. Contributions to scientific knowledge, although highly valued, came lower down the ranking, suggesting that efforts to move research discoveries to health products and services are valued more highly than pure advances in scientific knowledge. Although the Delphi technique has been used to elicit views on research questions in global health this was the first time it has been used to assess how a group of research experts value or rank different types of research impact. The results suggest it is feasible to inject the views of a key stakeholder group into the research prioritization process and the Delphi approach is a useful tool for eliciting views on the value or importance of research impact. Future work will explore other methods for assessing and valuing research impact and test the feasibility of developing a composite tool for measuring research outcomes weighted by the values of different stakeholders.

ACR Appropriateness Criteria® Routine Chest Radiography.

PubMed

McComb, Barbara L; Chung, Jonathan H; Crabtree, Traves D; Heitkamp, Darel E; Iannettoni, Mark D; Jokerst, Clinton; Saleh, Anthony G; Shah, Rakesh D; Steiner, Robert M; Mohammed, Tan-Lucien H; Ravenel, James G

2016-03-01

Chest radiographs are sometimes taken before surgeries and interventional procedures on hospital admissions and outpatients. This manuscript summarizes the American College of Radiology review of the literature and recommendations on routinely performed chest radiographies in these settings. The American College of Radiology Appropriateness Criteria are evidence-based guidelines for specific clinical conditions that are reviewed every 3 years by a multidisciplinary expert panel. The guideline development and review include an extensive analysis of current medical literature from peer-reviewed journals and the application of a well-established consensus methodology (modified Delphi) to rate the appropriateness of imaging and treatment procedures by the panel. In those instances in which evidence is lacking or not definitive, expert opinion may be used to recommend imaging or treatment.

The Art of Dressing Selection: A Consensus Statement on Skin Tears and Best Practice.

PubMed

LeBlanc, Kimberly; Baranoski, Sharon; Christensen, Dawn; Langemo, Diane; Edwards, Karen; Holloway, Samantha; Gloeckner, Mary; Williams, Ann; Campbell, Karen; Alam, Tarik; Woo, Kevin Y

2016-01-01

To provide information about product selection for the management of skin tears. This continuing education activity is intended for physicians and nurses with an interest in skin and wound care. After participating in this educational activity, the participant should be better able to:1. Explain skin tear (ST) risk factors and assessment guidelines.2. Identify best practice treatments for STs, including the appropriate dressings for each ST type. To aid healthcare professionals in product selection specific for skin tears, the International Skin Tear Advisory Panel conducted a systematic literature review and 3-phase Delphi consensus with a panel of international reviewers to provide the best available evidence for product selection related to the treatment of skin tears.

Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis Standard Reporting and Evaluation Guidelines: Results of a National Institutes of Health Working Group.

PubMed

Maverakis, Emanual; Wang, Elizabeth A; Shinkai, Kanade; Mahasirimongkol, Surakameth; Margolis, David J; Avigan, Mark; Chung, Wen-Hung; Goldman, Jennifer; La Grenade, Lois; Pirmohamed, Munir; Shear, Neil H; Tassaeeyakul, Wichittra; Hoetzenecker, Wolfram; Klaewsongkram, Jettanong; Rerkpattanapipat, Ticha; Manuyakorn, Wiparat; Yasuda, Sally Usdin; Sharon, Victoria R; Sukhov, Andrea; Micheletti, Robert; Struewing, Jeff; French, Lars E; Cheng, Michelle Y

2017-06-01

Toxic epidermal necrolysis (TEN) and Stevens-Johnson Syndrome (SJS) are rare, acute, life-threatening dermatologic disorders involving the skin and mucous membranes. Research into these conditions is hampered by a lack of standardization of case reporting and data collection. To establish a standardized case report form to facilitate comparisons and maintain data quality based on an international panel of SJS/TEN experts who performed a Delphi consensus-building exercise. The elements presented for committee scrutiny were adapted from previous case report forms and from PubMed literature searches of highly cited manuscripts pertaining to SJS/TEN. The expert opinions and experience of the members of the consensus group were included in the discussion. Overall, 21 out of 29 experts who were invited to participate in the online Delphi exercise agreed to participate. Surveys at each stage were administered via an online survery software tool. For the first 2 Delphi rounds, results were analyzed using the Interpercentile Range Adjusted for Symmetry method and statements that passed consensus formulated a new case report form. For the third Delphi round, the case report form was presented to the committee, who agreed that it was "appropriate and useful" for documenting cases of SJS/TEN, making it more reliable and valuable for future research endeavors. With the consensus of international experts, a case report form for SJS/TEN has been created to help standardize the collection of patient information in future studies and the documentation of individual cases.

Defining the activities of publicness for Korea's public community hospitals using the Delphi method.

PubMed

Lee, Kunsei; Kim, Hyun Joo; You, Myoungsoon; Lee, Jin-Seok; Eun, Sang Jun; Jeong, Hyoseon; Ahn, Hye Mi; Lee, Jin Yong

2017-03-01

This study aims to identify which activities of a public community hospital (PHC) should be included in their definition of publicness and tries to achieve a consensus among experts using the Delphi method. We conduct 2 rounds of the Delphi process with 17 panel members using a developed draft of tentative activities for publicness including 5 main categories covering 27 items. The questions remain the same in both rounds and the applicability of each of the 27 items to publicness is measured on a 9-point scale. If the participants believe government funding is needed, we ask how much they think the government should support each item on a 0% to 100% scale. After conducting 2 rounds of the Delphi process, 22 out of the 27 items reached a consensus as activities defining the publicness of the PHCs. Among the 5 major categories, in category C, activities preventing market failure, all 10 items were considered activities of publicness. Nine of these were evaluated as items that should be compensated at 100% of total financial loss by the Korean government. Throughout results, we were able to define the activities of the PCH that encompassed its publicness and confirm that there are "good deficits" in the context of the PCHs. Thus, some PCH deficits are unavoidable and not wasted as these monies support a necessary role and function in providing public health. The Korean government should therefore consider taking actions such as exempting such "good deficits" or providing additional financial aid to reimburse the PHCs for "good deficits."

Development of a standardized training course for laparoscopic procedures using Delphi methodology.

PubMed

Bethlehem, Martijn S; Kramp, Kelvin H; van Det, Marc J; ten Cate Hoedemaker, Henk O; Veeger, Nicolaas J G M; Pierie, Jean Pierre E N

2014-01-01

Content, evaluation, and certification of laparoscopic skills and procedure training lack uniformity among different hospitals in The Netherlands. Within the process of developing a new regional laparoscopic training curriculum, a uniform and transferrable curriculum was constructed for a series of laparoscopic procedures. The aim of this study was to determine regional expert consensus regarding the key steps for laparoscopic appendectomy and cholecystectomy using Delphi methodology. Lists of suggested key steps for laparoscopic appendectomy and cholecystectomy were created using surgical textbooks, available guidelines, and local practice. A total of 22 experts, working for teaching hospitals throughout the region, were asked to rate the suggested key steps for both procedures on a Likert scale from 1-5. Consensus was reached with Crohnbach's α ≥ 0.90. Of the 22 experts, 21 completed and returned the survey (95%). Data analysis already showed consensus after the first round of Delphi on the key steps for laparoscopic appendectomy (Crohnbach's α = 0.92) and laparoscopic cholecystectomy (Crohnbach's α = 0.90). After the second round, 15 proposed key steps for laparoscopic appendectomy and 30 proposed key steps for laparoscopic cholecystectomy were rated as important (≥4 by at least 80% of the expert panel). These key steps were used for the further development of the training curriculum. By using the Delphi methodology, regional consensus was reached on the key steps for laparoscopic appendectomy and cholecystectomy. These key steps are going to be used for standardized training and evaluation purposes in a new regional laparoscopic curriculum. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

[Prioritization and Consentation of Criteria for the Appraisal, Funding and Evaluation of Projects from the German Innovationsfonds: A multi-perspective Delphi study].

PubMed

Schmitt, J; Petzold, T; Nellessen-Martens, G; Pfaff, H

2015-09-01

The German Innovationsfonds provides the chance for evidence-based developments of the German healthcare system. Prioritization of recommendations for an effective, efficient, fair, transparent, and sustainable granting of funds through a transparent, evidence-driven consensus-process involving all relevant stakeholder groups. Representatives from health and research policy, payers, patient representatives, healthcare providers, and scientists were invited to nominate participants for an electronic 3 round iterative Delphi-study to prioritize the thematic focus, requirements concerning study methods, the team of applicants, evaluation, utilization of study results, and for the selection of reviewers. Criteria considered as relevant by at least 60% of the panel (consensus definition) in the first 2 Delphi rounds were rated as facultative, preferable, or obligatory criteria for project funding. Data were analyzed descriptively. ( Datenbank Versorgungsforschung Deutschland VfD_15_003561). All invited stakeholder groups except payers participated. 34 (85%) of 40 nominated representatives participated in the Delphi-study. A total of 64 criteria were consented as relevant for project review and funding concerning the thematic focus (n=28), methodological requirements (n=13), requirements for applicants (n=4), for the evaluation (n=4), utilization (n=6), and selection of peer reviewers (n=9). It is the collective responsibility of all stakeholders to spend the designated funds as efficient and sustainable as possible. The consented recommendations shall serve decision makers as a resource for the granting of funds and the evaluation of the Innovationsfonds. © Georg Thieme Verlag KG Stuttgart · New York.

Competencies Needed by Korean HRD Master's Graduates: A Comparison between the ASTD WLP Competency Model and the Korean Study

ERIC Educational Resources Information Center

Lee, Yonghak

2009-01-01

The primary purpose of this study was to identify competencies needed by current human resource development (HRD) master's degree graduate students in Korea. The study used a quantitative method, the Delphi technique, in combination with a qualitative method consisting of a series of in-depth interviews. The Delphi technique was conducted using a…

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Experience of Delphi technique in the process of establishing consensus on core competencies.

PubMed

Raghav, Pankaja Ravi; Kumar, Dewesh; Bhardwaj, Pankaj

2016-01-01

The Department of Community Medicine and Family Medicine (CMFM) has been started as a new model for imparting the components of family medicine and delivering health-care services at primary and secondary levels in all six newly established All India Institute of Medical Sciences (AIIMS), but there is no competency-based curriculum for it. The paper aims to share the experience of Delphi method in the process of developing consensus on core competencies of the new model of CMFM in AIIMS for undergraduate medical students in India. The study adopted different approaches and methods, but Delphi was the most critical method used in this research. In Delphi, the experts were contacted by e-mail and their feedback on the same was analyzed. Two rounds of Delphi were conducted in which 150 participants were contacted in Delphi-I but only 46 responded. In Delphi-II, 26 participants responded whose responses were finally considered for analysis. Three of the core competencies namely clinician, primary-care physician, and professionalism were agreed by all the participants, and the least agreement was observed in the competencies of epidemiologist and medical teacher. The experts having more experience were less consistent as responses were changed from agree to disagree in more than 15% of participants and 6% changed from disagree to agree. Within the given constraints, the final list of competencies and skills for the discipline of CMFM compiled after the Delphi process will provide a useful insight into the development of competency-based curriculum of the subject.

Proposal of quality indicators for cardiac rehabilitation after acute coronary syndrome in Japan: a modified Delphi method and practice test.

PubMed

Ohtera, Shosuke; Kanazawa, Natsuko; Ozasa, Neiko; Ueshima, Kenji; Nakayama, Takeo

2017-01-27

Cardiac rehabilitation is underused and its quality in practice is unclear. A quality indicator is a measurable element of clinical practice performance. This study aimed to propose a set of quality indicators for cardiac rehabilitation following an acute coronary event in the Japanese population and conduct a small-size practice test to confirm feasibility and applicability of the indicators in real-world clinical practice. This study used a modified Delphi technique (the RAND/UCLA appropriateness method), a consensus method which involves an evidence review, a face-to-face multidisciplinary panel meeting and repeated anonymous rating. Evidence to be reviewed included clinical practice guidelines available in English or Japanese and existing quality indicators. Performance of each indicator was assessed retrospectively using medical records at a university hospital in Japan. 10 professionals in cardiac rehabilitation for the consensus panel. In the literature review, 23 clinical practice guidelines and 16 existing indicators were identified to generate potential indicators. Through the consensus-building process, a total of 30 indicators were assessed and finally 13 indicators were accepted. The practice test (n=39) revealed that 74% of patients underwent cardiac rehabilitation. Median performance of process measures was 93% (IQR 46-100%). 'Communication with the doctor who referred the patient to cardiac rehabilitation' and 'continuous participation in cardiac rehabilitation' had low performance (32% and 38%, respectively). A modified Delphi technique identified a comprehensive set of quality indicators for cardiac rehabilitation. The single-site, small-size practice test confirmed that most of the proposed indicators were measurable in real-world clinical practice. However, some clinical processes which are not covered by national health insurance in Japan had low performance. Further studies will be needed to clarify and improve the quality of care in cardiac rehabilitation. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Optimizing the pre-referral workup for gastroenterology and hepatology specialty care: consensus using the Delphi method.

PubMed

Ho, Chanda K; Boscardin, Christy K; Gleason, Nathaniel; Collado, Don; Terdiman, Jonathan; Terrault, Norah A; Gonzales, Ralph

2016-02-01

Specialty care referrals have doubled in the last decade. Optimization of the pre-referral workup by a primary care doctor can lead to a more efficient first specialty visit with the patient. Guidance regarding pre-referral laboratory testing is a first step towards improving the specialty referral process. Our aim was to establish consensus regarding appropriate pre-referral workup for common gastrointestinal and liver conditions. The Delphi method was used to establish local consensus for recommending certain laboratory tests prior to specialty referral for 13 clinical conditions. Seven conditions from The University of Michigan outpatient referral guidelines were used as a baseline. An expert panel of three PCPs and nine gastroenterologists from three academic hospitals participated in three iterative rounds of electronic surveys. Each panellist ranked each test using a 5-point Likert scale (strongly disagree to strongly agree). Local panellists could recommend additional tests for the initial diagnoses, and also recommended additional diagnoses needing guidelines: iron deficiency anaemia, abdominal pain, irritable bowel syndrome, fatty liver disease, liver mass and cirrhosis. Consensus was defined as ≥70% of experts scoring ≥4 (agree or strongly agree). Applying Delphi methodology to extrapolate externally developed referral guidelines for local implementation resulted in considerable modifications. For some conditions, many tests from the external group were eliminated by the local group (abdominal bloating; iron deficiency anaemia; irritable bowel syndrome). In contrast, for chronic diarrhoea, abnormal liver enzymes and viral hepatitis, all/most original tests were retained with additional tests added. For liver mass, fatty liver disease and cirrhosis, there was high concordance among the panel with few tests added or eliminated. Consideration of externally developed referral guidelines using a consensus-building process leads to significant local tailoring and adaption. Our next steps include implementation and dissemination of these guidelines and evaluating their impact on care efficiency in clinical practice. © 2015 John Wiley & Sons, Ltd.

Drivers for the effective management of HIV and AIDS in the South African construction industry--a Delphi study.

PubMed

Harinarain, Nishani; Haupt, Theo Conrad

2014-09-01

Different industries manage the threats presented by HIV and AIDS in different ways. The construction industry is particularly vulnerable to the pandemic because of its large unskilled labour force, high labour turnover and the migratory nature of the workforce. The study reported on in this paper, the first of its kind in the South African construction industry, aimed to identify the important drivers needed for the effective management of HIV and AIDS and to understand their impact on the construction industry. The aim was achieved in two stages. The first stage involved an extensive literature review to determine the factors that drive corporate response in the management of HIV and AIDS in the South African construction sector. Six drivers, namely legal requirements, social pressures, business costs, voluntary regulation, visibility of the disease, and individuals within companies with a total of 87 items were identified. An iterative Delphi technique with a panel of experts was used to validate the factors identified in the literature review and formed the second stage of this research. The Delphi method was used as it provided a systematic approach to achieve consensus on the six drivers for effective management of HIV and AIDS management in the construction industry. An expert panel responded to three iterations of questionnaires to achieve consensus. The experts reached consensus on 56 items categorised under the 6 drivers. This study found that the legal driver was considered most important but only second in terms of impact. The second most important driver was the visibility of the disease and was regarded as the driver with the highest impact. Internal agents ranked third in terms of importance and impact. This study can be used for further research to assist the construction industry in helping fight HIV and AIDS.

Clinical strategies for the management of intestinal obstruction and pseudo-obstruction. A Delphi Consensus study of SICUT (Società Italiana di Chirurgia d'Urgenza e del Trauma).

PubMed

Costa, Gianluca; Ruscelli, Paolo; Balducci, Genoveffa; Buccoliero, Francesco; Lorenzon, Laura; Frezza, Barbara; Chirletti, Piero; Stagnitti, Franco; Miniello, Stefano; Stella, Francesco

2016-01-01

Intestinal obstructions/pseudo-obstruction of the small/large bowel are frequent conditions but their management could be challenging. Moreover, a general agreement in this field is currently lacking, thus SICUT Society designed a consensus study aimed to define their optimal workout. The Delphi methodology was used to reach consensus among 47 Italian surgical experts in two study rounds. Consensus was defined as an agreement of 75.0% or greater. Four main topic areas included nosology, diagnosis, management and treatment. A bowel obstruction was defined as an obstacle to the progression of intestinal contents and fluids generally beginning with a sudden onset. The panel identified four major criteria of diagnosis including absence of flatus, presence of >3.5 cm ileal levels or >6 cm colon dilatation and abdominal distension. Panel also recommended a surgical admission, a multidisciplinary approach, and a gastrografin swallow for patients presenting occlusions. Criteria for immediate surgery included: presence of strangulated hernia, a >10 cm cecal dilatation, signs of vascular pedicles obstructions and persistence of metabolic acidosis. Moreover, rules for non-operative management (to be conducted for maximum 72 hours) included a naso-gastric drainage placement and clinical and laboratory controls each 12 hours. Non-operative treatment should be suspended if any suspects of intra-abdominal complications, high level of lactates, leukocytosis (>18.000/mm3 or Neutrophils >85%) or a doubling of creatinine level comparing admission. Conversely, consensus was not reached regarding the exact timing of CT scan and the appropriateness of colonic stenting. This consensus is in line with current international strategies and guidelines, and it could be a useful tool in the safe basic daily management of these common and peculiar diseases. Delphi study, Intestinal obstruction, Large bowel obstruction, Pseudo-obstruction, Small bowel.

Characteristics of a global classification system for perinatal deaths: a Delphi consensus study.

PubMed

Wojcieszek, Aleena M; Reinebrant, Hanna E; Leisher, Susannah Hopkins; Allanson, Emma; Coory, Michael; Erwich, Jan Jaap; Frøen, J Frederik; Gardosi, Jason; Gordijn, Sanne; Gulmezoglu, Metin; Heazell, Alexander E P; Korteweg, Fleurisca J; McClure, Elizabeth; Pattinson, Robert; Silver, Robert M; Smith, Gordon; Teoh, Zheyi; Tunçalp, Özge; Flenady, Vicki

2016-08-15

Despite the global burden of perinatal deaths, there is currently no single, globally-acceptable classification system for perinatal deaths. Instead, multiple, disparate systems are in use world-wide. This inconsistency hinders accurate estimates of causes of death and impedes effective prevention strategies. The World Health Organisation (WHO) is developing a globally-acceptable classification approach for perinatal deaths. To inform this work, we sought to establish a consensus on the important characteristics of such a system. A group of international experts in the classification of perinatal deaths were identified and invited to join an expert panel to develop a list of important characteristics of a quality global classification system for perinatal death. A Delphi consensus methodology was used to reach agreement. Three rounds of consultation were undertaken using a purpose built on-line survey. Round one sought suggested characteristics for subsequent scoring and selection in rounds two and three. The panel of experts agreed on a total of 17 important characteristics for a globally-acceptable perinatal death classification system. Of these, 10 relate to the structural design of the system and 7 relate to the functional aspects and use of the system. This study serves as formative work towards the development of a globally-acceptable approach for the classification of the causes of perinatal deaths. The list of functional and structural characteristics identified should be taken into consideration when designing and developing such a system.

Standards for midwife practitioners of external cephalic version: A Delphi study.

PubMed

Walker, Shawn; Perilakalathil, Prasanth; Moore, Jenny; Gibbs, Claire L; Reavell, Karen; Crozier, Kenda

2015-05-01

expansion of advanced and specialist midwifery practitioner roles across professional boundaries requires an evidence-based framework to evaluate achievement and maintenance of competency. In order to develop the role of Breech Specialist Midwife to include the autonomous performance of external cephalic version within one hospital, guidance was required on standards of training and skill development, particularly in the use of ultrasound. a three-round Delphi survey was used to determine consensus among an expert panel, including highly experienced obstetric and midwife practitioners, as well as sonographers. The first round used mostly open-ended questions to gather data, from which statements were formed and returned to the panel for evaluation in subsequent rounds. standards for achieving and maintaining competence to perform ECV, and in the use of basic third trimester ultrasound as part of this practice, should be the same for midwives and doctors. The maintenance of proficiency requires regular practice. midwives can appropriately expand their sphere of practice to include ECV and basic third trimester ultrasound, according to internal guidelines, following the completion of a competency-based training programme roughly equivalent to those used to guide obstetric training. Ideally, ECV services should be offered in organised clinics where individual practitioners in either profession are able to perform approximately 30 or more ECVs per year in order to maintain an appropriate level of skill. Copyright © 2015 Elsevier Ltd. All rights reserved.

A decision-making framework for total ownership cost management of complex systems: A Delphi study

NASA Astrophysics Data System (ADS)

King, Russel J.

This qualitative study, using a modified Delphi method, was conducted to develop a decision-making framework for the total ownership cost management of complex systems in the aerospace industry. The primary focus of total ownership cost is to look beyond the purchase price when evaluating complex system life cycle alternatives. A thorough literature review and the opinions of a group of qualified experts resulted in a compilation of total ownership cost best practices, cost drivers, key performance factors, applicable assessment methods, practitioner credentials and potential barriers to effective implementation. The expert panel provided responses to the study questions using a 5-point Likert-type scale. Data were analyzed and provided to the panel members for review and discussion with the intent to achieve group consensus. As a result of the study, the experts agreed that a total ownership cost analysis should (a) be as simple as possible using historical data; (b) establish cost targets, metrics, and penalties early in the program; (c) monitor the targets throughout the product lifecycle and revise them as applicable historical data becomes available; and (d) directly link total ownership cost elements with other success factors during program development. The resultant study framework provides the business leader with incentives and methods to develop and implement strategies for controlling and reducing total ownership cost over the entire product life cycle when balancing cost, schedule, and performance decisions.

[Preventable drug-related morbidity: determining valid indicators for primary care in Portugal].

PubMed

Guerreiro, Mara Pereira; Cantrill, Judith A; Martins, Ana Paula

2007-01-01

Preventable drug-related morbidity (PDRM) indicators are operational measures of therapeutic risk management. These clinical indicators, which cover a wide range of drugs, combine process and outcome in the same instrument. They were developed in the US and have been validated for primary care settings in the US, UK and Canada. This study is part of a research programme; it aimed to determine a valid set of PDRM indicators for adult patients in primary care in Portugal. Face validity of 61 US and UK-derived indicators translated to Portuguese was preliminarily determined by means of a postal questionnaire using a purposive sample of four Portuguese pharmacists with different backgrounds. Preliminary content validity of indicators approved in the previous stage was determined by cross-checking each definition of PDRM with standard drug information sources in Portugal. Face and content validity of indicators yielded by preliminary work were then established by a 37 expert panel (20 community pharmacists and 17 general practitioners) using a two-round Delphi survey. Data were analysed using SPSS release 11.5. Nineteen indicators were ruled out in preliminary validation. Changes were made in the content of eight of the remaining 42 indicators; these were related to differences in the drugs being marketed and patterns of drug monitoring between countries. Thirty-five indicators were consensus approved as PDRM for adult patients in Portuguese primary care by the Delphi panel.

Academic food-supply veterinarians: future demand and likely shortages.

PubMed

Bruce Prince, J; Andrus, David M; Gwinner, Kevin

2006-01-01

The future demand for and potential shortages of food-supply veterinarians have been the subject of much concern. Using the Delphi forecasting method in a three-phase Web-based survey process, a panel of experts identified the trends and issues shaping the demand for and supply of academic food-animal veterinarians, then forecasted the likely future demand and shortages of food-supply veterinarians employed in academic institutions in the United States and Canada through 2016. The results indicate that there will be increasing future demand and persistent shortages of academic food-supply veterinarians unless current trends are countered with targeted, strategic action. The Delphi panel also evaluated the effectiveness of several strategies for reversing current trends and increasing the number of food-supply veterinarians entering into academic careers. Academic food-supply veterinarians are a key link in the system that produces food-supply veterinarians for all sectors (private practice, government service, etc.); shortages in the academic sector will amplify shortages wherever food-supply veterinarians are needed. Even fairly small shortages have significant public-health, food-safety, animal-welfare, and bio-security implications. Recent events demonstrate that in an increasingly interconnected global economic food supply system, national economies and public health are at risk unless an adequate supply of appropriately trained food-supply veterinarians is available to counter a wide variety of threats ranging from animal and zoonotic diseases to bioterrorism.

Obstacles to comprehensive dental care in patients with sustained limitations of their decision-making abilities: findings from a Delphi study.

PubMed

Blaizot, Alessandra; Catteau, Céline; Delfosse, Caroline; Hamel, Olivier; Trentesaux, Thomas

2018-06-01

The objective of this study was to explore the therapeutic limitations experienced by a panel of special-care dentists in France when treating patients with sustained limitations of their decision-making abilities. We used a Delphi technique conducted in three rounds from 01 June 2014 to 30 September 2015. A first questionnaire comprising open-ended questions was addressed to 72 panellists. A content analysis of the returned questionnaires served to draft a second questionnaire comprising closed-ended questions; this was sent to the 28 panellists who responded in the first round. A third questionnaire was sent to the 20 panellists who responded in the second round to give them an opportunity to reconsider their response in the context of the second-round response group. Sixteen panellists answered the last round. A large majority agreed on the importance of providing comprehensive care, but they encountered obstacles at two time points: (i) when proposing the care; and (ii) when setting it up. The panel put forward recommendations in two main areas: (i) the training of those involved in oral health decisions; and (ii) dental care management and organization of the care system. The study provided a foundation for building future orientations in health care for patients with limited decision-making abilities. © 2018 Eur J Oral Sci.

Cost and economic burden of adverse events associated with metastatic melanoma treatments in five countries.

PubMed

Vouk, Katja; Benter, Ursula; Amonkar, Mayur M; Marocco, Alessia; Stapelkamp, Ceilidh; Pfersch, Sylvie; Benjamin, Laure

2016-09-01

To estimate per-event cost and economic burden associated with managing the most common and/or severe metastatic melanoma (MM) treatment-related adverse events (AEs) in Australia, France, Germany, Italy, and the UK. AEs associated with chemotherapy (dacarbazine, paclitaxel, fotemustine), immunotherapy (ipilimumab), and targeted therapy (vemurafenib) were identified by literature review. Medical resource use data associated with managing AEs were collected through two blinded Delphi panel cycles in each of the five countries. Published costs were used to estimate per-event costs and combined with AEs incidence, treatment usage, and MM prevalence to estimate the economic burden for each country. The costliest AEs were grade 3/4 events due to immunotherapy (Australia/France: colitis; UK: diarrhea) and chemotherapy (Germany/Italy: neutropenia/leukopenia). Treatment of AEs specific to chemotherapy (Australia/Germany/Italy/France: neutropenia/leukopenia) and targeted therapy (UK: squamous cell carcinoma) contributed heavily to country-specific economic burden. Economic burden was estimated assuming that each patient experienced an AE only once. In addition, the context of settings was heterogeneous and the number of Delphi panel experts was limited. Management costs for MM treatment-associated AEs can be substantial. Results could be incorporated in economic models that support reimbursement dossiers. With the availability of newer treatments, establishment of a baseline measure of the economic burden of AEs will be crucial for assessing their impact on patients and regional healthcare systems.

A consensus exercise identifying priorities for research into clinical effectiveness among children's orthopaedic surgeons in the United Kingdom.

PubMed

Perry, D C; Wright, J G; Cooke, S; Roposch, A; Gaston, M S; Nicolaou, N; Theologis, T

2018-05-01

Aims High-quality clinical research in children's orthopaedic surgery has lagged behind other surgical subspecialties. This study used a consensus-based approach to identify research priorities for clinical trials in children's orthopaedics. Methods A modified Delphi technique was used, which involved an initial scoping survey, a two-round Delphi process and an expert panel formed of members of the British Society of Children's Orthopaedic Surgery. The survey was conducted amongst orthopaedic surgeons treating children in the United Kingdom and Ireland. Results A total of 86 clinicians contributed to both rounds of the Delphi process, scoring priorities from one (low priority) to five (high priority). Elective topics were ranked higher than those relating to trauma, with the top ten elective research questions scoring higher than the top question for trauma. Ten elective, and five trauma research priorities were identified, with the three highest ranked questions relating to the treatment of slipped capital femoral epiphysis (mean score 4.6/ 5), Perthes' disease (4.5) and bone infection (4.5). Conclusion This consensus-based research agenda will guide surgeons, academics and funders to improve the evidence in children's orthopaedic surgery and encourage the development of multicentre clinical trials. Cite this article: Bone Joint J 2018;100-B:680-4.

Construction of Nutrition Literacy Indicators for College Students in Taiwan: A Delphi Consensus Study.

PubMed

Liao, Li-Ling; Lai, I-Ju

2017-10-01

To use the Delphi process to select nutrition literacy (NL) indicators for Taiwan college students. Initial formulation of 8 principal indicators and 77 subindicators, followed by a 2-round Delphi survey and final selection of indicators. A total of 28 nutrition experts selected through snowball sampling; 100% response rate. An expert panel scored and ranked NL themes and indicators for relevance, representativeness, and importance. Quantitative analysis. For principal indicators, the defined cutoff was mean (relevance and representativeness) > 4 and SD < 1. For subindicators, screening criteria were: (1) >20 experts ranked the nutrition theme's importance in the top 50% of the 12 themes; (2) mean (relevance and representativeness) > 4 and SD < 1 and >20 experts ranked the indicator's importance in the top 50% of all indicators within a domain. Consensus was reached on 8 principal indicators and 28 subindicators in 8 themes, including 10 in understand, 8 in analyze, 5 in appraise, and 5 in apply. An initial set of NL indicators was developed for Taiwan college students, serving as a basis to develop Taiwan College's Nutrition Literacy Scale and providing information on nutrition education. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Expert surgical consensus for prenatal counseling using the Delphi method.

PubMed

Berman, Loren; Jackson, Jordan; Miller, Kristen; Kowalski, Rebecca; Kolm, Paul; Luks, Francois I

2017-11-28

Pediatric surgeons frequently offer prenatal consultation for congenital pulmonary airway malformation (CPAM) and congenital diaphragmatic hernia (CDH); however, there is no evidence-based consensus to guide prenatal decision making and counseling for these conditions. Eliciting feedback from experts is integral to defining best practice regarding prenatal counseling and intervention. A Delphi consensus process was undertaken using a panel of pediatric surgeons identified as experts in fetal therapy to address current limitations. Areas of discrepancy in the literature on CPAM and CDH were identified and used to generate a list of content and intervention questions. Experts were invited to participate in an online Delphi survey. Items that did not reach first-round consensus were broken down into additional questions, and consensus was achieved in the second round. Fifty-four surgeons (69%) responded to at least one of the two survey rounds. During round one, consensus was reached on 54 of 89 survey questions (61%), and 45 new questions were developed. During round two, consensus was reached on 53 of 60 survey questions (88%). We determined expert consensus to establish guidelines regarding perinatal management of CPAM and CDH. Our results can help educate pediatric surgeons participating in perinatal care of these patients. V. Copyright © 2017 Elsevier Inc. All rights reserved.

A hospital-based child protection programme evaluation instrument: a modified Delphi study.

PubMed

Wilson, Denise; Koziol-McLain, Jane; Garrett, Nick; Sharma, Pritika

2010-08-01

Refine instrument for auditing hospital-based child abuse and neglect violence intervention programmes prior to field-testing. A modified Delphi study to identify and rate items and domains indicative of an effective and quality child abuse and neglect intervention programme. Experts participated in four Delphi rounds: two surveys, a one-day workshop and the opportunity to comment on the penultimate instrument. New Zealand. Twenty-four experts in the field of care and protection of children. Items with panel agreement >or=85% and mean importance rating >or=4.0 (scale from 1 (not important) to 5 (very important)). There was high-level consensus on items across Rounds 1 and 2 (89% and 85%, respectively). In Round 3 an additional domain (safety and security) was agreed upon and cultural issues, alert systems for children at risk, and collaboration among primary care, community, non-government and government agencies were discussed. The final instrument included nine domains ('policies and procedures', 'safety and security', 'collaboration', 'cultural environment', 'training of providers', 'intervention services', 'documentation' 'evaluation' and 'physical environment') and 64 items. The refined instrument represents the hallmarks of an ideal child abuse and neglect programme given current knowledge and experience. The instrument enables rigorous evaluations of hospital-based child abuse and neglect intervention programmes for quality improvement and benchmarking with other programmes.

Defining and identifying concepts of medication literacy: An international perspective.

PubMed

Pouliot, Annie; Vaillancourt, Régis; Stacey, Danielle; Suter, Philippe

2017-11-08

Multiple concepts to define health literacy in the context of medication use exist, such as medication literacy, pharmacotherapy literacy, pharmacy health literacy; however, no studies have looked at consensus among experts internationally. A Delphi process was used to achieve consensus on the statements about medication literacy. Experts for the Delphi were selected from a review of the literature and suggestions from an international survey conducted with members of the International Pharmaceutical Federation on medication literacy. The preliminary Delphi questionnaire was built using the statements about medication literacy found in the scientific literature. Responses and comments were analyzed using a pre-established method and communicated to the experts after each round of Delphi. Statements with an agreement of at least 80% were accepted and used to develop a definition of medication literacy. The Delphi process started with 21 experts and included 4 rounds. Overall, 30 statements regarding medication literacy were accepted and divided into 4 clusters representing: (1) type of information necessary for optimal and safe use of medication, (2) skills and abilities, (3) format of information, and (4) outcomes. These statements were used to propose 2 different definitions of medication literacy. One of the definitions was preferred by 75% of the expert panel, which provided further comments for improvements. Of the 11 experts who answered the final questionnaire, nine strongly agreed with the refined definition. Medication literacy is the degree to which individuals can obtain, comprehend, communicate, calculate and process patient-specific information about their medications to make informed medication and health decisions in order to safely and effectively use their medications, regardless of the mode by which the content is delivered (e.g. written, oral and visual). Future studies should focus on how this definition can be operationalized to support the role that pharmacists and other healthcare providers. Copyright © 2017 Elsevier Inc. All rights reserved.

2014 Consensus conference on viscoelastic test-based transfusion guidelines for early trauma resuscitation: Report of the panel.

PubMed

Inaba, Kenji; Rizoli, Sandro; Veigas, Precilla V; Callum, Jeannie; Davenport, Ross; Hess, John; Maegele, Marc

2015-06-01

There has been an increased interest in the use of viscoelastic testing to guide blood product replacement during the acute resuscitation of the injured patient. Currently, no uniformly accepted guidelines exist for how this technology should be integrated into clinical care. In September 2014, an international multidisciplinary group of leaders in the field of trauma coagulopathy and resuscitation was assembled for a 2-day consensus conference in Philadelphia, Pennsylvania. This panel included trauma surgeons, hematologists, blood bank specialists, anesthesiologists, and the lay public.Nine questions regarding the impact of viscoelastic testing in the early resuscitation of trauma patients were developed before the conference by panel consensus. Early use was defined as baseline viscoelastic test result thresholds obtained within the first minutes of hospital arrival-when conventional laboratory results are not available. The available data for each question were then reviewed in person using standardized presentations by the expert panel. A consensus summary document was then developed and reviewed by the panel in an open forum. Finally, a two-round Delphi poll was administered to the panel of experts regarding viscoelastic thresholds for triggering the initiation of specific treatments including fibrinogen, platelets, plasma, and prothrombin complex concentrates. This report summarizes the findings and recommendations of this consensus conference.

Identification of retention strategies for neurosurgeons in Iran: Results from expert panels.

PubMed

Rafiei, Sima; Abdollahzadeh, Sina; Hashemi, Fariba; Ranjbar, Mohammad

2017-04-04

Background: The key challenge is how to encourage and retain health professionals in their work location. There is a list of policy options for this purpose but applying an appropriate and effective set of strategies requires a country level research. Our study aimed to identify retention strategies for neurosurgeons and examine both the importance and feasibility of the identified strategies using expert panels' point of view. Methods: First of all, a literature review was conducted to identify retention strategies for physicians. Then to gain consensus on the strategies and determine their importance and feasibility an expert panel was organized and a modified Delphi process was used. Results: A total of 40 strategies were identified by the panel classified in seven categories of income and economic factors, professional/job factors, clinical infrastructure, personal/family factors, living condition and welfare, educational factors and career development, governmental regulations and management policies. Conclusion: Based on the study results, three areas of economic incentives, personal and professional factors got the greatest priority in health professional planning for retention purposes.

Identifying the features of an exercise addiction: A Delphi study

PubMed Central

Macfarlane, Lucy; Owens, Glynn; Cruz, Borja del Pozo

2016-01-01

Objectives There remains limited consensus regarding the definition and conceptual basis of exercise addiction. An understanding of the factors motivating maintenance of addictive exercise behavior is important for appropriately targeting intervention. The aims of this study were twofold: first, to establish consensus on features of an exercise addiction using Delphi methodology and second, to identify whether these features are congruous with a conceptual model of exercise addiction adapted from the Work Craving Model. Methods A three-round Delphi process explored the views of participants regarding the features of an exercise addiction. The participants were selected from sport and exercise relevant domains, including physicians, physiotherapists, coaches, trainers, and athletes. Suggestions meeting consensus were considered with regard to the proposed conceptual model. Results and discussion Sixty-three items reached consensus. There was concordance of opinion that exercising excessively is an addiction, and therefore it was appropriate to consider the suggestions in light of the addiction-based conceptual model. Statements reaching consensus were consistent with all three components of the model: learned (negative perfectionism), behavioral (obsessive–compulsive drive), and hedonic (self-worth compensation and reduction of negative affect and withdrawal). Conclusions Delphi methodology allowed consensus to be reached regarding the features of an exercise addiction, and these features were consistent with our hypothesized conceptual model of exercise addiction. This study is the first to have applied Delphi methodology to the exercise addiction field, and therefore introduces a novel approach to exercise addiction research that can be used as a template to stimulate future examination using this technique. PMID:27554504

Development of quality indicators for transition from pediatric to adult care in sickle cell disease: A modified Delphi survey of adult providers.

PubMed

Sobota, Amy E; Shah, Nishita; Mack, Jennifer W

2017-06-01

Transition from pediatric to adult care is a vulnerable time for young adults with sickle cell disease (SCD); however, improvements in transition are limited by a lack of quality indicators. The purpose of this study was to establish quality indicators for transition in SCD and to determine the optimal timing between the final pediatric visit and the first adult provider visit. We conducted a modified Delphi survey to reach a consensus on which quality indicators are most important for a successful transition. Our expert panel consisted of members of the Sickle Cell Adult Provider Network. In the first round, the participants ranked a list of quality indicators by importance. In the second round, the participants chose their "top 5" quality indicators in terms of importance and also ranked them on feasibility. The response rates for the two rounds were 68 and 96%, respectively. Nine quality indicators were chosen as "top 5" by a majority of respondents, including communication between pediatric and adult providers, timing of first adult visit, patient self-efficacy, quality of life, and trust with their adult provider. Based on the comments from round 1, respondents were also asked for the optimal timing between leaving pediatric care and entering adult care. Most recommended a first adult visit within 2 months of the final pediatric visit. By using these quality indicators chosen by the majority of respondents, we can better develop and evaluate transition programs for young adults with SCD and improve health outcomes for these vulnerable patients. © 2016 Wiley Periodicals, Inc.

Executive competencies in healthcare administration: preceptors of the Army-Baylor University Graduate Program.

PubMed

Finstuen, Kenn; Mangelsdorff, A David

2006-01-01

The purpose of this research was to identify the mentoring and executive competencies required among preceptors of the Army-Baylor University Graduate Program in Health and Business Administration, and to specify the requisite skills, knowledge, and abilities (SKAs) needed to achieve those competencies. In the first wave of inquiry, a list of 123 competencies and associated SKAs was elicited from a network of 80 current and past preceptor executives employing a Delphi methodology using e-mail. An expert panel, which consisted of seven past program directors, examined and sorted the list into four preceptor content domains, viz., Health Systems Management (HS Management), Leadership, Residency Administration, and Community Involvement. Frequency analyses showed that the HS Management domain constituted over half of the competencies, with particular emphasis on strategic thinking, planning, billing, finance, manpower, and contracting. In the second wave, the preceptor Delphi network reviewed the expertpanel list and made 7-pointSKA importance ratings on an 80-item structured questionnaire representative of the four domains. Findings indicated thataverage SKA ratings were reliable and agreed upon to a high degree among preceptors. Results, rank ordered by SKA item means within preceptor content domains and overall, suggested that the most important rated items centered on teamwork, negotiation, interpersonal skills, communication, leadership vision, and customer and healthcare business operations. Outcomes from the competency list are expected to be useful for preceptor mentoring, self-assessment, and for professional development. Additionally, specific SKAs can provide a means for developing job requirements and career performance criteria at a behavioral task level, and can contribute information for identifying continuing education and conference topical needs.

Controversy between anesthesiologists and obstetricians on the labour ward: the Delphi method is used as a consensus-building technique.

PubMed

Nguyen-Lu, Nhathien; Downey, Kristi; Carvalho, Jose C A

2015-03-01

Obstetricians and anesthesiologists may interpret medical evidence differently, which could potentially generate conflict and compromise patient care. We sought to identify the most important controversial topics involving obstetricians and anesthesiologists on the labour ward that had the potential to affect patient outcome. We conducted a consensus-building study based on the Delphi technique. A panel of experts comprised of obstetric anesthesiologists and obstetricians responded to a series of four parallel sequential questionnaires interspersed with feedback. The first round consisted of an open questionnaire: Which topics in patient management would rouse a difference of opinion between anesthesiologists and obstetricians that may interfere with patient outcome, and why? The second round sought agreement on the topics, and the third round sought to rank the topics, and their underlying reasons, that scored at least 60% agreement. The final round allowed each discipline insight into the controversies gathered by the other discipline. Ten anesthesiologists and ten obstetricians participated in the study. Anesthesiologists identified twice as many controversial topics as the obstetricians (six vs three, respectively). The obstetricians agreed with all topics identified by the anesthesiologists, but agreed with only five of the 18 (28%) reasons to support them. Anesthesiologists agreed with all topics raised by the obstetricians, but agreed with only three of the six (50%) reasons to support them. Both the obstetricians and the anesthesiologists identified several controversial topics that may influence clinical practice on the labour ward. This information could serve as the basis to develop educational programs and strategies to improve communication between the two disciplines.

Development and validation of the Geriatric In-hospital Nursing Care Questionnaire.

PubMed

Persoon, Anke; Bakker, Franka C; van der Wal-Huisman, Hanneke; Olde Rikkert, Marcel G M

2015-02-01

To develop a questionnaire, the Geriatric In-hospital Nursing Care Questionnaire (GerINCQ), to measure, in an integrated way, the care that older adults receive in the hospital and nurses' attitudes toward and perceptions about caring for older adults. Questionnaire development. Twelve university and teaching hospitals. Thirteen experienced geriatric nurses and three geriatricians from 12 hospitals evaluated an initial version of the questionnaire. Two hundred seventy-one nurses, primarily registered nurses from 11 geriatric, medical, and surgical departments in six hospitals, validated the final questionnaire. Items from two published instruments were extracted for use in the questionnaire. Content validity was confirmed using the Delphi technique with an expert panel. Internal consistency was measured by calculating Cronbach alpha; intrarater reliability was measured using test-retest correlations and intraclass correlation coefficients (ICCs); differences between hospital departments were analyzed using analysis of variance. Sensitivity to detect before-and-after changes with implementation of a geriatric care program was determined using the Student t-test. Consensus was reached after three Delphi rounds. The GerINCQ is a self-administered questionnaire to be filled out by hospital nurses that comprises five subscales with 67 items. It has good content validity (each item content validity index >0.9) and good internal consistency (Cronbach alpha = 0.86). Intrarater reliability revealed high test-retest results (ICC = 0.87). The questionnaire detected significant differences between nurses in three types of hospital departments (medical, surgical, and geriatric (P < .01). The GerINCQ was sensitive to changes after an educational program (P < .02) and had a large effect size (0.5). The GerINCQ is a reliable and valid tool and is sensitive to change over time. It is clinically relevant because it provides a quantitative measure of hospital nurses' geriatric practices, attitudes, and perceptions. Moreover, the GerINCQ is suitable for monitoring progress after implementation of geriatric improvement programs. © 2015, Copyright the Authors Journal compilation © 2015, The American Geriatrics Society.

Development of consensus guidance to facilitate service redesign around pharmacist prescribing in UK hospital practice.

PubMed

Tonna, Antonella; McCaig, Dorothy; Diack, Lesley; West, Bernice; Stewart, Derek

2014-10-01

The last decade has seen a drive towards non-medical prescribing in the United Kingdom (UK). However, there is a dearth of any published literature on applying the principles of service redesign to support pharmacist prescribing in any sphere of practice. To develop consensus guidance to facilitate service redesign around pharmacist prescribing. UK hospital practice. The Delphi technique was used to measure consensus of a panel of expert opinion holders in Scotland. Individuals with key strategic and operational roles in implementing initiatives of pharmacy practice and medicines management were recruited as experts. An electronic questionnaire consisting of 30 statements related to pharmacist prescribing service redesign was developed. These were presented as five-point Likert scales with illustrative quotes. Consensus, defined as 70 % of panel members agreeing (ranked strongly agree/agree) with each statement. Responses were obtained from 35/40 (87.5 %) experts in round one and 29 (72.5 %) in round two. Consensus in round one was achieved for 27/30 of statements relating to aspects of generic 'service development' (e.g. succession planning, multidisciplinary working, quality evaluation, practice development and outcome measures) and 'pharmacist prescribing role development' (e.g. education and future orientation of service). Issues of disagreement were around targeting of pharmacist prescribing to clinical specialities and financial remuneration for prescribing in the hospital setting. Consensus guidance has been developed to facilitate service redesign around hospital pharmacist prescribing.

Developing a guideline for clinical trial protocol content: Delphi consensus survey

PubMed Central

2012-01-01

Background Recent evidence has highlighted deficiencies in clinical trial protocols, having implications for many groups. Existing guidelines for randomized clinical trial (RCT) protocol content vary substantially and most do not describe systematic methodology for their development. As one of three prespecified steps for the systematic development of a guideline for trial protocol content, the objective of this study was to conduct a three-round Delphi consensus survey to develop and refine minimum content for RCT protocols. Methods Panellists were identified using a multistep iterative approach, met prespecified minimum criteria and represented key stakeholders who develop or use clinical trial protocols. They were asked to rate concepts for importance in a minimum set of items for RCT protocols. The main outcome measures were degree of importance (scale of 1 to 10; higher scores indicating higher importance) and level of consensus for items. Results were presented as medians, interquartile ranges, counts and percentages. Results Ninety-six expert panellists participated in the Delphi consensus survey including trial investigators, methodologists, research ethics board members, funders, industry, regulators and journal editors. Response rates were between 88 and 93% per round. Overall, panellists rated 63 of 88 concepts of high importance (of which 50 had a 25th percentile rating of 8 or greater), 13 of moderate importance (median 6 or 7) and 12 of low importance (median less than or equal to 5) for minimum trial protocol content. General and item-specific comments and subgroup results provided valuable insight for further discussions. Conclusions This Delphi process achieved consensus from a large panel of experts from diverse stakeholder groups on essential content for RCT protocols. It also highlights areas of divergence. These results, complemented by other empirical research and consensus meetings, are helping guide the development of a guideline for protocol content. PMID:23006145

The scientifically substantiated art of teaching: A study in the development of standards in the new academic field of neuroeducation (mind, brain, and education science)

NASA Astrophysics Data System (ADS)

Tokuhama-Espinosa, Tracey Noel

Concepts from neuroeducation, commonly referred in the popular press as "brain-based learning," have been applied indiscreetly and inconsistently to classroom teaching practices for many years. While standards exist in neurology, psychology and pedagogy, there are no agreed upon standards in their intersection, neuroeducation, and a formal bridge linking the fields is missing. This study used grounded theory development to determine the parameters of the emerging neuroeducational field based on a meta-analysis of the literature over the past 30 years, which included over 2,200 documents. This research results in a new model for neuroeducation. The design of the new model was followed by a Delphi survey of 20 international experts from six different countries that further refined the model contents over several months of reflection. Finally, the revised model was compared to existing information sources, including popular press, peer review journals, academic publications, teacher training textbooks and the Internet, to determine to what extent standards in neuroeducation are met in the current literature. This study determined that standards in the emerging field, now labeled Mind, Brain, and Education: The Science of Teaching and Learning after the Delphi rounds, are the union of standards in the parent fields of neuroscience, psychology, and education. Additionally, the Delphi expert panel agreed upon the goals of the new discipline, its history, the thought leaders, and a model for judging quality information. The study culminated in a new model of the academic discipline of Mind, Brain, and Education science, which explains the tenets, principles and instructional guidelines supported by the meta-analysis of the literature and the Delphi response.

Determination of Problematic ICD-9-CM Subcategories for Further Study of Coding Performance: Delphi Method

PubMed Central

Zeng, Xiaoming; Bell, Paul D

2011-01-01

In this study, we report on a qualitative method known as the Delphi method, used in the first part of a research study for improving the accuracy and reliability of ICD-9-CM coding. A panel of independent coding experts interacted methodically to determine that the three criteria to identify a problematic ICD-9-CM subcategory for further study were cost, volume, and level of coding confusion caused. The Medicare Provider Analysis and Review (MEDPAR) 2007 fiscal year data set as well as suggestions from the experts were used to identify coding subcategories based on cost and volume data. Next, the panelists performed two rounds of independent ranking before identifying Excisional Debridement as the subcategory that causes the most confusion among coders. As a result, they recommended it for further study aimed at improving coding accuracy and variation. This framework can be adopted at different levels for similar studies in need of a schema for determining problematic subcategories of code sets. PMID:21796264

Development of a clinical feeding assessment scale for very young infants in South Africa

PubMed Central

2016-01-01

Background There is a need for validated neonatal feeding assessment instruments in South Africa. A locally developed instrument may contribute to standardised evaluation procedures of high-risk neonates and address needs in resource constrained developing settings. Objective The aim of the study was to develop and validate the content of a clinical feeding assessment scale to diagnose oropharyngeal dysphagia (OPD) in neonates. Method The Neonatal Feeding Assessment Scale (NFAS) was developed using the Delphi method. Five international and South African speech-language therapists (SLTs) formed the expert panel, participating in two rounds of electronic questionnaires to develop and validate the content of the NFAS. Results All participants agreed on the need for the development of a valid clinical feeding assessment instrument to use with the neonatal population. The initial NFAS consisted of 240 items across 8 sections, and after the Delphi process was implemented, the final format was reduced to 211 items across 6 sections. The final format of the NFAS is scored using a binary scoring system guiding the clinician to diagnose the presence or absence of OPD. All members agreed on the format, the scoring system and the feeding constructs addressed in the revised final format of the NFAS. Conclusion The Delphi method and the diverse clinical and research experience of participants could be integrated to develop the NFAS which may be used in clinical practice in South Africa or similar developing contexts. Because of demographically different work settings marked by developed versus developing contexts, participants did not have the same expectations of a clinical dysphagia assessment. The international participants contributed to evidence-based content development. Local participants considered the contextual challenges of South African SLTs entering the field with basic competencies in neonatal dysphagia management, thereby justifying a comprehensive clinical instrument. The NFAS is aimed at clinicians working in Neonatal Intensive Care Units where they manage large caseloads of high-risk neonates. Further validation of the NFAS is recommended to determine its criterion validity in comparison with a widely accepted standard such as the modified barium swallow study. PMID:27796101

Development of a portfolio of learning for postgraduate family medicine training in South Africa: a Delphi study

PubMed Central

2012-01-01

Background Within the 52 health districts in South Africa, the family physician is seen as the clinical leader within a multi-professional district health team. Family physicians must be competent to meet 90% of the health needs of the communities in their districts. The eight university departments of Family Medicine have identified five unit standards, broken down into 85 training outcomes, for postgraduate training. The family medicine registrar must prove at the end of training that all the required training outcomes have been attained. District health managers must be assured that the family physician is competent to deliver the expected service. The Colleges of Medicine of South Africa (CMSA) require a portfolio to be submitted as part of the uniform assessment of all registrars applying to write the national fellowship examinations. This study aimed to achieve a consensus on the contents and principles of the first national portfolio for use in family medicine training in South Africa. Methods A workshop held at the WONCA Africa Regional Conference in 2009 explored the purpose and broad contents of the portfolio. The 85 training outcomes, ideas from the WONCA workshop, the literature, and existing portfolios in the various universities were used to develop a questionnaire that was tested for content validity by a panel of 31 experts in family medicine in South Africa, via the Delphi technique in four rounds. Eighty five content items (national learning outcomes) and 27 principles were tested. Consensus was defined as 70% agreement. For those items that the panel thought should be included, they were also asked how to provide evidence for the specific item in the portfolio, and how to assess that evidence. Results Consensus was reached on 61 of the 85 national learning outcomes. The panel recommended that 50 be assessed by the portfolio and 11 should not be. No consensus could be reached on the remaining 24 outcomes and these were also omitted from the portfolio. The panel recommended that various types of evidence be included in the portfolio. The panel supported 26 of the 27 principles, but could not reach consensus on whether the portfolio should reflect on the relationship between the supervisor and registrar. Conclusion A portfolio was developed and distributed to the eight departments of Family Medicine in South Africa, and the CMSA, to be further tested in implementation. PMID:22385468

Development of a portfolio of learning for postgraduate family medicine training in South Africa: a Delphi study.

PubMed

Jenkins, Louis; Mash, Bob; Derese, Anselme

2012-03-03

Within the 52 health districts in South Africa, the family physician is seen as the clinical leader within a multi-professional district health team. Family physicians must be competent to meet 90% of the health needs of the communities in their districts. The eight university departments of Family Medicine have identified five unit standards, broken down into 85 training outcomes, for postgraduate training. The family medicine registrar must prove at the end of training that all the required training outcomes have been attained. District health managers must be assured that the family physician is competent to deliver the expected service. The Colleges of Medicine of South Africa (CMSA) require a portfolio to be submitted as part of the uniform assessment of all registrars applying to write the national fellowship examinations. This study aimed to achieve a consensus on the contents and principles of the first national portfolio for use in family medicine training in South Africa. A workshop held at the WONCA Africa Regional Conference in 2009 explored the purpose and broad contents of the portfolio. The 85 training outcomes, ideas from the WONCA workshop, the literature, and existing portfolios in the various universities were used to develop a questionnaire that was tested for content validity by a panel of 31 experts in family medicine in South Africa, via the Delphi technique in four rounds. Eighty five content items (national learning outcomes) and 27 principles were tested. Consensus was defined as 70% agreement. For those items that the panel thought should be included, they were also asked how to provide evidence for the specific item in the portfolio, and how to assess that evidence. Consensus was reached on 61 of the 85 national learning outcomes. The panel recommended that 50 be assessed by the portfolio and 11 should not be. No consensus could be reached on the remaining 24 outcomes and these were also omitted from the portfolio. The panel recommended that various types of evidence be included in the portfolio. The panel supported 26 of the 27 principles, but could not reach consensus on whether the portfolio should reflect on the relationship between the supervisor and registrar. A portfolio was developed and distributed to the eight departments of Family Medicine in South Africa, and the CMSA, to be further tested in implementation.

Frontline over ivory tower: key competencies in community-based curricula.

PubMed

Millar, Adam; Malcolm, Janine; Cheng, Alice; Fine, Rebecca; Wong, Rene

2015-01-01

The Royal College of Physicians and Surgeons of Canada mandates that community experiences be incorporated into medicine-based specialties. Presently there is wide variability in community endocrine experiences across Canadian training programs. This is complicated by the paucity of literature providing guidance on what constitutes a 'community' rotation. A modified Delphi technique was used to determine the CanMEDS competencies best taught in a community endocrinology curriculum. The Delphi technique is a qualitative-research method that uses a series of questionnaires sent to a group of experts with controlled feedback provided by the researchers after each survey round. The experts in this study included endocrinology program directors, community endocrinologists, endocrinology residents and recent endocrinology graduates. Thirty four out of 44 competencies rated by the panel were deemed suitable for a community curriculum. The experts considered the "Manager" role best taught in the community, while they considered the community least suitable to learn the "Medical Expert" competency. To our knowledge, this is the first time the content of a community-based subspecialty curriculum was determined using the Delphi process in Canada. These findings suggest that community settings have potential to fill in gaps in residency training in regards to the CanMEDS Manager role. The results will aid program directors in designing competency-based community endocrinology rotations and competency-based community rotations in other medical subspecialty programs.

Defining Malaysian Knowledge Society: Results from the Delphi Technique

NASA Astrophysics Data System (ADS)

Hamid, Norsiah Abdul; Zaman, Halimah Badioze

This paper outlines the findings of research where the central idea is to define the term Knowledge Society (KS) in Malaysian context. The research focuses on three important dimensions, namely knowledge, ICT and human capital. This study adopts a modified Delphi technique to seek the important dimensions that can contribute to the development of Malaysian's KS. The Delphi technique involved ten experts in a five-round iterative and controlled feedback procedure to obtain consensus on the important dimensions and to verify the proposed definition of KS. The finding shows that all three dimensions proposed initially scored high and moderate consensus. Round One (R1) proposed an initial definition of KS and required comments and inputs from the panel. These inputs were then used to develop items for a R2 questionnaire. In R2, 56 out of 73 items scored high consensus and in R3, 63 out of 90 items scored high. R4 was conducted to re-rate the new items, in which 8 out of 17 items scored high. Other items scored moderate consensus and no item scored low or no consensus in all rounds. The final round (R5) was employed to verify the final definition of KS. Findings and discovery of this study are significant to the definition of KS and the development of a framework in the Malaysian context.

Development of quality indicators to evaluate antibiotic treatment of patients with community-acquired pneumonia in Indonesia.

PubMed

Farida, Helmia; Rondags, Angelique; Gasem, M Hussein; Leong, Katharina; Adityana, A; van den Broek, Peterhans J; Keuter, Monique; Natsch, Stephanie

2015-04-01

To develop an instrument for evaluating the quality of antibiotic management of patients with community-acquired pneumonia (CAP) applicable in a middle-income developing country. A previous study and Indonesian guidelines were reviewed to derive potential quality of care indicators (QIs). An expert panel performed a two-round Delphi consensus procedure on the QI's relevance to patient recovery, reduction of antimicrobial resistance and cost containment. Applicability in practice, including reliability, feasibility and opportunity for improvement, was determined in a data set of 128 patients hospitalised with CAP in Semarang, Indonesia. Fifteen QIs were selected by the consensus procedure. Five QIs did not pass feasibility criteria, because of inappropriate documentation, inefficient laboratory services or patient factors. Three QIs provided minor opportunity for improvement. Two QIs contradicted each other; one of these was considered not valid and excluded. A final set of six QIs was defined for use in the Indonesian setting. Using the Delphi method, we defined a list of QIs for assessing the quality of care, in particular antibiotic treatment, for CAP in Indonesia. For further improvement, a modified Delphi method that includes discussion, a sound medical documentation system, improvement of microbiology laboratory services, and multi-center applicability tests are needed to develop a valid and applicable QI list for the Indonesian setting. © 2014 John Wiley & Sons Ltd.

Building expert agreement on the importance and feasibility of workplace health promotion interventions for nurses and midwives: A modified Delphi consultation.

PubMed

Perry, Lin; Nicholls, Rachel; Duffield, Christine; Gallagher, Robyn

2017-11-01

To use a Delphi panel to determine the relative importance and feasibility of workplace health promotion interventions to promote and support the health of the Australian nursing and midwifery workforce. The nursing workforce experiences rates of ill health above that of other workforces, yet there is little investment in workplace health promotion. The study used a modified Delphi design conducted between September and November 2015. Eleven of 19 purposively selected expert panellists discussed, rated and provided feedback through two rounds of an electronic questionnaire about the relative importance and feasibility of 46 workplace health promotion interventions and processes for nurses and midwives. Scores for importance and feasibility were calculated and ranked and a composite score of importance multiplied by feasibility. Mental health strategies were prioritized as the most important and feasible of the intervention topics, followed closely by healthy eating and physical activity interventions; smoking cessation ranked lowest. The most highly ranked interventions targeted healthy eating, stress management and resilience training. Highest ranked processes to support development of a healthy work environment included intersectoral collaboration and employee wellness groups. Study findings prompt consideration of health promotion opportunities to support nurses' health and well-being. Findings identified key workplace health promotion priorities and provide direction for policy makers and managers to promote nursing and midwifery workforce health. © 2017 John Wiley & Sons Ltd.

FOTROCAN Delphi consensus statement regarding the prevention and treatment of cancer-associated thrombosis in areas of uncertainty and low quality of evidence.

PubMed

Jimenez-Fonseca, P; Carmona-Bayonas, A; Calderon, C; Fontcuberta Boj, J; Font, C; Lecumberri, R; Monreal, M; Muñoz Martín, A J; Otero, R; Rubio, A; Ruiz-Artacho, P; Suarez Fernández, C; Colome, E; Pérez Segura, P

2017-08-01

Decision-making in cancer-related venous thromboembolism (VTE) is often founded on scant lines of evidence and weak recommendations. The aim of this work is to evaluate the percentage of agreement surrounding a series of statements about complex, clinically relevant, and highly uncertain aspects to formulate explicit action guidelines. Opinions were based on a structured questionnaire with appropriate scores and were agreed upon using a Delphi method. Questions were selected based on a list of recommendations with low evidence from the Spanish Society of Oncology Clinical Guideline for Thrombosis. The questionnaire was completed in two iterations by a multidisciplinary panel of experts in thrombosis. Of the 123 statements analyzed, the panel concurred on 22 (17%) and another 81 (65%) were agreed on by qualified majority, including important aspects of long-term and prolonged anticoagulation, major bleeding and rethrombosis management, treatment in special situations, catheter-related thrombosis and thromboprophylaxis. Among them, the panelists agreed the incidental events should be equated to symptomatic ones, long-term and extended use of full-dose low-molecular weight heparin, and concluded that the Khorana score is not sensitive enough to uphold an effective thromboprophylaxis strategy. Though the level of consensus varied depending on the scenario presented, overall, the iterative process achieved broad agreement as to the general treatment principles of cancer-associated VTE. Clinical validation of these statements in genuine practice conditions would be useful.

A comparison of three methods for estimating the requirements for medical specialists: the case of otolaryngologists.

PubMed Central

Anderson, G F; Han, K C; Miller, R H; Johns, M E

1997-01-01

OBJECTIVE: To compare three methods of computing the national requirements for otolaryngologists in 1994 and 2010. DATA SOURCES: Three large HMOs, a Delphi panel, the Bureau of Health Professions (BHPr), and published sources. STUDY DESIGN: Three established methods of computing requirements for otolaryngologists were compared: managed care, demand-utilization, and adjusted needs assessment. Under the managed care model, a published method based on reviewing staffing patterns in HMOs was modified to estimate the number of otolaryngologists. We obtained from BHPr estimates of work force projections from their demand model. To estimate the adjusted needs model, we convened a Delphi panel of otolaryngologists using the methodology developed by the Graduate Medical Education National Advisory Committee (GMENAC). DATA COLLECTION/EXTRACTION METHODS: Not applicable. PRINCIPAL FINDINGS: Wide variation in the estimated number of otolaryngologists required occurred across the three methods. Within each model it was possible to alter the requirements for otolaryngologists significantly by changing one or more of the key assumptions. The managed care model has a potential to obtain the most reliable estimates because it reflects actual staffing patterns in institutions that are attempting to use physicians efficiently. CONCLUSIONS: Estimates of work force requirements can vary considerably if one or more assumptions are changed. In order for the managed care approach to be useful for actual decision making concerning the appropriate number of otolaryngologists required, additional research on the methodology used to extrapolate the results to the general population is necessary. PMID:9180613

Key interventions and quality indicators for quality improvement of STEMI care: a RAND Delphi survey.

PubMed

Aeyels, Daan; Sinnaeve, Peter R; Claeys, Marc J; Gevaert, Sofie; Schoors, Danny; Sermeus, Walter; Panella, Massimiliano; Coeckelberghs, Ellen; Bruyneel, Luk; Vanhaecht, Kris

2017-12-13

Identification, selection and validation of key interventions and quality indicators for improvement of in hospital quality of care for ST-elevated myocardial infarction (STEMI) patients. A structured literature review was followed by a RAND Delphi Survey. A purposively selected multidisciplinary expert panel of cardiologists, nurse managers and quality managers selected and validated key interventions and quality indicators prior for quality improvement for STEMI. First, 34 experts (76% response rate) individually assessed the appropriateness of items to quality improvement on a nine point Likert scale. Twenty-seven key interventions, 16 quality indicators at patient level and 27 quality indicators at STEMI care programme level were selected. Eighteen additional items were suggested. Experts received personal feedback, benchmarking their score with group results (response rate, mean, median and content validity index). Consequently, 32 experts (71% response rate) openly discussed items with an item-content validity index above 75%. By consensus, the expert panel validated a final set of 25 key interventions, 13 quality indicators at patient level and 20 quality indicators at care programme level prior for improvement of in hospital care for STEMI. A structured literature review and multidisciplinary expertise was combined to validate a set of key interventions and quality indicators prior for improvement of care for STEMI. The results allow researchers and hospital staff to evaluate and support quality improvement interventions in a large cohort within the context of a health care system.

Development of guidelines to assist organisations to support employees returning to work after an episode of anxiety, depression or a related disorder: a Delphi consensus study with Australian professionals and consumers

PubMed Central

2012-01-01

Background Mental disorders are a significant cause of disability and loss of workplace productivity. The scientific evidence for how organisations should best support those returning to work after common mental disorders is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods A systematic review of websites, books and journal articles was conducted to develop a 387 item survey containing strategies that organisations might use to support those returning to work after common mental disorders. Three panels of Australian experts (66 health professionals, 30 employers and 80 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results The participation rate across all three rounds was 60.2% (57.6% health professionals, 76.7% employers, 56.3% consumers). 308 strategies were endorsed as essential or important by at least 80% of all three panels. The endorsed strategies provided information on policy and procedures, the roles of supervisors, employees and colleagues in managing absence and return to work, and provision of mental health information and training. Conclusions The guidelines outline strategies for organisations supporting those returning to work after common mental disorders. It is hoped that they may be used to inform policy and practice in a variety of workplaces. PMID:22943604

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

Development and initial validation of a content taxonomy for patient records in general dentistry

PubMed Central

Acharya, Amit; Hernandez, Pedro; Thyvalikakath, Thankam; Ye, Harold; Song, Mei; Schleyer, Titus

2013-01-01

Objective Develop and validate an initial content taxonomy for patient records in general dentistry. Methods Phase 1–Obtain 95 de-identified patient records from 11 general dentists in the United States. Phase 2–Extract individual data fields (information items), both explicit (labeled) and implicit (unlabeled), from records, and organize into categories mirroring original field context. Phase 3–Refine raw list of information items by eliminating duplicates/redundancies and focusing on general dentistry. Phase 4–Validate all items regarding inclusion and importance using a two-round Delphi study with a panel of 22 general dentists active in clinical practice, education, and research. Results Analysis of 76 patient records from 9 dentists, combined with previous work, yielded a raw list of 1,509 information items. Refinement reduced this list to 1,107 items, subsequently rated by the Delphi panel. The final model contained 870 items, with 761 (88%) rated as mandatory. In Round 1, 95% (825) of the final items were accepted, in Round 2 the remaining 5% (45). Only 45 items on the initial list were rejected and 192 (or 17%) remained equivocal. Conclusion Grounded in the reality of clinical practice, our proposed content taxonomy represents a significant advance over existing guidelines and standards by providing a granular and comprehensive information representation for general dental patient records. It offers a significant foundational asset for implementing an interoperable health information technology infrastructure for general dentistry. PMID:23838618

Use of a modified Delphi panel to identify and weight criteria for prioritization of zoonotic diseases in Switzerland.

PubMed

Stebler, N; Schuepbach-Regula, G; Braam, P; Falzon, L C

2015-09-01

Zoonotic diseases have a significant impact on public health globally. To prevent or reduce future zoonotic outbreaks, there is a constant need to invest in research and surveillance programs while updating risk management strategies. However, given the limited resources available, disease prioritization based on the need for their control and surveillance is important. This study was performed to identify and weight disease criteria for the prioritization of zoonotic diseases in Switzerland using a semi-quantitative research method based on expert opinion. Twenty-eight criteria relevant for disease control and surveillance, classified under five domains, were selected following a thorough literature review, and these were evaluated and weighted by seven experts from the Swiss Federal Veterinary Office using a modified Delphi panel. The median scores assigned to each criterion were then used to rank 16 notifiable and/or emerging zoonoses in Switzerland. The experts weighted the majority of the criteria similarly, and the top three criteria were Severity of disease in humans, incidence and prevalence of the disease in humans and treatment in humans. Based on these weightings, the three highest ranked diseases were Avian Influenza, Bovine Spongiform Encephalitis, and Bovine Tuberculosis. Overall, this study provided a preliminary list of criteria relevant for disease prioritization in Switzerland. These were further evaluated in a companion study which involved a quantitative prioritization method and multiple stakeholders. Copyright © 2015 Elsevier B.V. All rights reserved.

Development of a consensus operational definition of child assent for research.

PubMed

Tait, Alan R; Geisser, Michael E

2017-06-09

There is currently no consensus from the relevant stakeholders regarding the operational and construct definitions of child assent for research. As such, the requirements for assent are often construed in different ways, institutionally disparate, and often conflated with those of parental consent. Development of a standardized operational definition of assent would thus be important to ensure that investigators, institutional review boards, and policy makers consider the assent process in the same way. To this end, we describe a Delphi study that provided consensus from a panel of expert stakeholders regarding the definitions of child assent for research. Based on current guidelines, a preliminary definition of assent was generated and sent out for review to a Delphi panel including pediatric bioethicists and researchers, Institutional Review Board members, parents, and individuals with regulatory/legal expertise. For each subsequent review, the process of summarizing and revising responses was repeated until consensus was achieved. Panelists were also required to rank order elements of assent that they believed were most important in defining the underlying constructs of the assent process (e.g., capacity for assent, disclosure). In providing these rankings, panelists were asked to frame their responses in the contexts of younger (≤ 11 yrs) and adolescents/older children (12-17 yrs) in non-therapeutic and therapeutic trials. Summary rankings of the most important identified elements were then used to generate written construct definitions which were sent out for iterative reviews by the expert panel. Consensus regarding the operational definition was reached by 14/18 (78%) of the panel members. Seventeen (94%) panelists agreed with the definitions of capacity for assent, elements of disclosure for younger children, and the requirements for meaningful assent, respectively. Fifteen (83%) members agreed with the elements of disclosure for adolescents/older children. It is hoped that this study will positively inform and effect change in the way investigators, regulators, and IRBs operationalize the assent process, respect children's developing autonomy, and in concert with parental permission, ensure the protection of children who participate in research.

Standardised method for reporting exercise programmes: protocol for a modified Delphi study.

PubMed

Slade, Susan C; Dionne, Clermont E; Underwood, Martin; Buchbinder, Rachelle

2014-12-30

Exercise is integral to health across the lifespan and important for people with chronic health conditions. A systematic review of exercise trials for chronic conditions reported suboptimal descriptions of the evaluated interventions and concluded that this hinders interpretation and replication. The aim of this project is to develop a standardised method for reporting essential exercise programme details being evaluated in clinical trials. A modified Delphi technique will be used to gain consensus among international exercise experts. We will use three sequential rounds of anonymous online questionnaires to refine a standardised checklist. A draft checklist of potentially relevant items was developed based on the results of a systematic review of exercise systematic reviews. An international panel of experts was identified by exercise systematic review authorship, established international profile in exercise research and practice and by peer referral. In round 1, the international panel of experts will be asked to rate the importance of each draft item and provide additional suggestions for revisions or new items. Consensus will be considered reached if at least 70% of the panel strongly agree/disagree that an item should be included or excluded. Where agreement is not reached or there are suggestions for altered or new items, these will be taken to round 2 together with an aggregated summary of round 1 responses. Following the second round, a ranking of item importance will be made to rationalise the number of items. The final template will be distributed to panel members for approval. Ethics approval was received from The Cabrini Institute Ethics Committee, Melbourne, Australia (HREC 02-07-04-14). We plan to use a stepwise process to develop and refine a standardised and internationally agreed template for explicit reporting of exercise programmes. The template will be generalisable across all types of exercise interventions. The findings will be disseminated through peer-reviewed publications and conference presentations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Consensus-Based Attributes for Identifying Patients With Spasmodic Dysphonia and Other Voice Disorders.

PubMed

Ludlow, Christy L; Domangue, Rickie; Sharma, Dinesh; Jinnah, H A; Perlmutter, Joel S; Berke, Gerald; Sapienza, Christine; Smith, Marshall E; Blumin, Joel H; Kalata, Carrie E; Blindauer, Karen; Johns, Michael; Hapner, Edie; Harmon, Archie; Paniello, Randal; Adler, Charles H; Crujido, Lisa; Lott, David G; Bansberg, Stephen F; Barone, Nicholas; Drulia, Teresa; Stebbins, Glenn

2018-06-21

A roadblock for research on adductor spasmodic dysphonia (ADSD), abductor SD (ABSD), voice tremor (VT), and muscular tension dysphonia (MTD) is the lack of criteria for selecting patients with these disorders. To determine the agreement among experts not using standard guidelines to classify patients with ABSD, ADSD, VT, and MTD, and develop expert consensus attributes for classifying patients for research. From 2011 to 2016, a multicenter observational study examined agreement among blinded experts when classifying patients with ADSD, ABSD, VT or MTD (first study). Subsequently, a 4-stage Delphi method study used reiterative stages of review by an expert panel and 46 community experts to develop consensus on attributes to be used for classifying patients with the 4 disorders (second study). The study used a convenience sample of 178 patients clinically diagnosed with ADSD, ABSD, VT MTD, vocal fold paresis/paralysis, psychogenic voice disorders, or hypophonia secondary to Parkinson disease. Participants were aged 18 years or older, without laryngeal structural disease or surgery for ADSD and underwent speech and nasolaryngoscopy video recordings following a standard protocol. Speech and nasolaryngoscopy video recordings following a standard protocol. Specialists at 4 sites classified 178 patients into 11 categories. Four international experts independently classified 75 patients using the same categories without guidelines after viewing speech and nasolaryngoscopy video recordings. Each member from the 4 sites also classified 50 patients from other sites after viewing video clips of voice/laryngeal tasks. Interrater κ less than 0.40 indicated poor classification agreement among rater pairs and across recruiting sites. Consequently, a Delphi panel of 13 experts identified and ranked speech and laryngeal movement attributes for classifying ADSD, ABSD, VT, and MTD, which were reviewed by 46 community specialists. Based on the median attribute rankings, a final attribute list was created for each disorder. When classifying patients without guidelines, raters differed in their classification distributions (likelihood ratio, χ2 = 107.66), had poor interrater agreement, and poor agreement with site categories. For 11 categories, the highest agreement was 34%, with no κ values greater than 0.26. In external rater pairs, the highest κ was 0.23 and the highest agreement was 38.5%. Using 6 categories, the highest percent agreement was 73.3% and the highest κ was 0.40. The Delphi method yielded 18 attributes for classifying disorders from speech and nasolaryngoscopic examinations. Specialists without guidelines had poor agreement when classifying patients for research, leading to a Delphi-based development of the Spasmodic Dysphonia Attributes Inventory for classifying patients with ADSD, ABSD, VT, and MTD for research.

Approaches to the management of agents used for the treatment of multiple sclerosis: consensus statements from a panel of U.S. managed care pharmacists and physicians.

PubMed

Miller, Ross M; Happe, Laura E; Meyer, Kellie L; Spear, Rachel J

2012-01-01

Multiple sclerosis (MS) is a chronic, disabling, and costly disease with several treatment options available; however, there is variability in evidence-based clinical guidelines. Therefore, payers are at a disadvantage when making management decisions without the benefit of definitive guidance from treatment guidelines. To outline approaches for the management of agents used to treat MS, as determined from a group of U.S. managed care pharmacists and physicians. A modified Delphi process was used to develop consensus statements regarding MS management approaches. The panel was composed of experts in managed care and included 8 pharmacy directors and 6 medical directors presently or previously involved in formulary decision making from 12 health plans, 1 specialty pharmacy, and 1 consulting company. These decision makers, who have experience designing health care benefits that include MS treatments, provided anonymous feedback through 2 rounds of web-based surveys and participated in 1 live panel meeting held in December 2010. Consensus was defined as a mean response of at least 3.3 or 100% of responses either "agree" or "strongly agree" (i.e., no panelist answered "disagree" or "strongly disagree") on a 4-item Likert scale (1=strongly disagree, 2=disagree, 3=agree, 4=strongly agree). After 3 phases, these managed care representatives reached consensus on 25 statements for management of patients with MS. Consistent with managed care principles, this group of managed care experts found that health plans should consider efficacy, effectiveness, and safety, as well as patient preference, when evaluating MS therapies for formulary placement. Cost and contracting should be considered if efficacy and safety are judged to be comparable between agents. The consensus statements developed by a panel of managed care representatives provide some insight into decision making in formulary and utilization management of MS therapies.

Development of Australian clinical practice outcome standards for graduates of critical care nurse education.

PubMed

Gill, Fenella J; Leslie, Gavin D; Grech, Carol; Boldy, Duncan; Latour, Jos M

2015-02-01

To develop critical care nurse education practice standards. Critical care specialist education for registered nurses in Australia is provided at graduate level. Considerable variation exists across courses with no framework to guide practice outcomes or evidence supporting the level of qualification. An eDelphi technique involved the iterative process of a national expert panel responding to three survey rounds. For the first round, 84 statements, organised within six domains, were developed from earlier phases of the study that included a literature review, analysis of critical care courses and input from health consumers. The panel, which represented the perspectives of four stakeholder groups, responded to two rating scales: level of importance and level of practice. Of 105 experts who agreed to participate, 92 (88%) completed survey round I; 85 (92%) round II; and 73 (86%) round III. Of the 98 statements, 75 were rated as having a high level of importance - median 7 (IQR 6-7); 14 were rated as having a moderate level of importance - median 6 (IQR 5-7); and nine were rated as having a low level of importance - median 4 (IQR 4-6)-6 (IQR 4-6). The majority of the panel rated graduate level of practice as 'demonstrates independently' or 'teaches or supervises others' for 80 statements. For 18 statements, there was no category selected by 50% or more of the panel. The process resulted in the development of 98 practice standards, categorised into three levels, indicating a practice outcome level by the practitioner who can independently provide nursing care for a variety of critically ill patients in most contexts, using a patient- and family-focused approach. The graduate practice outcomes provide a critical care qualification definition for nursing workforce standards and can be used by course providers to achieve consistent practice outcomes. © 2014 John Wiley & Sons Ltd.

Quality Indicators for Global Benchmarking of Localized Prostate Cancer Management.

PubMed

Sampurno, Fanny; Zheng, Jia; Di Stefano, Lydia; Millar, Jeremy L; Foster, Claire; Fuedea, Ferran; Higano, Celestia; Hulan, Hartwig; Mark, Stephen; Moore, Caroline; Richardson, Alison; Sullivan, Frank; Wenger, Neil S; Wittmann, Daniela; Evans, Sue

2018-03-01

We sought to develop a core set of clinical indicators to enable international benchmarking of localized prostate cancer management using data available in the TrueNTH (True North) Global Registry. An international expert panel completed an online survey and participated in a face to face meeting. Participants included 3 urologists, 3 radiation oncologists, 2 psychologists, 1 medical oncologist, 1 nurse and 1 epidemiologist with prostate cancer expertise from a total of 7 countries. Current guidelines on prostate cancer treatment and potential quality indicators were identified from a literature review. These potential indicators were refined and developed through a modified Delphi process during which each panelist independently and repeatedly rated each indicator based on importance (satisfying the indicator demonstrated a provision of high quality care) and feasibility (the likelihood that data used to construct the indicator could be collected at a population level). The main outcome measure was items with panel agreement indicted by a disagreement index less 1, median importance 8.5 or greater and median feasibility 9 or greater. The expert panel endorsed 33 indicators. Seven of these 33 prostate cancer quality indicators assessed care relating to diagnosis, 7 assessed primary treatment, 1 assessed salvage treatment and 18 assessed health outcomes. We developed a set of quality indicators to measure prostate cancer care using numerous international evidence-based clinical guidelines. These indicators will be pilot tested in the TrueNTH Global Registry. Reports comparing indicator performance will subsequently be distributed to groups at participating sites with the purpose of improving the consistency and quality of prostate cancer management on a global basis. Copyright © 2018 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Assessment of chronic post-surgical pain after knee replacement: development of a core outcome set.

PubMed

Wylde, V; MacKichan, F; Bruce, J; Gooberman-Hill, R

2015-05-01

Approximately 20% of patients experience chronic post-surgical pain (CPSP) after total knee replacement (TKR). There is scope to improve assessment of CPSP after TKR, and this study aimed to develop a core outcome set. Eighty patients and 43 clinicians were recruited into a three-round modified Delphi study. In Round 1, participants were presented with 56 pain features identified from a systematic review, structured interviews with patients and focus groups with clinicians. Participants assigned importance ratings, using a 1-9 scale, to individual pain features; those features rated as most important were retained in subsequent rounds. Consensus that a pain feature should be included in the core outcome set was defined as the feature having a rating of 7-9 by ≥70% of both panels (patients and clinicians) and 1-3 by ≤15% of both panels or rated as 7-9 by ≥90% of one panel. Round 1 was completed by 71 patients and 39 clinicians, and Round 3 by 62 patients and 33 clinicians. The final consensus was that 33 pain features were important. These were grouped into an 8-item core outcome set comprising: pain intensity, pain interference with daily living, pain and physical functioning, temporal aspects of pain, pain description, emotional aspects of pain, use of pain medication, and improvement and satisfaction with pain relief. This core outcome set serves to guide assessment of CPSP after TKR. Consistency in assessment can promote standardized reporting and facilitate comparability between studies that address a common but understudied type of CPSP. © 2014 The Authors. European Journal of Pain published by John Wiley & Sons Ltd on behalf of European Pain Federation - EFIC®.

Establishing research priorities for patient safety in emergency medicine: a multidisciplinary consensus panel.

PubMed

Plint, Amy C; Stang, Antonia S; Calder, Lisa A

2015-01-01

Patient safety in the context of emergency medicine is a relatively new field of study. To date, no broad research agenda for patient safety in emergency medicine has been established. The objective of this study was to establish patient safety-related research priorities for emergency medicine. These priorities would provide a foundation for high-quality research, important direction to both researchers and health-care funders, and an essential step in improving health-care safety and patient outcomes in the high-risk emergency department (ED) setting. A four-phase consensus procedure with a multidisciplinary expert panel was organized to identify, assess, and agree on research priorities for patient safety in emergency medicine. The 19-member panel consisted of clinicians, administrators, and researchers from adult and pediatric emergency medicine, patient safety, pharmacy, and mental health; as well as representatives from patient safety organizations. In phase 1, we developed an initial list of potential research priorities by electronically surveying a purposeful and convenience sample of patient safety experts, ED clinicians, administrators, and researchers from across North America using contact lists from multiple organizations. We used simple content analysis to remove duplication and categorize the research priorities identified by survey respondents. Our expert panel reached consensus on a final list of research priorities through an in-person meeting (phase 3) and two rounds of a modified Delphi process (phases 2 and 4). After phases 1 and 2, 66 unique research priorities were identified for expert panel review. At the end of phase 4, consensus was reached for 15 research priorities. These priorities represent four themes: (1) methods to identify patient safety issues (five priorities), (2) understanding human and environmental factors related to patient safety (four priorities), (3) the patient perspective (one priority), and (4) interventions for improving patient safety (five priorities). This study established expert, consensus-based research priorities for patient safety in emergency medicine. This framework could be used by researchers and health-care funders and represents an essential guiding step towards enhancing quality of care and patient safety in the ED.

Towards an international taxonomy of integrated primary care: a Delphi consensus approach.

PubMed

Valentijn, Pim P; Vrijhoef, Hubertus J M; Ruwaard, Dirk; Boesveld, Inge; Arends, Rosa Y; Bruijnzeels, Marc A

2015-05-22

Developing integrated service models in a primary care setting is considered an essential strategy for establishing a sustainable and affordable health care system. The Rainbow Model of Integrated Care (RMIC) describes the theoretical foundations of integrated primary care. The aim of this study is to refine the RMIC by developing a consensus-based taxonomy of key features. First, the appropriateness of previously identified key features was retested by conducting an international Delphi study that was built on the results of a previous national Delphi study. Second, categorisation of the features among the RMIC integrated care domains was assessed in a second international Delphi study. Finally, a taxonomy was constructed by the researchers based on the results of the three Delphi studies. The final taxonomy consists of 21 key features distributed over eight integration domains which are organised into three main categories: scope (person-focused vs. population-based), type (clinical, professional, organisational and system) and enablers (functional vs. normative) of an integrated primary care service model. The taxonomy provides a crucial differentiation that clarifies and supports implementation, policy formulation and research regarding the organisation of integrated primary care. Further research is needed to develop instruments based on the taxonomy that can reveal the realm of integrated primary care in practice.

Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

PubMed

Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

2014-06-25

The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our study. Based upon this consultation process, a guideline will be developed on instrument selection for outcomes to be included in a COS.

Guidelines for Developing and Reporting Machine Learning Predictive Models in Biomedical Research: A Multidisciplinary View

PubMed Central

2016-01-01

Background As more and more researchers are turning to big data for new opportunities of biomedical discoveries, machine learning models, as the backbone of big data analysis, are mentioned more often in biomedical journals. However, owing to the inherent complexity of machine learning methods, they are prone to misuse. Because of the flexibility in specifying machine learning models, the results are often insufficiently reported in research articles, hindering reliable assessment of model validity and consistent interpretation of model outputs. Objective To attain a set of guidelines on the use of machine learning predictive models within clinical settings to make sure the models are correctly applied and sufficiently reported so that true discoveries can be distinguished from random coincidence. Methods A multidisciplinary panel of machine learning experts, clinicians, and traditional statisticians were interviewed, using an iterative process in accordance with the Delphi method. Results The process produced a set of guidelines that consists of (1) a list of reporting items to be included in a research article and (2) a set of practical sequential steps for developing predictive models. Conclusions A set of guidelines was generated to enable correct application of machine learning models and consistent reporting of model specifications and results in biomedical research. We believe that such guidelines will accelerate the adoption of big data analysis, particularly with machine learning methods, in the biomedical research community. PMID:27986644

Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi.

PubMed

Pinnock, Hilary; Epiphaniou, Eleni; Sheikh, Aziz; Griffiths, Chris; Eldridge, Sandra; Craig, Peter; Taylor, Stephanie J C

2015-03-30

Dissemination and implementation of health care interventions are currently hampered by the variable quality of reporting of implementation research. Reporting of other study types has been improved by the introduction of reporting standards (e.g. CONSORT). We are therefore developing guidelines for reporting implementation studies (StaRI). Using established methodology for developing health research reporting guidelines, we systematically reviewed the literature to generate items for a checklist of reporting standards. We then recruited an international, multidisciplinary panel for an e-Delphi consensus-building exercise which comprised an initial open round to revise/suggest a list of potential items for scoring in the subsequent two scoring rounds (scale 1 to 9). Consensus was defined a priori as 80% agreement with the priority scores of 7, 8, or 9. We identified eight papers from the literature review from which we derived 36 potential items. We recruited 23 experts to the e-Delphi panel. Open round comments resulted in revisions, and 47 items went forward to the scoring rounds. Thirty-five items achieved consensus: 19 achieved 100% agreement. Prioritised items addressed the need to: provide an evidence-based justification for implementation; describe the setting, professional/service requirements, eligible population and intervention in detail; measure process and clinical outcomes at population level (using routine data); report impact on health care resources; describe local adaptations to the implementation strategy and describe barriers/facilitators. Over-arching themes from the free-text comments included balancing the need for detailed descriptions of interventions with publishing constraints, addressing the dual aims of reporting on the process of implementation and effectiveness of the intervention and monitoring fidelity to an intervention whilst encouraging adaptation to suit diverse local contexts. We have identified priority items for reporting implementation studies and key issues for further discussion. An international, multidisciplinary workshop, where participants will debate the issues raised, clarify specific items and develop StaRI standards that fit within the suite of EQUATOR reporting guidelines, is planned. The protocol is registered with Equator: http://www.equator-network.org/library/reporting-guidelines-under-development/#17 .

Incorporating the Delphi Technique to investigate renewable energy technology transfer in Saudi Arabia

NASA Astrophysics Data System (ADS)

Al-Otaibi, Nasir K.

Saudi Arabia is a major oil-producing nation facing a rapidly-growing population, high unemployment, climate change, and the depletion of its natural resources, potentially including its oil supply. Technology transfer is regarded as a means to diversify countries' economies beyond their natural resources. This dissertation examined the opportunities and barriers to utilizing technology transfer successfully to build renewable energy resources in Saudi Arabia to diversify the economy beyond oil production. Examples of other developing countries that have successfully used technology transfer to transform their economies are explored, including Japan, Malayasia, and the United Arab Emirates. Brazil is presented as a detailed case study to illustrate its transition to an economy based to a much greater degree than before on renewable energy. Following a pilot study, the Delphi Method was used in this research to gather the opinions of a panel of technology transfer experts consisting of 10 heterogeneous members of different institutions in the Kingdom of Saudi Arabia, including aviation, telecommunication, oil industry, education, health systems, and military and governmental organizations. In three rounds of questioning, the experts identified Education, Dependence on Oil, and Manpower as the 3 most significant factors influencing the potential for success of renewable energy technology transfer for Saudi Arabia. Political factors were also rated toward the "Very Important" end of a Likert scale and were discussed as they impact Education, Oil Dependence, and Manpower. The experts' opinions are presented and interpreted. They form the basis for recommended future research and discussion of how in light of its political system and its dependence on oil, Saudi Arabia can realistically move forward on renewable energy technology transfer and secure its economic future.

ACR Appropriateness Criteria® management of locoregionally advanced squamous cell carcinoma of the vulva.

PubMed

Kidd, Elizabeth; Moore, David; Varia, Mahesh A; Gaffney, David K; Elshaikh, Mohamed A; Erickson, Beth; Jhingran, Anuja; Lee, Larissa J; Mayr, Nina A; Puthawala, Ajmel A; Rao, Gautam G; Small, William; Wahl, Andrew O; Wolfson, Aaron H; Yashar, Catheryn M; Yuh, William; Cardenes, Higinia Rosa

2013-08-01

Locoregionally advanced vulvar cancer (LRAVC) is a rare disease that presents many challenging medical decisions. An expert panel was convened to reach consensus on the most appropriate pretreatment assessment and therapeutic interventions in LRAVC patients. The American College of Radiology Appropriateness Criteria are evidenced-based guidelines for specific clinical conditions that are reviewed every 2 years by a multidisciplinary expert panel. The guideline development and review include an extensive analysis of current medical literature from peer-reviewed journal and the application of a well-established consensus methodology (modified Delphi) to rate appropriateness of imaging and treatment procedures by the panel. In those instances where evidence is lacking or not definitive, expert opinion may be used to formulate recommendations. Three clinical variants were developed to address common scenarios in the management of LRAVC. Group members reached consensus on the appropriateness of specific evaluation and treatment approaches, with numerical ratings and descriptive commentary. In combining available medical literature and expert opinion, this manuscript may serve as an aid for other practitioners in the appropriate management of patients with LRAVC.

International, Expert-Based, Consensus Statement Regarding the Management of Acute Diverticulitis.

PubMed

O'Leary, D Peter; Lynch, Noel; Clancy, Cillian; Winter, Desmond C; Myers, Eddie

2015-09-01

This Delphi study provides consensus related to many aspects of acute diverticulitis and identifies other areas in need of research. To generate an international, expert-based, consensus statement to address controversies in the management of acute diverticulitis. This study was conducted using the Delphi technique from April 3 through October 21, 2014. A survey website was used and a panel of acute diverticulitis experts was formed via the snowball method. The top 5 acute diverticulitis experts in 5 international geographic regions were identified based on their number of publications related to acute diverticulitis. The Delphi study used 3 rounds of questions, after which the consensus statement was collated. A consensus statement related to the management of acute diverticulitis. Twenty items were selected for inclusion in the consensus statement following 3 rounds of questioning. A clear definition of uncomplicated and complicated diverticulitis is provided. In uncomplicated diverticulitis, consensus was reached regarding appropriate laboratory and radiological evaluation of patients as well as nonsurgical, surgical, and follow-up strategies. A number of important topics, including antibiotic treatment, failed to reach consensus. In addition, consensus was reached regarding many nonsurgical and surgical treatment strategies in complicated diverticulitis. Controversy continues internationally regarding the management of acute diverticulitis. This study demonstrates that there is more nonconsensus among experts than consensus regarding most issues, even in the same region. It also provides insight into the status quo regarding the treatment of acute diverticulitis and provides important direction for future research.

Strategies to promote better research on oral health in Africa: A Delphi consensus study

PubMed Central

Kanoute, Aïda; Faye, Daouda; Bourgeois, Denis

2014-01-01

Background: Research on oral health contributes to improved health outcomes; it is an indispensable tool in health policy. But how to fill the gaps in research oral health and to strengthen its capacity is the question. The main objective of the present study is to identify the current status of oral health research and potential strategies, thereby strengthening the research infrastructure and capacity. Delphi consultation, in the perspective of assisting decision-makers to identify strategies to promote better research on oral health in Africa, was initiated. Design and Methods: The panels of 30 experts were asked to complete the questionnaire with 42 items into four groups by web survey. Each indicator statement was considered to be in consensus if the expert's opinion rating was of “A or B” for more than 75% in a scale of seven categories. Quantitative analysis was made from the answers of Delphi round. Results: There was a strong consensus about three items concerning the role of oral health research, the development of research policy for oral health going through an effective governance of research institutes, migration of researchers and fund raising. Conclusion: This study shows strong many dispersal opinions by experts, but highlights the need for to improve the effectiveness of oral health research capacity strengthening activities. Africa's researchers, policy makers and partners will have to give special attention to ensuring that knowledge generated from oral health research is acted on to improve health for all. PMID:24808689

Identification of Translational Dermatology Research Priorities in the UK; Results of an e-Delphi Exercise

PubMed Central

Healy, E.; Reynolds, N.J.

2016-01-01

Summary Background Translational research is the direct application of basic and applied research to patient care. It is estimated that there are at least 2,000 different skin diseases, thus there are considerable challenges in seeking to undertake research on each of these disorders. Objective This eDelphi exercise was conducted in order to generate a list of translational dermatology research questions which are regarded as a priority for further investigations. Results During the first phase of the eDelphi, 228 research questions were generated by an expert panel which included clinical academic dermatologists, clinical dermatologists, non-clinical scientists, dermatology trainees and representatives from patient support groups. Following completion of the second and third phases, 40 questions on inflammatory skin disease, 20 questions on structural skin disorders / genodermatoses, 37 questions on skin cancer and 8 miscellaneous questions were designated as priority translational dermatology research questions (PRQs). In addition to PRQs on a variety of disease areas (including multiple PRQs on psoriasis, eczema, squamous cell carcinoma (SCC) and melanoma), there were a number of cross-cutting themes which identified a need to investigate mechanisms / pathogenesis of disease and the necessity to improve treatments for patients with skin disease. Conclusion It is predicted that this list of PRQs will help to provide a strategic direction for translational dermatology research in the UK and that addressing this list of questions will ultimately provide clinical benefit for substantial numbers of subjects with skin disorders. PMID:26149834

The Development, Description and Appraisal of an Emergent Multimethod Research Design to Study Workforce Changes in Integrated Care Interventions.

PubMed

Busetto, Loraine; Luijkx, Katrien; Calciolari, Stefano; González-Ortiz, Laura G; Vrijhoef, Hubertus J M

2017-03-08

In this paper, we provide a detailed and explicit description of the processes and decisions underlying and shaping the emergent multimethod research design of our study on workforce changes in integrated chronic care. The study was originally planned as mixed method research consisting of a preliminary literature review and quantitative check of these findings via a Delphi panel. However, when the findings of the literature review were not appropriate for quantitative confirmation, we chose to continue our qualitative exploration of the topic via qualitative questionnaires and secondary analysis of two best practice case reports. The resulting research design is schematically described as an emergent and interactive multimethod design with multiphase combination timing. In doing so, we provide other researchers with a set of theory- and experience-based options to develop their own multimethod research and provide an example for more detailed and structured reporting of emergent designs. We argue that the terminology developed for the description of mixed methods designs should also be used for multimethod designs such as the one presented here.

Library as place: results of a delphi study

PubMed Central

Ludwig, Logan; Starr, Susan

2005-01-01

Objective: An expert consensus on the future of the library as place was developed to assist health sciences librarians in designing new library spaces. Method: An expert panel of health sciences librarians, building consultants, architects, and information technologists was asked to reflect on the likelihood, desirability, timing, and impact on building design of more than seventy possible changes in the use of library space. Results: An expert consensus predicted that the roles librarians play and the way libraries are used will substantially change. These changes come in response to changes in technology, scholarly communication, learning environments, and the health care economy. Conclusions: How health sciences library space is used will be far less consistent by 2015, as space becomes more tailored to institutional needs. However, the manner in which health sciences libraries develop and deliver services and collections will drastically change in the next decade. Libraries will continue to exist and will provide support for knowledge management and clinical trials, provide access to digital materials, and play a host of other roles that will enable libraries to emerge as institutional change agents. PMID:16059421

Expert agreed standards for the selection and development of cancer support group leaders: an online reactive Delphi study.

PubMed

Pomery, Amanda; Schofield, Penelope; Xhilaga, Miranda; Gough, Karla

2018-01-01

The aim of this study was to develop pragmatic, consensus-based minimum standards for the role of a cancer support group leader. Secondly, to produce a structured interview designed to assess the knowledge, skills and attributes of the individuals who seek to undertake the role. An expert panel of 73 academics, health professionals, cancer agency workers and cancer support group leaders were invited to participate in a reactive online Delphi study involving three online questionnaire rounds. Participants determined and ranked requisite knowledge, skills and attributes (KSA) for cancer support group leaders, differentiated ideal from required KSA to establish minimum standards, and agreed on a method of rating KSA to determine suitability and readiness. Forty-five experts (62%) participated in round 1, 36 (49%) in round 2 and 23 (31%) in round 3. In round 1, experts confirmed 59 KSA identified via a systemic review and identified a further 55 KSA. In round 2, using agreement ≥75%, 52 KSA emerged as minimum standards for support group leaders. In round 3, consensus was reached on almost every aspect of the content and structure of a structured interview. Panel member comments guided refinement of wording, re-ordering of questions and improvement of probing questions. Alongside a novel structured interview, the first consensus-based minimum standards have been developed for cancer support group leaders, incorporating expert consensus and pragmatic considerations. Pilot and field testing will be used to appraise aspects of clinical utility and establish a rational scoring model for the structured interview.

Criteria required for an acceptable point-of-care test for UTI detection: Obtaining consensus using the Delphi technique.

PubMed

Weir, Nichola-Jane M; Pattison, Sally H; Kearney, Paddy; Stafford, Bob; Gormley, Gerard J; Crockard, Martin A; Gilpin, Deirdre F; Tunney, Michael M; Hughes, Carmel M

2018-01-01

Urinary Tract Infections (UTIs) are common bacterial infections, second only to respiratory tract infections and particularly prevalent within primary care. Conventional detection of UTIs is culture, however, return of results can take between 24 and 72 hours. The introduction of a point of care (POC) test would allow for more timely identification of UTIs, facilitating improved, targeted treatment. This study aimed to obtain consensus on the criteria required for a POC UTI test, to meet patient need within primary care. Criteria for consideration were compiled by the research team. These criteria were validated through a two-round Delphi process, utilising an expert panel of healthcare professionals from across Europe and United States of America. Using web-based questionnaires, panellists recorded their level of agreement with each criterion based on a 5-point Likert Scale, with space for comments. Using median response, interquartile range and comments provided, criteria were accepted/rejected/revised depending on pre-agreed cut-off scores. The first round questionnaire presented thirty-three criteria to the panel, of which 22 were accepted. Consensus was not achieved for the remaining 11 criteria. Following response review, one criterion was removed, while after revision, the remaining 10 criteria entered the second round. Of these, four were subsequently accepted, resulting in 26 criteria considered appropriate for a POC test to detect urinary infections. This study generated an approved set of criteria for a POC test to detect urinary infections. Criteria acceptance and comments provided by the healthcare professionals also supports the development of a multiplex point of care UTI test.

Validation of the Chinese translation of the 6-item De Jong Gierveld Loneliness Scale in elderly Chinese.

PubMed

Leung, Grace Tak Yu; de Jong Gierveld, Jenny; Lam, Linda Chiu Wa

2008-12-01

This study aims to develop and validate a Chinese translation of the 6-item De Jong Gierveld Loneliness Scale - a widely used instrument to measure loneliness - specifically determining its psychometric properties in community-dwelling Chinese elders in Hong Kong. The relationships between loneliness and several clinical variables are also assessed. The English version was translated into Chinese. Content validity was established by group discussion and Delphi panel. The questionnaire was administered to 103 Hong Kong Chinese community-dwelling elders. Statistical analysis was performed to test the reliability and validity of the scale. The content validity was high as shown by the results of the Delphi panel. Cronbach's alpha of the 6-item scale was 0.76. For the inter-rater reliability of the six items, the intra-class correlation coefficients ranged from 0.98 to 1.00. The emotional loneliness subscale significantly correlated with the social loneliness subscale (rho = 0.37; p < 0.001). In using a direct question to measure loneliness, 21 participants (20%) reported that they were lonely. The overall loneliness scale score significantly correlated with the answers on the direct question of loneliness (rpb = 0.71; p < 0.001). The overall loneliness score showed significant correlation with Cornell Scale for Depression in Dementia (rho = 0.29; p = 0.003), current smoking status (rpb = 0.24; p = 0.014), and some objective social characteristics. The Chinese version of the 6-item De Jong Gierveld Loneliness Scale is a reliable and valid measure of loneliness in Chinese elders.

Standardization of definitions in focal therapy of prostate cancer: report from a Delphi consensus project.

PubMed

Postema, A W; De Reijke, T M; Ukimura, O; Van den Bos, W; Azzouzi, A R; Barret, E; Baumunk, D; Blana, A; Bossi, A; Brausi, M; Coleman, J A; Crouzet, S; Dominguez-Escrig, J; Eggener, S; Ganzer, R; Ghai, S; Gill, I S; Gupta, R T; Henkel, T O; Hohenfellner, M; Jones, J S; Kahmann, F; Kastner, C; Köhrmann, K U; Kovacs, G; Miano, R; van Moorselaar, R J; Mottet, N; Osorio, L; Pieters, B R; Polascik, T J; Rastinehad, A R; Salomon, G; Sanchez-Salas, R; Schostak, M; Sentker, L; Tay, K J; Varkarakis, I M; Villers, A; Walz, J; De la Rosette, J J

2016-10-01

To reach standardized terminology in focal therapy (FT) for prostate cancer (PCa). A four-stage modified Delphi consensus project was undertaken among a panel of international experts in the field of FT for PCa. Data on terminology in FT was collected from the panel by three rounds of online questionnaires. During a face-to-face meeting on June 21, 2015, attended by 38 experts, all data from the online rounds were reviewed and recommendations for definitions were formulated. Consensus was attained on 23 of 27 topics; Targeted FT was defined as a lesion-based treatment strategy, treating all identified significant cancer foci; FT was generically defined as an anatomy-based (zonal) treatment strategy. Treatment failure due to the ablative energy inadequately destroying treated tissue is defined as ablation failure. In targeting failure the energy is not adequately applied to the tumor spatially and selection failure occurs when a patient was wrongfully selected for FT. No definition of biochemical recurrence can be recommended based on the current data. Important definitions for outcome measures are potency (minimum IIEF-5 score of 21), incontinence (new need for pads or leakage) and deterioration in urinary function (increase in IPSS >5 points). No agreement on the best quality of life tool was established, but UCLA-EPIC and EORTC-QLQ-30 were most commonly supported by the experts. A complete overview of statements is presented in the text. Focal therapy is an emerging field of PCa therapeutics. Standardization of definitions helps to create comparable research results and facilitate clear communication in clinical practice.

Delphi consensus of an expert committee in oncogeriatrics regarding comprehensive geriatric assessment in seniors with cancer in Spain.

PubMed

Molina-Garrido, Maria-Jose; Guillén-Ponce, Carmen; Blanco, Remei; Saldaña, Juana; Feliú, Jaime; Antonio, Maite; López-Mongil, Rosa; Ramos Cordero, Primitivo; Gironés, Regina

2018-07-01

The aim of this work was to reach a national consensus in Spain regarding the Comprehensive Geriatric Assessment (CGA) domains in older oncological patients and the CGA scales to be used as a foundation for widespread use. The Delphi method was implemented to attain consensus. Representatives of the panel were chosen from among the members of the Oncogeriatric Working Group of the Spanish Society of Medical Oncology (SEOM). Consensus was defined as ≥66.7% coincidence in responses and by the stability of said coincidence (changes ≤15% between rounds). The study was conducted between July and December 2016. Of the 17 people invited to participate, 16 agreed. The panel concluded by consensus that the following domains should be included in the CGA:(and the scales to evaluate them): functional (Barthel Index, Lawton-Brody scale, gait speed), cognitive (Pfeiffer questionnaire), nutritional (Mini Nutritional Assessment - MNA), psychological/mood (Yesavage scale), social-familial (Gijon scale), comorbidity (Charlson index), medications, and geriatric syndromes (urinary and/or fecal incontinence, low auditory and/or visual acuity, presence of falls, pressure sores, insomnia, and abuse). Also by consensus, the CGA should be administered to older patients with cancer for whom there is a subsequent therapeutic intent and who scored positive on a previous frailty-screening questionnaire. After 3 rounds, consensus was reached regarding CGA domains to be used in older patients with cancer, the scales to be administered for each of these domains, as well as the timeline to be followed during consultation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Delphi-RAND consensus of the Spanish Society of Internal Medicine on the controversies in anticoagulant therapy and prophylaxis in medical diseases. INTROMBIN Project (Uncertainty in thromboprophylaxis in internal medicine).

PubMed

Ruiz-Ruiz, F; Medrano, F J; Navarro-Puerto, M A; Rodríguez-Torres, P; Romero-Alonso, A; Santos-Lozano, J M; Alonso-Ortiz Del Rio, C; Varela-Aguilar, J M; Calderón, E J; Marín-León, I

2018-05-21

The aim of this study was to determine the opinion of internists on the management of anticoagulation and thromboembolism prophylaxis in complex clinical scenarios in which the risk-benefit ratio of surgery is narrow and to develop a consensus document on the use of drugs anticoagulant therapy in this patient group. To this end, we identified by consensus the clinical areas of greatest uncertainty, a survey was created with 20 scenarios laid out in 40 clinical questions, and we reviewed the specific literature. The survey was distributed among the internists of the Spanish Society of Internal Medicine (SEMI) and was completed by 290 of its members. The consensus process was implemented by changing the Delphi-RAND appropriateness method in an anonymous, double-round process that enabled an expert panel to identify the areas of agreement and uncertainty. In our case, we also added the survey results to the panel, a methodological innovation that helps provide additional information on the standard clinical practice. The result of the process is a set of 19 recommendations formulated by SEMI experts, which helps establish guidelines for action on anticoagulant therapy in complex scenarios (high risk or active haemorrhage, short life expectancy, coexistence of antiplatelet therapy or comorbidities such as kidney disease and liver disease), which are not uncommon in standard clinical practice. Copyright © 2018 Elsevier España, S.L.U. and Sociedad Española de Medicina Interna (SEMI). All rights reserved.

Identification of an updated set of prescribing-safety indicators for GPs

PubMed Central

Spencer, Rachel; Bell, Brian; Avery, Anthony J; Gookey, Gill; Campbell, Stephen M

2014-01-01

Background Medication error is an important contributor to patient morbidity and mortality and is associated with inadequate patient safety measures. However, prescribing-safety tools specifically designed for use in general practice are lacking. Aim To identify and update a set of prescribing-safety indicators for assessing the safety of prescribing in general practice, and to estimate the risk of harm to patients associated with each indicator. Design and setting RAND/UCLA consensus development of indicators in UK general practice. Method Prescribing indicators were identified from a systematic review and previous consensus exercise. The RAND Appropriateness Method was used to further identify and develop the indicators with an electronic-Delphi method used to rate the risk associated with them. Twelve GPs from all the countries of the UK participated in the RAND exercise, with 11 GPs rating risk using the electronic-Delphi approach. Results Fifty-six prescribing-safety indicators were considered appropriate for inclusion (overall panel median rating of 7–9, with agreement). These indicators cover hazardous prescribing across a range of therapeutic indications, hazardous drug–drug combinations and inadequate laboratory test monitoring. Twenty-three (41%) of these indicators were considered high risk or extreme risk by 80% or more of the participants. Conclusion This study identified a set of 56 indicators that were considered, by a panel of GPs, to be appropriate for assessing the safety of GP prescribing. Twenty-three of these indicators were considered to be associated with high or extreme risk to patients and should be the focus of efforts to improve patient safety. PMID:24686882

Early psychosis workforce development: Core competencies for mental health professionals working in the early psychosis field.

PubMed

Osman, Helen; Jorm, Anthony F; Killackey, Eoin; Francey, Shona; Mulcahy, Dianne

2017-08-09

The aim of this study was to identify the core competencies required of mental health professionals working in the early psychosis field, which could function as an evidence-based tool to support the early psychosis workforce and in turn assist early psychosis service implementation and strengthen early psychosis model fidelity. The Delphi method was used to establish expert consensus on the core competencies. In the first stage, a systematic literature search was conducted to generate competency items. In the second stage, a panel consisting of expert early psychosis clinicians from around the world was formed. Panel members then rated each of the competency items on how essential they are to the clinical practice of all early psychosis clinicians. In total, 1023 pieces of literature including textbooks, journal articles and grey literature were reviewed. A final 542 competency items were identified for inclusion in the questionnaire. A total of 63 early psychosis experts participated in 3 rating rounds. Of the 542 competency items, 242 were endorsed as the required core competencies. There were 29 competency items that were endorsed by 62 or more experts, and these may be considered the foundational competencies for early psychosis practice. The study generated a set of core competencies that provide a common language for early psychosis clinicians across professional disciplines and country of practice, and potentially are a useful professional resource to support early psychosis workforce development and service reform. © 2017 John Wiley & Sons Australia, Ltd.

Engaging Patients and Caregivers Managing Rare Diseases to Improve the Methods of Clinical Guideline Development: A Research Protocol

PubMed Central

Kinnett, Kathi; Grant, Sean; Lucas, Ann; Martin, Ann; Denger, Brian; Peay, Holly; Coulter, Ian; Fink, Arlene

2017-01-01

Background Clinical guidelines provide systematically developed recommendations for deciding on appropriate health care options for specific conditions and clinical circumstances. Up until recently, patients and caregivers have rarely been included in the process of developing care guidelines. Objective This project will develop and test a new online method for including patients and their caregivers in this process using Duchenne muscular dystrophy (DMD) care guidelines as an example. The new method will mirror and complement the RAND/UCLA Appropriateness Method (RAM)—the gold standard approach for conducting clinical expert panels that uses a modified Delphi format. RAM is often used in clinical guideline development to determine care appropriateness and necessity in situations where existing clinical evidence is uncertain, weak, or unavailable. Methods To develop the new method for engaging patients and their caregivers in guideline development, we will first conduct interviews with experts on RAM, guideline development, patient engagement, and patient-centeredness and engage with Duchenne patients and caregivers to identify how RAM should be modified for the purposes of patient engagement and what rating criteria should patients and caregivers use to provide their input during the process of guideline development. Once the new method is piloted, we will test it by conducting two concurrently run patient/caregiver panels that will rate patient-centeredness of a subset of DMD care management recommendations already deemed clinically appropriate and necessary. The ExpertLens™ system—a previously evaluated online modified Delphi system that combines two rounds of rating with a round of feedback and moderated online discussions—will be used to conduct these panels. In addition to developing and testing the new engagement method, we will work with the members of our project’s Advisory Board to generate a list of best practices for enhancing the level of patient and caregiver involvement in the guideline development process. We will solicit input on these best practice from Duchenne patients, caregivers, and clinicians by conducting a series of round-table discussions and making a presentation at an annual conference on Duchenne. Results The study protocol was reviewed by RAND’s Human Subjects Protection Committee, which determined it to be exempt from review. Interviews with RAM experts have been completed. The projected study completion date is May 2020. Conclusions We expect that the new method will make it easier to engage large numbers of patients and caregivers in the process of guideline development in a rigorous and culturally appropriate manner that is consistent with the way clinicians participate in guideline development. Moreover, this project will develop best practices that could help involve patients and caregivers in the clinical guideline development process in other clinical areas, thereby facilitating the work of guideline developers. PMID:28455279

Adoption of Biosimilar Infliximab for Rheumatoid Arthritis, Ankylosing Spondylitis, and Inflammatory Bowel Diseases in the EU5: A Budget Impact Analysis Using a Delphi Panel

PubMed Central

Kanters, Tim A.; Stevanovic, Jelena; Huys, Isabelle; Vulto, Arnold G.; Simoens, Steven

2017-01-01

Introduction: Introducing biosimilar infliximab for the treatment in rheumatology (rheumatoid arthritis and ankylosing spondylitis) and inflammatory bowel disease (Crohn's disease and ulcerative colitis) may reduce treatment costs associated with biologics. This study aimed to investigate the budget impact of adopting biosimilar infliximab in five European countries, considering that the budget impact includes the adoption of biosimilar infliximab and the availability of biologic alternatives such as vedolizumab, biosimilar etanercept, biosimilar rituximab, and other relevant factors. Methods: An existing budget impact model was adapted to forecast the budget impact in the UK, Germany, France, Spain, and Italy. Epidemiological parameters were derived from published literature reviewed in July 2015. Current market shares of biologics were derived from Therapy Watch (2012/2013 data). Respondents in a Delphi panel, conducted in 2015 and consisting of several leading rheumatologists and gastroenterologists from different nationalities, were asked to forecast uptake of biosimilar infliximab and estimate the proportion of patients eligible for a particular type of biological treatment, including biosimilar infliximab. Scenario analyses assessed the influence of various factors, including price reductions, on the budget. Results: Uptake of biosimilar infliximab was particularly expected for naïve patients; switching patients that already received other biologics was not expected much. Market shares after 5 years of biosimilar infliximab were ~2% in rheumatology in all five countries and in gastroenterology ranged from 4% in France to over 30% in Italy. Except for France, budgets were expected to decrease for rheumatologic diseases. For gastroenterology, budgets were expected to decrease in Spain and Italy. Budgets were expected to increase substantially in the UK and Germany, due to the introduction of vedolizumab in the studied period. In France, budget was expected to slightly increase for ankylosing spondylitis, Crohn's Disease, and ulcerative collitis. Savings in budget were expected in all countries, for all diseases, when larger price discounts on biosimilar infliximab were used. Discussion and Conclusion: This study has shown that only when price reductions are large enough (i.e., 50% or more), physicians indicated that they will prescribe biosimilars. Policy makers should ensure substantial price reductions and stimulate physicians to use biosimilar products, to obtain savings in healthcare budgets. PMID:28620302

Adoption of Biosimilar Infliximab for Rheumatoid Arthritis, Ankylosing Spondylitis, and Inflammatory Bowel Diseases in the EU5: A Budget Impact Analysis Using a Delphi Panel.

PubMed

Kanters, Tim A; Stevanovic, Jelena; Huys, Isabelle; Vulto, Arnold G; Simoens, Steven

2017-01-01

Introduction: Introducing biosimilar infliximab for the treatment in rheumatology (rheumatoid arthritis and ankylosing spondylitis) and inflammatory bowel disease (Crohn's disease and ulcerative colitis) may reduce treatment costs associated with biologics. This study aimed to investigate the budget impact of adopting biosimilar infliximab in five European countries, considering that the budget impact includes the adoption of biosimilar infliximab and the availability of biologic alternatives such as vedolizumab, biosimilar etanercept, biosimilar rituximab, and other relevant factors. Methods: An existing budget impact model was adapted to forecast the budget impact in the UK, Germany, France, Spain, and Italy. Epidemiological parameters were derived from published literature reviewed in July 2015. Current market shares of biologics were derived from Therapy Watch (2012/2013 data). Respondents in a Delphi panel, conducted in 2015 and consisting of several leading rheumatologists and gastroenterologists from different nationalities, were asked to forecast uptake of biosimilar infliximab and estimate the proportion of patients eligible for a particular type of biological treatment, including biosimilar infliximab. Scenario analyses assessed the influence of various factors, including price reductions, on the budget. Results: Uptake of biosimilar infliximab was particularly expected for naïve patients; switching patients that already received other biologics was not expected much. Market shares after 5 years of biosimilar infliximab were ~2% in rheumatology in all five countries and in gastroenterology ranged from 4% in France to over 30% in Italy. Except for France, budgets were expected to decrease for rheumatologic diseases. For gastroenterology, budgets were expected to decrease in Spain and Italy. Budgets were expected to increase substantially in the UK and Germany, due to the introduction of vedolizumab in the studied period. In France, budget was expected to slightly increase for ankylosing spondylitis, Crohn's Disease, and ulcerative collitis. Savings in budget were expected in all countries, for all diseases, when larger price discounts on biosimilar infliximab were used. Discussion and Conclusion: This study has shown that only when price reductions are large enough (i.e., 50% or more), physicians indicated that they will prescribe biosimilars. Policy makers should ensure substantial price reductions and stimulate physicians to use biosimilar products, to obtain savings in healthcare budgets.

Delphi definition of the EADC-ADNI Harmonized Protocol for hippocampal segmentation on magnetic resonance

PubMed Central

Boccardi, Marina; Bocchetta, Martina; Apostolova, Liana G.; Barnes, Josephine; Bartzokis, George; Corbetta, Gabriele; DeCarli, Charles; deToledo-Morrell, Leyla; Firbank, Michael; Ganzola, Rossana; Gerritsen, Lotte; Henneman, Wouter; Killiany, Ronald J.; Malykhin, Nikolai; Pasqualetti, Patrizio; Pruessner, Jens C.; Redolfi, Alberto; Robitaille, Nicolas; Soininen, Hilkka; Tolomeo, Daniele; Wang, Lei; Watson, Craig; Wolf, Henrike; Duvernoy, Henri; Duchesne, Simon; Jack, Clifford R.; Frisoni, Giovanni B.

2015-01-01

Background This study aimed to have international experts converge on a harmonized definition of whole hippocampus boundaries and segmentation procedures, to define standard operating procedures for magnetic resonance (MR)-based manual hippocampal segmentation. Methods The panel received a questionnaire regarding whole hippocampus boundaries and segmentation procedures. Quantitative information was supplied to allow evidence-based answers. A recursive and anonymous Delphi procedure was used to achieve convergence. Significance of agreement among panelists was assessed by exact probability on Fisher’s and binomial tests. Results Agreement was significant on the inclusion of alveus/fimbria (P =.021), whole hippocampal tail (P =.013), medial border of the body according to visible morphology (P =.0006), and on this combined set of features (P =.001). This definition captures 100% of hippocampal tissue, 100% of Alzheimer’s disease-related atrophy, and demonstrated good reliability on preliminary intrarater (0.98) and inter-rater (0.94) estimates. Discussion Consensus was achieved among international experts with respect to hippocampal segmentation using MR resulting in a harmonized segmentation protocol. PMID:25130658

Developing an industry-oriented safety curriculum using the Delphi technique.

PubMed

Chen, Der-Fa; Wu, Tsung-Chih; Chen, Chi-Hsiang; Chang, Shu-Hsuan; Yao, Kai-Chao; Liao, Chin-Wen

2016-09-01

In this study, we examined the development of industry-oriented safety degree curricula at a college level. Based on a review of literature on the practices and study of the development of safety curricula, we classified occupational safety and health curricula into the following three domains: safety engineering, health engineering, and safety and health management. We invited 44 safety professionals to complete a four-round survey that was designed using a modified Delphi technique. We used Chi-square statistics to test the panel experts' consensus on the significance of the items in the three domains and employed descriptive statistics to rank the participants' rating of each item. The results showed that the top three items for each of the three domains were Risk Assessment, Dangerous Machinery and Equipment, and Fire and Explosion Prevention for safety engineering; Ergonomics, Industrial Toxicology, and Health Risk Assessment for health engineering; and Industrial Safety and Health Regulations, Accident Investigation and Analysis, and Emergency Response for safety and health management. Only graduates from safety programmes who possess practical industry-oriented abilities can satisfy industry demands and provide value to the existence of college safety programmes.

Guidelines to encourage the adoption and meaningful use of health information technologies in the South African healthcare landscape.

PubMed

Mostert-Phipps, Nicky; Pottas, Dalenca; Korpela, Mikko

2013-01-01

There are various benefits associated with the adoption and meaningful use of health information technologies (HITs) in the healthcare sector. Despite these benefits, the South African healthcare sector has been slow to adopt HITs such as electronic record systems. The purpose of this research project was to formulate guidelines to encourage the adoption and meaningful use of HITs in the South African healthcare landscape. A three-round Delphi study was conducted to identify factors that should be addressed to encourage the adoption and meaningful use of HITs in the South African healthcare landscape. The Delphi panel included 21 participants that were considered to be suitably knowledgeable regarding the area under consideration. Consensus was reached on 42 factors that were rated as having a direct to significant impact on the adoption and meaningful use of HITs in the South African context. These factors were further analysed to formulate 20 guidelines that indicate that there are a wide range of factors that would have to be addressed involving a multitude of stakeholders.

Delphi definition of the EADC-ADNI Harmonized Protocol for hippocampal segmentation on magnetic resonance.

PubMed

Boccardi, Marina; Bocchetta, Martina; Apostolova, Liana G; Barnes, Josephine; Bartzokis, George; Corbetta, Gabriele; DeCarli, Charles; deToledo-Morrell, Leyla; Firbank, Michael; Ganzola, Rossana; Gerritsen, Lotte; Henneman, Wouter; Killiany, Ronald J; Malykhin, Nikolai; Pasqualetti, Patrizio; Pruessner, Jens C; Redolfi, Alberto; Robitaille, Nicolas; Soininen, Hilkka; Tolomeo, Daniele; Wang, Lei; Watson, Craig; Wolf, Henrike; Duvernoy, Henri; Duchesne, Simon; Jack, Clifford R; Frisoni, Giovanni B

2015-02-01

This study aimed to have international experts converge on a harmonized definition of whole hippocampus boundaries and segmentation procedures, to define standard operating procedures for magnetic resonance (MR)-based manual hippocampal segmentation. The panel received a questionnaire regarding whole hippocampus boundaries and segmentation procedures. Quantitative information was supplied to allow evidence-based answers. A recursive and anonymous Delphi procedure was used to achieve convergence. Significance of agreement among panelists was assessed by exact probability on Fisher's and binomial tests. Agreement was significant on the inclusion of alveus/fimbria (P = .021), whole hippocampal tail (P = .013), medial border of the body according to visible morphology (P = .0006), and on this combined set of features (P = .001). This definition captures 100% of hippocampal tissue, 100% of Alzheimer's disease-related atrophy, and demonstrated good reliability on preliminary intrarater (0.98) and inter-rater (0.94) estimates. Consensus was achieved among international experts with respect to hippocampal segmentation using MR resulting in a harmonized segmentation protocol. Copyright © 2015 The Alzheimer's Association. Published by Elsevier Inc. All rights reserved.

A delphi study on health in future India.

PubMed

Rohatgi, K; Rohatgi, P K

1980-07-01

A delphi study was conducted to identify or envision health scenarios in India by the year 2000. Questionnaires consisting of 48 questions on 5 areas (diagnosis and therapy; family planning; pharmaceuticals and drugs; biochemical and biomedical research; health services) were mailed to 250 experts in India. 36 responded. Results were compiled and mailed back to the respondents for changes and comments. 17 people responded. Results of the delphi study shows that policy decisions with respect to compulsory family planning as well as health education at secondary school level will precede further breakthroughs in birth control technology. Non operation reversible sterilization procedures, immunological birth control, Ayurvedic medicines for contraception and abortion, and selection of baby's sex are all possible by 2000 thereafter. Complete eradication of infectious diseases, malnutrition and associated diseases is considered unlikely before 2000, as are advances in biomedical research. Changes in health services (e.g., significant increases in hospital beds and doctors, cheap bulk drugs), particularly in rural areas, are imminent, leading to prolonging of life expectancy to 70 years. Genetic engineering may provide significant breakthroughs in the prevention of malignancies and cardiac disorders. The India delphi study is patterned after a similar delphi study conducted in the U.S. by Smith, Kline and French (SKF) Laboratories in 1968. The SKF study was able to predict some breakthroughs with basic research which have been realized.

Development of an Electronic Pediatric All-Cause Harm Measurement Tool Using a Modified Delphi Method.

PubMed

Stockwell, David Christopher; Bisarya, Hema; Classen, David C; Kirkendall, Eric S; Lachman, Peter I; Matlow, Anne G; Tham, Eric; Hyman, Dan; Lehman, Samuel M; Searles, Elizabeth; Muething, Stephen E; Sharek, Paul J

2016-12-01

To have impact on reducing harm in pediatric inpatients, an efficient and reliable process for harm detection is needed. This work describes the first step toward the development of a pediatric all-cause harm measurement tool by recognized experts in the field. An international group of leaders in pediatric patient safety and informatics were charged with developing a comprehensive pediatric inpatient all-cause harm measurement tool using a modified Delphi technique. The process was conducted in 5 distinct steps: (1) literature review of triggers (elements from a medical record that assist in identifying patient harm) for inclusion; (2) translation of triggers to likely associated harm, improving the ability for expert prioritization; (3) 2 applications of a modified Delphi selection approach with consensus criteria using severity and frequency of harm as well as detectability of the associated trigger as criteria to rate each trigger and associated harm; (4) developing specific trigger logic and relevant values when applicable; and (5) final vetting of the entire trigger list for pilot testing. Literature and expert panel review identified 108 triggers and associated harms suitable for consideration (steps 1 and 2). This list was pared to 64 triggers and their associated harms after the first of the 2 independent expert reviews. The second independent expert review led to further refinement of the trigger package, resulting in 46 items for inclusion (step 3). Adding in specific trigger logic expanded the list. Final review and voting resulted in a list of 51 triggers (steps 4 and 5). Application of a modified Delphi method on an expert-constructed list of 108 triggers, focusing on severity and frequency of harms as well as detectability of triggers in an electronic medical record, resulted in a final list of 51 pediatric triggers. Pilot testing this list of pediatric triggers to identify all-cause harm for pediatric inpatients is the next step to establish the appropriateness of each trigger for inclusion in a global pediatric safety measurement tool.

Expert validation of a teamwork assessment rubric: A modified Delphi study.

PubMed

Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

2016-01-01

Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with confidence in the university setting. Copyright © 2015 Elsevier Ltd. All rights reserved.

Consensus on Hearing Aid Candidature and Fitting for Mild Hearing Loss, With and Without Tinnitus: Delphi Review

PubMed Central

Hoare, Derek J.; Nicholson, Richard; Smith, Sandra; Hall, Deborah A.

2015-01-01

Objectives: In many countries including the United Kingdom, hearing aids are a first line of audiologic intervention for many people with tinnitus and aidable hearing loss. Nevertheless, there is a lack of high quality evidence to support that they are of benefit for tinnitus, and wide variability in their use in clinical practice especially for people with mild hearing loss. The aim of this study was to identify a consensus among a sample of UK clinicians on the criteria for hearing aid candidature and clinical practice in fitting hearing aids specifically for mild hearing loss with and without tinnitus. This will allow professionals to establish clinical benchmarks and to gauge their practice with that used elsewhere. Design: The Delphi technique, a systematic methodology that seeks consensus amongst experts through consultation using a series of iterative questionnaires, was used. A three-round Delphi survey explored clinical consensus among a panel of 29 UK hearing professionals. The authors measured panel agreement on 115 statements covering: (i) general factors affecting the decision to fit hearing aids, (ii) protocol-driven factors affecting the decision to fit hearing aids, (iii) general practice, and (iv) clinical observations. Consensus was defined as a priori ≥70% agreement across the panel. Results: Consensus was reached for 58 of the 115 statements. The broad areas of consensus were around factors important to consider when fitting hearing aids; hearing aid technology/features offered; and important clinical assessment to verify hearing aid fit (agreement of 70% or more). For patients with mild hearing loss, the greatest priority was given by clinicians to patient-centered criteria for fitting hearing aids: hearing difficulties, motivation to wear hearing aids, and impact of hearing loss on quality of life (chosen as top five by at least 64% of panelists). Objective measures were given a lower priority: degree of hearing loss and shape of the audiogram (chosen as top five by less than half of panelists). Areas where consensus was not reached were related to the use of questionnaires to predict and verify hearing aid benefit for both hearing and tinnitus; audiometric criteria for fitting hearing aids; and safety of using loud sounds when verifying hearing aid fitting when the patient has tinnitus (agreement of <70%). Conclusions: The authors identified practices that are considered important when recommending or fitting hearing aid for a patient with tinnitus. More importantly perhaps, they identified practical issues where there are divided opinions. Their findings inform the design of clinical trials and open up debate on the potential impact of practice differences on patient outcomes. PMID:25587668

Basic concepts and architectural details of the Delphi trigger system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bocci, V.; Booth, P.S.L.; Bozzo, M.

1995-08-01

Delphi (DEtector with Lepton, Photon and Hadron Identification) is one of the four experiments of the LEP (Large Electron Positron) collider at CERN. The detector is laid out to provide a nearly 4 {pi} coverage for charged particle tracking, electromagnetic, hadronic calorimetry and extended particle identification. The trigger system consists of four levels. The first two are synchronous with the BCO (Beam Cross Over) and rely on hardwired control units, while the last two are performed asynchronously with respect to the BCO and are driven by the Delphi host computers. The aim of this paper is to give a comprehensivemore » global view of the trigger system architecture, presenting in detail the first two levels, their various hardware components and the latest modifications introduced in order to improve their performance and make more user friendly the whole software user interface.« less

Development of a Child Abuse Checklist to Evaluate Prehospital Provider Performance.

PubMed

Alphonso, Aimee; Auerbach, Marc; Bechtel, Kirsten; Bilodeau, Kyle; Gawel, Marcie; Koziel, Jeannette; Whitfill, Travis; Tiyyagura, Gunjan Kamdar

2017-01-01

To develop and provide validity evidence for a performance checklist to evaluate the child abuse screening behaviors of prehospital providers. Checklist Development: We developed the first iteration of the checklist after review of the relevant literature and on the basis of the authors' clinical experience. Next, a panel of six content experts participated in three rounds of Delphi review to reach consensus on the final checklist items. Checklist Validation: Twenty-eight emergency medical services (EMS) providers (16 EMT-Basics, 12 EMT-Paramedics) participated in a standardized simulated case of physical child abuse to an infant followed by one-on-one semi-structured qualitative interviews. Three reviewers scored the videotaped performance using the final checklist. Light's kappa and Cronbach's alpha were calculated to assess inter-rater reliability (IRR) and internal consistency, respectively. The correlation of successful child abuse screening with checklist task completion and with participant characteristics were compared using Pearson's chi squared test to gather evidence for construct validity. The Delphi review process resulted in a final checklist that included 24 items classified with trichotomous scoring (done, not done, or not applicable). The overall IRR of the three raters was 0.70 using Light's kappa, indicating substantial agreement. Internal consistency of the checklist was low, with an overall Cronbach's alpha of 0.61. Of 28 participants, only 14 (50%) successfully screened for child abuse in simulation. Participants who successfully screened for child abuse did not differ significantly from those who failed to screen in terms of training level, past experience with child abuse reporting, or self-reported confidence in detecting child abuse (all p > 0.30). Of all 24 tasks, only the task of exposing the infant significantly correlated with successful detection of child abuse (p < 0.05). We developed a child abuse checklist that demonstrated strong content validity and substantial inter-rater reliability, but successful item completion did not correlate with other markers of provider experience. The validated instrument has important potential for training, continuing education, and research for prehospital providers at all levels of training.

[Construction of a physiological aging scale for healthy people based on a modified Delphi method].

PubMed

Long, Yao; Zhou, Xuan; Deng, Pengfei; Liao, Xiong; Wu, Lei; Zhou, Jianming; Huang, Helang

2016-04-01

To build a physiological aging scale for healthy people.
 We collected age-related physiologic items through literature screening and expert interview. Two rounds of Delphi were implemented. The importance, feasibility and the degree of authority for the physiological index system were graded. Using analytic hierarchy process, we determined the weight of dimensions and items.
 Using Delphy mothod, 17 physiological and other professional experts offered the results as follow: coefficient of expert authorities Cr was 0.86±0.03, coordination coefficients for the first and second round were 0.264(χ2=229.691, P<0.001) and 0.293(χ2=228.474，P<0.001), respectively. The consistency was good. The aging scale for healthy people included 3 dimensions, namely physical form, feeling movement and functional status. Each dimension had 8 items. The weight coefficients for the 3 dimensions were 0.54, 0.16, and 0.30, respectively. The Cronbach's α coefficient of the scale was 0.893, the reliability was 0.796, and the variance of the common factor was 58.17%.
 The improved Delphi method or physiological aging scale is satisfied, which can provide reference for the evaluation of aging.

Development of a core outcome set for effectiveness trials aimed at optimising prescribing in older adults in care homes.

PubMed

Millar, Anna N; Daffu-O'Reilly, Amrit; Hughes, Carmel M; Alldred, David P; Barton, Garry; Bond, Christine M; Desborough, James A; Myint, Phyo K; Holland, Richard; Poland, Fiona M; Wright, David

2017-04-12

Prescribing medicines for older adults in care homes is known to be sub-optimal. Whilst trials testing interventions to optimise prescribing in this setting have been published, heterogeneity in outcome reporting has hindered comparison of interventions, thus limiting evidence synthesis. The aim of this study was to develop a core outcome set (COS), a list of outcomes which should be measured and reported, as a minimum, for all effectiveness trials involving optimising prescribing in care homes. The COS was developed as part of the Care Homes Independent Pharmacist Prescribing Study (CHIPPS). A long-list of outcomes was identified through a review of published literature and stakeholder input. Outcomes were reviewed and refined prior to entering a two-round online Delphi exercise and then distributed via a web link to the CHIPPS Management Team, a multidisciplinary team including pharmacists, doctors and Patient Public Involvement representatives (amongst others), who comprised the Delphi panel. The Delphi panellists (n = 19) rated the importance of outcomes on a 9-point Likert scale from 1 (not important) to 9 (critically important). Consensus for an outcome being included in the COS was defined as ≥70% participants scoring 7-9 and <15% scoring 1-3. Exclusion was defined as ≥70% scoring 1-3 and <15% 7-9. Individual and group scores were fed back to participants alongside the second questionnaire round, which included outcomes for which no consensus had been achieved. A long-list of 63 potential outcomes was identified. Refinement of this long-list of outcomes resulted in 29 outcomes, which were included in the Delphi questionnaire (round 1). Following both rounds of the Delphi exercise, 13 outcomes (organised into seven overarching domains: medication appropriateness, adverse drug events, prescribing errors, falls, quality of life, all-cause mortality and admissions to hospital (and associated costs)) met the criteria for inclusion in the final COS. We have developed a COS for effectiveness trials aimed at optimising prescribing in older adults in care homes using robust methodology. Widespread adoption of this COS will facilitate evidence synthesis between trials. Future work should focus on evaluating appropriate tools for these key outcomes to further reduce heterogeneity in outcome measurement in this context.

Development of key performance indicators for prehospital emergency care.

PubMed

Murphy, Adrian; Wakai, Abel; Walsh, Cathal; Cummins, Fergal; O'Sullivan, Ronan

2016-04-01

Key performance indicators (KPIs) are used to monitor and evaluate critical areas of clinical and support functions that influence patient outcome. Traditional prehospital emergency care performance monitoring has focused solely on response time metrics. The landscape of emergency care delivery in Ireland is in the process of significant national reconfiguration. The development of KPIs is therefore considered one of the key priorities in prehospital research. The aim of this study was to develop a suite of KPIs for prehospital emergency care in Ireland. A systematic literature review of prehospital care performance measurement was undertaken followed by a three-round Delphi consensus process facilitated by a broad-based multidisciplinary group of panellists. The consensus process was conducted between June 2012 and October 2013. Each candidate indicator on the Delphi survey questionnaire was rated using a 5-point Likert-type rating scale. Agreement was defined as at least 70% of responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using descriptive statistics. Sensitivity of the ratings was examined for robustness by bootstrapping the original sample. Of the 78 citations identified by the systematic review, 5 relevant publications were used to select candidate indicators for the Delphi round 1 questionnaire. Response rates in Delphi rounds 1 and 2 were 89% and 83%, respectively. Following the consensus development conference, 101 KPIs reached consensus. Based on the Donabedian framework for quality-of-care indicators, 7 of the KPIs which reached agreement were structure KPIs, 74 were process KPIs and 20 were outcome KPIs. The highest ranked indicator was a process KPI ('Direct transport of ST-elevation myocardial infarction patients to a primary percutaneous intervention (PCI)-capable facility for ECG to PCI time <90 min'). Improving the quality of prehospital care requires the development and implementation of performance measurement using scientifically valid and reliable KPIs. Employing a Delphi panel of key multidisciplinary Emergency Medical Service stakeholders, it was feasible to develop a suite of 101 KPIs for performance monitoring of prehospital emergency care in Ireland. This suite of KPIs may contribute to a framework for achieving safer, better care in the prehospital environment. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Pathway to Prevention of Nosocomial Clostridium difficile Infection.

PubMed

Goldstein, Ellie J C; Johnson, Stuart; Maziade, Pierre-Jean; McFarland, Lynne V; Trick, William; Dresser, Linda; Millette, Mathieu; Mazloum, Hadi; Low, Donald E

2015-05-15

To address the significant morbidity and mortality rates associated with nosocomial Clostridium difficile-associated diarrhea (CDAD), a series of recommendations and a pathway to prevention were developed. An expert panel of infectious disease (ID) specialists participated in a modified Delphi process with specific objectives: (1) conduct a review for CDAD and prevention; (2) develop statements based upon panel members' opinions; (3) hold a panel meeting during the 2012 IDWeek; and (4) review the final recommendations and prevention pathway prior to submission for publication. The panel voted on (1) antibiotic stewardship (7 of 8 panelists); (2) reduction of other potentially modifiable risk factors (variable); (3) utilization of specific probiotics to prevent C. difficile overgrowth (8/8); (4) staff education regarding CDAD preventive measures (8/8); (5) appropriate hand hygiene for everyone (7/8); (6) environmental cleaning (8/8); (7) medical equipment disinfection (7/8); (8) early detection of CDAD in symptomatic patients (7/8); (9) usage of protective clothing/gloves (8/8); (10) proper measures during outbreak (8/8); and (11) surveillance to monitor efficacy data of preventive measures (8/8). The panel members agreed with 11 of 17 recommendations presented. The additional recommendations by the panel were proton pump inhibitor use as a risk factor and the use of adjunctive therapy with specific probiotic, as it was approved by Health Canada for the risk reduction of CDAD in hospitalized patients. © The Author 2015. Published by Oxford University Press on behalf of the Infectious Diseases Society of America. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

A protocol for the development of a critical thinking assessment tool for nurses using a Delphi technique.

PubMed

Jacob, Elisabeth; Duffield, Christine; Jacob, Darren

2017-08-01

The aim of this study was to develop an assessment tool to measure the critical thinking ability of nurses. As an increasing number of complex patients are admitted to hospitals, the importance of nurses recognizing changes in health status and picking up on deterioration is more important. To detect early signs of complication requires critical thinking skills. Registered Nurses are expected to commence their clinical careers with the necessary critical thinking skills to ensure safe nursing practice. Currently, there is no published tool to assess critical thinking skills which is context specific to Australian nurses. A modified Delphi study will be used for the project. This study will develop a series of unfolding case scenarios using national health data with multiple-choice questions to assess critical thinking. Face validity of the scenarios will be determined by an expert reference group of clinical and academic nurses. A Delphi study will determine the answers to scenario questions. Panel members will be expert clinicians and educators from two states in Australia. Rasch analysis of the questionnaire will assess validity and reliability of the tool. Funding for the study and Research Ethics Committee approval were obtained in March and November 2016, respectively. Patient outcomes and safety are directly linked to nurses' critical thinking skills. This study will develop an assessment tool to provide a standardized method of measuring nurses' critical thinking skills across Australia. This will provide healthcare providers with greater confidence in the critical thinking level of graduate Registered Nurses. © 2017 John Wiley & Sons Ltd.

Design and validation of key text messages (Tonsil-Text-To-Me) to improve parent and child perioperative tonsillectomy experience: A modified Delphi study.

PubMed

Song, Jin Soo A; Wozney, Lori; Chorney, Jill; Ishman, Stacey L; Hong, Paul

2017-11-01

Parents can struggle while providing perioperative tonsillectomy care for their children at home. Short message service (SMS) technology is an accessible and direct modality to communicate timely, evidence-based recommendations to parents across the perioperative period. This study focused on validating a SMS protocol, Tonsil-Text-To-Me (TTTM), for parents of children undergoing tonsillectomy. This study used a modified Delphi expert consensus method. Participants were an international sample of 27 clinicians/researchers. Participants rated level of agreement with recommendations across seven perioperative domains, derived systematically from scientific and lay literature. A priori consensus analysis was conducted using threshold criterion. A multidisciplinary team of local clinicians were also individually interviewed to consolidate text messages and implement recurrent suggestions. In the modified Delphi panel, 30 statements reached threshold agreement (>3.0 of 4.0); recommendations surrounding diet (3.87) and hygiene (3.83) had the highest level of consensus, while recommendations regarding activity (3.42) and non-pharmacologic pain management (3.55) had the lowest consensus. The 30 statements reconfigured into 12 concise text messages. After further interviews with local clinicians, 14 final text messages were included in the SMS protocol to be sent two weeks preoperatively to one week postoperatively. This study illustrates the development of TTTM which is designed to deliver key sequential text messages at the optimal time during the perioperative setting to parents caring for their children who are undergoing tonsillectomy. Copyright © 2017 Elsevier B.V. All rights reserved.

Consensus in controversy: The modified Delphi method applied to Gynecologic Oncology practice.

PubMed

Cohn, David E; Havrilesky, Laura J; Osann, Kathryn; Lipscomb, Joseph; Hsieh, Susie; Walker, Joan L; Wright, Alexi A; Alvarez, Ronald D; Karlan, Beth Y; Bristow, Robert E; DiSilvestro, Paul A; Wakabayashi, Mark T; Morgan, Robert; Mukamel, Dana B; Wenzel, Lari

2015-09-01

To determine the degree of consensus regarding the probabilities of outcomes associated with IP/IV and IV chemotherapy. A survey was administered to an expert panel using the Delphi method. Ten ovarian cancer experts were asked to estimate outcomes for patients receiving IP/IV or IV chemotherapy. The clinical estimates were: 1) probability of completing six cycles of chemotherapy, 2) probability of surviving five years, 3) median survival, and 4) probability of ER/hospital visits during treatment. Estimates for two patients, one with a low comorbidity index (patient 1) and the other with a moderate index (patient 2), were included. The survey was administered in three rounds, and panelists could revise their subsequent responses based on review of the anonymous opinions of their peers. The ranges were smaller for IV compared with IP/IV therapy. Ranges decreased with each round. Consensus converged around outcomes related to IP/IV chemotherapy for: 1) completion of 6 cycles of therapy (type 1 patient, 62%, type 2 patient, 43%); 2) percentage of patients surviving 5 years (type 1 patient, 66%, type 2 patient, 47%); and 3) median survival (type 1 patient, 83 months, type 2 patient, 58 months). The group required three rounds to achieve consensus on the probabilities of ER/hospital visits (type 1 patient, 24%, type 2 patient, 35%). Initial estimates of survival and adverse events associated with IP/IV chemotherapy differ among experts. The Delphi process works to build consensus and may be a pragmatic tool to inform patients of their expected outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

Outcomes from the Delphi process of the Thoracic Robotic Curriculum Development Committee.

PubMed

Veronesi, Giulia; Dorn, Patrick; Dunning, Joel; Cardillo, Giuseppe; Schmid, Ralph A; Collins, Justin; Baste, Jean-Marc; Limmer, Stefan; Shahin, Ghada M M; Egberts, Jan-Hendrik; Pardolesi, Alessandro; Meacci, Elisa; Stamenkovic, Sasha; Casali, Gianluca; Rueckert, Jens C; Taurchini, Mauro; Santelmo, Nicola; Melfi, Franca; Toker, Alper

2018-06-01

As the adoption of robotic procedures becomes more widespread, additional risk related to the learning curve can be expected. This article reports the results of a Delphi process to define procedures to optimize robotic training of thoracic surgeons and to promote safe performance of established robotic interventions as, for example, lung cancer and thymoma surgery. In June 2016, a working panel was spontaneously created by members of the European Society of Thoracic Surgeons (ESTS) and European Association for Cardio-Thoracic Surgery (EACTS) with a specialist interest in robotic thoracic surgery and/or surgical training. An e-consensus-finding exercise using the Delphi methodology was applied requiring 80% agreement to reach consensus on each question. Repeated iterations of anonymous voting continued over 3 rounds. Agreement was reached on many points: a standardized robotic training curriculum for robotic thoracic surgery should be divided into clearly defined sections as a staged learning pathway; the basic robotic curriculum should include a baseline evaluation, an e-learning module, a simulation-based training (including virtual reality simulation, Dry lab and Wet lab) and a robotic theatre (bedside) observation. Advanced robotic training should include e-learning on index procedures (right upper lobe) with video demonstration, access to video library of robotic procedures, simulation training, modular console training to index procedure, transition to full-procedure training with a proctor and final evaluation of the submitted video to certified independent examiners. Agreement was reached on a large number of questions to optimize and standardize training and education of thoracic surgeons in robotic activity. The production of the content of the learning material is ongoing.

Developing a clinical pathway for the identification and management of anxiety and depression in adult cancer patients: an online Delphi consensus process.

PubMed

Shaw, Joanne M; Price, Melanie A; Clayton, Josephine M; Grimison, Peter; Shaw, Tim; Rankin, Nicole; Butow, Phyllis N

2016-01-01

People with cancer and their families experience high levels of psychological morbidity. However, many cancer services do not routinely screen patients for anxiety and depression, and there are no standardized clinical referral pathways. This study aimed to establish consensus on elements of a draft clinical pathway tailored to the Australian context. A two-round Delphi study was conducted to gain consensus among Australian oncology and psycho-oncology clinicians about the validity of 39 items that form the basis of a clinical pathway that includes screening, assessment, referral and stepped care management of anxiety and depression in the context of cancer. The expert panel comprised 87 multidisciplinary clinician members of the Australian Psycho-oncology Co-operative Research Group (PoCoG). Respondents rated their level of agreement with each statement on a 5-point Likert scale. Consensus was defined as >80% of respondents scoring within 2 points on the Likert scale. Consensus was reached for 21 of 39 items, and a further 15 items approached consensus except for specific contextual factors, after two Delphi rounds. Formal screening for anxiety and depression, a stepped care model of management and recommendations for inclusion of length of treatment and time to review were endorsed. Consensus was not reached on items related to roles and responsibilities, particularly those not applicable across cancer settings. This study identified a core set of evidence- and consensus-based principles considered essential to a stepped care model of care incorporating identification, referral and management of anxiety and depression in adult cancer patients.

Treatment patterns, health care utilization, and costs of ovarian cancer in Central and Eastern Europe using a Delphi panel based on a retrospective chart review.

PubMed

Kim, Kun; Hernlund, Emma; Hernadi, Zoltán; Révész, János; Pete, Imre; Szánthó, András; Bodnar, Lubomir; Madry, Rodoslaw; Timorek-Lemieszczuk, Agnieszka; Bozanovic, Tatjana; Vasovic, Suzana; Tomasevic, Zorica; Zivaljevic, Milica; Pazin, Vladimir; Minárik, Tomáš; Garanová, Hana; Helpianska, Lýdia; Justo, Nahila

2013-06-01

Despite the considerable disease burden of ovarian cancer, there were no cost studies in Central and Eastern Europe. This study aimed to describe treatment patterns, health care utilization, and costs associated with treating ovarian cancer in Hungary, Poland, Serbia, and Slovakia. Overall clinical practice for management of epithelial ovarian cancer was investigated through a 3-round Delphi panel. Experts completed a survey based on the chart review (n = 1542). The survey was developed based on clinical guidelines and the International Federation of Gynecology and Obstetrics Annual Report. Means, ranges, and outlier values were discussed with the experts during a telephone interview. Finally, consensus estimates were obtained in face-to-face workshops. Based on these results, overall cost of ovarian cancer was estimated using a Markov model. The patients included in the chart review were followed up from presurgical diagnosis and in each phase of treatment, that is, surgical staging and primary surgery, chemotherapy and chemotherapy monitoring, follow-up, and palliative care. The 5-year overall cost per patient was €14,100 to €16,300 in Hungary, €14,600 to €15,800 in Poland, €7600 to €8100 in Serbia, and €12,400 to €14,500 in Slovakia. The main components were chemotherapy-associated costs (68%-74% of the total cost), followed by cost of primary treatment with surgery (15%-21%) and palliative care (3%-10%). Patients with ovarian cancer consume considerable health care resources and incur substantial costs in Central and Eastern Europe. These findings may prove useful for clinicians and decision makers in understanding the economic implications of managing ovarian cancer in Central and Eastern Europe and the need for innovative therapies.

Criteria required for an acceptable point-of-care test for UTI detection: Obtaining consensus using the Delphi technique

PubMed Central

Kearney, Paddy; Stafford, Bob; Gormley, Gerard J.; Crockard, Martin A.; Gilpin, Deirdre F.

2018-01-01

Background Urinary Tract Infections (UTIs) are common bacterial infections, second only to respiratory tract infections and particularly prevalent within primary care. Conventional detection of UTIs is culture, however, return of results can take between 24 and 72 hours. The introduction of a point of care (POC) test would allow for more timely identification of UTIs, facilitating improved, targeted treatment. This study aimed to obtain consensus on the criteria required for a POC UTI test, to meet patient need within primary care. Methods Criteria for consideration were compiled by the research team. These criteria were validated through a two-round Delphi process, utilising an expert panel of healthcare professionals from across Europe and United States of America. Using web-based questionnaires, panellists recorded their level of agreement with each criterion based on a 5-point Likert Scale, with space for comments. Using median response, interquartile range and comments provided, criteria were accepted/rejected/revised depending on pre-agreed cut-off scores. Results The first round questionnaire presented thirty-three criteria to the panel, of which 22 were accepted. Consensus was not achieved for the remaining 11 criteria. Following response review, one criterion was removed, while after revision, the remaining 10 criteria entered the second round. Of these, four were subsequently accepted, resulting in 26 criteria considered appropriate for a POC test to detect urinary infections. Conclusion This study generated an approved set of criteria for a POC test to detect urinary infections. Criteria acceptance and comments provided by the healthcare professionals also supports the development of a multiplex point of care UTI test. PMID:29879161

Adolescence transitional care in neurogenic detrusor overactivity and the use of OnabotulinumtoxinA: A clinical algorithm from an Italian consensus statement.

PubMed

Palleschi, Giovanni; Mosiello, Giovanni; Iacovelli, Valerio; Musco, Stefania; Del Popolo, Giulio; Giannantoni, Antonella; Carbone, Antonio; Carone, Roberto; Tubaro, Andrea; De Gennaro, Mario; Marte, Antonio; Finazzi Agrò, Enrico

2018-03-01

OnabotulinumtoxinA (onaBNTa) for treating neurogenic detrusor overactivity (NDO) is widely used after its regulatory approval in adults. Although the administration of onaBNTa is still considered off-label in children, data have already been reported on its efficacy and safety. Nowadays, there is a lack of standardized protocols for treatment of NDO with onaBNTa in adolescent patients in their transition from the childhood to the adult age. With the aim to address this issue a consensus panel was obtained. A panel of leading urologists and urogynaecologists skilled in functional urology, neuro-urology, urogynaecology, and pediatric urology participated in a consensus-forming project using a Delphi method to reach national consensus on NDO-onaBNTa treatment in adolescence transitional care. In total, 11 experts participated. All panelists participated in the four phases of the consensus process. Consensus was reached if ≥70% of the experts agreed on recommendations. To facilitate a common understanding among all experts, a face-to-face consensus meeting was held in Rome in march 2015 and then with a follow-up teleconference in march 2017. By the end of the Delphi process, formal consensus was achieved for 100% of the items and an algorithm was then developed. This manuscript represents the first report on the onaBNTa in adolescents. Young adults should be treated as a distinct sub-population in policy, planning, programming, and research, as strongly sustained by national public health care. This consensus and the algorithm could support multidisciplinary communication, reduce the extent of variations in clinical practice and optimize clinical decision making. © 2017 Wiley Periodicals, Inc.

Ocular surface disease incidence in patients with open-angle glaucoma.

PubMed

Radenković, Marija; Stanković-Babić, Gordana; Jovanović, Predrag; Djordjević-Jocić, Jasmina; Trenkić-Božinović, Marija

2016-01-01

Ocular surface disease (OSD) is a multifactorial disease of the tears and ocular surface that results in symptoms of discomfort, visual disturbances, tear film instability with potential damage to the ocular surface, accompanied by increased tear film osmolarity and inflammation of the ocular surface. It is a consequence of disrupted homeostasis of lacrimal functional unit. The main pathogenetic mechanism stems from tear hyperosmolarity and tear film instability. The etiological classification is hyposecretory (Sy-Sjögren and non-Sjögren) and evaporative (extrinsic and intrinsic) form. Delphi panel classification grades disease stages. Antiglaucoma topical therapy causes exacerbation or occurrence of symptoms of dry eye due to main ingredients or preservatives (benzalkonium chloride – BAK), which are dose- and time-dependent. BAK reduces the stability of the lipid layer of tears, the number of goblet cells, induces apoptosis and inflammatory infiltration. The aim of this study was the analysis of the OSD incidence in open-angle glaucoma patients caused by topical medicamentous therapy. Retrospective analysis of examined patients with open-angle glaucoma was used. Increased incidence of moderate and advanced OSD Index degrees in the group of primary open-angle glaucoma (POAG) and pseudoexfoliative glaucoma. According to the Delphi Panel Scale the most common grade is IIb (POAG and pseudoexfoliative glaucoma). Evaporative form of OSD prevailed in all treatment groups. High percentage of dry eye in patients with higher concentrations of preservatives applied was noticed. OSD should be timely diagnosed and treated. Dry eye has an impact on surgical outcome and postoperative visual acuity, and in order to improve patient compliance and quality of life, symptoms of dry eye should be addressed and medications with lower concentrations of preservatives should be applied.

The Global Spine Care Initiative: a consensus process to develop and validate a stratification scheme for surgical care of spinal disorders as a guide for improved resource utilization in low- and middle-income communities.

PubMed

Acaroğlu, Emre; Mmopelwa, Tiro; Yüksel, Selcen; Ayhan, Selim; Nordin, Margareta; Randhawa, Kristi; Haldeman, Scott

2017-10-16

The purpose of this study was to develop a stratification scheme for surgical spinal care to serve as a framework for referrals and distribution of patients with spinal disorders. We used a modified Delphi process. A literature search identified experts for the consensus panel and the panel was expanded by inviting spine surgeons known to be global opinion leaders. After creating a seed document of five hierarchical levels of surgical care, a four-step modified Delphi process (question validation, collection of factors, evaluation of factors, re-evaluation of factors) was performed. Of 78 invited experts, 19 participated in round 1, and of the 19, 14 participated in 2, and 12 in 3 and 4. Consensus was fairly heterogeneous for levels of care 2-4 (moderate resources). Only simple assessment methods based on the clinical skills of the medical personnel were considered feasible and safe in low-resource settings. Diagnosis, staging, and treatment were deemed feasible and safe in a specialized spine center. Accurate diagnostic workup was deemed feasible and safe for lower levels of care complexity (from level 3 upwards) compared to non-invasive procedures (level 4) and the full range of invasive procedures (level 5). This study introduces a five-level stratification scheme for the surgical care of spinal disorders. This stratification may provide input into the Global Spine Care Initiative care pathway that will be applied in medically underserved areas and low- and middle-income countries. These slides can be retrieved under Electronic Supplementary Material.

Development and Measurement of Guidelines-Based Quality Indicators of Caesarean Section Care in the Netherlands: A RAND-Modified Delphi Procedure and Retrospective Medical Chart Review

PubMed Central

de Boer, Karin; Burggraaf, Henriëtte; Derks, Jan B.; van Dijk, Det; van Dillen, Jeroen; Dirksen, Carmen D.; Duvekot, Johannes J.; Franx, Arie; Hasaart, Tom H. M.; Huisjes, Anjoke J. M.; Kolkman, Diny; Kwee, Anneke; Mol, Ben W.; van Pampus, Mariëlle G.; de Roon-Immerzeel, Alieke; van Roosmalen, Jos J. M.; Roumen, Frans J. M. E.; Smid-Koopman, Ellen; Spaans, Wilbert A.; Visser, Harry; van Wijngaarden, Wim J.; Willekes, Christine; Wouters, Maurice G. A. J.

2016-01-01

Background There is an ongoing discussion on the rising CS rate worldwide. Suboptimal guideline adherence may be an important contributor to this rise. Before improvement of care can be established, optimal CS care in different settings has to be defined. This study aimed to develop and measure quality indicators to determine guideline adherence and identify target groups for improvement of care with direct effect on caesarean section (CS) rates. Method Eighteen obstetricians and midwives participated in an expert panel for systematic CS quality indicator development according to the RAND-modified Delphi method. A multi-center study was performed and medical charts of 1024 women with a CS and a stratified and weighted randomly selected group of 1036 women with a vaginal delivery were analysed. Quality indicator frequency and adherence were scored in 2060 women with a CS or vaginal delivery. Results The expert panel developed 16 indicators on planned CS and 11 indicators on unplanned CS. Indicator adherence was calculated, defined as the number of women in a specific obstetrical situation in which care was performed as recommended in both planned and unplanned CS settings. The most frequently occurring obstetrical situations with low indicator adherence were: 1) suspected fetal distress (frequency 17%, adherence 46%), 2) non-progressive labour (frequency 12%, CS performed too early in over 75%), 3) continuous support during labour (frequency 88%, adherence 37%) and 4) previous CS (frequency 12%), with adequate counselling in 15%. Conclusions We identified four concrete target groups for improvement of obstetrical care, which can be used as a starting point to reduce CS rates worldwide. PMID:26783742

A European classification of services for long-term care—the EU-project eDESDE-LTC

PubMed Central

Weber, Germain; Brehmer, Barbara; Zeilinger, Elisabeth; Salvador-Carulla, Luis

2009-01-01

Purpose and theory The eDESDE-LTC project aims at developing an operational system for coding, mapping and comparing services for long-term care (LTC) across EU. The projects strategy is to improve EU listing and access to relevant sources of healthcare information via development of SEMANTIC INTER-OPERABILITY in eHEALTH (coding and listing of services for LTC); to increase access to relevant sources of information on LTC services, and to improve linkages between national and regional websites; to foster cooperation with international organizations (OECD). Methods This operational system will include a standard classification of main types of care for persons with LTC needs and an instrument for mapping and standard description of services. These instruments are based on previous classification systems for mental health services (ESMS), disabilities services (DESDE) and ageing services (DESDAE). A Delphi panel made by seven partners developed a DESDE-LTC beta version, which was translated into six languages. The feasibility of DESDE-LTC is tested in six countries using national focal groups. Then the final version will be developed by the Delphi panel, a webpage, training material and course will be carried out. Results and conclusions The eDESDE-LTC system will be piloted in two EU countries (Spain and Bulgaria). Evaluation will focus primarily on usability and impact analysis. Discussion The added value of this project is related to the right of “having access to high-quality healthcare when and where it is needed” by EU citizens. Due to semantic variability and service complexity, existing national listings of services do not provide an adequate framework for patient mobility.

Mammographic image quality in relation to positioning of the breast: A multicentre international evaluation of the assessment systems currently used, to provide an evidence base for establishing a standardised method of assessment.

PubMed

Taylor, K; Parashar, D; Bouverat, G; Poulos, A; Gullien, R; Stewart, E; Aarre, R; Crystal, P; Wallis, M

2017-11-01

Optimum mammography positioning technique is necessary to maximise cancer detection. Current criteria for mammography appraisal lack reliability and validity with a need to develop a more objective system. We aimed to establish current international practice in assessing image quality (IQ), of screening mammograms then develop and validate a reproducible assessment tool. A questionnaire sent to centres in countries undertaking population screening identified practice, participants for an expert panel (EP) of radiologists/radiographers and a testing panel (TP) of radiographers. The EP developed category criteria and descriptors using a modified Delphi process to agree definitions. The EP scored 12 screening mammograms to test agreement then a main set of 178 cases. Weighted scores were derived for each descriptor enabling calculation of numerical parameters for each new category. The TP then scored the main set. Statistical analysis included ANOVA, t-tests and Kendall's coefficient. 11 centres in 8 countries responded forming an EP of 7 members and TP of 44 members. The EP showed moderate agreement when the scoring the mini test set W = 0.50 p < 0.001 and the main set W = 0.55 p < 0.001, 'posterior nipple line' being the most difficult descriptor. The weighted total scores differentiated the 4 new categories Perfect, Good, Adequate and Inadequate (p < 0.001). We have developed an assessment tool by Delphi consensus and weighted consensus criteria. We have successfully tabulated a range of numerical scores for each new category providing the first validated and reproducible mammography IQ scoring system. Copyright © 2017 The College of Radiographers. Published by Elsevier Ltd. All rights reserved.

The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study

PubMed Central

Gagliardi, Diana; Rondinone, Bruna M; Mirabile, Marco; Buresti, Giuliana; Ellwood, Peter; Hery, Michel; Paszkiewicz, Peter; Valenti, Antonio; Iavicoli, Sergio

2017-01-01

Objectives This study, developed within the frame of the Partnership for European Research on Occupational Safety and Health joint research activities and based on the frame designed by the 2013 European Agency for Safety and Health at Work (EU-OSHA) study, is the first example of using the points of view of European occupational safety and health (OSH) researchers. The objective is to identify priorities for OSH research that may contribute to the achievement of present and future sustainable growth objectives set by the European strategies. Methods The study was carried out using a modified Delphi method with a two-round survey. Each round involved a panel of about 110 researchers representing the network member institutes was selected according to specific criteria, including the ownership of research expertise in at least one of the four macroareas identified by the reference report developed by EU-OSHA in 2013. Results The study identified some innovative research topics (for example, ‘Emerging technological devices’ and ‘OSH consequences of markets integration’) and research priorities (ie, crowdsourcing, e-work, zero-hours contracts) that are not reflected in previous studies of this nature. The absence of any reference to violence and harassment at work among the researchers’ proposals is a major difference from previous similar studies, while topics related to gender issues and electromagnetic fields show a lower importance. Conclusions The innovative design of a research priorities identification process, which takes advantage of a large, representative and qualified panel of European researchers allowed the definition of a number of research priorities able to support the inclusion of innovative OSH research issues in the scope of the next European research agenda. PMID:28645965

Recommendations for the evaluation and management of patients with rheumatic autoimmune and inflammatory diseases during the reproductive age, pregnancy, postpartum and breastfeeding.

PubMed

Martínez López, Juan Antonio; García Vivar, M Luz; Cáliz, Rafael; Freire, Mercedes; Galindo, María; Hernández, Maria Victoria; López Longo, Francisco Javier; Martínez Taboada, Víctor; Pego Reigosa, Jose María; Rubio, Esteban; Trujillo, Elisa; Vela-Casasempere, Paloma

To develop recommendations on the evaluation and management of patients with rheumatic autoimmune and inflammatory diseases during the reproductive age, pregnancy, post-partum and breastfeeding based on the best evidence and experience. Recommendations were generated using nominal group and Delphi techniques. An expert panel of 12 rheumatologists was established. A systematic literature review and a narrative review (websites, clinical guidelines and other relevant documentation) were performed and presented to the panel in its 1 st meeting to be discussed and to help define recommendations. A first draft of recommendations was generated and circulated for comments and wording refinement. A national survey analyzing different aspects of this topic was undertaken separately, followed by a Delphi process (2 rounds). Agreement with each recommendation was ranked on a scale of 1 (total disagreement) to 10 (total agreement), and was considered to be achieved if at least 70% voted≥7. The level of evidence and grade of recommendation were assessed using the Oxford Centre for Evidence-based Medicine Levels of Evidence. A total of 14 recommendations were generated for the preconception period (oral and hormonal contraception, reproductive techniques), pregnancy (planning, treatment and follow-up), and breastfeeding (treatment and follow-up). High-risk situations such as lupus or antiphospholipid syndrome were included. A consensus>90% was reached for all but one recommendation. These recommendations are intended to provide rheumatologists, patients, families and other stakeholders with a consensus on the evaluation and management of patients with autoimmune and inflammatory diseases during the reproductive age, pregnancy, postpartum and breastfeeding. Copyright © 2016 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Setting priorities for surveillance, prevention, and control of zoonoses in Bogotá, Colombia.

PubMed

Cediel, Natalia; Villamil, Luis Carlos; Romero, Jaime; Renteria, Libardo; De Meneghi, Daniele

2013-05-01

To establish priorities for zoonoses surveillance, prevention, and control in Bogotá, Colombia. A Delphi panel of experts in veterinary and human medicine was conducted using a validated prioritization method to assess the importance of 32 selected zoonoses. This exercise was complemented by a questionnaire survey, using the knowledge, attitudes, and practices (KAP) methodology, administered in 19 districts of Bogotá from September 2009 to April 2010 to an at-risk population (workers at veterinary clinics; pet shops; butcher shops; and traditional food markets that sell poultry, meat, cheese, and eggs). A risk indicator based on level of knowledge about zoonoses was constructed using categorical principal component and logistic regression analyses. Twelve experts participated in the Delphi panel. The diseases scored as highest priority were: influenza A(H1N1), salmonellosis, Escherichia coli infection, leptospirosis, and rabies. The diseases scored as lowest priority were: ancylostomiasis, scabies, ringworm, and trichinellosis. A total of 535 questionnaires were collected and analyzed. Respondents claimed to have had scabies (21%), fungi (8%), brucellosis (8%), and pulicosis (8%). Workers with the most limited knowledge on zoonoses and therefore the highest health risk were those who 1) did not have a professional education, 2) had limited or no zoonoses prevention training, and 3) worked in Usme, Bosa, or Ciudad Bolívar districts. According to the experts, influenza A(H1N1) was the most important zoonoses. Rabies, leptospirosis, brucellosis, and toxoplasmosis were identified as priority diseases by both the experts and the exposed workers. This is the first prioritization exercise focused on zoonoses surveillance, prevention, and control in Colombia. These results could be used to guide decision-making for resource allocation in public health.

Building consensus on key priorities for rural health care in South Africa using the Delphi technique.

PubMed

Versteeg, Marije; du Toit, Lilo; Couper, Ian

2013-01-24

South Africa is currently undergoing major health system restructuring in an attempt to improve health outcomes and reduce inequities in access. Such inequities exist between private and public health care and within the public health system itself. Experience shows that rural health care can be disadvantaged in policy formulation despite good intentions. The objective of this study was to identify the major challenges and priority interventions for rural health care provision in South Africa thereby contributing to pro-rural health policy dialogue. The Delphi technique was used to develop consensus on a list of statements that was generated through interviews and literature review. A panel of rural health practitioners and other stakeholders was asked to indicate their level of agreement with these statements and to rank the top challenges in and interventions required for rural health care. Response rates ranged from 83% in the first round (n=44) to 64% in the final round (n=34). The top five priorities were aligned to three of the WHO health system building blocks: human resources for health (HRH), governance, and finance. Specifically, the panel identified a need to focus on recruitment and support of rural health professionals, the employment of managers with sufficient and appropriate skills, a rural-friendly national HRH plan, and equitable funding formulae. Specific policies and strategies are required to address the greatest rural health care challenges and to ensure improved access to quality health care in rural South Africa. In addition, a change in organisational climate and a concerted effort to make a career in rural health appealing to health care workers and adequate funding for rural health care provision are essential.

Usability Testing of the iPhone App to Improve Pain Assessment for Older Adults with Cognitive Impairment (Prehospital Setting): A Qualitative Study.

PubMed

Docking, Rachael E; Lane, Matthew; Schofield, Pat A

2017-03-15

Pain assessment in older adults with cognitive impairment is often challenging, and paramedics are not given sufficient tools/training to assess pain. The development of a mobile app may improve pain assessment and management in this vulnerable population. We conducted usability testing of a newly developed iPhone pain assessment application with potential users, in this case as a tool for clinical paramedic practice to improve pain assessment of older adults with cognitive impairment. We conducted usability testing with paramedic students and a Delphi panel of qualified paramedics. Participants studied the app and paper-based algorithm from which the app was developed. The potential use for the app was discussed. Usability testing focus groups were recorded, transcribed verbatim, and analyzed using a thematic approach. Proposed recommendations were disseminated to the Delphi panel that reviewed and confirmed them. Twenty-four paramedic students from two UK ambulance services participated in the focus groups. Usability of the app and its potential were viewed positively. Four major themes were identified: 1) overall opinion of the app for use in paramedic services; 2) incorporating technological applications into the health care setting; 3) improving knowledge and governance; and 4) alternative uses for the app. Subthemes were identified and are presented. Our results indicate that the pain assessment app constitutes a potentially useful tool in the prehospital setting. By providing access to a tool specifically developed to help identify/assess pain in a user-friendly format, paramedics are likely to have increased knowledge and confidence in assessing pain in patients with dementia. © 2017 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Research priorities in nursing--a Delphi study among Swedish nurses.

PubMed

Bäck-Pettersson, Siv; Hermansson, Evelyn; Sernert, Ninni; Björkelund, Cecilia

2008-08-01

The main aim was to illuminate essential areas for future patient-related nursing research. The secondary aim was to stimulate nurses to explore important research areas based on clinical practice. Priority-setting is regarded as one of the main strategies to ensure excellence in nursing science, to direct nursing research and develop healthcare practice accordingly as well as strengthening the nursing profession's research commitment. A three-round Delphi survey was conducted. A panel of 118 clinicians, in various nursing, teaching and administrative positions participated. Ninety-five panel members completed all three rounds (81%). The majority were female, aged 25-67 (mean 49) years, with an average of 23 (range 1-40) years in nursing, working in hospitals (42%), primary healthcare centres, community care (44%) and administration/education (14%). Sixty-six per cent had graduate diplomas and 34% had an academic education, ranging from bachelors' to doctoral degrees. Three hundred and eighty nursing research areas were identified, evaluated and ranked using content analysis and descriptive statistics. The participants' prioritized research aimed at preserving humanistic values and developing cross-organisational collaboration in the healthcare system. Nursing research aimed at preserving human dignity in geriatric care, respectful transfers, continuity of care and exploring the characteristics of a caring encounter were ranked high relative to the patient welfare, to the healthcare organisation and to the nursing profession. Nurses prioritize research that will improve clinical practice, assure patients' wellbeing and a caring environment. Nurses can reach consensus on the objectives of patient-related nursing research despite differences in age, workplace, educational period and level of academic degree. Relevance to clinical practice. When prioritizing important areas for patient-related nursing research, informed nursing practitioners' commitment initiates knowledge development within clinical practice from a nursing science perspective as well as expanding cross-professional and cross-organisational collaboration.

Personalising care of adults with asthma from Asia: a modified e-Dephi consensus study to inform management tailored to attitude and control profiles.

PubMed

Chisholm, Alison; Price, David B; Pinnock, Hilary; Lee, Tan Tze; Roa, Camilo; Cho, Sang-Heon; David-Wang, Aileen; Wong, Gary; van der Molen, Thys; Ryan, Dermot; Castillo-Carandang, Nina; Yong, Yee Vern

2017-01-05

REALISE Asia-an online questionnaire-based study of Asian asthma patients-identified five patient clusters defined in terms of their control status and attitude towards their asthma (categorised as: 'Well-adjusted and at least partly controlled'; 'In denial about symptoms'; 'Tolerating with poor control'; 'Adrift and poorly controlled'; 'Worried with multiple symptoms'). We developed consensus recommendations for tailoring management of these attitudinal-control clusters. An expert panel undertook a three-round electronic Delphi (e-Delphi): Round 1: panellists received descriptions of the attitudinal-control clusters and provided free text recommendations for their assessment and management. Round 2: panellists prioritised Round 1 recommendations and met (or joined a teleconference) to consolidate the recommendations. Round 3: panellists voted and prioritised the remaining recommendations. Consensus was defined as Round 3 recommendations endorsed by >50% of panellists. Highest priority recommendations were those receiving the highest score. The multidisciplinary panellists (9 clinicians, 1 pharmacist and 1 health social scientist; 7 from Asia) identified consensus recommendations for all clusters. Recommended pharmacological (e.g., step-up/down; self-management; simplified regimen) and non-pharmacological approaches (e.g., trigger management, education, social support; inhaler technique) varied substantially according to each cluster's attitude to asthma and associated psychosocial drivers of behaviour. The attitudinal-control clusters defined by REALISE Asia resonated with the international panel. Consensus was reached on appropriate tailored management approaches for all clusters. Summarised and incorporated into a structured management pathway, these recommendations could facilitate personalised care. Generalisability of these patient clusters should be assessed in other socio-economic, cultural and literacy groups and nationalities in Asia.

Development and validation of a mass casualty conceptual model.

PubMed

Culley, Joan M; Effken, Judith A

2010-03-01

To develop and validate a conceptual model that provides a framework for the development and evaluation of information systems for mass casualty events. The model was designed based on extant literature and existing theoretical models. A purposeful sample of 18 experts validated the model. Open-ended questions, as well as a 7-point Likert scale, were used to measure expert consensus on the importance of each construct and its relationship in the model and the usefulness of the model to future research. Computer-mediated applications were used to facilitate a modified Delphi technique through which a panel of experts provided validation for the conceptual model. Rounds of questions continued until consensus was reached, as measured by an interquartile range (no more than 1 scale point for each item); stability (change in the distribution of responses less than 15% between rounds); and percent agreement (70% or greater) for indicator questions. Two rounds of the Delphi process were needed to satisfy the criteria for consensus or stability related to the constructs, relationships, and indicators in the model. The panel reached consensus or sufficient stability to retain all 10 constructs, 9 relationships, and 39 of 44 indicators. Experts viewed the model as useful (mean of 5.3 on a 7-point scale). Validation of the model provides the first step in understanding the context in which mass casualty events take place and identifying variables that impact outcomes of care. This study provides a foundation for understanding the complexity of mass casualty care, the roles that nurses play in mass casualty events, and factors that must be considered in designing and evaluating information-communication systems to support effective triage under these conditions.

Project PriMo: sharing principles and practices of bronchodilator therapy monitoring in COPD: a consensus initiative for optimizing therapeutic appropriateness among Italian specialists.

PubMed

Cazzola, Mario; Brusasco, Vito; Centanni, Stefano; Cerveri, Isa; De Michele, Fausto; Di Maria, Giuseppe; Palange, Paolo; Pellegrino, Riccardo; Polverino, Mario; Rossi, Andrea; Papi, Alberto

2013-04-01

Even after publication of the 2011 update of GOLD report, some fundamental questions in the management of COPD are still open and this may weaken the applicability of these guidelines in everyday clinical practice. To assess the level of consensus amongst Italian respirologists on different topics related to diagnosis, monitoring and role of bronchodilator therapy in COPD, by using the Delphi technique. A Delphi study was undertaken between July and November 2011, when two questionnaires were consecutively sent to a panel of experts to be answered anonymously. After each round, the data were aggregated at group level of question topics and structured feedback was given to the panel. A first-round questionnaire was sent to 208 pulmonologists randomly selected from different Italian regions. The 132 respondents (63% of those initially selected) were from northern (53%), central (19%) and southern (28%) Italy. A second-round questionnaire was sent to all the first-round respondents, and a response was received from 110 of them (83%). The main topics that reached the pre-defined cut off for consensus (67% or more) were: a) bronchodilator therapy with long-acting bronchodilators could be beneficial in patients with airflow limitation even in the absence of symptoms, b) in patients not fully controlled with one long-acting bronchodilator, maximizing bronchodilation (i.e. adding another bronchodilator with a different mechanism of action) is the preferable option; and c) the use of inhaled corticosteroids (ICSs) as add on therapy should be considered in severe patients with frequent exacerbations. Italian specialists agree on several aspects of the diagnosis and treatment of COPD and expert opinion could support everyday decision process in the management of COPD. Copyright © 2012 Elsevier Ltd. All rights reserved.

Building consensus on key priorities for rural health care in South Africa using the Delphi technique

PubMed Central

Versteeg, Marije; du Toit, Lilo; Couper, Ian

2013-01-01

Background South Africa is currently undergoing major health system restructuring in an attempt to improve health outcomes and reduce inequities in access. Such inequities exist between private and public health care and within the public health system itself. Experience shows that rural health care can be disadvantaged in policy formulation despite good intentions. The objective of this study was to identify the major challenges and priority interventions for rural health care provision in South Africa thereby contributing to pro-rural health policy dialogue. Methods The Delphi technique was used to develop consensus on a list of statements that was generated through interviews and literature review. A panel of rural health practitioners and other stakeholders was asked to indicate their level of agreement with these statements and to rank the top challenges in and interventions required for rural health care. Results Response rates ranged from 83% in the first round (n=44) to 64% in the final round (n=34). The top five priorities were aligned to three of the WHO health system building blocks: human resources for health (HRH), governance, and finance. Specifically, the panel identified a need to focus on recruitment and support of rural health professionals, the employment of managers with sufficient and appropriate skills, a rural-friendly national HRH plan, and equitable funding formulae. Conclusion Specific policies and strategies are required to address the greatest rural health care challenges and to ensure improved access to quality health care in rural South Africa. In addition, a change in organisational climate and a concerted effort to make a career in rural health appealing to health care workers and adequate funding for rural health care provision are essential. PMID:23364081

Development and Pilot Testing of Caregiver-Reported Pediatric Quality Measures for Transitions Between Sites of Care.

PubMed

Desai, Arti D; Burkhart, Q; Parast, Layla; Simon, Tamara D; Allshouse, Carolyn; Britto, Maria T; Leyenaar, JoAnna K; Gidengil, Courtney A; Toomey, Sara L; Elliott, Marc N; Schneider, Eric C; Mangione-Smith, Rita

Few measures exist to assess pediatric transition quality between care settings. The study objective was to develop and pilot test caregiver-reported quality measures for pediatric hospital and emergency department (ED) to home transitions. On the basis of an evidence review, we developed draft caregiver-reported quality measures for transitions between sites of care. Using the RAND-UCLA Modified Delphi method, a multistakeholder panel endorsed measures for further development. Measures were operationalized into 2 surveys, which were administered to caregivers of patients (n = 2839) discharged from Seattle Children's Hospital between July 1 and September 1, 2014. Caregivers were randomized to mail or telephone survey mode. Measure scores were computed as a percentage of eligible caregivers who endorsed receiving the indicated care. Differences in scores were examined according to survey mode and caregiver characteristics. The Delphi panel endorsed 6 of 8 hospital to home transition measures and 2 of 3 ED to home transitions measures. Scores differed significantly according to mode for 1 measure. Caregivers with lower levels of educational attainment and/or Spanish-speaking caregivers reported significantly higher scores on 3 of the measures. The largest difference was reported for the measure that assessed whether caregivers received assistance with scheduling follow-up appointments; 92% score for caregivers with lower educational attainment versus 79% for caregivers with higher educational attainment (P < .001). We developed 8 new, evidence-based quality measures to assess transition quality from the perspective of caregivers. Pilot testing of these measures in a single institution yielded valuable insights for future testing and implementation of these measures. Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

Establishing Key Performance Indicators [KPIs] and Their Importance for the Surgical Management of Inflammatory Bowel Disease-Results From a Pan-European, Delphi Consensus Study.

PubMed

Morar, Pritesh S; Hollingshead, James; Bemelman, Willem; Sevdalis, Nick; Pinkney, Thomas; Wilson, Graeme; Dunlop, Malcolm; Davies, R Justin; Guy, Richard; Fearnhead, Nicola; Brown, Steven; Warusavitarne, Janindra; Edwards, Cathryn; Faiz, Omar

2017-10-27

Key performance indicators [KPIs] exist across a range of areas in medicine. They help to monitor outcomes, reduce variation, and drive up standards across services. KPIs exist for inflammatory bowel disease [IBD] care, but none specifically cover inflammatory bowel disease [IBD] surgical service provision. This was a consensus-based study using a panel of expert IBD clinicians from across Europe. Items were developed and fed through a Delphi process to achieve consensus. Items were ranked on a Likert scale from 1 [not important] to 5 [very important]. Consensus was defined when the inter quartile range was ≤ 1, and items with a median score > 3 were considered for inclusion. A panel of 21 experts [14 surgeons and 7 gastroenterologists] was recruited. Consensus was achieved on procedure-specific KPIs for ileocaecal and perianal surgery for Crohn's disease, [N = 10] with themes relating to morbidity [N = 7], multidisciplinary input [N = 2], and quality of life [N = 1]; and for subtotal colectomy, proctocolectomy and ileoanal pouch surgery for ulcerative colitis [N = 11], with themes relating to mortality [N = 2], morbidity [N = 8], and service provision [N = 1]. Consensus was also achieved for measures of the quality of IBD surgical service provision and quality assurance in IBD surgery. This study has provided measurable KPIs for the provision of surgical services in IBD. These indicators cover IBD surgery in general, the governance and structures of the surgical services, and separate indicators for specific subareas of surgery. Monitoring of IBD services with these KPIs may reduce variation across services and improve quality. Copyright © 2017 European Crohn’s and Colitis Organisation (ECCO). Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com

Study of labor-negotiation productivity concerns in the petroleum-refining industry

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, J.E.

The primary objective of this study was to identify productivity factors relative to negotiating future labor contracts with the Oil, Chemical and Atomic Workers International Union (OCAWIU). A Delphi research method was utilized to accomplish this purpose. The study utilized three rounds to obtain the stated objectives. Round one involved the use of an open instrument to solicit productivity factors that would be beneficial in future negotiations with the OCAWIU. In round two, two separate instruments were sent to the panel members who were asked to judge the value of each item on the first instrument, and to rank themore » ten most significant items on the second. The round three instruments were individualized for each panel member. The productivity items were rated by the panel members, and descriptive statistics were used to describe the combined order of listings and weights for determining the relative importance of each factor in the consensus model. The nonparametric statistics were used to examine the degree of consensus between the mean values on the first instrument with the ranked values for the second instrument. No significant differences were formed. Twenty-five productivity items were identified and prioritized as viable negotiable items with the OCAWIU.« less

Important challenges for coordination and inter-municipal cooperation in health care services: a Delphi study

PubMed Central

2013-01-01

Background Demographical changes have stimulated a coordination reform in the Norwegian health care sector, creating new working practices and extending coordination within and between primary and hospital care, increasing the need for inter-municipal cooperation (IMC). This study aimed to identify challenges to coordination and IMC in the Norwegian health care sector as a basis for further theorizing and managerial advice in this growing area of research and practice. Methods A Delphi study of consensus development was used. Experts in coordination and IMC in health care services were selected by the healthcare manager or the councillor in their respective municipalities. In the first round, an expert panel received open-ended questions addressing possible challenges, and their answers were categorized and consolidated as the basis for further validation in the second round. The expert panel members were then asked to point out important statements in the third round, before the most important statements ranked by a majority of the members were rated again in the fourth round, including the option to explain the ratings. The same procedure was used in round five, with the exception that the expert panel members could view the consolidated results of their previous rankings as the basis for a new and final rating. The statements reaching consensus in round five were abstracted and themed. Results Nineteen experts consented to participate. Nine experts (47%) completed all of the five rounds. Eight statements concerning coordination reached consensus, resulting in four themes covering these challenges: different culture, uneven balance of power, lack of the possibility to communicate electronically, and demanding tasks in relation to resources. Three statements regarding challenges to IMC reached consensus, resulting in following themes: coopetition, complex leadership, and resistance to change. Conclusions This study identified several important challenges for coordination and it supports previous research. IMC in health care services deals with challenges other than coordination, and these must be addressed specifically. Our study contributes to extended knowledge of theoretical and practical implications in the field of coordination and IMC in health care sector. PMID:24171839

A consensus process on management of major burns accidents: lessons learned from the café fire in Volendam, The Netherlands.

PubMed

Welling, L; Boers, M; Mackie, D P; Patka, P; Bierens, J J L M; Luitse, J S K; Kreis, R W

2006-01-01

The optimum response to the different stages of a major burns incident is still not established. The fire in a café in Volendam on New Year's Eve 2000 was the worst incident in recent Dutch history and resulted in mass burn casualties. The fire has been the subject of several investigations concerned with organisational and medical aspects. Based on the findings in these investigations, a multidisciplinary research group started a consensus study. The aim of this study was to further identify areas of improvement in the care after mass burns incidents. The consensus process comprised three postal rounds (Delphi Method) and a consensus conference (modified nominal group technique). The multidisciplinary panel consisted of 26 Dutch-speaking experts, working in influential positions within the sphere of disaster management and healthcare. In response to the postal questionnaires, consensus was reached for 66 per cent of the statements. Six topics were subsequently discussed during the consensus conference; three topics were discussed within the plenary session and three during subgroup meetings. During the conference, consensus was reached for seven statements (one subject generated two statements). In total, the panel agreed on 21 statements. These covered the following topics: registration and evaluation of disaster care, capacity planning for disasters, pre hospital care of victims of burns disasters, treatment and transportation priorities, distribution of casualties (including interhospital transports), diagnosis and treatment and education and training. In disaster medicine, the paper shows how a consensus process is a suitable tool to identify areas of improvement of care after mass burns incidents.

Multinational evidence-based recommendations on how to investigate and follow-up undifferentiated peripheral inflammatory arthritis: integrating systematic literature research and expert opinion of a broad international panel of rheumatologists in the 3E Initiative.

PubMed

Machado, P; Castrejon, I; Katchamart, W; Koevoets, R; Kuriya, B; Schoels, M; Silva-Fernández, L; Thevissen, K; Vercoutere, W; Villeneuve, E; Aletaha, D; Carmona, L; Landewé, R; van der Heijde, D; Bijlsma, J W J; Bykerk, V; Canhão, H; Catrina, A I; Durez, P; Edwards, C J; Mjaavatten, M D; Leeb, B F; Losada, B; Martín-Mola, E M; Martinez-Osuna, P; Montecucco, C; Müller-Ladner, U; Østergaard, M; Sheane, B; Xavier, R M; Zochling, J; Bombardier, C

2011-01-01

To develop evidence-based recommendations on how to investigate and follow-up undifferentiated peripheral inflammatory arthritis (UPIA). 697 rheumatologists from 17 countries participated in the 3E (Evidence, Expertise, Exchange) Initiative of 2008-9 consisting of three separate rounds of discussions and modified Delphi votes. In the first round 10 clinical questions were selected. A bibliographic team systematically searched Medline, Embase, the Cochrane Library and ACR/EULAR 2007-2008 meeting abstracts. Relevant articles were reviewed for quality assessment, data extraction and synthesis. In the second round each country elaborated a set of national recommendations. Finally, multinational recommendations were formulated and agreement among the participants and the potential impact on their clinical practice was assessed. A total of 39,756 references were identified, of which 250 were systematically reviewed. Ten multinational key recommendations about the investigation and follow-up of UPIA were formulated. One recommendation addressed differential diagnosis and investigations prior to establishing the operational diagnosis of UPIA, seven recommendations related to the diagnostic and prognostic value of clinical and laboratory assessments in established UPIA (history and physical examination, acute phase reactants, autoantibodies, radiographs, MRI and ultrasound, genetic markers and synovial biopsy), one recommendation highlighted predictors of persistence (chronicity) and the final recommendation addressed monitoring of clinical disease activity in UPIA. Ten recommendations on how to investigate and follow-up UPIA in the clinical setting were developed. They are evidence-based and supported by a large panel of rheumatologists, thus enhancing their validity and practical use.

Development of key performance indicators to evaluate centralized intake for patients with osteoarthritis and rheumatoid arthritis.

PubMed

Barber, Claire E; Patel, Jatin N; Woodhouse, Linda; Smith, Christopher; Weiss, Stephen; Homik, Joanne; LeClercq, Sharon; Mosher, Dianne; Christiansen, Tanya; Howden, Jane Squire; Wasylak, Tracy; Greenwood-Lee, James; Emrick, Andrea; Suter, Esther; Kathol, Barb; Khodyakov, Dmitry; Grant, Sean; Campbell-Scherer, Denise; Phillips, Leah; Hendricks, Jennifer; Marshall, Deborah A

2015-11-14

Centralized intake is integral to healthcare systems to support timely access to appropriate health services. The aim of this study was to develop key performance indicators (KPIs) to evaluate centralized intake systems for patients with osteoarthritis (OA) and rheumatoid arthritis (RA). Phase 1 involved stakeholder meetings including healthcare providers, managers, researchers and patients to obtain input on candidate KPIs, aligned along six quality dimensions: appropriateness, accessibility, acceptability, efficiency, effectiveness, and safety. Phase 2 involved literature reviews to ensure KPIs were based on best practices and harmonized with existing measures. Phase 3 involved a three-round, online modified Delphi panel to finalize the KPIs. The panel consisted of two rounds of rating and a round of online and in-person discussions. KPIs rated as valid and important (≥7 on a 9-point Likert scale) were included in the final set. Twenty-five KPIs identified and substantiated during Phases 1 and 2 were submitted to 27 panellists including healthcare providers, managers, researchers, and patients in Phase 3. After the in-person meeting, three KPIs were removed and six were suggested. The final set includes 9 OA KPIs, 10 RA KPIs and 9 relating to centralized intake processes for both conditions. All 28 KPIs were rated as valid and important. Arthritis stakeholders have proposed 28 KPIs that should be used in quality improvement efforts when evaluating centralized intake for OA and RA. The KPIs measure five of the six dimensions of quality and are relevant to patients, practitioners and health systems.

Best practices in the evaluation and treatment of foramen magnum stenosis in achondroplasia during infancy.

PubMed

White, Klane K; Bompadre, Viviana; Goldberg, Michael J; Bober, Michael B; Campbell, Jeffrey W; Cho, Tae-Joon; Hoover-Fong, Julie; Mackenzie, William; Parnell, Shawn E; Raggio, Cathleen; Rapoport, David M; Spencer, Samantha A; Savarirayan, Ravi

2016-01-01

Achondroplasia is the most common inherited disorder of bone growth (skeletal dysplasia). Despite this fact, consistent and evidence-based management approaches to recognized, life-threatening complications, such as foramen magnum stenosis, are lacking. This study aims to outline best practice, based on evidence and expert consensus, regarding the diagnosis, assessment, and management of foramen magnum stenosis in achondroplasia during infancy. A panel of 11 multidisciplinary international experts on skeletal dysplasia was invited to participate in a Delphi process. They were: 1) presented with a list of 26 indications and a thorough literature review, 2) given the opportunity to anonymously rate the indications and discuss in face to face discussion; 3) edit the list and rate it in a second round. Those indications with more than 80% agreement were considered as consensual. After two rounds of rating and a face-to-face meeting, consensus was reached to support 22 recommendations for the evaluation and treatment of foramen magnum stenosis in infants with achondroplasia. These recommendations include indications for surgical decompression, ventriculomegaly, and hydrocephalus, sleep-disordered breathing, physical exams and the use of polysomnography and imaging in this condition. We present a consensus-based best practice guidelines consisting of 22 recommendations. It is hoped that these guidelines will lead to more uniform and structured evaluation, standardizing care pathways, and improving mortality and morbidity outcomes for this cohort. © 2015 Wiley Periodicals, Inc.

Optimizing the Diagnosis and Management of Dravet Syndrome: Recommendations From a North American Consensus Panel.

PubMed

Wirrell, Elaine C; Laux, Linda; Donner, Elizabeth; Jette, Nathalie; Knupp, Kelly; Meskis, Mary Anne; Miller, Ian; Sullivan, Joseph; Welborn, Michelle; Berg, Anne T

2017-03-01

To establish standards for early, cost-effective, and accurate diagnosis; optimal therapies for seizures; and recommendations for evaluation and management of comorbidities for children and adults with Dravet syndrome, using a modified Delphi process. An expert panel was convened comprising epileptologists with nationally recognized expertise in Dravet syndrome and parents of children with Dravet syndrome, whose experience and understanding was enhanced by their active roles in Dravet syndrome associations. Panelists were asked to base their responses to questions both on their clinical expertise and results of a literature review that was forwarded to each panelist. Three rounds of online questionnaires were conducted to identify areas of consensus and strength of that consensus, as well as areas of contention. The panel consisted of 13 physicians and five family members. Strong consensus was reached regarding typical clinical presentation of Dravet syndrome, range of electroencephalography and magnetic resonance imaging findings, need for genetic testing, critical information that should be conveyed to families at diagnosis, priorities for seizure control and typical degree of control, seizure triggers and recommendations for avoidance, first- and second-line therapies for seizures, requirement and indications for rescue therapy, specific recommendations for comorbidity screening, and need for family support. Consensus was not as strong regarding later therapies, including vagus nerve stimulation and callosotomy, and for specific therapies of associated comorbidities. Beyond the initial treatment with benzodiazepines and use of valproate, there was no consensus on the optimal in-hospital management of convulsive status epilepticus. We were able to identify areas where there was strong consensus that we hope will (1) inform health care providers on optimal diagnosis and management of patients with Dravet syndrome, (2) support reimbursement from insurance companies for genetic testing and Dravet syndrome-specific therapies, and (3) improve quality of life for patients with Dravet syndrome and their families by avoidance of unnecessary testing and provision of an early accurate diagnosis allowing optimal selection of therapeutic strategies. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of the Learning Health System Researcher Core Competencies.

PubMed

Forrest, Christopher B; Chesley, Francis D; Tregear, Michelle L; Mistry, Kamila B

2017-08-04

To develop core competencies for learning health system (LHS) researchers to guide the development of training programs. Data were obtained from literature review, expert interviews, a modified Delphi process, and consensus development meetings. The competencies were developed from August to December 2016 using qualitative methods. The literature review formed the basis for the initial draft of a competency domain framework. Key informant semi-structured interviews, a modified Delphi survey, and three expert panel (n = 19 members) consensus development meetings produced the final set of competencies. The iterative development process yielded seven competency domains: (1) systems science; (2) research questions and standards of scientific evidence; (3) research methods; (4) informatics; (5) ethics of research and implementation in health systems; (6) improvement and implementation science; and (7) engagement, leadership, and research management. A total of 33 core competencies were prioritized across these seven domains. The real-world milieu of LHS research, the embeddedness of the researcher within the health system, and engagement of stakeholders are distinguishing characteristics of this emerging field. The LHS researcher core competencies can be used to guide the development of learning objectives, evaluation methods, and curricula for training programs. © Health Research and Educational Trust.

Development of a multimedia educational programme for first-time hearing aid users: a participatory design.

PubMed

Ferguson, Melanie; Leighton, Paul; Brandreth, Marian; Wharrad, Heather

2018-05-02

To develop content for a series of interactive video tutorials (or reusable learning objects, RLOs) for first-time adult hearing aid users, to enhance knowledge of hearing aids and communication. RLO content was based on an electronically-delivered Delphi review, workshops, and iterative peer-review and feedback using a mixed-methods participatory approach. An expert panel of 33 hearing healthcare professionals, and workshops involving 32 hearing aid users and 11 audiologists. This ensured that social, emotional and practical experiences of the end-user alongside clinical validity were captured. Content for evidence-based, self-contained RLOs based on pedagogical principles was developed for delivery via DVD for television, PC or internet. Content was developed based on Delphi review statements about essential information that reached consensus (≥90%), visual representations of relevant concepts relating to hearing aids and communication, and iterative peer-review and feedback of content. This participatory approach recognises and involves key stakeholders in the design process to create content for a user-friendly multimedia educational intervention, to supplement the clinical management of first-time hearing aid users. We propose participatory methodologies are used in the development of content for e-learning interventions in hearing-related research and clinical practice.

A practical guideline for examining a uterine niche using ultrasonography in non-pregnant women: a modified Delphi method amongst European experts.

PubMed

Jordans, I P M; de Leeuw, R; Stegwee, S I; Amso, N N; Barri-Soldevila, P N; van den Bosch, T; Bourne, T; Brolmann, H A M; Donnez, O; Dueholm, M; Hehenkamp, W J K; Jastrow, N; Jurkovic, D; Mashiach, R; Naji, O; Streuli, I; Timmerman, D; Vd Voet, L F; Huirne, J A F

2018-03-14

To generate a uniform, internationally recognized guideline for detailed uterine niche evaluation by ultrasonography in non-pregnant women using a modified Delphi method amongst international experts. Fifteen international gynecological experts were recruited by their membership of the European niche taskforce group. All experts were physicians with extensive experience in niche evaluation in clinical practice and/or authors of niche studies. Relevant items for niche measurement were determined based on the results of a literature search and recommendations of a focus group. Two online questionnaires were sent to the expert panel and one group meeting was organized. Consensus was predefined as a consensus rate of at least 70%. In total 15 experts participated in this study. Consensus was reached for a total of 42 items on niche evaluation, including definitions, relevance, method of measurement and tips for visualization of the niche. All experts agreed on the proposed guideline for niche evaluation in non-pregnant women as presented in this paper. Consensus between niche experts was achieved on all items regarding ultrasonographic niche measurement. This article is protected by copyright. All rights reserved.

The development of a tournament preparation framework for competitive golf: A Delphi study.

PubMed

Pilgrim, Jarred; Kremer, Peter; Robertson, Samuel

2018-05-09

Tournament preparation in golf is used by players to increase course knowledge, develop strategy, optimise playing conditions and facilitate self-regulation. It is not known whether specific behaviours in tournament preparation should be given priority in education and practice at different stages of competition. This study aimed to achieve consensus on the importance of specific tournament preparation behaviours or "items" to players of five competitive levels. A two-round Delphi study was used, including an expert panel of 36 coaches, high-performance staff, players and academics. Participants were asked to score the relative importance of 48 items to players using a 5-point Likert-type scale. For an item to achieve consensus, 67% agreement was required in two adjacent score categories. Consensus was reached for 46 items and these were used to develop a ranked framework for each competitive level. The developed framework provides consensus-based guidelines of the behaviours that are perceived as important in tournament preparation. This framework could be used by national sport organisations to guide the development of more comprehensive learning environments for players and coaches. It could also direct future studies examining the critical behaviours for golfers across different competitive levels.

Position Statement of the Israeli Society for Musculoskeletal Medicine on Intramuscular Stimulation for Myofascial Pain Syndrome-A Delphi Process.

PubMed

Ratmansky, Motti; Minerbi, Amir; Kalichman, Leonid; Kent, John; Wende, Osnat; Finestone, Aharon S; Vulfsons, Simon

2017-04-01

To develop consensus on a position paper on the use of intramuscular stimulation (IMS) for the treatment of myofascial pain syndrome (MPS) by physicians in Israel. The Israeli Society of Musculoskeletal Medicine ran a modified Delphi process to gather opinions from a multidisciplinary expert panel. Eight experts in the treatment of MPS were chosen and asked to participate, and six participated. The position paper was iterated three times. After three iterations, general consensus was reached by all six experts. The general statement that was agreed on was: "IMS is one of the preferred treatments for myofascial pain syndrome. The treatment is evidence-based, effective, safe, and inexpensive. The position of the Israeli Society of Musculoskeletal Medicine is that the treatment should be taught and used by all primary care physicians and those physicians in other areas of medicine who deal with pain in their work." The position paper is a basis for clinical work and education programs for physicians interested in a better understanding and ability to treat patients with a musculoskeletal complaint or manifestation of disease. © 2016 World Institute of Pain.

What is a good result after clubfoot treatment? A Delphi-based consensus on success by regional clubfoot trainers from across Africa.

PubMed

Smythe, Tracey; Wainwright, Andrew; Foster, Allen; Lavy, Christopher

2017-01-01

Congenital talipes equino-varus (CTEV), also known as clubfoot, is one of the most common congenital musculoskeletal malformations. Despite this, considerable variation exists in the measurement of deformity correction and outcome evaluation. This study aims to determine the criteria for successful clubfoot correction using the Ponseti technique in low resource settings through Africa. Using the Delphi method, 18 experienced clubfoot practitioners and trainers from ten countries in Africa ranked the importance of 22 criteria to define an 'acceptable or good clubfoot correction' at the end of bracing with the Ponseti technique. A 10cm visual analogue scale was used. They repeated the rating with the results of the mean scores and standard deviation of the first test provided. The consistency among trainers was determined with the intra-class correlation coefficient (ICC). From the original 22 criteria, ten criteria with a mean score >7 and SD <2 were identified and were rated through a second Delphi round by 17 different clubfoot treatment trainers from 11 countries in Africa. The final definition consisted of all statements that achieved strong agreement, a mean score of >9 and SD<1.5. The consensus definition of a successfully treated clubfoot includes: (1) a plantigrade foot, (2) the ability to wear a normal shoe, (3) no pain, and (4) the parent is satisfied. Participants demonstrated good consistency in rating these final criteria (ICC 0.88; 0.74,0.97). The consistency of Ponseti technique trainers from Africa in rating criteria for a successful outcome of clubfoot management was good. The consensus definition includes basic physical assessment, footwear use, pain and parent satisfaction.

Solid State Energy Conversion Energy Alliance (SECA)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hennessy, Daniel; Sibisan, Rodica; Rasmussen, Mike

2011-09-12

The overall objective is to develop a Solid Oxide Fuel Cell (SOFC) stack that can be economically produced in high volumes and mass customized for different applications in transportation, stationary power generation, and military market sectors. In Phase I, work will be conducted on system design and integration, stack development, and development of reformers for natural gas and gasoline. Specifically, Delphi-Battelle will fabricate and test a 5 kW stationary power generation system consisting of a SOFC stack, a steam reformer for natural gas, and balance-of-plant (BOP) components, having an expected efficiency of ≥ 35 percent (AC/LHV). In Phase II andmore » Phase III, the emphasis will be to improve the SOFC stack, reduce start-up time, improve thermal cyclability, demonstrate operation on diesel fuel, and substantially reduce materials and manufacturing cost by integrating several functions into one component and thus reducing the number of components in the system. In Phase II, Delphi-Battelle will fabricate and demonstrate two SOFC systems: an improved stationary power generation system consisting of an improved SOFC stack with integrated reformation of natural gas, and the BOP components, with an expected efficiency of ≥ 40 percent (AC/LHV), and a mobile 5 kW system for heavy-duty trucks and military power applications consisting of an SOFC stack, reformer utilizing anode tailgate recycle for diesel fuel, and BOP components, with an expected efficiency of ≥ 30 percent (DC/LHV). Finally, in Phase III, Delphi-Battelle will fabricate and test a 5 kW Auxiliary Power Unit (APU) for mass-market automotive application consisting of an optimized SOFC stack, an optimized catalytic partial oxidation (CPO) reformer for gasoline, and BOP components, having an expected efficiency of ≥ 30 percent (DC/LHV) and a factory cost of ≤ $400/kW.« less

Solid State Energy Conversion Energy Alliance (SECA)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hennessy, Daniel; Sibisan, Rodica; Rasmussen, Mike

2011-09-12

The overall objective is to develop a solid oxide fuel cell (SOFC) stack that can be economically produced in high volumes and mass customized for different applications in transportation, stationary power generation, and military market sectors. In Phase I, work will be conducted on system design and integration, stack development, and development of reformers for natural gas and gasoline. Specifically, Delphi-Battelle will fabricate and test a 5 kW stationary power generation system consisting of a SOFC stack, a steam reformer for natural gas, and balance-of-plant (BOP) components, having an expected efficiency of 35 percent (AC/LHV). In Phase II and Phasemore » III, the emphasis will be to improve the SOFC stack, reduce start-up time, improve thermal cyclability, demonstrate operation on diesel fuel, and substantially reduce materials and manufacturing cost by integrating several functions into one component and thus reducing the number of components in the system. In Phase II, Delphi-Battelle will fabricate and demonstrate two SOFC systems: an improved stationary power generation system consisting of an improved SOFC stack with integrated reformation of natural gas, and the BOP components, with an expected efficiency of ≥40 percent (AC/LHV), and a mobile 5 kW system for heavy-duty trucks and military power applications consisting of an SOFC stack, reformer utilizing anode tailgate recycle for diesel fuel, and BOP components, with an expected efficiency of ≥30 percent (DC/LHV). Finally, in Phase III, Delphi-Battelle will fabricate and test a 5 kW Auxiliary Power Unit (APU) for mass-market automotive application consisting of an optimized SOFC stack, an optimized catalytic partial oxidation (CPO) reformer for gasoline, and BOP components, having an expected efficiency of 30 percent (DC/LHV) and a factory cost of ≤$400/kW.« less

75 FR 16513 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-01

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8th, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture... location of Delphi Packard Electrical/Electronic Architecture, a subsidiary of Delphi Corporation. The...

On using ethical principles of community-engaged research in translational science.

PubMed

Khodyakov, Dmitry; Mikesell, Lisa; Schraiber, Ron; Booth, Marika; Bromley, Elizabeth

2016-05-01

The transfer of new discoveries into both clinical practice and the wider community calls for reliance on interdisciplinary translational teams that include researchers with different areas of expertise, representatives of health care systems and community organizations, and patients. Engaging new stakeholders in research, however, calls for a reconsideration or expansion of the meaning of ethics in translational research. We explored expert opinion on the applicability of ethical principles commonly practiced in community-engaged research (CEnR) to translational research. To do so, we conducted 2 online, modified-Delphi panels with 63 expert stakeholders who iteratively rated and discussed 9 ethical principles commonly used in CEnR in terms of their importance and feasibility for use in translational research. The RAND/UCLA appropriateness method was used to analyze the data and determine agreement and disagreement among participating experts. Both panels agreed that ethical translational research should be "grounded in trust." Although the academic panel endorsed "culturally appropriate" and "forthcoming with community about study risks and benefits," the mixed academic-community panel endorsed "scientifically valid" and "ready to involve community in interpretation and dissemination" as important and feasible principles of ethical translational research. These findings suggest that in addition to protecting human subjects, contemporary translational science models need to account for the interests of, and owe ethical obligations to, members of the investigative team and the community at large. Copyright © 2016 Elsevier Inc. All rights reserved.

On Using Ethical Principles of Community-Engaged Research in Translational Science

PubMed Central

Mikesell, Lisa; Schraiber, Ron; Booth, Marika; Bromley, Elizabeth

2015-01-01

The transfer of new discoveries into both clinical practice and the wider community calls for reliance on interdisciplinary translational teams that include researchers with different areas of expertise, representatives of healthcare systems and community organizations, and patients. Engaging new stakeholders in research, however, calls for a re-consideration or expansion of the meaning of ethics in translational research. We explored expert opinion on the applicability of ethical principles commonly practiced in community-engaged research (CEnR) to translational research. To do so, we conducted two online, modified-Delphi panels with 63 expert stakeholders who iteratively rated and discussed nine ethical principles commonly used in CEnR in terms of their importance and feasibility for use in translational research. The RAND/UCLA Appropriateness Method was used to analyze the data and determine agreement and disagreement among participating experts. Both panels agreed that ethical translational research should be “grounded in trust.” While the academic panel endorsed “culturally appropriate” and “forthcoming with community about study risks and benefits,” the mixed academic-community panel endorsed “scientifically valid” and “ready to involve community in interpretation and dissemination” as important and feasible principles of ethical translational research. These findings suggest that in addition to protecting human subjects, contemporary translational science models need to account for the interests of, and owe ethical obligations to, members of the investigative team and the community at large. PMID:26773561

Estimating the financial resources needed for local public health departments in Minnesota: a multimethod approach.

PubMed

Riley, William; Briggs, Jill; McCullough, Mac

2011-01-01

This study presents a model for determining total funding needed for individual local health departments. The aim is to determine the financial resources needed to provide services for statewide local public health departments in Minnesota based on a gaps analysis done to estimate the funding needs. We used a multimethod analysis consisting of 3 approaches to estimate gaps in local public health funding consisting of (1) interviews of selected local public health leaders, (2) a Delphi panel, and (3) a Nominal Group Technique. On the basis of these 3 approaches, a consensus estimate of funding gaps was generated for statewide projections. The study includes an analysis of cost, performance, and outcomes from 2005 to 2007 for all 87 local governmental health departments in Minnesota. For each of the methods, we selected a panel to represent a profile of Minnesota health departments. The 2 main outcome measures were local-level gaps in financial resources and total resources needed to provide public health services at the local level. The total public health expenditure in Minnesota for local governmental public health departments was $302 million in 2007 ($58.92 per person). The consensus estimate of the financial gaps in local public health departments indicates that an additional $32.5 million (a 10.7% increase or $6.32 per person) is needed to adequately serve public health needs in the local communities. It is possible to make informed estimates of funding gaps for public health activities on the basis of a combination of quantitative methods. There is a wide variation in public health expenditure at the local levels, and methods are needed to establish minimum baseline expenditure levels to adequately treat a population. The gaps analysis can be used by stakeholders to inform policy makers of the need for improved funding of the public health system.

Informatics Competencies for Nursing and Healthcare Leaders

PubMed Central

Westra, Bonnie L.; Delaney, Connie W.

2008-01-01

Historically, educational preparation did not address informatics competencies; thus managers, administrators, or executives may not be prepared to use or lead change in the use of health information technologies. A number of resources for informatics competencies exist, however, a comprehensive list addressing the unique knowledge and skills required in the role of a manager or administrator was not found. The purpose of this study was to develop informatics competencies for nursing leaders. A synthesis of the literature and a Delphi approach using three rounds of surveys with an expert panel resulted in identification of informatics competencies for nursing leaders that address computer skills, informatics knowledge, and informatics skills. PMID:18998803

Initiation of biological agents in patients with ankylosing spondylitis: results of a Delphi study by the ASAS Group

PubMed Central

Pham, T; van der Heijde, D; Calin, A; Khan, M; van der Linden, S.; Bellamy, N; Dougados, M

2003-01-01

Background: There is ample evidence of important symptomatic efficacy of tumour necrosis factor α (TNFα) inhibition in ankylosing spondylitis (AS). Moreover, studies suggest that anti-TNF could be considered as the first disease controlling antirheumatic treatment (DC-ART) for AS. Objective: To determine precisely which patients with AS are most likely to benefit from anti-TNFα treatment because of the cost and possible long term side effects of such treatment. Methods: Assessment in Ankylosing Spondylitis (ASAS) members were asked to use a Delphi technique to name the characteristics of patients with AS for whom they would start DC-ART, in three different clinical presentations (isolated axial involvement, peripheral arthritis, enthesitis). Results: Among the 62 invited ASAS members, more than 50% actively participated in the four phases of definition according to the Delphi technique. For each of the three clinical presentations, a combination of five to six domains was proposed, with an evaluation instrument and a cut off point defining a minimum level of activity for each domain. Conclusion: This study provides a profile for a patient with AS for considering initiation of biological agents that reflects the opinion of the ASAS members, using a Delphi exercise. Further studies are required to assess their relevance and their consistency with clinical practice. PMID:12922951

Stakeholders' Perspectives About and Priorities for Economic Evaluation of Health and Safety Programs in Healthcare.

PubMed

Tompa, Emile; de Boer, Henriette; Macdonald, Sara; Alamgir, Hasanat; Koehoorn, Mieke; Guzman, Jaime

2016-04-01

This study identified and prioritized resources and outcomes that should be considered in more comprehensive and scientifically rigorous health and safety economic evaluations according to healthcare sector stakeholders. A literature review and stakeholder interviews identified candidate resources and outcomes and then a Delphi panel ranked them. According to the panel, the top five resources were (a) health and safety staff time; (b) training workers; (c) program planning, promotion, and evaluation costs; (d) equipment purchases and upgrades; and (e) administration costs. The top five outcomes were (a) number of injuries, illnesses, and general sickness absences; (b) safety climate; (c) days lost due to injuries, illnesses, and general sickness absences; (d) job satisfaction and engagement; and (e) quality of care and patient safety. These findings emphasize stakeholders' stated priorities and are useful as a benchmark for assessing the quality of health and safety economic evaluations and the comprehensiveness of these findings. © 2016 The Author(s).

Proposal of a trigger tool to assess adverse events in dental care.

PubMed

Corrêa, Claudia Dolores Trierweiler Sampaio de Oliveira; Mendes, Walter

2017-11-21

The aim of this study was to propose a trigger tool for research of adverse events in outpatient dentistry in Brazil. The tool was elaborated in two stages: (i) to build a preliminary set of triggers, a literature review was conducted to identify the composition of trigger tools used in other areas of health and the principal adverse events found in dentistry; (ii) to validate the preliminarily constructed triggers a panel of experts was organized using the modified Delphi method. Fourteen triggers were elaborated in a tool with explicit criteria to identify potential adverse events in dental care, essential for retrospective patient chart reviews. Studies on patient safety in dental care are still incipient when compared to other areas of health care. This study intended to contribute to the research in this field. The contribution by the literature and guidance from the expert panel allowed elaborating a set of triggers to detect adverse events in dental care, but additional studies are needed to test the instrument's validity.

Is There a Consensus on Consensus Methodology? Descriptions and Recommendations for Future Consensus Research.

PubMed

Waggoner, Jane; Carline, Jan D; Durning, Steven J

2016-05-01

The authors of this article reviewed the methodology of three common consensus methods: nominal group process, consensus development panels, and the Delphi technique. The authors set out to determine how a majority of researchers are conducting these studies, how they are analyzing results, and subsequently the manner in which they are reporting their findings. The authors conclude with a set of guidelines and suggestions designed to aid researchers who choose to use the consensus methodology in their work.Overall, researchers need to describe their inclusion criteria. In addition to this, on the basis of the current literature the authors found that a panel size of 5 to 11 members was most beneficial across all consensus methods described. Lastly, the authors agreed that the statistical analyses done in consensus method studies should be as rigorous as possible and that the predetermined definition of consensus must be included in the ultimate manuscript. More specific recommendations are given for each of the three consensus methods described in the article.

The Berlin 2016 process: a summary of methodology for the 5th International Consensus Conference on Concussion in Sport.

PubMed

Meeuwisse, Willem H; Schneider, Kathryn J; Dvořák, Jiří; Omu, Onutobor Tobi; Finch, Caroline F; Hayden, K Alix; McCrory, Paul

2017-06-01

The purpose of this paper is to summarise the methodology for the 5th International Consensus Conference on Concussion in Sport. The 18 months of preparation included engagement of a scientific committee, an expert panel of 33 individuals in the field of concussion and a modified Delphi technique to determine the primary questions to be answered. The methodology also involved the writing of 12 systematic reviews to inform the consensus conference and submission and review of scientific abstracts. The meeting itself followed a 2-day open format, a 1-day closed expert panel meeting and two additional half day meetings to develop the Concussion Recognition Tool 5 (Pocket CRT5), Sport Concussion Assessment Tool 5 (SCAT5) and Child SCAT5. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

[Adherence of Type 2 Diabetes Mellitus approach: Current situation and possible solutions].

PubMed

Orozco-Beltrán, Domingo; Mata-Cases, Manel; Artola, Sara; Conthe, Pedro; Mediavilla, Javier; Miranda, Carlos

2016-01-01

Define the impact and causes of non-adherent type-2 diabetes mellitus (DM2) patients, possible solutions and the role of the different health care professionals involved in the treatment. Structured questionnaire rating by a two-round Delphi method. The study was conducted in the Primary Care settings. The expert panel consisted of renowned medical professionals with extensive experience in diabetes. Assessment through a 9-point Likert scale, of the degree of agreement or disagreement on 131 items grouped into 4 blocks: impact; causes of nonadherence; diagnosis of non-adherence, and possible causes, solutions and role of the different professionals involved in adherence. The participation rate was 76.31%. The primary care health professionals agreed on 110 of the 131 proposals statements (84%), showing agreement on 102 items (77.9%) and disagreement in 8 (6.1%). Consensus was not reached on 21 items. The lack of adherence of DM2 patients makes the achievement of therapeutic control difficult. The medical practice needs to have specific training and enough resources to reduce the impact of the lack of therapeutic compliance. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

Development and validation of a competency framework for veterinarians.

PubMed

Bok, Harold G J; Jaarsma, Debbie A D C; Teunissen, Pim W; van der Vleuten, Cees P M; van Beukelen, Peter

2011-01-01

Changing demands from society and the veterinary profession call for veterinary medical curricula that can deliver veterinarians who are able to integrate specific and generic competencies in their professional practice. This requires educational innovation directed by an integrative veterinary competency framework to guide curriculum development. Given the paucity of relevant information from the veterinary literature, a qualitative multi-method study was conducted to develop and validate such a framework. A competency framework was developed based on the analysis of focus group interviews with 54 recently graduated veterinarians and clients and subsequently validated in a Delphi procedure with a panel of 29 experts, representing the full range and diversity of the veterinary profession. The study resulted in an integrated competency framework for veterinary professionals, which consists of 16 competencies organized in seven domains: veterinary expertise, communication, collaboration, entrepreneurship, health and welfare, scholarship, and personal development. Training veterinarians who are able to use and integrate the seven domains in their professional practice is an important challenge for today's veterinary medical schools. The Veterinary Professional (VetPro) framework provides a sound empirical basis for the ongoing debate about the direction of veterinary education and curriculum development.

The Development, Description and Appraisal of an Emergent Multimethod Research Design to Study Workforce Changes in Integrated Care Interventions

PubMed Central

Luijkx, Katrien; Calciolari, Stefano; González-Ortiz, Laura G.

2017-01-01

Introduction: In this paper, we provide a detailed and explicit description of the processes and decisions underlying and shaping the emergent multimethod research design of our study on workforce changes in integrated chronic care. Theory and methods: The study was originally planned as mixed method research consisting of a preliminary literature review and quantitative check of these findings via a Delphi panel. However, when the findings of the literature review were not appropriate for quantitative confirmation, we chose to continue our qualitative exploration of the topic via qualitative questionnaires and secondary analysis of two best practice case reports. Results: The resulting research design is schematically described as an emergent and interactive multimethod design with multiphase combination timing. In doing so, we provide other researchers with a set of theory- and experience-based options to develop their own multimethod research and provide an example for more detailed and structured reporting of emergent designs. Conclusion and discussion: We argue that the terminology developed for the description of mixed methods designs should also be used for multimethod designs such as the one presented here. PMID:29042843

Development of a Chinese medicine assessment measure: an interdisciplinary approach using the delphi method.

PubMed

Schnyer, Rosa N; Conboy, Lisa A; Jacobson, Eric; McKnight, Patrick; Goddard, Thomas; Moscatelli, Francesca; Legedza, Anna T R; Kerr, Catherine; Kaptchuk, Ted J; Wayne, Peter M

2005-12-01

The diagnostic framework and clinical reasoning process in Chinese medicine emphasizes the contextual and qualitative nature of a patient's illness. Chinese medicine assessment data may help interpret clinical outcomes. As part of a study aimed at assessing the validity and improving the inter-rater reliability of the Chinese diagnostic process, a structured assessment instrument was developed for use in clinical trials of acupuncture and other Chinese medical therapies. To foster collaboration and maximize resources and information, an interdisciplinary advisory team was assembled. Under the guidance of two group process facilitators, and in order to establish whether the assessment instrument was consistent with accepted Chinese medicine diagnostic categories (face validity) and included the full range of each concept's meaning (content validity), a panel of Traditional Chinese Medicine (TCM) expert clinicians was convened and their responses were organized using the Delphi process, an iterative, anonymous, idea-generating and consensus-building process. An aggregate rating measure was obtained by taking the mean of mean ratings for each question across all 10 experts. Over three rounds, the overall rating increased from 7.4 (SD = 1.3) in Round 1 to 9.1 (SD = 0.5) in Round 3. The level of agreement among clinicians was measured by a decrease in SD. The final instrument TEAMSI-TCM (Traditional East Asian Medicine Structured Interview, TCM version) uses the pattern differentiation model characteristic of TCM. This modular, dynamic version was specifically designed to assess women, with a focus on gynecologic conditions; with modifications it can be adapted for use with other populations and conditions. TEAMSI-TCM is a prescriptive instrument that guides clinicians to use the proper indicators, combine them in a systematic manner, and generate conclusions. In conjunction with treatment manualization and training it may serve to increase inter-rater reliability and inter-trial reproducibility in Chinese medicine clinical trials. Testing of the validity and reliability of this instrument currently is underway.

Developing a primary care patient measure of safety (PC PMOS): a modified Delphi process and face validity testing.

PubMed

Hernan, Andrea L; Giles, Sally J; O'Hara, Jane K; Fuller, Jeffrey; Johnson, Julie K; Dunbar, James A

2016-04-01

Patients are a valuable source of information about ways to prevent harm in primary care and are in a unique position to provide feedback about the factors that contribute to safety incidents. Unlike in the hospital setting, there are currently no tools that allow the systematic capture of this information from patients. The aim of this study was to develop a quantitative primary care patient measure of safety (PC PMOS). A two-stage approach was undertaken to develop questionnaire domains and items. Stage 1 involved a modified Delphi process. An expert panel reached consensus on domains and items based on three sources of information (validated hospital PMOS, previous research conducted by our study team and literature on threats to patient safety). Stage 2 involved testing the face validity of the questionnaire developed during stage 1 with patients and primary care staff using the 'think aloud' method. Following this process, the questionnaire was revised accordingly. The PC PMOS was received positively by both patients and staff during face validity testing. Barriers to completion included the length, relevance and clarity of questions. The final PC PMOS consisted of 50 items across 15 domains. The contributory factors to safety incidents centred on communication, access to care, patient-related factors, organisation and care planning, task performance and information flow. This is the first tool specifically designed for primary care settings, which allows patients to provide feedback about factors contributing to potential safety incidents. The PC PMOS provides a way for primary care organisations to learn about safety from the patient perspective and make service improvements with the aim of reducing harm in this setting. Future research will explore the reliability and construct validity of the PC PMOS. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Assessment of mastication in healthy children and children with cerebral palsy: a validity and consistency study.

PubMed

Remijn, L; Speyer, R; Groen, B E; Holtus, P C M; van Limbeek, J; Nijhuis-van der Sanden, M W G

2013-05-01

The aim of this study was to develop the Mastication Observation and Evaluation instrument for observing and assessing the chewing ability of children eating solid and lumpy foods. This study describes the process of item definition and item selection and reports the content validity, reproducibility and consistency of the instrument. In the developmental phase, 15 experienced speech therapists assessed item relevance and descriptions over three Delphi rounds. Potential items were selected based on the results from a literature review. At the initial Delphi round, 17 potential items were included. After three Delphi rounds, 14 items that regarded as providing distinctive value in assessment of mastication (consensus >75%) were included in the Mastication Observation and Evaluation instrument. To test item reproducibility and consistency, two experts and five students evaluated video recordings of 20 children (10 children with cerebral palsy aged 29-65 months and 10 healthy children aged 11-42 months) eating bread and a biscuit. Reproducibility was estimated by means of the intraclass correlation coefficient (ICC). With the exception of one item concerning chewing duration, all items showed good to excellent intra-observer agreement (ICC students: 0.73-1.0). With the exception of chewing duration and number of swallows, inter-observer agreement was fair to excellent for all items (ICC experts: 0.68-1.0 and ICC students: 0.42-1.0). Results indicate that this tool is a feasible instrument and could be used in clinical practice after further research is completed on the reliability of the tool. © 2013 Blackwell Publishing Ltd.

Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

PubMed

Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

2016-07-01

To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

Which information on women's issues in epilepsy does a community pharmacist need to know? A Delphi consensus study.

PubMed

Shawahna, Ramzi

2017-12-01

The aim of this study was to develop and achieve consensus on a core list of important knowledge items that community pharmacists should know on women's issues in epilepsy. This was a consensual study using a modified Delphi technique. Knowledge items were collected from the literature and from nine key contacts who were interviewed on their views on what information community pharmacists should have on women's issues in epilepsy. More knowledge items were suggested by five researchers with interest in women's issues who were contacted to rate and comment on the knowledge items collected. Two iterative Delphi rounds were conducted among a panel of pharmacists (n=30) to achieve consensus on the knowledge items to be included in the core list. Ten panelists ranked the knowledge items by their importance using the Analytical Hierarchy Process (AHP). Consensus was achieved to include 68 knowledge under 13 categories in the final core list. Items ranked by their importance were related to the following: teratogenicity (10.3%), effect of pregnancy on epilepsy (7.4%), preconception counseling (10.3%), bone health (5.9%), catamenial epilepsy (7.4%), menopause and hormonal replacement therapy (2.9%), contraception (14.7%), menstrual disorders and infertility (8.8%), eclampsia (2.9%), breastfeeding (4.4%), folic acid and vitamin K (5.9%), counseling on general issues (14.7%), and sexuality (4.4%). Using consensual knowledge lists might promote congruence in educating and/or training community pharmacists on women's issues in epilepsy. Future studies are needed to investigate if such lists can improve health services provided to women with epilepsy (WWE). Copyright © 2017 Elsevier Inc. All rights reserved.

Surviving critical illness: what is next? An expert consensus statement on physical rehabilitation after hospital discharge.

PubMed

Major, M E; Kwakman, R; Kho, M E; Connolly, B; McWilliams, D; Denehy, L; Hanekom, S; Patman, S; Gosselink, R; Jones, C; Nollet, F; Needham, D M; Engelbert, R H H; van der Schaaf, M

2016-10-29

The study objective was to obtain consensus on physical therapy (PT) in the rehabilitation of critical illness survivors after hospital discharge. Research questions were: what are PT goals, what are recommended measurement tools, and what constitutes an optimal PT intervention for survivors of critical illness? A Delphi consensus study was conducted. Panelists were included based on relevant fields of expertise, years of clinical experience, and publication record. A literature review determined five themes, forming the basis for Delphi round one, which was aimed at generating ideas. Statements were drafted and ranked on a 5-point Likert scale in two additional rounds with the objective to reach consensus. Results were expressed as median and semi-interquartile range, with the consensus threshold set at ≤0.5. Ten internationally established researchers and clinicians participated in this Delphi panel, with a response rate of 80 %, 100 %, and 100 % across three rounds. Consensus was reached on 88.5 % of the statements, resulting in a framework for PT after hospital discharge. Essential handover information should include information on 15 parameters. A core set of outcomes should test exercise capacity, skeletal muscle strength, function in activities of daily living, mobility, quality of life, and pain. PT interventions should include functional exercises, circuit and endurance training, strengthening exercises for limb and respiratory muscles, education on recovery, and a nutritional component. Screening tools to identify impairments in other health domains and referral to specialists are proposed. A consensus-based framework for optimal PT after hospital discharge is proposed. Future research should focus on feasibility testing of this framework, developing risk stratification tools and validating core outcome measures for ICU survivors.

POPI (Pediatrics: Omission of Prescriptions and Inappropriate Prescriptions): Development of a Tool to Identify Inappropriate Prescribing

PubMed Central

Prot-Labarthe, Sonia; Weil, Thomas; Angoulvant, François; Boulkedid, Rym; Alberti, Corinne; Bourdon, Olivier

2014-01-01

Introduction Rational prescribing for children is an issue for all countries and has been inadequately studied. Inappropriate prescriptions, including drug omissions, are one of the main causes of medication errors in this population. Our aim is to develop a screening tool to identify omissions and inappropriate prescriptions in pediatrics based on French and international guidelines. Methods A selection of diseases was included in the tool using data from social security and hospital statistics. A literature review was done to obtain criteria which could be included in the tool called POPI. A 2-round-Delphi consensus technique was used to establish the content validity of POPI; panelists were asked to rate their level of agreement with each proposition on a 9-point Likert scale and add suggestions if necessary. Results 108 explicit criteria (80 inappropriate prescriptions and 28 omissions) were obtained and submitted to a 16-member expert panel (8 pharmacists, 8 pediatricians hospital-based −50%- or working in community −50%-). Criteria were categorized according to the main physiological systems (gastroenterology, respiratory infections, pain, neurology, dermatology and miscellaneous). Each criterion was accompanied by a concise explanation as to why the practice is potentially inappropriate in pediatrics (including references). Two round of Delphi process were completed via an online questionnaire. 104 out of the 108 criteria submitted to experts were selected after 2 Delphi rounds (79 inappropriate prescriptions and 25 omissions). Discussion Conclusion POPI is the first screening-tool develop to detect inappropriate prescriptions and omissions in pediatrics based on explicit criteria. Inter-user reliability study is necessary before using the tool, and prospective study to assess the effectiveness of POPI is also necessary. PMID:24978045

Developing a set of consensus indicators to support maternity service quality improvement: using Core Outcome Set methodology including a Delphi process.

PubMed

Bunch, K J; Allin, B; Jolly, M; Hardie, T; Knight, M

2018-05-16

To develop a core metric set to monitor the quality of maternity care. Delphi process followed by a face-to-face consensus meeting. English maternity units. Three representative expert panels: service designers, providers and users. Maternity care metrics judged important by participants. Participants were asked to complete a two-phase Delphi process, scoring metrics from existing local maternity dashboards. A consensus meeting discussed the results and re-scored the metrics. In all, 125 distinct metrics across six domains were identified from existing dashboards. Following the consensus meeting, 14 metrics met the inclusion criteria for the final core set: smoking rate at booking; rate of birth without intervention; caesarean section delivery rate in Robson group 1 women; caesarean section delivery rate in Robson group 2 women; caesarean section delivery rate in Robson group 5 women; third- and fourth-degree tear rate among women delivering vaginally; rate of postpartum haemorrhage of ≥1500 ml; rate of successful vaginal birth after a single previous caesarean section; smoking rate at delivery; proportion of babies born at term with an Apgar score <7 at 5 minutes; proportion of babies born at term admitted to the neonatal intensive care unit; proportion of babies readmitted to hospital at <30 days of age; breastfeeding initiation rate; and breastfeeding rate at 6-8 weeks. Core outcome set methodology can be used to incorporate the views of key stakeholders in developing a core metric set to monitor the quality of care in maternity units, thus enabling improvement. Achieving consensus on core metrics for monitoring the quality of maternity care. © 2018 The Authors. BJOG: An International Journal of Obstetrics and Gynaecology published by John Wiley & Sons Ltd on behalf of Royal College of Obstetricians and Gynaecologists.

A core outcome set for clinical trials on non-specific low back pain: study protocol for the development of a core domain set.

PubMed

Chiarotto, Alessandro; Terwee, Caroline B; Deyo, Richard A; Boers, Maarten; Lin, Chung-Wei Christine; Buchbinder, Rachelle; Corbin, Terry P; Costa, Leonardo O P; Foster, Nadine E; Grotle, Margreth; Koes, Bart W; Kovacs, Francisco M; Maher, Chris G; Pearson, Adam M; Peul, Wilco C; Schoene, Mark L; Turk, Dennis C; van Tulder, Maurits W; Ostelo, Raymond W

2014-12-26

Low back pain (LBP) is one of the most disabling and costly disorders affecting modern society, and approximately 90% of patients are labelled as having non-specific LBP (NSLBP). Several interventions for patients with NSLBP have been assessed in clinical trials, but heterogeneous reporting of outcomes in these trials has hindered comparison of results and performance of meta-analyses. Moreover, there is a risk of selective outcome reporting bias. To address these issues, the development of a core outcome set (COS) that should be measured in all clinical trials for a specific health condition has been recommended. A standardized set of outcomes for LBP was proposed in 1998, however, with evolution in COS development methodology, new instruments, interventions, and understanding of measurement properties, it is appropriate to update that proposal. This protocol describes the methods used in the initial step in developing a COS for NSLBP, namely, establishing a core domain set that should be measured in all clinical trials. An International Steering Committee including researchers, clinicians, and patient representatives from four continents was formed to guide the development of this COS. The approach of initiatives like Core Outcome Measures in Effectiveness Trials (COMET) and Outcome Measures in Rheumatology (OMERACT) was followed. Participants were invited to participate in a Delphi study aimed at generating a consensus-based core domain set for NSLBP. A list of potential core domains was drafted and presented to the Delphi participants who were asked to judge which domains were core. Participant suggestions about overlap, aggregation, or addition of potential core domains were addressed during the study. The patients' responses were isolated to assess whether there was substantial disagreement with the rest of the Delphi panel. A priori thresholds for consensus were established before each Delphi round. All participants' responses were analysed from a quantitative and qualitative perspective to ascertain that no substantial discrepancies between the two approaches emerged. We present the initial step in developing a COS for NSLBP. The next step will be to determine which measurement instruments adequately cover the domains.

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

Development of Cardiovascular Quality Indicators for Rheumatoid Arthritis: Results from an International Expert Panel Using a Novel Online Process

PubMed Central

Barber, Claire E. H.; Marshall, Deborah A; Alvarez, Nanette; John Mancini, G. B.; Lacaille, Diane; Keeling, Stephanie; Aviña-Zubieta, J. Antonio; Khodyakov, Dmitry; Barnabe, Cheryl; Faris, Peter; Smith, Alexa; Noormohamed, Raheem; Hazlewood, Glen; Martin, Liam O.; Esdaile, John M.

2016-01-01

Objective Patients with rheumatoid arthritis (RA) have a high risk of premature cardiovascular disease (CVD). We developed CVD quality indicators (QIs) for screening and use in Rheumatology clinics. Methods A systematic review of the literature on CVD risk reduction in RA and the general population was conducted. Based on the best practices identified from this review, a draft set of 12 candidate QIs were presented to a Canadian panel of rheumatologists and cardiologists (n=6) from three academic centers to achieve consensus on the QI specifications. The resulting 11 QIs were then evaluated by an online modified-Delphi panel of multidisciplinary health professionals and patients (n = 43) to determine their relevance, validity and feasibility in three rounds of online voting and threaded discussion using a modified RAND/UCLA Appropriateness Methodology. Results Response rates for the online panel were 86%. All 11 QIs were rated as highly relevant, valid and feasible (median rating ≥7 on a 1–9 scale) with no significant disagreement. The final QI set addresses the following themes: communication to primary care about increased CV risk in RA, CV risk assessment, defining smoking status and providing cessation counseling, screening and addressing hypertension, dyslipidemia and diabetes, exercise recommendations, body mass index screening and lifestyle counseling, minimizing corticosteroid use and communicating to patients at high risk of CVD about the risks/benefits of non-steroidal anti-inflammatory drugs. Conclusion Eleven QIs for CVD care in RA patients have been developed and are rated as highly relevant, valid and feasible by an international multidisciplinary panel. PMID:26178275

Ottawa Panel evidence-based clinical practice guidelines for therapeutic exercise in the management of hip osteoarthritis.

PubMed

Brosseau, Lucie; Wells, George A; Pugh, Arlanna G; Smith, Christine Am; Rahman, Prinon; Àlvarez Gallardo, Inmaculada C; Toupin-April, Karine; Loew, Laurianne; De Angelis, Gino; Cavallo, Sabrina; Taki, Jade; Marcotte, Rachel; Fransen, Marlene; Hernandez-Molina, Gabriela; Kenny, Glen P; Regnaux, Jean-Philippe; Lefevre-Colau, Marie-Martine; Brooks, Sydney; Laferriere, Lucie; McLean, Linda; Longchamp, Guy

2016-10-01

The primary objective is to identify effective land-based therapeutic exercise interventions and provide evidence-based recommendations for managing hip osteoarthritis. A secondary objective is to develop an Ottawa Panel evidence-based clinical practice guideline for hip osteoarthritis. The search strategy and modified selection criteria from a Cochrane review were used. Studies included hip osteoarthritis patients in comparative controlled trials with therapeutic exercise interventions. An Expert Panel arrived at a Delphi survey consensus to endorse the recommendations. The Ottawa Panel hierarchical alphabetical grading system (A, B, C+, C, D, D+, or D-) considered the study design (level I: randomized controlled trial and level II: controlled clinical trial), statistical significance (p < 0.5), and clinical importance (⩾15% improvement). Four high-quality studies were included, which demonstrated that variations of strength training, stretching, and flexibility exercises are generally effective for improving the management of hip osteoarthritis. Strength training exercises displayed the greatest improvements for pain (Grade A), disability (Grades A and C+), physical function (Grade A), stiffness (Grade A), and range of motion (Grade A) within a short time period (8-24 weeks). Stretching also greatly improved physical function (Grade A), and flexibility exercises improved pain (Grade A), range of motion (Grade A), physical function (Grade A), and stiffness (Grade C+). The Ottawa Panel recommends land-based therapeutic exercise, notably strength training, for management of hip osteoarthritis in reducing pain, stiffness and self-reported disability, and improving physical function and range of motion. © The Author(s) 2015.

Guideline for Reporting Interventions on Spinal Manipulative Therapy: Consensus on Interventions Reporting Criteria List for Spinal Manipulative Therapy (CIRCLe SMT).

PubMed

Groeneweg, Ruud; Rubinstein, Sidney M; Oostendorp, Rob A B; Ostelo, Raymond W J G; van Tulder, Maurits W

2017-02-01

The aim of the Consensus on Interventions Reporting Criteria List for Spinal Manipulative Therapy (CIRCLe SMT) study was to develop a criteria list for reporting spinal manipulative therapy (SMT). A Delphi procedure was conducted from September 2011 to April 2013 and consisted of international experts in the field of SMT. The authors formed a steering committee and invited participants, selected initial items, structured the comments of the participants after each Delphi round, and formulated the feedback. To ensure content validity, a large number of international experts from different SMT-related disciplines were invited to participate. A workshop was organized following the consensus phase, and it was used to discuss and refine the wording of the items. In total, 123 experts from 18 countries participated. These experts included clinicians (70%), researchers (93%), and academics working in the area of SMT (27%), as well as journal editors (14%). (Note: The total is more than 100% because most participants reported 2 jobs.) Three Delphi rounds were necessary to reach a consensus. The criteria list comprised 24 items under 5 domains, including (1) rationale of the therapy, (2) description of the intervention, (3) SMT techniques, (4) additional intervention/techniques, and (5) quantitative data. A valid criteria list was constructed with the aim of promoting consistency in reporting SMT intervention in scientific publications. Copyright © 2016. Published by Elsevier Inc.

Guidelines for Developing and Reporting Machine Learning Predictive Models in Biomedical Research: A Multidisciplinary View.

PubMed

Luo, Wei; Phung, Dinh; Tran, Truyen; Gupta, Sunil; Rana, Santu; Karmakar, Chandan; Shilton, Alistair; Yearwood, John; Dimitrova, Nevenka; Ho, Tu Bao; Venkatesh, Svetha; Berk, Michael

2016-12-16

As more and more researchers are turning to big data for new opportunities of biomedical discoveries, machine learning models, as the backbone of big data analysis, are mentioned more often in biomedical journals. However, owing to the inherent complexity of machine learning methods, they are prone to misuse. Because of the flexibility in specifying machine learning models, the results are often insufficiently reported in research articles, hindering reliable assessment of model validity and consistent interpretation of model outputs. To attain a set of guidelines on the use of machine learning predictive models within clinical settings to make sure the models are correctly applied and sufficiently reported so that true discoveries can be distinguished from random coincidence. A multidisciplinary panel of machine learning experts, clinicians, and traditional statisticians were interviewed, using an iterative process in accordance with the Delphi method. The process produced a set of guidelines that consists of (1) a list of reporting items to be included in a research article and (2) a set of practical sequential steps for developing predictive models. A set of guidelines was generated to enable correct application of machine learning models and consistent reporting of model specifications and results in biomedical research. We believe that such guidelines will accelerate the adoption of big data analysis, particularly with machine learning methods, in the biomedical research community. ©Wei Luo, Dinh Phung, Truyen Tran, Sunil Gupta, Santu Rana, Chandan Karmakar, Alistair Shilton, John Yearwood, Nevenka Dimitrova, Tu Bao Ho, Svetha Venkatesh, Michael Berk. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 16.12.2016.

[Competency requirements for executives in healthcare and social services organizations: Results of a Delphi study].

PubMed

Pielach, Martin; Schubert, Hans-Joachim

2018-02-07

Leadership in social services and healthcare organizations is marked by high levels of complexity and contradiction, which cannot be fully explained by politically, economically, and socially induced changes. Rather, it is the particularities of service provision in healthcare and social services that confront executives with specific demands. This study aimed to capture and prioritize required leadership competencies in healthcare and social services organizations. A three-step Delphi study was conducted with executives and managerial staff, who are job holders and thus experts on their occupation. For the first step, an explorative qualitative approach was chosen to record general opinion without prior assumptions. The following two steps weighted and selected the competency requirements in step one using rating- and ranking procedures. Results of the Delphi inquiry imply high relevance of social and personal competencies. Approximately 66 % of the competencies assessed in round three were social and personal competencies. 12 out of the 15 highest rated competencies in Delphi step three can be assigned to these two competency categories. In contrast, the importance of professional as well as methodical competencies was rated as less important. Only two methodical competencies and one professional competency were rated as very important by the panel. Nevertheless, the importance of executive professional and methodical competencies in healthcare and social services organizations is emphasized by high ratings of the competencies "Sector-specific expertise" and "Analytical skills". The methodical competency "Analytical skills" was identified by the Delphi respondents as the most important competency requirement. Social and personal requirements are of primary importance for leadership in healthcare and social services organizations. These results mostly correspond to leadership requirements posited in the literature on leadership skills. Emphasis should be on the specific relevance of professionalism, which can be traced back to the high proportion of professional activities in everyday working practices, the self-conception of executive staff based on professional qualifications and profession as well as the organizational form as expert organization. Healthcare and social services organizations are expert organizations with a strong emphasis on professional expertise. Professional knowledge is the most important means of production of expert organizations and imperative to leadership in healthcare and social services organization, given the high integration of executives into the professional system. Despite the dominance of social and personal competency requirements, the most important competency requirement is "Analytical skills", which can be described as the basis of every action. Copyright © 2018. Published by Elsevier GmbH.

75 FR 28655 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-21

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture, a.../Electronic Architecture, a subsidiary of Delphi Corporation, including on-site leased [[Page 28656

Delphi Method Validation of a Procedural Performance Checklist for Insertion of an Ultrasound-Guided Internal Jugular Central Line.

PubMed

Hartman, Nicholas; Wittler, Mary; Askew, Kim; Manthey, David

2016-01-01

Placement of ultrasound-guided central lines is a critical skill for physicians in several specialties. Improving the quality of care delivered surrounding this procedure demands rigorous measurement of competency, and validated tools to assess performance are essential. Using the iterative, modified Delphi technique and experts in multiple disciplines across the United States, the study team created a 30-item checklist designed to assess competency in the placement of ultrasound-guided internal jugular central lines. Cronbach α was .94, indicating an excellent degree of internal consistency. Further validation of this checklist will require its implementation in simulated and clinical environments. © The Author(s) 2014.

Priorities for implementing nutritional science into practice to optimize military performance.

PubMed

Elfenbaum, Pamela; Crawford, Cindy; Enslein, Viviane; Berry, Kevin

2017-06-01

The Metabolically Optimized Brain study explores nutritional science believed to be ready to place into practice to help improve US service member mission-readiness and performance. To this end, an implementation expert panel considered how the US Department of Defense Subsistence Food Service Program, which is operated by each branch of the military in dining facilities within the continental United States, could apply the best nutritional science in a cost-effective manner. The work of this panel was facilitated through a series of thematic conversations guided by evidence generated through systematic reviews, which were performed to identify systems and process gaps and propose possible solutions. The expert panel used a Delphi method of multiple voting, and ultimately proposed 11 systems changes, of which 6 were ranked as highest priority. The proposed highest priority changes were then discussed by the participants with additional stakeholders. The process described here highlights how experts from different sectors operating in a complex system of subsystems can come together to cross talk, identify gaps, and propose mutually beneficial system and process changes to improve the alignment of nutritional science and institutional food-service practice. © The Author(s) 2017. Published by Oxford University Press on behalf of the International Life Sciences Institute. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Evaluation of a procedure to assess the adverse effects of illicit drugs.

PubMed

van Amsterdam, J G C; Best, W; Opperhuizen, A; de Wolff, F A

2004-02-01

The assessment procedure of new synthetic illicit drugs that are not documented in the UN treaty on psychotropic drugs was evaluated using a modified Electre model. Drugs were evaluated by an expert panel via the open Delphi approach, where the written score was discussed on 16 items, covering medical, health, legal, and criminalistic issues of the drugs. After this face-to-face discussion the drugs were scored again. Taking the assessment of ketamine as an example, it appeared that each expert used its own scale to score, and that policymakers do not score deviant from experts trained in the medical-biological field. Of the five drugs evaluated by the panel, p-methoxy-metamphetamine (PMMA), gamma-hydroxybutyric acid (GHB), and 4-methylthio-amphetamine (MTA) were assessed as more adverse than ketamine and psilocine and psilocybine-containing mushrooms. Whereas some experts slightly adjusted during the assessment procedure their opinion on ketamine and PMMA, the opinion on mushrooms was not affected by the discussion held between the two scoring rounds. All experts rank the five drugs in a similar way on the adverse effect scale i.e., concordance scale of the Electre model, indicating unanimity in the expert panel with respect to the risk classification of these abused drugs.

Development and Validation of the Agency for Healthcare Research and Quality Measures of Potentially Preventable Emergency Department (ED) Visits: The ED Prevention Quality Indicators for General Health Conditions.

PubMed

Davies, Sheryl; Schultz, Ellen; Raven, Maria; Wang, Nancy Ewen; Stocks, Carol L; Delgado, Mucio Kit; McDonald, Kathryn M

2017-10-01

To develop and validate rates of potentially preventable emergency department (ED) visits as indicators of community health. Agency for Healthcare Research and Quality, Healthcare Cost and Utilization Project 2008-2010 State Inpatient Databases and State Emergency Department Databases. Empirical analyses and structured panel reviews. Panels of 14-17 clinicians and end users evaluated a set of ED Prevention Quality Indicators (PQIs) using a Modified Delphi process. Empirical analyses included assessing variation in ED PQI rates across counties and sensitivity of those rates to county-level poverty, uninsurance, and density of primary care physicians (PCPs). ED PQI rates varied widely across U.S. communities. Indicator rates were significantly associated with county-level poverty, median income, Medicaid insurance, and levels of uninsurance. A few indicators were significantly associated with PCP density, with higher rates in areas with greater density. A clinical and an end-user panel separately rated the indicators as having strong face validity for most uses evaluated. The ED PQIs have undergone initial validation as indicators of community health with potential for use in public reporting, population health improvement, and research. © Health Research and Educational Trust.

Practical Considerations for Conducting Delphi Studies: The Oracle Enters a New Age.

ERIC Educational Resources Information Center

Eggers, Renee M.; Jones, Charles M.

1998-01-01

In addition to giving an overview of Delphi methodology and describing the methodology used by the researchers in two Delphi studies, the authors provide information about electronic communication in Delphi studies. Also provided are suggestions that can be used in a Delphi study involving any form of communication. (SLD)

A Consensus Model: Shifting assessment practices in dietetics tertiary education.

PubMed

Bacon, Rachel; Kellett, Jane; Dart, Janeane; Knight-Agarwal, Cathy; Mete, Rebecca; Ash, Susan; Palermo, Claire

2018-02-21

The aim of this research was to evaluate a Consensus Model for competency-based assessment. An evaluative case study was used to allow a holistic examination of a constructivist-interpretivist programmatic model of assessment. Using a modified Delphi process, the competence of all 29 students enrolled in their final year of a Master of Nutrition and Dietetics course was assessed by a panel (with expertise in competency-based assessment; industry and academic representation) from a course e-portfolio (that included the judgements of student performance made by worksite educators) and a panel interview. Data were triangulated with assessments from a capstone internship. Qualitative descriptive studies with worksite educators (focus groups n = 4, n = 5, n = 8) and students (personal interviews n = 29) explored stakeholder experiences analysed using thematic analysis. Panel consensus was achieved for all cases by the third-round and corroborated by internship outcomes. For 34% of students this differed to the 'interpretations' of their performance made by their worksite educator/s. Emerging qualitative themes from stakeholder data found the model: (i) supported sustainable assessment practices; (ii) shifted the power relationship between students and worksite educators and (iii) provided a fair method to assess competence. To maximise benefits, more refinement, resources and training are required. This research questions competency-based assessment practices based on discrete placement units and supports a constructivist-interpretivist programmatic approach where evidence across a whole course of study is considered by a panel of assessors. © 2018 Dietitians Association of Australia.

Explicit criteria for prioritization of cataract surgery

PubMed Central

Ma Quintana, José; Escobar, Antonio; Bilbao, Amaia

2006-01-01

Background Consensus techniques have been used previously to create explicit criteria to prioritize cataract extraction; however, the appropriateness of the intervention was not included explicitly in previous studies. We developed a prioritization tool for cataract extraction according to the RAND method. Methods Criteria were developed using a modified Delphi panel judgment process. A panel of 11 ophthalmologists was assembled. Ratings were analyzed regarding the level of agreement among panelists. We studied the effect of all variables on the final panel score using general linear and logistic regression models. Priority scoring systems were developed by means of optimal scaling and general linear models. The explicit criteria developed were summarized by means of regression tree analysis. Results Eight variables were considered to create the indications. Of the 310 indications that the panel evaluated, 22.6% were considered high priority, 52.3% intermediate priority, and 25.2% low priority. Agreement was reached for 31.9% of the indications and disagreement for 0.3%. Logistic regression and general linear models showed that the preoperative visual acuity of the cataractous eye, visual function, and anticipated visual acuity postoperatively were the most influential variables. Alternative and simple scoring systems were obtained by optimal scaling and general linear models where the previous variables were also the most important. The decision tree also shows the importance of the previous variables and the appropriateness of the intervention. Conclusion Our results showed acceptable validity as an evaluation and management tool for prioritizing cataract extraction. It also provides easy algorithms for use in clinical practice. PMID:16512893

International Expert Panel Consensus Guidelines for Structure and Delivery of Qigong Exercise for Cancer Care Programming

PubMed Central

Klein, Penelope; Picard, George; Schneider, Roger; Oh, Byeongsang

2017-01-01

Integrative oncology, including Qigong, is a relatively new concept in modern healthcare. Evidence of benefits of Qigong in cancer survivors is emerging. As such, several cancer centers, world-wide, have introduced Qigong as part of integrative medicine within supportive cancer care programming. Qigong exercise programming content and quality varies among institutions due to lack of standard guidelines and, at present, relies solely on the instructor’s skills, knowledge, personal preferences and clinical experience. Development of consensus guidelines recommending the basic structure and delivery of Qigong programming in cancer care can potentiate quality assurance and reduce risk of harm. This applied qualitative research utilized a modified Delphi approach to formulate consensus guidelines. Guidelines were developed through discussions among an international expert panel (N = 13) with representation from Australia, Canada, Ireland, and the United States. Panel communication was predominantly conducted by email and occurred from November 2016 through February 2017. Expert panel work resulted in the generation of a work product: Qigong in Cancer Care Guidelines: A Working Paper including: (a) Consensus Guidelines for structure and delivery of Qigong exercise for Cancer care programming; (b) Consensus guidelines for instructor competence for teaching Qigong exercise for cancer care classes; (c) Screening tool for safe participation in Qigong exercise; (d) Class participant instructions for maintaining safety during Qigong exercise; and (e) Advice from the field. Generation of these resources is the first step in establishing recommendations for ‘best practice’ in the area of Qigong for cancer care programming.

Multinational evidence-based recommendations on how to investigate and follow-up undifferentiated peripheral inflammatory arthritis: integrating systematic literature research and expert opinion of a broad international panel of rheumatologists in the 3E Initiative

PubMed Central

Machado, P; Castrejon, I; Katchamart, W; Koevoets, R; Kuriya, B; Schoels, M; Silva-Fernández, L; Thevissen, K; Vercoutere, W; Villeneuve, E; Aletaha, D; Carmona, L; Landewé, R; van der Heijde, D; Bijlsma, J W J; Bykerk, V; Canhão, H; Catrina, A I; Durez, P; Edwards, C J; Mjaavatten, M D; Leeb, B F; Losada, B; Martín-Mola, E M; Martinez-Osuna, P; Montecucco, C; Müller-Ladner, U; Østergaard, M; Sheane, B; Xavier, R M; Zochling, J; Bombardier, C

2011-01-01

Objective To develop evidence-based recommendations on how to investigate and follow-up undifferentiated peripheral inflammatory arthritis (UPIA). Methods 697 rheumatologists from 17 countries participated in the 3E (Evidence, Expertise, Exchange) Initiative of 2008–9 consisting of three separate rounds of discussions and modified Delphi votes. In the first round 10 clinical questions were selected. A bibliographic team systematically searched Medline, Embase, the Cochrane Library and ACR/EULAR 2007–2008 meeting abstracts. Relevant articles were reviewed for quality assessment, data extraction and synthesis. In the second round each country elaborated a set of national recommendations. Finally, multinational recommendations were formulated and agreement among the participants and the potential impact on their clinical practice was assessed. Results A total of 39 756 references were identified, of which 250 were systematically reviewed. Ten multinational key recommendations about the investigation and follow-up of UPIA were formulated. One recommendation addressed differential diagnosis and investigations prior to establishing the operational diagnosis of UPIA, seven recommendations related to the diagnostic and prognostic value of clinical and laboratory assessments in established UPIA (history and physical examination, acute phase reactants, autoantibodies, radiographs, MRI and ultrasound, genetic markers and synovial biopsy), one recommendation highlighted predictors of persistence (chronicity) and the final recommendation addressed monitoring of clinical disease activity in UPIA. Conclusions Ten recommendations on how to investigate and follow-up UPIA in the clinical setting were developed. They are evidence-based and supported by a large panel of rheumatologists, thus enhancing their validity and practical use. PMID:20724311

Multinational evidence-based recommendations for the use of methotrexate in rheumatic disorders with a focus on rheumatoid arthritis: integrating systematic literature research and expert opinion of a broad international panel of rheumatologists in the 3E Initiative

PubMed Central

Visser, K; Katchamart, W; Loza, E; Martinez-Lopez, J A; Salliot, C; Trudeau, J; Bombardier, C; Carmona, L; van der Heijde, D; Bijlsma, J W J; Boumpas, D T; Canhao, H; Edwards, C J; Hamuryudan, V; Kvien, T K; Leeb, B F; Martín-Mola, E M; Mielants, H; Müller-Ladner, U; Murphy, G; Østergaard, M; Pereira, I A; Ramos-Remus, C; Valentini, G; Zochling, J; Dougados, M

2009-01-01

Objectives: To develop evidence-based recommendations for the use of methotrexate in daily clinical practice in rheumatic disorders. Methods: 751 rheumatologists from 17 countries participated in the 3E (Evidence, Expertise, Exchange) Initiative of 2007–8 consisting of three separate rounds of discussions and Delphi votes. Ten clinical questions concerning the use of methotrexate in rheumatic disorders were formulated. A systematic literature search in Medline, Embase, Cochrane Library and 2005–7 American College of Rheumatology/European League Against Rheumatism meeting abstracts was conducted. Selected articles were systematically reviewed and the evidence was appraised according to the Oxford levels of evidence. Each country elaborated a set of national recommendations. Finally, multinational recommendations were formulated and agreement among the participants and the potential impact on their clinical practice was assessed. Results: A total of 16 979 references was identified, of which 304 articles were included in the systematic reviews. Ten multinational key recommendations on the use of methotrexate were formulated. Nine recommendations were specific for rheumatoid arthritis (RA), including the work-up before initiating methotrexate, optimal dosage and route, use of folic acid, monitoring, management of hepatotoxicity, long-term safety, mono versus combination therapy and management in the perioperative period and before/during pregnancy. One recommendation concerned methotrexate as a steroid-sparing agent in other rheumatic diseases. Conclusions: Ten recommendations for the use of methotrexate in daily clinical practice focussed on RA were developed, which are evidence based and supported by a large panel of rheumatologists, enhancing their validity and practical use. PMID:19033291

Validating competencies for an undergraduate training program in rural medicine using the Delphi technique.

PubMed

Gouveia, Eneline Ah; Braga, Taciana D; Heráclio, Sandra A; Pessoa, Bruno Henrique S

2016-01-01

Worldwide, half the population lives in rural or remote areas; however, less than 25% of doctors work in such regions. Despite the continental dimensions of Brazil and its enormous cultural diversity, only some medical schools in this country offer students the opportunity to acquire work experience focused on medicine in rural or remote areas. The objective of the present study was to develop a framework of competencies for a longitudinal medical training program in rural medicine as an integrated part of medical training in Brazil. Two rounds of a modified version of the Delphi technique were conducted. Initially, a structured questionnaire was elaborated, based on a literature review. This questionnaire was submitted to the opinion of 20 panelists affiliated with the Rural Medicine Working Party of the Brazilian Society of Family and Community Medicine. The panelists were asked to evaluate the relevance of the competencies using a five-point Likert-type scale. In this study, the consensus criterion for a competency to be included in the framework was it being deemed 'very important' or 'indispensable' by a simple majority of the participants, while the criterion for excluding a competency was that a simple majority of the panel members considered that it 'should not be included' or was 'of little importance'. When a consensus was not reached regarding a given competency, it was submitted to a second round to enable the panelists to re-evaluate the now dichotomized questions. Compliance in responding to the questionnaire was better among the panelists predominantly involved in teaching activities (85%; n=12) compared to those working principally in patient care (45%; n=8). The questionnaire consisted of 26 core competencies and 165 secondary competencies. After evaluation by the specialists, all the 26 core competencies were classified as relevant, with none being excluded and only eight secondary competencies failing to achieve a consensus. No new competencies were suggested. Of the competencies that failed to reach a consensus in the first round, seven were excluded from the framework in the second round, with most of these being associated with hospital procedures. A framework of competencies for a program in rural medicine was developed and validated. It consists of 26 core competencies and 158 secondary competencies that should be useful when constructing competency-based curricula in rural medicine for medical education in Brazil.

Development of a quality instrument for assessing the spontaneous reports of ADR/ADE using Delphi method in China.

PubMed

Chen, Lixun; Jiang, Ling; Shen, Aizong; Wei, Wei

2016-09-01

The frequently low quality of submitted spontaneous reports is of an increasing concern; to our knowledge, no validated instrument exists for assessing case reports' quality comprehensively enough. This work was conducted to develop such a quality instrument for assessing the spontaneous reports of adverse drug reaction (ADR)/adverse drug event (ADE) in China. Initial evaluation indicators were generated using systematic and literature data analysis. Final indicators and their weights were identified using Delphi method. The final quality instrument was developed by adopting the synthetic scoring method. A consensus was reached after four rounds of Delphi survey. The developed quality instrument consisted of 6 first-rank indicators, 18 second-rank indicators, and 115 third-rank indicators, and each rank indicator has been weighted. It evaluates the quality of spontaneous reports of ADR/ADE comprehensively and quantitatively on six parameters: authenticity, duplication, regulatory, completeness, vigilance level, and reporting time frame. The developed instrument was tested with good reliability and validity, which can be used to comprehensively and quantitatively assess the submitted spontaneous reports of ADR/ADE in China.

Benchmarks for effective primary care-based nursing services for adults with depression: a Delphi study.

PubMed

McIlrath, Carole; Keeney, Sinead; McKenna, Hugh; McLaughlin, Derek

2010-02-01

This paper is a report of a study conducted to identify and gain consensus on appropriate benchmarks for effective primary care-based nursing services for adults with depression. Worldwide evidence suggests that between 5% and 16% of the population have a diagnosis of depression. Most of their care and treatment takes place in primary care. In recent years, primary care nurses, including community mental health nurses, have become more involved in the identification and management of patients with depression; however, there are no appropriate benchmarks to guide, develop and support their practice. In 2006, a three-round electronic Delphi survey was completed by a United Kingdom multi-professional expert panel (n = 67). Round 1 generated 1216 statements relating to structures (such as training and protocols), processes (such as access and screening) and outcomes (such as patient satisfaction and treatments). Content analysis was used to collapse statements into 140 benchmarks. Seventy-three benchmarks achieved consensus during subsequent rounds. Of these, 45 (61%) were related to structures, 18 (25%) to processes and 10 (14%) to outcomes. Multi-professional primary care staff have similar views about the appropriate benchmarks for care of adults with depression. These benchmarks could serve as a foundation for depression improvement initiatives in primary care and ongoing research into depression management by nurses.

Privacy impact assessment in the design of transnational public health information systems: the BIRO project.

PubMed

Di Iorio, C T; Carinci, F; Azzopardi, J; Baglioni, V; Beck, P; Cunningham, S; Evripidou, A; Leese, G; Loevaas, K F; Olympios, G; Federici, M Orsini; Pruna, S; Palladino, P; Skeie, S; Taverner, P; Traynor, V; Benedetti, M Massi

2009-12-01

To foster the development of a privacy-protective, sustainable cross-border information system in the framework of a European public health project. A targeted privacy impact assessment was implemented to identify the best architecture for a European information system for diabetes directly tapping into clinical registries. Four steps were used to provide input to software designers and developers: a structured literature search, analysis of data flow scenarios or options, creation of an ad hoc questionnaire and conduction of a Delphi procedure. The literature search identified a core set of relevant papers on privacy (n = 11). Technicians envisaged three candidate system architectures, with associated data flows, to source an information flow questionnaire that was submitted to the Delphi panel for the selection of the best architecture. A detailed scheme envisaging an "aggregation by group of patients" was finally chosen, based upon the exchange of finely tuned summary tables. Public health information systems should be carefully engineered only after a clear strategy for privacy protection has been planned, to avoid breaching current regulations and future concerns and to optimise the development of statistical routines. The BIRO (Best Information Through Regional Outcomes) project delivers a specific method of privacy impact assessment that can be conveniently used in similar situations across Europe.

A Quality, Benefit, Cost, and Financial Framework for Health Information Technology, E-Prescribing: A Delphi Study.

PubMed

DeMuro, Paul R; Ash, Joan; Middleton, Blackford; Fletcher, Justin; Madison, Cecelia J

2017-01-01

Little research has been conducted about the quality, benefits, costs, and financial considerations associated with health information technology (HIT), particularly informatics technologies, such as e-prescribing, from the perspective of all its stakeholders. This research effort sought to identify the stakeholders involved in e-prescribing and to identify and rank-order the positives and the negatives from the perspective of the stakeholders to create a framework to assist in the development of incentives and payment mechanisms which result in better managed care. The Delphi method was employed by enlisting a panel of experts. They were presented with the results of initial research in an online survey of questions which sought to prioritize the quality, benefit, cost, and financial effects of e-prescribing from the perspective of each stakeholder. From the results of this study, a framework was presented to framework experts. The experts added stakeholders and positives and negatives to the initial lists and rank-ordered the positives and negatives of e-prescribing from the perspective of each stakeholder. The aggregate results were summarized by category of stakeholder. The framework experts evaluated the framework. Positives and negatives can be rank-ordered from the perspective of each stakeholder. A useful framework was created.

Choosing Wisely: the American College of Rheumatology's Top 5 for pediatric rheumatology.

PubMed

Rouster-Stevens, Kelly A; Ardoin, Stacy P; Cooper, Ashley M; Becker, Mara L; Dragone, Leonard L; Huttenlocher, Anna; Jones, Karla B; Kolba, Karen S; Moorthy, L Nandini; Nigrovic, Peter A; Stinson, Jennifer N; Ferguson, Polly J

2014-05-01

To create a pediatric rheumatology Top 5 list as part of the American Board of Internal Medicine Foundation's Choosing Wisely campaign. Delphi surveys of a core group of representative pediatric rheumatology providers from across North America generated candidate Top 5 items. Items with high content agreement and perceived to be of prevalent use and of high impact were included in a survey of all American College of Rheumatology (ACR) members who identified themselves as providing care to pediatric patients. Items with the highest ratings were subjected to literature review and further evaluation. A total of 121 candidate items were proposed in the initial Delphi survey and were reduced to 28 items in subsequent surveys. These 28 items were sent to 1,198 rheumatology providers who care for pediatric patients, and 397 (33%) responded. Based upon survey data and literature review, the Top 5 items were identified. These items focused on testing for antinuclear antibodies, autoantibody panels, Lyme disease, methotrexate toxicity monitoring, and use of routine radiographs. The ACR pediatric rheumatology Top 5 is one of the first pediatric subspecialty-specific Choosing Wisely Top 5 lists and provides an opportunity for patients and providers to discuss appropriate use of health care in pediatric rheumatology. Copyright © 2014 by the American College of Rheumatology.

Institutional Oversight of Faculty-Industry Consulting Relationships in U.S. Medical Schools: A Delphi Study.

PubMed

Morain, Stephanie R; Joffe, Steven; Campbell, Eric G; Mello, Michelle M

2015-01-01

The conflicts of interest that may arise in relationships between academic researchers and industry continue to prompt controversy. The bulk of attention has focused on financial aspects of these relationships, but conflicts may also arise in the legal obligations that faculty acquire through consulting contracts. However, oversight of faculty members' consulting agreements is far less vigorous than for financial conflicts, creating the potential for faculty to knowingly or unwittingly contract away important rights and freedoms. Increased regulation could prevent this, but it is unclear what forms of oversight universities view as feasible and effective. In this article, we report on a Delphi study to evaluate several approaches for oversight of consulting agreements by medical schools. The panel was comprised of 11 senior administrators with responsibility for oversight of faculty consulting relationships. We found broad agreement among panelists regarding the importance of institutional oversight to protect universities' interests. There was strong support for two specific approaches: providing educational resources to faculty and submitting consulting agreements for institutional review. Notwithstanding the complexities of asserting authority to regulate private consulting agreements between faculty members and companies, medical school administrators reached consensus that several approaches to improving institutional oversight are feasible and useful. © 2015 American Society of Law, Medicine & Ethics, Inc.

Assisting an Australian Aboriginal and Torres Strait Islander person with gambling problems: a Delphi study.

PubMed

Bond, Kathy S; Dart, Katrina M; Jorm, Anthony F; Kelly, Claire M; Kitchener, Betty A; Reavley, Nicola J

2017-08-02

Gambling problems appear to be more prevalent in the Australian Aboriginal and Torres Strait Islander population than in the non-Indigenous population. Although gambling harms can be significant, treatment-seeking rates are low. The Delphi expert consensus method was used to develop a set of guidelines on how a family or community member can assist an Aboriginal or Torres Strait Islander person with gambling problems. Building on a previous systematic review of websites, books and journal articles a questionnaire was developed that contained items about the knowledge, skills and actions needed for supporting an Aboriginal or Torres Strait Islander person with gambling problems. These items were rated over three rounds by an expert panel comprising professionals who provide treatment to or conduct research with Aboriginal and Torres Strait Islander people with gambling problems. A total of 22 experts rated 407 helping statements according to whether they thought the statements should be included in these guidelines. There were 225 helping statements that were endorsed by at least 90% of participants. These endorsed statements were used to develop the guidelines. Experts were able to reach substantial consensus on how someone can recognise the signs of gambling problems and support an Aboriginal or Torres Strait Islander person to change.

Clinical utility of FDG-PET for the differential diagnosis among the main forms of dementia.

PubMed

Nestor, Peter J; Altomare, Daniele; Festari, Cristina; Drzezga, Alexander; Rivolta, Jasmine; Walker, Zuzana; Bouwman, Femke; Orini, Stefania; Law, Ian; Agosta, Federica; Arbizu, Javier; Boccardi, Marina; Nobili, Flavio; Frisoni, Giovanni Battista

2018-05-07

To assess the clinical utility of FDG-PET as a diagnostic aid for differentiating Alzheimer's disease (AD; both typical and atypical forms), dementia with Lewy bodies (DLB), frontotemporal lobar degeneration (FTLD), vascular dementia (VaD) and non-degenerative pseudodementia. A comprehensive literature search was conducted using the PICO model to extract evidence from relevant studies. An expert panel then voted on six different diagnostic scenarios using the Delphi method. The level of empirical study evidence for the use of FDG-PET was considered good for the discrimination of DLB and AD; fair for discriminating FTLD from AD; poor for atypical AD; and lacking for discriminating DLB from FTLD, AD from VaD, and for pseudodementia. Delphi voting led to consensus in all scenarios within two iterations. Panellists supported the use of FDG-PET for all PICOs-including those where study evidence was poor or lacking-based on its negative predictive value and on the assistance it provides when typical patterns of hypometabolism for a given diagnosis are observed. Although there is an overall lack of evidence on which to base strong recommendations, it was generally concluded that FDG-PET has a diagnostic role in all scenarios. Prospective studies targeting diagnostically uncertain patients for assessing the added value of FDG-PET would be highly desirable.

What is a Pharmacist: Opinions of Pharmacy Department Academics and Community Pharmacists on Competences Required for Pharmacy Practice

PubMed Central

Atkinson, Jeffrey; de Paepe, Kristien; Sánchez Pozo, Antonio; Rekkas, Dimitrios; Volmer, Daisy; Hirvonen, Jouni; Bozic, Borut; Skowron, Agnieska; Mircioiu, Constantin; Marcincal, Annie; Koster, Andries; Wilson, Keith; van Schravendijk, Chris; Wilkinson, Jamie

2016-01-01

This paper looks at the opinions of 241 European academics (who provide pharmacy education), and of 258 European community pharmacists (who apply it), on competences for pharmacy practice. A proposal for competences was generated by a panel of experts using Delphi methodology. Once finalized, the proposal was then submitted to a large, European-wide community of academics and practicing pharmacists in an additional Delphi round. Academics and community pharmacy practitioners recognized the importance of the notion of patient care competences, underlining the nature of the pharmacist as a specialist of medicines. The survey revealed certain discrepancies. Academics placed substantial emphasis on research, pharmaceutical technology, regulatory aspects of quality, etc., but these were ranked much lower by community pharmacists who concentrated more on patient care competences. In a sub-analysis of the data, we evaluated how perceptions may have changed since the 1980s and the introduction of the notions of competence and pharmaceutical care. This was done by splitting both groups into respondents < 40 and > 40 years old. Results for the subgroups were essentially statistically the same but with some different qualitative tendencies. The results are discussed in the light of the different conceptions of the professional identity of the pharmacist. PMID:28970385

Estimating community health needs against a Triple Aim background: What can we learn from current predictive risk models?

PubMed

Elissen, Arianne M J; Struijs, Jeroen N; Baan, Caroline A; Ruwaard, Dirk

2015-05-01

To support providers and commissioners in accurately assessing their local populations' health needs, this study produces an overview of Dutch predictive risk models for health care, focusing specifically on the type, combination and relevance of included determinants for achieving the Triple Aim (improved health, better care experience, and lower costs). We conducted a mixed-methods study combining document analyses, interviews and a Delphi study. Predictive risk models were identified based on a web search and expert input. Participating in the study were Dutch experts in predictive risk modelling (interviews; n=11) and experts in healthcare delivery, insurance and/or funding methodology (Delphi panel; n=15). Ten predictive risk models were analysed, comprising 17 unique determinants. Twelve were considered relevant by experts for estimating community health needs. Although some compositional similarities were identified between models, the combination and operationalisation of determinants varied considerably. Existing predictive risk models provide a good starting point, but optimally balancing resources and targeting interventions on the community level will likely require a more holistic approach to health needs assessment. Development of additional determinants, such as measures of people's lifestyle and social network, may require policies pushing the integration of routine data from different (healthcare) sources. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The process of collecting and evaluating evidences for the development of Guidelines for the management of rheumatoid arthritis, Japan College of Rheumatology 2014: Utilization of GRADE approach.

PubMed

Kojima, Masayo; Nakayama, Takeo; Kawahito, Yutaka; Kaneko, Yuko; Kishimoto, Mitsumasa; Hirata, Shintaro; Seto, Yohei; Endo, Hirahito; Ito, Hiromu; Kojima, Toshihisa; Nishida, Keiichiro; Matsushita, Isao; Tsutani, Kiichiro; Igarashi, Ataru; Kamatani, Naoyuki; Hasegawa, Mieko; Miyasaka, Nobuyuki; Yamanaka, Hisashi

2016-01-01

To describe the process of collecting and evaluating evidence for treating rheumatoid arthritis (RA) for developing clinical practice guidelines (CPGs) for rheumatologists in Japan. The task force comprised rheumatologists, epidemiologists, health economists, and patients. First, the critical outcomes were determined according to a three-round Delphi method, and eight topics with 88 clinical questions (CQs) were formulated. A systematic review of CQs was conducted using the Cochran Database of Systematic Reviews, MEDLINE, and Japana Centra Revvo Medicina (2003-2012). A questionnaire survey and focus group interview were performed to capture the patients' values and preferences. Data from the National Health Insurance drug price list and product information provided by pharmaceutical companies were collected to evaluate drug cost and safety. The GRADE approach was used to describe the evidence quality and determine the strength of recommendations. Recommendations were developed using a modified Delphi method by a multidisciplinary panel including patients. Eight meetings and frequent e-mail communications were conducted to draft a quality assessment of evidence and recommendations. For 88 CQs, recommendation statements were determined. Using the GRADE approach, new CPGs successfully addressed important clinical issues for treating RA patients. Timely updating of recommendations should be routinely considered.

Neonatal palliative care: developing consensus among neonatologists using the Delphi technique in Portugal.

PubMed

Mendes, Joana C C; Justo da Silva, Lincoln

2013-12-01

Pediatric palliative care in Portugal is improving, but there is still additional work to do concerning programs or guidelines for this subject. In Portugal, physicians are the stakeholders in the decision-making process with reference to the transition to palliative care in the neonatal intensive care unit, and it was considered very important to raise their awareness and motivation about neonatal palliative care. Our research was based on Catlin and Carter's protocol from 2002 and the main goal was to assess neonatologists' willingness to build a palliative care and end-of-life protocol that could be acceptable nationwide. The survey used the Delphi technique and was developed in 3 rounds. The expert panel was composed of 57 participants who represented 41% of the Portuguese neonatologists. The study was conducted via the Internet, based in a researcher-created private Web site, and e-mail was used for data collection and feedback. Neonatologists agreed on 7 areas: (1) planning (medical education, resources, and local), (2) prenatal palliative care, (3) neonatal palliative care criteria, (4) the parents (presenting neonatal palliative care to parents, including then in the daily care of newborns and in family-centered care), (5) physicians' needs, (6) pain and symptom management, and (7) end-of-life care (withholding/withdrawing ventilation and hydration/nutrition).

The competencies of Registered Nurses working in care homes: a modified Delphi study.

PubMed

Stanyon, Miriam Ruth; Goldberg, Sarah Elizabeth; Astle, Anita; Griffiths, Amanda; Gordon, Adam Lee

2017-07-01

registered Nurses (RNs) working in UK care homes receive most of their training in acute hospitals. At present the role of care home nursing is underdeveloped and it is seen as a low status career. We describe here research to define core competencies for RNs working in UK care homes. a two-stage process was adopted. A systematic literature review and focus groups with stakeholders provided an initial list of competencies. The competency list was modified over three rounds of a Delphi process with a multi-disciplinary expert panel of 28 members. twenty-two competencies entered the consensus process, all competencies were amended and six split. Thirty-one competencies were scored in round two, eight were agreed as essential, one competency was split into two. Twenty-four competencies were submitted for scoring in round three. In total, 22 competencies were agreed as essential for RNs working in care homes. A further 10 competencies did not reach consensus. the output of this study is an expert-consensus list of competencies for RNs working in care homes. This would be a firm basis on which to build a curriculum for this staff group. © The Author 2017. Published by Oxford University Press on behalf of the British Geriatrics Society.All rights reserved. For permissions, please email: journals.permissions@oup.com

Development of an instructional model for higher order thinking in science among secondary school students: a fuzzy Delphi approach

NASA Astrophysics Data System (ADS)

Saido, G. A. M.; Siraj, S.; DeWitt, D.; Al-Amedy, O. S.

2018-05-01

It is important for science students to develop higher order thinking (HOT) so that they can reason like scientists in the field. In this study, a HOT instructional model for secondary school science was developed with experts. The model would focus on reflective thinking (RT) and science process skills (SPS) among Grade 7 students. The Fuzzy Delphi Method (FDM) was employed to determine consensus among a panel of 20 experts. First, semi-structured interviews were conducted among the experts to generate the elements required for the model. Then, a questionnaire was developed using a seven-point linguistic scale based on these elements. The defuzzification value was calculated for each item, and a threshold value (d) of 0.75 was used to determine consensus for the items in the questionnaire. The alpha-cut value of >0.5 was used to select the phases and sub-phases in the model. The elements in the model were ranked to identify the sub-phases which had to be emphasised for implementation in instruction. Consensus was achieved on the phases of the HOT instructional model: engagement, investigation, explanation, conclusion and reflection. An additional 24 learning activities to encourage RT skills and SPS among students were also identified to develop HOT skills in science.

[Spanish cultural adaptation and psychometric validation of the Summary of Diabetes Self-Care Activities measure (SDSCA) among persons with type 2 diabetes mellitus].

PubMed

Caro-Bautista, Jorge; Morilla-Herrera, Juan Carlos; Villa-Estrada, Francisca; Cuevas-Fernández-Gallego, Magdalena; Lupiáñez-Pérez, Inmaculada; Morales-Asencio, José Miguel

2016-01-01

To undertake the cultural adaptation and the psychometric assessment of the Summary of Diabetes Self-Care Activities measure (SDSCA) in Spanish population with type 2 diabetes mellitus. Clinimetric validation study. Primary health care centers of District Malaga and Valle del Guadalhorce. Three hundred thirty-one persons with type 2 diabetes mellitus. The SDSCA validated in mexican population was subjected to semantic and content equivalence using a Delphi method, its legibility was determined by INFLESZ scale. Subsequently psychometric validation was conducted through exploratory and confirmatory factor analysis (herein after EFA and CFA), internal consistency, test-retest reliability and discriminant validity. Two rounds were needed to achieve the consensus in between the panel members. Then, the index provided a good readability. The EFA suggested a model with 3 factors (diet, exercise and self-analysis) with 7 items which explained 79.16% variance. The results of CFA showed a good fit of SDSCA-Sp. The Internal consistency was moderate to low (α-Cronbach =0.62) and test-retest reliability was evaluated in 198 patients (t=0.462-0.796, p<0.001) with a total correlation of 0.764 (p< 0.0001). The SDSCA-Sp is used, in a valid way to assess self-care in type 2 DM version in clinical practice and research with similar clinimetric properties to previous studies. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

Web-based dynamic Delphi: a new survey instrument

NASA Astrophysics Data System (ADS)

Yao, JingTao; Liu, Wei-Ning

2006-04-01

We present a mathematical model for a dynamic Delphi survey method which takes advantages of Web technology. A comparative study on the performance of the conventional Delphi method and the dynamic Delphi instrument is conducted. It is suggested that a dynamic Delphi survey may form a consensus quickly. However, the result may not be robust due to the judgement leaking issues.

Considerations when conducting e-Delphi research: a case study.

PubMed

Toronto, Coleen

2017-06-22

Background E-Delphi is a way to access a geographically dispersed group of experts. It is similar to other Delphi methods but conducted online. E-research methodologies, such as the e-Delphi method, have yet to undergo significant critical discussion. Aim To highlight some of the challenges nurse researchers may wish to consider when using e-Delphi in their research. Discussion This paper provides details about the author's approach to conducting an e-Delphi study in which a group of health literacy nurse experts (n=41) used an online survey platform to identify and prioritise essential health literacy competencies for registered nurses. Conclusion This paper advances methodological discourse about e-Delphi by critically assessing an e-Delphi case study. The online survey platform used in this study was advantageous for the researcher and the experts: the experts could participate at any time and place where the internet was available; the researcher could efficiently access a national group of experts, track responses and analyse data in each round. Implications for practice E-Delphi studies create opportunities for nurse researchers to conduct research nationally and internationally. Before conducting an e-Delphi study, researchers should carefully consider the design and methods for collecting data, to avoid challenges that could potentially compromise the quality of the findings. Researchers are encouraged to publish details about their approaches to e-Delphi studies, to advance the state of the science.

Quality indicators for the detection and management of chronic kidney disease in primary care in Canada derived from a modified Delphi panel approach.

PubMed

Tu, Karen; Bevan, Lindsay; Hunter, Katie; Rogers, Jess; Young, Jacqueline; Nesrallah, Gihad

2017-01-01

The detection and management of chronic kidney disease lies within primary care; however, performance measures applicable in the Canadian context are lacking. We sought to develop a set of primary care quality indicators for chronic kidney disease in the Canadian setting and to assess the current state of the disease's detection and management in primary care. We used a modified Delphi panel approach, involving 20 panel members from across Canada (10 family physicians, 7 nephrologists, 1 patient, 1 primary care nurse and 1 pharmacist). Indicators identified from peer-reviewed and grey literature sources were subjected to 3 rounds of voting to develop a set of quality indicators for the detection and management of chronic kidney disease in the primary care setting. The final indicators were applied to primary care electronic medical records in the Electronic Medical Record Administrative data Linked Database (EMRALD) to assess the current state of primary care detection and management of chronic kidney disease in Ontario. Seventeen indicators made up the final list, with 1 under the category Prevalence, Incidence and Mortality; 4 under Screening, Diagnosis and Risk Factors; 11 under Management; and 1 under Referral to a Specialist. In a sample of 139 993 adult patients not on dialysis, 6848 (4.9%) had stage 3 or higher chronic kidney disease, with the average age of patients being 76.1 years (standard deviation [SD] 11.0); 62.9% of patients were female. Diagnosis and screening for chronic kidney disease were poorly performed. Only 27.1% of patients with stage 3 or higher disease had their diagnosis documented in their cumulative patient profile. Albumin-creatinine ratio testing was only performed for 16.3% of patients with a low estimated glomerular filtration rate (eGFR) and for 28.5% of patients with risk factors for chronic kidney disease. Family physicians performed relatively better with the management of chronic kidney disease, with 90.4% of patients with stage 3 or higher disease having an eGFR performed in the previous 18 months and 83.1% having a blood pressure recorded in the previous 9 months. We propose a set of measurable indicators to evaluate the quality of the management of chronic kidney disease in primary care. These indicators may be used to identify opportunities to improve current practice in Canada.

Best practices recommendations for chiropractic care for infants, children, and adolescents: results of a consensus process.

PubMed

Hawk, Cheryl; Schneider, Michael; Ferrance, Randy J; Hewitt, Elise; Van Loon, Meghan; Tanis, Lora

2009-10-01

There has been much discussion about the role of chiropractic care in the evaluation, management, and treatment of pediatric patients. To date, no specific guidelines have been adopted that address this issue from an evidence based perspective. Previous systematic reviews of the chiropractic literature concluded that there is not yet a substantial body of high quality evidence from which to develop standard clinical guidelines. The purpose of this project was to develop recommendations on "best practices" related primarily to the evaluation and spinal manipulation aspects of pediatric chiropractic care; nonmanipulative therapies were not addressed in detail. Based on both clinical experience and the results of an extensive literature search, a set of seed documents was compiled to inform development of the seed statements. These were circulated electronically to the Delphi panel until consensus was reached, which was considered to be present when there was agreement by at least 80% of the panelists. A multidisciplinary panel of 37 was made up primarily of doctors of chiropractic with a mean of 18 years in practice, many with post-graduate training in pediatrics. The panel represented 5 countries and 17 states; there were members of the American Chiropractic Association, the International Chiropractors Association, and the International Chiropractic Pediatric Association. The panel reached a minimum of 80% consensus on the 51 seed statements after 4 rounds. A broad-based panel of experienced chiropractors was able to reach a high level (80%) of consensus regarding specific aspects of the chiropractic approach to clinical evaluation, management, and manual treatment for pediatric patients, based on both scientific evidence and clinical experience.

Identification of recruitment and retention strategies for rehabilitation professionals in Ontario, Canada: results from expert panels

PubMed Central

Tran, Diem; Hall, Linda McGillis; Davis, Aileen; Landry, Michel D; Burnett, Dawn; Berg, Katherine; Jaglal, Susan

2008-01-01

Background Demand for rehabilitation services is expected to increase due to factors such as an aging population, workforce pressures, rise in chronic and complex multi-system disorders, advances in technology, and changes in interprofessional health service delivery models. However, health human resource (HHR) strategies for Canadian rehabilitation professionals are lagging behind other professional groups such as physicians and nurses. The objectives of this study were: 1) to identify recruitment and retention strategies of rehabilitation professionals including occupational therapists, physical therapists and speech language pathologists from the literature; and 2) to investigate both the importance and feasibility of the identified strategies using expert panels amongst HHR and education experts. Methods A review of the literature was conducted to identify recruitment and retention strategies for rehabilitation professionals. Two expert panels, one on Recruitment and Retention and the other on Education were convened to determine the importance and feasibility of the identified strategies. A modified-delphi process was used to gain consensus and to rate the identified strategies along these two dimensions. Results A total of 34 strategies were identified by the Recruitment and Retention and Education expert panels as being important and feasible for the development of a HHR plan for recruitment and retention of rehabilitation professionals. Seven were categorized under the Quality of Worklife and Work Environment theme, another seven in Financial Incentives and Marketing, two in Workload and Skill Mix, thirteen in Professional Development and five in Education and Training. Conclusion Based on the results from the expert panels, the three major areas of focus for HHR planning in the rehabilitation sector should include strategies addressing Quality of Worklife and Work Environment, Financial Incentives and Marketing and Professional Development. PMID:19068134

Identification of recruitment and retention strategies for rehabilitation professionals in Ontario, Canada: results from expert panels.

PubMed

Tran, Diem; Hall, Linda McGillis; Davis, Aileen; Landry, Michel D; Burnett, Dawn; Berg, Katherine; Jaglal, Susan

2008-12-09

Demand for rehabilitation services is expected to increase due to factors such as an aging population, workforce pressures, rise in chronic and complex multi-system disorders, advances in technology, and changes in interprofessional health service delivery models. However, health human resource (HHR) strategies for Canadian rehabilitation professionals are lagging behind other professional groups such as physicians and nurses. The objectives of this study were: 1) to identify recruitment and retention strategies of rehabilitation professionals including occupational therapists, physical therapists and speech language pathologists from the literature; and 2) to investigate both the importance and feasibility of the identified strategies using expert panels amongst HHR and education experts. A review of the literature was conducted to identify recruitment and retention strategies for rehabilitation professionals. Two expert panels, one on Recruitment and Retention and the other on Education were convened to determine the importance and feasibility of the identified strategies. A modified-delphi process was used to gain consensus and to rate the identified strategies along these two dimensions. A total of 34 strategies were identified by the Recruitment and Retention and Education expert panels as being important and feasible for the development of a HHR plan for recruitment and retention of rehabilitation professionals. Seven were categorized under the Quality of Worklife and Work Environment theme, another seven in Financial Incentives and Marketing, two in Workload and Skill Mix, thirteen in Professional Development and five in Education and Training. Based on the results from the expert panels, the three major areas of focus for HHR planning in the rehabilitation sector should include strategies addressing Quality of Worklife and Work Environment, Financial Incentives and Marketing and Professional Development.

A Delphi study to determine the European core curriculum for Master programmes in genetic counselling.

PubMed

Skirton, Heather; Barnoy, Sivia; Ingvoldstad, Charlotta; van Kessel, Ingrid; Patch, Christine; O'Connor, Anita; Serra-Juhe, Clara; Stayner, Barbara; Voelckel, Marie-Antoinette

2013-10-01

Genetic counsellors have been working in some European countries for at least 30 years. Although there are great disparities between the numbers, education, practice and acceptance of these professionals across Europe, it is evident that genetic counsellors and genetic nurses in Europe are working autonomously within teams to deliver patient care. The aim of this study was to use the Delphi research method to develop a core curriculum to guide the educational preparation of these professionals in Europe. The Delphi method enables the researcher to utilise the views and opinions of a group of recognised experts in the field of study; this study consisted of four phases. Phases 1 and 4 consisted of expert workshops, whereas data were collected in phases 2 and 3 (n=35) via online surveys. All participants in the study were considered experts in the field of genetic counselling. The topics considered essential for genetic counsellor training have been organised under the following headings: (1) counselling; (2) psychological issues; (3) medical genetics; (4) human genetics; (5) ethics, law and sociology; (6) professional practice; and (7) education and research. Each topic includes the knowledge, skills and attitudes required to enable genetic counsellors to develop competence. In addition, it was considered by the experts that clinical practice should comprise 50% of the educational programme. The core Master programme curriculum will enable current courses to be assessed and inform the design of future educational programmes for European genetic counsellors.

A systematic approach towards the development of quality indicators for postnatal care after discharge in Flanders, Belgium.

PubMed

Helsloot, Kaat; Walraevens, Mieke; Besauw, Saskia Van; Van Parys, An-Sofie; Devos, Hanne; Holsbeeck, Ann Van; Roelens, Kristien

2017-05-01

to develop a set of quality indicators for postnatal care after discharge from the hospital, using a systematic approach. key elements of qualitative postnatal care were defined by performing a systematic review and the literature was searched for potential indicators (step 1). The potential indicators were evaluated by five criteria (validity, reliability, sensitivity, feasibility and acceptability) and by making use of the 'Appraisal of Guidelines for Research and Evaluation', the AIRE-instrument (step 2). In a modified Delphi-survey, the quality indicators were presented to a panel of experts in the field of postnatal care using an online tool (step 3). The final results led to a Flemish model of postnatal care (step 4). Flanders, Belgium PARTICIPANTS: health care professionals, representatives of health care organisations and policy makers with expertise in the field of postnatal care. after analysis 57 research articles, 10 reviews, one book and eight other documents resulted in 150 potential quality indicators in seven critical care domains. Quality assessment of the indicators resulted in 58 concept quality indicators which were presented to an expert-panel of health care professionals. After two Delphi-rounds, 30 quality indicators (six structure, 17 process, and seven outcome indicators) were found appropriate to monitor and improve the quality of postnatal care after discharge from the hospital. KEY CONCLUSIONS AND IMPLICATIONS FOR CLINICAL PRACTICE: the quality indicators resulted in a Flemish model of qualitative postnatal care that was implemented by health authorities as a minimum standard in the context of shortened length of stay. Postnatal care should be adjusted to a flexible length of stay and start in pregnancy with an individualised care plan that follows mother and new-born throughout pregnancy, childbirth and postnatal period. Criteria for discharge and local protocols about the organisation and content of care are essential to facilitate continuity of care. Copyright © 2017 Elsevier Ltd. All rights reserved.

Development of guidelines for tertiary education institutions to assist them in supporting students with a mental illness: a Delphi consensus study with Australian professionals and consumers.

PubMed

Reavley, Nicola J; Ross, Anna M; Killackey, Eoin; Jorm, Anthony F

2013-01-01

Background. The age at which most young people are in tertiary education is also the age of peak onset for mental illness. Because mental health problems can have adverse effects on students' academic performance and welfare, institutions require guidance how they can best provide support. However, the scientific evidence for how best to do this is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods. A systematic review of websites, books and journal articles was conducted to develop a 172 item survey containing strategies that institutions might use to support students with a mental illness. Two panels of Australian experts (74 professionals and 35 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results. The overall response rate across three rounds was 83% (80% consumers, 85% professionals). 155 strategies were endorsed as essential or important by at least 80% of panel members. The endorsed strategies provided information on policy, measures to promote support services, service provision, accessibility of support services, relationships between services, other types of support and issues associated with reasonable adjustments. They also provided guidance on the procedures the institutions should have for making staff aware of issues associated with mental illness, mental illness training, support for staff and communicating with a student with a mental illness. They also covered student rights and responsibilities, the procedures the institutions should have for making students aware of issues associated with mental illness, dealing with mental health crises, funding and research and evaluation. Conclusions. The guidelines provide guidance for tertiary institutions to assist them in supporting students with a mental illness. It is hoped that they may be used to inform policy and practice in tertiary institutions.

Development of guidelines for tertiary education institutions to assist them in supporting students with a mental illness: a Delphi consensus study with Australian professionals and consumers

PubMed Central

Ross, Anna M.; Killackey, Eoin; Jorm, Anthony F.

2013-01-01

Background. The age at which most young people are in tertiary education is also the age of peak onset for mental illness. Because mental health problems can have adverse effects on students’ academic performance and welfare, institutions require guidance how they can best provide support. However, the scientific evidence for how best to do this is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods. A systematic review of websites, books and journal articles was conducted to develop a 172 item survey containing strategies that institutions might use to support students with a mental illness. Two panels of Australian experts (74 professionals and 35 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results. The overall response rate across three rounds was 83% (80% consumers, 85% professionals). 155 strategies were endorsed as essential or important by at least 80% of panel members. The endorsed strategies provided information on policy, measures to promote support services, service provision, accessibility of support services, relationships between services, other types of support and issues associated with reasonable adjustments. They also provided guidance on the procedures the institutions should have for making staff aware of issues associated with mental illness, mental illness training, support for staff and communicating with a student with a mental illness. They also covered student rights and responsibilities, the procedures the institutions should have for making students aware of issues associated with mental illness, dealing with mental health crises, funding and research and evaluation. Conclusions. The guidelines provide guidance for tertiary institutions to assist them in supporting students with a mental illness. It is hoped that they may be used to inform policy and practice in tertiary institutions. PMID:23638380

Core Health Outcomes In Childhood Epilepsy (CHOICE): protocol for the selection of a core outcome set.

PubMed

Morris, Christopher; Dunkley, Colin; Gibbon, Frances M; Currier, Janet; Roberts, Deborah; Rogers, Morwenna; Crudgington, Holly; Bray, Lucy; Carter, Bernie; Hughes, Dyfrig; Tudur Smith, Catrin; Williamson, Paula R; Gringras, Paul; Pal, Deb K

2017-11-28

There is increasing recognition that establishing a core set of outcomes to be evaluated and reported in trials of interventions for particular conditions will improve the usefulness of health research. There is no established core outcome set for childhood epilepsy. The aim of this work is to select a core outcome set to be used in evaluative research of interventions for children with rolandic epilepsy, as an exemplar of common childhood epilepsy syndromes. First we will identify what outcomes should be measured; then we will decide how to measure those outcomes. We will engage relevant UK charities and health professional societies as partners, and convene advisory panels for young people with epilepsy and parents of children with epilepsy. We will identify candidate outcomes from a search for trials of interventions for childhood epilepsy, statutory guidance and consultation with our advisory panels. Families, charities and health, education and neuropsychology professionals will be invited to participate in a Delphi survey following recommended practices in the development of core outcome sets. Participants will be able to recommend additional outcome domains. Over three rounds of Delphi survey participants will rate the importance of candidate outcome domains and state the rationale for their decisions. Over the three rounds we will seek consensus across and between families and health professionals on the more important outcomes. A face-to-face meeting will be convened to ratify the core outcome set. We will then review and recommend ways to measure the shortlisted outcomes using clinical assessment and/or patient-reported outcome measures. Our methodology is a proportionate and pragmatic approach to expediently produce a core outcome set for evaluative research of interventions aiming to improve the health of children with epilepsy. A number of decisions have to be made when designing a study to develop a core outcome set including defining the scope, choosing which stakeholders to engage, most effective ways to elicit their views, especially children and a potential role for qualitative research.

The definition and application of Pilates exercise to treat people with chronic low back pain: a Delphi survey of Australian physical therapists.

PubMed

Wells, Cherie; Kolt, Gregory S; Marshall, Paul; Bialocerkowski, Andrea

2014-06-01

Pilates exercise is recommended for people with chronic low back pain (CLBP). In the literature, however, Pilates exercise is described and applied differently to treat people with CLBP. These differences in the definition and application of Pilates exercise make it difficult to evaluate its effectiveness. The aim of this study was to establish consensus regarding the definition and application of Pilates exercise to treat people with CLBP. A panel of Australian physical therapists who are experienced in treating people with CLBP using Pilates exercise were surveyed using the Delphi technique. Three electronic questionnaires were used to collect the respondents' opinions. Answers to open-ended questions were analyzed thematically, combined with systematic literature review findings, and translated into statements about Pilates exercise for people with CLBP. Participants then rated their level of agreement with these statements using a 6-point Likert scale. Consensus was achieved when 70% of the panel members strongly agreed, agreed, or somewhat agreed (or strongly disagreed, disagreed, or somewhat disagreed) with an item. Thirty physical therapists completed all 3 questionnaires and reached consensus on the majority of items. Participants agreed that Pilates exercise requires body awareness, breathing, movement control, posture, and education. It was recommended that people with CLBP should undertake supervised sessions for 30 to 60 minutes, twice per week, for 3 to 6 months. Participants also suggested that people with CLBP would benefit from individualized assessment and exercise prescription, supervision and functional integration of exercises, and use of specialized equipment. Item consensus does not guarantee the accuracy of findings. This survey reflects the opinion of only 30 physical therapists and requires validation in future trials. These findings contribute to a better understanding of Pilates exercise and how it is utilized by physical therapists to treat people with CLBP. This information provides direction for future research into Pilates exercise, but findings need to be interpreted within the context of study limitations. © 2014 American Physical Therapy Association.

The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study.

PubMed

Gagliardi, Diana; Rondinone, Bruna M; Mirabile, Marco; Buresti, Giuliana; Ellwood, Peter; Hery, Michel; Paszkiewicz, Peter; Valenti, Antonio; Iavicoli, Sergio

2017-06-23

This study, developed within the frame of the Partnership for European Research on Occupational Safety and Health joint research activities and based on the frame designed by the 2013 European Agency for Safety and Health at Work (EU-OSHA) study, is the first example of using the points of view of European occupational safety and health (OSH) researchers.The objective is to identify priorities for OSH research that may contribute to the achievement of present and future sustainable growth objectives set by the European strategies. The study was carried out using a modified Delphi method with a two-round survey. Each round involved a panel of about 110 researchers representing the network member institutes was selected according to specific criteria, including the ownership of research expertise in at least one of the four macroareas identified by the reference report developed by EU-OSHA in 2013. The study identified some innovative research topics (for example, 'Emerging technological devices' and 'OSH consequences of markets integration') and research priorities (ie, crowdsourcing, e-work, zero-hours contract s ) that are not reflected in previous studies of this nature.The absence of any reference to violence and harassment at work among the researchers' proposals is a major difference from previous similar studies, while topics related to gender issues and electromagnetic fields show a lower importance. The innovative design of a research priorities identification process, which takes advantage of a large, representative and qualified panel of European researchers allowed the definition of a number of research priorities able to support the inclusion of innovative OSH research issues in the scope of the next European research agenda. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Beyond the false negative rate: development of quality indicators for sentinel lymph node biopsy in breast cancer.

PubMed

Quan, May Lynn; Wells, Bryan J; McCready, David; Wright, Frances C; Fraser, Novlette; Gagliardi, Anna R

2010-02-01

Sentinel lymph node biopsy (SNLB) has been adopted as the standard method of axillary staging for women with clinically node-negative early-stage breast cancer. The false negative rate as a quality indicator is impractical given the need for a completion axillary dissection to calculate. The objective of this study was to develop practical quality indicators for SLNB using an expert consensus method and to determine if they were feasible to measure. We used a modified Delphi consensus process to develop quality indicators for SLNB. A multidisciplinary expert panel reviewed potential indicators extracted from the medical literature to select quality indicators that were relevant and measurable. Feasibility was determined by abstracting the quality indicator variables from a retrospective chart review. The expert panel prioritized 11 quality indicators as benchmarks for assessing the quality of surgical care in SNLB. Nine of the indicators were measurable at the chart or institutional level. A systematic evidence- and consensus-based approach was used to develop measurable quality indicators that could be used by practicing surgeons and administrators to evaluate performance of SLNB in breast cancer.

A consensus approach to improving patient adherence and persistence with topical treatment for actinic keratosis

PubMed Central

Stockfleth, Eggert; Peris, Ketty; Guillen, Carlos; Cerio, Rino; Basset-Seguin, Nicole; Foley, Peter; Sanches, José; Culshaw, Alex; Erntoft, Sandra; Lebwohl, Mark

2015-01-01

Background Topical therapy is important in the treatment of actinic keratosis, but guidance for improving adherence/persistence during topical therapy is still lacking. Objectives To utilize expert consensus to generate a list of recommendations to improve real-world efficacy when prescribing topical therapy for actinic keratosis. Methods An expert panel of eight dermatologists was convened to generate recommendations based on facilitated discussion and consensus generation using a modified Delphi session. The recommendations were ratified with the expert panel. Results Facilitated discussion generated 31 issues within five themes, which were prioritized using expert voting. Consensus was achieved on the importance of short and simple treatment regimens for maximizing patient compliance, physician awareness of the progression of actinic keratosis to squamous cell carcinoma, provision of appropriate patient information, and the use of effective communication strategies to educate physicians about actinic keratosis. Based on these key findings, eight recommendations were generated. Conclusions The recommendations will assist physicians when prescribing topical actinic keratosis therapy. Further research should focus on the types of patient outcomes that are influenced by the characteristics of topical field therapy. PMID:25865875

Assessment, Selection, Use, and Evaluation of Body-Worn Absorbent Products for Adults With Incontinence: A WOCN Society Consensus Conference.

PubMed

Gray, Mikel; Kent, Dea; Ermer-Seltun, JoAnn; McNichol, Laurie

The Wound, Ostomy and Continence Nurses (WOCN) Society charged a task force with creating recommendations for assessment, selection, use, and evaluation of body-worn absorbent products. The 3-member task force, assisted by a moderator with knowledge of this area of care, completed a scoping literature review to identify recommendations supported by adequate research to qualify as evidence-based, and area of care where evidence needed to guide care was missing. Based on findings of this scoping review, the Society then convened a panel of experts to develop consensus statements guiding assessment, use, and evaluation of the effect of body-worn absorbent products for adults with urinary and/or fecal incontinence. These consensus-based statements underwent a second round of content validation using a modified Delphi technique using a different panel of clinicians with expertise in this area of care. This article reports on the scoping review and subsequent evidence-based statements, along with generation and validation of consensus-based statements that will be used to create an algorithm to aid clinical decision making.

From the Medical Board of the National Psoriasis Foundation: Treatment targets for plaque psoriasis.

PubMed

Armstrong, April W; Siegel, Michael P; Bagel, Jerry; Boh, Erin E; Buell, Megan; Cooper, Kevin D; Callis Duffin, Kristina; Eichenfield, Lawrence F; Garg, Amit; Gelfand, Joel M; Gottlieb, Alice B; Koo, John Y M; Korman, Neil J; Krueger, Gerald G; Lebwohl, Mark G; Leonardi, Craig L; Mandelin, Arthur M; Menter, M Alan; Merola, Joseph F; Pariser, David M; Prussick, Ronald B; Ryan, Caitriona; Shah, Kara N; Weinberg, Jeffrey M; Williams, MaryJane O U; Wu, Jashin J; Yamauchi, Paul S; Van Voorhees, Abby S

2017-02-01

An urgent need exists in the United States to establish treatment goals in psoriasis. We aim to establish defined treatment targets toward which clinicians and patients with psoriasis can strive to inform treatment decisions, reduce disease burden, and improve outcomes in practice. The National Psoriasis Foundation conducted a consensus-building study among psoriasis experts using the Delphi method. The process consisted of: (1) literature review, (2) pre-Delphi question selection and input from general dermatologists and patients, and (3) 4 Delphi rounds. A total of 25 psoriasis experts participated in the Delphi process. The most preferred instrument was body surface area (BSA). The most preferred time for evaluating patient response after starting new therapies was at 3 months. The acceptable response at 3 months postinitiation was either BSA 3% or less or BSA improvement 75% or more from baseline. The target response at 3 months postinitiation was BSA 1% or less. During the maintenance period, evaluation every 6 months was most preferred. The target response at every 6 months maintenance evaluation is BSA 1% or less. Although BSA is feasible in practice, it does not encompass health-related quality of life, costs, and risks of side effects. With defined treatment targets, clinicians and patients can regularly evaluate treatment responses and perform benefit-risk assessments of therapeutic options individualized to the patient. Copyright © 2016 American Academy of Dermatology, Inc. Published by Elsevier Inc. All rights reserved.