A critical evaluation of the validity of episodic future thinking: A clinical neuropsychology perspective.

PubMed

Ward, Amanda M

2016-11-01

Episodic future thinking is defined as the ability to mentally simulate a future event. Although episodic future thinking has been studied extensively in neuroscience, this construct has not been explored in depth from the perspective of clinical neuropsychology. The aim of this critical narrative review is to assess the validity and clinical implications of episodic future thinking. A systematic review of episodic future thinking literature was conducted. PubMed and PsycInfo were searched through July 2015 for review and empirical articles with the following search terms: "episodic future thinking," "future mental simulation," "imagining the future," "imagining new experiences," "future mental time travel," "future autobiographical experience," and "prospection." The review discusses evidence that episodic future thinking is important for adaptive functioning, which has implications for neurological populations. To determine the validity of episodic future thinking, the construct is evaluated with respect to related constructs, such as imagination, episodic memory, autobiographical memory, prospective memory, narrative construction, and working memory. Although it has been minimally investigated, there is evidence of convergent and discriminant validity for episodic future thinking. Research has not addressed the incremental validity of episodic future thinking. Practical considerations of episodic future thinking tasks and related constructs in a clinical neuropsychological setting are considered. The utility of episodic future thinking is currently unknown due to the lack of research investigating the validity of episodic future thinking. Future work is discussed, which could determine whether episodic future thinking is an important missing piece in standard clinical neuropsychological assessment. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do

PubMed Central

2018-01-01

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit. PMID:29805337

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do.

PubMed

Park, Seong Ho; Kressel, Herbert Y

2018-05-28

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit.

Validation of Immunohistochemical Assays for Integral Biomarkers in the NCI-MATCH EAY131 Clinical Trial.

PubMed

Khoury, Joseph D; Wang, Wei-Lien; Prieto, Victor G; Medeiros, L Jeffrey; Kalhor, Neda; Hameed, Meera; Broaddus, Russell; Hamilton, Stanley R

2018-02-01

Biomarkers that guide therapy selection are gaining unprecedented importance as targeted therapy options increase in scope and complexity. In conjunction with high-throughput molecular techniques, therapy-guiding biomarker assays based upon immunohistochemistry (IHC) have a critical role in cancer care in that they inform about the expression status of a protein target. Here, we describe the validation procedures for four clinical IHC biomarker assays-PTEN, RB, MLH1, and MSH2-for use as integral biomarkers in the nationwide NCI-Molecular Analysis for Therapy Choice (NCI-MATCH) EAY131 clinical trial. Validation procedures were developed through an iterative process based on collective experience and adaptation of broad guidelines from the FDA. The steps included primary antibody selection; assay optimization; development of assay interpretation criteria incorporating biological considerations; and expected staining patterns, including indeterminate results, orthogonal validation, and tissue validation. Following assay lockdown, patient samples and cell lines were used for analytic and clinical validation. The assays were then approved as laboratory-developed tests and used for clinical trial decisions for treatment selection. Calculations of sensitivity and specificity were undertaken using various definitions of gold-standard references, and external validation was required for the PTEN IHC assay. In conclusion, validation of IHC biomarker assays critical for guiding therapy in clinical trials is feasible using comprehensive preanalytic, analytic, and postanalytic steps. Implementation of standardized guidelines provides a useful framework for validating IHC biomarker assays that allow for reproducibility across institutions for routine clinical use. Clin Cancer Res; 24(3); 521-31. ©2017 AACR . ©2017 American Association for Cancer Research.

Construct Validity: Advances in Theory and Methodology

PubMed Central

Strauss, Milton E.; Smith, Gregory T.

2008-01-01

Measures of psychological constructs are validated by testing whether they relate to measures of other constructs as specified by theory. Each test of relations between measures reflects on the validity of both the measures and the theory driving the test. Construct validation concerns the simultaneous process of measure and theory validation. In this chapter, we review the recent history of validation efforts in clinical psychological science that has led to this perspective, and we review five recent advances in validation theory and methodology of importance for clinical researchers. These are: the emergence of nonjustificationist philosophy of science; an increasing appreciation for theory and the need for informative tests of construct validity; valid construct representation in experimental psychopathology; the need to avoid representing multidimensional constructs with a single score; and the emergence of effective new statistical tools for the evaluation of convergent and discriminant validity. PMID:19086835

Anger Assessment in Clinical and Nonclinical Populations: Further Validation of the State-Trait Anger Expression Inventory-2.

PubMed

Lievaart, Marien; Franken, Ingmar H A; Hovens, Johannes E

2016-03-01

The most commonly used instrument for measuring anger is the State-Trait Anger Expression Inventory-2 (STAXI-2; Spielberger, 1999). This study further examines the validity of the STAXI-2 and compares anger scores between several clinical and nonclinical samples. Reliability, concurrent, and construct validity were investigated in Dutch undergraduate students (N = 764), a general population sample (N = 1211), and psychiatric outpatients (N = 226). The results support the reliability and validity of the STAXI-2. Concurrent validity was strong, with meaningful correlations between the STAXI-2 scales and anger-related constructs in both clinical and nonclinical samples. Importantly, patients showed higher experience and expression of anger than the general population sample. Additionally, forensic outpatients with addiction problems reported higher Anger Expression-Out than general psychiatric outpatients. Our conclusion is that the STAXI-2 is a suitable instrument to measure both the experience and the expression of anger in both general and clinical populations. © 2016 Wiley Periodicals, Inc.

The development and validation of the clinicians' awareness towards cognitive errors (CATChES) in clinical decision making questionnaire tool.

PubMed

Chew, Keng Sheng; Kueh, Yee Cheng; Abdul Aziz, Adlihafizi

2017-03-21

Despite their importance on diagnostic accuracy, there is a paucity of literature on questionnaire tools to assess clinicians' awareness toward cognitive errors. A validation study was conducted to develop a questionnaire tool to evaluate the Clinician's Awareness Towards Cognitive Errors (CATChES) in clinical decision making. This questionnaire is divided into two parts. Part A is to evaluate the clinicians' awareness towards cognitive errors in clinical decision making while Part B is to evaluate their perception towards specific cognitive errors. Content validation for both parts was first determined followed by construct validation for Part A. Construct validation for Part B was not determined as the responses were set in a dichotomous format. For content validation, all items in both Part A and Part B were rated as "excellent" in terms of their relevance in clinical settings. For construct validation using exploratory factor analysis (EFA) for Part A, a two-factor model with total variance extraction of 60% was determined. Two items were deleted. Then, the EFA was repeated showing that all factor loadings are above the cut-off value of >0.5. The Cronbach's alpha for both factors are above 0.6. The CATChES questionnaire tool is a valid questionnaire tool aimed to evaluate the awareness among clinicians toward cognitive errors in clinical decision making.

Performance validity testing in neuropsychology: a clinical guide, critical review, and update on a rapidly evolving literature.

PubMed

Lippa, Sara M

2018-04-01

Over the past two decades, there has been much research on measures of response bias and myriad measures have been validated in a variety of clinical and research samples. This critical review aims to guide clinicians through the use of performance validity tests (PVTs) from test selection and administration through test interpretation and feedback. Recommended cutoffs and relevant test operating characteristics are presented. Other important issues to consider during test selection, administration, interpretation, and feedback are discussed including order effects, coaching, impact on test data, and methods to combine measures and improve predictive power. When interpreting performance validity measures, neuropsychologists must use particular caution in cases of dementia, low intelligence, English as a second language/minority cultures, or low education. PVTs provide valuable information regarding response bias and, under the right circumstances, can provide excellent evidence of response bias. Only after consideration of the entire clinical picture, including validity test performance, can concrete determinations regarding the validity of test data be made.

Imaging biomarker roadmap for cancer studies

PubMed Central

O’Connor, James P. B.; Aboagye, Eric O.; Adams, Judith E.; Aerts, Hugo J. W. L.; Barrington, Sally F.; Beer, Ambros J.; Boellaard, Ronald; Bohndiek, Sarah E.; Brady, Michael; Brown, Gina; Buckley, David L.; Chenevert, Thomas L.; Clarke, Laurence P.; Collette, Sandra; Cook, Gary J.; deSouza, Nandita M.; Dickson, John C.; Dive, Caroline; Evelhoch, Jeffrey L.; Faivre-Finn, Corinne; Gallagher, Ferdia A.; Gilbert, Fiona J.; Gillies, Robert J.; Goh, Vicky; Griffiths, John R.; Groves, Ashley M.; Halligan, Steve; Harris, Adrian L.; Hawkes, David J.; Hoekstra, Otto S.; Huang, Erich P.; Hutton, Brian F.; Jackson, Edward F.; Jayson, Gordon C.; Jones, Andrew; Koh, Dow-Mu; Lacombe, Denis; Lambin, Philippe; Lassau, Nathalie; Leach, Martin O.; Lee, Ting-Yim; Leen, Edward L.; Lewis, Jason S.; Liu, Yan; Lythgoe, Mark F.; Manoharan, Prakash; Maxwell, Ross J.; Miles, Kenneth A.; Morgan, Bruno; Morris, Steve; Ng, Tony; Padhani, Anwar R.; Parker, Geoff J. M.; Partridge, Mike; Pathak, Arvind P.; Peet, Andrew C.; Punwani, Shonit; Reynolds, Andrew R.; Robinson, Simon P.; Shankar, Lalitha K.; Sharma, Ricky A.; Soloviev, Dmitry; Stroobants, Sigrid; Sullivan, Daniel C.; Taylor, Stuart A.; Tofts, Paul S.; Tozer, Gillian M.; van Herk, Marcel; Walker-Samuel, Simon; Wason, James; Williams, Kaye J.; Workman, Paul; Yankeelov, Thomas E.; Brindle, Kevin M.; McShane, Lisa M.; Jackson, Alan; Waterton, John C.

2017-01-01

Imaging biomarkers (IBs) are integral to the routine management of patients with cancer. IBs used daily in oncology include clinical TNM stage, objective response and left ventricular ejection fraction. Other CT, MRI, PET and ultrasonography biomarkers are used extensively in cancer research and drug development. New IBs need to be established either as useful tools for testing research hypotheses in clinical trials and research studies, or as clinical decision-making tools for use in healthcare, by crossing ‘translational gaps’ through validation and qualification. Important differences exist between IBs and biospecimen-derived biomarkers and, therefore, the development of IBs requires a tailored ‘roadmap’. Recognizing this need, Cancer Research UK (CRUK) and the European Organisation for Research and Treatment of Cancer (EORTC) assembled experts to review, debate and summarize the challenges of IB validation and qualification. This consensus group has produced 14 key recommendations for accelerating the clinical translation of IBs, which highlight the role of parallel (rather than sequential) tracks of technical (assay) validation, biological/clinical validation and assessment of cost-effectiveness; the need for IB standardization and accreditation systems; the need to continually revisit IB precision; an alternative framework for biological/clinical validation of IBs; and the essential requirements for multicentre studies to qualify IBs for clinical use. PMID:27725679

The ENDOCARE questionnaire guides European endometriosis clinics to improve the patient-centeredness of their care.

PubMed

Dancet, E A F; Apers, S; Kluivers, K B; Kremer, J A M; Sermeus, W; Devriendt, C; Nelen, W L D M; D'Hooghe, T M

2012-11-01

How patient-centered are two included specialized endometriosis clinics relative to each other and how can they improve the patient-centeredness of their care? The validated ENDOCARE questionnaire (ECQ) reliably concluded that the adjusted overall patient-centeredness did not differ between the clinics, that each clinic was significantly more patient-centered for 2 out of 10 dimensions of patient-centered endometriosis care and that clinics 1 and 2 had to improve 8 and 13 specific care aspects, respectively. Patient-centered endometriosis care is essential to high-quality care and is defined by 10 dimensions. The ECQ was developed, validated and proved to be reliable in a European setting of self-reported endometriosis patients but had not yet been used at a clinic level for quality management. A cross-sectional survey was disseminated in 2011 to all 514 women diagnosed with endometriosis during a laparoscopy indicated for pain and/or infertility during a retrospective 2-year period (2009-2010) in two university clinics from two different European countries. In total 337 patients completed the ECQ (216 and 121 per clinic). Respondents had a mean age of 34.3 years. Three in four reported a surgical diagnosis of moderate or severe endometriosis and the majority reported surgical treatment by a multidisciplinary team. The ECQ assessed the 10 dimensions of patient-centeredness, more specifically whether the health-care performance, as perceived by patients, measured up to what is important to patients in general. The ECQ was completed by 337 respondents (response rate = 65.6%). Reliability and validity of the ECQ for use on clinic level were confirmed. Clinics did not differ in overall mean importance scores; importance rankings of the ECQ dimensions were almost identical. The overall patient-centeredness scores (PCS), adjusted for education level, did not discriminate between the clinics. However, the adjusted PCS for the dimensions 'clinic staff' and 'technical skills' were significantly better in clinic 1, whereas the dimensions 'physical comfort' and 'access to care' were significantly better in clinic 2. There were 8 (clinic 1) and 13 (clinic 2) targets identified for joint and cross-clinic improvement. Response rates were relatively high. Recall bias was the most important limitation and research in more clinics is needed to define the statistical discriminative value of the ECQ. European endometriosis clinics can use the validated ECQ for reliable assessment of their 'patient-centeredness', for comparison with others and for setting specific targets to improve the patient-centeredness of their endometriosis care, to plan interventions, and to evaluate their effectiveness. This work was funded by KU Leuven and European Network of Endometriosis (ENE), supported by the European Commission (Public Health Executive Agency). No competing interests are declared.

Multimethod Investigation of Interpersonal Functioning in Borderline Personality Disorder

PubMed Central

Stepp, Stephanie D.; Hallquist, Michael N.; Morse, Jennifer Q.; Pilkonis, Paul A.

2011-01-01

Even though interpersonal functioning is of great clinical importance for patients with borderline personality disorder (BPD), the comparative validity of different assessment methods for interpersonal dysfunction has not yet been tested. This study examined multiple methods of assessing interpersonal functioning, including self- and other-reports, clinical ratings, electronic diaries, and social cognitions in three groups of psychiatric patients (N=138): patients with (1) BPD, (2) another personality disorder, and (3) Axis I psychopathology only. Using dominance analysis, we examined the predictive validity of each method in detecting changes in symptom distress and social functioning six months later. Across multiple methods, the BPD group often reported higher interpersonal dysfunction scores compared to other groups. Predictive validity results demonstrated that self-report and electronic diary ratings were the most important predictors of distress and social functioning. Our findings suggest that self-report scores and electronic diary ratings have high clinical utility, as these methods appear most sensitive to change. PMID:21808661

Understanding Interrater Reliability and Validity of Risk Assessment Tools Used to Predict Adverse Clinical Events.

PubMed

Siedlecki, Sandra L; Albert, Nancy M

This article will describe how to assess interrater reliability and validity of risk assessment tools, using easy-to-follow formulas, and to provide calculations that demonstrate principles discussed. Clinical nurse specialists should be able to identify risk assessment tools that provide high-quality interrater reliability and the highest validity for predicting true events of importance to clinical settings. Making best practice recommendations for assessment tool use is critical to high-quality patient care and safe practices that impact patient outcomes and nursing resources. Optimal risk assessment tool selection requires knowledge about interrater reliability and tool validity. The clinical nurse specialist will understand the reliability and validity issues associated with risk assessment tools, and be able to evaluate tools using basic calculations. Risk assessment tools are developed to objectively predict quality and safety events and ultimately reduce the risk of event occurrence through preventive interventions. To ensure high-quality tool use, clinical nurse specialists must critically assess tool properties. The better the tool's ability to predict adverse events, the more likely that event risk is mediated. Interrater reliability and validity assessment is relatively an easy skill to master and will result in better decisions when selecting or making recommendations for risk assessment tool use.

Clinical Utility and "DSM-V"

ERIC Educational Resources Information Center

Mullins-Sweatt, Stephanie N.; Widiger, Thomas A.

2009-01-01

The construction of the American Psychiatric Association's diagnostic manual has been guided primarily by concerns of construct validity rather than of clinical utility, despite claims by its authors that the highest priority has in fact been clinical utility. The purpose of this article was to further articulate the concept and importance of…

Empirical evaluation demonstrated importance of validating biomarkers for early detection of cancer in screening settings to limit the number of false-positive findings.

PubMed

Chen, Hongda; Knebel, Phillip; Brenner, Hermann

2016-07-01

Search for biomarkers for early detection of cancer is a very active area of research, but most studies are done in clinical rather than screening settings. We aimed to empirically evaluate the role of study setting for early detection marker identification and validation. A panel of 92 candidate cancer protein markers was measured in 35 clinically identified colorectal cancer patients and 35 colorectal cancer patients identified at screening colonoscopy. For each case group, we selected 38 controls without colorectal neoplasms at screening colonoscopy. Single-, two- and three-marker combinations discriminating cases and controls were identified in each setting and subsequently validated in the alternative setting. In all scenarios, a higher number of predictive biomarkers were initially detected in the clinical setting, but a substantially lower proportion of identified biomarkers could subsequently be confirmed in the screening setting. Confirmation rates were 50.0%, 84.5%, and 74.2% for one-, two-, and three-marker algorithms identified in the screening setting and were 42.9%, 18.6%, and 25.7% for algorithms identified in the clinical setting. Validation of early detection markers of cancer in a true screening setting is important to limit the number of false-positive findings. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Validity evidence and reliability of a simulated patient feedback instrument.

PubMed

Schlegel, Claudia; Woermann, Ulrich; Rethans, Jan-Joost; van der Vleuten, Cees

2012-01-27

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Development and validation of a nursing professionalism evaluation model in a career ladder system.

PubMed

Kim, Yeon Hee; Jung, Young Sun; Min, Ja; Song, Eun Young; Ok, Jung Hui; Lim, Changwon; Kim, Kyunghee; Kim, Ji-Su

2017-01-01

The clinical ladder system categorizes the degree of nursing professionalism and rewards and is an important human resource tool for managing nursing. We developed a model to evaluate nursing professionalism, which determines the clinical ladder system levels, and verified its validity. Data were collected using a clinical competence tool developed in this study, and existing methods such as the nursing professionalism evaluation tool, peer reviews, and face-to-face interviews to evaluate promotions and verify the presented content in a medical institution. Reliability and convergent and discriminant validity of the clinical competence evaluation tool were verified using SmartPLS software. The validity of the model for evaluating overall nursing professionalism was also analyzed. Clinical competence was determined by five dimensions of nursing practice: scientific, technical, ethical, aesthetic, and existential. The structural model explained 66% of the variance. Clinical competence scales, peer reviews, and face-to-face interviews directly determined nursing professionalism levels. The evaluation system can be used for evaluating nurses' professionalism in actual medical institutions from a nursing practice perspective. A conceptual framework for establishing a human resources management system for nurses and a tool for evaluating nursing professionalism at medical institutions is provided.

SurvExpress: an online biomarker validation tool and database for cancer gene expression data using survival analysis.

PubMed

Aguirre-Gamboa, Raul; Gomez-Rueda, Hugo; Martínez-Ledesma, Emmanuel; Martínez-Torteya, Antonio; Chacolla-Huaringa, Rafael; Rodriguez-Barrientos, Alberto; Tamez-Peña, José G; Treviño, Victor

2013-01-01

Validation of multi-gene biomarkers for clinical outcomes is one of the most important issues for cancer prognosis. An important source of information for virtual validation is the high number of available cancer datasets. Nevertheless, assessing the prognostic performance of a gene expression signature along datasets is a difficult task for Biologists and Physicians and also time-consuming for Statisticians and Bioinformaticians. Therefore, to facilitate performance comparisons and validations of survival biomarkers for cancer outcomes, we developed SurvExpress, a cancer-wide gene expression database with clinical outcomes and a web-based tool that provides survival analysis and risk assessment of cancer datasets. The main input of SurvExpress is only the biomarker gene list. We generated a cancer database collecting more than 20,000 samples and 130 datasets with censored clinical information covering tumors over 20 tissues. We implemented a web interface to perform biomarker validation and comparisons in this database, where a multivariate survival analysis can be accomplished in about one minute. We show the utility and simplicity of SurvExpress in two biomarker applications for breast and lung cancer. Compared to other tools, SurvExpress is the largest, most versatile, and quickest free tool available. SurvExpress web can be accessed in http://bioinformatica.mty.itesm.mx/SurvExpress (a tutorial is included). The website was implemented in JSP, JavaScript, MySQL, and R.

SurvExpress: An Online Biomarker Validation Tool and Database for Cancer Gene Expression Data Using Survival Analysis

PubMed Central

Aguirre-Gamboa, Raul; Gomez-Rueda, Hugo; Martínez-Ledesma, Emmanuel; Martínez-Torteya, Antonio; Chacolla-Huaringa, Rafael; Rodriguez-Barrientos, Alberto; Tamez-Peña, José G.; Treviño, Victor

2013-01-01

Validation of multi-gene biomarkers for clinical outcomes is one of the most important issues for cancer prognosis. An important source of information for virtual validation is the high number of available cancer datasets. Nevertheless, assessing the prognostic performance of a gene expression signature along datasets is a difficult task for Biologists and Physicians and also time-consuming for Statisticians and Bioinformaticians. Therefore, to facilitate performance comparisons and validations of survival biomarkers for cancer outcomes, we developed SurvExpress, a cancer-wide gene expression database with clinical outcomes and a web-based tool that provides survival analysis and risk assessment of cancer datasets. The main input of SurvExpress is only the biomarker gene list. We generated a cancer database collecting more than 20,000 samples and 130 datasets with censored clinical information covering tumors over 20 tissues. We implemented a web interface to perform biomarker validation and comparisons in this database, where a multivariate survival analysis can be accomplished in about one minute. We show the utility and simplicity of SurvExpress in two biomarker applications for breast and lung cancer. Compared to other tools, SurvExpress is the largest, most versatile, and quickest free tool available. SurvExpress web can be accessed in http://bioinformatica.mty.itesm.mx/SurvExpress (a tutorial is included). The website was implemented in JSP, JavaScript, MySQL, and R. PMID:24066126

The Danish Neuro-Oncology Registry: establishment, completeness and validity.

PubMed

Hansen, Steinbjørn; Nielsen, Jan; Laursen, René J; Rasmussen, Birthe Krogh; Nørgård, Bente Mertz; Gradel, Kim Oren; Guldberg, Rikke

2016-08-30

The Danish Neuro-Oncology Registry (DNOR) is a nationwide clinical cancer database that has prospectively registered data on patients with gliomas since January 2009. The purpose of this study was to describe the establishment of the DNOR and further to evaluate the database completeness of patient registration and validity of data. The completeness of the number of patients registered in the database was evaluated in the study period from January 2009 through December 2014 by comparing cases reported to the DNOR with the Danish National Patient Registry and the Danish Pathology Registry. The data validity of important clinical variables was evaluated by a random sample of 100 patients from the DNOR using the medical records as reference. A total of 2241 patients were registered in the DNOR by December 2014 with an overall patient completeness of 92 %, which increased during the study period (from 78 % in 2009 to 96 % in 2014). Medical records were available for all patients in the validity analyses. Most variables showed a high agreement proportion (56-100 %), with a fair to good chance-corrected agreement (k = 0.43-1.0). The completeness of patient registration was very high (92 %) and the validity of the most important patient data was good. The DNOR is a newly established national database, which is a reliable source for future scientific studies and clinical quality assessments among patients with gliomas.

Validity, Responsiveness, Minimal Detectable Change, and Minimal Clinically Important Change of the Pediatric Motor Activity Log in Children with Cerebral Palsy

ERIC Educational Resources Information Center

Lin, Keh-chung; Chen, Hui-fang; Chen, Chia-ling; Wang, Tien-ni; Wu, Ching-yi; Hsieh, Yu-wei; Wu, Li-ling

2012-01-01

This study examined criterion-related validity and clinimetric properties of the Pediatric Motor Activity Log (PMAL) in children with cerebral palsy. Study participants were 41 children (age range: 28-113 months) and their parents. Criterion-related validity was evaluated by the associations between the PMAL and criterion measures at baseline and…

Readability of Self-Report Measures of Depression and Anxiety

ERIC Educational Resources Information Center

McHugh, R. Kathryn; Behar, Evelyn

2009-01-01

As the demand for accountability in service provision settings increases, the need for valid methods for assessing clinical outcomes is of particular importance. Self-report measures of functioning are particularly useful in the assessment of psychological functioning, but a vital factor in their validity and transportability is the reading level…

Validity of temporomandibular disorder examination procedures for assessment of temporomandibular joint status.

PubMed

Schmitter, Marc; Kress, Bodo; Leckel, Michael; Henschel, Volkmar; Ohlmann, Brigitte; Rammelsberg, Peter

2008-06-01

This hypothesis-generating study was performed to determine which items in the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) and additional diagnostic tests have the best predictive accuracy for joint-related diagnoses. One hundred forty-nine TMD patients and 43 symptom-free subjects were examined in clinical examinations and with magnetic resonance imaging (MRI). The importance of each variable of the clinical examination for correct joint-related diagnosis was assessed by using MRI diagnoses. For this purpose, "random forest" statistical software (based on classification trees) was used. Maximum unassisted jaw opening, maximum assisted jaw opening, history of locked jaw, joint sound with and without compression, joint pain, facial pain, pain on palpation of the lateral pterygoid area, and overjet proved suitable for distinguishing between subtypes of joint-related TMD. Measurement of excursion, protrusion, and midline deviation were less important. The validity of clinical TMD examination procedures can be enhanced by using the 16 variables of greatest importance identified in this study. In addition to other variables, maximum unassisted and assisted opening and a history of locked jaw were important when assessing the status of the TMJ.

Best Practices in Stability Indicating Method Development and Validation for Non-clinical Dose Formulations.

PubMed

Henry, Teresa R; Penn, Lara D; Conerty, Jason R; Wright, Francesca E; Gorman, Gregory; Pack, Brian W

2016-11-01

Non-clinical dose formulations (also known as pre-clinical or GLP formulations) play a key role in early drug development. These formulations are used to introduce active pharmaceutical ingredients (APIs) into test organisms for both pharmacokinetic and toxicological studies. Since these studies are ultimately used to support dose and safety ranges in human studies, it is important to understand not only the concentration and PK/PD of the active ingredient but also to generate safety data for likely process impurities and degradation products of the active ingredient. As such, many in the industry have chosen to develop and validate methods which can accurately detect and quantify the active ingredient along with impurities and degradation products. Such methods often provide trendable results which are predictive of stability, thus leading to the name; stability indicating methods. This document provides an overview of best practices for those choosing to include development and validation of such methods as part of their non-clinical drug development program. This document is intended to support teams who are either new to stability indicating method development and validation or who are less familiar with the requirements of validation due to their position within the product development life cycle.

Measuring primary care organizational capacity for diabetes care coordination: the Diabetes Care Coordination Readiness Assessment.

PubMed

Weeks, Douglas L; Polello, Jennifer M; Hansen, Daniel T; Keeney, Benjamin J; Conrad, Douglas A

2014-01-01

Not all primary care clinics are prepared to implement care coordination services for chronic conditions, such as diabetes. Understanding true capacity to coordinate care is an important first-step toward establishing effective and efficient care coordination. Yet, we could identify no diabetes-specific instruments to systematically assess readiness and/or status of primary care clinics to engage in diabetes care coordination. This report describes the development and initial validation of the Diabetes Care Coordination Readiness Assessment (DCCRA), which is intended to measure primary care clinic readiness to coordinate care for adult patients with diabetes. The instrument was developed through iterative item generation within a framework of five domains of care coordination: Organizational Capacity, Care Coordination, Clinical Management, Quality Improvement, and Technical Infrastructure. Validation data was collected on 39 primary care clinics. Content validity, inter-rater reliability, internal consistency, and construct validity of the 49-item instrument were assessed. Inter-rater agreement indices per item ranged from 0.50 to 1.0. Cronbach's alpha of the entire instrument was 0.964, and for the five domain scales ranged from 0.688 to 0.961. Clinics with existing care coordinators were rated as more ready to support care coordination than clinics without care coordinators for the entire DCCRA and for each domain, supporting construct validity. As providers increasingly attempt to adopt patient-centered approaches, introduction of the DCCRA is timely and appropriate for assisting clinics with identifying gaps in provision of care coordination services. The DCCRA's strengths include promising psychometric properties. A valid measure of diabetes care coordination readiness should be useful in diabetes program evaluation, assistance with quality improvement initiatives, and measurement of patient-centered care in research.

A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review

PubMed Central

2014-01-01

Background Patient-reported outcome validation needs to achieve validity and reliability standards. Among reliability analysis parameters, test-retest reliability is an important psychometric property. Retested patients must be in a clinically stable condition. This is particularly problematic in palliative care (PC) settings because advanced cancer patients are prone to a faster rate of clinical deterioration. The aim of this study was to evaluate the methods by which multi-symptom and health-related qualities of life (HRQoL) based on patient-reported outcomes (PROs) have been validated in oncological PC settings with regards to test-retest reliability. Methods A systematic search of PubMed (1966 to June 2013), EMBASE (1980 to June 2013), PsychInfo (1806 to June 2013), CINAHL (1980 to June 2013), and SCIELO (1998 to June 2013), and specific PRO databases was performed. Studies were included if they described a set of validation studies. Studies were included if they described a set of validation studies for an instrument developed to measure multi-symptom or multidimensional HRQoL in advanced cancer patients under PC. The COSMIN checklist was used to rate the methodological quality of the study designs. Results We identified 89 validation studies from 746 potentially relevant articles. From those 89 articles, 31 measured test-retest reliability and were included in this review. Upon critical analysis of the overall quality of the criteria used to determine the test-retest reliability, 6 (19.4%), 17 (54.8%), and 8 (25.8%) of these articles were rated as good, fair, or poor, respectively, and no article was classified as excellent. Multi-symptom instruments were retested over a shortened interval when compared to the HRQoL instruments (median values 24 hours and 168 hours, respectively; p = 0.001). Validation studies that included objective confirmation of clinical stability in their design yielded better results for the test-retest analysis with regard to both pain and global HRQoL scores (p < 0.05). The quality of the statistical analysis and its description were of great concern. Conclusion Test-retest reliability has been infrequently and poorly evaluated. The confirmation of clinical stability was an important factor in our analysis, and we suggest that special attention be focused on clinical stability when designing a PRO validation study that includes advanced cancer patients under PC. PMID:24447633

Validity threats: overcoming interference with proposed interpretations of assessment data.

PubMed

Downing, Steven M; Haladyna, Thomas M

2004-03-01

Factors that interfere with the ability to interpret assessment scores or ratings in the proposed manner threaten validity. To be interpreted in a meaningful manner, all assessments in medical education require sound, scientific evidence of validity. The purpose of this essay is to discuss 2 major threats to validity: construct under-representation (CU) and construct-irrelevant variance (CIV). Examples of each type of threat for written, performance and clinical performance examinations are provided. The CU threat to validity refers to undersampling the content domain. Using too few items, cases or clinical performance observations to adequately generalise to the domain represents CU. Variables that systematically (rather than randomly) interfere with the ability to meaningfully interpret scores or ratings represent CIV. Issues such as flawed test items written at inappropriate reading levels or statistically biased questions represent CIV in written tests. For performance examinations, such as standardised patient examinations, flawed cases or cases that are too difficult for student ability contribute CIV to the assessment. For clinical performance data, systematic rater error, such as halo or central tendency error, represents CIV. The term face validity is rejected as representative of any type of legitimate validity evidence, although the fact that the appearance of the assessment may be an important characteristic other than validity is acknowledged. There are multiple threats to validity in all types of assessment in medical education. Methods to eliminate or control validity threats are suggested.

Measurement of Harm Outcomes in Older Adults after Hospital Discharge: Reliability and Validity

PubMed Central

Douglas, Alison; Letts, Lori; Eva, Kevin; Richardson, Julie

2012-01-01

Objectives. Defining and validating a measure of safety contributes to further validation of clinical measures. The objective was to define and examine the psychometric properties of the outcome “incidents of harm.” Methods. The Incident of Harm Caregiver Questionnaire was administered to caregivers of older adults discharged from hospital by telephone. Caregivers completed daily logs for one month and medical charts were examined. Results. Test-retest reliability (n = 38) was high for the occurrence of an incident of harm (yes/no; kappa = 1.0) and the type of incident (agreement = 100%). Validation against daily logs found no disagreement regarding occurrence or types of incidents. Validation with medical charts found no disagreement regarding incident occurrence and disagreement in half regarding incident type. Discussion. The data support the Incident of Harm Caregiver Questionnaire as a reliable and valid estimation of incidents for this sample and are important to researchers as a method to measure safety when validating clinical measures. PMID:22649728

Reliability and validity of the Bowel Function Index for evaluating opioid-induced constipation: translation, cultural adaptation and validation of the Portuguese version (BFI-P).

PubMed

Dueñas, María; Mendonça, Liliane; Sampaio, Rute; Gouvinhas, Cláudia; Oliveira, Daniela; Castro-Lopes, José Manuel; Azevedo, Luís Filipe

2017-03-01

The Bowel Function Index (BFI) is a simple and sound bowel function and opioid-induced constipation (OIC) screening tool. We aimed to develop the translation and cultural adaptation of this measure (BFI-P) and to assess its reliability and validity for the Portuguese language and a chronic pain population. The BFI-P was created after a process including translation, back translation and cultural adaptation. Participants (n = 226) were recruited in a chronic pain clinic and were assessed at baseline and after one week. Internal consistency, test-retest reliability, responsiveness, construct (convergent and known groups) and factorial validity were assessed. Test-retest reliability had an intra-class correlation of 0.605 for BFI mean score. Internal consistency of BFI had Cronbach's alpha of 0.865. The construct validity of BFI-P was shown to be excellent and the exploratory factor analysis confirmed its unidimensional structure. The responsiveness of BFI-P was excellent, with a suggested 17-19 point and 8-12 point change in score constituting a clinically relevant change in constipation for patients with and without previous constipation, respectively. This study had some limitations, namely, the criterion validity of BFI-P was not directly assessed; and the absence of a direct criterion for OIC precluded the assessment of the criterion based responsiveness of BFI-P. Nevertheless, BFI may importantly contribute to better OIC screening and its Portuguese version (BFI-P) has been shown to have excellent reliability, internal consistency, validity and responsiveness. Further suggestions regarding statistically and clinically important change cut-offs for this instrument are presented.

Validity evidence and reliability of a simulated patient feedback instrument

PubMed Central

2012-01-01

Background In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients. PMID:22284898

Mothers and Children as Informants of Bullying Victimization: Results from an Epidemiological Cohort of Children

ERIC Educational Resources Information Center

Shakoor, Sania; Jaffee, Sara R.; Andreou, Penelope; Bowes, Lucy; Ambler, Antony P.; Caspi, Avshalom; Moffitt, Terrie E.; Arseneault, Louise

2011-01-01

Stressful events early in life can affect children's mental health problems. Collecting valid and reliable information about children's bad experiences is important for research and clinical purposes. This study aimed to (1) investigate whether mothers and children provide valid reports of bullying victimization, (2) examine the inter-rater…

Development and psychometric properties rating scale of “clinical competency evaluation in mental health nurses”: Exploratory factor analysis

PubMed Central

Moskoei, Sara; Mohtashami, Jamileh; Ghalenoeei, Mahdie; Nasiri, Maliheh; Tafreshi, Mansoreh Zaghari

2017-01-01

Introduction Evaluation of clinical competency in nurses has a distinct importance in healthcare due to its significant impact on improving the quality of patient care and creation of opportunities for professional promotion. This is a psychometric study for development of the “Clinical Competency of Mental Health Nursing”(CCMHN) rating scale. Methods In this methodological research that was conducted in 2015, in Tehran, Iran, the main items were developed after literature review and the validity and reliability of the tool were identified. The face, content (content validity ratio and content validity index) and construct validities were calculated. For face and content validity, experts’ comments were used. Exploratory factor analysis was used to determine the construct validity. The reliability of scale was determined by the internal consistency and inter-rater correlation. The collected data were analyzed by SPSS version 16, using descriptive statistical analysis. Results A scale with 45 items in two parts including Emotional/Moral and Specific Care competencies was developed. Content validity ratio and content validity index were 0.88, 0.97 respectively. Exploratory factor analysis indicated two factors: The first factor with 23.93 eigenvalue and second factor with eigenvalue 2.58. Cronbach’s alpha coefficient for determination of internal consistency was 0.98 and the ICC for confirmation inter-rater correlation was 0.98. Conclusion A scale with 45 items and two areas was developed with appropriate validity and reliability. This scale can be used to assess the clinical competency in nursing students and mental health nurses. PMID:28607650

Instruments to identify prescription medication misuse, abuse, and related events in clinical trials: an ACTTION systematic review

PubMed Central

Smith, Shannon M.; Paillard, Florence; McKeown, Andrew; Burke, Laurie B.; Edwards, Robert R.; Katz, Nathaniel P.; Papadopoulos, Elektra J.; Rappaport, Bob A.; Slagle, Ashley; Strain, Eric C.; Wasan, Ajay D.; Turk, Dennis C.; Dworkin, Robert H.

2017-01-01

Measurement of inappropriate medication use events (e.g., abuse, misuse) in clinical trials is important in characterizing a medication’s abuse potential. However, no “gold standard” assessment of inappropriate use events in clinical trials has been identified. In this systematic review, we examine the measurement properties (i.e., content validity, cross-sectional reliability and construct validity, longitudinal construct validity, ability to detect change, and responder definitions) of instruments assessing inappropriate use of opioid and non-opioid prescription medications to identify any that meet U.S. and European regulatory agencies’ rigorous standards for outcome measures in clinical trials. Sixteen published instruments were identified, most of which were not designed for the selected concept of interest and context of use. For this reason, many instruments were found to lack adequate content validity (or documentation of content validity) to evaluate current inappropriate medication use events; for example, evaluating inappropriate use across the lifespan rather than current use, including items that did not directly assess inappropriate use (e.g., questions about anger), or failing to capture information pertinent to inappropriate use events (e.g., intention, route of administration). In addition, the psychometric data across all instruments were generally limited in scope. A further limitation is the heterogeneous, non-standardized use of inappropriate medication use terminology. These observations suggest that available instruments are not well suited for assessing current inappropriate medication use within the specific context of clinical trials. Further effort is needed to develop reliable and valid instruments to measure current inappropriate medication use events in clinical trials. PMID:25660826

The Brunnsviken Brief Quality of Life Scale (BBQ): Development and Psychometric Evaluation.

PubMed

Lindner, Philip; Frykheden, Ola; Forsström, David; Andersson, Erik; Ljótsson, Brjánn; Hedman, Erik; Andersson, Gerhard; Carlbring, Per

2016-04-01

Measurements of subjective quality of life (QoL) are an important complement to symptom ratings in clinical research and practice. Despite there being several established QoL self-rating scales, we identified a need for a freely accessible, easy-to-use inventory, validated for use with both clinical and non-clinical samples, based on the overall life satisfaction conceptualization of QoL. The Brunnsviken Brief Quality of life scale (BBQ) was designed to meet these requirements. Items were selected by performing a factor analysis on a large data-set of QoL ratings collected previously. Six life areas (Leisure time, View on life, Creativity, Learning, Friends and Friendship, and View of self) were identified as important for overall QoL and were included in the BBQ. A psychometric evaluation was performed using two independent samples: healthy undergraduate students (n = 163), and a sample seeking treatment for social anxiety disorder (n = 568). Results suggested a unifactorial structure, with good concurrent and convergent validity, high internal and test-retest reliability, and accurate classification ability. We conclude that the BBQ is a valid and reliable measure of subjective QoL for use in clinical and research settings. The BBQ is presently available in 31 languages and can be freely downloaded from www.bbqscale.com .

Psychological stress in sarcoidosis.

PubMed

Wilsher, Margaret L

2012-09-01

Sarcoidosis is a chronic illness associated with emotional and physical consequences which impact on quality of life. Although the impact of fatigue is well understood, emotional impacts of sarcoidosis are less commonly recognized and addressed in routine clinical practice. The purpose of this review is to highlight that sarcoidosis can result in considerable psychological distress. Not only is there a high prevalence of depressive symptoms in sarcoidosis, but clinical depressive and anxiety disorders are more common than seen in the general population. Patients with sarcoidosis have perceptions and beliefs about their disease that may impact on their willingness to engage in recommended therapies. They may also exhibit a disordered perception of their disease and a personality profile of neuroticism. Understanding the minimally important clinical difference in the Fatigue Assessment Scale (FAS) and validation of the Sarcoidosis Health Questionnaire (SHQ) across different populations supports the use of these tools in routine clinical practice and clinical trials. Understanding the global impact of sarcoidosis is important for patients and clinicians, and use of validated instruments, such as the SHQ and FAS, allows for more comprehensive assessment of the disease and the impact of any interventions.

Design and internal validation of an obstetric early warning score: secondary analysis of the Intensive Care National Audit and Research Centre Case Mix Programme database.

PubMed

Carle, C; Alexander, P; Columb, M; Johal, J

2013-04-01

We designed and internally validated an aggregate weighted early warning scoring system specific to the obstetric population that has the potential for use in the ward environment. Direct obstetric admissions from the Intensive Care National Audit and Research Centre's Case Mix Programme Database were randomly allocated to model development (n = 2240) or validation (n = 2200) sets. Physiological variables collected during the first 24 h of critical care admission were analysed. Logistic regression analysis for mortality in the model development set was initially used to create a statistically based early warning score. The statistical score was then modified to create a clinically acceptable early warning score. Important features of this clinical obstetric early warning score are that the variables are weighted according to their statistical importance, a surrogate for the FI O2 /Pa O2 relationship is included, conscious level is assessed using a simplified alert/not alert variable, and the score, trigger thresholds and response are consistent with the new non-obstetric National Early Warning Score system. The statistical and clinical early warning scores were internally validated using the validation set. The area under the receiver operating characteristic curve was 0.995 (95% CI 0.992-0.998) for the statistical score and 0.957 (95% CI 0.923-0.991) for the clinical score. Pre-existing empirically designed early warning scores were also validated in the same way for comparison. The area under the receiver operating characteristic curve was 0.955 (95% CI 0.922-0.988) for Swanton et al.'s Modified Early Obstetric Warning System, 0.937 (95% CI 0.884-0.991) for the obstetric early warning score suggested in the 2003-2005 Report on Confidential Enquiries into Maternal Deaths in the UK, and 0.973 (95% CI 0.957-0.989) for the non-obstetric National Early Warning Score. This highlights that the new clinical obstetric early warning score has an excellent ability to discriminate survivors from non-survivors in this critical care data set. Further work is needed to validate our new clinical early warning score externally in the obstetric ward environment. Anaesthesia © 2013 The Association of Anaesthetists of Great Britain and Ireland.

Instruments to Identify Prescription Medication Misuse, Abuse, and Related Events in Clinical Trials: An ACTTION Systematic Review.

PubMed

Smith, Shannon M; Paillard, Florence; McKeown, Andrew; Burke, Laurie B; Edwards, Robert R; Katz, Nathaniel P; Papadopoulos, Elektra J; Rappaport, Bob A; Slagle, Ashley; Strain, Eric C; Wasan, Ajay D; Turk, Dennis C; Dworkin, Robert H

2015-05-01

Measurement of inappropriate medication use events (eg, abuse or misuse) in clinical trials is important in characterizing a medication's abuse potential. However, no gold standard assessment of inappropriate use events in clinical trials has been identified. In this systematic review, we examine the measurement properties (ie, content validity, cross-sectional reliability and construct validity, longitudinal construct validity, ability to detect change, and responder definitions) of instruments assessing inappropriate use of opioid and nonopioid prescription medications to identify any that meet U.S. and European regulatory agencies' rigorous standards for outcome measures in clinical trials. Sixteen published instruments were identified, most of which were not designed for the selected concept of interest and context of use. For this reason, many instruments were found to lack adequate content validity (or documentation of content validity) to evaluate current inappropriate medication use events; for example, evaluating inappropriate use across the life span rather than current use, including items that did not directly assess inappropriate use (eg, questions about anger), or failing to capture information pertinent to inappropriate use events (eg, intention and route of administration). In addition, the psychometric data across all instruments were generally limited in scope. A further limitation is the heterogeneous, nonstandardized use of inappropriate medication use terminology. These observations suggest that available instruments are not well suited for assessing current inappropriate medication use within the specific context of clinical trials. Further effort is needed to develop reliable and valid instruments to measure current inappropriate medication use events in clinical trials. This systematic review evaluates the measurement properties of inappropriate medication use (eg, abuse or misuse) instruments to determine whether any meet regulatory standards for clinical trial outcome measures to assess abuse potential. Copyright © 2015 American Pain Society. All rights reserved.

[The Basel Screening Instrument for Psychosis (BSIP): development, structure, reliability and validity].

PubMed

Riecher-Rössler, A; Aston, J; Ventura, J; Merlo, M; Borgwardt, S; Gschwandtner, U; Stieglitz, R-D

2008-04-01

Early detection of psychosis is of growing clinical importance. So far there is, however, no screening instrument for detecting individuals with beginning psychosis in the atypical early stages of the disease with sufficient validity. We have therefore developed the Basel Screening Instrument for Psychosis (BSIP) and tested its feasibility, interrater-reliability and validity. Aim of this paper is to describe the development and structure of the instrument, as well as to report the results of the studies on reliability and validity. The instrument was developed based on a comprehensive search of literature on the most important risk factors and early signs of schizophrenic psychoses. The interraterreliability study was conducted on 24 psychiatric cases. Validity was tested based on 206 individuals referred to our early detection clinic from 3/1/2000 until 2/28/2003. We identified seven categories of relevance for early detection of psychosis and used them to construct a semistructured interview. Interrater-reliability for high risk individuals was high (Kappa .87). Predictive validity was comparable to other, more comprehensive instruments: 16 (32 %) of 50 individuals classified as being at risk for psychosis by the BSIP have in fact developed frank psychosis within an follow-up period of two to five years. The BSIP is the first screening instrument for the early detection of psychosis which has been validated based on transition to psychosis. The BSIP is easy to use by experienced psychiatrists and has a very good interrater-reliability and predictive validity.

Cross-Cultural Validity of the Social Communication Questionnaire for Adults with Intellectual Developmental Disorder

ERIC Educational Resources Information Center

Sappok, Tanja; Brooks, Whitney; Heinrich, Manuel; McCarthy, Jane; Underwood, Lisa

2017-01-01

Diagnosing Autism Spectrum Disorders (ASD) is important throughout the lifespan. The objective was to investigate the transcultural diagnostic validity of the Social Communication Questionnaire (SCQ) in a clinical sample of 451 adults with Intellectual Developmental Disorder (IDD) with and without ASD in Germany, the U.S.A. and Great Britain.…

Predictive and Treatment Validity of Life Satisfaction and the Quality of Life Inventory

ERIC Educational Resources Information Center

Frisch, Michael B.; Clark, Michelle P.; Rouse, Steven V.; Rudd, M. David; Paweleck, Jennifer K.; Greenstone, Andrew; Kopplin, David A.

2005-01-01

The clinical and positive psychology usefulness of quality of life, well-being, and life satisfaction assessments depends on their ability to predict important outcomes and to detect intervention-related change. These issues were explored in the context of a program of instrument validation for the Quality of Life Inventory (QOLI) involving 3,927…

Validation of a modified Bristol stool scale - inter-rater reliability amongst pediatric gastroenterologists

USDA-ARS?s Scientific Manuscript database

Stool form and changes in stool form are important criteria in both clinical practice and clinical research. However, descriptions of stool form from both patients and physicians alike may be subjective and objective measurements of stool form are not well developed. Although the Bristol stool scale...

Validation of a clinical leadership qualities framework for managers in aged care: a Delphi study.

PubMed

Jeon, Yun-Hee; Conway, Jane; Chenoweth, Lynn; Weise, Janelle; Thomas, Tamsin Ht; Williams, Anna

2015-04-01

To establish validity of a clinical leadership framework for aged care middle managers (The Aged care Clinical Leadership Qualities Framework). Middle managers in aged care have responsibility not only for organisational governance also and operational management but also quality service delivery. There is a need to better define clinical leadership abilities in aged care middle managers, in order to optimise their positional authority to lead others to achieve quality outcomes. A Delphi method. Sixty-nine experts in aged care were recruited, representing rural, remote and metropolitan community and residential aged care settings. Panellists were asked to rate the proposed framework in terms of the relevance and importance of each leadership quality using four-point Likert scales, and to provide comments. Three rounds of consultation were conducted. The number and corresponding percentage of the relevance and importance rating for each quality was calculated for each consultation round, as well as mean scores. Consensus was determined to be reached when a percentage score reached 70% or greater. Twenty-three panellists completed all three rounds of consultation. Following the three rounds of consultation, the acceptability and face validity of the framework was confirmed. The study confirmed the framework as useful in identifying leadership requirements for middle managers in Australian aged care settings. The framework is the first validated framework of clinical leadership attributes for middle managers in aged care and offers an initial step forward in clarifying the aged care middle manager role. The framework provides clarity in the breadth of role expectations for the middle managers and can be used to inform an aged care specific leadership program development, individuals' and organisations' performance and development processes; and policy and guidelines about the types of activities required of middle managers in aged care. © 2014 John Wiley & Sons Ltd.

Validating and determining the weight of items used for evaluating clinical governance implementation based on analytic hierarchy process model.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Vafaee Najar, Ali; Meraji, Marziye; Ebrahimipour, Hossein

2015-04-08

The purpose of implementing a system such as Clinical Governance (CG) is to integrate, establish and globalize distinct policies in order to improve quality through increasing professional knowledge and the accountability of healthcare professional toward providing clinical excellence. Since CG is related to change, and change requires money and time, CG implementation has to be focused on priority areas that are in more dire need of change. The purpose of the present study was to validate and determine the significance of items used for evaluating CG implementation. The present study was descriptive-quantitative in method and design. Items used for evaluating CG implementation were first validated by the Delphi method and then compared with one another and ranked based on the Analytical Hierarchy Process (AHP) model. The items that were validated for evaluating CG implementation in Iran include performance evaluation, training and development, personnel motivation, clinical audit, clinical effectiveness, risk management, resource allocation, policies and strategies, external audit, information system management, research and development, CG structure, implementation prerequisites, the management of patients' non-medical needs, complaints and patients' participation in the treatment process. The most important items based on their degree of significance were training and development, performance evaluation, and risk management. The least important items included the management of patients' non-medical needs, patients' participation in the treatment process and research and development. The fundamental requirements of CG implementation included having an effective policy at national level, avoiding perfectionism, using the expertise and potentials of the entire country and the coordination of this model with other models of quality improvement such as accreditation and patient safety. © 2015 by Kerman University of Medical Sciences.

Sideline coverage: when to get radiographs? A review of clinical decision tools.

PubMed

Gould, Sara J; Cardone, Dennis A; Munyak, John; Underwood, Philipp J; Gould, Stephen A

2014-05-01

Sidelines coverage presents unique challenges in the evaluation of injured athletes. Health care providers may be confronted with the question of when to obtain radiographs following an injury. Given that most sidelines coverage occurs outside the elite level, radiographs are not readily available at the time of injury, and the decision of when to send a player for radiographs must be made based on physical examination. Clinical tools have been developed to aid in identifying injuries that are likely to result in radiographically important fractures or dislocations. A search for the keywords x-ray and decision rule along with the anatomic locations shoulder, elbow, wrist, knee, and ankle was performed using the PubMed database. No limits were set regarding year of publication. We selected meta-analyses, randomized controlled trials, and survey results. Our selection focused on the largest, most well-studied published reports. We also attempted to include studies that reported the application of the rules to the field of sports medicine. Retrospective literature review. Level 4. The Ottawa Foot and Ankle Rules have been validated and implemented and are appropriate for use in both pediatric and adult populations. The Ottawa Knee Rules have been widely studied, validated, and accepted for evaluation of knee injuries. There are promising studies of decision rules for clinically important fractures of the wrist, but these studies have not been validated. The elbow has been evaluated with good outcomes via the elbow extension test, which has been validated in both single and multicenter studies. Currently, there are no reliable clinical decision tools for traumatic sports injuries to the shoulder to aid in the decision of when to obtain radiographs. Clinical decision tools have been developed to aid in the diagnosis and management of injuries commonly sustained during sporting events. Tools that have been appropriately validated in populations outside the initial study population can assist sports medicine physicians in the decision of when to get radiographs from the sidelines.

Review of patient-reported outcome measures in chronic hepatitis C

PubMed Central

2012-01-01

Background Chronic hepatitis C (CHC) and its treatment are associated with a variety of patient-reported symptoms and impacts. Some CHC symptoms and impacts may be difficult to evaluate through objective clinical testing, and more easily measured through patient self-report. This literature review identified concepts raised by CHC patients related to symptoms, impacts, and treatment effects, and evaluated integration of these concepts within patient-reported outcome (PRO) measures. The goal of this work was to provide recommendations for incorporation of PRO measurement of concepts that are relevant to the CHC experience into CHC clinical trial design. Methods A three-tiered literature search was conducted. This included searches on concepts of importance, PRO measures used in clinical trials, and existing PRO measures. The PRO Concept Search focused on reviewing issues raised by CHC patients about CHC symptoms, disease impact, and treatment effects. The CHC Trials with PRO Endpoints Search reviewed clinical trials with PRO endpoints to assess differences between treatments over time. The PRO Measure Search reviewed existing PRO measures associated with the concepts of interest. Results This multi-tiered approach identified five key concepts of interest: depression/anxiety, fatigue, flu-like symptoms, cognitive function, insomnia. Comparing these five concepts of interest to the PRO measures in published CHC clinical trials showed that, while treatment of CHC may decrease health-related quality of life in a number of mental and physical domains, the PRO measures that were utilized in published clinical trials inadequately covered the concepts of interest. Further review of 18 existing PRO measures of the concepts of interest showed only four of the 18 were validated in CHC populations. Conclusions This review identified several gaps in the literature regarding assessment of symptoms and outcomes reported as important by CHC patients. Further research is needed to ensure that CHC clinical trials evaluate concepts that are important to patients and include measures that have evidence supporting content validity, reliability, construct validity, and responsiveness. PMID:22871087

Validating archetypes for the Multiple Sclerosis Functional Composite.

PubMed

Braun, Michael; Brandt, Alexander Ulrich; Schulz, Stefan; Boeker, Martin

2014-08-03

Numerous information models for electronic health records, such as openEHR archetypes are available. The quality of such clinical models is important to guarantee standardised semantics and to facilitate their interoperability. However, validation aspects are not regarded sufficiently yet. The objective of this report is to investigate the feasibility of archetype development and its community-based validation process, presuming that this review process is a practical way to ensure high-quality information models amending the formal reference model definitions. A standard archetype development approach was applied on a case set of three clinical tests for multiple sclerosis assessment: After an analysis of the tests, the obtained data elements were organised and structured. The appropriate archetype class was selected and the data elements were implemented in an iterative refinement process. Clinical and information modelling experts validated the models in a structured review process. Four new archetypes were developed and publicly deployed in the openEHR Clinical Knowledge Manager, an online platform provided by the openEHR Foundation. Afterwards, these four archetypes were validated by domain experts in a team review. The review was a formalised process, organised in the Clinical Knowledge Manager. Both, development and review process turned out to be time-consuming tasks, mostly due to difficult selection processes between alternative modelling approaches. The archetype review was a straightforward team process with the goal to validate archetypes pragmatically. The quality of medical information models is crucial to guarantee standardised semantic representation in order to improve interoperability. The validation process is a practical way to better harmonise models that diverge due to necessary flexibility left open by the underlying formal reference model definitions.This case study provides evidence that both community- and tool-enabled review processes, structured in the Clinical Knowledge Manager, ensure archetype quality. It offers a pragmatic but feasible way to reduce variation in the representation of clinical information models towards a more unified and interoperable model.

Validating archetypes for the Multiple Sclerosis Functional Composite

PubMed Central

2014-01-01

Background Numerous information models for electronic health records, such as openEHR archetypes are available. The quality of such clinical models is important to guarantee standardised semantics and to facilitate their interoperability. However, validation aspects are not regarded sufficiently yet. The objective of this report is to investigate the feasibility of archetype development and its community-based validation process, presuming that this review process is a practical way to ensure high-quality information models amending the formal reference model definitions. Methods A standard archetype development approach was applied on a case set of three clinical tests for multiple sclerosis assessment: After an analysis of the tests, the obtained data elements were organised and structured. The appropriate archetype class was selected and the data elements were implemented in an iterative refinement process. Clinical and information modelling experts validated the models in a structured review process. Results Four new archetypes were developed and publicly deployed in the openEHR Clinical Knowledge Manager, an online platform provided by the openEHR Foundation. Afterwards, these four archetypes were validated by domain experts in a team review. The review was a formalised process, organised in the Clinical Knowledge Manager. Both, development and review process turned out to be time-consuming tasks, mostly due to difficult selection processes between alternative modelling approaches. The archetype review was a straightforward team process with the goal to validate archetypes pragmatically. Conclusions The quality of medical information models is crucial to guarantee standardised semantic representation in order to improve interoperability. The validation process is a practical way to better harmonise models that diverge due to necessary flexibility left open by the underlying formal reference model definitions. This case study provides evidence that both community- and tool-enabled review processes, structured in the Clinical Knowledge Manager, ensure archetype quality. It offers a pragmatic but feasible way to reduce variation in the representation of clinical information models towards a more unified and interoperable model. PMID:25087081

A practical guide to surveys and questionnaires.

PubMed

Slattery, Eric L; Voelker, Courtney C J; Nussenbaum, Brian; Rich, Jason T; Paniello, Randal C; Neely, J Gail

2011-06-01

Surveys with questionnaires play a vital role in decision and policy making in society. Within medicine, including otolaryngology, surveys with questionnaires may be the only method for gathering data on rare or unusual events. In addition, questionnaires can be developed and validated to be used as outcome measures in clinical trials and other clinical research architecture. Consequently, it is fundamentally important that such tools be properly developed and validated. Just asking questions that have not gone through rigorous design and development may be misleading and unfair at best; at worst, they can result in under- or overtreatment and unnecessary expense. Furthermore, it is important that consumers of the data produced by these instruments understand the principles of questionnaire design to interpret results in an optimal and meaningful way. This article presents a practical guide for understanding the methodologies of survey and questionnaire design, including the concepts of validity and reliability, how surveys are administered and implemented, and, finally, biases and pitfalls of surveys.

Emotional suppression and breast cancer: validation research on the Spanish Adaptation of the Courtauld Emotional Control Scale (CECS).

PubMed

Durá, Estrella; Andreu, Yolanda; Galdón, Maria José; Ibáñez, Elena; Pérez, Sandra; Ferrando, Maite; Murgui, Sergio; Martínez, Paula

2010-05-01

Emotional suppression has played an important role in the research on psychosocial factors related to cancer. It has been argued to be an important psychological factor predicting worse psychosocial adjustment in people with cancer and it may mediate health outcomes. The reference instrument in the research on emotional suppression is the Courtauld Emotional Control Scale (CECS). The present study analysed construct validity of a new Spanish adaptation of the CECS in a sample of 175 breast cancer patients. The results confirmed the proposal by Watson and Greer claiming that the CECS is composed of three subscales that measure different dimensions, but not independent, from emotional control. The present Spanish version of the CECS showed high internal consistency in each subseale as well as the total score. According to Derogatis (BSI-18) criteria, emotional suppression predicts clinically significant distress. In short, our results support the reliability, validity and utility of this Spanish adaptation of the CECS in clinical and research settings.

Nursing Outcomes for Patients with Risk of Perioperative Positioning Injury.

PubMed

de Lima, Luciana Bjorklund; E Cardozo, Michelle Cardoso; Bernardes, Daniela de Souza; Rabelo-Silva, Eneida Rejane

2018-04-16

To select and refine the outcomes and indicators of Nursing Outcomes Classification for the diagnosis of risk for perioperative positioning injury. Validation study on expert consensus and refinement through pilot study. Eight outcomes and 35 indicators were selected in consensus. After clinical testing was performed, in which 10 patients were assessed at five different times. Eight outcomes and 33 indicators remained in the protocol. This study made it possible to select the most relevant outcomes and indicators to be measured for this diagnosis in clinical practice. Validation studies by consensus and clinical testing are important to promote the accuracy, creating opportunities to legitimize, and improve the concepts of taxonomies. © 2018 NANDA International, Inc.

The application and value of information sources in clinical practice: an examination of the perspective of naturopaths.

PubMed

Steel, Amie; Adams, Jon

2011-06-01

The approach of evidence-based medicine (EBM), providing a paradigm to validate information sources and a process for critiquing their value, is an important platform for guiding practice. Researchers have explored the application and value of information sources in clinical practice with regard to a range of health professions; however, naturopathic practice has been overlooked. An exploratory study of naturopaths' perspectives of the application and value of information sources has been undertaken. Semi-structured interviews with 12 naturopaths in current clinical practice, concerning the information sources used in clinical practice and their perceptions of these sources. Thematic analysis identified differences in the application of the variety of information sources used, depending upon the perceived validity. Internet databases were viewed as highly valid. Textbooks, formal education and interpersonal interactions were judged based upon a variety of factors, whilst validation of general internet sites and manufacturers information was required prior to use. The findings of this study will provide preliminary aid to those responsible for supporting naturopaths' information use and access. In particular, it may assist publishers, medical librarians and professional associations in developing strategies to expand the clinically useful information sources available to naturopaths. © 2011 The authors. Health Information and Libraries Journal © 2011 Health Libraries Group.

Symptom validity testing in memory clinics: Hippocampal-memory associations and relevance for diagnosing mild cognitive impairment.

PubMed

Rienstra, Anne; Groot, Paul F C; Spaan, Pauline E J; Majoie, Charles B L M; Nederveen, Aart J; Walstra, Gerard J M; de Jonghe, Jos F M; van Gool, Willem A; Olabarriaga, Silvia D; Korkhov, Vladimir V; Schmand, Ben

2013-01-01

Patients with mild cognitive impairment (MCI) do not always convert to dementia. In such cases, abnormal neuropsychological test results may not validly reflect cognitive symptoms due to brain disease, and the usual brain-behavior relationships may be absent. This study examined symptom validity in a memory clinic sample and its effect on the associations between hippocampal volume and memory performance. Eleven of 170 consecutive patients (6.5%; 13% of patients younger than 65 years) referred to memory clinics showed noncredible performance on symptom validity tests (SVTs, viz. Word Memory Test and Test of Memory Malingering). They were compared to a demographically matched group (n = 57) selected from the remaining patients. Hippocampal volume, measured by an automated volumetric method (Freesurfer), was correlated with scores on six verbal memory tests. The median correlation was r = .49 in the matched group. However, the relation was absent (median r = -.11) in patients who failed SVTs. Memory clinic samples may include patients who show noncredible performance, which invalidates their MCI diagnosis. This underscores the importance of applying SVTs in evaluating patients with cognitive complaints that may signify a predementia stage, especially when these patients are relatively young.

The Responsiveness and Correlation between Fugl-Meyer Assessment, Motor Status Scale, and the Action Research Arm Test in Chronic Stroke with Upper-Extremity Rehabilitation Robotic Training

ERIC Educational Resources Information Center

Wei, Xi-Jun; Tong, Kai-yu; Hu, Xiao-ling

2011-01-01

Responsiveness of clinical assessments is an important element in the report of clinical effectiveness after rehabilitation. The correlation could reflect the validity of assessments as an indication of clinical performance before and after interventions. This study investigated the correlation and responsiveness of Fugl-Meyer Assessment (FMA),…

Developing an evidence-based practice protocol: implications for midwifery practice.

PubMed

Carr, K C

2000-01-01

Evidence-based practice is defined and its importance to midwifery practice is presented. Guidelines are provided for the development of an evidence-based practice protocol. These include: identifying the clinical question, obtaining the evidence, evaluating the validity and importance of the evidence, synthesizing the evidence and applying it to the development of a protocol or clinical algorithm, and, finally, developing an evaluation plan or measurement strategy to see if the new protocol is effective.

Methodological review of the quality of reach out and read: does it "work"?

PubMed

Yeager Pelatti, Christina; Pentimonti, Jill M; Justice, Laura M

2014-04-01

A considerable percentage of American children and adults fail to learn adequate literacy skills and read below a third grade level. Shared book reading is perhaps the single most important activity to prepare young children for success in reading. The primary objective of this manuscript was to critically review the methodological quality of Read Out and Read (ROR), a clinically based literacy program/intervention that teaches parents strategies to incorporate while sharing books with children as a method of preventing reading difficulties and academic struggles. A PubMed search was conducted. Articles that met three criteria were considered. First, the study must be clinically based and include parent contact with a pediatrician. Second, parental counseling ("anticipatory guidance") about the importance of parent-child book reading must be included. Third, only experimental or quasi-experimental studies were included; no additional criteria were used. Published articles from any year and peer-reviewed journal were considered. Study quality was determined using a modified version of the Downs and Black (1998) checklist assessing four categories: (1) Reporting, (2) External Validity, (3) Internal Validity-Bias, and (4) Internal Validity-Confounding. We were also interested in whether quality differed based on study design, children's age, sample size, and study outcome. Eleven studies met the inclusion criteria. The overall quality of evidence was variable across all studies; Reporting and External Validity categories were relatively strong while methodological concerns were found in the area of internal validity. Quality scores differed on the four study characteristics. Implications related to clinical practice and future studies are discussed.

Health status in patients with coexistent COPD and heart failure: a validation and comparison between the Clinical COPD Questionnaire and the Minnesota Living with Heart Failure Questionnaire

PubMed Central

Berkhof, Farida F; Metzemaekers, Leola; Uil, Steven M; Kerstjens, Huib AM; van den Berg, Jan WK

2014-01-01

Background Chronic obstructive pulmonary disease (COPD) and heart failure (HF) are both common diseases that coexist frequently. Patients with both diseases have worse stable state health status when compared with patients with one of these diseases. In many outpatient clinics, health status is monitored routinely in COPD patients using the Clinical COPD Questionnaire (CCQ) and in HF patients with the Minnesota Living with Heart Failure Questionnaire (MLHF-Q). This study validated and compared which questionnaire, ie, the CCQ or the MLHF-Q, is suited best for patients with coexistent COPD and HF. Methods Patients with both COPD and HF and aged ≥40 years were included. Construct validity, internal consistency, test–retest reliability, and agreement were determined. The Short-Form 36 was used as the external criterion. All questionnaires were completed at baseline. The CCQ and MLHF-Q were repeated after 2 weeks, together with a global rating of change. Results Fifty-eight patients were included, of whom 50 completed the study. Construct validity was acceptable. Internal consistency was adequate for CCQ and MLHF-Q total and domain scores, with a Cronbach’s alpha ≥0.70. Reliability was adequate for MLHF-Q and CCQ total and domain scores, and intraclass correlation coefficients were 0.70–0.90, except for the CCQ symptom score (intraclass correlation coefficient 0.42). The standard error of measurement on the group level was smaller than the minimal clinical important difference for both questionnaires. However, the standard error of measurement on the individual level was larger than the minimal clinical important difference. Agreement was acceptable on the group level and limited on the individual level. Conclusion CCQ and MLHF-Q were both valid and reliable questionnaires for assessment of health status in patients with coexistent COPD and HF on the group level, and hence for research. However, in clinical practice, on the individual level, the characteristics of both questionnaires were not as good. There is room for a questionnaire with good evaluative properties on the individual level, preferably tested in a setting of patients with COPD or HF, or both. PMID:25285000

Validity, Responsiveness, Minimal Detectable Change, and Minimal Clinically Important Change of "Pediatric Balance Scale" in Children with Cerebral Palsy

ERIC Educational Resources Information Center

Chen, Chia-ling; Shen, I-hsuan; Chen, Chung-yao; Wu, Ching-yi; Liu, Wen-Yu; Chung, Chia-ying

2013-01-01

This study examined criterion-related validity and clinimetric properties of the pediatric balance scale ("PBS") in children with cerebral palsy (CP). Forty-five children with CP (age range: 19-77 months) and their parents participated in this study. At baseline and at follow up, Pearson correlation coefficients were used to determine…

Development and validation of a multiplex PCR for detection of Scedosporium spp. in respiratory tract specimens from patients with cystic fibrosis.

PubMed

Harun, Azian; Blyth, Christopher C; Gilgado, Felix; Middleton, Peter; Chen, Sharon C-A; Meyer, Wieland

2011-04-01

The emergence of Scedosporium infections in diverse groups of individuals, which are often treatment refractory, warrants timely and accurate laboratory diagnosis. Species- or group-specific primers based on internal transcribed spacer (ITS) sequence polymorphisms were designed for Scedosporium aurantiacum, Scedosporium dehoogii, Scedosporium prolificans, Pseudallescheria boydii species complex (former clade 5)/Pseudallescheria apiosperma (formerly classified as S. apiospermum sensu lato) and Pseudallescheria minutispora. Primers for S. aurantiacum, S. prolificans, and P. boydii species complex/P. apiosperma were incorporated into a multiplex PCR assay for the detection and identification of the three major clinically important Scedosporium species and validated using sputum specimens collected from patients seen at a major Australian cystic fibrosis clinic. The multiplex PCR assay showed 100% specificity in identifying the three major clinically relevant Scedosporium species from pure culture. When evaluated using DNA extracts from sputa, sensitivity and specificity of the multiplex PCR assay were 62.1% and 97.2%, respectively. This highly species-specific multiplex PCR assay offers a rapid and simple method of detection of the most clinically important Scedosporium species in respiratory tract specimens.

Longitudinal construct validity: establishment of clinical meaning in patient evaluative instruments.

PubMed

Liang, M H

2000-09-01

Although widely used and reported in research for the evaluation of groups, measures of health status and health-related quality of life have had little application in clinical practice for the assessment of individual patients. One of the principal barriers is the demonstration that these measures add clinically significant information to measures of function or symptoms alone. Here, we review the methods for evaluation of construct validity in longitudinal studies and make recommendations for nomenclature, reporting of study results, and future research agenda. Analytical review. The terms "sensitivity" and "responsiveness" have been used interchangeably, and there are few studies that evaluate the extent to which health status or health-related quality-of life measures capture clinically important changes ("responsiveness"). Current methods of evaluating responsiveness are not standardized or evaluated. Approaches for the assessment of a clinically significant or meaningful change are described; rather than normative information, however, standardized transition questions are proposed. They would be reported routinely and as separate axes of description to capture individual perceptions. Research in methods to assess the subject's evaluation of the importance and magnitude of a measured change are critical if health status and health-related quality-of-life measures are to have an impact on patient care.

Determination of N-acylhomoserine lactones of Pseudomonas aeruginosa in clinical samples from dogs with otitis externa.

PubMed

Kušar, Darja; Šrimpf, Karin; Isaković, Petra; Kalšek, Lina; Hosseini, Javid; Zdovc, Irena; Kotnik, Tina; Vengušt, Modest; Tavčar-Kalcher, Gabrijela

2016-10-18

Bacterial intercellular communication, called quorum sensing, takes place via the production and collective response to signal molecules. In Gram-negative bacteria, like Pseudomonas aeruginosa, these signaling molecules are N-acylhomoserine lactones (AHLs). P. aeruginosa is a common cause of inflammation of the ear canal (otitis externa) in dogs. It employs quorum sensing to coordinate the expression of host tissue-damaging factors, which are largely responsible for its virulence. The treatment of P. aeruginosa-associated otitis is challenging due to a high intrinsic resistance of P. aeruginosa to several antibiotics. Attenuation of quorum sensing signals to inhibit bacterial virulence is a novel strategy for the treatment of resistant bacterial pathogens, including P. aeruginosa. Therefore, it is important to recognize and define quorum sensing signal molecules in clinical samples. To date, there are no reports on determination of AHLs in the veterinary clinical samples. The purpose of this study was to validate an analytical procedure for determination of the concentration of AHLs in the ear rinses from dogs with P. aeruginosa-associated otitis externa. Samples were obtained with rinsing the ear canals with physiological saline solution. For validation, samples from healthy dogs were spiked with none or different known amounts of the selected AHLs. With the validated procedure, AHLs were analyzed in the samples taken in weekly intervals from two dogs, receiving a standard treatment for P. aeruginosa-associated otitis externa. Validation proved that the procedure enables quantification of AHLs in non-clinical and clinical samples. In addition, a time dependent reduction of AHL concentration was detected for the treated dogs. Our results indicate that liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS) is superior in detecting AHLs compared to other chromatographic techniques. This is the first report on determination of AHLs in the clinical samples of veterinary importance. The analytical procedure described in this paper is capable of supporting novel antimicrobial strategies, which target quorum sensing.

Evaluative measurement properties of the patient-specific functional scale for primary shoulder complaints in physical therapy practice.

PubMed

Koehorst, Marije L S; van Trijffel, Emiel; Lindeboom, Robert

2014-08-01

Clinical measurement, longitudinal. To assess the test-retest reliability, construct validity, and responsiveness of the Patient-Specific Functional Scale (PSFS) in patients with a primary shoulder complaint. Health measurement outcomes have become increasingly important for evaluating treatment. Patient-specific questionnaires are useful tools for determining treatment goals and evaluating treatment in individual patients. These questionnaires have not yet been validated in patients with nonspecific shoulder pain. Patients completed the PSFS, the numeric pain rating scale, and the Shoulder Pain and Disability Index at baseline, and after 1 week and 4 to 6 weeks. Test-retest reliability was determined using intraclass correlation coefficients. To assess convergent validity, change scores of the PSFS were correlated with the numeric pain rating scale and Shoulder Pain and Disability Index change scores. Responsiveness was assessed by calculating the area under the curve, the minimal clinically important change, and minimal detectable change, using the global rating of change as an external criterion. Fifty patients (37 men; mean age, 47.7 years) participated in the study. Reliability was high (intraclass correlation coefficient = 0.87; 95% confidence interval [CI]: 0.72, 0.94). The correlations between the change scores of the PSFS and those of the Shoulder Pain and Disability Index and numeric pain rating scale were 0.45 (95% CI: 0.17, 0.80) and 0.55 (95% CI: 0.29, 0.73), respectively. The area under the curve for the PSFS was 0.67 (95% CI: 0.51, 0.83). The minimal detectable change and minimal clinically important change were 0.97 and 1.29 points, respectively. These results suggest that the PSFS is a reliable, valid, and responsive instrument that can be used as an evaluative instrument in patients with a primary shoulder complaint.

The Abbott RealTime High Risk HPV test is a clinically validated human papillomavirus assay for triage in the referral population and use in primary cervical cancer screening in women 30 years and older: a review of validation studies.

PubMed

Poljak, Mario; Oštrbenk, Anja

2013-01-01

Human papillomavirus (HPV) testing has become an essential part of current clinical practice in the management of cervical cancer and precancerous lesions. We reviewed the most important validation studies of a next-generation real-time polymerase chain reaction-based assay, the RealTime High Risk HPV test (RealTime)(Abbott Molecular, Des Plaines, IL, USA), for triage in referral population settings and for use in primary cervical cancer screening in women 30 years and older published in peer-reviewed journals from 2009 to 2013. RealTime is designed to detect 14 high-risk HPV genotypes with concurrent distinction of HPV-16 and HPV-18 from 12 other HPV genotypes. The test was launched on the European market in January 2009 and is currently used in many laboratories worldwide for routine detection of HPV. We concisely reviewed validation studies of a next-generation real-time polymerase chain reaction (PCR)-based assay: the Abbott RealTime High Risk HPV test. Eight validation studies of RealTime in referral settings showed its consistently high absolute clinical sensitivity for both CIN2+ (range 88.3-100%) and CIN3+ (range 93.0-100%), as well as comparative clinical sensitivity relative to the currently most widely used HPV test: the Qiagen/Digene Hybrid Capture 2 HPV DNA Test (HC2). Due to the significantly different composition of the referral populations, RealTime absolute clinical specificity for CIN2+ and CIN3+ varied greatly across studies, but was comparable relative to HC2. Four validation studies of RealTime performance in cervical cancer screening settings showed its consistently high absolute clinical sensitivity for both CIN2+ and CIN3+, as well as comparative clinical sensitivity and specificity relative to HC2 and GP5+/6+ PCR. RealTime has been extensively evaluated in the last 4 years. RealTime can be considered clinically validated for triage in referral population settings and for use in primary cervical cancer screening in women 30 years and older.

[Modeling in value-based medicine].

PubMed

Neubauer, A S; Hirneiss, C; Kampik, A

2010-03-01

Modeling plays an important role in value-based medicine (VBM). It allows decision support by predicting potential clinical and economic consequences, frequently combining different sources of evidence. Based on relevant publications and examples focusing on ophthalmology the key economic modeling methods are explained and definitions are given. The most frequently applied model types are decision trees, Markov models, and discrete event simulation (DES) models. Model validation includes besides verifying internal validity comparison with other models (external validity) and ideally validation of its predictive properties. The existing uncertainty with any modeling should be clearly stated. This is true for economic modeling in VBM as well as when using disease risk models to support clinical decisions. In economic modeling uni- and multivariate sensitivity analyses are usually applied; the key concepts here are tornado plots and cost-effectiveness acceptability curves. Given the existing uncertainty, modeling helps to make better informed decisions than without this additional information.

The validity of the Health-Relevant Personality Inventory (HP5i) and the Junior Temperament and Character Inventory (JTCI) among adolescents referred for a substance misuse problem.

PubMed

Hemphälä, Malin; Gustavsson, J Petter; Tengström, Anders

2013-01-01

The aim was to study the validity of 2 personality instruments, the Health-Relevant Personality Inventory (HP5i) and the Junior Temperament and Character Inventory (JTCI), among adolescents with a substance use problem. Clinical interviews were completed with 180 adolescents and followed up after 12 months. Discriminant validity was demonstrated in the lack of correlation to intelligence in both instruments' scales. Two findings were in support of convergent validity: Negative affectivity (HP5i) and harm avoidance (JTCI) were correlated to internalizing symptoms, and impulsivity (HP5i) and novelty seeking (JTCI) were correlated to externalizing symptoms. The predictive validity of JTCI was partly supported. When psychiatric symptoms at baseline were controlled for, cooperativeness predicted conduct disorder after 12 months. Summarizing, both instruments can be used in adolescent clinical samples to tailor treatment efforts, although some scales need further investigation. It is important to include personality assessment when evaluating psychiatric problems in adolescents.

Development and Validation of a Natural Language Processing Tool to Identify Patients Treated for Pneumonia across VA Emergency Departments.

PubMed

Jones, B E; South, B R; Shao, Y; Lu, C C; Leng, J; Sauer, B C; Gundlapalli, A V; Samore, M H; Zeng, Q

2018-01-01

Identifying pneumonia using diagnosis codes alone may be insufficient for research on clinical decision making. Natural language processing (NLP) may enable the inclusion of cases missed by diagnosis codes. This article (1) develops a NLP tool that identifies the clinical assertion of pneumonia from physician emergency department (ED) notes, and (2) compares classification methods using diagnosis codes versus NLP against a gold standard of manual chart review to identify patients initially treated for pneumonia. Among a national population of ED visits occurring between 2006 and 2012 across the Veterans Affairs health system, we extracted 811 physician documents containing search terms for pneumonia for training, and 100 random documents for validation. Two reviewers annotated span- and document-level classifications of the clinical assertion of pneumonia. An NLP tool using a support vector machine was trained on the enriched documents. We extracted diagnosis codes assigned in the ED and upon hospital discharge and calculated performance characteristics for diagnosis codes, NLP, and NLP plus diagnosis codes against manual review in training and validation sets. Among the training documents, 51% contained clinical assertions of pneumonia; in the validation set, 9% were classified with pneumonia, of which 100% contained pneumonia search terms. After enriching with search terms, the NLP system alone demonstrated a recall/sensitivity of 0.72 (training) and 0.55 (validation), and a precision/positive predictive value (PPV) of 0.89 (training) and 0.71 (validation). ED-assigned diagnostic codes demonstrated lower recall/sensitivity (0.48 and 0.44) but higher precision/PPV (0.95 in training, 1.0 in validation); the NLP system identified more "possible-treated" cases than diagnostic coding. An approach combining NLP and ED-assigned diagnostic coding classification achieved the best performance (sensitivity 0.89 and PPV 0.80). System-wide application of NLP to clinical text can increase capture of initial diagnostic hypotheses, an important inclusion when studying diagnosis and clinical decision-making under uncertainty. Schattauer GmbH Stuttgart.

Statistical Design for Biospecimen Cohort Size in Proteomics-based Biomarker Discovery and Verification Studies

PubMed Central

Skates, Steven J.; Gillette, Michael A.; LaBaer, Joshua; Carr, Steven A.; Anderson, N. Leigh; Liebler, Daniel C.; Ransohoff, David; Rifai, Nader; Kondratovich, Marina; Težak, Živana; Mansfield, Elizabeth; Oberg, Ann L.; Wright, Ian; Barnes, Grady; Gail, Mitchell; Mesri, Mehdi; Kinsinger, Christopher R.; Rodriguez, Henry; Boja, Emily S.

2014-01-01

Protein biomarkers are needed to deepen our understanding of cancer biology and to improve our ability to diagnose, monitor and treat cancers. Important analytical and clinical hurdles must be overcome to allow the most promising protein biomarker candidates to advance into clinical validation studies. Although contemporary proteomics technologies support the measurement of large numbers of proteins in individual clinical specimens, sample throughput remains comparatively low. This problem is amplified in typical clinical proteomics research studies, which routinely suffer from a lack of proper experimental design, resulting in analysis of too few biospecimens to achieve adequate statistical power at each stage of a biomarker pipeline. To address this critical shortcoming, a joint workshop was held by the National Cancer Institute (NCI), National Heart, Lung and Blood Institute (NHLBI), and American Association for Clinical Chemistry (AACC), with participation from the U.S. Food and Drug Administration (FDA). An important output from the workshop was a statistical framework for the design of biomarker discovery and verification studies. Herein, we describe the use of quantitative clinical judgments to set statistical criteria for clinical relevance, and the development of an approach to calculate biospecimen sample size for proteomic studies in discovery and verification stages prior to clinical validation stage. This represents a first step towards building a consensus on quantitative criteria for statistical design of proteomics biomarker discovery and verification research. PMID:24063748

Statistical design for biospecimen cohort size in proteomics-based biomarker discovery and verification studies.

PubMed

Skates, Steven J; Gillette, Michael A; LaBaer, Joshua; Carr, Steven A; Anderson, Leigh; Liebler, Daniel C; Ransohoff, David; Rifai, Nader; Kondratovich, Marina; Težak, Živana; Mansfield, Elizabeth; Oberg, Ann L; Wright, Ian; Barnes, Grady; Gail, Mitchell; Mesri, Mehdi; Kinsinger, Christopher R; Rodriguez, Henry; Boja, Emily S

2013-12-06

Protein biomarkers are needed to deepen our understanding of cancer biology and to improve our ability to diagnose, monitor, and treat cancers. Important analytical and clinical hurdles must be overcome to allow the most promising protein biomarker candidates to advance into clinical validation studies. Although contemporary proteomics technologies support the measurement of large numbers of proteins in individual clinical specimens, sample throughput remains comparatively low. This problem is amplified in typical clinical proteomics research studies, which routinely suffer from a lack of proper experimental design, resulting in analysis of too few biospecimens to achieve adequate statistical power at each stage of a biomarker pipeline. To address this critical shortcoming, a joint workshop was held by the National Cancer Institute (NCI), National Heart, Lung, and Blood Institute (NHLBI), and American Association for Clinical Chemistry (AACC) with participation from the U.S. Food and Drug Administration (FDA). An important output from the workshop was a statistical framework for the design of biomarker discovery and verification studies. Herein, we describe the use of quantitative clinical judgments to set statistical criteria for clinical relevance and the development of an approach to calculate biospecimen sample size for proteomic studies in discovery and verification stages prior to clinical validation stage. This represents a first step toward building a consensus on quantitative criteria for statistical design of proteomics biomarker discovery and verification research.

Comment on Hall et al. (2017), "How to Choose Between Measures of Tinnitus Loudness for Clinical Research? A Report on the Reliability and Validity of an Investigator-Administered Test and a Patient-Reported Measure Using Baseline Data Collected in a Phase IIa Drug Trial".

PubMed

Sabour, Siamak

2018-03-08

The purpose of this letter, in response to Hall, Mehta, and Fackrell (2017), is to provide important knowledge about methodology and statistical issues in assessing the reliability and validity of an audiologist-administered tinnitus loudness matching test and a patient-reported tinnitus loudness rating. The author uses reference textbooks and published articles regarding scientific assessment of the validity and reliability of a clinical test to discuss the statistical test and the methodological approach in assessing validity and reliability in clinical research. Depending on the type of the variable (qualitative or quantitative), well-known statistical tests can be applied to assess reliability and validity. The qualitative variables of sensitivity, specificity, positive predictive value, negative predictive value, false positive and false negative rates, likelihood ratio positive and likelihood ratio negative, as well as odds ratio (i.e., ratio of true to false results), are the most appropriate estimates to evaluate validity of a test compared to a gold standard. In the case of quantitative variables, depending on distribution of the variable, Pearson r or Spearman rho can be applied. Diagnostic accuracy (validity) and diagnostic precision (reliability or agreement) are two completely different methodological issues. Depending on the type of the variable (qualitative or quantitative), well-known statistical tests can be applied to assess validity.

Clinical utility of measures of breathlessness.

PubMed

Cullen, Deborah L; Rodak, Bernadette

2002-09-01

The clinical utility of measures of dyspnea has been debated in the health care community. Although breathlessness can be evaluated with various instruments, the most effective dyspnea measurement tool for patients with chronic lung disease or for measuring treatment effectiveness remains uncertain. Understanding the evidence for the validity and reliability of these instruments may provide a basis for appropriate clinical application. Evaluate instruments designed to measure breathlessness, either as single-symptom or multidimensional instruments, based on psychometrics foundations such as validity, reliability, and discriminative and evaluative properties. Classification of each dyspnea measurement instrument will recommend clinical application in terms of exercise, benchmarking patients, activities of daily living, patient outcomes, clinical trials, and responsiveness to treatment. Eleven dyspnea measurement instruments were selected. Each instrument was assessed as discriminative or evaluative and then analyzed as to its psychometric properties and purpose of design. Descriptive data from all studies were described according to their primary patient application (ie, chronic obstructive pulmonary disease, asthma, or other patient populations). The Borg Scale and the Visual Analogue Scale are applicable to exertion and thus can be applied to any cardiopulmonary patient to determine dyspnea. All other measures were determined appropriate for chronic obstructive pulmonary disease, whereas the Shortness of Breath Questionnaire can be applied to cystic fibrosis and lung transplant patients. The most appropriate utility for all instruments was measuring the effects on activities of daily living and for benchmarking patient progress. Instruments that quantify function and health-related quality of life have great utility for documenting outcomes but may be limited as to documenting treatment responsiveness in terms of clinically important changes. The dyspnea measurement instruments we studied meet important standards of validity and reliability. Discriminative measures have limited clinical utility and, when used for populations or conditions for which they are not designed or validated, the data collected may not be clinically relevant. Evaluative measures have greater clinical utility and can be applied for outcome purposes. Measures should be applied to the populations and conditions for which they were designed. The relationship between clinical therapies and the measurement of dyspnea as an outcome can develop as respiratory therapists become more comfortable with implementing dyspnea measurement instruments and use the data to improve patient treatment. Dyspnea evaluation should be considered for all clinical practice guidelines and care pathways.

Psychometric Testing of the Greek Version of the Clinical Learning Environment-Teacher (CLES+T).

PubMed

Papastavrou, Evridiki; Dimitriadou, Maria; Tsangari, Haritini

2015-09-01

Clinical practice is an important part of nursing education, and robust instruments are required to evaluate the effectiveness of the hospital setting as a learning environment. The study aim is the psychometric test of the Clinical Learning Environment+Teacher (CLES+T) scale-Greek version. 463 students practicing in acute care hospitals participated in the study. The reliability of the instrument was estimated with Cronbach's alpha coefficients. The construct validity was evaluated using exploratory factor analysis (EFA) with Varimax rotation. Convergent validity was examined by measuring the bivariate correlations between the scale/subscales. Content, validity and semantic equivalence were examined through reviews by a panel of experts. The total scale showed high internal consistency (α=0.95). EFA was identical to the original scale, had eigen values larger than one and explained a total of 67.4% of the variance. The factor with the highest eigen value and the largest percentage of variance explained was "supervisory relationship", with an original eigenvalue of 13.1 (6.8 after Varimax rotation) and an explanation of around 38% of the variance (or 20% after rotation). Convergent validity was examined by measuring the bivariate correlations between the scale and a question that measured the general satisfaction. The Greek version of the CLES+T is a valid and reliable instrument that can be used to examine students' perceptions of the clinical learning environment.

Clinical utility and validity of the Functional Disability Inventory (FDI) among a multicenter sample of youth with chronic pain

PubMed Central

Kashikar-Zuck, Susmita; Flowers, Stacy R.; Claar, Robyn Lewis; Guite, Jessica W.; Logan, Deirdre E.; Lynch-Jordan, Anne M; Palermo, Tonya M.; Wilson, Anna C.

2011-01-01

The Functional Disability Inventory (FDI) is a well-established and commonly used measure of physical functioning and disability in youth with chronic pain. Further validation of the measure has been called for, in particular, examination of the clinical utility and factor structure of the measure. To address this need, we utilized a large multicenter dataset of pediatric patients with chronic pain who had completed the FDI and other measures assessing pain and emotional functioning. Clinical reference points to allow for interpretation of raw scores were developed to enhance clinical utility of the measure and exploratory factor analysis was performed to examine its factor structure. Participants included 1300 youth ages 8 to 18 years (M=14.2 years; 76% female) with chronic pain. Examination of the distribution of FDI scores and validation with measures of depressive symptoms and pain intensity yielded three distinct categories of disability: No/Minimal Disability, Moderate Disability and Severe Disability. Factor analysis of FDI scores revealed a two-factor solution representing vigorous Physical Activities and non-physically strenuous Daily Activities. The three-level classification system and factor structure were further explored via comparison across the four most commonly encountered pain conditions in clinical settings (head, back, abdominal and widespread pain). Our findings provide important new information regarding the clinical utility and validity of the FDI. This will greatly enhance the interpretability of scores for research and clinical use in a wide range of pediatric pain conditions. In particular these findings will facilitate use of the FDI as an outcome measure in future clinical trials. PMID:21458162

Validation of computerized sniffer for monitoring perioperative normothermia.

PubMed

Giri, Jyothsna; Li, Man; Pickering, Brian; Subramanian, Arun; Kor, Daryl J; Herasevich, Vitaly

2013-01-01

The World Health Organization sets a standard to maintain patient core temperature greater than 36°C throughout the perioperative period. Normothermia (defined as >36°C) in the Operating Room (OR) is an important factor to preventing complications in patients (MI, infection, coagulopathy). Randomized studies suggests that maintaining at higher temperatures may further reduce complications in surgery (less complications for group at 36.4°C than the control group at 36.0°C) [1,2]. Perioperative normothermia is an important but often unrecognized element during anesthesia. Early recognition of hypothermia would allow for appropriate interventions and prevent complications. Manual validation of the diagnostic performance a clinical tool (alert) that would automatically measure changes in core temperature to identify patients who fail to be in range of normothermia during surgery. The clinical tool (alert) was found to be 97 % sensitive.

Test-retest and interrater reliability of the functional lower extremity evaluation.

PubMed

Haitz, Karyn; Shultz, Rebecca; Hodgins, Melissa; Matheson, Gordon O

2014-12-01

Repeated-measures clinical measurement reliability study. To establish the reliability and face validity of the Functional Lower Extremity Evaluation (FLEE). The FLEE is a 45-minute battery of 8 standardized functional performance tests that measures 3 components of lower extremity function: control, power, and endurance. The reliability and normative values for the FLEE in healthy athletes are unknown. A face validity survey for the FLEE was sent to sports medicine personnel to evaluate the level of importance and frequency of clinical usage of each test included in the FLEE. The FLEE was then administered and rated for 40 uninjured athletes. To assess test-retest reliability, each athlete was tested twice, 1 week apart, by the same rater. To assess interrater reliability, 3 raters scored each athlete during 1 of the testing sessions. Intraclass correlation coefficients were used to assess the test-retest and interrater reliability of each of the FLEE tests. In the face validity survey, the FLEE tests were rated as highly important by 58% to 71% of respondents but frequently used by only 26% to 45% of respondents. Interrater reliability intraclass correlation coefficients ranged from 0.83 to 1.00, and test-retest reliability ranged from 0.71 to 0.95. The FLEE tests are considered clinically important for assessing lower extremity function by sports medicine personnel but are underused. The FLEE also is a reliable assessment tool. Future studies are required to determine if use of the FLEE to make return-to-play decisions may reduce reinjury rates.

A validated LC-MS/MS method for the quantitative measurement of creatinine as an endogenous biomarker in human plasma.

PubMed

Zhao, Yue; Liu, Guowen; Angeles, Aida; Christopher, Lisa J; Wang, Zhaoqing; Arnold, Mark E; Shen, Jim X

2016-10-01

Creatinine is an endogenous compound generated from creatine by normal muscular metabolism. It is an important indicator of renal function and the serum level is routinely monitored in clinical labs. Results & methodology: Surrogate analyte (d3-creatinine) was used for calibration standard and quality control preparation and the relative instrument response ratio between creatinine and d3-creatinine was used to calculate the endogenous creatinine concentrations. A fit-for-purpose strategy of using a surrogate analyte and authentic matrix was adopted for this validation. The assay was the first human plasma assay using such strategy and was successfully applied to a clinical study to confirm a transient elevation of creatinine observed using an existing clinical assay.

Are You "Tilting at Windmills" or Undertaking a Valid Clinical Trial?

PubMed Central

Zariffa, Jose; Kramer, John L.K.

2011-01-01

In this review, several aspects surrounding the choice of a therapeutic intervention and the conduct of clinical trials are discussed. Some of the background for why human studies have evolved to their current state is also included. Specifically, the following questions have been addressed: 1) What criteria should be used to determine whether a scientific discovery or invention is worthy of translation to human application? 2) What recent scientific advance warrants a deeper understanding of clinical trials by everyone? 3) What are the different types and phases of a clinical trial? 4) What characteristics of a human disorder should be noted, tracked, or stratified for a clinical trial and what inclusion /exclusion criteria are important to enrolling appropriate trial subjects? 5) What are the different study designs that can be used in a clinical trial program? 6) What confounding factors can alter the accurate interpretation of clinical trial outcomes? 7) What are the success rates of clinical trials and what can we learn from previous clinical trials? 8) What are the essential principles for the conduct of valid clinical trials? PMID:21786433

Prediction models for successful external cephalic version: a systematic review.

PubMed

Velzel, Joost; de Hundt, Marcella; Mulder, Frederique M; Molkenboer, Jan F M; Van der Post, Joris A M; Mol, Ben W; Kok, Marjolein

2015-12-01

To provide an overview of existing prediction models for successful ECV, and to assess their quality, development and performance. We searched MEDLINE, EMBASE and the Cochrane Library to identify all articles reporting on prediction models for successful ECV published from inception to January 2015. We extracted information on study design, sample size, model-building strategies and validation. We evaluated the phases of model development and summarized their performance in terms of discrimination, calibration and clinical usefulness. We collected different predictor variables together with their defined significance, in order to identify important predictor variables for successful ECV. We identified eight articles reporting on seven prediction models. All models were subjected to internal validation. Only one model was also validated in an external cohort. Two prediction models had a low overall risk of bias, of which only one showed promising predictive performance at internal validation. This model also completed the phase of external validation. For none of the models their impact on clinical practice was evaluated. The most important predictor variables for successful ECV described in the selected articles were parity, placental location, breech engagement and the fetal head being palpable. One model was assessed using discrimination and calibration using internal (AUC 0.71) and external validation (AUC 0.64), while two other models were assessed with discrimination and calibration, respectively. We found one prediction model for breech presentation that was validated in an external cohort and had acceptable predictive performance. This model should be used to council women considering ECV. Copyright © 2015. Published by Elsevier Ireland Ltd.

A biomarker-based risk score to predict death in patients with atrial fibrillation: the ABC (age, biomarkers, clinical history) death risk score

PubMed Central

Hijazi, Ziad; Oldgren, Jonas; Lindbäck, Johan; Alexander, John H; Connolly, Stuart J; Eikelboom, John W; Ezekowitz, Michael D; Held, Claes; Hylek, Elaine M; Lopes, Renato D; Yusuf, Salim; Granger, Christopher B; Siegbahn, Agneta; Wallentin, Lars

2018-01-01

Abstract Aims In atrial fibrillation (AF), mortality remains high despite effective anticoagulation. A model predicting the risk of death in these patients is currently not available. We developed and validated a risk score for death in anticoagulated patients with AF including both clinical information and biomarkers. Methods and results The new risk score was developed and internally validated in 14 611 patients with AF randomized to apixaban vs. warfarin for a median of 1.9 years. External validation was performed in 8548 patients with AF randomized to dabigatran vs. warfarin for 2.0 years. Biomarker samples were obtained at study entry. Variables significantly contributing to the prediction of all-cause mortality were assessed by Cox-regression. Each variable obtained a weight proportional to the model coefficients. There were 1047 all-cause deaths in the derivation and 594 in the validation cohort. The most important predictors of death were N-terminal pro B-type natriuretic peptide, troponin-T, growth differentiation factor-15, age, and heart failure, and these were included in the ABC (Age, Biomarkers, Clinical history)-death risk score. The score was well-calibrated and yielded higher c-indices than a model based on all clinical variables in both the derivation (0.74 vs. 0.68) and validation cohorts (0.74 vs. 0.67). The reduction in mortality with apixaban was most pronounced in patients with a high ABC-death score. Conclusion A new biomarker-based score for predicting risk of death in anticoagulated AF patients was developed, internally and externally validated, and well-calibrated in two large cohorts. The ABC-death risk score performed well and may contribute to overall risk assessment in AF. ClinicalTrials.gov identifier NCT00412984 and NCT00262600 PMID:29069359

Development and psychometric testing of the Clinical Learning Organisational Culture Survey (CLOCS).

PubMed

Henderson, Amanda; Creedy, Debra; Boorman, Rhonda; Cooke, Marie; Walker, Rachel

2010-10-01

This paper describes the development and psychometric testing of the Clinical Learning Organisational Culture Survey (CLOCS) that measures prevailing beliefs and assumptions important for learning to occur in the workplace. Items from a tool that measured motivation in workplace learning were adapted to the nursing practice context. The tool was tested in the clinical setting, and then further modified to enhance face and content validity. Registered nurses (329) across three major Australian health facilities were surveyed between June 2007 and September 2007. An exploratory factor analysis identified five concepts--recognition, dissatisfaction, affiliation, accomplishment, and influence. VALIDITY AND RELIABILITY: Internal consistency measures of reliability revealed that four concepts had good internal consistency: recognition (alpha=.914), dissatisfaction (alpha=.771), affiliation (alpha=.801), accomplishment (alpha=.664), but less so for influence (alpha=.529). This tool effectively measures recognition, affiliation and accomplishment--three concepts important for learning in practice situations, as well as dissatisfied staff across all these domains. Testing of additional influence items identify that this concept is difficult to delineate. The CLOCS can effectively inform leaders about concepts inherent in the culture important for maximising learning by staff. Crown Copyright © 2009. Published by Elsevier Ltd. All rights reserved.

Sideline Coverage

PubMed Central

Gould, Sara J.; Cardone, Dennis A.; Munyak, John; Underwood, Philipp J.; Gould, Stephen A.

2014-01-01

Context: Sidelines coverage presents unique challenges in the evaluation of injured athletes. Health care providers may be confronted with the question of when to obtain radiographs following an injury. Given that most sidelines coverage occurs outside the elite level, radiographs are not readily available at the time of injury, and the decision of when to send a player for radiographs must be made based on physical examination. Clinical tools have been developed to aid in identifying injuries that are likely to result in radiographically important fractures or dislocations. Evidence Acquisition: A search for the keywords x-ray and decision rule along with the anatomic locations shoulder, elbow, wrist, knee, and ankle was performed using the PubMed database. No limits were set regarding year of publication. We selected meta-analyses, randomized controlled trials, and survey results. Our selection focused on the largest, most well-studied published reports. We also attempted to include studies that reported the application of the rules to the field of sports medicine. Study Design: Retrospective literature review. Level of Evidence: Level 4. Results: The Ottawa Foot and Ankle Rules have been validated and implemented and are appropriate for use in both pediatric and adult populations. The Ottawa Knee Rules have been widely studied, validated, and accepted for evaluation of knee injuries. There are promising studies of decision rules for clinically important fractures of the wrist, but these studies have not been validated. The elbow has been evaluated with good outcomes via the elbow extension test, which has been validated in both single and multicenter studies. Currently, there are no reliable clinical decision tools for traumatic sports injuries to the shoulder to aid in the decision of when to obtain radiographs. Conclusion: Clinical decision tools have been developed to aid in the diagnosis and management of injuries commonly sustained during sporting events. Tools that have been appropriately validated in populations outside the initial study population can assist sports medicine physicians in the decision of when to get radiographs from the sidelines. PMID:24790698

Alliance of Glycobiologists for Detection of Cancer | Division of Cancer Prevention

Cancer.gov

A consortium of eight Tumor Glycomics Laboratories is working to reveal cancer-related dynamics of complex carbohydrates to develop new, validated clinical biomarkers for early detection. Studying important biologic mechanisms, Alliance investigators focus their efforts on diverse classes of glycan markers that are likely to play important roles in cancer development. | 8

Treatment Fidelity: Its Importance and Reported Frequency in Aphasia Treatment Studies

ERIC Educational Resources Information Center

Hinckley, Jacqueline J.; Douglas, Natalie F.

2013-01-01

Purpose: Treatment fidelity is a measure of the reliability of the administration of an intervention in a treatment study. It is an important aspect of the validity of a research study, and it has implications for the ultimate implementation of evidence-supported interventions in typical clinical settings. Method: Aphasia treatment studies…

Development and initial validity of the in-hand manipulation assessment.

PubMed

Klymenko, Gabrielle; Liu, Karen P Y; Bissett, Michelle; Fong, Kenneth N K; Welage, Nandana; Wong, Rebecca S M

2018-04-01

A review of the literature related to in-hand manipulation (IHM) revealed that there is no assessment which specifically measures this construct in the adult population. This study reports the face and content validity of an IHM assessment for adults with impaired hand function based on expert opinion. The definition of IHM skills, assessment tasks and scoring methods identified from literature was discussed in a focus group (n = 4) to establish face validity. An expert panel (n = 16) reviewed the content validity of the proposed assessment; evaluating the representativeness and relevance of encompassing the IHM skills in the proposed assessment tasks, the clarity and importance to daily life of the task and the clarity and applicability to clinical environment of the scoring method. The content validity was calculated using the content validity index for both the individual task and all tasks together (I-CVI and S-CVI). Feedback was incorporated to create the assessment. The focus group members agreed to include 10 assessment tasks that covered all IHM skills. In the expert panel review, all tasks received an I-CVI above 0.78 and S-CVI above 0.80 in representativeness and relevance ratings, representing good content validity. With the comments from the expert panel, tasks were modified to improve the clarity and importance to daily life. A four-point Likert scale was identified for assessing both the completion of the assessment tasks and the quality of IHM skills within the task performance. Face and content validity were established in this new IHM assessment. Further studies to examine psychometric properties and use within clinical practice are recommended. © 2018 Occupational Therapy Australia.

Quality assurance of the clinical learning environment in Austria: Construct validity of the Clinical Learning Environment, Supervision and Nurse Teacher Scale (CLES+T scale).

PubMed

Mueller, Gerhard; Mylonas, Demetrius; Schumacher, Petra

2018-07-01

Within nursing education, the clinical learning environment is of a high importance in regards to the development of competencies and abilities. The organization, atmosphere, and supervision in the clinical learning environment are only a few factors that influence this development. In Austria there is currently no valid instrument available for the evaluation of influencing factors. The aim of the study was to test the construct validity with principal component analysis as well as the internal consistency of the German Clinical Learning Environment, Supervision and Teacher Scale (CLES+T scale) in Austria. The present validation study has a descriptive-quantitative cross-sectional design. The sample consisted of 385 nursing students from thirteen training institutions in Austria. The data collection was carried out online between March and April 2016. Starting with a polychoric correlation matrix, a parallel analysis with principal component extraction and promax rotation was carried out due to the ordinal data. The exploratory ordinal factor analysis supported a four-component solution and explained 73% of the total variance. The internal consistency of all 25 items reached a Cronbach's α of 0.95 and the four components ranged between 0.83 and 0.95. The German version of the CLES+T scale seems to be a useful instrument for identifying potential areas of improvement in clinical practice in order to derive specific quality measures for the practical learning environment. Copyright © 2018 Elsevier Ltd. All rights reserved.

2016 Revisions to the 2010/2011 fibromyalgia diagnostic criteria.

PubMed

Wolfe, Frederick; Clauw, Daniel J; Fitzcharles, Mary-Ann; Goldenberg, Don L; Häuser, Winfried; Katz, Robert L; Mease, Philip J; Russell, Anthony S; Russell, Irwin Jon; Walitt, Brian

2016-12-01

The provisional criteria of the American College of Rheumatology (ACR) 2010 and the 2011 self-report modification for survey and clinical research are widely used for fibromyalgia diagnosis. To determine the validity, usefulness, potential problems, and modifications required for the criteria, we assessed multiple research reports published in 2010-2016 in order to provide a 2016 update to the criteria. We reviewed 14 validation studies that compared 2010/2011 criteria with ACR 1990 classification and clinical criteria, as well as epidemiology, clinical, and databank studies that addressed important criteria-level variables. Based on definitional differences between 1990 and 2010/2011 criteria, we interpreted 85% sensitivity and 90% specificity as excellent agreement. Against 1990 and clinical criteria, the median sensitivity and specificity of the 2010/2011 criteria were 86% and 90%, respectively. The 2010/2011 criteria led to misclassification when applied to regional pain syndromes, but when a modified widespread pain criterion (the "generalized pain criterion") was added misclassification was eliminated. Based on the above data and clinic usage data, we developed a (2016) revision to the 2010/2011 fibromyalgia criteria. Fibromyalgia may now be diagnosed in adults when all of the following criteria are met: CONCLUSIONS: The fibromyalgia criteria have good sensitivity and specificity. This revision combines physician and questionnaire criteria, minimizes misclassification of regional pain disorders, and eliminates the previously confusing recommendation regarding diagnostic exclusions. The physician-based criteria are valid for individual patient diagnosis. The self-report version of the criteria is not valid for clinical diagnosis in individual patients but is valid for research studies. These changes allow the criteria to function as diagnostic criteria, while still being useful for classification. Copyright © 2016 Elsevier Inc. All rights reserved.

External validation and clinical utility of a prediction model for 6-month mortality in patients undergoing hemodialysis for end-stage kidney disease.

PubMed

Forzley, Brian; Er, Lee; Chiu, Helen Hl; Djurdjev, Ognjenka; Martinusen, Dan; Carson, Rachel C; Hargrove, Gaylene; Levin, Adeera; Karim, Mohamud

2018-02-01

End-stage kidney disease is associated with poor prognosis. Health care professionals must be prepared to address end-of-life issues and identify those at high risk for dying. A 6-month mortality prediction model for patients on dialysis derived in the United States is used but has not been externally validated. We aimed to assess the external validity and clinical utility in an independent cohort in Canada. We examined the performance of the published 6-month mortality prediction model, using discrimination, calibration, and decision curve analyses. Data were derived from a cohort of 374 prevalent dialysis patients in two regions of British Columbia, Canada, which included serum albumin, age, peripheral vascular disease, dementia, and answers to the "the surprise question" ("Would I be surprised if this patient died within the next year?"). The observed mortality in the validation cohort was 11.5% at 6 months. The prediction model had reasonable discrimination (c-stat = 0.70) but poor calibration (calibration-in-the-large = -0.53 (95% confidence interval: -0.88, -0.18); calibration slope = 0.57 (95% confidence interval: 0.31, 0.83)) in our data. Decision curve analysis showed the model only has added value in guiding clinical decision in a small range of threshold probabilities: 8%-20%. Despite reasonable discrimination, the prediction model has poor calibration in this external study cohort; thus, it may have limited clinical utility in settings outside of where it was derived. Decision curve analysis clarifies limitations in clinical utility not apparent by receiver operating characteristic curve analysis. This study highlights the importance of external validation of prediction models prior to routine use in clinical practice.

Screening for potential child maltreatment in parents of a newborn baby: The predictive validity of an Instrument for early identification of Parents At Risk for child Abuse and Neglect (IPARAN).

PubMed

van der Put, Claudia E; Bouwmeester-Landweer, Merian B R; Landsmeer-Beker, Eleonore A; Wit, Jan M; Dekker, Friedo W; Kousemaker, N Pieter J; Baartman, Herman E M

2017-08-01

For preventive purposes it is important to be able to identify families with a high risk of child maltreatment at an early stage. Therefore we developed an actuarial instrument for screening families with a newborn baby, the Instrument for identification of Parents At Risk for child Abuse and Neglect (IPARAN). The aim of this study was to assess the predictive validity of the IPARAN and to examine whether combining actuarial and clinical methods leads to an improvement of the predictive validity. We examined the predictive validity by calculating several performance indicators (i.e., sensitivity, specificity and the Area Under the receiver operating characteristic Curve [AUC]) in a sample of 4692 Dutch families with newborns. The outcome measure was a report of child maltreatment at Child Protection Services during a follow-up of 3 years. For 17 children (.4%) a report of maltreatment was registered. The predictive validity of the IPARAN was significantly better than chance (AUC=.700, 95% CI [.567-.832]), in contrast to a low value for clinical judgement of nurses of the Youth Health Care Centers (AUC=.591, 95% CI [.422-.759]). The combination of the IPARAN and clinical judgement resulted in the highest predictive validity (AUC=.720, 95% CI [.593-.847]), however, the difference between the methods did not reach statistical significance. The good predictive validity of the IPARAN in combination with clinical judgment of the nurse enables professionals to assess risks at an early stage and to make referrals to early intervention programs. Copyright © 2017 Elsevier Ltd. All rights reserved.

Psychometric validation of the Italian Rehabilitation Complexity Scale-Extended version 13

PubMed Central

Agosti, Maurizio; Merlo, Andrea; Maini, Maurizio; Lombardi, Francesco; Tedeschi, Claudio; Benedetti, Maria Grazia; Basaglia, Nino; Contini, Mara; Nicolotti, Domenico; Brianti, Rodolfo

2017-01-01

In Italy, at present, a well-known problem is inhomogeneous provision of rehabilitative services, as stressed by MoH, requiring appropriate criteria and parameters to plan rehabilitation actions. According to the Italian National Rehabilitation Plan, Comorbidity, Disability and Clinical Complexity should be assessed to define the patient’s real needs. However, to date, clinical complexity is still difficult to measure with shared and validated tools. The study aims to psychometrically validate the Italian Rehabilitation Complexity Scale-Extended v13 (RCS-E v13), in order to meet the guidelines requirements. An observational multicentre prospective cohort study, involving 8 intensive rehabilitation facilities of the Emilia-Romagna Region and 1712 in-patients, [823 male (48%) and 889 female (52%), mean age 68.34 years (95% CI 67.69–69.00 years)] showing neurological, orthopaedic and cardiological problems, was carried out. The construct and concurrent validity of the RCS-E v13 was confirmed through its correlation to Barthel Index (disability) and Cumulative Illness Rating Scale (comorbidity) and appropriate admission criteria (not yet published), respectively. Furthermore, the factor analysis indicated two different components (“Basic Care or Risk—Equipment” and “Medical—Nursing Needs and Therapy Disciplines”) of the RCS-E v13. In conclusion, the Italian RCS-E v13 appears to be a useful tool to assess clinical complexity in the Italian rehab scenario case-mix and its psychometric validation may have an important clinical rehabilitation impact allowing the assessment of the rehabilitation needs considering all three dimensions (disability, comorbidity and clinical complexity) as required by the Guidelines and the inhomogeneity could be reduced. PMID:29045409

Use of the Menopause-Specific Quality of Life (MENQOL) questionnaire in research and clinical practice: a comprehensive scoping review.

PubMed

Sydora, Beate C; Fast, Hilary; Campbell, Sandy; Yuksel, Nese; Lewis, Jacqueline E; Ross, Sue

2016-09-01

The Menopause-Specific Quality of Life (MENQOL) questionnaire was developed as a validated research tool to measure condition-specific QOL in early postmenopausal women. We conducted a comprehensive scoping review to explore the extent of MENQOL's use in research and clinical practice to assess its value in providing effective, adequate, and comparable participant assessment information. Thirteen biomedical and clinical databases were systematically searched with "menqol" as a search term to find articles using MENQOL or its validated derivative MENQOL-Intervention as investigative or clinical tools from 1996 to November 2014 inclusive. Review articles, conference abstracts, proceedings, dissertations, and incomplete trials were excluded. Additional articles were collected from references within key articles. Three independent reviewers extracted data reflecting study design, intervention, sample characteristics, MENQOL questionnaire version, modifications and language, recall period, and analysis detail. Data analyses included categorization and descriptive statistics. The review included 220 eligible papers of various study designs, covering 39 countries worldwide and using MENQOL translated into more than 25 languages. A variety of modifications to the original questionnaire were identified, including omission or addition of items and alterations to the validated methodological analysis. No papers were found that described MENQOL's use in clinical practice. Our study found an extensive and steadily increasing use of MENQOL in clinical and epidemiological research over 18 years postpublication. Our results stress the importance of proper reporting and validation of translations and variations to ensure outcome comparison and transparency of MENQOL's use. The value of MENQOL in clinical practice remains unknown.

A Practical Approach to Governance and Optimization of Structured Data Elements.

PubMed

Collins, Sarah A; Gesner, Emily; Morgan, Steven; Mar, Perry; Maviglia, Saverio; Colburn, Doreen; Tierney, Diana; Rocha, Roberto

2015-01-01

Definition and configuration of clinical content in an enterprise-wide electronic health record (EHR) implementation is highly complex. Sharing of data definitions across applications within an EHR implementation project may be constrained by practical limitations, including time, tools, and expertise. However, maintaining rigor in an approach to data governance is important for sustainability and consistency. With this understanding, we have defined a practical approach for governance of structured data elements to optimize data definitions given limited resources. This approach includes a 10 step process: 1) identification of clinical topics, 2) creation of draft reference models for clinical topics, 3) scoring of downstream data needs for clinical topics, 4) prioritization of clinical topics, 5) validation of reference models for clinical topics, and 6) calculation of gap analyses of EHR compared against reference model, 7) communication of validated reference models across project members, 8) requested revisions to EHR based on gap analysis, 9) evaluation of usage of reference models across project, and 10) Monitoring for new evidence requiring revisions to reference model.

Defining and validating a short form Montreal Cognitive Assessment (s-MoCA) for use in neurodegenerative disease

PubMed Central

Roalf, David R; Moore, Tyler M; Wolk, David A; Arnold, Steven E; Mechanic-Hamilton, Dawn; Rick, Jacqueline; Kabadi, Sushila; Ruparel, Kosha; Chen-Plotkin, Alice S; Chahine, Lama M; Dahodwala, Nabila A; Duda, John E; Weintraub, Daniel A; Moberg, Paul J

2016-01-01

Introduction Screening for cognitive deficits is essential in neurodegenerative disease. Screening tests, such as the Montreal Cognitive Assessment (MoCA), are easily administered, correlate with neuropsychological performance and demonstrate diagnostic utility. Yet, administration time is too long for many clinical settings. Methods Item response theory and computerised adaptive testing simulation were employed to establish an abbreviated MoCA in 1850 well-characterised community-dwelling individuals with and without neurodegenerative disease. Results 8 MoCA items with high item discrimination and appropriate difficulty were identified for use in a short form (s-MoCA). The s-MoCA was highly correlated with the original MoCA, showed robust diagnostic classification and cross-validation procedures substantiated these items. Discussion Early detection of cognitive impairment is an important clinical and public health concern, but administration of screening measures is limited by time constraints in demanding clinical settings. Here, we provide as-MoCA that is valid across neurological disorders and can be administered in approximately 5 min. PMID:27071646

Rater reliability and construct validity of a mobile application for posture analysis

PubMed Central

Szucs, Kimberly A.; Brown, Elena V. Donoso

2018-01-01

[Purpose] Measurement of posture is important for those with a clinical diagnosis as well as researchers aiming to understand the impact of faulty postures on the development of musculoskeletal disorders. A reliable, cost-effective and low tech posture measure may be beneficial for research and clinical applications. The purpose of this study was to determine rater reliability and construct validity of a posture screening mobile application in healthy young adults. [Subjects and Methods] Pictures of subjects were taken in three standing positions. Two raters independently digitized the static standing posture image twice. The app calculated posture variables, including sagittal and coronal plane translations and angulations. Intra- and inter-rater reliability were calculated using the appropriate ICC models for complete agreement. Construct validity was determined through comparison of known groups using repeated measures ANOVA. [Results] Intra-rater reliability ranged from 0.71 to 0.99. Inter-rater reliability was good to excellent for all translations. ICCs were stronger for translations versus angulations. The construct validity analysis found that the app was able to detect the change in the four variables selected. [Conclusion] The posture mobile application has demonstrated strong rater reliability and preliminary evidence of construct validity. This application may have utility in clinical and research settings. PMID:29410561

Modified Moral Distress Scale (MDS-11): Validation Study Among Italian Nurses.

PubMed

Badolamenti, Sondra; Fida, Roberto; Biagioli, Valentina; Caruso, Rosario; Zaghini, Francesco; Sili, Alessandro; Rea, Teresa

2017-01-01

Moral distress (MD) has significant implications on individual and organizational health. However there is a lack of an instrument to assess it among Italian nurses. The main aim of this study was to validate a brief instrument to assess MD, developed from the Corley's Moral Distress Scale (MDS). The modified MDS scale was subjected to content and cultural validity. The scale was administered to 347 nurses. Psychometric analysis were performed to assess construct validity. The scale consists of 11 items, investigating MD in nursing practice in different clinical settings. The dimensionality of the scale was investigated through exploratory factor analysis (EFA), which showed a two-dimensional structure labeled futility and potential damage. The futility refers to feelings of powerlessness and ineffectiveness in some clinical situations; the potential damage dimension captures feelings of powerlessness when nurses are forced to tolerate or perform perceived abusive clinical proceedings. Nurses who experienced higher MD, were more lilely to experience burnout. The modified MDS showed good psychometric properties, and it is valid and reliable for assessing moral distress among Italian nurses. Hence, the modified MDS allows to monitor the distress experienced by nurses and it is an important contribution to the scientific community and all those dealing with well-being of health workers.

Rater reliability and construct validity of a mobile application for posture analysis.

PubMed

Szucs, Kimberly A; Brown, Elena V Donoso

2018-01-01

[Purpose] Measurement of posture is important for those with a clinical diagnosis as well as researchers aiming to understand the impact of faulty postures on the development of musculoskeletal disorders. A reliable, cost-effective and low tech posture measure may be beneficial for research and clinical applications. The purpose of this study was to determine rater reliability and construct validity of a posture screening mobile application in healthy young adults. [Subjects and Methods] Pictures of subjects were taken in three standing positions. Two raters independently digitized the static standing posture image twice. The app calculated posture variables, including sagittal and coronal plane translations and angulations. Intra- and inter-rater reliability were calculated using the appropriate ICC models for complete agreement. Construct validity was determined through comparison of known groups using repeated measures ANOVA. [Results] Intra-rater reliability ranged from 0.71 to 0.99. Inter-rater reliability was good to excellent for all translations. ICCs were stronger for translations versus angulations. The construct validity analysis found that the app was able to detect the change in the four variables selected. [Conclusion] The posture mobile application has demonstrated strong rater reliability and preliminary evidence of construct validity. This application may have utility in clinical and research settings.

Use of clinical movement screening tests to predict injury in sport

PubMed Central

Chimera, Nicole J; Warren, Meghan

2016-01-01

Clinical movement screening tests are gaining popularity as a means to determine injury risk and to implement training programs to prevent sport injury. While these screens are being used readily in the clinical field, it is only recently that some of these have started to gain attention from a research perspective. This limits applicability and poses questions to the validity, and in some cases the reliability, of the clinical movement tests as they relate to injury prediction, intervention, and prevention. This editorial will review the following clinical movement screening tests: Functional Movement Screen™, Star Excursion Balance Test, Y Balance Test, Drop Jump Screening Test, Landing Error Scoring System, and the Tuck Jump Analysis in regards to test administration, reliability, validity, factors that affect test performance, intervention programs, and usefulness for injury prediction. It is important to review the aforementioned factors for each of these clinical screening tests as this may help clinicians interpret the current body of literature. While each of these screening tests were developed by clinicians based on what appears to be clinical practice, this paper brings to light that this is a need for collaboration between clinicians and researchers to ensure validity of clinically meaningful tests so that they are used appropriately in future clinical practice. Further, this editorial may help to identify where the research is lacking and, thus, drive future research questions in regards to applicability and appropriateness of clinical movement screening tools. PMID:27114928

Informed consent process: A step further towards making it meaningful!

PubMed Central

Kadam, Rashmi Ashish

2017-01-01

Informed consent process is the cornerstone of ethics in clinical research. Obtaining informed consent from patients participating in clinical research is an important legal and ethical imperative for clinical trial researchers. Although informed consent is an important process in clinical research, its effectiveness and validity are always a concern. Issues related to understanding, comprehension, competence, and voluntariness of clinical trial participants may adversely affect the informed consent process. Communication of highly technical, complex, and specialized clinical trial information to participants with limited literacy, diverse sociocultural background, diminished autonomy, and debilitating diseases is a difficult task for clinical researchers. It is therefore essential to investigate and adopt innovative communication strategies to enhance understanding of clinical trial information among participants. This review article visits the challenges that affect the informed consent process and explores various innovative strategies to enhance the consent process. PMID:28828304

Implicit cognitive processes in psychopathology: an introduction.

PubMed

Wiers, Reinout W; Teachman, Bethany A; De Houwer, Jan

2007-06-01

Implicit or automatic processes are important in understanding the etiology and maintenance of psychopathological problems. In order to study implicit processes in psychopathology, measures are needed that are valid and reliable when applied to clinical problems. One of the main topics in this special issue concerns the development and validation of new or modified implicit tests in different domains of psychopathology. The other main topic concerns the prediction of clinical outcomes and new ways to directly influence implicit processes in psychopathology. We summarize the contributions to this special issue and discuss how they further our knowledge of implicit processes in psychopathology and how to measure them.

Considerations regarding the validation of chromatographic mass spectrometric methods for the quantification of endogenous substances in forensics.

PubMed

Hess, Cornelius; Sydow, Konrad; Kueting, Theresa; Kraemer, Michael; Maas, Alexandra

2018-02-01

The requirement for correct evaluation of forensic toxicological results in daily routine work and scientific studies is reliable analytical data based on validated methods. Validation of a method gives the analyst tools to estimate the efficacy and reliability of the analytical method. Without validation, data might be contested in court and lead to unjustified legal consequences for a defendant. Therefore, new analytical methods to be used in forensic toxicology require careful method development and validation of the final method. Until now, there are no publications on the validation of chromatographic mass spectrometric methods for the detection of endogenous substances although endogenous analytes can be important in Forensic Toxicology (alcohol consumption marker, congener alcohols, gamma hydroxy butyric acid, human insulin and C-peptide, creatinine, postmortal clinical parameters). For these analytes, conventional validation instructions cannot be followed completely. In this paper, important practical considerations in analytical method validation for endogenous substances will be discussed which may be used as guidance for scientists wishing to develop and validate analytical methods for analytes produced naturally in the human body. Especially the validation parameters calibration model, analytical limits, accuracy (bias and precision) and matrix effects and recovery have to be approached differently. Highest attention should be paid to selectivity experiments. Copyright © 2017 Elsevier B.V. All rights reserved.

Does the decision in a validation process of a surrogate endpoint change with level of significance of treatment effect? A proposal on validation of surrogate endpoints.

PubMed

Sertdemir, Y; Burgut, R

2009-01-01

In recent years the use of surrogate end points (S) has become an interesting issue. In clinical trials, it is important to get treatment outcomes as early as possible. For this reason there is a need for surrogate endpoints (S) which are measured earlier than the true endpoint (T). However, before a surrogate endpoint can be used it must be validated. For a candidate surrogate endpoint, for example time to recurrence, the validation result may change dramatically between clinical trials. The aim of this study is to show how the validation criterion (R(2)(trial)) proposed by Buyse et al. are influenced by the magnitude of treatment effect with an application using real data. The criterion R(2)(trial) proposed by Buyse et al. (2000) is applied to the four data sets from colon cancer clinical trials (C-01, C-02, C-03 and C-04). Each clinical trial is analyzed separately for treatment effect on survival (true endpoint) and recurrence free survival (surrogate endpoint) and this analysis is done also for each center in each trial. Results are used for standard validation analysis. The centers were grouped by the Wald statistic in 3 equal groups. Validation criteria R(2)(trial) were 0.641 95% CI (0.432-0.782), 0.223 95% CI (0.008-0.503), 0.761 95% CI (0.550-0.872) and 0.560 95% CI (0.404-0.687) for C-01, C-02, C-03 and C-04 respectively. The R(2)(trial) criteria changed by the Wald statistics observed for the centers used in the validation process. Higher the Wald statistic groups are higher the R(2)(trial) values observed. The recurrence free survival is not a good surrogate for overall survival in clinical trials with non significant treatment effects and moderate for significant treatment effects. This shows that the level of significance of treatment effect should be taken into account in validation process of surrogate endpoints.

Clinical Implications of a Dimensional Approach: The Normal:Abnormal Spectrum of Early Irritability.

PubMed

Wakschlag, Lauren S; Estabrook, Ryne; Petitclerc, Amelie; Henry, David; Burns, James L; Perlman, Susan B; Voss, Joel L; Pine, Daniel S; Leibenluft, Ellen; Briggs-Gowan, Margaret L

2015-08-01

The importance of dimensional approaches is widely recognized, but an empirical base for clinical application is lacking. This is particularly true for irritability, a dimensional phenotype that cuts across many areas of psychopathology and manifests early in life. We examine longitudinal, dimensional patterns of irritability and their clinical import in early childhood. Irritability was assessed longitudinally over an average of 16 months in a clinically enriched, diverse community sample of preschoolers (N = 497; mean = 4.2 years; SD = 0.8). Using the Temper Loss scale of the Multidimensional Assessment Profile of Disruptive Behavior (MAP-DB) as a developmentally sensitive indicator of early childhood irritability, we examined its convergent/divergent, clinical, and incremental predictive validity, and modeled its linear and nonlinear associations with clinical risk. The Temper Loss scale demonstrated convergent and divergent validity to child and maternal factors. In multivariate analyses, Temper Loss predicted mood (separation anxiety disorder [SAD], generalized anxiety disorder [GAD], and depression/dysthymia), disruptive (oppositional defiant disorder [ODD], attention-deficit/hyperactivity disorder [ADHD], and conduct disorder [CD]) symptoms. Preschoolers with even mildly elevated Temper Loss scale scores showed substantially increased risk of symptoms and disorders. For ODD, GAD, SAD, and depression, increases in Temper Loss scale scores at the higher end of the dimension had a greater impact on symptoms relative to increases at the lower end. Temper Loss scale scores also showed incremental validity over DSM-IV disorders in predicting subsequent impairment. Finally, accounting for the substantial heterogeneity in longitudinal patterns of Temper Loss significantly improved prediction of mood and disruptive symptoms. Dimensional, longitudinal characterization of irritability informs clinical prediction. A vital next step will be empirically generating parameters for the incorporation of dimensional information into clinical decision-making with reasonable certainty. Copyright © 2015 American Academy of Child and Adolescent Psychiatry. All rights reserved.

Development and Validation of a Multiplex PCR for Detection of Scedosporium spp. in Respiratory Tract Specimens from Patients with Cystic Fibrosis▿

PubMed Central

Harun, Azian; Blyth, Christopher C.; Gilgado, Felix; Middleton, Peter; Chen, Sharon C.-A.; Meyer, Wieland

2011-01-01

The emergence of Scedosporium infections in diverse groups of individuals, which are often treatment refractory, warrants timely and accurate laboratory diagnosis. Species- or group-specific primers based on internal transcribed spacer (ITS) sequence polymorphisms were designed for Scedosporium aurantiacum, Scedosporium dehoogii, Scedosporium prolificans, Pseudallescheria boydii species complex (former clade 5)/Pseudallescheria apiosperma (formerly classified as S. apiospermum sensu lato) and Pseudallescheria minutispora. Primers for S. aurantiacum, S. prolificans, and P. boydii species complex/P. apiosperma were incorporated into a multiplex PCR assay for the detection and identification of the three major clinically important Scedosporium species and validated using sputum specimens collected from patients seen at a major Australian cystic fibrosis clinic. The multiplex PCR assay showed 100% specificity in identifying the three major clinically relevant Scedosporium species from pure culture. When evaluated using DNA extracts from sputa, sensitivity and specificity of the multiplex PCR assay were 62.1% and 97.2%, respectively. This highly species-specific multiplex PCR assay offers a rapid and simple method of detection of the most clinically important Scedosporium species in respiratory tract specimens. PMID:21325557

Assessing severity of patients with community-acquired pneumonia.

PubMed

Pereira, Jose Manuel; Paiva, Jose Artur; Rello, Jordi

2012-06-01

Despite all advances in its management, community-acquired pneumonia (CAP) is still an important cause of morbidity and mortality requiring a great consumption of health, social, and economic resources. An early and adequate severity assessment is of paramount importance to provide optimized care to these patients. In the last 2 decades, this issue has been the subject of extensive research. Based on 30 day mortality, several prediction rules have been proposed to aid clinicians in deciding on the appropriate site of care. In spite of being well validated, their sensitivity and specificity vary, which limits their widespread use. The utility of biomarkers to overcome this problem has been investigated. At this moment, their full clinical value remains undetermined, and no single biomarker is consistently ideal for assessing CAP severity. Biomarkers should be seen as a complement rather than superseding clinical judgment or validated clinical scores. The search for a gold standard is not over, and new tools, like bacterial DNA load, are in the pipeline. Until then, CAP severity assessment should be based in three key points: a pneumonia-specific score, biomarkers, and clinical judgment. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

Validation of the Chronic Pain Acceptance Questionnaire (CPAQ) in Cantonese-speaking Chinese patients.

PubMed

Cheung, Michelle N; Ning, Michelle Cheung; Wong, Tony C M; Ming, Tony Wong Chi; Yap, Jacqueline C M; Mae, Jacqueline Yap Chooi; Chen, Phoon P; Ping, Chen Phoon

2008-09-01

Acceptance of chronic pain has become an important concept in understanding and predicting that chronic pain sufferers can remain engaged with meaningful aspects of life. Assessment of acceptance has been facilitated by the development of Chronic Pain Acceptance Questionnaire (CPAQ). In this study, we aimed to test the reliability and validity of translated Chinese version of CPAQ to use this important tool in the future management of Hong Kong Chinese patients with chronic nonmalignant pain. Content validity was established by consensus formed among a panel of 5 experts in clinical psychology and pain specialty during the process of forward and backward translations. Test-retest reliability was examined by completing the Chinese CPAQ twice, 2 weeks apart, by 54 patients. A total of 224 Chinese patients with chronic nonmalignant pain attending our cluster multidisciplinary pain clinic were asked to complete a battery of psychometric instruments in Chinese, including an intake form for demographic data, Hospital Anxiety and Depression Score (HADS), Medical Outcome Study Short Form 36 (SF-36), Pain Catastrophizing Scale (PCS), and Pain Self-Efficacy Questionnaire (PSEQ). Analysis results showed that Chinese CPAQ had good test-retest reliability (intraclass correlation coefficient, 0.79) and internal consistency reliability (Cronbach alpha = 0.79). The Chinese CPAQ score was significantly correlated to anxiety, depression, pain catastrophizing, pain self-efficacy, and physical and psychosocial disability. Scree plot and Principal Components Factor analysis confirmed the same 2-factor construct as the original English CPAQ. Construct validity of the Chinese CPAQ can therefore be supported. In conclusion, the Chinese CPAQ is a reliable clinical assessment tool with valid construct for acceptance measurement in our heterogeneous Chinese patients sample with chronic nonmalignant pain. This article confirms the reliability and validity of a Chinese version of the CPAQ. The Chinese CPAQ can then be used by pain clinicians caring for Chinese chronic pain patients worldwide for acceptance-based psychometric assessment as well as therapies.

Validation of a Brief Structured Interview: The Children's Interview for Psychiatric Syndromes (ChIPS).

PubMed

Young, Matthew E; Bell, Ziv E; Fristad, Mary A

2016-12-01

Evidence-based assessment is important in the treatment of childhood psychopathology. While researchers and clinicians frequently use structured diagnostic interviews to ensure reliability, the most commonly used instrument, the Schedule for Affective Disorders and Schizophrenia for School Aged Children (K-SADS) is too long for most clinical applications. The Children's Interview for Psychiatric Syndromes (ChIPS/P-ChIPS) is a highly-structured brief diagnostic interview. The present study compared K-SADS and ChIPS/P-ChIPS diagnoses in an outpatient clinical sample of 50 parent-child pairs aged 7-14. Agreement between most diagnoses was moderate to high between the instruments and with consensus clinical diagnoses. ChIPS was significantly briefer to administer than the K-SADS. Interviewer experience level and participant demographics did not appear to affect agreement. Results provide further evidence for the validity of the ChIPS and support its use in clinical and research settings.

Commissioning and validation of COMPASS system for VMAT patient specific quality assurance

NASA Astrophysics Data System (ADS)

Pimthong, J.; Kakanaporn, C.; Tuntipumiamorn, L.; Laojunun, P.; Iampongpaiboon, P.

2016-03-01

Pre-treatment patient specific quality assurance (QA) of advanced treatment techniques such as volumetric modulated arc therapy (VMAT) is one of important QA in radiotherapy. The fast and reliable dosimetric device is required. The objective of this study is to commission and validate the performance of COMPASS system for dose verification of VMAT technique. The COMPASS system is composed of an array of ionization detectors (MatriXX) mounted to the gantry using a custom holder and software for the analysis and visualization of QA results. We validated the COMPASS software for basic and advanced clinical application. For the basic clinical study, the simple open field in various field sizes were validated in homogeneous phantom. And the advanced clinical application, the fifteen prostate and fifteen nasopharyngeal cancers VMAT plans were chosen to study. The treatment plans were measured by the MatriXX. The doses and dose-volume histograms (DVHs) reconstructed from the fluence measurements were compared to the TPS calculated plans. And also, the doses and DVHs computed using collapsed cone convolution (CCC) Algorithm were compared with Eclipse TPS calculated plans using Analytical Anisotropic Algorithm (AAA) that according to dose specified in ICRU 83 for PTV.

Clinical protein science developments for patient monitoring in hospital central laboratories.

PubMed

Malm, Johan; Marko-Varga, György

2016-12-01

Patient care relies heavily on standardized tests performed in hospital laboratories, typically including clinical chemistry, pathology and microbiology. With the introduction of personalized medicine tremendous efforts have been made to identify new biomarkers of disease with various omics technologies, often including mass spectrometry. In order to validate new biomarkers and perform clinical studies high quality biobank samples are of key importance. In this editorial different aspects of mass spectrometry in future personalized medicine are discussed.

Quality of life questionnaires in otorhinolaryngology: a systematic overview.

PubMed

Koenraads, S P C; Aarts, M C J; van der Veen, E L; Grolman, W; Stegeman, I

2016-12-01

The importance of quality of life (QOL) as an endpoint and the use of validated QOL questionnaires have increased over time. To evaluate health-related quality of life (HR-QOL) measurement instruments used in patients in otorhinolaryngology (ORL). We aimed to establish the use of QOL questionnaires in ORL over a period of time, establish the use of QOL questionnaires within different domains and determine the use of validated QOL questionnaires. We performed a comprehensive search in PubMed up to 1 January 2014. Articles were included that measured HR-QOL questionnaires in clinical practice in children, adolescents or adults in 42 journals of ORL. Multiple unique QOL questionnaires, organised according to domain, time and survey of validation, were extracted from reported articles. Of 2442 articles, we utilised 1196 publications with a total of 2103 QOL questionnaires regarding ORL. We evaluated a variety of 363 unique QOL questionnaires in which 60% (n = 220) QOL questionnaires had been validated. We found a continuing increase in the amount of articles which used QOL questionnaires since the beginning of the 20th century, while the percentage of validated QOL questionnaires remained the same (76%). Most QOL questionnaires were used in the domains oncology (35%), otology (21%) and rhinology (20%). The domain otology had the largest amount of unique QOL questionnaires (n = 122). We identified and evaluated all unique HR-QOL questionnaires utilised in patients in ORL. Recently, the use of validated and non-validated HR-QOL questionnaires has increased within all domains of ORL. The assessment of QOL has become an important outcome measure in clinical practice, in medical research and for healthcare organisations. © 2015 John Wiley & Sons Ltd.

Validity, responsiveness, and minimal clinically important difference of EQ-5D-5L in stroke patients undergoing rehabilitation.

PubMed

Chen, Poyu; Lin, Keh-Chung; Liing, Rong-Jiuan; Wu, Ching-Yi; Chen, Chia-Ling; Chang, Ku-Chou

2016-06-01

To examine the criterion validity, responsiveness, and minimal clinically important difference (MCID) of the EuroQoL 5-Dimensions Questionnaire (EQ-5D-5L) and visual analog scale (EQ-VAS) in people receiving rehabilitation after stroke. The EQ-5D-5L, along with four criterion measures-the Medical Research Council scales for muscle strength, the Fugl-Meyer assessment, the functional independence measure, and the Stroke Impact Scale-was administered to 65 patients with stroke before and after 3- to 4-week therapy. Criterion validity was estimated using the Spearman correlation coefficient. Responsiveness was analyzed by the effect size, standardized response mean (SRM), and criterion responsiveness. The MCID was determined by anchor-based and distribution-based approaches. The percentage of patients exceeding the MCID was also reported. Concurrent validity of the EQ-Index was better compared with the EQ-VAS. The EQ-Index has better power for predicting the rehabilitation outcome in the activities of daily living than other motor-related outcome measures. The EQ-Index was moderately responsive to change (SRM = 0.63), whereas the EQ-VAS was only mildly responsive to change. The MCID estimation of the EQ-Index (the percentage of patients exceeding the MCID) was 0.10 (33.8 %) and 0.10 (33.8 %) based on the anchor-based and distribution-based approaches, respectively, and the estimation of EQ-VAS was 8.61 (41.5 %) and 10.82 (32.3 %). The EQ-Index has shown reasonable concurrent validity, limited predictive validity, and acceptable responsiveness for detecting the health-related quality of life in stroke patients undergoing rehabilitation, but not for EQ-VAS. Future research considering different recovery stages after stroke is warranted to validate these estimations.

Measuring Eccentric Strength of the Shoulder External Rotators Using a Handheld Dynamometer: Reliability and Validity

PubMed Central

Johansson, Fredrik R.; Skillgate, Eva; Lapauw, Mattis L.; Clijmans, Dorien; Deneulin, Valentijn P.; Palmans, Tanneke; Engineer, Human Kinetic; Cools, Ann M.

2015-01-01

Context Shoulder strength assessment plays an important role in the clinical examination of the shoulder region. Eccentric strength measurements are of special importance in guiding the clinician in injury prevention or return-to-play decisions after injury. Objective To examine the absolute and relative reliability and validity of a standardized eccentric strength-measurement protocol for the glenohumeral external rotators. Design Descriptive laboratory study. Setting Testing environment at the Department of Rehabilitation Sciences and Physiotherapy of Ghent University, Belgium. Patients or Other Participants Twenty-five healthy participants (9 men and 16 women) without any history of shoulder pain were tested by 2 independent assessors using a handheld dynamometer (HHD) and underwent an isokinetic testing procedure. Intervention(s) The clinical protocol used an HHD, a DynaPort accelerometer to measure acceleration and angular velocity of testing 30°/s over 90° of range of motion, and a Biodex dynamometer to measure isokinetic activity. Main Outcome Measure(s) Three eccentric strength measurements: (1) tester 1 with the HHD, (2) tester 2 with the HHD, and (3) Biodex isokinetic strength measurement. Results The intratester reliability was excellent (0.879 and 0.858), whereas the intertester reliability was good, with an intraclass correlation coefficient between testers of 0.714. Pearson product moment correlation coefficients of 0.78 and 0.70 were noted between the HHD and the isokinetic data, showing good validity of this new procedure. Conclusions Standardized eccentric rotator cuff strength can be tested and measured in the clinical setting with good-to-excellent reliability and validity using an HHD. PMID:25974381

Validation of the Chinese version of functional assessment of anorexia-cachexia therapy (FAACT) scale for measuring quality of life in cancer patients with cachexia.

PubMed

Zhou, Ting; Yang, Kaixiang; Thapa, Sudip; Fu, Qiang; Jiang, Yongsheng; Yu, Shiying

2017-04-01

The assessment of quality of life (QOL) is an important part of cachexia management for cancer patients. Functional assessment of anorexia-cachexia therapy (FAACT), a specific QOL instrument for cachexia patients, has not been validated in Chinese population. The aim of this study was to validate the FAACT scale in Chinese cancer patients for its future use. Eligible cancer patients were included in our study. Patients' demographic and clinical characteristics were collected from the electronic medical records. Patients were asked to complete the Chinese version of FAACT scale and the MD Anderson symptom inventory (MDASI), and then the reliability and validity were analyzed. A total of 285 patients were enrolled in our study, data of 241 patients were evaluated. Coefficients of Cronbach's alpha, test-retest and split-half analyses were all greater than 0.8, which indicated an excellent reliability for FAACT scale. In item-subscale correlation analysis and factor analysis, good construct validity for FAACT scale was found. The correlation between FAACT and MDASI interference subscale showed reasonable criterion-related validity, and for further clinical validation, the FAACT scale showed excellent discriminative validity for distinguishing patients in different cachexia status and in different performance status. The Chinese version of FAACT scale has good reliability and validity and is suitable for measuring QOL of cachexia patients in Chinese population.

The predictive validity of the BioMedical Admissions Test for pre-clinical examination performance.

PubMed

Emery, Joanne L; Bell, John F

2009-06-01

Some medical courses in the UK have many more applicants than places and almost all applicants have the highest possible previous and predicted examination grades. The BioMedical Admissions Test (BMAT) was designed to assist in the student selection process specifically for a number of 'traditional' medical courses with clear pre-clinical and clinical phases and a strong focus on science teaching in the early years. It is intended to supplement the information provided by examination results, interviews and personal statements. This paper reports on the predictive validity of the BMAT and its predecessor, the Medical and Veterinary Admissions Test. Results from the earliest 4 years of the test (2000-2003) were matched to the pre-clinical examination results of those accepted onto the medical course at the University of Cambridge. Correlation and logistic regression analyses were performed for each cohort. Section 2 of the test ('Scientific Knowledge') correlated more strongly with examination marks than did Section 1 ('Aptitude and Skills'). It also had a stronger relationship with the probability of achieving the highest examination class. The BMAT and its predecessor demonstrate predictive validity for the pre-clinical years of the medical course at the University of Cambridge. The test identifies important differences in skills and knowledge between candidates, not shown by their previous attainment, which predict their examination performance. It is thus a valid source of additional admissions information for medical courses with a strong scientific emphasis when previous attainment is very high.

Psychometric properties of the Persian version of the Ambulatory Care Learning Educational Environment Measure (ACLEEM) questionnaire, Shiraz, Iran

PubMed Central

Parvizi, Mohammad Mahdi; Amini, Mitra; Dehghani, Mohammad Reza; Jafari, Peyman; Parvizi, Zahra

2016-01-01

Purpose Evaluation is the main component in design and implementation of educational activities and rapid growth of educational institution programs. Outpatient medical education and clinical training environment is one of the most important parts of training of medical residents. This study aimed to determine the validity and reliability of the Persian version of Ambulatory Care Learning Educational Environment Measure (ACLEEM) questionnaire, as an instrument for assessment of educational environments in residency medical clinics. Materials and methods This study was performed on 180 residents in Shiraz University of Medical Sciences, Shiraz, Iran, in 2014–2015. The questionnaire designers’ electronic permission (by email) and the residents’ verbal consent were obtained before distributing the questionnaires. The study data were gathered using ACLEEM questionnaire developed by Arnoldo Riquelme in 2013. The data were analyzed using the SPSS statistical software, version 14, and MedCalc® software. Then, the construct validity, including convergent and discriminant validities, of the Persian version of ACLEEM questionnaire was assessed. Its internal consistency was also checked by Cronbach’s alpha coefficient. Results Five team members who were experts in medical education were consulted to test the cultural adaptation, linguistic equivalency, and content validity of the Persian version of the questionnaire. Content validity indexes were >0.9 in all items. In factor analysis of the instrument, the Kaiser–Meyer–Olkin index was 0.928 and Barlett’s sphericity test yielded the following results: X2=6,717.551, df =1,225, and P≤0.001. Besides, Cronbach’s alpha coefficient of ACLEEM questionnaire was 0.964. Cronbach’s alpha coefficients were also >0.80 in all the three domains of the questionnaire. Overall, the Persian version of ACLEEM showed excellent convergent validity and acceptable discriminant validity, except for the clinical training domain. Conclusion According to the results, the Persian version of ACLEEM questionnaire was a valid and reliable instrument for Iranian residents to assess specialized clinics and residency ambulatory settings. PMID:27729824

Psychometric properties of the Persian version of the Ambulatory Care Learning Educational Environment Measure (ACLEEM) questionnaire, Shiraz, Iran.

PubMed

Parvizi, Mohammad Mahdi; Amini, Mitra; Dehghani, Mohammad Reza; Jafari, Peyman; Parvizi, Zahra

2016-01-01

Evaluation is the main component in design and implementation of educational activities and rapid growth of educational institution programs. Outpatient medical education and clinical training environment is one of the most important parts of training of medical residents. This study aimed to determine the validity and reliability of the Persian version of Ambulatory Care Learning Educational Environment Measure (ACLEEM) questionnaire, as an instrument for assessment of educational environments in residency medical clinics. This study was performed on 180 residents in Shiraz University of Medical Sciences, Shiraz, Iran, in 2014-2015. The questionnaire designers' electronic permission (by email) and the residents' verbal consent were obtained before distributing the questionnaires. The study data were gathered using ACLEEM questionnaire developed by Arnoldo Riquelme in 2013. The data were analyzed using the SPSS statistical software, version 14, and MedCalc ® software. Then, the construct validity, including convergent and discriminant validities, of the Persian version of ACLEEM questionnaire was assessed. Its internal consistency was also checked by Cronbach's alpha coefficient. Five team members who were experts in medical education were consulted to test the cultural adaptation, linguistic equivalency, and content validity of the Persian version of the questionnaire. Content validity indexes were >0.9 in all items. In factor analysis of the instrument, the Kaiser-Meyer-Olkin index was 0.928 and Barlett's sphericity test yielded the following results: X 2 =6,717.551, df =1,225, and P ≤0.001. Besides, Cronbach's alpha coefficient of ACLEEM questionnaire was 0.964. Cronbach's alpha coefficients were also >0.80 in all the three domains of the questionnaire. Overall, the Persian version of ACLEEM showed excellent convergent validity and acceptable discriminant validity, except for the clinical training domain. According to the results, the Persian version of ACLEEM questionnaire was a valid and reliable instrument for Iranian residents to assess specialized clinics and residency ambulatory settings.

The Localized Scleroderma Cutaneous Assessment Tool: responsiveness to change in a pediatric clinical population.

PubMed

Kelsey, Christina E; Torok, Kathryn S

2013-08-01

Lack of agreement on how to accurately capture disease outcomes in localized scleroderma (LS) has hindered the development of efficacious treatment protocols. The LS Cutaneous Assessment Tool (LoSCAT), consisting of the modified LS Skin Severity Index (mLoSSI) and the LS Damage Index, has potential for use in clinical trials. The goal of this article is to further evaluate the clinical responsiveness of the LoSCAT. Based on the modifiable nature of disease activity versus damage, we expected the mLoSSI to be responsive to change. At 2 study visits, a physician completed the LoSCAT and Physician Global Assessment (PGA) of Disease Activity and of Disease Damage for 29 patients with LS. Spearman correlations were used to examine the relationships between the change in the LoSCAT and the PGA scores. To evaluate contrasted group validity, patients were grouped according to disease activity classification and change scores of groups were compared. Minimal clinically important differences were calculated and compared with the standard error of measurement. Change in the mLoSSI score correlated strongly with change in the PGA of Disease Activity score, whereas change in the LS Damage Index score correlated weakly with change in the PGA of Disease Damage score. The mLoSSI and PGA of Disease Activity exhibited contrasted group validity. Minimal clinically important differences for the activity measures were greater than the respective standard errors of measurement. Only 2 study visits were included in analysis. This study gives further evidence that the LoSCAT, specifically the mLoSSI, is a responsive, valid measure of activity in LS and should be used in future treatment studies. Copyright © 2013 American Academy of Dermatology, Inc. Published by Mosby, Inc. All rights reserved.

Biomarker-Based Risk Model to Predict Cardiovascular Mortality in Patients With Stable Coronary Disease.

PubMed

Lindholm, Daniel; Lindbäck, Johan; Armstrong, Paul W; Budaj, Andrzej; Cannon, Christopher P; Granger, Christopher B; Hagström, Emil; Held, Claes; Koenig, Wolfgang; Östlund, Ollie; Stewart, Ralph A H; Soffer, Joseph; White, Harvey D; de Winter, Robbert J; Steg, Philippe Gabriel; Siegbahn, Agneta; Kleber, Marcus E; Dressel, Alexander; Grammer, Tanja B; März, Winfried; Wallentin, Lars

2017-08-15

Currently, there is no generally accepted model to predict outcomes in stable coronary heart disease (CHD). This study evaluated and compared the prognostic value of biomarkers and clinical variables to develop a biomarker-based prediction model in patients with stable CHD. In a prospective, randomized trial cohort of 13,164 patients with stable CHD, we analyzed several candidate biomarkers and clinical variables and used multivariable Cox regression to develop a clinical prediction model based on the most important markers. The primary outcome was cardiovascular (CV) death, but model performance was also explored for other key outcomes. It was internally bootstrap validated, and externally validated in 1,547 patients in another study. During a median follow-up of 3.7 years, there were 591 cases of CV death. The 3 most important biomarkers were N-terminal pro-B-type natriuretic peptide (NT-proBNP), high-sensitivity cardiac troponin T (hs-cTnT), and low-density lipoprotein cholesterol, where NT-proBNP and hs-cTnT had greater prognostic value than any other biomarker or clinical variable. The final prediction model included age (A), biomarkers (B) (NT-proBNP, hs-cTnT, and low-density lipoprotein cholesterol), and clinical variables (C) (smoking, diabetes mellitus, and peripheral arterial disease). This "ABC-CHD" model had high discriminatory ability for CV death (c-index 0.81 in derivation cohort, 0.78 in validation cohort), with adequate calibration in both cohorts. This model provided a robust tool for the prediction of CV death in patients with stable CHD. As it is based on a small number of readily available biomarkers and clinical factors, it can be widely employed to complement clinical assessment and guide management based on CV risk. (The Stabilization of Atherosclerotic Plaque by Initiation of Darapladib Therapy Trial [STABILITY]; NCT00799903). Copyright © 2017 American College of Cardiology Foundation. Published by Elsevier Inc. All rights reserved.

Cultural adaptation and validation of the Lasater Clinical Judgment Rubric in nursing students in Spain.

PubMed

Román-Cereto, Montserrat; García-Mayor, Silvia; Kaknani-Uttumchandani, Shakira; García-Gámez, Marina; León-Campos, Alvaro; Fernández-Ordóñez, Eloisa; Ruiz-García, Maria Luisa; Martí-García, C; López-Leiva, Inmaculada; Lasater, Kathie; Morales-Asencio, José Miguel

2018-05-01

The clinical judgment and decision-making abilities of nurses can influence many health outcomes, hence the importance of addressing these qualities in university studies. In this respect, clinical simulation is a commonly employed teaching method. The evaluation of simulation activities requires standardised instruments, such as the Lasater Clinical Judgment Rubric, which is widely used for this purpose, although a culturally adapted and validated version in Spain is not available. To obtain a Spanish culturally adapted and validated version of the rubric for undergraduate students of nursing. Cultural adaptation and psychometric validation study carried out with undergraduate nursing students in the simulation laboratories at the University of Málaga (Spain). A process of translation/back-translation and cultural adaptation was carried out in accordance with international standards. The rubric was empirically evaluated in standardised scenarios with high and medium-fidelity simulators. Each student took part in two different simulation sessions, led by two instructors. In each simulation, the data were collected by two independent observers. 152 observations were obtained from 76 students. The interobserver reliability was high, with an intraclass correlation coefficient of 0.93 (95% CI 0.92-0.95) (p = 0.0001) and Cronbach's alpha of 0.93. According to the confirmatory factor analysis, the fit of the model was satisfactory in all indices, with a χ 2 /df value of 1.08, GFI 0.96, TLI 0.99, NFI 0.97 and RMSEA 0.24 (90% CI 0.000-0.066). The rubric obtained is culturally adapted to the Spanish educational context, and is valid and reliable for nursing students. Further prospective studies should be undertaken to evaluate the responsiveness, potential for transfer to clinical practice and cost-benefit ratios of different simulation designs. Copyright © 2018 Elsevier Ltd. All rights reserved.

The MG Composite

PubMed Central

Burns, Ted M.; Conaway, Mark; Sanders, Donald B.

2010-01-01

Objective: To study the concurrent and construct validity and test-retest reliability in the practice setting of an outcome measure for myasthenia gravis (MG). Methods: Eleven centers participated in the validation study of the Myasthenia Gravis Composite (MGC) scale. Patients with MG were evaluated at 2 consecutive visits. Concurrent and construct validities of the MGC were assessed by evaluating MGC scores in the context of other MG-specific outcome measures. We used numerous potential indicators of clinical improvement to assess the sensitivity and specificity of the MGC for detecting clinical improvement. Test-retest reliability was performed on patients at the University of Virginia. Results: A total of 175 patients with MG were enrolled at 11 sites from July 1, 2008, to January 31, 2009. A total of 151 patients were seen in follow-up. Total MGC scores showed excellent concurrent validity with other MG-specific scales. Analyses of sensitivities and specificities of the MGC revealed that a 3-point improvement in total MGC score was optimal for signifying clinical improvement. A 3-point improvement in the MGC also appears to represent a meaningful improvement to most patients, as indicated by improved 15-item myasthenia gravis quality of life scale (MG-QOL15) scores. The psychometric properties were no better for an individualized subscore made up of the 2 functional domains that the patient identified as most important to treat. The test-retest reliability coefficient of the MGC was 98%, with a lower 95% confidence interval of 97%, indicating excellent test-retest reliability. Conclusions: The Myasthenia Gravis Composite is a reliable and valid instrument for measuring clinical status of patients with myasthenia gravis in the practice setting and in clinical trials. PMID:20439845

WHO Study on the reliability and validity of the alcohol and drug use disorder instruments: overview of methods and results.

PubMed

Ustün, B; Compton, W; Mager, D; Babor, T; Baiyewu, O; Chatterji, S; Cottler, L; Göğüş, A; Mavreas, V; Peters, L; Pull, C; Saunders, J; Smeets, R; Stipec, M R; Vrasti, R; Hasin, D; Room, R; Van den Brink, W; Regier, D; Blaine, J; Grant, B F; Sartorius, N

1997-09-25

The WHO Study on the reliability and validity of the alcohol and drug use disorder instruments in an international study which has taken place in centres in ten countries, aiming to test the reliability and validity of three diagnostic instruments for alcohol and drug use disorders: the Composite International Diagnostic Interview (CIDI), the Schedules for Clinical Assessment in Neuropsychiatry (SCAN) and a special version of the Alcohol Use Disorder and Associated Disabilities Interview schedule-alcohol/drug-revised (AUDADIS-ADR). The purpose of the reliability and validity (R&V) study is to further develop the alcohol and drug sections of these instruments so that a range of substance-related diagnoses can be made in a systematic, consistent, and reliable way. The study focuses on new criteria proposed in the tenth revision of the International Classification of Diseases (ICD-10) and the fourth revision of the diagnostic and statistical manual of mental disorders (DSM-IV) for dependence, harmful use and abuse categories for alcohol and psychoactive substance use disorders. A systematic study including a scientifically rigorous measure of reliability (i.e. 1 week test-retest reliability) and validity (i.e. comparison between clinical and non-clinical measures) has been undertaken. Results have yielded useful information on reliability and validity of these instruments at diagnosis, criteria and question level. Overall the diagnostic concordance coefficients (kappa, kappa) were very good for dependence disorders (0.7-0.9), but were somewhat lower for the abuse and harmful use categories. The comparisons among instruments and independent clinical evaluations and debriefing interviews gave important information about possible sources of unreliability, and provided useful clues on the applicability and consistency of nosological concepts across cultures.

The dialysis orders objective structured clinical examination (OSCE): a formative assessment for nephrology fellows.

PubMed

Prince, Lisa K; Campbell, Ruth C; Gao, Sam W; Kendrick, Jessica; Lebrun, Christopher J; Little, Dustin J; Mahoney, David L; Maursetter, Laura A; Nee, Robert; Saddler, Mark; Watson, Maura A; Yuan, Christina M

2018-04-01

Few quantitative nephrology-specific simulations assess fellow competency. We describe the development and initial validation of a formative objective structured clinical examination (OSCE) assessing fellow competence in ordering acute dialysis. The three test scenarios were acute continuous renal replacement therapy, chronic dialysis initiation in moderate uremia and acute dialysis in end-stage renal disease-associated hyperkalemia. The test committee included five academic nephrologists and four clinically practicing nephrologists outside of academia. There were 49 test items (58 points). A passing score was 46/58 points. No item had median relevance less than 'important'. The content validity index was 0.91. Ninety-five percent of positive-point items were easy-medium difficulty. Preliminary validation was by 10 board-certified volunteers, not test committee members, a median of 3.5 years from graduation. The mean score was 49 [95% confidence interval (CI) 46-51], κ = 0.68 (95% CI 0.59-0.77), Cronbach's α = 0.84. We subsequently administered the test to 25 fellows. The mean score was 44 (95% CI 43-45); 36% passed the test. Fellows scored significantly less than validators (P < 0.001). Of evidence-based questions, 72% were answered correctly by validators and 54% by fellows (P = 0.018). Fellows and validators scored least well on the acute hyperkalemia question. In self-assessing proficiency, 71% of fellows surveyed agreed or strongly agreed that the OSCE was useful. The OSCE may be used to formatively assess fellow proficiency in three common areas of acute dialysis practice. Further validation studies are in progress.

Advanced topics in evidence-based urologic oncology: surrogate endpoints.

PubMed

Lavallée, Luke T; Montori, Victor M; Canfield, Stephen E; Breau, Rodney H

2011-01-01

Clinical trials often report surrogate endpoint data. A surrogate endpoint is a biological marker or clinical sign that can be substituted for a patient-important outcome. Using surrogate endpoints correctly may facilitate and expedite clinical trials and may improve medical decisions. However, rigorous criteria must be met for an endpoint to be considered a valid surrogate. The purpose of this article is to review the topic of surrogate endpoints in the context of a urologic encounter. Copyright © 2011 Elsevier Inc. All rights reserved.

Measuring the statistical validity of summary meta-analysis and meta-regression results for use in clinical practice.

PubMed

Willis, Brian H; Riley, Richard D

2017-09-20

An important question for clinicians appraising a meta-analysis is: are the findings likely to be valid in their own practice-does the reported effect accurately represent the effect that would occur in their own clinical population? To this end we advance the concept of statistical validity-where the parameter being estimated equals the corresponding parameter for a new independent study. Using a simple ('leave-one-out') cross-validation technique, we demonstrate how we may test meta-analysis estimates for statistical validity using a new validation statistic, Vn, and derive its distribution. We compare this with the usual approach of investigating heterogeneity in meta-analyses and demonstrate the link between statistical validity and homogeneity. Using a simulation study, the properties of Vn and the Q statistic are compared for univariate random effects meta-analysis and a tailored meta-regression model, where information from the setting (included as model covariates) is used to calibrate the summary estimate to the setting of application. Their properties are found to be similar when there are 50 studies or more, but for fewer studies Vn has greater power but a higher type 1 error rate than Q. The power and type 1 error rate of Vn are also shown to depend on the within-study variance, between-study variance, study sample size, and the number of studies in the meta-analysis. Finally, we apply Vn to two published meta-analyses and conclude that it usefully augments standard methods when deciding upon the likely validity of summary meta-analysis estimates in clinical practice. © 2017 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd. © 2017 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd.

Quality of life in multiple myeloma: clinical validation of the Mexican-Spanish version of the QLQ-MY20 instrument.

PubMed

Espinoza-Zamora, José Ramiro; Portilla-Espinosa, César Miguel; Labardini-Méndez, Juan Rafael; Cervera, Eduardo; Niesvisky, Ruben; Oñate-Ocaña, Luis F

2015-06-01

Health-related quality of life (HRQL) has become an important outcome measurement in hematology. Our aim was to validate the quality of life questionnaire (QLQ)-MY20 instrument in patients with multiple myeloma (MM) in Mexico. The Mexican-Spanish versions of the QLQ-C30 and QLQ-MY20 instruments were applied to patients with MM at a cancer referral centre. Reliability and validity tests were performed. Test-retest was carried out in selected patients. Ninety-eight patients with MM were included in this study. Questionnaire compliance rates were high, and the instrument was well accepted; internal consistency tests demonstrated good convergent and divergent validity. Cronbach's α coefficients of seven of nine multi-item scales of the QLQ-C30 and of all three multi-item scales of the QLQ-MY20 instruments were >0.7 (range, 0.36-0.89). The scales of the QLQ-C30 and QLQ-MY20 instruments distinguished among clinically distinct groups of patients; 9 of 15 scales of the QLQ-C30 and all 4 scales of the QLQ-MY20 presented responsiveness after change over time. The Mexican-Spanish version of the QLQ-MY20 questionnaire is reliable and valid for the assessment of HRQL in patients with MM and can be used in clinical trials in the Mexican community.

The development and psychometric properties of the selective mutism questionnaire.

PubMed

Bergman, R Lindsey; Keller, Melody L; Piacentini, John; Bergman, Andrea J

2008-04-01

Research on selective mutism (SM) has been limited by the absence of standardized, psychometrically sound assessment measures. The purpose of our investigation was to present two studies that examined the factor structure and initial reliability and validity of the Selective Mutism Questionnaire (SMQ), a 17-item parent report measure of failure to speak related to SM. Study 1 (N = 589) utilized an Internet sample of parents of children ages 3 to 11 to demonstrate that the SMQ has a theoretically and clinically meaningful factor structure accounting for a significant portion of variance in responses with good internal consistency. Study 2 (N = 66) supported the validity of the SMQ in that scores discriminated clinic-referred children with SM from children with other anxiety disorders. Scores on the SMQ were correlated with measures of several theoretically and clinically important dimensions.

The druggable genome and support for target identification and validation in drug development.

PubMed

Finan, Chris; Gaulton, Anna; Kruger, Felix A; Lumbers, R Thomas; Shah, Tina; Engmann, Jorgen; Galver, Luana; Kelley, Ryan; Karlsson, Anneli; Santos, Rita; Overington, John P; Hingorani, Aroon D; Casas, Juan P

2017-03-29

Target identification (determining the correct drug targets for a disease) and target validation (demonstrating an effect of target perturbation on disease biomarkers and disease end points) are important steps in drug development. Clinically relevant associations of variants in genes encoding drug targets model the effect of modifying the same targets pharmacologically. To delineate drug development (including repurposing) opportunities arising from this paradigm, we connected complex disease- and biomarker-associated loci from genome-wide association studies to an updated set of genes encoding druggable human proteins, to agents with bioactivity against these targets, and, where there were licensed drugs, to clinical indications. We used this set of genes to inform the design of a new genotyping array, which will enable association studies of druggable genes for drug target selection and validation in human disease. Copyright © 2017, American Association for the Advancement of Science.

Development and Validation of the Eating Loss of Control Scale

PubMed Central

Blomquist, Kerstin K.; Roberto, Christina A.; Barnes, Rachel D.; White, Marney A.; Masheb, Robin M.; Grilo, Carlos M.

2014-01-01

Recurrent objective bulimic episodes (OBE) are a defining diagnostic characteristic of binge eating disorder (BED) and bulimia nervosa (BN). OBEs are characterized by experiencing loss of control (LOC) while eating an unusually large quantity of food. Despite nosological importance and complex heterogeneity across patients, measurement of LOC has been assessed dichotomously (present/absent). This study describes the development and initial validation of the Eating Loss of Control Scale (ELOCS), a self-report questionnaire that examines the complexity of the LOC construct. Participants were 168 obese treatment-seeking individuals with BED who completed the Eating Disorder Examination interview and self-report measures. Participants rated their LOC-related feelings or behaviors on continuous Likert-type scales and reported the number of LOC episodes in the past 28 days. Principal component analysis identified a single-factor, 18-item scale, which demonstrated good internal reliability (α=0.90). Frequency of LOC episodes was significantly correlated with frequency of OBEs and subjective bulimic episodes. The ELOCS demonstrated good convergent validity and was significantly correlated with greater eating pathology, greater emotion dysregulation, greater depression, and lower self-control, but not with BMI. The findings suggest that the ELOCS is a valid self-report questionnaire that may provide important clinical information regarding experiences of LOC in obese persons with BED. Future research should examine the ELOCS in other eating disorders and non-clinical samples. PMID:24219700

Preanalytical management: serum vacuum tubes validation for routine clinical chemistry.

PubMed

Lima-Oliveira, Gabriel; Lippi, Giuseppe; Salvagno, Gian Luca; Montagnana, Martina; Picheth, Geraldo; Guidi, Gian Cesare

2012-01-01

The validation process is essential in accredited clinical laboratories. Aim of this study was to validate five kinds of serum vacuum tubes for routine clinical chemistry laboratory testing. Blood specimens from 100 volunteers in five different serum vacuum tubes (Tube I: VACUETTE, Tube II: LABOR IMPORT, Tube III: S-Monovette, Tube IV: SST and Tube V: SST II) were collected by a single, expert phlebotomist. The routine clinical chemistry tests were analyzed on cobas 6000 module. The significance of the differences between samples was assessed by paired Student's t-test after checking for normality. The level of statistical significance was set at P < 0.005. Finally, the biases from Tube I, Tube II, Tube III, Tube IV and Tube V were compared with the current desirable quality specifications for bias (B), derived from biological variation. Basically, our validation will permit the laboratory or hospital managers to select the brand's vacuum tubes validated according him/her technical or economical reasons, in order to perform the following laboratory tests: glucose, total cholesterol, high density lipoprotein-cholesterol, triglycerides, total protein, albumin, blood urea nitrogen, uric acid, alkaline phosphatise, aspartate aminotransferase, gamma-glutamyltransferase, lactate dehydrogenase, creatine kinase, total bilirubin, direct bilirubin, calcium, iron, sodium and potassium. On the contrary special attention will be required if the laboratory already performs creatinine, amylase, phosphate and magnesium determinations and the quality laboratory manager intend to change the serum tubes. We suggest that laboratory management should both standardize the procedures and frequently evaluate the quality of in vitro diagnostic devices.

Functional Recovery Measures for Spinal Cord Injury: An Evidence-Based Review for Clinical Practice and Research

PubMed Central

Anderson, Kim; Aito, Sergio; Atkins, Michal; Biering-Sørensen, Fin; Charlifue, Susan; Curt, Armin; Ditunno, John; Glass, Clive; Marino, Ralph; Marshall, Ruth; Mulcahey, Mary Jane; Post, Marcel; Savic, Gordana; Scivoletto, Giorgio; Catz, Amiram

2008-01-01

Background/Objective: The end goal of clinical care and clinical research involving spinal cord injury (SCI) is to improve the overall ability of persons living with SCI to function on a daily basis. Neurologic recovery does not always translate into functional recovery. Thus, sensitive outcome measures designed to assess functional status relevant to SCI are important to develop. Method: Evaluation of currently available SCI functional outcome measures by a multinational work group. Results: The 4 measures that fit the prespecified inclusion criteria were the Modified Barthel Index (MBI), the Functional Independence Measure (FIM), the Quadriplegia Index of Function (QIF), and the Spinal Cord Independence Measure (SCIM). The MBI and the QIF were found to have minimal evidence for validity, whereas the FIM and the SCIM were found to be reliable and valid. The MBI has little clinical utility for use in the SCI population. Likewise, the FIM applies mainly when measuring burden of care, which is not necessarily a reflection of functional recovery. The QIF is useful for measuring functional recovery but only in a subpopulation of people with SCI, and substantial validity data are still required. The SCIM is the only functional recovery outcome measure designed specifically for SCI. Conclusions: The multinational work group recommends that the latest version of the SCIM (SCIM III) continue to be refined and validated and subsequently implemented worldwide as the primary functional recovery outcome measure for SCI. The QIF may continue to be developed and validated for use as a supplemental tool for the nonambulatory tetraplegic population. PMID:18581660

Classification of diabetic foot ulcers.

PubMed

Game, Frances

2016-01-01

It is known that the relative importance of factors involved in the development of diabetic foot problems can vary in both their presence and severity between patients and lesions. This may be one of the reasons why outcomes seem to vary centre to centre and why some treatments may seem more effective in some people than others. There is a need therefore to classify and describe lesions of the foot in patients with diabetes in a manner that is agreed across all communities but is simple to use in clinical practice. No single system is currently in widespread use, although a number have been published. Not all are well validated outside the system from which they were derived, and it has not always been made clear the clinical purposes to which such classifications should be put to use, whether that be for research, clinical description in routine clinical care or audit. Here the currently published classification systems, their validation in clinical practice, whether they were designed for research, audit or clinical care, and the strengths and weaknesses of each are explored. Copyright © 2016 John Wiley & Sons, Ltd.

Genetic counselor perceptions of genetic counseling session goals: a validation study of the reciprocal-engagement model.

PubMed

Hartmann, Julianne E; Veach, Patricia McCarthy; MacFarlane, Ian M; LeRoy, Bonnie S

2015-04-01

Although some researchers have attempted to define genetic counseling practice goals, no study has obtained consensus about the goals from a large sample of genetic counselors. The Reciprocal-Engagement Model (REM; McCarthy Veach, Bartels & LeRoy, 2007) articulates 17 goals of genetic counseling practice. The present study investigated whether these goals could be generalized as a model of practice, as determined by a larger group of clinical genetic counselors. Accordingly, 194 genetic counselors were surveyed regarding their opinions about the importance of each goal and their perceptions of how frequently they achieve each goal. Mean importance ratings suggest they viewed every goal as important. Factor analysis of the 17 goals yielded four factors: Understanding and Appreciation, Support and Guidance, Facilitative Decision-Making, and Patient-Centered Education. Patient-Centered Education and Facilitative Decision-Making goals received the highest mean importance ratings. Mean frequency ratings were consistently lower than importance ratings, suggesting genetic counseling goals may be difficult to achieve and/or not applicable in all situations. A number of respondents provided comments about the REM goals that offer insight into factors related to implementing the goals in clinical practice. This study presents preliminary evidence concerning the validity of the goals component of the REM.

[Validation and verfication of microbiology methods].

PubMed

Camaró-Sala, María Luisa; Martínez-García, Rosana; Olmos-Martínez, Piedad; Catalá-Cuenca, Vicente; Ocete-Mochón, María Dolores; Gimeno-Cardona, Concepción

2015-01-01

Clinical microbiologists should ensure, to the maximum level allowed by the scientific and technical development, the reliability of the results. This implies that, in addition to meeting the technical criteria to ensure their validity, they must be performed with a number of conditions that allows comparable results to be obtained, regardless of the laboratory that performs the test. In this sense, the use of recognized and accepted reference methodsis the most effective tool for these guarantees. The activities related to verification and validation of analytical methods has become very important, as there is continuous development, as well as updating techniques and increasingly complex analytical equipment, and an interest of professionals to ensure quality processes and results. The definitions of validation and verification are described, along with the different types of validation/verification, and the types of methods, and the level of validation necessary depending on the degree of standardization. The situations in which validation/verification is mandatory and/or recommended is discussed, including those particularly related to validation in Microbiology. It stresses the importance of promoting the use of reference strains as controls in Microbiology and the use of standard controls, as well as the importance of participation in External Quality Assessment programs to demonstrate technical competence. The emphasis is on how to calculate some of the parameters required for validation/verification, such as the accuracy and precision. The development of these concepts can be found in the microbiological process SEIMC number 48: «Validation and verification of microbiological methods» www.seimc.org/protocols/microbiology. Copyright © 2013 Elsevier España, S.L.U. y Sociedad Española de Enfermedades Infecciosas y Microbiología Clínica. All rights reserved.

How Can We Improve Outcomes for Patients and Families Under Palliative Care? Implementing Clinical Audit for Quality Improvement in Resource Limited Settings

PubMed Central

Selman, Lucy; Harding, Richard

2010-01-01

Palliative care in India has made enormous advances in providing better care for patients and families living with progressive disease, and many clinical services are well placed to begin quality improvement initiatives, including clinical audit. Clinical audit is recognized globally to be essential in all healthcare, as a way of monitoring and improving quality of care. However, it is not common in developing country settings, including India. Clinical audit is a cyclical activity involving: identification of areas of care in need of improvement, through data collection and analysis utilizing an appropriate questionnaire; setting measurable quality of care targets in specific areas; designing and implementing service improvement strategies; and then re-evaluating quality of care to assess progress towards meeting the targets. Outcome measurement is an important component of clinical audit that has additional advantages; for example, establishing an evidence base for the effectiveness of services. In resource limited contexts, outcome measurement in clinical audit is particularly important as it enables service development to be evidence-based and ensures resources are allocated effectively. Key success factors in conducting clinical audit are identified (shared ownership, training, managerial support, inclusion of all members of staff and a positive approach). The choice of outcome measurement tool is discussed, including the need for a culturally appropriate and validated measure which is brief and simple enough to incorporate into clinical practice and reflects the holistic nature of palliative care. Support for clinical audit is needed at a national level, and development and validation of an outcome measurement tool in the Indian context is a crucial next step. PMID:20859465

The validity of the SF-12 and SF-6D instruments in people living with HIV/AIDS in Kenya.

PubMed

Patel, Anik R; Lester, Richard T; Marra, Carlo A; van der Kop, Mia L; Ritvo, Paul; Engel, Lidia; Karanja, Sarah; Lynd, Larry D

2017-07-17

Health-related quality of life (HRQoL) and health state utility value (HSUV) measurements are vital components of healthcare clinical and economic evaluations. Accurate measurement of HSUV and HRQoL require validated instruments. The 12-item Short-Form Health Survey (SF-12) is one of few instruments that can evaluate both HRQoL and HSUV, but its validity has not been assessed in people living with HIV/AIDS (PLWHA) in east Africa, where the burden of HIV is high. This cross-sectional study used baseline data from a randomized trial involving PLWHA in Kenya. Data included responses from a translated and adapted SF-12 survey as well as key demographic and clinical data. Construct validity of the survey was examined by testing the SF-12's ability to distinguish between groups known in advance to have differences in their health based on their disease severity. We classified disease severity based on established definitions from the US Center for Disease Control (CDC) and WHO, as well as a previously studied viral load threshold. T-tests and ANOVA were used to test for differences in HRQoL and HSUV scores. Area under the receive operator curve (AUC) was used to test the discriminative ability of the HRQoL and HSUV instruments. Differences in physical component scores met the minimum clinically important difference among participants with more advanced HIV when defined by CD4 count (4.3 units) and WHO criteria (compared to stage 1, stages 2, 3 and 4 were 2.0, 7.2 and 9.8 units lower respectively). Mental score differences met the minimum clinically important difference between WHO stage 1 and stage 4 patients (4.4). Differences in the HSUV were statistically lower in more advanced HIV by all three definitions of severity. The AUC showed poor to weak discriminatory ability in most analyses, but had fair discriminatory ability between WHO clinical stage 1 and clinical stage 4 individuals (AUC = 0.71). Our findings suggest that the Kiswahili translated and adapted version of the SF-12 could be used as an assessment tool for physical health, mental health and HSUV for Kiswahili-speaking PLHWA. Clinical trials.gov identifier: NCT00830622 . Registered 26 January 2009.

Factor Structure of the Devereux Early Childhood Assessment Clinical Form in Low-Income Hispanic American Bilingual Preschool Children

ERIC Educational Resources Information Center

Oades-Sese, Geraldine V.; Kaliski, Pamela K.; Weiss, Karen

2010-01-01

The Devereux Early Childhood Assessment Clinical Form (DECA-C) is the first instrument to measure the social-emotional resilience of young children from ages 2 to 5 years. This study is an important step toward gathering validity evidence for the teacher-rated DECA-C. This is the first study to investigate the DECA-C factor structure and the first…

Development and Validation of the Pride in Eating Pathology Scale (PEP-S).

PubMed

Faija, Cintia L; Fox, John R E; Tierney, Stephanie; Peters, Sarah; Gooding, Patricia A

2017-01-01

There is a growing body of theoretical and clinical literature highlighting the role of pride in maintaining eating disordered behaviours. Despite its clinical importance, there are no measures to assess feelings of pride associated with eating psychopathology. This study describes the development and validation of the Pride in Eating Pathology Scale (PEP-S), a self-report questionnaire that examines feelings of pride towards eating disordered symptoms (e.g., pride in food restriction, thinness and weight loss). Participants were 390 females, recruited from university and community populations, whose mean age was 26.99 years. Respondents rated pride in eating pathology on a 7-point Likert-scale. Principal Component Analysis indicated that the 60-item scale comprised a four component structure: (1) pride in weight loss, food control and thinness, (2) pride in healthy weight and healthy eating, (3) pride in outperforming others and social recognition and (4) pride in capturing other people's attention due to extreme thinness. These four components explained a total of 65.31% of the variance. The PEP-S demonstrated very good internal reliability (α ranging from 0.88 to 0.98) and very good test-retest reliability over a 3-week time-span (r ranging from 0.81 to 0.93). The PEP-S also showed excellent convergent and discriminant validity. Furthermore, the scale discriminated between women with high and low levels of eating psychopathology. The PEP-S is a psychometrically robust measure of pride in eating pathology. It has the potential to advance theoretical understanding and may also be clinically useful. Copyright © 2015 John Wiley & Sons, Ltd. The PEP-S is a valid, reliable, quick and easy to administer self-report questionnaire that measures pride related to eating pathology. The PEP-S assesses four clinically relevant dimensions: (1) pride in weight loss, food control and thinness, (2) pride in healthy weight and healthy eating, (3) pride in outperforming others and social recognition and (4) pride in capturing other people's attention due to extreme thinness. The PEP-S has very good internal and test-retest reliability, and very good convergent and discriminant validity. The PEP-S distinguishes between women with higher and lower levels of eating psychopathology. The PEP-S makes an important contribution to understanding pride in eating psychopathology, which is essential from both clinical and theoretical perspectives. Copyright © 2015 John Wiley & Sons, Ltd.

A disease-specific measure of health-related quality of life in adults with chronic immune thrombocytopenic purpura: psychometric testing in an open-label clinical trial.

PubMed

Mathias, Susan D; Bussel, James B; George, James N; McMillan, Robert; Okano, Gary J; Nichol, Janet L

2007-05-01

The Immune Thrombocytopenic Purpura Patient Assessment Questionnaire (ITP-PAQ) was developed to assess disease-specific quality of life (QoL) in adults with ITP. It is a 44-item questionnaire that includes scales for physical health (symptoms, fatigue/sleep, bother, and activity), emotional health (psychological and fear), overall QoL, social activity, women's reproductive health, and work. A previous study reported preliminary evidence of its reliability and validity. The present study was conducted to ascertain the responsiveness (ability to detect a clinically important treatment effect), reliability, and validity of the ITP-PAQ and to corroborate the earlier findings. The women's reproductive health scale was evaluated for psychometric evidence of the existence of separate menstrual symptoms and fertility subscales. The ITP-PAQ was evaluated in the context of an ongoing open-label extension study assessing the tolerability and durability of increases in the platelet count with AMG 531 (a thrombopoiesis peptibody that increases platelet production by targeting the thrombopoietin receptor) administered by subcutaneous injection once weekly in adult patients with ITP It was self-administered at baseline and at weeks 4, 12, and 24. The responsiveness of the questionnaire was evaluated by calculating and comparing the change scores of patients who showed clinical improvement-categorized as platelet responders (those with a platelet count > or =50 x 10(9) cells/L and a doubling of baseline values at week 24) and durable platelet responders (those with a platelet count > or =50 x 10(9) cells/L and a doubling of baseline values on > or =6 occasions during weeks 17-24)-with the change scores of patients wh did not show clinical improvement. The reliability (internal consistency and test-retest) and validity (convergent, discriminant, and known groups) of the questionnaire were also evaluated. Validity was examined in terms of correlations between the ITP-PAQ and the 36-item Short-Form Health Survey (SF-36), a generic measure of health-related QoL. Thirty-four patients completed the ITP-PAQ. Most of the scales were found capable of detecting clinically important treatment effects, with the scales for symptoms, fatigue/sleep, bother, and activity being particularly responsive. All scales were found to have internal consistency reliability (Cronbach's alpha, 0.700-0.950), with the exceptions of the menstrual symptoms subscale (0.988 and 0.959 at weeks 12 and 24, respectively) and the work scale (0.691 at week 24). Test-retest reliability was acceptable (intraclass correlation coefficient, 0.725-0.867), with the exceptions of the scales for symptoms (0.677) and women's reproductive health (0.592) and the fertility subscale (0.171). Construct validity was supported by correlations between specific ITP-PAQ and SF-36 scales, with the exceptions of the menstrual symptoms and fertility subscales. Discriminant validity was reported for the symptoms, fatigue/sleep, bother, and activity scales. Durable platelet responders had significantly better scores than nonresponders on the symptoms (P = 0.022), bother (P = 0.008), psychological (P = 0.033), and overall QoL scales (P = 0.032). Compared with those who had undergone splenectomy, patients without splenectomy had significantly higher scores on the women's reproductive health scale (P = 0.03). The results of this analysis indicate that the ITP-PAQ has acceptable responsiveness, reliability, and validity. Further study of the minimal clinically important difference in ITP-PAQ scale scores is needed.

Validity and Responsiveness of the Two-Minute Walk Test for Measuring Functional Recovery After Total Knee Arthroplasty.

PubMed

Unnanuntana, Aasis; Ruangsomboon, Pakpoom; Keesukpunt, Worawut

2018-06-01

The 2-minute walk test (2mwt) is a performance-based test that evaluates functional recovery after total knee arthroplasty (TKA). This study evaluated its validity compared with the modified Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), Oxford Knee Score (OKS), modified Knee Score, Numerical Pain Rating Scale, and Timed Up and Go test, and its responsiveness in assessing functional recovery in TKA patients. This prospective cohort study included 162 patients undergoing primary TKA between 2013 and 2015. We used patient-reported outcome measures (modified WOMAC, OKS, modified Knee Score, Numerical Pain Rating Scale) and performance-based tests (2mwt and Timed Up and Go test) at baseline and 3, 6, and 12 months postoperatively. The construct validity of 2mwt was determined between the 2mwt distances walked and other outcome measurements. To assess responsiveness, effect size and standardized response mean were analyzed. Minimal clinically important difference of 2mwt at 12 months after TKA was also calculated. All outcome measurements improved significantly from baseline to 3, 6, and 12 months postoperatively. Bivariate analysis revealed mild to moderate associations between the 2mwt and modified WOMAC function subscales, and moderate to strong associations with OKS. Mild to moderate correlations were found for pain and stiffness between 2mwt and other outcome measurements. The effect size and standardized response mean at 12 months were large, with a minimal clinically important difference of 12.7 m. 2mwt is a validated performance-based test with responsiveness properties. Being simple and easy to perform, it can be used routinely in clinical practice to evaluate functional recovery after TKA. Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.

Is a controlled randomised trial the non-plus-ultra design? A contribution to discussion on comparative, controlled, non-randomised trials.

PubMed

Gaus, Wilhelm; Muche, Rainer

2013-05-01

Clinical studies provide formalised experience for evidence-based medicine (EBM). Many people consider a controlled randomised trial (CRT, identical to a randomised controlled trial RCT) to be the non-plus-ultra design. However, CRTs also have limitations. The problem is not randomisation itself but informed consent for randomisation and masking of therapies according to today's legal and ethical standards. We do not want to de-rate CRTs, but we would like to contribute to the discussion on clinical research methodology. Informed consent to a CRT and masking of therapies plainly select patients. The excellent internal validity of CRTs can be counterbalanced by poor external validity, because internal and external validity act as antagonists. In a CRT, patients may feel like guinea pigs, this can decrease compliance, cause protocol violations, reduce self-healing properties, suppress unspecific therapeutic effects and possibly even modify specific efficacy. A control group (comparative study) is most important for the degree of evidence achieved by a trial. Study control by detailed protocol and good clinical practice (controlled study) is second in importance and randomisation and masking is third (thus the sequence CRT instead of RCT). Controlled non-randomised trials are just as ambitious and detailed as CRTs. We recommend clinicians and biometricians to take high quality controlled non-randomised trials into consideration more often. They combine good internal and external validity, better suit daily medical practice, show better patient compliance and fewer protocol violations, deliver estimators unbiased by alienated patients, and perhaps provide a clearer explanation of the achieved success. Copyright © 2013 Elsevier Inc. All rights reserved.

Screening for important unwarranted variation in clinical practice: a triple-test of processes of care, costs and patient outcomes.

PubMed

Partington, Andrew; Chew, Derek P; Ben-Tovim, David; Horsfall, Matthew; Hakendorf, Paul; Karnon, Jonathan

2017-03-01

Objective Unwarranted variation in clinical practice is a target for quality improvement in health care, but there is no consensus on how to identify such variation or to assess the potential value of initiatives to improve quality in these areas. This study illustrates the use of a triple test, namely the comparative analysis of processes of care, costs and outcomes, to identify and assess the burden of unwarranted variation in clinical practice. Methods Routinely collected hospital and mortality data were linked for patients presenting with symptoms suggestive of acute coronary syndromes at the emergency departments of four public hospitals in South Australia. Multiple regression models analysed variation in re-admissions and mortality at 30 days and 12 months, patient costs and multiple process indicators. Results After casemix adjustment, an outlier hospital with statistically significantly poorer outcomes and higher costs was identified. Key process indicators included admission patterns, use of invasive diagnostic procedures and length of stay. Performance varied according to patients' presenting characteristics and time of presentation. Conclusions The joint analysis of processes, outcomes and costs as alternative measures of performance inform the importance of reducing variation in clinical practice, as well as identifying specific targets for quality improvement along clinical pathways. Such analyses could be undertaken across a wide range of clinical areas to inform the potential value and prioritisation of quality improvement initiatives. What is known about the topic? Variation in clinical practice is a long-standing issue that has been analysed from many different perspectives. It is neither possible nor desirable to address all forms of variation in clinical practice: the focus should be on identifying important unwarranted variation to inform actions to reduce variation and improve quality. What does this paper add? This paper proposes the comparative analysis of processes of care, costs and outcomes for patients with similar diagnoses presenting at alternative hospitals, using linked, routinely collected data. This triple test of performance indicators extracts maximum value from routine data to identify priority areas for quality improvement to reduce important and unwarranted variations in clinical practice. What are the implications for practitioners? The proposed analyses need to be applied to other clinical areas to demonstrate the general application of the methods. The outputs can then be validated through the application of quality improvement initiatives in clinical areas with identified important and unwarranted variation. Validated frameworks for the comparative analysis of clinical practice provide an efficient approach to valuing and prioritising actions to improve health service quality.

Bleeding impacting mortality after noncardiac surgery: a protocol to establish diagnostic criteria, estimate prognostic importance, and develop and validate a prediction guide in an international prospective cohort study

PubMed Central

Roshanov, Pavel S.; Eikelboom, John W.; Crowther, Mark; Tandon, Vikas; Borges, Flavia K.; Kearon, Clive; Lamy, Andre; Whitlock, Richard; Biccard, Bruce M.; Szczeklik, Wojciech; Guyatt, Gordon H.; Panju, Mohamed; Spence, Jessica; Garg, Amit X.; McGillion, Michael; VanHelder, Tomas; Kavsak, Peter A.; de Beer, Justin; Winemaker, Mitchell; Sessler, Daniel I.; Le Manach, Yannick; Sheth, Tej; Pinthus, Jehonathan H.; Thabane, Lehana; Simunovic, Marko R.I.; Mizera, Ryszard; Ribas, Sebastian; Devereaux, P.J.

2017-01-01

Introduction: Various definitions of bleeding have been used in perioperative studies without systematic assessment of the diagnostic criteria for their independent association with outcomes important to patients. Our proposed definition of bleeding impacting mortality after noncardiac surgery (BIMS) is bleeding that is independently associated with death during or within 30 days after noncardiac surgery. We describe our analysis plan to sequentially 1) establish the diagnostic criteria for BIMS, 2) estimate the independent contribution of BIMS to 30-day mortality and 3) develop and internally validate a clinical prediction guide to estimate patient-specific risk of BIMS. Methods: In the Vascular Events In Noncardiac Surgery Patients Cohort Evaluation (VISION) study, we prospectively collected bleeding data for 16 079 patients aged 45 years or more who had noncardiac inpatient surgery between 2007 and 2011 at 12 centres in 8 countries across 5 continents. We will include bleeding features independently associated with 30-day mortality in the diagnostic criteria for BIMS. Candidate features will include the need for reoperation due to bleeding, the number of units of erythrocytes transfused, the lowest postoperative hemoglobin concentration, and the absolute and relative decrements in hemoglobin concentration from the preoperative value. We will then estimate the incidence of BIMS and its independent association with 30-day mortality. Last, we will construct and internally validate a clinical prediction guide for BIMS. Interpretation: This study will address an important gap in our knowledge about perioperative bleeding, with implications for the 200 million patients who undergo noncardiac surgery globally every year. Trial registration: ClinicalTrials.gov, no NCT00512109. PMID:28943515

Validation of the Italian version of the Apathy Evaluation Scale (AES-I) in institutionalized geriatric patients.

PubMed

Borgi, Marta; Caccamo, Floriana; Giuliani, Alessandro; Piergentili, Alessandro; Sessa, Sonia; Reda, Emilia; Alleva, Enrico; Cirulli, Francesca; Miraglia, Fabio

2016-01-01

Apathy is a very common symptom in the institutionalized elderly and represents a condition of both clinical and public health importance. The Apathy Evaluation Scale (AES) has been shown to be a valid and reliable tool for characterizing, quantifying and differentiating apathy in various health conditions. The aims of this study were to establish the validity and reliability of the Italian version of the AES, and to assess the severity of apathy in a sample of Italian institutionalized geriatric patients. Data were collected from clinical interviews using the AES informant version (AES-I). Associations between measures of apathy and depression, cognitive functioning and perceived quality of life were evaluated, as well as the effects of the living environment on apathetic symptoms. Multiple forms of reliability and validity (i.e. test-retest, internal consistency, discriminability of apathy rating from a standard measure of depression) were satisfied. Our results also show that the characteristics of the care setting may affect the severity of apathetic symptoms. The AES-I Italian version is a reliable and valid instrument for measuring apathy in Italian patients, also allowing a direct comparison with data gathered in other countries.

Measuring the statistical validity of summary meta‐analysis and meta‐regression results for use in clinical practice

PubMed Central

Riley, Richard D.

2017-01-01

An important question for clinicians appraising a meta‐analysis is: are the findings likely to be valid in their own practice—does the reported effect accurately represent the effect that would occur in their own clinical population? To this end we advance the concept of statistical validity—where the parameter being estimated equals the corresponding parameter for a new independent study. Using a simple (‘leave‐one‐out’) cross‐validation technique, we demonstrate how we may test meta‐analysis estimates for statistical validity using a new validation statistic, Vn, and derive its distribution. We compare this with the usual approach of investigating heterogeneity in meta‐analyses and demonstrate the link between statistical validity and homogeneity. Using a simulation study, the properties of Vn and the Q statistic are compared for univariate random effects meta‐analysis and a tailored meta‐regression model, where information from the setting (included as model covariates) is used to calibrate the summary estimate to the setting of application. Their properties are found to be similar when there are 50 studies or more, but for fewer studies Vn has greater power but a higher type 1 error rate than Q. The power and type 1 error rate of Vn are also shown to depend on the within‐study variance, between‐study variance, study sample size, and the number of studies in the meta‐analysis. Finally, we apply Vn to two published meta‐analyses and conclude that it usefully augments standard methods when deciding upon the likely validity of summary meta‐analysis estimates in clinical practice. © 2017 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd. PMID:28620945

Illness severity and self-efficacy as course predictors of DSM-IV alcohol dependence in a multisite clinical sample.

PubMed

Langenbucher, J; Sulesund, D; Chung, T; Morgenstern, J

1996-01-01

Illness severity and self-efficacy are two constructs of growing interest as predictors of clinical response in alcoholism. Using alternative measures of illness severity (DSM-IV symptom count, Alcohol Dependence Scale, and Addiction Severity Index) and self-efficacy (brief version of the Situational Confidence Questionnaire) rigorously controlled for theoretically important background variables, we studied their unique contribution to multiple indices of relapse, relapse latency, and use of alternative coping behaviors in a large, heterogeneous clinical sample. The Alcohol Dependence Scale contributed to the prediction of 4 of 5 relapse indicators. The SCQ failed to predict relapse behavior or its precursor, coping response. The findings emphasize the predictive validity of severity of dependence as a course specifier and underline the need for more sensitive and externally valid measures of cognitive processes such as self-efficacy for application in future studies of posttreatment behavior.

Self-efficacy in weight management.

PubMed

Clark, M M; Abrams, D B; Niaura, R S; Eaton, C A; Rossi, J S

1991-10-01

Self-efficacy is an important mediating mechanism in advancing understanding of the treatment of obesity. This study developed and validated the Weight Efficacy Life-Style Questionnaire (WEL), improving on previous studies by the use of clinical populations, cross-validation of the initial factor analysis, exploration of the best fitting theoretical model of self-efficacy, and examination of change in treatment. The resulting 20-item WEL consists of five situational factors: Negative Emotions, Availability, Social Pressure, Physical Discomfort, and Positive Activities. A hierarchical model was found to provide the best fit to the data. Results from two separate clinical treatment studies (total N = 382) show that the WEL is sensitive to changes in global scores as well as to a subset of the five situational factor scores. Treatment programs may be incomplete if they change only a subset of the situational dimensions of self-efficacy. Theoretical and clinical implications are discussed.

Development and validation of the JAX Cancer Treatment Profile™ for detection of clinically actionable mutations in solid tumors

PubMed Central

Ananda, Guruprasad; Mockus, Susan; Lundquist, Micaela; Spotlow, Vanessa; Simons, Al; Mitchell, Talia; Stafford, Grace; Philip, Vivek; Stearns, Timothy; Srivastava, Anuj; Barter, Mary; Rowe, Lucy; Malcolm, Joan; Bult, Carol; Karuturi, Radha Krishna Murthy; Rasmussen, Karen; Hinerfeld, Douglas

2015-01-01

Background The continued development of targeted therapeutics for cancer treatment has required the concomitant development of more expansive methods for the molecular profiling of the patient’s tumor. We describe the validation of the JAX Cancer Treatment Profile™ (JAX-CTP™), a next generation sequencing (NGS)-based molecular diagnostic assay that detects actionable mutations in solid tumors to inform the selection of targeted therapeutics for cancer treatment. Methods NGS libraries are generated from DNA extracted from formalin fixed paraffin embedded tumors. Using hybrid capture, the genes of interest are enriched and sequenced on the Illumina HiSeq 2500 or MiSeq sequencers followed by variant detection and functional and clinical annotation for the generation of a clinical report. Results The JAX-CTP™ detects actionable variants, in the form of single nucleotide variations and small insertions and deletions (≤50bp) in 190 genes in specimens with a neoplastic cell content of ≥10%. The JAX-CTP™ is also validated for the detection of clinically actionable gene amplifications. Conclusions There is a lack of consensus in the molecular diagnostics field on the best method for the validation of NGS-based assays in oncology, thus the importance of communicating methods, as contained in this report. The growing number of targeted therapeutics and the complexity of the tumor genome necessitates continued development and refinement of advanced assays for tumor profiling to enable precision cancer treatment. PMID:25562415

The perceived personal control (PPC) questionnaire: reliability and validity in a sample from the United Kingdom.

PubMed

McAllister, Marion; Wood, Alex M; Dunn, Graham; Shiloh, Shoshana; Todd, Chris

2012-02-01

Outcome measures are important assessment tools to evaluate clinical genetics services. Research suggests that perceived personal control (PPC) is an outcome valued by clinical genetics patients and clinicians. The PPC scale was developed in Hebrew to capture three dimensions of PPC: Cognitive, decisional, and behavioral control. This article reports on the first psychometric validation of the English translation of the PPC scale. Previous research has shown that the Hebrew and Dutch translations have good psychometric properties. However, the psychometric properties of the English translation have not been tested, and there is disagreement about the factor structure, with implications for how to score the measure. A total of 395 patients attending a clinical genetics appointment in the United Kingdom completed several measures at baseline, and a further 241 also completed measures at 2-4 weeks follow-up. The English language PPC has (a) a one-factor structure, (b) convergent validity with internal health locus of control (IHLC), satisfaction with life (SWL), depression, and authenticity, (c) high internal consistency (α = 0.83), and (d) sensitivity to change, being able to identify moderate changes in PPC following clinic attendance (Cohen's d = 0.40). These properties suggest the English language PPC measure is a useful tool for both clinical genetics research and for use as a Patient Reported Outcome Measure (PROM) in service evaluation. Copyright © 2011 Wiley Periodicals, Inc.

The preanalytic phase in veterinary clinical pathology.

PubMed

Braun, Jean-Pierre; Bourgès-Abella, Nathalie; Geffré, Anne; Concordet, Didier; Trumel, Cathy

2015-03-01

This article presents the general causes of preanalytic variability with a few examples showing specialists and practitioners that special and improved care should be given to this too often neglected phase. The preanalytic phase of clinical pathology includes all the steps from specimen collection to analysis. It is the phase where most laboratory errors occur in human, and probably also in veterinary clinical pathology. Numerous causes may affect the validity of the results, including technical factors, such as the choice of anticoagulant, the blood vessel sampled, and the duration and conditions of specimen handling. While the latter factors can be defined, influence of biologic and physiologic factors such as feeding and fasting, stress, and biologic and endocrine rhythms can often not be controlled. Nevertheless, as many factors as possible should at least be documented. The importance of the preanalytic phase is often not given the necessary attention, although the validity of the results and consequent clinical decision making and medical management of animal patients would likely be improved if the quality of specimens submitted to the laboratory was optimized. © 2014 American Society for Veterinary Clinical Pathology.

Towards optimised information about clinical trials; identification and validation of key issues in collaboration with cancer patient advocates.

PubMed

Dellson, P; Nilbert, M; Bendahl, P-O; Malmström, P; Carlsson, C

2011-07-01

Clinical trials are crucial to improve cancer treatment but recruitment is difficult. Optimised patient information has been recognised as a key issue. In line with the increasing focus on patients' perspectives in health care, we aimed to study patients' opinions about the written information used in three clinical trials for breast cancer. Primary data collection was done in focus group interviews with breast cancer patient advocates. Content analysis identified three major themes: comprehensibility, emotions and associations, and decision making. Based on the advocates' suggestions for improvements, 21 key issues were defined and validated through a questionnaire in an independent group of breast cancer patient advocates. Clear messages, emotionally neutral expressions, careful descriptions of side effects, clear comparisons between different treatment alternatives and information about the possibility to discontinue treatment were perceived as the most important issues. Patients' views of the information in clinical trials provide new insights and identify key issues to consider in optimising future written information and may improve recruitment to clinical cancer trials. © 2010 Blackwell Publishing Ltd.

Adolescent Balloon Analog Risk Task and Behaviors that Influence Risk of Motor Vehicle Crash Injury

PubMed Central

Vaca, Federico E.; Walthall, Jessica M.; Ryan, Sheryl; Moriarty-Daley, Alison; Riera, Antonio; Crowley, Michael J.; Mayes, Linda C.

2013-01-01

Risk-taking propensity is a pivotal facet of motor vehicle crash involvement and subsequent traumatic injury in adolescents. Clinical encounters are important opportunities to identify teens with high risk-taking propensity who may later experience serious injury. Our objective was to compare self-reports of health risk behavior with performance on the Balloon Analog Risk Task (BART), a validated metric of risk-taking propensity, in adolescents during a clinical encounter. 100 adolescent patients from a hospital emergency department and adolescent health clinic completed a computer-based survey of self-reported risk behaviors including substance use behaviors and behaviors that influence crash involvement. They then completed the BART, a validated laboratory-based risk task in which participants earn points by pumping up a computer-generated balloon with greater pumps leading to increased chance of balloon explosion. 20 trials were undertaken. Mean number of pumps on the BART showed a correlation of .243 (p=.015) with self-reported driver/passenger behaviors and attitudes towards driving that influence risk of crash injury. Regression analyses showed that self-reports of substance use and mean number of pumps on the BART uniquely predict self-reports of behaviors influencing the risk of crash injury. The BART is a promising correlate of real-world risk-taking behavior related to traffic safety. It remains a valid predictor of behaviors influencing risk of crash injury when using just 10 trials, suggesting its utility as a quick and effective screening measure for use in busy clinical environments. This tool may be an important link to prevention interventions for those most at-risk for future motor vehicle crash involvement and injury. PMID:24406948

[Clinical practice guidelines (II): searching and critical evaluation].

PubMed

Alonso, P; Bonfill, X

2007-01-01

Clinical practice guidelines have unique characteristics of the Internet era in which they are starting to be increasingly popular. The fact that they are often elaborated by governmental agencies and are not published in conventional journals means that they may not be accessible using the usual search methods employed for other types of scientific studies and documents (clinical trials, reviews, etc.). The Internet has become an essential tool for locating clinical practice guidelines, and meta-search engines, specific databases, directories, and elaborating institutions are of special importance. The relative lack of indexing of clinical practice guides means that Medline and Embase are not as useful in this context as in searching for original studies. With the aim of evaluating the validity, reproducibility, and reliability of clinical practice guidelines, a series of European institutions designed a tool to evaluate clinical practice guidelines at the end of the 1990s. This instrument, named AGREE, aims to offer a framework for the evaluation of the quality of clinical practice guidelines. It can also be useful in the design of new clinical practice guidelines as well as in the evaluation of the validity of guidelines to be updated or adapted. The AGREE instrument has become the reference for those that use guidelines, those that elaborate them, and for healthcare providers.

Repeatability Evaluation of a Contrast Sensitivity System for Transfer to the Eye Clinic

NASA Astrophysics Data System (ADS)

Alcalde, N. G.; Castillo, L. R.; Filgueira, C. Paz; Colombo, E. M.

2016-04-01

The Contrast Sensitivity Function (CSF) is a valuable tool which can be used to characterize functional vision and also for the diagnosis and management of patients with different eye diseases. In spite of its usefulness, the CSF is currently hardly ever used in clinical practice. The aim of this study was to validate the use of the system called FVC-100 (Tecnovinc-UNT-CONICET, Argentina), which calculates the CSF, in order to transfer this important tool to ophthalmological clinics. The validation was carried out through the design of a repeatability test and the subsequent analysis of the results. Furthermore, we evaluated the impact of different factors influencing the repeatability of the measurements such as age and previous training. The tests were based on the discrimination of sinusoidal gratings for different spatial frequencies (1, 4 and 12 c/°) in both eyes of 12 people, aged between 20 and 70. The results show that the calculated values of SC of each subject have a high repeatability and are not dependent on age or training. These results allow us to conclude positively regarding the effectiveness of the FVC-100, and to validate its use in clinics for the calculation of the FSC as a standard measure of functional vision quality.

PCR-RFLP on β-tubulin gene for rapid identification of the most clinically important species of Aspergillus.

PubMed

Nasri, Tuba; Hedayati, Mohammad Taghi; Abastabar, Mahdi; Pasqualotto, Alessandro C; Armaki, Mojtaba Taghizadeh; Hoseinnejad, Akbar; Nabili, Mojtaba

2015-10-01

Aspergillus species are important agents of life-threatening infections in immunosuppressed patients. Proper speciation in the Aspergilli has been justified based on varied fungal virulence, clinical presentations, and antifungal resistance. Accurate identification of Aspergillus species usually relies on fungal DNA sequencing but this requires expensive equipment that is not available in most clinical laboratories. We developed and validated a discriminative low-cost PCR-based test to discriminate Aspergillus isolates at the species level. The Beta tubulin gene of various reference strains of Aspergillus species was amplified using the universal fungal primers Bt2a and Bt2b. The PCR products were subjected to digestion with a single restriction enzyme AlwI. All Aspergillus isolates were subjected to DNA sequencing for final species characterization. The PCR-RFLP test generated unique patterns for six clinically important Aspergillus species, including Aspergillus flavus, Aspergillus fumigatus, Aspergillus nidulans, Aspergillus terreus, Aspergillus clavatus and Aspergillus nidulans. The one-enzyme PCR-RFLP on Beta tubulin gene designed in this study is a low-cost tool for the reliable and rapid differentiation of the clinically important Aspergillus species. Copyright © 2015 Elsevier B.V. All rights reserved.

An empirical study of the predictive validity of number grades in medical school using 3 decades of longitudinal data: implications for a grading system.

PubMed

Gonnella, Joseph S; Erdmann, James B; Hojat, Mohammadreza

2004-04-01

Context It is important to establish the predictive validity of medical school grades. The strength of predictive validity and the ability to identify at-risk students in medical schools depends upon assessment systems such as number grades, pass/fail (P/F) or honours/pass/fail (H/P/F) systems. Objective This study was designed to examine the predictive validity of number grades in medical school, and to determine whether any important information is lost in a shift from number to P/F and H/P/F grading systems. Subjects The participants in this prospective, longitudinal study were 6656 medical students who studied at Jefferson Medical College over 3 decades. They were grouped into 10 deciles based on their number grades in Year 1 of medical school. Methods Participants were compared on academic accomplishments in Years 2 and 3 of medical school, medical school class rank, delayed graduation and attrition, performance on medical licensing examinations and clinical competence ratings in the first postgraduate year. Results Results supported the short- and longterm predictive validity of the number grades. Ratings of clinical competence beyond medical school were predicted by number grades in medical school. We demonstrated that small differences in number grades are statistically meaningful, and that important information for identifying students in need of remedial education is lost when students who narrowly meet faculty's expectations are included with the rest of the class in a broad 'pass' category. Conclusions The findings refute the argument that knowledge of sciences basic to medicine is not critical to subsequent performance in medical school and beyond if an appropriate evaluation system is used. Furthermore, the results of this study raise questions about abandoning number grades in favour of a pass/fail system. Consideration of these findings in policy decisions regarding assessment systems of medical students is recommended.

Confidence in outcome estimates from systematic reviews used in informed consent.

PubMed

Fritz, Robert; Bauer, Janet G; Spackman, Sue S; Bains, Amanjyot K; Jetton-Rangel, Jeanette

2016-12-01

Evidence-based dentistry now guides informed consent in which clinicians are obliged to provide patients with the most current, best evidence, or best estimates of outcomes, of regimens, therapies, treatments, procedures, materials, and equipment or devices when developing personal oral health care, treatment plans. Yet, clinicians require that the estimates provided from systematic reviews be verified to their validity, reliability, and contextualized as to performance competency so that clinicians may have confidence in explaining outcomes to patients in clinical practice. The purpose of this paper was to describe types of informed estimates from which clinicians may have confidence in their capacity to assist patients in competent decision-making, one of the most important concepts of informed consent. Using systematic review methodology, researchers provide clinicians with valid best estimates of outcomes regarding a subject of interest from best evidence. Best evidence is verified through critical appraisals using acceptable sampling methodology either by scoring instruments (Timmer analysis) or checklist (grade), a Cochrane Collaboration standard that allows transparency in open reviews. These valid best estimates are then tested for reliability using large databases. Finally, valid and reliable best estimates are assessed for meaning using quantification of margins and uncertainties. Through manufacturer and researcher specifications, quantification of margins and uncertainties develops a performance competency continuum by which valid, reliable best estimates may be contextualized for their performance competency: at a lowest margin performance competency (structural failure), high margin performance competency (estimated true value of success), or clinically determined critical values (clinical failure). Informed consent may be achieved when clinicians are confident of their ability to provide useful and accurate best estimates of outcomes regarding regimens, therapies, treatments, and equipment or devices to patients in their clinical practices and when developing personal, oral health care, treatment plans. Copyright © 2016 Elsevier Inc. All rights reserved.

Development and validation of response markers to predict survival and pleurodesis success in patients with malignant pleural effusion (PROMISE): a multicohort analysis.

PubMed

Psallidas, Ioannis; Kanellakis, Nikolaos I; Gerry, Stephen; Thézénas, Marie Laëtitia; Charles, Philip D; Samsonova, Anastasia; Schiller, Herbert B; Fischer, Roman; Asciak, Rachelle; Hallifax, Robert J; Mercer, Rachel; Dobson, Melissa; Dong, Tao; Pavord, Ian D; Collins, Gary S; Kessler, Benedikt M; Pass, Harvey I; Maskell, Nick; Stathopoulos, Georgios T; Rahman, Najib M

2018-06-13

The prevalence of malignant pleural effusion is increasing worldwide, but prognostic biomarkers to plan treatment and to understand the underlying mechanisms of disease progression remain unidentified. The PROMISE study was designed with the objectives to discover, validate, and prospectively assess biomarkers of survival and pleurodesis response in malignant pleural effusion and build a score that predicts survival. In this multicohort study, we used five separate and independent datasets from randomised controlled trials to investigate potential biomarkers of survival and pleurodesis. Mass spectrometry-based discovery was used to investigate pleural fluid samples for differential protein expression in patients from the discovery group with different survival and pleurodesis outcomes. Clinical, radiological, and biological variables were entered into least absolute shrinkage and selection operator regression to build a model that predicts 3-month mortality. We evaluated the model using internal and external validation. 17 biomarker candidates of survival and seven of pleurodesis were identified in the discovery dataset. Three independent datasets (n=502) were used for biomarker validation. All pleurodesis biomarkers failed, and gelsolin, macrophage migration inhibitory factor, versican, and tissue inhibitor of metalloproteinases 1 (TIMP1) emerged as accurate predictors of survival. Eight variables (haemoglobin, C-reactive protein, white blood cell count, Eastern Cooperative Oncology Group performance status, cancer type, pleural fluid TIMP1 concentrations, and previous chemotherapy or radiotherapy) were validated and used to develop a survival score. Internal validation with bootstrap resampling and external validation with 162 patients from two independent datasets showed good discrimination (C statistic values of 0·78 [95% CI 0·72-0·83] for internal validation and 0·89 [0·84-0·93] for external validation of the clinical PROMISE score). To our knowledge, the PROMISE score is the first prospectively validated prognostic model for malignant pleural effusion that combines biological and clinical parameters to accurately estimate 3-month mortality. It is a robust, clinically relevant prognostic score that can be applied immediately, provide important information on patient prognosis, and guide the selection of appropriate management strategies. European Respiratory Society, Medical Research Funding-University of Oxford, Slater & Gordon Research Fund, and Oxfordshire Health Services Research Committee Research Grants. Copyright © 2018 Elsevier Ltd. All rights reserved.

Resampling procedures to identify important SNPs using a consensus approach.

PubMed

Pardy, Christopher; Motyer, Allan; Wilson, Susan

2011-11-29

Our goal is to identify common single-nucleotide polymorphisms (SNPs) (minor allele frequency > 1%) that add predictive accuracy above that gained by knowledge of easily measured clinical variables. We take an algorithmic approach to predict each phenotypic variable using a combination of phenotypic and genotypic predictors. We perform our procedure on the first simulated replicate and then validate against the others. Our procedure performs well when predicting Q1 but is less successful for the other outcomes. We use resampling procedures where possible to guard against false positives and to improve generalizability. The approach is based on finding a consensus regarding important SNPs by applying random forests and the least absolute shrinkage and selection operator (LASSO) on multiple subsamples. Random forests are used first to discard unimportant predictors, narrowing our focus to roughly 100 important SNPs. A cross-validation LASSO is then used to further select variables. We combine these procedures to guarantee that cross-validation can be used to choose a shrinkage parameter for the LASSO. If the clinical variables were unavailable, this prefiltering step would be essential. We perform the SNP-based analyses simultaneously rather than one at a time to estimate SNP effects in the presence of other causal variants. We analyzed the first simulated replicate of Genetic Analysis Workshop 17 without knowledge of the true model. Post-conference knowledge of the simulation parameters allowed us to investigate the limitations of our approach. We found that many of the false positives we identified were substantially correlated with genuine causal SNPs.

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

PubMed

Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

2009-01-01

Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content validity of a PRO instrument for an intended application is often limited. Such evidence is, however, important to evaluating the adequacy of a PRO instrument for the intended application. This article provides an overview of key issues involved in assessing and documenting content validity as it relates to using existing instruments in the drug approval process.

Drug-resistant tuberculosis clinical trials: proposed core research definitions in adults.

PubMed

Furin, J; Alirol, E; Allen, E; Fielding, K; Merle, C; Abubakar, I; Andersen, J; Davies, G; Dheda, K; Diacon, A; Dooley, K E; Dravnice, G; Eisenach, K; Everitt, D; Ferstenberg, D; Goolam-Mahomed, A; Grobusch, M P; Gupta, R; Harausz, E; Harrington, M; Horsburgh, C R; Lienhardt, C; McNeeley, D; Mitnick, C D; Nachman, S; Nahid, P; Nunn, A J; Phillips, P; Rodriguez, C; Shah, S; Wells, C; Thomas-Nyang'wa, B; du Cros, P

2016-03-01

Drug-resistant tuberculosis (DR-TB) is a growing public health problem, and for the first time in decades, new drugs for the treatment of this disease have been developed. These new drugs have prompted strengthened efforts in DR-TB clinical trials research, and there are now multiple ongoing and planned DR-TB clinical trials. To facilitate comparability and maximise policy impact, a common set of core research definitions is needed, and this paper presents a core set of efficacy and safety definitions as well as other important considerations in DR-TB clinical trials work. To elaborate these definitions, a search of clinical trials registries, published manuscripts and conference proceedings was undertaken to identify groups conducting trials of new regimens for the treatment of DR-TB. Individuals from these groups developed the core set of definitions presented here. Further work is needed to validate and assess the utility of these definitions but they represent an important first step to ensure there is comparability in clinical trials on multidrug-resistant TB.

Preliminary identification of key clinical domains for outcome evaluation in fibromyalgia using the Delphi method: the Italian experience.

PubMed

Salaffi, F; Ciapetti, A; Sarzi Puttini, P; Atzeni, F; Iannuccelli, C; Di Franco, M; Cazzola, M; Bazzichi, L

2012-03-19

Fibromyalgia (FM) is a complex syndrome that, in Italy, affects at least 2% of the adult population. It is characterized by chronic widespread musculoskeletal pain often accompanied by multiple other symptoms. The aim of this study was to identify a set of clinical domains for FM considered relevant by both clinicians and patients using a consensus process. Consensus was achieved using the Delphi method based on questionnaires and systematic, controlled opinion feedback. The Delphi exercise involved a panel of 252 rheumatologists and 86 patients with FM as defined by the American College of Rheumatology criteria. All of the patients and clinicians were asked to rank the relative different domains of FM in order of priority. The content validity index (CVI) was used to establish the percentage agreement. The importance of each item was ranked on a 0-3 Likert scale. The frequency, mean relevance scores, and frequency importance product were also calculated. The Delphi exercise showed that the domains ranked highest by patients were similar to those of the clinicians, with the exception of tender point intensity (considered relevant by the clinicians but not by the patients) and environmental sensitivity (considered important by the patients but not by the clinicians). A final 8-item model was developed which was considered to demonstrate adequate validity. The Delphi exercises identified and ranked relevant key clinical domains that need to be assessed in FM research. On the basis of these results, a new patient-reported composite outcome index can be developed and used in clinical trials.

Reply to "Further issues in determining the readability of self-report items: comment on McHugh and Behar (2009)".

PubMed

McHugh, R Kathryn; Behar, Evelyn

2012-12-01

In his commentary on our previously published article "Readability of Self-Report Measures of Depression and Anxiety," J. Schinka (2012) argued for the importance of considering readability of patient materials and highlighted limitations of existing methodologies for this assessment. Schinka's commentary articulately described the weaknesses of readability assessment and emphasized the importance of the development of improved strategies for assessing readability to maximize the validity of self-report measures in applied settings. In our reply, we support and extend Schinka's argument, highlighting the importance of consideration of the range of factors (e.g., use of reverse-scored items) that may increase respondent difficulty with comprehension. Consideration of the readability of self-report symptom measures is critical to the validity of these measures in both clinical practice and research settings.

[Treatment regulations and treatment limits: factors influencing clinical decision-making].

PubMed

Baberg, H T; Kielstein, R; de Zeeuw, J; Sass, H-M

2002-08-02

Providing or withholding of treatment is based on a variety of factors. We sought for criteria in clinical decision making and reviewed attitudes towards clinical intuition and the patient's will. 503 physicians (25.6 % females; mean age 36.3) in 49 departments at nine hospitals of the universities Bochum and Magdeburg filled in a validated questionnaire. The most important factors in the decision to carry out a therapy were "international standards" and "own experience". The decision to omit a therapy was mainly influenced by the "patient's wish". Physicians with a higher status judged their own experience higher than young physicians, who considered the experience of colleagues more important. "Severe accompanying illnesses" and "multimorbidity" were the most frequently named reasons to withdraw a therapy. Intuitive decision-making was rare, especially in young physicians, although these decisions were seldom risky and often successful. A patient's will plays a prominent role in clinical decision making, especially in decisions to withdraw or to withhold treatment. Cost containment and research interest have been called less important, a remarkable response from research-based university hospitals. Also remarkable is the recognition and importance of clinical intuition in situations of complex or missing information. This important aspect is rarely discussed in the literature or in medical education. The widely voiced concern that priorities in clinical care are guided by scientific interest, financial or technical possibilities could not be confirmed.

Using Chinese Version of MYMOP in Chinese Medicine Evaluation: Validity, Responsiveness and Minimally Important Change

PubMed Central

2010-01-01

Background Measure Yourself Medical Outcome Profile (MYMOP) is a patient generated outcome instrument applicable in the evaluation of both allopathic and complementary medicine treatment. This study aims to adapt MYMOP into Chinese, and to assess its validity, responsiveness and minimally important change values in a sample of patients using Chinese medicine (CM) services. Methods A Chinese version of MYMOP (CMYMOP) is developed by forward-backward-forward translation strategy, expert panel assessment and pilot testing amongst patients. 272 patients aged 18 or above with subjective symptoms in the past 2 weeks were recruited at a CM clinic, and were invited to complete a set of questionnaire containing CMYMOP and SF-36. Follow ups were performed at 2nd and 4th week after consultation, using the same set of questionnaire plus a global rating of change question. Criterion validity of CMYMOP was assessed by its correlation with SF-36 at baseline, and responsiveness was evaluated by calculating the Cohen effect size (ES) of change at two follow ups. Minimally important difference (MID) values were estimated via anchor based method, while minimally detectable difference (MDC) figures were calculated by distribution based method. Results Criterion validity of CMYMOP was demonstrated by negative correlation between CMYMOP Profile scores and all SF-36 domain and summary scores at baseline. For responsiveness between baseline and 4th week follow up, ES of CMYMOP Symptom 1, Activity and Profile reached the moderate change threshold (ES>0.5), while Symptom 2 and Wellbeing reached the weak change threshold (ES>0.2). None of the SF-36 scores reached the moderate change threshold, implying CMYMOP's stronger responsiveness in CM setting. At 2nd week follow up, MID values for Symptom 1, Symptom 2, Wellbeing and Profile items were 0.894, 0.580, 0.263 and 0.516 respectively. For Activity item, MDC figure of 0.808 was adopted to estimate MID. Conclusions The findings support the validity and responsiveness of CMYMOP for capturing patient centred clinical changes within 2 weeks in a CM clinical setting. Further researches are warranted (1) to estimate Activity item MID, (2) to assess the test-retest reliability of CMYMOP, and (3) to perform further MID evaluation using multiple, item specific anchor questions. PMID:20920284

Evaluation of the Seeplex® Meningitis ACE Detection kit for the detection of 12 common bacterial and viral pathogens of acute meningitis.

PubMed

Shin, So Youn; Kwon, Kye Chul; Park, Jong Woo; Kim, Ji Myung; Shin, So Young; Koo, Sun Hoe

2012-01-01

Bacterial meningitis is an infectious disease with high rates of mortality and high frequency of severe sequelae. Early identification of causative bacterial and viral pathogens is important for prompt and proper treatment of meningitis and for prevention of life-threatening clinical outcomes. In the present study, we evaluated the value of the Seeplex Meningitis ACE Detection kit (Seegene Inc., Korea), a newly developed multiplex PCR kit employing dual priming oligonucleotide methods, for diagnosing acute meningitis. Analytical sensitivity of the kit was studied using reference strains for each pathogen targeted by the kit, while it's analytical specificity was studied using the human genome DNA and 58 clinically well-identified reference strains. For clinical validation experiment, we used 27 control cerebrospinal fluid (CSF) samples and 78 clinical CSF samples collected from patients at the time of diagnosis of acute meningitis. The lower detection limits ranged from 10(1) copies/µL to 5×10(1) copies/µL for the 12 viral and bacterial pathogens targeted. No cross-reaction was observed. In the validation study, high detection rate of 56.4% was obtained. None of the control samples tested positive, i.e., false-positive results were absent. The Seeplex Meningitis ACE Detection kit showed high sensitivity, specificity, and detection rate for the identification of pathogens in clinical CSF samples. This kit may be useful for rapid identification of important acute meningitis-causing pathogens.

Evaluation of the Seeplex® Meningitis ACE Detection Kit for the Detection of 12 Common Bacterial and Viral Pathogens of Acute Meningitis

PubMed Central

Shin, So Youn; Kwon, Kye Chul; Park, Jong Woo; Kim, Ji Myung; Shin, So Young

2012-01-01

Background Bacterial meningitis is an infectious disease with high rates of mortality and high frequency of severe sequelae. Early identification of causative bacterial and viral pathogens is important for prompt and proper treatment of meningitis and for prevention of life-threatening clinical outcomes. In the present study, we evaluated the value of the Seeplex Meningitis ACE Detection kit (Seegene Inc., Korea), a newly developed multiplex PCR kit employing dual priming oligonucleotide methods, for diagnosing acute meningitis. Methods Analytical sensitivity of the kit was studied using reference strains for each pathogen targeted by the kit, while it's analytical specificity was studied using the human genome DNA and 58 clinically well-identified reference strains. For clinical validation experiment, we used 27 control cerebrospinal fluid (CSF) samples and 78 clinical CSF samples collected from patients at the time of diagnosis of acute meningitis. Results The lower detection limits ranged from 101 copies/µL to 5×101 copies/µL for the 12 viral and bacterial pathogens targeted. No cross-reaction was observed. In the validation study, high detection rate of 56.4% was obtained. None of the control samples tested positive, i.e., false-positive results were absent. Conclusions The Seeplex Meningitis ACE Detection kit showed high sensitivity, specificity, and detection rate for the identification of pathogens in clinical CSF samples. This kit may be useful for rapid identification of important acute meningitis-causing pathogens. PMID:22259778

A case of Munchausen syndrome with claims of trauma and haemophilia.

PubMed Central

Park, G; Huang, A; Wright, S

1996-01-01

A case of Munchausen syndrome presented with both factitious trauma and factitious haemophilia. He was treated inappropriately with factor VIII concentrate before the history of the presenting complaint could be validated. Clinical suspicion remains the most important aid to diagnosis. Images Figure 1 PMID:8832359

Measuring Maternal Behaviors in the Neonatal Intensive Care Unit

ERIC Educational Resources Information Center

Lakes, Kimberley D.; Guo, Yuqing; Taylor Lucas, Candice; Cooper, Dan

2017-01-01

One of the most important considerations in designing clinical infant research studies is the selection of reliable and valid measurement procedures. Few measures of caregiver-child interactions have been studied with newborns, particularly premature infants. The main objective of this study was to examine psychometric properties of the National…

EG-09EPIGENETIC PROFILING REVEALS A CpG HYPERMETHYLATION PHENOTYPE (CIMP) ASSOCIATED WITH WORSE PROGRESSION-FREE SURVIVAL IN MENINGIOMA

PubMed Central

Olar, Adriana; Wani, Khalida; Mansouri, Alireza; Zadeh, Gelareh; Wilson, Charmaine; DeMonte, Franco; Fuller, Gregory; Jones, David; Pfister, Stefan; von Deimling, Andreas; Sulman, Erik; Aldape, Kenneth

2014-01-01

BACKGROUND: Methylation profiling of solid tumors has revealed biologic subtypes, often with clinical implications. Methylation profiles of meningioma and their clinical implications are not well understood. METHODS: Ninety-two meningioma samples (n = 44 test set and n = 48 validation set) were profiled using the Illumina HumanMethylation450 BeadChip. Unsupervised clustering and analyses for recurrence-free survival (RFS) were performed. RESULTS: Unsupervised clustering of the test set using approximately 900 highly variable markers identified two clearly defined methylation subgroups. One of the groups (n = 19) showed global hypermethylation of a set of markers, analogous to CpG island methylator phenotype (CIMP). These findings were reproducible in the validation set, with 18/48 samples showing the CIMP-positive phenotype. Importantly, of 347 highly variable markers common to both the test and validation set analyses, 107 defined CIMP in the test set and 94 defined CIMP in the validation set, with an overlap of 83 markers between the two datasets. This number is much greater than expected by chance indicating reproducibly of the hypermethylated markers that define CIMP in meningioma. With respect to clinical correlation, the 37 CIMP-positive cases displayed significantly shorter RFS compared to the 55 non-CIMP cases (hazard ratio 2.9, p = 0.013). In an effort to develop a preliminary outcome predictor, a 155-marker subset correlated with RFS was identified in the test dataset. When interrogated in the validation dataset, this 155-marker subset showed a statistical trend (p < 0.1) towards distinguishing survival groups. CONCLUSIONS: This study defines the existence of a CIMP phenotype in meningioma, which involves a substantial proportion (37/92, 40%) of samples with clinical implications. Ongoing work will expand this cohort and examine identification of additional biologic differences (mutational and DNA copy number analysis) to further characterize the aberrant methylation subtype in meningioma. CIMP-positivity with aberrant methylation in recurrent/malignant meningioma suggests a potential therapeutic target for clinically aggressive cases.

Development, validity and responsiveness of the Clinical COPD Questionnaire.

PubMed

van der Molen, Thys; Willemse, Brigitte W M; Schokker, Siebrig; ten Hacken, Nick H T; Postma, Dirkje S; Juniper, Elizabeth F

2003-04-28

The new Global Obstructive Lung Disease (GOLD) guidelines advice to focus treatment in Chronic Obstructive Pulmonary Disease (COPD) on improvement of functional state, prevention of disease progression and minimization of symptoms. So far no validated questionnaires are available to measure symptom and functional state in daily clinical practice. The aim of this study was to develop and validate the Clinical COPD Questionnaire (CCQ). Qualitative research with patients and clinicians was performed to generate possible items to evaluate clinical COPD control. Thereafter, an item reduction questionnaire was sent to 77 international experts. Sixty-seven experts responded and the 10 most important items, divided into 3 domains (symptoms, functional and mental state) were included in the CCQ (scale: 0 = best, 6 = worst). Cross-sectional data were collected from 119 subjects (57 COPD, GOLD stage I-III; 18 GOLD stage 0 and 44 (ex)smokers). Cronbach's alpha was high (0.91). The CCQ scores in patients (GOLD 0-III) were significantly higher than in healthy (ex)smokers. Furthermore, significant correlations were found between the CCQ total score and domains of the SF-36 (rho = 0.48 to rho = 0.69) and the SGRQ (rho = 0.67 to rho = 0.72). In patients with COPD, the correlation between the CCQ and FEV1%pred was rho =-0.49. Test-retest reliability was determined in 20 subjects in a 2-week interval (Intra Class Coefficient = 0.94). Thirty-six smokers with and without COPD showed significant improvement in the CCQ after 2 months smoking cessation, indicating the responsiveness of the CCQ. The CCQ is a self-administered questionnaire specially developed to measure clinical control in patients with COPD. Data support the validity, reliability and responsiveness of this short and easy to administer questionnaire.

Development, validity and responsiveness of the Clinical COPD Questionnaire

PubMed Central

van der Molen, Thys; Willemse, Brigitte WM; Schokker, Siebrig; ten Hacken, Nick HT; Postma, Dirkje S; Juniper, Elizabeth F

2003-01-01

Background The new Global Obstructive Lung Disease (GOLD) guidelines advice to focus treatment in Chronic Obstructive Pulmonary Disease (COPD) on improvement of functional state, prevention of disease progression and minimization of symptoms. So far no validated questionnaires are available to measure symptom and functional state in daily clinical practice. The aim of this study was to develop and validate the Clinical COPD Questionnaire (CCQ). Methods Qualitative research with patients and clinicians was performed to generate possible items to evaluate clinical COPD control. Thereafter, an item reduction questionnaire was sent to 77 international experts. Sixty-seven experts responded and the 10 most important items, divided into 3 domains (symptoms, functional and mental state) were included in the CCQ (scale: 0 = best, 6 = worst). Results Cross-sectional data were collected from 119 subjects (57 COPD, GOLD stage I-III; 18 GOLD stage 0 and 44 (ex)smokers). Cronbach's α was high (0.91). The CCQ scores in patients (GOLD 0-III) were significantly higher than in healthy (ex)smokers. Furthermore, significant correlations were found between the CCQ total score and domains of the SF-36 (ρ = 0.48 to ρ = 0.69) and the SGRQ (ρ = 0.67 to ρ = 0.72). In patients with COPD, the correlation between the CCQ and FEV1%pred was ρ =-0.49. Test-retest reliability was determined in 20 subjects in a 2-week interval (Intra Class Coefficient = 0.94). Thirty-six smokers with and without COPD showed significant improvement in the CCQ after 2 months smoking cessation, indicating the responsiveness of the CCQ. Conclusion The CCQ is a self-administered questionnaire specially developed to measure clinical control in patients with COPD. Data support the validity, reliability and responsiveness of this short and easy to administer questionnaire. PMID:12773199

Validation of an instrument to measure inter-organisational linkages in general practice.

PubMed

Amoroso, Cheryl; Proudfoot, Judith; Bubner, Tanya; Jayasinghe, Upali W; Holton, Christine; Winstanley, Julie; Beilby, Justin; Harris, Mark F

2007-12-03

Linkages between general medical practices and external services are important for high quality chronic disease care. The purpose of this research is to describe the development, evaluation and use of a brief tool that measures the comprehensiveness and quality of a general practice's linkages with external providers for the management of patients with chronic disease. In this study, clinical linkages are defined as the communication, support, and referral arrangements between services for the care and assistance of patients with chronic disease. An interview to measure surgery-level (rather than individual clinician-level) clinical linkages was developed, piloted, reviewed, and evaluated with 97 Australian general practices. Two validated survey instruments were posted to patients, and a survey of locally available services was developed and posted to participating Divisions of General Practice (support organisations). Hypotheses regarding internal validity, association with local services, and patient satisfaction were tested using factor analysis, logistic regression and multilevel regression models. The resulting General Practice Clinical Linkages Interview (GP-CLI) is a nine-item tool with three underlying factors: referral and advice linkages, shared care and care planning linkages, and community access and awareness linkages. Local availability of chronic disease services has no affect on the comprehensiveness of services with which practices link, however, comprehensiveness of clinical linkages has an association with patient assessment of access, receptionist services, and of continuity of care in their general practice. The GP-CLI may be useful to researchers examining comparable health care systems for measuring the comprehensiveness and quality of linkages at a general practice-level with related services, possessing both internal and external validity. The tool can be used with large samples exploring the impact, outcomes, and facilitators of high quality clinical linkages in general practice.

The Teamwork Mini-Clinical Evaluation Exercise (T-MEX): a workplace-based assessment focusing on collaborative competencies in health care.

PubMed

Olupeliyawa, Asela M; O'Sullivan, Anthony J; Hughes, Chris; Balasooriya, Chinthaka D

2014-02-01

Teamwork is an important and challenging area of learning during the transition from medical graduate to intern. This preliminary investigation examined the psychometric and logistic properties of the Teamwork Mini-Clinical Evaluation Exercise (T-MEX) for the workplace-based assessment of key competencies in working with health care teams. The authors designed the T-MEX for direct observation and assessment of six collaborative behaviors in seven clinical situations important for teamwork, feedback, and reflection. In 2010, they tested it on University of New South Wales senior medical students during their last six-week clinical term to investigate its overall utility, including validity and reliability. Assessors rated students in different situations on the extent to which they met expectations for interns for each collaborative behavior. Both assessors and students rated the tool's usefulness and feasibility. Assessment forms for 88 observed encounters were submitted by 25 students. The T-MEX was suited to a broad range of collaborative clinical practice situations, as evidenced by the encounter types and the behaviors assessed by health care team members. The internal structure of the behavior ratings indicated construct validity. A generalizability study found that eight encounters were adequate for high-stakes measurement purposes. The mean times for observation and feedback and the participants' perceptions suggested usefulness for feedback and feasibility in busy clinical settings. Findings suggest that the T-MEX has good utility for assessing trainee competence in working with health care teams. It fills a gap within the suite of existing tools for workplace-based assessment of professional attributes.

Diagnosis of borderline personality disorder in China: current status and future directions.

PubMed

Zhong, Jie; Leung, Freedom

2009-02-01

This paper reviews the current status and future directions of borderline personality disorder (BPD) research in China. Although the committee of the third version of the Chinese Classification of Mental Disorders (CCMD-3) rejected BPD as a valid diagnostic category and instead adopted the term impulsive personality disorder (IPD), our literature review on personality disorders from 1979 to 2008 in China indicated that BPD was the most popular research topic among researchers and clinicians. Available empiric evidence on BPD in China provided preliminary support for the construct validity and clinical utility of BPD in clinical and nonclinical Chinese samples. Future studies in the following areas are suggested: 1) developing reliable assessment instruments for measuring BPD pathology in China, 2) comparing the construct validity and phenomenology of CCMD IPD and DSM BPD among Chinese patients, 3) examining potential cultural differences in symptom expression of BPD pathology among the Chinese, and 4) exploring indigenous and imported methods for treating BPD patients in China.

Standards for testing and clinical validation of seizure detection devices.

PubMed

Beniczky, Sándor; Ryvlin, Philippe

2018-06-01

To increase the quality of studies on seizure detection devices, we propose standards for testing and clinical validation of such devices. We identified 4 key features that are important for studies on seizure detection devices: subjects, recordings, data analysis and alarms, and reference standard. For each of these features, we list the specific aspects that need to be addressed in the studies, and depending on these, studies are classified into 5 phases (0-4). We propose a set of outcome measures that need to be reported, and we propose standards for reporting the results. These standards will help in designing and reporting studies on seizure detection devices, they will give readers clear information on the level of evidence provided by the studies, and they will help regulatory bodies in assessing the quality of the validation studies. These standards are flexible, allowing classification of the studies into one of the 5 phases. We propose actions that can facilitate development of novel methods and devices. Wiley Periodicals, Inc. © 2018 International League Against Epilepsy.

Development and Initial Validation of the Caregiver Perceptions About Communication With Clinical Team Members (CAPACITY) Measure.

PubMed

Van Houtven, Courtney Harold; Miller, Katherine E M; O'Brien, Emily C; Wolff, Jennifer L; Lindquist, Jennifer; Kabat, Margaret; Campbell-Kotler, Margaret; Henius, Jennifer; Voils, Corrine I

2017-12-01

Despite the important role that family caregivers play managing the care of persons with complex health needs, little is known about how caregivers perceive themselves to be recognized and valued by health care professionals. Our objective was to develop and validate a novel measure, the CAregiver Perceptions About Commun Ication with Clinical Team members (CAPACITY) instrument. Questions focus on perceived quality of communication with the health care team and the extent to which caregivers believe that the health care team considers their capacity and preferences in decision making. A confirmatory factor analysis supported a two-factor solution addressing communication and capacity. Internal consistency reliability was .90 for the communication domain and .93 for the capacity domain. Correlations between these two subscales and individual difference measures provided evidence of convergent and discriminant validity. The CAPACITY instrument may be a useful performance measure that quantifies the extent to which caregivers' experience person- and family-centered health care.

Development and Validation of the Sleep Inertia Questionnaire (SIQ) and Assessment of Sleep Inertia in Analogue and Clinical Depression

PubMed Central

Kanady, Jennifer C.; Harvey, Allison G.

2015-01-01

Sleep inertia is the transitional state from sleep to wake. Research on sleep inertia is important in depression because many people with depression report having difficulty getting out of bed, which contributes to impairment and can impede the implementation of interventions. The first aim was to develop and validate the first self-report measure of sleep inertia, the Sleep Inertia Questionnaire (SIQ). The second aim was to compare reports of sleep inertia across three groups: (1) No-to-Mild-Depression, (2) Analogue-Depression, and (3) Syndromal-Depression. The SIQ demonstrates strong psychometric properties; it has good to excellent internal consistency, strong construct validity, and SIQ severity is associated with less prior sleep duration. Sleep inertia is more severe in the Analogue-Depression and Syndromal-Depression groups compared to the No-to-Mild-Depression group. In conclusion, the SIQ is a reliable measure of sleep inertia and has potential for improving the assessment of sleep inertia in clinical and research settings. PMID:26451063

Development and Validation of the Sleep Inertia Questionnaire (SIQ) and Assessment of Sleep Inertia in Analogue and Clinical Depression.

PubMed

Kanady, Jennifer C; Harvey, Allison G

2015-10-01

Sleep inertia is the transitional state from sleep to wake. Research on sleep inertia is important in depression because many people with depression report having difficulty getting out of bed, which contributes to impairment and can impede the implementation of interventions. The first aim was to develop and validate the first self-report measure of sleep inertia, the Sleep Inertia Questionnaire (SIQ). The second aim was to compare reports of sleep inertia across three groups: (1) No-to-Mild-Depression, (2) Analogue-Depression, and (3) Syndromal-Depression. The SIQ demonstrates strong psychometric properties; it has good to excellent internal consistency, strong construct validity, and SIQ severity is associated with less prior sleep duration. Sleep inertia is more severe in the Analogue-Depression and Syndromal-Depression groups compared to the No-to-Mild-Depression group. In conclusion, the SIQ is a reliable measure of sleep inertia and has potential for improving the assessment of sleep inertia in clinical and research settings.

Educating psychotherapy supervisors.

PubMed

Watkins, C Edward

2012-01-01

What do we know clinically and empirically about the education of psychotherapy supervisors? In this paper, I attempt to address that question by: (1) reviewing briefly current thinking about psychotherapy supervisor training; and (2) examining the available research where supervisor training and supervision have been studied. The importance of such matters as training format and methods, supervision topics for study, supervisor development, and supervisor competencies are considered, and some prototypical, competency-based supervisor training programs that hold educational promise are identified and described. Twenty supervisor training studies are critiqued, and their implications for practice and research are examined. Based on this review of training programs and research, the following conclusions are drawn: (1) the clinical validity of supervisor education appears to be strong, solid, and sound, (2) although research suggests that supervisor training can have value in stimulating the development of supervisor trainees and better preparing them for the supervisory role, any such base of empirical support or validity should be regarded as tentative at best; and (3) the most formidable challenge for psychotherapy supervisor education may well be correcting the imbalance that currently exists between clinical and empirical validity and "raising the bar" on the rigor, relevance, and replicability of future supervisor training research.

Reconceptualising the external validity of discrete choice experiments.

PubMed

Lancsar, Emily; Swait, Joffre

2014-10-01

External validity is a crucial but under-researched topic when considering using discrete choice experiment (DCE) results to inform decision making in clinical, commercial or policy contexts. We present the theory and tests traditionally used to explore external validity that focus on a comparison of final outcomes and review how this traditional definition has been empirically tested in health economics and other sectors (such as transport, environment and marketing) in which DCE methods are applied. While an important component, we argue that the investigation of external validity should be much broader than a comparison of final outcomes. In doing so, we introduce a new and more comprehensive conceptualisation of external validity, closely linked to process validity, that moves us from the simple characterisation of a model as being or not being externally valid on the basis of predictive performance, to the concept that external validity should be an objective pursued from the initial conceptualisation and design of any DCE. We discuss how such a broader definition of external validity can be fruitfully used and suggest innovative ways in which it can be explored in practice.

The clinical learning environment and supervision by staff nurses: developing the instrument.

PubMed

Saarikoski, Mikko; Leino-Kilpi, Helena

2002-03-01

The aims of this study were (1) to describe students' perceptions of the clinical learning environment and clinical supervision and (2) to develop an evaluation scale by using the empirical results of this study. The data were collected using the Clinical Learning Environment and Supervision instrument (CLES). The instrument was based on the literature review of earlier studies. The derived instrument was tested empirically in a study involving nurse students (N=416) from four nursing colleges in Finland. The results demonstrated that the method of supervision, the number of separate supervision sessions and the psychological content of supervisory contact within a positive ward atmosphere are the most important variables in the students' clinical learning. The results also suggest that ward managers can create the conditions of a positive ward culture and a positive attitude towards students and their learning needs. The construct validity of the instrument was analysed by using exploratory factor analysis. The analysis indicated that the most important factor in the students' clinical learning is the supervisory relationship. The two most important factors constituting a 'good' clinical learning environment are the management style of the ward manager and the premises of nursing on the ward. The results of the factor analysis support the theoretical construction of the clinical learning environment modelled by earlier empirical studies.

The development and validation of a questionnaire for rotator cuff disorders: The Functional Shoulder Score

PubMed Central

Ibrahim, Edward F; Petrou, Charalambos; Galanos, Antonis

2015-01-01

Background The purpose of the present study was to validate the Functional Shoulder Score (FSS), a new patient-reported outcome score specifically designed to evaluate patients with rotator cuff disorders. Methods One hundred and nineteen patients were assessed using two shoulder scoring systems [the FSS and the Constant–Murley Score (CMS)] at 3 weeks pre- and 6 months post-arthroscopic rotator cuff surgery. The reliability, validity, responsiveness and interpretability of the FSS were evaluated. Results Reliability analysis (test–retest) showed an intraclass correlation coefficient value of 0.96 [95% confidence interval (CI) = 0.92 to 0.98]. Internal consistency analysis revealed a Cronbach's alpha coefficient of 0.93. The Pearson correlation coefficient FSS-CMS was 0.782 pre-operatively and 0.737 postoperatively (p < 0.0005). There was a statistically significant increase in FSS scores postoperatively, an effect size of 3.06 and standardized response mean of 2.80. The value for minimal detectable change was ±8.38 scale points (based on a 90% CI) and the minimal clinically important difference for improvement was 24.7 ± 5.4 points. Conclusions The FSS is a patient-reported outcome measure that can easily be incorporated into clinical practice, providing a quick, reliable, valid and practical measure for rotator cuff problems. The questionnaire is highly sensitive to clinical change. PMID:27582986

Borderline personality disorder subscale (Chinese version) of the structured clinical interview for DSM-IV axis II personality disorders: a validation study in Cantonese-speaking Hong Kong Chinese.

PubMed

Wong, H M; Chow, L Y

2011-06-01

Borderline personality disorder is an important but under-recognised clinical entity, for which there are only a few available diagnostic instruments in the Chinese language. None has been tested for its psychometric properties in the Cantonese-speaking population in Hong Kong. The present study aimed to assess the validity of the Chinese version of the Borderline Personality Disorder subscale of the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders Axis II Personality Disorders (SCID-II) in Cantonese-speaking Hong Kong Chinese. A convenience sampling method was used. The subjects were seen by a multidisciplinary clinical team, who arrived at a best-estimate diagnosis and then by application of the SCID-II rater using the Chinese version of the Borderline Personality Disorder subscale. The study was carried out at the psychiatric clinic of the Prince of Wales Hospital in Hong Kong. A total of 87 patients of Chinese ethnicity aged 18 to 64 years who attended the clinic in April 2007 were recruited. The aforementioned patient parameters were used to examine the internal consistency, best-estimate clinical diagnosis-SCID diagnosis agreement, sensitivity, and specificity of the Chinese version of the subscale. The Borderline Personality Disorder subscale (Chinese version) of SCID-II had an internal consistency of 0.82 (Cronbach's alpha coefficient), best-estimate clinical diagnosis-SCID diagnosis agreement of 0.82 (kappa), sensitivity of 0.92, and specificity of 0.94. The Borderline Personality Disorder subscale (Chinese version) of the SCID-II rater had reasonable validity when applied to Cantonese-speaking Chinese subjects in Hong Kong.

Validity assessment and the neurological physical examination.

PubMed

Zasler, Nathan D

2015-01-01

The assessment of any patient or examinee with neurological impairment, whether acquired or congenital, provides a key set of data points in the context of developing accurate diagnostic impressions and implementing an appropriate neurorehabilitation program. As part of that assessment, the neurological physical exam is an extremely important component of the overall neurological assessment. In the aforementioned context, clinicians often are confounded by unusual, atypical or unexplainable physical exam findings that bring into question the organicity, veracity, and/or underlying cause of the observed clinical presentation. The purpose of this review is to provide readers with general directions and specific caveats regarding validity assessment in the context of the neurological physical exam. It is of utmost importance for health care practitioners to be aware of assessment methodologies that may assist in determining the validity of the neurological physical exam and differentiating organic from non-organic/functional impairments. Maybe more importantly, the limitations of many commonly used strategies for assessment of non-organicity should be recognized and consider prior to labeling observed physical findings on neurological exam as non-organic or functional.

Ion channel gene expression predicts survival in glioma patients

PubMed Central

Wang, Rong; Gurguis, Christopher I.; Gu, Wanjun; Ko, Eun A; Lim, Inja; Bang, Hyoweon; Zhou, Tong; Ko, Jae-Hong

2015-01-01

Ion channels are important regulators in cell proliferation, migration, and apoptosis. The malfunction and/or aberrant expression of ion channels may disrupt these important biological processes and influence cancer progression. In this study, we investigate the expression pattern of ion channel genes in glioma. We designate 18 ion channel genes that are differentially expressed in high-grade glioma as a prognostic molecular signature. This ion channel gene expression based signature predicts glioma outcome in three independent validation cohorts. Interestingly, 16 of these 18 genes were down-regulated in high-grade glioma. This signature is independent of traditional clinical, molecular, and histological factors. Resampling tests indicate that the prognostic power of the signature outperforms random gene sets selected from human genome in all the validation cohorts. More importantly, this signature performs better than the random gene signatures selected from glioma-associated genes in two out of three validation datasets. This study implicates ion channels in brain cancer, thus expanding on knowledge of their roles in other cancers. Individualized profiling of ion channel gene expression serves as a superior and independent prognostic tool for glioma patients. PMID:26235283

Design and validation of an immunoaffinity LC-MS/MS assay for the quantification of a collagen type II neoepitope peptide in human urine: application as a biomarker of osteoarthritis.

PubMed

Nemirovskiy, Olga; Li, Wenlin Wendy; Szekely-Klepser, Gabriella

2010-01-01

Biomarkers play an increasingly important role for drug efficacy and safety evaluation in all stages of drug development. It is especially important to develop and validate sensitive and selective biomarkers for diseases where the onset of the disease is very slow and/or the disease progression is hard to follow, i.e., osteoarthritis (OA). The degradation of Type II collagen has been associated with the disease state of OA. Matrix metalloproteinases (MMPs) are enzymes that catalyze the degradation of collagen and therefore pursued as potential targets for the treatment of OA. Peptide biomarkers of MMP activity related to type II collagen degradation were identified and the presence of these peptides in MMP digests of human articular cartilage (HAC) explants and human urine were confirmed. An immunoaffinity LC/MS/MS assay for the quantification of the most abundant urinary type II collagen neoepitope (uTIINE) peptide, a 45-mer with 5 HO-proline residues was developed and clinically validated. The assay has subsequently been applied to analyze human urine samples from clinical studies. We have shown that the assay is able to differentiate between symptomatic OA and normal subjects, indicating that uTIINE can be used as potential biomarker for OA. This chapter discusses the assay procedure and provides information on the validation experiments used to evaluate the accuracy, precision, and selectivity data with attention to the specific challenges related to the quantification of endogenous protein/peptide biomarker analytes. The generalized approach can be used as a follow-up to studies whereby proteomics-based urinary biomarkers are identified and an assay needs to be developed. Considerations for the validation of such an assay are described.

Validity and reproducibility of cephalometric measurements obtained from digital photographs of analogue headfilms.

PubMed

Grybauskas, Simonas; Balciuniene, Irena; Vetra, Janis

2007-01-01

The emerging market of digital cephalographs and computerized cephalometry is overwhelming the need to examine the advantages and drawbacks of manual cephalometry, meanwhile, small offices continue to benefit from the economic efficacy and ease of use of analogue cephalograms. The use of modern cephalometric software requires import of digital cephalograms or digital capture of analogue data: scanning and digital photography. The validity of digital photographs of analogue headfilms rather than original headfilms in clinical practice has not been well established. Digital photography could be a fast and inexpensive method of digital capture of analogue cephalograms for use in digital cephalometry. The objective of this study was to determine the validity and reproducibility of measurements obtained from digital photographs of analogue headfilms in lateral cephalometry. Analogue cephalometric radiographs were performed on 15 human dry skulls. Each of them was traced on acetate paper and photographed three times independently. Acetate tracings and digital photographs were digitized and analyzed in cephalometric software. Linear regression model, paired t-test intergroup analysis and coefficient of repeatability were used to assess validity and reproducibility for 63 angular, linear and derivative measurements. 54 out of 63 measurements were determined to have clinically acceptable reproducibility in the acetate tracing group as well as 46 out of 63 in the digital photography group. The worst reproducibility was determined for measurements dependent on landmarks of incisors and poorly defined outlines, majority of them being angular measurements. Validity was acceptable for all measurements, and although statistically significant differences between methods existed for as many as 15 parameters, they appeared to be clinically insignificant being smaller than 1 unit of measurement. Validity was acceptable for 59 of 63 measurements obtained from digital photographs, substantiating the use of digital photography for headfilm capture and computer-aided cephalometric analysis.

Translation, cross-cultural adaptation and validation of SinoNasal Outcome Test (SNOT): 22 to Brazilian Portuguese.

PubMed

Kosugi, Eduardo Macoto; Chen, Vitor Guo; Fonseca, Viviane Maria Guerreiro da; Cursino, Milena Martins Pellogia; Mendes Neto, José Arruda; Gregório, Luís Carlos

2011-01-01

Quality of life questionnaires have been increasingly used in clinical trials to help establish the impact of medical intervention or to assess the outcome of health care services. Among disease-specific outcome measures, SNOT-22 was considered the most suitable tool for assessing chronic rhinosinusitis and patients with nasal polyps. To perform translation, cross-cultural adaptation and validation of the SNOT-22 to Brazilian Portuguese. Prospective study involving eighty-nine patients with chronic rhinosinusitis or nasal polyps submitted to functional endoscopic sinus surgery, who answered the questionnaire before and after surgery. Furthermore, 113 volunteers without sinonasal disease also answered the questionnaire. Internal consistency, test-retest reliability, measure validity, responsiveness and clinical interpretability were assessed. Mean preoperative, postoperative and no sinonasal disease scores were 62.39, 23.09 and 11.42, respectively (p<0.0001); showing validity and responsiveness. Internal consistency was high (Cronbach's alpha = 0.9276). Reliability was sufficiently good, considering inter-interviewers (r=0.81) and intra-interviewers within a 10 to 14 day-interval (r=0.72). Surgery effect size was 1.55. Minimally important difference was 14 points; and scores up to 10 points were considered normal. The Brazilian Portuguese SNOT-22 version is a valid instrument to assess patients with chronic rhinosinusitis and nasal polyps.

Distinguishing between hypochondriasis and somatization disorder: a review of the existing literature.

PubMed

Noyes, Russell; Stuart, Scott; Watson, David B; Langbehn, Douglas R

2006-01-01

A valid classification is important for further understanding of the somatoform disorders. The main disorders in this grouping - somatization disorder and hypochondriasis - have lengthy historical traditions and are defined in a contrasting manner. Various authors point to distinguishing demographic and clinical features, but there have been few direct comparisons of patients with these disorders. A review of the literature indicates those domains where differences are most likely to be found. Research assessing these may serve to refine and validate these key somatoform categories and/or dimensions.

Experimental Design in Clinical 'Omics Biomarker Discovery.

PubMed

Forshed, Jenny

2017-11-03

This tutorial highlights some issues in the experimental design of clinical 'omics biomarker discovery, how to avoid bias and get as true quantities as possible from biochemical analyses, and how to select samples to improve the chance of answering the clinical question at issue. This includes the importance of defining clinical aim and end point, knowing the variability in the results, randomization of samples, sample size, statistical power, and how to avoid confounding factors by including clinical data in the sample selection, that is, how to avoid unpleasant surprises at the point of statistical analysis. The aim of this Tutorial is to help translational clinical and preclinical biomarker candidate research and to improve the validity and potential of future biomarker candidate findings.

Development and psychometric validation of a cystic fibrosis knowledge scale.

PubMed

Balfour, Louise; Armstrong, Michael; Holly, Crystal; Gaudet, Ena; Aaron, Shawn; Tasca, George; Cameron, William; Pakhale, Smita

2014-11-01

Well-developed and validated measures of cystic fibrosis (CF) knowledge are scarce. The purpose of the present study is to develop and validate a CF knowledge scale that is brief, easy to use, self-administered and demonstrates clinical utility. A comprehensive literature search generated a pool of scale items; an expert panel of CF team members reviewed and provided recommendations for item inclusion. A focus group of CF patients and family members (n = 12) then reviewed the items for face validity and reading clarity. To evaluate the validity and reliability of the newly developed CF knowledge scale, it was administered to several different samples including CF patients (n = 45), respirology patients (n = 100), health-care providers (n = 74) and university student samples (psychology students, n = 71; medical students, n = 36). Internal consistency of the scale was high, with an alpha coefficient for the overall sample of .95 (n = 326). The scale also demonstrated excellent construct validity. This study is an important first step in a line of research that aims to develop and empirically validate a psycho-educational adherence intervention for improving quality of life and treatment outcomes among adult CF patients. The CF knowledge scale has potential applications as a clinical teaching tool with patients and health-care providers and could be used as an outcome measure in CF educational intervention studies aimed at optimizing CF treatment knowledge, adherence and quality of life among CF patients. © 2014 Asian Pacific Society of Respirology.

Author Response to Sabour (2018), "Comment on Hall et al. (2017), 'How to Choose Between Measures of Tinnitus Loudness for Clinical Research? A Report on the Reliability and Validity of an Investigator-Administered Test and a Patient-Reported Measure Using Baseline Data Collected in a Phase IIa Drug Trial'".

PubMed

Hall, Deborah A; Mehta, Rajnikant L; Fackrell, Kathryn

2018-03-08

The authors respond to a letter to the editor (Sabour, 2018) concerning the interpretation of validity in the context of evaluating treatment-related change in tinnitus loudness over time. The authors refer to several landmark methodological publications and an international standard concerning the validity of patient-reported outcome measurement instruments. The tinnitus loudness rating performed better against our reported acceptability criteria for (face and convergent) validity than did the tinnitus loudness matching test. It is important to distinguish between tests that evaluate the validity of measuring treatment-related change over time and tests that quantify the accuracy of diagnosing tinnitus as a case and non-case.

Validated Questionnaire of Maternal Attitude and Knowledge for Predicting Caries Risk in Children: Epidemiological Study in North Jakarta, Indonesia.

PubMed

Laksmiastuti, Sri Ratna; Budiardjo, Sarworini Bagio; Sutadi, Heriandi

2017-06-01

Predicting caries risk in children can be done by identifying caries risk factors. It is an important measure which contributes to best understanding of the cariogenic profile of the patient. Identification could be done by clinical examination and answering the questionnaire. We arrange the study to verify the questionnaire validation for predicting caries risk in children. The study was conducted on 62 pairs of mothers and their children, aged between 3 and 5 years. The questionnaire consists of 10 questions concerning mothers' attitude and knowledge about oral health. The reliability and validity test is based on Cronbach's alpha and correlation coefficient value. All question are reliable (Cronbach's alpha = 0.873) and valid (Corrected item-total item correlation >0.4). Five questionnaires of mother's attitude about oral health and five questionnaires of mother's knowledge about oral health are reliable and valid for predicting caries risk in children.

Development and Validation of a Scoring System to Predict Outcomes of Vedolizumab Treatment in Patients with Crohn's Disease.

PubMed

Dulai, Parambir S; Boland, Brigid S; Singh, Siddharth; Chaudrey, Khadija; Koliani-Pace, Jenna L; Kochhar, Gursimran; Parikh, Malav P; Shmidt, Eugenia; Hartke, Justin; Chilukuri, Prianka; Meserve, Joseph; Whitehead, Diana; Hirten, Robert; Winters, Adam C; Katta, Leah G; Peerani, Farhad; Narula, Neeraj; Sultan, Keith; Swaminath, Arun; Bohm, Matthew; Lukin, Dana; Hudesman, David; Chang, John T; Rivera-Nieves, Jesus; Jairath, Vipul; Zou, G Y; Feagan, Brian G; Shen, Bo; Siegel, Corey A; Loftus, Edward V; Kane, Sunanda; Sands, Bruce E; Colombel, Jean-Frederic; Sandborn, William J; Lasch, Karen; Cao, Charlie

2018-05-29

As more treatment options for inflammatory bowel diseases become available, it is important to identify patients most likely to respond to different therapies. We created and validated a scoring system to identify patients with Crohn's disease (CD) who respond to vedolizumab. We collected data from GEMINI 2 phase 3 trial of patients with active CD treated with vedolizumab for 26 weeks (n=814) and performed logistic regression analysis to identify factors associated with clinical, steroid-free, and durable remission (derivation set). We used these data to develop a clinical decision support tool, which we validated using data from 366 participants in a separate clinical practice observational cohort of patients with active CD treated with vedolizumab for 26 weeks (the VICTORY cohort). We evaluated the ability of this tool to identify patients in clinical remission or corticosteroid-free remission, or those with mucosal healing (MH), clinical remission with MH, or corticosteroid-free remission with MH after vedolizumab therapy using receiver operating characteristic area under the curve (AUC) analyses. The primary outcome was to develop and validate a list of factors associated with achieving remission by vedolizumab in patients with active CD. In the derivation analysis, we identified absence of previous treatment with a tumor necrosis factor antagonist (+3 points), absence of prior bowel surgery (+2 points), absence of prior fistulizing disease (+2 points), baseline level of albumin (+0.4 points per g/L), and baseline concentration of C-reactive protein (reduction of 0.5 points for values between 3.0-10.0 mg/L and 3.0 points for values > 10.0 mg/L) as factors associated with remission. In the validation set, our model identified patients in clinical remission with an AUC of 0.67, patients in corticosteroid-free remission with an AUC of 0.66, patients with MH with an AUC of 0.72, patients in clinical remission with MH with an AUC of 0.73, and patients in corticosteroid-free clinical remission with MH with an AUC of 0.75. A cut-off value of 13 points identified patients in clinical remission after vedolizumab therapy with 92% sensitivity, patients in corticosteroid-free remission with 94% sensitivity, patients with MH with 98% sensitivity, patients in deep remission with 100% sensitivity, and patients with corticosteroid-free clinical remission with MH with 100% sensitivity. We developed and validated a scoring system to identify patients with CD most likely to respond to 26 weeks of vedolizumab therapy. Further studies are needed to optimize its accuracy in select populations and determine its cost effectiveness. Copyright © 2018 AGA Institute. Published by Elsevier Inc. All rights reserved.

The Validity of the Multi-Informant Approach to Assessing Child and Adolescent Mental Health

PubMed Central

De Los Reyes, Andres; Augenstein, Tara M.; Wang, Mo; Thomas, Sarah A.; Drabick, Deborah A.G.; Burgers, Darcy E.; Rabinowitz, Jill

2015-01-01

Child and adolescent patients may display mental health concerns within some contexts and not others (e.g., home vs. school). Thus, understanding the specific contexts in which patients display concerns may assist mental health professionals in tailoring treatments to patients' needs. Consequently, clinical assessments often include reports from multiple informants who vary in the contexts in which they observe patients' behavior (e.g., patients, parents, teachers). Previous meta-analyses indicate that informants' reports correlate at low-to-moderate magnitudes. However, is it valid to interpret low correspondence among reports as indicating that patients display concerns in some contexts and not others? We meta-analyzed 341 studies published between 1989 and 2014 that reported cross-informant correspondence estimates, and observed low-to-moderate correspondence (mean internalizing: r = .25; mean externalizing: r = .30; mean overall: r = .28). Informant pair, mental health domain, and measurement method moderated magnitudes of correspondence. These robust findings have informed the development of concepts for interpreting multi-informant assessments, allowing researchers to draw specific predictions about the incremental and construct validity of these assessments. In turn, we critically evaluated research on the incremental and construct validity of the multi-informant approach to clinical child and adolescent assessment. In so doing, we identify crucial gaps in knowledge for future research, and provide recommendations for “best practices” in using and interpreting multi-informant assessments in clinical work and research. This paper has important implications for developing personalized approaches to clinical assessment, with the goal of informing techniques for tailoring treatments to target the specific contexts where patients display concerns. PMID:25915035

Standard Setting Methods for Pass/Fail Decisions on High-Stakes Objective Structured Clinical Examinations: A Validity Study.

PubMed

Yousuf, Naveed; Violato, Claudio; Zuberi, Rukhsana W

2015-01-01

CONSTRUCT: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. The objective structured clinical examination (OSCE) was established for valid, reliable, and objective assessment of clinical skills in health professions education. Various standard setting methods have been proposed to identify objective, reliable, and valid cutoff scores on OSCEs. These methods may identify different cutoff scores for the same examinations. Identification of valid and reliable cutoff scores for OSCEs remains an important issue and a challenge. Thirty OSCE stations administered at least twice in the years 2010-2012 to 393 medical students in Years 2 and 3 at Aga Khan University are included. Psychometric properties of the scores are determined. Cutoff scores and pass/fail decisions of Wijnen, Cohen, Mean-1.5SD, Mean-1SD, Angoff, borderline group and borderline regression (BL-R) methods are compared with each other and with three variants of cluster analysis using repeated measures analysis of variance and Cohen's kappa. The mean psychometric indices on the 30 OSCE stations are reliability coefficient = 0.76 (SD = 0.12); standard error of measurement = 5.66 (SD = 1.38); coefficient of determination = 0.47 (SD = 0.19), and intergrade discrimination = 7.19 (SD = 1.89). BL-R and Wijnen methods show the highest convergent validity evidence among other methods on the defined criteria. Angoff and Mean-1.5SD demonstrated least convergent validity evidence. The three cluster variants showed substantial convergent validity with borderline methods. Although there was a high level of convergent validity of Wijnen method, it lacks the theoretical strength to be used for competency-based assessments. The BL-R method is found to show the highest convergent validity evidences for OSCEs with other standard setting methods used in the present study. We also found that cluster analysis using mean method can be used for quality assurance of borderline methods. These findings should be further confirmed by studies in other settings.

Forecasting COPD hospitalization in the clinic: optimizing the chronic respiratory questionnaire

PubMed Central

Abascal-Bolado, Beatriz; Novotny, Paul J; Sloan, Jeff A; Karpman, Craig; Dulohery, Megan M; Benzo, Roberto P

2015-01-01

Purpose Forecasting hospitalization in patients with COPD has gained significant interest in the field of COPD care. There is a need to find simple tools that can help clinicians to stratify the risk of hospitalization in these patients at the time of care. The perception of quality of life has been reported to be independently associated with hospitalizations, but questionnaires are impractical for daily clinical use. Individual questions from valid questionnaires can have robust predictive abilities, as has been suggested in previous reports, as a way to use patient-reported outcomes to forecast important events like hospitalizations in COPD. Our primary aim was to assess the predictive value of individual questions from the Chronic Respiratory Questionnaire Self-Assessment Survey (CRQ-SAS) on the risk of hospitalization and to develop a clinically relevant and simple algorithm that clinicians can use in routine practice to identify patients with an increased risk of hospitalization. Patients and methods A total of 493 patients with COPD prospectively recruited from an outpatient pulmonary clinic completed the CRQ-SAS, demographic information, pulmonary function testing, and clinical outcomes. The cohort had a mean age of 70 years, was 54% male, with forced expiratory volume in 1 second percentage predicted 42.8±16.7, and modified Medical Research Council dyspnea scale score of 2±1.13. Results Our analysis validated the original CRQ-SAS domains. Importantly, recursive partitioning analysis identified three CRQ-SAS items regarding fear or panic of breathlessness, dyspnea with basic activities of daily living, and depressive symptoms that were highly predictive of hospitalization. We propose a robust (area under the curve =0.70) but short and easy algorithm for daily clinical care to forecast hospitalizations in patients with COPD. Conclusion We identified three themes – fear of breathlessness, dyspnea with basic activities of daily living, and depressive symptoms – as important patient-reported outcomes to predict hospitalizations, and propose a short and easy algorithm to forecast hospitalizations in patients with COPD. PMID:26543362

Forecasting COPD hospitalization in the clinic: optimizing the chronic respiratory questionnaire.

PubMed

Abascal-Bolado, Beatriz; Novotny, Paul J; Sloan, Jeff A; Karpman, Craig; Dulohery, Megan M; Benzo, Roberto P

2015-01-01

Forecasting hospitalization in patients with COPD has gained significant interest in the field of COPD care. There is a need to find simple tools that can help clinicians to stratify the risk of hospitalization in these patients at the time of care. The perception of quality of life has been reported to be independently associated with hospitalizations, but questionnaires are impractical for daily clinical use. Individual questions from valid questionnaires can have robust predictive abilities, as has been suggested in previous reports, as a way to use patient-reported outcomes to forecast important events like hospitalizations in COPD. Our primary aim was to assess the predictive value of individual questions from the Chronic Respiratory Questionnaire Self-Assessment Survey (CRQ-SAS) on the risk of hospitalization and to develop a clinically relevant and simple algorithm that clinicians can use in routine practice to identify patients with an increased risk of hospitalization. A total of 493 patients with COPD prospectively recruited from an outpatient pulmonary clinic completed the CRQ-SAS, demographic information, pulmonary function testing, and clinical outcomes. The cohort had a mean age of 70 years, was 54% male, with forced expiratory volume in 1 second percentage predicted 42.8±16.7, and modified Medical Research Council dyspnea scale score of 2±1.13. Our analysis validated the original CRQ-SAS domains. Importantly, recursive partitioning analysis identified three CRQ-SAS items regarding fear or panic of breathlessness, dyspnea with basic activities of daily living, and depressive symptoms that were highly predictive of hospitalization. We propose a robust (area under the curve =0.70) but short and easy algorithm for daily clinical care to forecast hospitalizations in patients with COPD. We identified three themes - fear of breathlessness, dyspnea with basic activities of daily living, and depressive symptoms - as important patient-reported outcomes to predict hospitalizations, and propose a short and easy algorithm to forecast hospitalizations in patients with COPD.

Evaluation of the aspartate aminotransferase/platelet ratio index and enhanced liver fibrosis tests to detect significant fibrosis due to chronic hepatitis C.

PubMed

Petersen, John R; Stevenson, Heather L; Kasturi, Krishna S; Naniwadekar, Ashutosh; Parkes, Julie; Cross, Richard; Rosenberg, William M; Xiao, Shu-Yuan; Snyder, Ned

2014-04-01

The assessment of liver fibrosis in chronic hepatitis C patients is important for prognosis and making decisions regarding antiviral treatment. Although liver biopsy is considered the reference standard for assessing hepatic fibrosis in patients with chronic hepatitis C, it is invasive and associated with sampling and interobserver variability. Serum fibrosis markers have been utilized as surrogates for a liver biopsy. We completed a prospective study of 191 patients in which blood draws and liver biopsies were performed on the same visit. Using liver biopsies the sensitivity, specificity, and negative and positive predictive values for both aspartate aminotransferase/platelet ratio index (APRI) and enhanced liver fibrosis (ELF) were determined. The patients were divided into training and validation patient sets to develop and validate a clinically useful algorithm for differentiating mild and significant fibrosis. The area under the ROC curve for the APRI and ELF tests for the training set was 0.865 and 0.880, respectively. The clinical sensitivity in separating mild (F0-F1) from significant fibrosis (F2-F4) was 80% and 86.0% with a clinical specificity of 86.7% and 77.8%, respectively. For the validation sets the area under the ROC curve for the APRI and ELF tests was, 0.855 and 0.780, respectively. The clinical sensitivity of the APRI and ELF tests in separating mild (F0-F1) from significant (F2-F4) fibrosis for the validation set was 90.0% and 70.0% with a clinical specificity of 73.3% and 86.7%, respectively. There were no differences between the APRI and ELF tests in distinguishing mild from significant fibrosis for either the training or validation sets (P=0.61 and 0.20, respectively). Using APRI as the primary test followed by ELF for patients in the intermediate zone, would have decreased the number of liver biopsies needed by 40% for the validation set. Overall, use of our algorithm would have decreased the number of patients who needed a liver biopsy from 95 to 24-a 74.7% reduction. This study has shown that the APRI and ELF tests are equally accurate in distinguishing mild from significant liver fibrosis, and combining them into a validated algorithm improves their performance in distinguishing mild from significant fibrosis.

Validity and reliability of a novel immunosuppressive adverse effects scoring system in renal transplant recipients.

PubMed

Meaney, Calvin J; Arabi, Ziad; Venuto, Rocco C; Consiglio, Joseph D; Wilding, Gregory E; Tornatore, Kathleen M

2014-06-12

After renal transplantation, many patients experience adverse effects from maintenance immunosuppressive drugs. When these adverse effects occur, patient adherence with immunosuppression may be reduced and impact allograft survival. If these adverse effects could be prospectively monitored in an objective manner and possibly prevented, adherence to immunosuppressive regimens could be optimized and allograft survival improved. Prospective, standardized clinical approaches to assess immunosuppressive adverse effects by health care providers are limited. Therefore, we developed and evaluated the application, reliability and validity of a novel adverse effects scoring system in renal transplant recipients receiving calcineurin inhibitor (cyclosporine or tacrolimus) and mycophenolic acid based immunosuppressive therapy. The scoring system included 18 non-renal adverse effects organized into gastrointestinal, central nervous system and aesthetic domains developed by a multidisciplinary physician group. Nephrologists employed this standardized adverse effect evaluation in stable renal transplant patients using physical exam, review of systems, recent laboratory results, and medication adherence assessment during a clinic visit. Stable renal transplant recipients in two clinical studies were evaluated and received immunosuppressive regimens comprised of either cyclosporine or tacrolimus with mycophenolic acid. Face, content, and construct validity were assessed to document these adverse effect evaluations. Inter-rater reliability was determined using the Kappa statistic and intra-class correlation. A total of 58 renal transplant recipients were assessed using the adverse effects scoring system confirming face validity. Nephrologists (subject matter experts) rated the 18 adverse effects as: 3.1 ± 0.75 out of 4 (maximum) regarding clinical importance to verify content validity. The adverse effects scoring system distinguished 1.75-fold increased gastrointestinal adverse effects (p=0.008) in renal transplant recipients receiving tacrolimus and mycophenolic acid compared to the cyclosporine regimen. This finding demonstrated construct validity. Intra-class correlation was 0.81 (95% confidence interval: 0.65-0.90) and Kappa statistic of 0.68 ± 0.25 for all 18 adverse effects and verified substantial inter-rater reliability. This immunosuppressive adverse effects scoring system in stable renal transplant recipients was evaluated and substantiated face, content and construct validity with inter-rater reliability. The scoring system may facilitate prospective, standardized clinical monitoring of immunosuppressive adverse drug effects in stable renal transplant recipients and improve medication adherence.

The role of effective communication in achieving informed consent for clinical trials.

PubMed

Pick, Andrew; Gilbert, Kayleigh; McCaul, James

2014-11-11

Informed consent is fundamental to the protection of the rights, safety and wellbeing of patients in clinical research. For consent to be valid, patients must first be given all the information they need about the proposed research to be able to decide whether they would like to take part. This material should be presented in a way that is easy for them to understand. This article explores the importance of communication in clinical research, and how more effective communication with patients during the informed consent process can ensure they are fully informed.

Application of a framework to assess the usefulness of alternative sepsis criteria

PubMed Central

Seymour, Christopher W.; Coopersmith, Craig M.; Deutschman, Clifford S; Gesten, Foster; Klompas, Michael; Levy, Mitchell; Martin, Gregory S.; Osborn, Tiffany M.; Rhee, Chanu; Warren, David; Watson, R. Scott; Angus, Derek C.

2016-01-01

The current definition for sepsis is life-threatening, acute organ dysfunction secondary to a dysregulated host response to infection. Criteria to operationalize this definition can be judged by 6 domains of usefulness (reliability; content, construct and criterion validity, measurement burden, and timeliness). The relative importance of these 6 domains depends on the intended purpose for the criteria (clinical care, basic and clinical research, surveillance, or quality improvement (QI) and audit). For example, criteria for clinical care should have high content and construct validity, timeliness, and low measurement burden to facilitate prompt care. Criteria for surveillance or QI/audit place greater emphasis on reliability across individuals and sites and lower emphasis on timeliness. Criteria for clinical trials require timeliness to ensure prompt enrollment and reasonable reliability but can tolerate high measurement burden. Basic research also tolerates high measurement burden and may not need stability over time. In an illustrative case study, we compared examples of criteria designed for clinical care, surveillance and QI/audit among 396,241 patients admitted to 12 academic and community hospitals in an integrated health system. Case rates differed 4-fold and mortality 3-fold. Predictably, clinical care criteria, which emphasized timeliness and low burden and therefore used vital signs and routine laboratory tests, had the highest case identification with lowest mortality. QI /audit criteria, which emphasized reliability and criterion validity, used discharge information and had the lowest case identification with highest mortality. Using this framework to identify the purpose and apply domains of usefulness can help with the evaluation of existing sepsis diagnostic criteria and provide a roadmap for future work. PMID:26901560

Application of a Framework to Assess the Usefulness of Alternative Sepsis Criteria.

PubMed

Seymour, Christopher W; Coopersmith, Craig M; Deutschman, Clifford S; Gesten, Foster; Klompas, Michael; Levy, Mitchell; Martin, Gregory S; Osborn, Tiffany M; Rhee, Chanu; Warren, David K; Watson, R Scott; Angus, Derek C

2016-03-01

The current definition of sepsis is life-threatening, acute organ dysfunction secondary to a dysregulated host response to infection. Criteria to operationalize this definition can be judged by six domains of usefulness (reliability, content, construct and criterion validity, measurement burden, and timeliness). The relative importance of these six domains depends on the intended purpose for the criteria (clinical care, basic and clinical research, surveillance, or quality improvement [QI] and audit). For example, criteria for clinical care should have high content and construct validity, timeliness, and low measurement burden to facilitate prompt care. Criteria for surveillance or QI/audit place greater emphasis on reliability across individuals and sites and lower emphasis on timeliness. Criteria for clinical trials require timeliness to ensure prompt enrollment and reasonable reliability but can tolerate high measurement burden. Basic research also tolerates high measurement burden and may not need stability over time. In an illustrative case study, we compared examples of criteria designed for clinical care, surveillance and QI/audit among 396,241 patients admitted to 12 academic and community hospitals in an integrated health system. Case rates differed four-fold and mortality three-fold. Predictably, clinical care criteria, which emphasized timeliness and low burden and therefore used vital signs and routine laboratory tests, had the greater case identification with lowest mortality. QI/audit criteria, which emphasized reliability and criterion validity, used discharge information and had the lowest case identification with highest mortality. Using this framework to identify the purpose and apply domains of usefulness can help with the evaluation of existing sepsis diagnostic criteria and provide a roadmap for future work.

Validation of wet mount microscopy against Trichomonas culture among women of reproductive age group in Western province, Sri Lanka.

PubMed

Banneheke, H; Fernandopulle, R; Gunasekara, U; Barua, A; Fernando, N; Wickremasinghe, R

2015-06-01

Wet mount microscopy is the most commonly used diagnostic method for trichomoniasis in clinical diagnostic services all over the world including Sri Lanka due to its availability, simplicity and is relatively inexpensive. However, Trichomonas culture and PCR are the gold standard tests. Unfortunately, neither the culture nor PCR is available for the diagnosis of trichomoniasis in Sri Lanka. Thus, it is important to validate the wet mount microscopy as it is the only available diagnostic test and has not been validated to date in Sri Lanka. The objective was to evaluate the validity and reliability of wet mount microscopy against gold standard Trichomonas culture among clinic based population of reproductive age group women in Western province, Sri Lanka. Women attending hospital and institutional based clinics were enrolled. They were interviewed and high vaginal swabs were taken for laboratory diagnosis by culture and wet mount microscopy. There were 601 participants in the age group of 15-45 years. Wet mount microscopy showed 68% sensitivity, 100% specificity, 100% positive (PPV) and 98% negative predictive values (NPV) (P=0.001, kappa=0.803) respectively against the gold standard culture. The area under the ROC curve was 0.840. Sensitivity of wet mount microscopy is low. However it has high validity and reliability as a specific diagnostic test for trichomoniasis. If it is to be used among women of reproductive age group in Western province, Sri Lanka, a culture method could be adopted as a second test to confirm the negative wet mount for symptomatic patients.

Clinical validation of robot simulation of toothbrushing - comparative plaque removal efficacy

PubMed Central

2014-01-01

Background Clinical validation of laboratory toothbrushing tests has important advantages. It was, therefore, the aim to demonstrate correlation of tooth cleaning efficiency of a new robot brushing simulation technique with clinical plaque removal. Methods Clinical programme: 27 subjects received dental cleaning prior to 3-day-plaque-regrowth-interval. Plaque was stained, photographically documented and scored using planimetrical index. Subjects brushed teeth 33–47 with three techniques (horizontal, rotating, vertical), each for 20s buccally and for 20s orally in 3 consecutive intervals. The force was calibrated, the brushing technique was video supported. Two different brushes were randomly assigned to the subject. Robot programme: Clinical brushing programmes were transfered to a 6-axis-robot. Artificial teeth 33–47 were covered with plaque-simulating substrate. All brushing techniques were repeated 7 times, results were scored according to clinical planimetry. All data underwent statistical analysis by t-test, U-test and multivariate analysis. Results The individual clinical cleaning patterns are well reproduced by the robot programmes. Differences in plaque removal are statistically significant for the two brushes, reproduced in clinical and robot data. Multivariate analysis confirms the higher cleaning efficiency for anterior teeth and for the buccal sites. Conclusions The robot tooth brushing simulation programme showed good correlation with clinically standardized tooth brushing. This new robot brushing simulation programme can be used for rapid, reproducible laboratory testing of tooth cleaning. PMID:24996973

Clinical validation of robot simulation of toothbrushing--comparative plaque removal efficacy.

PubMed

Lang, Tomas; Staufer, Sebastian; Jennes, Barbara; Gaengler, Peter

2014-07-04

Clinical validation of laboratory toothbrushing tests has important advantages. It was, therefore, the aim to demonstrate correlation of tooth cleaning efficiency of a new robot brushing simulation technique with clinical plaque removal. Clinical programme: 27 subjects received dental cleaning prior to 3-day-plaque-regrowth-interval. Plaque was stained, photographically documented and scored using planimetrical index. Subjects brushed teeth 33-47 with three techniques (horizontal, rotating, vertical), each for 20s buccally and for 20s orally in 3 consecutive intervals. The force was calibrated, the brushing technique was video supported. Two different brushes were randomly assigned to the subject. Robot programme: Clinical brushing programmes were transfered to a 6-axis-robot. Artificial teeth 33-47 were covered with plaque-simulating substrate. All brushing techniques were repeated 7 times, results were scored according to clinical planimetry. All data underwent statistical analysis by t-test, U-test and multivariate analysis. The individual clinical cleaning patterns are well reproduced by the robot programmes. Differences in plaque removal are statistically significant for the two brushes, reproduced in clinical and robot data. Multivariate analysis confirms the higher cleaning efficiency for anterior teeth and for the buccal sites. The robot tooth brushing simulation programme showed good correlation with clinically standardized tooth brushing.This new robot brushing simulation programme can be used for rapid, reproducible laboratory testing of tooth cleaning.

Validation of a Brief Structured Interview: The Children’s Interview for Psychiatric Syndromes (ChIPS)

PubMed Central

Young, Matthew E.; Bell, Ziv E.; Fristad, Mary A.

2016-01-01

Evidence-based assessment is important in the treatment of childhood psychopathology (Jensen-Doss, 2011). While researchers and clinicians frequently use structured diagnostic interviews to ensure reliability, the most commonly used instrument, the Schedule for Affective Disorders and Schizophrenia for School Aged Children (K-SADS; Kaufman et al., 1997), is too long for most clinical applications. The Children’s Interview for Psychiatric Syndromes, (ChIPS/P-ChIPS; Weller, Weller, Rooney, & Fristad, 1999a; 1999b) is a highly-structured brief diagnostic interview. The present study compared K-SADS and ChIPS/P-ChIPS diagnoses in an outpatient clinical sample of 50 parent-child pairs aged 7–14. Agreement between most diagnoses was moderate to high between instruments and with consensus clinical diagnoses. ChIPS was significantly briefer to administer than the K-SADS. Interviewer experience level and participant demographics did not appear to affect agreement. Results provide further evidence for the validity of the ChIPS and support its use in clinical and research settings. PMID:27761777

The accuracy and efficiency of electronic screening for recruitment into a clinical trial on COPD.

PubMed

Schmickl, Christopher N; Li, Man; Li, Guangxi; Wetzstein, Marnie M; Herasevich, Vitaly; Gajic, Ognjen; Benzo, Roberto P

2011-10-01

Participant recruitment is an important process in successful conduct of randomized controlled trials. To facilitate enrollment into a National Institutes of Health-sponsored clinical trial involving patients with chronic obstructive pulmonary disease (COPD), we developed and prospectively validated an automated electronic screening tool based on boolean free-text search of admission notes in electronic medical records. During a 2-week validation period, all patients admitted to prespecified general medical services were screened for eligibility by both the electronic screening tool and a COPD nurse. Group discussion was the gold standard for confirmation of true-positive results. Compared with the gold standard, electronic screening yielded 100% sensitivity, 92% specificity, 100% negative predictive value, and 72% positive predictive value. Compared with traditional manual screening, electronic screening demonstrated time-saving potential of 76%. Thus, the electronic screening tool accurately identifies potential study subjects and improves efficiency of patient accrual for a clinical trial on COPD. This method may be expanded into other institutional and clinical settings. Copyright © 2011 Elsevier Ltd. All rights reserved.

The role of diagnostic laboratories in support of animal disease surveillance systems.

PubMed

Zepeda, C

2007-01-01

Diagnostic laboratories are an essential component of animal disease surveillance systems. To understand the occurrence of disease in populations, surveillance systems rely on random or targeted surveys using three approaches: clinical, serological and virological surveillance. Clinical surveillance is the basis for early detection of disease and is usually centered on the detection of syndromes and clinical findings requiring confirmation by diagnostic laboratories. Although most of the tests applied usually perform to an acceptable standard, several have not been properly validated in terms of their diagnostic sensitivity and specificity. Sensitivity and specificity estimates can vary according to local conditions and, ideally, should be determined by national laboratories where the tests are to be applied. The importance of sensitivity and specificity estimates in the design and interpretation of statistically based surveys and risk analysis is fundamental to establish appropriate disease control and prevention strategies. The World Organisation for Animal Health's (OIE) network of reference laboratories acts as centers of expertise for the diagnosis of OIE listed diseases and have a role in promoting the validation of OIE prescribed tests for international trade. This paper discusses the importance of the epidemiological evaluation of diagnostic tests and the role of the OIE Reference Laboratories and Collaborating Centres in this process.

BreaKmer: detection of structural variation in targeted massively parallel sequencing data using kmers.

PubMed

Abo, Ryan P; Ducar, Matthew; Garcia, Elizabeth P; Thorner, Aaron R; Rojas-Rudilla, Vanesa; Lin, Ling; Sholl, Lynette M; Hahn, William C; Meyerson, Matthew; Lindeman, Neal I; Van Hummelen, Paul; MacConaill, Laura E

2015-02-18

Genomic structural variation (SV), a common hallmark of cancer, has important predictive and therapeutic implications. However, accurately detecting SV using high-throughput sequencing data remains challenging, especially for 'targeted' resequencing efforts. This is critically important in the clinical setting where targeted resequencing is frequently being applied to rapidly assess clinically actionable mutations in tumor biopsies in a cost-effective manner. We present BreaKmer, a novel approach that uses a 'kmer' strategy to assemble misaligned sequence reads for predicting insertions, deletions, inversions, tandem duplications and translocations at base-pair resolution in targeted resequencing data. Variants are predicted by realigning an assembled consensus sequence created from sequence reads that were abnormally aligned to the reference genome. Using targeted resequencing data from tumor specimens with orthogonally validated SV, non-tumor samples and whole-genome sequencing data, BreaKmer had a 97.4% overall sensitivity for known events and predicted 17 positively validated, novel variants. Relative to four publically available algorithms, BreaKmer detected SV with increased sensitivity and limited calls in non-tumor samples, key features for variant analysis of tumor specimens in both the clinical and research settings. © The Author(s) 2014. Published by Oxford University Press on behalf of Nucleic Acids Research.

Recommendations on risk-based strategies for detection and characterization of antibodies against biotechnology products.

PubMed

Koren, Eugen; Smith, Holly W; Shores, Elizabeth; Shankar, Gopi; Finco-Kent, Deborah; Rup, Bonita; Barrett, Yu-Chen; Devanarayan, Viswanath; Gorovits, Boris; Gupta, Shalini; Parish, Thomas; Quarmby, Valerie; Moxness, Michael; Swanson, Steven J; Taniguchi, Gary; Zuckerman, Linda A; Stebbins, Christopher C; Mire-Sluis, Anthony

2008-04-20

The appropriate evaluation of the immunogenicity of biopharmaceuticals is of major importance for their successful development and licensure. Antibodies elicited by these products in many cases cause no detectable clinical effects in humans. However, antibodies to some therapeutic proteins have been shown to cause a variety of clinical consequences ranging from relatively mild to serious adverse events. In addition, antibodies can affect drug efficacy. In non-clinical studies, anti-drug antibodies (ADA) can complicate interpretation of the toxicity, pharmacokinetic (PK) and pharmacodynamic (PD) data. Therefore, it is important to develop testing strategies that provide valid assessments of antibody responses in both non-clinical and clinical studies. This document provides recommendations for antibody testing strategies stemming from the experience of contributing authors. The recommendations are intended to foster a more unified approach to antibody testing across the biopharmaceutical industry. The strategies proposed are also expected to contribute to better understanding of antibody responses and to further advance immunogenicity evaluation.

Development of a novel observational measure for anxiety in young children: The Anxiety Dimensional Observation Scale

PubMed Central

Mian, Nicholas D.; Carter, Alice S.; Pine, Daniel S.; Wakschlag, Lauren S.; Briggs-Gowan, Margaret J.

2015-01-01

Background Identifying anxiety disorders in preschool-age children represents an important clinical challenge. Observation is essential to clinical assessment and can help differentiate normative variation from clinically significant anxiety. Yet, most anxiety assessment methods for young children rely on parent-reports. The goal of this article is to present and preliminarily test the reliability and validity of a novel observational paradigm for assessing a range of fearful and anxious behaviors in young children, the Anxiety Dimensional Observation Schedule (Anx-DOS). Methods A diverse sample of 403 children, aged 3 to 6 years, and their mothers was studied. Reliability and validity in relation to parent reports (Preschool Age Psychiatric Assessment) and known risk factors, including indicators of behavioral inhibition (latency to touch novel objects) and attention bias to threat (in the dot-probe task) were investigated. Results The Anx-DOS demonstrated good inter-rater reliability and internal consistency. Evidence for convergent validity was demonstrated relative to mother-reported separation anxiety, social anxiety, phobic avoidance, trauma symptoms, and past service use. Finally, fearfulness was associated with observed latency and attention bias toward threat. Conclusions Findings support the Anx-DOS as a method for capturing early manifestations of fearfulness and anxiety in young children. Multimethod assessments incorporating standardized methods for assessing discrete, observable manifestations of anxiety may be beneficial for early identification and clinical intervention efforts. PMID:25773515

Robust Dimensions of Anxiety Sensitivity: Development and Initial Validation of the Anxiety Sensitivity Index-3

ERIC Educational Resources Information Center

Taylor, Steven; Zvolensky, Michael J.; Cox, Brian J.; Deacon, Brett; Heimberg, Richard G.; Ledley, Deborah Roth; Abramowitz, Jonathan S.; Holaway, Robert M.; Sandin, Bonifacio; Stewart, Sherry H.; Coles, Meredith; Eng, Winnie; Daly, Erin S.; Arrindell, Willem A.; Bouvard, Martine; Cardenas, Samuel Jurado

2007-01-01

Accumulating evidence suggests that anxiety sensitivity (fear of arousal-related sensations) plays an important role in many clinical conditions, particularly anxiety disorders. Research has increasingly focused on how the basic dimensions of anxiety sensitivity are related to various forms of psychopathology. Such work has been hampered because…

In the Minds of OSCE Examiners: Uncovering Hidden Assumptions

ERIC Educational Resources Information Center

Chahine, Saad; Holmes, Bruce; Kowalewski, Zbigniew

2016-01-01

The Objective Structured Clinical Exam (OSCE) is a widely used method of assessment in medical education. Rater cognition has become an important area of inquiry in the medical education assessment literature generally, and in the OSCE literature specifically, because of concerns about potential compromises of validity. In this study, a novel…

Accuracy of PECARN, CATCH, and CHALICE head injury decision rules in children: a prospective cohort study.

PubMed

Babl, Franz E; Borland, Meredith L; Phillips, Natalie; Kochar, Amit; Dalton, Sarah; McCaskill, Mary; Cheek, John A; Gilhotra, Yuri; Furyk, Jeremy; Neutze, Jocelyn; Lyttle, Mark D; Bressan, Silvia; Donath, Susan; Molesworth, Charlotte; Jachno, Kim; Ward, Brenton; Williams, Amanda; Baylis, Amy; Crowe, Louise; Oakley, Ed; Dalziel, Stuart R

2017-06-17

Clinical decision rules can help to determine the need for CT imaging in children with head injuries. We aimed to validate three clinical decision rules (PECARN, CATCH, and CHALICE) in a large sample of children. In this prospective observational study, we included children and adolescents (aged <18 years) with head injuries of any severity who presented to the emergency departments of ten Australian and New Zealand hospitals. We assessed the diagnostic accuracy of PECARN (stratified into children aged <2 years and ≥2 years), CATCH, and CHALICE in predicting each rule-specific outcome measure (clinically important traumatic brain injury [TBI], need for neurological intervention, and clinically significant intracranial injury, respectively). For each calculation we used rule-specific predictor variables in populations that satisfied inclusion and exclusion criteria for each rule (validation cohort). In a secondary analysis, we compiled a comparison cohort of patients with mild head injuries (Glasgow Coma Scale score 13-15) and calculated accuracy using rule-specific predictor variables for the standardised outcome of clinically important TBI. This study is registered with the Australian New Zealand Clinical Trials Registry, number ACTRN12614000463673. Between April 11, 2011, and Nov 30, 2014, we analysed 20 137 children and adolescents attending with head injuries. CTs were obtained for 2106 (10%) patients, 4544 (23%) were admitted, 83 (<1%) underwent neurosurgery, and 15 (<1%) died. PECARN was applicable for 4011 (75%) of 5374 patients younger than 2 years and 11 152 (76%) of 14 763 patients aged 2 years and older. CATCH was applicable for 4957 (25%) patients and CHALICE for 20 029 (99%). The highest point validation sensitivities were shown for PECARN in children younger than 2 years (100·0%, 95% CI 90·7-100·0; 38 patients identified of 38 with outcome [38/38]) and PECARN in children 2 years and older (99·0%, 94·4-100·0; 97/98), followed by CATCH (high-risk predictors only; 95·2%; 76·2-99·9; 20/21; medium-risk and high-risk predictors 88·7%; 82·2-93·4; 125/141) and CHALICE (92·3%, 89·2-94·7; 370/401). In the comparison cohort of 18 913 patients with mild injuries, sensitivities for clinically important TBI were similar. Negative predictive values in both analyses were higher than 99% for all rules. The sensitivities of three clinical decision rules for head injuries in children were high when used as designed. The findings are an important starting point for clinicians considering the introduction of one of the rules. National Health and Medical Research Council, Emergency Medicine Foundation, Perpetual Philanthropic Services, WA Health Targeted Research Funds, Townsville Hospital Private Practice Fund, Auckland Medical Research Foundation, A + Trust. Copyright © 2017 Elsevier Ltd. All rights reserved.

Clinical Validity, Understandability, and Actionability of Online Cardiovascular Disease Risk Calculators: Systematic Review.

PubMed

Bonner, Carissa; Fajardo, Michael Anthony; Hui, Samuel; Stubbs, Renee; Trevena, Lyndal

2018-02-01

Online health information is particularly important for cardiovascular disease (CVD) prevention, where lifestyle changes are recommended until risk becomes high enough to warrant pharmacological intervention. Online information is abundant, but the quality is often poor and many people do not have adequate health literacy to access, understand, and use it effectively. This project aimed to review and evaluate the suitability of online CVD risk calculators for use by low health literate consumers in terms of clinical validity, understandability, and actionability. This systematic review of public websites from August to November 2016 used evaluation of clinical validity based on a high-risk patient profile and assessment of understandability and actionability using Patient Education Material Evaluation Tool for Print Materials. A total of 67 unique webpages and 73 unique CVD risk calculators were identified. The same high-risk patient profile produced widely variable CVD risk estimates, ranging from as little as 3% to as high as a 43% risk of a CVD event over the next 10 years. One-quarter (25%) of risk calculators did not specify what model these estimates were based on. The most common clinical model was Framingham (44%), and most calculators (77%) provided a 10-year CVD risk estimate. The calculators scored moderately on understandability (mean score 64%) and poorly on actionability (mean score 19%). The absolute percentage risk was stated in most (but not all) calculators (79%), and only 18% included graphical formats consistent with recommended risk communication guidelines. There is a plethora of online CVD risk calculators available, but they are not readily understandable and their actionability is poor. Entering the same clinical information produces widely varying results with little explanation. Developers need to address actionability as well as clinical validity and understandability to improve usefulness to consumers with low health literacy. ©Carissa Bonner, Michael Anthony Fajardo, Samuel Hui, Renee Stubbs, Lyndal Trevena. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 01.02.2018.

Predicting stress urinary incontinence during pregnancy: combination of pelvic floor ultrasound parameters and clinical factors.

PubMed

Chen, Ling; Luo, Dan; Yu, Xiajuan; Jin, Mei; Cai, Wenzhi

2018-05-12

The aim of this study was to develop and validate a predictive tool that combining pelvic floor ultrasound parameters and clinical factors for stress urinary incontinence during pregnancy. A total of 535 women in first or second trimester were included for an interview and transperineal ultrasound assessment from two hospitals. Imaging data sets were analyzed offline to assess for bladder neck vertical position, urethra angles (α, β, and γ angles), hiatal area and bladder neck funneling. All significant continuous variables at univariable analysis were analyzed by receiver-operating characteristics. Three multivariable logistic models were built on clinical factor, and combined with ultrasound parameters. The final predictive model with best performance and fewest variables was selected to establish a nomogram. Internal and external validation of the nomogram were performed by both discrimination represented by C-index and calibration measured by Hosmer-Lemeshow test. A decision curve analysis was conducted to determine the clinical utility of the nomogram. After excluding 14 women with invalid data, 521 women were analyzed. β angle, γ angle and hiatal area had limited predictive value for stress urinary incontinence during pregnancy, with area under curves of 0.558-0.648. The final predictive model included body mass index gain since pregnancy, constipation, previous delivery mode, β angle at rest, and bladder neck funneling. The nomogram based on the final model showed good discrimination with a C-index of 0.789 and satisfactory calibration (P=0.828), both of which were supported by external validation. Decision curve analysis showed that the nomogram was clinical useful. The nomogram incorporating both the pelvic floor ultrasound parameters and clinical factors has been validated to show good discrimination and calibration, and could be an important tool for stress urinary incontinence risk prediction at an early stage of pregnancy. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Companion diagnostics and molecular imaging-enhanced approaches for oncology clinical trials.

PubMed

Van Heertum, Ronald L; Scarimbolo, Robert; Ford, Robert; Berdougo, Eli; O'Neal, Michael

2015-01-01

In the era of personalized medicine, diagnostic approaches are helping pharmaceutical and biotechnology sponsors streamline the clinical trial process. Molecular assays and diagnostic imaging are routinely being used to stratify patients for treatment, monitor disease, and provide reliable early clinical phase assessments. The importance of diagnostic approaches in drug development is highlighted by the rapidly expanding global cancer diagnostics market and the emergent attention of regulatory agencies worldwide, who are beginning to offer more structured platforms and guidance for this area. In this paper, we highlight the key benefits of using companion diagnostics and diagnostic imaging with a focus on oncology clinical trials. Nuclear imaging using widely available radiopharmaceuticals in conjunction with molecular imaging of oncology targets has opened the door to more accurate disease assessment and the modernization of standard criteria for the evaluation, staging, and treatment responses of cancer patients. Furthermore, the introduction and validation of quantitative molecular imaging continues to drive and optimize the field of oncology diagnostics. Given their pivotal role in disease assessment and treatment, the validation and commercialization of diagnostic tools will continue to advance oncology clinical trials, support new oncology drugs, and promote better patient outcomes.

Normative data and psychometric properties of the strengths and difficulties questionnaire among Japanese school-aged children.

PubMed

Moriwaki, Aiko; Kamio, Yoko

2014-01-21

Although child mental health problems are among the most important worldwide issues, development of culturally acceptable mental health services to serve the clinical needs of children and their families is especially lacking in regions outside Europe and North America. The Strengths and Difficulties Questionnaire (SDQ), which was developed in the United Kingdom and is now one of the most widely used measurement tools for screening child psychiatric symptoms, has been translated into Japanese, but culturally calibrated norms for Japanese schoolchildren have yet to be established. To this end, we examined the applicability of the Japanese versions of the parent and teacher SDQs by establishing norms and extending validation of its psychometric properties to a large nationwide sample, as well as to a smaller clinical sample. The Japanese versions of the SDQ were completed by parents and teachers of schoolchildren aged 7 to 15 years attending mainstream classes in primary or secondary schools in Japan. Data were analyzed to describe the population distribution and gender/age effects by informant, cut-off scores according to banding, factor structure, cross-scale correlations, and internal consistency for 24,519 parent ratings and 7,977 teacher ratings from a large nationwide sample. Inter-rater and test-retest reliabilities and convergent and divergent validities were confirmed for a smaller validation sample (total n = 128) consisting of a clinical sample with any mental disorder and community children without any diagnoses. Means, standard deviations, and banding of normative data for this Japanese child population were obtained. Gender/age effects were significant for both parent and teacher ratings. The original five-factor structure was replicated, and strong cross-scale correlations and internal reliability were shown across all SDQ subscales for this population. Inter-rater agreement was satisfactory, test-retest reliability was excellent, and convergent and divergent validities were satisfactory for the validation sample, with some differences between informants. This study provides evidence that the Japanese version of the SDQ is a useful instrument for parents and teachers as well as for research purposes. Our findings also emphasize the importance of establishing culturally calibrated norms and boundaries for the instrument's use.

Biomarkers in Breast Cancer – An Update

PubMed Central

Schmidt, M.; Fasching, P. A.; Beckmann, M. W.; Kölbl, H.

2012-01-01

The therapy of choice for breast cancer patients requiring adjuvant chemo- or radiotherapy is increasingly guided by the principle of weighing the individual effectiveness of the therapy against the associated side effects. This has only been made possible by the discovery and validation of modern biomarkers. In the last decades and in the last few years some biomarkers have been integrated in clinical practice and a number have been included in modern study concepts. The importance of biomarkers lies not merely in their prognostic value indicating the future course of disease but also in their use to predict patient response to therapy. Due to the many subgroups, mathematical models and computer-assisted analysis are increasingly being used to assess the prognostic information obtained from established clinical and histopathological factors. In addition to describing some recent computer programmes this overview will focus on established molecular markers which have already been extensively validated in clinical practice and on new molecular markers identified by genome-wide studies. PMID:26640290

The unbridged gap between clinical diagnosis and contemporary research on aphasia: A short discussion on the validity and clinical utility of taxonomic categories.

PubMed

Kasselimis, Dimitrios S; Simos, Panagiotis G; Peppas, Christos; Evdokimidis, Ioannis; Potagas, Constantin

2017-01-01

Even if the traditional aphasia classification is continuously questioned by many scholars, it remains widely accepted among clinicians and included in textbooks as the gold standard. The present study aims to investigate the validity and clinical utility of this taxonomy. For this purpose, 65 left-hemisphere stroke patients were assessed and classified with respect to aphasia type based on performance on a Greek adaptation of the Boston Diagnostic Aphasia Examination. MRI and/or CT scans were obtained for each patient and lesions were identified and coded according to location. Results indicate that 26.5% of the aphasic profiles remained unclassified. More importantly, we failed to confirm the traditional lesion-to-syndrome correspondence for 63.5% of patients. Overall, our findings elucidate crucial vulnerabilities of the neo-associationist classification, and further support a deficit-rather than a syndrome-based approach. The issue of unclassifiable patients is also discussed. Copyright © 2016 Elsevier Inc. All rights reserved.

Ensuring relational competency in critical care: Importance of nursing students' communication skills.

PubMed

Sánchez Expósito, Judit; Leal Costa, César; Díaz Agea, José Luis; Carrillo Izquierdo, María Dolores; Jiménez Rodríguez, Diana

2018-02-01

The aim of this study was to analyse the communication skills of students in interactions with simulated critically-ill patients using a new assessment tool to study the relationships between communication skills, teamwork and clinical skills and to analyse the psychometric properties of the tool. A cross-sectional study was conducted to assess the communications skills of 52 students with critically-ill patients through the use of a new measurement tool to score video recordings of simulated clinical scenarios. The 52 students obtained low scores on their skills in communicating with patients. The reliability of the measuring instrument showed good inter-observer agreement (ICC between 0.71 and 0.90) and the validity yielded a positive correlation (p<0.01). The results provide evidence that nursing students lack skills when communicating with critically ill patients in simulated scenarios. The measuring instrument used is therefore deemed valid and reliable for assessing nursing students through a clinical simulation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Predicting Relapse among Young Adults: Psychometric Validation of the Advanced Warning of Relapse (AWARE) Scale

PubMed Central

Kelly, John F.; Hoeppner, Bettina B.; Urbanoski, Karen A.; Slaymaker, Valerie

2011-01-01

Objective Failure to maintain abstinence despite incurring severe harm is perhaps the key defining feature of addiction. Relapse prevention strategies have been developed to attenuate this propensity to relapse, but predicting who will, and who will not, relapse has stymied attempts to more efficiently tailor treatments according to relapse risk profile. Here we examine the psychometric properties of a promising relapse risk measure - the Advance WArning of RElapse scale (AWARE) scale (Miller and Harris, 2000) in an understudied but clinically important sample of young adults. Method Inpatient youth (N=303; Age 18-24; 26% female) completed the AWARE scale and the Brief Symptom Inventory-18 (BSI) at the end of residential treatment, and at 1-, 3-, and 6-months following discharge. Internal and convergent validity was tested for each of these four timepoints using confirmatory factor analysis and correlations (with BSI scores). Predictive validity was tested for relapse 1, 3, and 6 months following discharge, as was incremental utility, where AWARE scores were used as predictors of any substance use while controlling for treatment entry substance use severity and having spent time in a controlled environment following treatment. Results Confirmatory factor analysis revealed a single, internally consistent, 25-item factor that demonstrated convergent validity and predicted subsequent relapse alone and when controlling for other important relapse risk predictors. Conclusions The AWARE scale may be a useful and efficient clinical tool for assessing short-term relapse risk among young people and, thus, could serve to enhance the effectiveness of relapse prevention efforts. PMID:21700396

Predicting relapse among young adults: psychometric validation of the Advanced WArning of RElapse (AWARE) scale.

PubMed

Kelly, John F; Hoeppner, Bettina B; Urbanoski, Karen A; Slaymaker, Valerie

2011-10-01

Failure to maintain abstinence despite incurring severe harm is perhaps the key defining feature of addiction. Relapse prevention strategies have been developed to attenuate this propensity to relapse, but predicting who will, and who will not, relapse has stymied attempts to more efficiently tailor treatments according to relapse risk profile. Here we examine the psychometric properties of a promising relapse risk measure-the Advance WArning of RElapse (AWARE) scale (Miller & Harris, 2000) in an understudied but clinically important sample of young adults. Inpatient youth (N=303; Ages 18-24; 26% female) completed the AWARE scale and the Brief Symptom Inventory-18 (BSI) at the end of residential treatment, and at 1-, 3-, and 6-months following discharge. Internal and convergent validity was tested for each of these four timepoints using confirmatory factor analysis and correlations (with BSI scores). Predictive validity was tested for relapse 1, 3, and 6 months following discharge, as was incremental utility, where AWARE scores were used as predictors of any substance use while controlling for treatment entry substance use severity and having spent time in a controlled environment following treatment. Confirmatory factor analysis revealed a single, internally consistent, 25-item factor that demonstrated convergent validity and predicted subsequent relapse alone and when controlling for other important relapse risk predictors. The AWARE scale may be a useful and efficient clinical tool for assessing short-term relapse risk among young people and, thus, could serve to enhance the effectiveness of relapse prevention efforts. Copyright © 2011 Elsevier Ltd. All rights reserved.

The Control Attitudes Scale-Revised: psychometric evaluation in three groups of patients with cardiac illness.

PubMed

Moser, Debra K; Riegel, Barbara; McKinley, Sharon; Doering, Lynn V; Meischke, Hendrika; Heo, Seongkum; Lennie, Terry A; Dracup, Kathleen

2009-01-01

Perceived control is a construct with important theoretical and clinical implications for healthcare providers, yet practical application of the construct in research and clinical practice awaits development of an easily administered instrument to measure perceived control with evidence of reliability and validity. To test the psychometric properties of the Control Attitudes Scale-Revised (CAS-R) using a sample of 3,396 individuals with coronary heart disease, 513 patients with acute myocardial infarction, and 146 patients with heart failure. Analyses were done separately in each patient group. Reliability was assessed using Cronbach's alpha to determine internal consistency, and item homogeneity was assessed using item-total and interitem correlations. Validity was examined using principal component analysis and testing hypotheses about known associations. Cronbach's alpha values for the CAS-R in patients with coronary heart disease, acute myocardial infarction, and heart failure were all greater than .70. Item-total and interitem correlation coefficients for all items were acceptable in the groups. In factor analyses, the same single factor was extracted in all groups, and all items were loaded moderately or strongly to the factor in each group. As hypothesized in the final construct validity test, in all groups, patients with higher levels of perceived control had less depression and less anxiety compared with those of patients who had lower levels of perceived control. This study provides evidence of the reliability and validity of the 8-item CAS-R as a measure of perceived control in patients with cardiac illness and provides important insight into a key patient construct.

The impact of clinical nurse specialists on clinical pathways in the application of evidence-based practice.

PubMed

Gurzick, Martha; Kesten, Karen S

2010-01-01

The purpose of this article was to address the call for evidence-based practice through the development of clinical pathways and to assert the role of the clinical nurse specialist (CNS) as a champion in clinical pathway implementation. In the current health care system, providing quality of care while maintaining cost-effectiveness is an ever-growing battle that institutions face. The CNS's role is central to meeting these demands. An extensive literature review has been conducted to validate the use of clinical pathways as a means of improving patient outcomes. This literature also suggests that clinical pathways must be developed, implemented, and evaluated utilizing validated methods including the use of best practice standards. Execution of clinical pathways should include a clinical expert, who has the ability to look at the system as a whole and can facilitate learning and change by employing a multitude of competencies while maintaining a sphere of influence over patient and families, nurses, and the system. The CNS plays a pivotal role in influencing effective clinical pathway development, implementation, utilization, and ongoing evaluation to ensure improved patient outcomes and reduced costs. This article expands upon the call for evidence-based practice through the utilization of clinical pathways to improve patient outcomes and reduce costs and stresses the importance of the CNS as a primary figure for ensuring proper pathway development, implementation, and ongoing evaluation. Copyright 2010 Elsevier Inc. All rights reserved.

Look--but also listen! ReQuest: an essay on a new validated scale to assess the outcome of GERD treatment.

PubMed

Bardhan, Karna D; Berghöfer, Peter

2007-01-01

The ReQuest (Reflux Questionnaire) is a new instrument: a diary developed specifically to allow patients to measure the totality of their gastroesophageal reflux disease (GERD) symptoms and to track changes each day during treatment, an increasingly important need in clinical trials. This paper reviews the background, development, testing, and validation of the instrument and shows how its flexibility allows it to be used in new ways to assess different aspects of GERD. There were four key steps. (1) A full symptom spectrum was gathered from experts, literature and, crucially, from GERD patients, and comprised 67 symptom descriptions. (2) By expert consensus, these symptom descriptions were empirically condensed into six easier-to-handle 'dimensions' (acid complaints, upper abdominal/stomach complaints, lower abdominal/digestive complaints, nausea, sleep disturbances, other complaints), to which the seventh, general well-being, was added, a key feature of the instrument. The symptom burden of each dimension is measured as frequency x intensity (general well-being: intensity only). (3) This prototype instrument was tested in PPI clinical trials involving patients with erosive and non-erosive GERD, while the data generated were used to validate the prototype. (4) Finally, the scale was refined by factor analysis, a statistical process. Detailed statistical testing validating the scale and factor analysis confirmed that empirically condensing the symptom descriptions into dimensions did not affect the measurement properties of the instrument. FURTHER APPLICATION: The structure of ReQuest and its product, which is numerical, makes the instrument highly flexible and allows for its use in other GERD areas. (1) Its subscales, ReQuest-GI and ReQuest-WSO, measure symptoms traditionally associated with reflux and with general well-being, respectively, and permit these to be quantified and tracked independently. (2) Minor degrees of reflux symptoms are common amongst the healthy. The level was determined in a large population without evidence of disease, and a 'GERD symptom threshold' calculated. Reduction below this threshold to 'background levels' is a more realistic end point in clinical trials than the rarely achieved 'complete absence'. (3) ReQuest-GI was re-scaled and integrated with the modified Los Angeles scale used to grade esophageal appearances at endoscopy. The new instrument is a matrix, the ReQuest/LA-classification, which allows both symptoms and endoscopy appearances to be expressed by a single set of numbers in individual patients and in populations. (4) This in turn allows identification of patients who on treatment achieve 'complete remission', i.e. healing and symptom relief. PPI clinical trials confirm that it takes a longer period of treatment to reach this endpoint than healing or symptom relief alone. Thus the conventional 4-8 weeks of PPI therapy may unwittingly result in under-treatment. (5) Studies are in progress to determine the 'minimum clinically important difference' (MCID). This is the minimum change measured on treatment, which is judged as being of clinical benefit, an increasingly important subject. (6) Finally, the ReQuest used in clinical trials has been simplified for application in day-to-day clinical practice. The results obtained with 'ReQuest in Practice', the simplified version, are similar to those observed with the full version, as confirmed in a large-scale study in general practice. The clinical practice version has also been validated. (1) The characteristics of ReQuest make it suitable for use as the primary endpoint in clinical trials assessing the outcome of GERD. (2) The subscales allows for closer examination on the nature of GERD and response to treatment. (3) A simplified version has proven suitable for use in daily practice. Copyright 2007 S. Karger AG, Basel.

Experimental and clinical experience with iodine 123-labeled iodophenylpentadecanoic acid in cardiology.

PubMed

Reske, S N

1994-01-01

Iodine 123-labeled iodophenylpentadecanoic acid (IPPA) has been synthesized for investigating myocardial free fatty acid (FFA) metabolism. The diagnostic application of labeled FFA in heart disease may be important, because FFA is the preferred substrate of cardiac energy metabolism at rest in the fasting state. In addition, regional myocardial FFA uptake and regional myocardial blood flow are tightly coupled in normal myocardium with beta-oxidation, which is extremely sensitive to oxygen deprivation. This article outlines basic physiologic pathways of cardiac IPPA metabolism in normal, acutely ischemic, and reperfused viable myocardium and summarizes the results of experimental studies in animals, validating the application of IPPA as an 123I-labeled fatty acid analog. In addition, the most important clinical studies indicating the clinical use of IPPA for diagnosis of coronary heart disease and myocardial viability are presented.

Nursing Diagnosis of "Spiritual Distress" in Women With Breast Cancer: Prevalence and Major Defining Characteristics.

PubMed

Caldeira, Sílvia; Timmins, Fiona; de Carvalho, Emília C; Vieira, Margarida

2016-01-01

Spirituality and spiritual needs of cancer patients are frequently mentioned in the nursing literature, but the most significant defining characteristics of spiritual distress in the context of clinical reasoning and nursing diagnosis are rarely explored. Understanding of these is important for effective spiritual intervention. The aim of this study was to identify the prevalence and the defining characteristics of the nursing diagnosis "spiritual distress," as classified according to NANDA International, among women with breast cancer. This was a quantitative and cross-sectional study, comprising the third phase of a larger study investigating the clinical validation of spiritual distress in cancer patients undergoing chemotherapy. Fehring's clinical diagnostic validation model was used to identify the prevalence and the major defining characteristics of the diagnosis. A convenience sample was used, and data were collected by structured interview. A total of 70 women participated; most were married (62.9%) and had a mean age of 54 years, and 55.7% reported having at least 1 person depending on them. The average length of time since the cancer diagnosis was 30.9 months. Twenty-seven participants were experiencing spiritual distress (38.6%). Eleven defining characteristics were classified as major. The prevalence of spiritual distress and the major defining characteristics give clinical evidence about the nurse's role in providing spiritual care. The results are useful for the improved use of the NANDA International diagnoses within this domain. The findings highlight the importance of assessing the defining characteristics of the diagnosis as an objective strategy to improve clinical reasoning related to spirituality and to facilitate more effective interventions.

Potentials of single-cell biology in identification and validation of disease biomarkers.

PubMed

Niu, Furong; Wang, Diane C; Lu, Jiapei; Wu, Wei; Wang, Xiangdong

2016-09-01

Single-cell biology is considered a new approach to identify and validate disease-specific biomarkers. However, the concern raised by clinicians is how to apply single-cell measurements for clinical practice, translate the message of single-cell systems biology into clinical phenotype or explain alterations of single-cell gene sequencing and function in patient response to therapies. This study is to address the importance and necessity of single-cell gene sequencing in the identification and development of disease-specific biomarkers, the definition and significance of single-cell biology and single-cell systems biology in the understanding of single-cell full picture, the development and establishment of whole-cell models in the validation of targeted biological function and the figure and meaning of single-molecule imaging in single cell to trace intra-single-cell molecule expression, signal, interaction and location. We headline the important role of single-cell biology in the discovery and development of disease-specific biomarkers with a special emphasis on understanding single-cell biological functions, e.g. mechanical phenotypes, single-cell biology, heterogeneity and organization of genome function. We have reason to believe that such multi-dimensional, multi-layer, multi-crossing and stereoscopic single-cell biology definitely benefits the discovery and development of disease-specific biomarkers. © 2016 The Authors. Journal of Cellular and Molecular Medicine published by John Wiley & Sons Ltd and Foundation for Cellular and Molecular Medicine.

The FACT-G7: a rapid version of the functional assessment of cancer therapy-general (FACT-G) for monitoring symptoms and concerns in oncology practice and research.

PubMed

Yanez, B; Pearman, T; Lis, C G; Beaumont, J L; Cella, D

2013-04-01

Health-related quality-of-life (HRQOL) assessments in research and clinical oncology settings are increasingly important. HRQOL instruments need to be rapid and still maintain the ability to capture the most relevant patient issues in a valid and reliable manner. The current study develops and validates the FACT-G7, a rapid version of the Functional Assessment of Cancer Therapy-General (FACT-G). Oncology patients with advanced cancer (N = 533) from 11 diseases sites ranked the symptoms and concerns they viewed as 'the very most important' when undergoing cancer treatment, completed the FACT-G, and additional HRQOL measures. Oncology patients' scores were referenced across a general US population sample (N = 2000). We selected the highest priority cancer-related symptoms and concerns endorsed by patients for inclusion in the FACT-G7. Fatigue and ability to enjoy life were ranked the most highly. The results provide preliminary support for the FACT-G7's internal consistency reliability (α = 0.74) and validity as evidenced by moderate-to-strong relationships with expected criteria. The references for the general population are summarized. The FACT-G7 can be used to assess top-rated symptoms and concerns for a broad spectrum of advanced cancers in clinical practice and research.

Measuring psychological flexibility in medical students and residents: a psychometric analysis

PubMed Central

Palladino, Christie L.; Ange, Brittany; Richardson, Deborah S.; Casillas, Rhonda; Decker, Matt; Gillies, Ralph A.; House, Amy; Rollock, Michael; Salazar, William H.; Waller, Jennifer L.; Zeidan, Ronnie; Stepleman, Lara

2013-01-01

Purpose Psychological flexibility involves mindful awareness of our thoughts and feelings without allowing them to prohibit acting consistently with our values and may have important implications for patient-centered clinical care. Although psychological flexibility appears quite relevant to the training and development of health care providers, prior research has not evaluated measures of psychological flexibility in medical learners. Therefore, we investigated the validity of our learners’ responses to three measures related to psychological flexibility. Methods Fourth-year medical students and residents (n=275) completed three measures of overlapping aspects of psychological flexibility: (1) Acceptance and Action Questionnaire-II (AAQ-II); (2) Cognitive Fusion Questionnaire (CFQ); and (3) Mindful Attention and Awareness Questionnaire (MAAS). We evaluated five aspects of construct validity: content, response process, internal structure, relationship with other variables, and consequences. Results We found good internal consistency for responses on the AAQ (α=0.93), MAAS (α=0.92), and CFQ (α=0.95). Factor analyses demonstrated a reasonable fit to previously published factor structures. As expected, scores on all three measures were moderately correlated with one another and with a measure of life satisfaction (p<0.01). Conclusion Our findings provide preliminary evidence supporting validity of the psychological flexibility construct in a medical education sample. As psychological flexibility is a central concept underlying self-awareness, this work may have important implications for clinical training and practice. PMID:23948496

Transcultural Endocrinology: Adapting Type-2 Diabetes Guidelines on a Global Scale.

PubMed

Nieto-Martínez, Ramfis; González-Rivas, Juan P; Florez, Hermes; Mechanick, Jeffrey I

2016-12-01

Type-2 diabetes (T2D) needs to be prevented and treated effectively to reduce its burden and consequences. White papers, such as evidence-based clinical practice guidelines (CPG) and their more portable versions, clinical practice algorithms and clinical checklists, may improve clinical decision-making and diabetes outcomes. However, CPG are underused and poorly validated. Protocols that translate and implement these CPG are needed. This review presents the global dimension of T2D, details the importance of white papers in the transculturalization process, compares relevant international CPG, analyzes cultural variables, and summarizes translation strategies that can improve care. Specific protocols and algorithmic tools are provided. Copyright © 2016 Elsevier Inc. All rights reserved.

Personal genome testing: Test characteristics to clarify the discourse on ethical, legal and societal issues

PubMed Central

2011-01-01

Background As genetics technology proceeds, practices of genetic testing have become more heterogeneous: many different types of tests are finding their way to the public in different settings and for a variety of purposes. This diversification is relevant to the discourse on ethical, legal and societal issues (ELSI) surrounding genetic testing, which must evolve to encompass these differences. One important development is the rise of personal genome testing on the basis of genetic profiling: the testing of multiple genetic variants simultaneously for the prediction of common multifactorial diseases. Currently, an increasing number of companies are offering personal genome tests directly to consumers and are spurring ELSI-discussions, which stand in need of clarification. This paper presents a systematic approach to the ELSI-evaluation of personal genome testing for multifactorial diseases along the lines of its test characteristics. Discussion This paper addresses four test characteristics of personal genome testing: its being a non-targeted type of testing, its high analytical validity, low clinical validity and problematic clinical utility. These characteristics raise their own specific ELSI, for example: non-targeted genetic profiling poses serious problems for information provision and informed consent. Questions about the quantity and quality of the necessary information, as well as about moral responsibilities with regard to the provision of information are therefore becoming central themes within ELSI-discussions of personal genome testing. Further, the current low level of clinical validity of genetic profiles raises questions concerning societal risks and regulatory requirements, whereas simultaneously it causes traditional ELSI-issues of clinical genetics, such as psychological and health risks, discrimination, and stigmatization, to lose part of their relevance. Also, classic notions of clinical utility are challenged by the newer notion of 'personal utility.' Summary Consideration of test characteristics is essential to any valuable discourse on the ELSI of personal genome testing for multifactorial diseases. Four key characteristics of the test - targeted/non-targeted testing, analytical validity, clinical validity and clinical utility - together determine the applicability and the relevance of ELSI to specific tests. The paper identifies and discusses four areas of interest for the ELSI-debate on personal genome testing: informational problems, risks, regulatory issues, and the notion of personal utility. PMID:21672210

Subtyping attention-deficit/hyperactivity disorder using temperament dimensions: toward biologically based nosologic criteria

PubMed Central

Karalunas, Sarah L.; Fair, Damien; Musser, Erica D.; Aykes, Kamari; Iyer, Swathi P.; Nigg, Joel T.

2014-01-01

Importance Psychiatric nosology is limited by behavioral and biological heterogeneity within existing disorder categories. The imprecise nature of current nosological distinctions limits both mechanistic understanding and clinical prediction. Here, we demonstrate an approach consistent with the NIMH Research Domain Criteria (RDoC) initiative to identifying superior, neurobiologically-valid subgroups with better predictive capacity than existing psychiatric categories for childhood Attention-Deficit Hyperactivity Disorder (ADHD). Objective Refine subtyping of childhood ADHD by using biologically-based behavioral dimensions (i.e. temperament), novel classification algorithms, and multiple external validators. In doing so, we demonstrate how refined nosology is capable of improving on current predictive capacity of long-term outcomes relative to current DSM-based nosology. Design, Setting, Participants 437 clinically well-characterized, community-recruited children with and without ADHD participated in an on-going longitudinal study. Baseline data were used to classify children into subgroups based on temperament dimensions and to examine external validators including physiological and MRI measures. One-year longitudinal follow-up data are reported for a subgroup of the ADHD sample to address stability and clinical prediction. Main Outcome Measures Parent/guardian ratings of children on a measure of temperament were used as input features in novel community detection analyses to identify subgroups within the sample. Groups were validated using three widely-accepted external validators: peripheral physiology (cardiac measures of respiratory sinus arrhythmia and pre-ejection period), central nervous system functioning (via resting-state functional connectivity MRI), and clinical outcomes (at one-year longitudinal follow-up). Results The community detection algorithm suggested three novel types of ADHD, labeled as “Mild” (normative emotion regulation); “Surgent” (extreme levels of positive approach-motivation); and “Irritable” (extreme levels of negative emotionality, anger, and poor soothability). Types were independent of existing clinical demarcations, including DSM-5 presentations or symptom severity. These types showed stability over time and were distinguished by unique patterns of cardiac physiological response, resting-state functional brain connectivity, and clinical outcome one year later. Conclusions and Relevance Results suggest that a biologically-informed temperament-based typology, developed with a discovery-based community detection algorithm, provided a superior description of heterogeneity in the ADHD population than any current clinical nosology. This demonstration sets the stage for more aggressive attempts at a tractable, biologically-based nosology. PMID:25006969

Recommendations for the Definition of Clinical Responder in Insulin Preservation Studies

PubMed Central

Gitelman, Stephen E.; Palmer, Jerry P.

2014-01-01

Clinical responder studies should contribute to the translation of effective treatments and interventions to the clinic. Since ultimately this translation will involve regulatory approval, we recommend that clinical trials prespecify a responder definition that can be assessed against the requirements and suggestions of regulatory agencies. In this article, we propose a clinical responder definition to specifically assist researchers and regulatory agencies in interpreting the clinical importance of statistically significant findings for studies of interventions intended to preserve β-cell function in newly diagnosed type 1 diabetes. We focus on studies of 6-month β-cell preservation in type 1 diabetes as measured by 2-h–stimulated C-peptide. We introduce criteria (bias, reliability, and external validity) for the assessment of responder definitions to ensure they meet U.S. Food and Drug Administration and European Medicines Agency guidelines. Using data from several published TrialNet studies, we evaluate our definition (no decrease in C-peptide) against published alternatives and determine that our definition has minimum bias with external validity. We observe that reliability could be improved by using changes in C-peptide later than 6 months beyond baseline. In sum, to support efficacy claims of β-cell preservation therapies in type 1 diabetes submitted to U.S. and European regulatory agencies, we recommend use of our definition. PMID:24722251

Upper gastrointestinal bleeding risk scores: Who, when and why?

PubMed Central

Monteiro, Sara; Gonçalves, Tiago Cúrdia; Magalhães, Joana; Cotter, José

2016-01-01

Upper gastrointestinal bleeding (UGIB) remains a significant cause of hospital admission. In order to stratify patients according to the risk of the complications, such as rebleeding or death, and to predict the need of clinical intervention, several risk scores have been proposed and their use consistently recommended by international guidelines. The use of risk scoring systems in early assessment of patients suffering from UGIB may be useful to distinguish high-risks patients, who may need clinical intervention and hospitalization, from low risk patients with a lower chance of developing complications, in which management as outpatients can be considered. Although several scores have been published and validated for predicting different outcomes, the most frequently cited ones are the Rockall score and the Glasgow Blatchford score (GBS). While Rockall score, which incorporates clinical and endoscopic variables, has been validated to predict mortality, the GBS, which is based on clinical and laboratorial parameters, has been studied to predict the need of clinical intervention. Despite the advantages previously reported, their use in clinical decisions is still limited. This review describes the different risk scores used in the UGIB setting, highlights the most important research, explains why and when their use may be helpful, reflects on the problems that remain unresolved and guides future research with practical impact. PMID:26909231

Concurrent validity and clinical usefulness of several individually administered tests of children's social-emotional cognition.

PubMed

McKown, Clark

2007-03-01

In this study, the validity of 5 tests of children's social-emotional cognition, defined as their encoding, memory, and interpretation of social information, was tested. Participants were 126 clinic-referred children between the ages of 5 and 17. All 5 tests were evaluated in terms of their (a) concurrent validity, (b) incremental validity, and (c) clinical usefulness in predicting social functioning. Tests included measures of nonverbal sensitivity, social language, and social problem solving. Criterion measures included parent and teacher report of social functioning. Analyses support the concurrent validity of all measures, and the incremental validity and clinical usefulness of tests of pragmatic language and problem solving.

Psychometric properties of the Numeric Pain Rating Scale and Neck Disability Index in patients with cervicogenic headache.

PubMed

Young, Ian A; Dunning, James; Butts, Raymond; Cleland, Joshua A; Fernández-de-Las-Peñas, César

2018-01-01

Background Self-reported disability and pain intensity are commonly used outcomes in patients with cervicogenic headaches. However, there is a paucity of psychometric evidence to support the use of these self-report outcomes for individuals treated with cervicogenic headaches. Therefore, it is unknown if these measures are reliable, responsive, or result in meaningful clinically important changes in this patient population. Methods A secondary analysis of a randomized clinical trial (n = 110) examining the effects of spinal manipulative therapy with and without exercise in patients with cervicogenic headaches. Reliability, construct validity, responsiveness and thresholds for minimal detectable change and clinically important difference values were calculated for the Neck Disability Index and Numeric Pain Rating Scale. Results The Neck Disability Index exhibited excellent reliability (ICC = 0.92; [95 % CI: 0.46-0.97]), while the Numeric Pain Rating Scale exhibited moderate reliability (ICC = 0.72; [95 % CI: 0.08-0.90]) in the short term. Both instruments also exhibited adequate responsiveness (area under the curve; range = 0.78-0.93) and construct validity ( p < 0.001) in this headache population. Conclusions Both instruments seem well suited as short-term self-report measures for patients with cervicogenic headaches. Clinicians and researchers should expect at least a 2.5-point reduction on the numeric pain rating scale and a 5.5-point reduction on the neck disability index after 4 weeks of intervention to be considered clinically meaningful.

An information management system for patients with tuberculosis: usability assessment with end-users.

PubMed

Darby, Jonathan; Black, Jim; Morrison, David; Buising, Kirsty

2012-01-01

Information systems with clinical decision support (CDS) offer great potential to assist the co-ordination of patients with chronic diseases and to improve patient care. Despite this, few have entered routine clinical use. Tuberculosis (TB) is an infection of public health importance. It has complex interactions with many comorbid conditions, requires close supervised care and prolonged treatment for effective cure. These features make it suitable for use with an information management system with CDS features. In close consultation with key stakeholders, a clinical application was developed for the management of TB patients in Victoria. A formal usability assessment using semi-structured case-scenario based exercises was performed. Subjects were 12 individuals closely involved in the care of TB patients, including Infectious Diseases and Respiratory Physicians, and Public Health Nurses. Two researchers conducted the sessions, independently analysed responses and discrepancies compared to the voice record for validity. Despite varied computer experience, responses were positive regarding user interface and content. Data location was not always intuitive, however this improved with familiarity of the program. Decision support was considered valuable, with useful suggestions for expansion of these features. Automated reporting for correspondence and notification to the Health Department were felt worth the initial investment in data entry. An important workflow-based issue regarding dismissal of alerts and several errors were detected. Usability assessment validated many design elements of the system, provided a unique insight into workflow issues faced by users and hopefully will impact on its ultimate clinical utility.

An interlaboratory transfer of a multi-analyte assay between continents.

PubMed

Georgiou, Alexandra; Dong, Kelly; Hughes, Stephen; Barfield, Matthew

2015-01-01

Alex has worked at GlaxoSmithKline for the past 15 years and currently works within the bioanalytical and toxicokinetic group in the United Kingdom. Alex's role in previous years has been the in-house support of preclinical and clinical bioanalysis, from method development through to sample analysis activities as well as acting as PI for GLP bioanalysis and toxicokinetics. For the past two years, Alex has applied this analytical and regulatory experience to focus on the outsourcing of preclinical bioanalysis, toxicokinetics and clinical bioanalysis, working closely with multiple bioanalytical and in-life CRO partners worldwide. Alex works to support DMPK and Safety Assessment outsourcing activities for GSK across multiple therapeutic areas, from the first GLP study through to late stage clinical PK studies. Transfer and cross-validation of an existing analytical assay between a laboratory providing current analytical support, and a laboratory needed for new or additional support, can present the bioanalyst with numerous challenges. These challenges can be technical or logistical in nature and may prove to be significant when transferring an assay between laboratories in different continents. Part of GlaxoSmithKline's strategy to improve confidence in providing quality data, is to cross-validate between laboratories. If the cross-validation fails predefined acceptance criteria, then a subsequent investigation would follow. This may also prove to be challenging. The importance of thorough planning and good communication throughout assay transfer, cross-validation and any subsequent investigations is illustrated in this case study.

Development of a Bayesian model to estimate health care outcomes in the severely wounded

PubMed Central

Stojadinovic, Alexander; Eberhardt, John; Brown, Trevor S; Hawksworth, Jason S; Gage, Frederick; Tadaki, Douglas K; Forsberg, Jonathan A; Davis, Thomas A; Potter, Benjamin K; Dunne, James R; Elster, E A

2010-01-01

Background: Graphical probabilistic models have the ability to provide insights as to how clinical factors are conditionally related. These models can be used to help us understand factors influencing health care outcomes and resource utilization, and to estimate morbidity and clinical outcomes in trauma patient populations. Study design: Thirty-two combat casualties with severe extremity injuries enrolled in a prospective observational study were analyzed using step-wise machine-learned Bayesian belief network (BBN) and step-wise logistic regression (LR). Models were evaluated using 10-fold cross-validation to calculate area-under-the-curve (AUC) from receiver operating characteristics (ROC) curves. Results: Our BBN showed important associations between various factors in our data set that could not be developed using standard regression methods. Cross-validated ROC curve analysis showed that our BBN model was a robust representation of our data domain and that LR models trained on these findings were also robust: hospital-acquired infection (AUC: LR, 0.81; BBN, 0.79), intensive care unit length of stay (AUC: LR, 0.97; BBN, 0.81), and wound healing (AUC: LR, 0.91; BBN, 0.72) showed strong AUC. Conclusions: A BBN model can effectively represent clinical outcomes and biomarkers in patients hospitalized after severe wounding, and is confirmed by 10-fold cross-validation and further confirmed through logistic regression modeling. The method warrants further development and independent validation in other, more diverse patient populations. PMID:21197361

Psychometric properties and clinical utility of the Scale for Suicidal Ideation (SSI) in adolescents

PubMed Central

Holi, Matti M; Pelkonen, Mirjami; Karlsson, Linnea; Kiviruusu, Olli; Ruuttu, Titta; Heilä, Hannele; Tuisku, Virpi; Marttunen, Mauri

2005-01-01

Background Accurate assessment of suicidality is of major importance in both clinical and research settings. The Scale for Suicidal Ideation (SSI) is a well-established clinician-rating scale but its suitability to adolescents has not been studied. The aim of this study was to evaluate the reliability and validity, and to test an appropriate cutoff threshold for the SSI in a depressed adolescent outpatient population and controls. Methods 218 adolescent psychiatric outpatient clinic patients suffering from depressive disorders and 200 age- and sex-matched school-attending controls were evaluated by the SSI for presence and severity of suicidal ideation. Internal consistency, discriminative-, concurrent-, and construct validity as well as the screening properties of the SSI were evaluated. Results Cronbach's α for the whole SSI was 0.95. The SSI total score differentiated patients and controls, and increased statistically significantly in classes with increasing severity of suicidality derived from the suicidality items of the K-SADS-PL diagnostic interview. Varimax-rotated principal component analysis of the SSI items yielded three theoretically coherent factors suggesting construct validity. Area under the receiver operating characteristic (ROC) curve was 0.84 for the whole sample and 0.80 for the patient sample. The optimal cutoff threshold for the SSI total score was 3/4 yielding sensitivity of 75% and specificity of 88.9% in this population. Conclusions SSI appears to be a reliable and a valid measure of suicidal ideation for depressed adolescents. PMID:15691388

Psychometric properties and clinical utility of the Scale for Suicidal Ideation (SSI) in adolescents.

PubMed

Holi, Matti M; Pelkonen, Mirjami; Karlsson, Linnea; Kiviruusu, Olli; Ruuttu, Titta; Heilä, Hannele; Tuisku, Virpi; Marttunen, Mauri

2005-02-03

Accurate assessment of suicidality is of major importance in both clinical and research settings. The Scale for Suicidal Ideation (SSI) is a well-established clinician-rating scale but its suitability to adolescents has not been studied. The aim of this study was to evaluate the reliability and validity, and to test an appropriate cutoff threshold for the SSI in a depressed adolescent outpatient population and controls. 218 adolescent psychiatric outpatient clinic patients suffering from depressive disorders and 200 age- and sex-matched school-attending controls were evaluated by the SSI for presence and severity of suicidal ideation. Internal consistency, discriminative-, concurrent-, and construct validity as well as the screening properties of the SSI were evaluated. Cronbach's alpha for the whole SSI was 0.95. The SSI total score differentiated patients and controls, and increased statistically significantly in classes with increasing severity of suicidality derived from the suicidality items of the K-SADS-PL diagnostic interview. Varimax-rotated principal component analysis of the SSI items yielded three theoretically coherent factors suggesting construct validity. Area under the receiver operating characteristic (ROC) curve was 0.84 for the whole sample and 0.80 for the patient sample. The optimal cutoff threshold for the SSI total score was 3/4 yielding sensitivity of 75% and specificity of 88.9% in this population. SSI appears to be a reliable and a valid measure of suicidal ideation for depressed adolescents.

Development of a brief instrument to measure smartphone addiction among nursing students.

PubMed

Cho, Sumi; Lee, Eunjoo

2015-05-01

Interruptions and distractions due to smartphone use in healthcare settings pose potential risks to patient safety. Therefore, it is important to assess smartphone use at work, to encourage nursing students to review their relevant behaviors, and to recognize these potential risks. This study's aim was to develop a scale to measure smartphone addiction and test its validity and reliability. We investigated nursing students' experiences of distractions caused by smartphones in the clinical setting and their opinions about smartphone use policies. Smartphone addiction and the need for a scale to measure it were identified through a literature review and in-depth interviews with nursing students. This scale showed reliability and validity with exploratory and confirmatory factor analysis. In testing the discriminant and convergent validity of the selected (18) items with four factors, the smartphone addiction model explained approximately 91% (goodness-of-fit index = 0.909) of the variance in the data. Pearson correlation coefficients among addiction level, distractions in the clinical setting, and attitude toward policies on smartphone use were calculated. Addiction level and attitude toward policies of smartphone use were negatively correlated. This study suggests that healthcare organizations in Korea should create practical guidelines and policies for the appropriate use of smartphones in clinical practice.

Hepatic fibrosis: Concept to treatment.

PubMed

Trautwein, Christian; Friedman, Scott L; Schuppan, Detlef; Pinzani, Massimo

2015-04-01

Understanding the molecular mechanisms underlying liver fibrogenesis is fundamentally relevant to developing new treatments that are independent of the underlying etiology. The increasing success of antiviral treatments in blocking or reversing the fibrogenic progression of chronic liver disease has unearthed vital information about the natural history of fibrosis regression, and has established important principles and targets for antifibrotic drugs. Although antifibrotic activity has been demonstrated for many compounds in vitro and in animal models, none has been thoroughly validated in the clinic or commercialized as a therapy for fibrosis. In addition, it is likely that combination therapies that affect two or more key pathogenic targets and/or pathways will be needed. To accelerate the preclinical development of these combination therapies, reliable single target validation is necessary, followed by the rational selection and systematic testing of combination approaches. Improved noninvasive tools for the assessment of fibrosis content, fibrogenesis and fibrolysis must accompany in vivo validation in experimental fibrosis models, and especially in clinical trials. The rapidly changing landscape of clinical trial design for liver disease is recognized by regulatory agencies in the United States (FDA) and Western Europe (EMA), who are working together with the broad range of stakeholders to standardize approaches to testing antifibrotic drugs in cohorts of patients with chronic liver diseases. Copyright © 2015. Published by Elsevier B.V.

Validation of the Ottawa Knee Rules.

PubMed

Emparanza, J I; Aginaga, J R

2001-10-01

We sought to validate the Ottawa Knee Rules for determining the need for radiography in patients with acute knee injury. A prospective cohort study was performed in emergency departments of 11 hospitals of the Osakidetza-Basque Country Health Service. The patient population was composed of a convenience sample of 1,522 eligible adults of 2,315 patients with acute knee injuries. The attending emergency physicians assessed each patient for standardized clinical variables and determined the need for radiography according to the decision rule. Radiography was performed in each patient, irrespective of the determination of the rule, after clinical evaluation findings were recorded. The rule was assessed for the ability to correctly identify fracture of the knee. The decision rule had a sensitivity of 1.0 (95% confidence interval [CI] 0.96 to 1.0), identifying 89 patients with clinically important fractures. The potential reduction in use of radiography was estimated to be 49%. The probability of fracture, if the decision rules were negative, is estimated to be 0% (95% CI 0% to 0.5%). Prospective validation has shown the Ottawa Knee Rules to be 100% sensitive for identifying fractures of the knee and to have the potential to allow physicians to reduce the use of radiography in patients with acute knee injuries.

Calibration of Clinical Audio Recording and Analysis Systems for Sound Intensity Measurement.

PubMed

Maryn, Youri; Zarowski, Andrzej

2015-11-01

Sound intensity is an important acoustic feature of voice/speech signals. Yet recordings are performed with different microphone, amplifier, and computer configurations, and it is therefore crucial to calibrate sound intensity measures of clinical audio recording and analysis systems on the basis of output of a sound-level meter. This study was designed to evaluate feasibility, validity, and accuracy of calibration methods, including audiometric speech noise signals and human voice signals under typical speech conditions. Calibration consisted of 3 comparisons between data from 29 measurement microphone-and-computer systems and data from the sound-level meter: signal-specific comparison with audiometric speech noise at 5 levels, signal-specific comparison with natural voice at 3 levels, and cross-signal comparison with natural voice at 3 levels. Intensity measures from recording systems were then linearly converted into calibrated data on the basis of these comparisons, and validity and accuracy of calibrated sound intensity were investigated. Very strong correlations and quasisimilarity were found between calibrated data and sound-level meter data across calibration methods and recording systems. Calibration of clinical sound intensity measures according to this method is feasible, valid, accurate, and representative for a heterogeneous set of microphones and data acquisition systems in real-life circumstances with distinct noise contexts.

The validity of the multi-informant approach to assessing child and adolescent mental health.

PubMed

De Los Reyes, Andres; Augenstein, Tara M; Wang, Mo; Thomas, Sarah A; Drabick, Deborah A G; Burgers, Darcy E; Rabinowitz, Jill

2015-07-01

Child and adolescent patients may display mental health concerns within some contexts and not others (e.g., home vs. school). Thus, understanding the specific contexts in which patients display concerns may assist mental health professionals in tailoring treatments to patients' needs. Consequently, clinical assessments often include reports from multiple informants who vary in the contexts in which they observe patients' behavior (e.g., patients, parents, teachers). Previous meta-analyses indicate that informants' reports correlate at low-to-moderate magnitudes. However, is it valid to interpret low correspondence among reports as indicating that patients display concerns in some contexts and not others? We meta-analyzed 341 studies published between 1989 and 2014 that reported cross-informant correspondence estimates, and observed low-to-moderate correspondence (mean internalizing: r = .25; mean externalizing: r = .30; mean overall: r = .28). Informant pair, mental health domain, and measurement method moderated magnitudes of correspondence. These robust findings have informed the development of concepts for interpreting multi-informant assessments, allowing researchers to draw specific predictions about the incremental and construct validity of these assessments. In turn, we critically evaluated research on the incremental and construct validity of the multi-informant approach to clinical child and adolescent assessment. In so doing, we identify crucial gaps in knowledge for future research, and provide recommendations for "best practices" in using and interpreting multi-informant assessments in clinical work and research. This article has important implications for developing personalized approaches to clinical assessment, with the goal of informing techniques for tailoring treatments to target the specific contexts where patients display concerns. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

Comparing Parent-Child Interactions in the Clinic and at Home: An Exploration of the Validity of Clinical Behavior Observations Using Sequential Analysis

ERIC Educational Resources Information Center

Shriver, Mark D.; Frerichs, Lynae J.; Williams, Melissa; Lancaster, Blake M.

2013-01-01

Direct observation is often considered the "gold standard" for assessing the function, frequency, and intensity of problem behavior. Currently, the literature investigating the construct validity of direct observation conducted in the clinic setting reveals conflicting results. Previous studies on the construct validity of clinic-based…

Systematic review of the clinical and economic value of gene expression profiles for invasive early breast cancer available in Europe.

PubMed

Blok, E J; Bastiaannet, E; van den Hout, W B; Liefers, G J; Smit, V T H B M; Kroep, J R; van de Velde, C J H

2018-01-01

Gene expression profiles with prognostic capacities have shown good performance in multiple clinical trials. However, with multiple assays available and numerous types of validation studies performed, the added value for daily clinical practice is still unclear. In Europe, the MammaPrint, OncotypeDX, PAM50/Prosigna and Endopredict assays are commercially available. In this systematic review, we aim to assess these assays on four important criteria: Assay development and methodology, clinical validation, clinical utility and economic value. We performed a literature search covering PubMed, Embase, Web of Science and Cochrane, for studies related to one or more of the four selected assays. We identified 147 papers for inclusion in this review. MammaPrint and OncotypeDX both have evidence available, including level IA clinical trial results for both assays. Both assays provide prognostic information. Predictive value has only been shown for OncotypeDX. In the clinical utility studies, a higher reduction in chemotherapy was achieved by OncotypeDX, although the number of available studies differ considerably between tests. On average, economic evaluations estimate that genomic testing results in a moderate increase in total costs, but that these costs are acceptable in relation to the expected improved patient outcome. PAM50/prosigna and EndoPredict showed comparable prognostic capacities, but with less economical and clinical utility studies. Furthermore, for these assays no level IA trial data are available yet. In summary, all assays have shown excellent prognostic capacities. The differences in the quantity and quality of evidence are discussed. Future studies shall focus on the selection of appropriate subgroups for testing and long-term outcome of validation trials, in order to determine the place of these assays in daily clinical practice. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Development of the Assessment of Belief Conflict in Relationship-14 (ABCR-14).

PubMed

Kyougoku, Makoto; Teraoka, Mutsumi; Masuda, Noriko; Ooura, Mariko; Abe, Yasushi

2015-01-01

Nurses and other healthcare workers frequently experience belief conflict, one of the most important, new stress-related problems in both academic and clinical fields. In this study, using a sample of 1,683 nursing practitioners, we developed The Assessment of Belief Conflict in Relationship-14 (ABCR-14), a new scale that assesses belief conflict in the healthcare field. Standard psychometric procedures were used to develop and test the scale, including a qualitative framework concept and item-pool development, item reduction, and scale development. We analyzed the psychometric properties of ABCR-14 according to entropy, polyserial correlation coefficient, exploratory factor analysis, confirmatory factor analysis, average variance extracted, Cronbach's alpha, Pearson product-moment correlation coefficient, and multidimensional item response theory (MIRT). The results of the analysis supported a three-factor model consisting of 14 items. The validity and reliability of ABCR-14 was suggested by evidence from high construct validity, structural validity, hypothesis testing, internal consistency reliability, and concurrent validity. The result of the MIRT offered strong support for good item response of item slope parameters and difficulty parameters. However, the ABCR-14 Likert scale might need to be explored from the MIRT point of view. Yet, as mentioned above, there is sufficient evidence to support that ABCR-14 has high validity and reliability. The ABCR-14 demonstrates good psychometric properties for nursing belief conflict. Further studies are recommended to confirm its application in clinical practice.

Rigour in Moderation Processes is More Important than the Choice of Method

ERIC Educational Resources Information Center

Zahra, Daniel; Robinson, Iain; Roberts, Martin; Coombes, Lee; Cockerill, Josephine; Burr, Steven

2017-01-01

Processes for moderating assessments are much debated in higher education. The myriad approaches to the task vary in their demands on staff time and expertise, and also in how valid, reliable and fair to students they appear. Medical education, with its diverse range of assessments and assessors across clinical and academic domains presents…

Development and Psychometric Evaluation of the Index of Dental Anxiety and Fear (IDAF-4C[superscript +])

ERIC Educational Resources Information Center

Armfield, Jason M.

2010-01-01

The measurement of dental fear is important due to its high prevalence and appreciable individual, clinical, and public health consequences. However, existing measures of dental anxiety and fear (DAF) have theoretical or practical limitations. This study describes the development and subsequent assessment of the reliability and validity of test…

A Cross-Cultural Comparison of Belgian and Vietnamese Children's Social Competence and Behavior

ERIC Educational Resources Information Center

Roskam, Isabelle; Hoang, Thi Vân; Schelstraete, Marie-Anne

2017-01-01

Children's social competence and behavioral adjustment are key issues for child development, education, and clinical research. Cross-cultural analyses are necessary to provide relevant methods of assessing them for cross-cultural research. The aim of the current study was to contribute to this important line of research by validating the 3-factor…

The NEO-FFI in Multiple Sclerosis: Internal Consistency, Factorial Validity, and Correspondence between Self and Informant Reports

ERIC Educational Resources Information Center

Schwartz, Eben S.; Chapman, Benjamin P.; Duberstein, Paul R.; Weinstock-Guttman, Bianca; Benedict, Ralph H. B.

2011-01-01

Personality assessment is a potentially important component of clinical and empirical work with neurological patients because (a) individual differences in personality may be associated with different neurological outcomes and (b) central nervous system changes may give rise to alteration in personality. For personality assessment to be useful to…

A Novel Pupillometric Method for Indexing Word Difficulty in Individuals with and without Aphasia

ERIC Educational Resources Information Center

Chapman, Laura R.; Hallowell, Brooke

2015-01-01

Purpose: Cognitive effort is a clinically important facet of linguistic processing that is often overlooked in the assessment and treatment of people with aphasia (PWA). Furthermore, there is a paucity of valid ways to index cognitive effort in PWA. The construct of cognitive effort has been indexed for decades via pupillometry (measurement of…

The Psychometric Properties of a New Measure of Sensory Behaviors in Autistic Children

ERIC Educational Resources Information Center

Neil, Louise; Green, Dido; Pellicano, Elizabeth

2017-01-01

Unusual reactions to sensory input became part of the diagnostic criteria for autism spectrum disorder in the DSM-5. Measures accurately assessing these symptoms are important for clinical decisions. This study examined the reliability and validity of the Sensory Behavior Questionnaire, a parent-report scale designed to assess frequency and impact…

Karolinska Interpersonal Violence Scale predicts suicide in suicide attempters.

PubMed

Jokinen, Jussi; Forslund, Kaj; Ahnemark, Ewa; Gustavsson, J Petter; Nordström, Peter; Asberg, Marie

2010-08-01

Both childhood trauma and violent behavior are important risk factors for suicidal behavior. The aim of the present study was to construct and validate a clinical rating scale that could measure both the exposure to and the expression of violence in childhood and during adult life and to study the ability of the Karolinska Interpersonal Violence Scale (KIVS) to predict ultimate suicide in suicide attempters. A total of 161 suicide attempters and 95 healthy volunteers were assessed with the KIVS measuring exposure to violence and expressed violent behavior in childhood (between 6-14 years of age) and during adult life (15 years or older). The Buss-Durkee Hostility Inventory (BDHI), "Urge to act out hostility" subscale from the Hostility and Direction of Hostility Questionnaire (HDHQ), and the Early Experience Questionnaire (EEQ) were used for validation. All patients were followed up for cause of death and a minimum of 4 years from entering in the study. Five patients who committed suicide within 4 years had significantly higher scores in exposure to violence as a child, in expressed violent behavior as an adult, and in KIVS total score compared to survivors. Suicide attempters scored significantly higher compared to healthy volunteers in 3 of the 4 KIVS subscales. There were significant correlations between the subscales measuring exposure to and expression of violent behavior during the life cycle. BDHI, Urge to act out hostility, and EEQ validated the KIVS. Exposure to violence in childhood and violent behavior in adulthood are risk factors for completed suicide in suicide attempters. Behavioral dysregulation of aggression is important to assess in clinical work. The KIVS is a valuable new tool for case detection and long-term clinical suicide prevention. Copyright 2010 Physicians Postgraduate Press, Inc.

Validation of genetic modifiers for Duchenne muscular dystrophy: a multicentre study assessing SPP1 and LTBP4 variants.

PubMed

van den Bergen, Janneke C; Hiller, Monika; Böhringer, Stefan; Vijfhuizen, Linda; Ginjaar, Hendrika B; Chaouch, Amina; Bushby, Kate; Straub, Volker; Scoto, Mariacristina; Cirak, Sebahattin; Humbertclaude, Véronique; Claustres, Mireille; Scotton, Chiara; Passarelli, Chiara; Lochmüller, Hanns; Muntoni, Francesco; Tuffery-Giraud, Sylvie; Ferlini, Alessandra; Aartsma-Rus, Annemieke M; Verschuuren, Jan J G M; 't Hoen, Peter Ac; Spitali, Pietro

2015-10-01

Duchenne muscular dystrophy (DMD) is characterised by progressive muscle weakness. It has recently been reported that single nucleotide polymorphisms (SNPs) located in the SPP1 and LTBP4 loci can account for some of the inter-individual variability observed in the clinical disease course. The validation of genetic association in large independent cohorts is a key process for rare diseases in order to qualify prognostic biomarkers and stratify patients in clinical trials. Duchenne patients from five European neuromuscular centres were included. Information about age at wheelchair dependence and steroid use was gathered. Melting curve analysis of PCR fragments or Sanger sequencing were used to genotype SNP rs28357094 in the SPP1 gene in 336 patients. The genotype of SNPs rs2303729, rs1131620, rs1051303 and rs10880 in the LTBP4 locus was determined in 265 patients by mass spectrometry. For both loci, a multivariate analysis was performed, using genotype/haplotype, steroid use and cohort as covariates. We show that corticosteroid treatment and the IAAM haplotype of the LTBP4 gene are significantly associated with prolonged ambulation in patients with DMD. There was no significant association between the SNP rs28357094 in the SPP1 gene and the age of ambulation loss. This study underlines the importance of replicating genetic association studies for rare diseases in large independent cohorts to identify the most robust associations. We anticipate that genotyping of validated genetic associations will become important for the design and interpretation of clinical trials. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

4D pressure MRI: validation through in-vitro experiments and simulations

NASA Astrophysics Data System (ADS)

Schiavazzi, Daniele; Amili, Omid; Coletti, Filippo

2017-11-01

Advances in MRI scan technology and recently developed acquisition sequences have led to the development of 4D flow MRI, a protocol capable of characterizing in-vivo hemodynamics in patients. Thus, the availability of phase-averaged time-resolved three-dimensional blood velocities has opened new opportunities for computing a wide spectrum of totally non-invasive hemodynamic indicators. In this regard, relative pressures play a particularly important role, as they are routinely employed in the clinic to detect cardiovascular abnormalities (e.g., in peripheral artery disease, valve stenosis, hypertension, etc.). In the first part of the talk, we discuss how the relative pressures can be robustly computed through the solution of a pressure Poisson equation and how noise in the velocities affects their estimate. Routine application of these techniques in the clinic, require however a thorough validation on multiple patients/anatomies and systematic comparisons with in-vitro and simulated representations. Thus, the second part of the talk illustrates the use of numerical simulation and in-vitro experimental protocols to validate these indicators with reference to aortic and cerebral vascular anatomies.

Complex and elementary histological scoring systems for articular cartilage repair.

PubMed

Orth, Patrick; Madry, Henning

2015-08-01

The repair of articular cartilage defects is increasingly moving into the focus of experimental and clinical investigations. Histological analysis is the gold standard for a valid and objective evaluation of cartilaginous repair tissue and predominantly relies on the use of established scoring systems. In the past three decades, numerous elementary and complex scoring systems have been described and modified, including those of O'Driscoll, Pineda, Wakitani, Sellers and Fortier for entire defects as well as those according to the International Cartilage Repair Society (ICRS-I/II) for osteochondral tissue biopsies. Yet, this coexistence of different grading scales inconsistently addressing diverse parameters may impede comparability between reported study outcomes. Furthermore, validation of these histological scoring systems has only seldom been performed to date. The aim of this review is (1) to give a comprehensive overview and to compare the most important established histological scoring systems for articular cartilage repair, (2) to describe their specific advantages and pitfalls, and (3) to provide valid recommendations for their use in translational and clinical studies of articular cartilage repair.

Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences

PubMed Central

Parsons, Thomas D.

2015-01-01

An essential tension can be found between researchers interested in ecological validity and those concerned with maintaining experimental control. Research in the human neurosciences often involves the use of simple and static stimuli lacking many of the potentially important aspects of real world activities and interactions. While this research is valuable, there is a growing interest in the human neurosciences to use cues about target states in the real world via multimodal scenarios that involve visual, semantic, and prosodic information. These scenarios should include dynamic stimuli presented concurrently or serially in a manner that allows researchers to assess the integrative processes carried out by perceivers over time. Furthermore, there is growing interest in contextually embedded stimuli that can constrain participant interpretations of cues about a target’s internal states. Virtual reality environments proffer assessment paradigms that combine the experimental control of laboratory measures with emotionally engaging background narratives to enhance affective experience and social interactions. The present review highlights the potential of virtual reality environments for enhanced ecological validity in the clinical, affective, and social neurosciences. PMID:26696869

Rapid stepping test towards virtual visual objects: Feasibility and convergent validity in older adults.

PubMed

Hutzler, Yeshayahu; Korsensky, Olga; Laufer, Yocheved

2017-01-01

Rapid voluntary stepping has been recognized as an important measure of balance control. The purpose of this study was to assess the feasibility and convergent validity of a Rapid Stepping Test protocol utilizing a virtual reality SeeMeTM system (VR-RST) in elderly ambulatory and independent individuals living in a community residential home. Associations between step execution times determined by the system and the Activities-specific Balance Confidence (ABC) Questionnaire, and clinical measures of balance performance in the MiniBESTest and Timed Up and Go (TUG) test, were established in 60 participants (mean age 88.2 ± 5.0 years). All participants completed the study. The correlations of the ABC questionnaire and the clinical tests with VR-RST forward and backward stepping were moderate (ρ rage 0.42-0.52), and weak to moderate with sideward stepping (ρ rage 0.32-0.52). Moderate to strong correlations were found across stepping directions (ρ rage 0.45-0.87). Findings support the test's feasibility and validity and confirm the utility of the VR-RST as an assessment tool in an elderly population.

Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences.

PubMed

Parsons, Thomas D

2015-01-01

An essential tension can be found between researchers interested in ecological validity and those concerned with maintaining experimental control. Research in the human neurosciences often involves the use of simple and static stimuli lacking many of the potentially important aspects of real world activities and interactions. While this research is valuable, there is a growing interest in the human neurosciences to use cues about target states in the real world via multimodal scenarios that involve visual, semantic, and prosodic information. These scenarios should include dynamic stimuli presented concurrently or serially in a manner that allows researchers to assess the integrative processes carried out by perceivers over time. Furthermore, there is growing interest in contextually embedded stimuli that can constrain participant interpretations of cues about a target's internal states. Virtual reality environments proffer assessment paradigms that combine the experimental control of laboratory measures with emotionally engaging background narratives to enhance affective experience and social interactions. The present review highlights the potential of virtual reality environments for enhanced ecological validity in the clinical, affective, and social neurosciences.

The Assessment of Physiotherapy Practice (APP) is a valid measure of professional competence of physiotherapy students: a cross-sectional study with Rasch analysis.

PubMed

Dalton, Megan; Davidson, Megan; Keating, Jenny

2011-01-01

Is the Assessment of Physiotherapy Practice (APP) a valid instrument for the assessment of entry-level competence in physiotherapy students? Cross-sectional study with Rasch analysis of initial (n=326) and validation samples (n=318). Students were assessed on completion of 4, 5, or 6-week clinical placements across one university semester. 298 clinical educators and 456 physiotherapy students at nine universities in Australia and New Zealand provided 644 completed APP instruments. APP data in both samples showed overall fit to a Rasch model of expected item functioning for interval scale measurement. Item 6 (Written communication) exhibited misfit in both samples, but was retained as an important element of competence. The hierarchy of item difficulty was the same in both samples with items related to professional behaviour and communication the easiest to achieve and items related to clinical reasoning the most difficult. Item difficulty was well targeted to person ability. No Differential Item Functioning was identified, indicating that the scale performed in a comparable way regardless of the student's age, gender or amount of prior clinical experience, and the educator's age, gender, or experience as an educator, or the type of facility, university, or clinical area. The instrument demonstrated unidimensionality confirming the appropriateness of summing the scale scores on each item to provide an overall score of clinical competence and was able to discriminate four levels of professional competence (Person Separation Index=0.96). Person ability and raw APP scores had a linear relationship (r(2)=0.99). Rasch analysis supports the interpretation that a student's APP score is an indication of their underlying level of professional competence in workplace practice. Copyright © 2011 Australian Physiotherapy Association. Published by .. All rights reserved.

Comparing Two Processing Pipelines to Measure Subcortical and Cortical Volumes in Patients with and without Mild Traumatic Brain Injury.

PubMed

Reid, Matthew W; Hannemann, Nathan P; York, Gerald E; Ritter, John L; Kini, Jonathan A; Lewis, Jeffrey D; Sherman, Paul M; Velez, Carmen S; Drennon, Ann Marie; Bolzenius, Jacob D; Tate, David F

2017-07-01

To compare volumetric results from NeuroQuant® and FreeSurfer in a service member setting. Since the advent of medical imaging, quantification of brain anatomy has been a major research and clinical effort. Rapid advancement of methods to automate quantification and to deploy this information into clinical practice has surfaced in recent years. NeuroQuant® is one such tool that has recently been used in clinical settings. Accurate volumetric data are useful in many clinical indications; therefore, it is important to assess the intermethod reliability and concurrent validity of similar volume quantifying tools. Volumetric data from 148 U.S. service members across three different experimental groups participating in a study of mild traumatic brain injury (mTBI) were examined. Groups included mTBI (n = 71), posttraumatic stress disorder (n = 22), or a noncranial orthopedic injury (n = 55). Correlation coefficients and nonparametric group mean comparisons were used to assess reliability and concurrent validity, respectively. Comparison of these methods across our entire sample demonstrates generally fair to excellent reliability as evidenced by large intraclass correlation coefficients (ICC = .4 to .99), but little concurrent validity as evidenced by significantly different Mann-Whitney U comparisons for 26 of 30 brain structures measured. While reliability between the two segmenting tools is fair to excellent, volumetric outcomes are statistically different between the two methods. As suggested by both developers, structure segmentation should be visually verified prior to clinical use and rigor should be used when interpreting results generated by either method. Copyright © 2017 by the American Society of Neuroimaging.

Assessment of Community Functioning in People With Schizophrenia and Other Severe Mental Illnesses: A White Paper Based on an NIMH-Sponsored Workshop

PubMed Central

Bellack, Alan S.; Green, Michael F.; Cook, Judith A.; Fenton, Wayne; Harvey, Philip D.; Heaton, Robert K.; Laughren, Thomas; Leon, Andrew C.; Mayo, Donna J.; Patrick, Donald L.; Patterson, Thomas L.; Rose, Andrew; Stover, Ellen; Wykes, Til

2007-01-01

People with schizophrenia frequently have significant problems in community functioning. Progress in developing effective interventions to ameliorate these problems has been slowed by the absence of reliable and valid measures that are suitable for use in clinical trials. The National Institute of Mental Health convened a workgroup in September 2005 to examine this issue and make recommendations to the field that would foster research in this area. This article reports on issues raised at the meeting. Many instruments have been developed to assess community functioning, but overall insufficient attention has been paid to psychometric issues and many instruments are not suitable for use in clinical trials. Consumer self-report, informant report, ratings by clinicians and trained raters, and behavioral assessment all can provide useful and valid information in some circumstances and may be practical for use in clinical trials. However, insufficient attention has been paid to when and how different forms of assessment and sources of information are useful or how to understand inconsistencies. A major limiting factor in development of reliable and valid instruments is failure to develop a suitable model of functioning and its primary mediators and moderators. Several examples that can guide thinking are presented. Finally, the field is limited by the absence of an objective gold standard of community functioning. Hence, outcomes must be evaluated in part by “clinical significance.” This criterion is problematic because different observers and constituencies often have different opinions about what types of change are clinically important and how much change is significant. PMID:16931542

Clinical assessment of the physical activity pattern of chronic fatigue syndrome patients: a validation of three methods.

PubMed

Scheeres, Korine; Knoop, Hans; Meer, van der Jos; Bleijenberg, Gijs

2009-04-01

Effective treatment of chronic fatigue syndrome (CFS) with cognitive behavioural therapy (CBT) relies on a correct classification of so called 'fluctuating active' versus 'passive' patients. For successful treatment with CBT is it especially important to recognise the passive patients and give them a tailored treatment protocol. In the present study it was evaluated whether CFS patient's physical activity pattern can be assessed most accurately with the 'Activity Pattern Interview' (API), the International Physical Activity Questionnaire (IPAQ) or the CFS-Activity Questionnaire (CFS-AQ). The three instruments were validated compared to actometers. Actometers are until now the best and most objective instrument to measure physical activity, but they are too expensive and time consuming for most clinical practice settings. In total 226 CFS patients enrolled for CBT therapy answered the API at intake and filled in the two questionnaires. Directly after intake they wore the actometer for two weeks. Based on receiver operating characteristic (ROC) curves the validity of the three methods were assessed and compared. Both the API and the two questionnaires had an acceptable validity (0.64 to 0.71). None of the three instruments was significantly better than the others. The proportion of false predictions was rather high for all three instrument. The IPAQ had the highest proportion of correct passive predictions (sensitivity 70.1%). The validity of all three instruments appeared to be fair, and all showed rather high proportions of false classifications. Hence in fact none of the tested instruments could really be called satisfactory. Because the IPAQ showed to be the best in correctly predicting 'passive' CFS patients, which is most essentially related to treatment results, it was concluded that the IPAQ is the preferable alternative for an actometer when treating CFS patients in clinical practice.

The Physician Recommendation Coding System (PhyReCS): A Reliable and Valid Method to Quantify the Strength of Physician Recommendations During Clinical Encounters

PubMed Central

Scherr, Karen A.; Fagerlin, Angela; Williamson, Lillie D.; Davis, J. Kelly; Fridman, Ilona; Atyeo, Natalie; Ubel, Peter A.

2016-01-01

Background Physicians’ recommendations affect patients’ treatment choices. However, most research relies on physicians’ or patients’ retrospective reports of recommendations, which offer a limited perspective and have limitations such as recall bias. Objective To develop a reliable and valid method to measure the strength of physician recommendations using direct observation of clinical encounters. Methods Clinical encounters (n = 257) were recorded as part of a larger study of prostate cancer decision making. We used an iterative process to create the 5-point Physician Recommendation Coding System (PhyReCS). To determine reliability, research assistants double-coded 50 transcripts. To establish content validity, we used one-way ANOVAs to determine whether relative treatment recommendation scores differed as a function of which treatment patients received. To establish concurrent validity, we examined whether patients’ perceived treatment recommendations matched our coded recommendations. Results The PhyReCS was highly reliable (Krippendorf’s alpha =. 89, 95% CI [.86, .91]). The average relative treatment recommendation score for each treatment was higher for individuals who received that particular treatment. For example, the average relative surgery recommendation score was higher for individuals who received surgery versus radiation (mean difference = .98, SE = .18, p < .001) or active surveillance (mean difference = 1.10, SE = .14, p < .001). Patients’ perceived recommendations matched coded recommendations 81% of the time. Conclusion The PhyReCS is a reliable and valid way to capture the strength of physician recommendations. We believe that the PhyReCS would be helpful for other researchers who wish to study physician recommendations, an important part of patient decision making. PMID:27343015

The Physician Recommendation Coding System (PhyReCS): A Reliable and Valid Method to Quantify the Strength of Physician Recommendations During Clinical Encounters.

PubMed

Scherr, Karen A; Fagerlin, Angela; Williamson, Lillie D; Davis, J Kelly; Fridman, Ilona; Atyeo, Natalie; Ubel, Peter A

2017-01-01

Physicians' recommendations affect patients' treatment choices. However, most research relies on physicians' or patients' retrospective reports of recommendations, which offer a limited perspective and have limitations such as recall bias. To develop a reliable and valid method to measure the strength of physician recommendations using direct observation of clinical encounters. Clinical encounters (n = 257) were recorded as part of a larger study of prostate cancer decision making. We used an iterative process to create the 5-point Physician Recommendation Coding System (PhyReCS). To determine reliability, research assistants double-coded 50 transcripts. To establish content validity, we used 1-way analyses of variance to determine whether relative treatment recommendation scores differed as a function of which treatment patients received. To establish concurrent validity, we examined whether patients' perceived treatment recommendations matched our coded recommendations. The PhyReCS was highly reliable (Krippendorf's alpha = 0.89, 95% CI [0.86, 0.91]). The average relative treatment recommendation score for each treatment was higher for individuals who received that particular treatment. For example, the average relative surgery recommendation score was higher for individuals who received surgery versus radiation (mean difference = 0.98, SE = 0.18, P < 0.001) or active surveillance (mean difference = 1.10, SE = 0.14, P < 0.001). Patients' perceived recommendations matched coded recommendations 81% of the time. The PhyReCS is a reliable and valid way to capture the strength of physician recommendations. We believe that the PhyReCS would be helpful for other researchers who wish to study physician recommendations, an important part of patient decision making. © The Author(s) 2016.

A standardised, generic, validated approach to stratify the magnitude of clinical benefit that can be anticipated from anti-cancer therapies: the European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS).

PubMed

Cherny, N I; Sullivan, R; Dafni, U; Kerst, J M; Sobrero, A; Zielinski, C; de Vries, E G E; Piccart, M J

2015-08-01

The value of any new therapeutic strategy or treatment is determined by the magnitude of its clinical benefit balanced against its cost. Evidence for clinical benefit from new treatment options is derived from clinical research, in particular phase III randomised trials, which generate unbiased data regarding the efficacy, benefit and safety of new therapeutic approaches. To date, there is no standard tool for grading the magnitude of clinical benefit of cancer therapies, which may range from trivial (median progression-free survival advantage of only a few weeks) to substantial (improved long-term survival). Indeed, in the absence of a standardised approach for grading the magnitude of clinical benefit, conclusions and recommendations derived from studies are often hotly disputed and very modest incremental advances have often been presented, discussed and promoted as major advances or 'breakthroughs'. Recognising the importance of presenting clear and unbiased statements regarding the magnitude of the clinical benefit from new therapeutic approaches derived from high-quality clinical trials, the European Society for Medical Oncology (ESMO) has developed a validated and reproducible tool to assess the magnitude of clinical benefit for cancer medicines, the ESMO Magnitude of Clinical Benefit Scale (ESMO-MCBS). This tool uses a rational, structured and consistent approach to derive a relative ranking of the magnitude of clinically meaningful benefit that can be expected from a new anti-cancer treatment. The ESMO-MCBS is an important first step to the critical public policy issue of value in cancer care, helping to frame the appropriate use of limited public and personal resources to deliver cost-effective and affordable cancer care. The ESMO-MCBS will be a dynamic tool and its criteria will be revised on a regular basis. © The Author 2015. Published by Oxford University Press on behalf of the European Society for Medical Oncology. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Validation of the Portuguese version of the Brief Multidimensional Measure of Religiousness/Spirituality (BMMRS-P) in clinical and non-clinical samples.

PubMed

Curcio, Cristiane Schumann Silva; Lucchetti, Giancarlo; Moreira-Almeida, Alexander

2015-04-01

Despite Brazil's high levels of religious involvement, there is a scarcity of validated religiousness/spirituality (R/S) measures in Portuguese, particularly multidimensional ones. This study presents the validation of the Portuguese version of the "Brief Multidimensional Measure in Religiousness and Spirituality" (BMMRS) within the Brazilian context. Inpatients (262) and caregivers (389) at two hospitals of Brazil answered the BMMRS, the DUREL-p, and a sociodemographic questionnaire. The internal and convergent validity and test-retest reliability for major dimensions were good. Discriminant validity was high (except for the Forgiveness dimension). The Portuguese version of the BMMRS is a reliable and valid instrument to assess multiple R/S dimensions in clinical and non-clinical samples.

Clinical and personality traits in emotional disorders: Evidence of a common framework.

PubMed

Mahaffey, Brittain L; Watson, David; Clark, Lee Anna; Kotov, Roman

2016-08-01

Certain clinical traits (e.g., ruminative response style, self-criticism, perfectionism, anxiety sensitivity, fear of negative evaluation, and thought suppression) increase the risk for and chronicity of emotional disorders. Similar to traditional personality traits, they are considered dispositional and typically show high temporal stability. Because the personality and clinical-traits literatures evolved largely independently, connections between them are not fully understood. We sought to map the interface between a widely studied set of clinical and personality traits. Two samples (N = 385 undergraduates; N = 188 psychiatric outpatients) completed measures of personality traits, clinical traits, and an interview-based assessment of emotional-disorder symptoms. First, the joint factor structure of these traits was examined in each sample. Second, structural equation modeling was used to clarify the effects of clinical traits in the prediction of clinical symptoms beyond negative temperament. Third, the incremental validity of clinical traits beyond a more comprehensive set of higher-order and lower-order personality traits was examined using hierarchical regression. Clinical and personality traits were highly correlated and jointly defined a 3-factor structure-Negative Temperament, Positive Temperament, and Disinhibition-in both samples, with all clinical traits loading on the Negative Temperament factor. Clinical traits showed modest but significant incremental validity in explaining symptoms after accounting for personality traits. These data indicate that clinical traits relevant to emotional disorders fit well within the traditional personality framework and offer some unique contributions to the prediction of psychopathology, but it is important to distinguish their effects from negative temperament/neuroticism. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Convergent validity of actigraphy with polysomnography and parent reports when measuring sleep in children with Down syndrome.

PubMed

Esbensen, A J; Hoffman, E K; Stansberry, E; Shaffer, R

2018-04-01

There is a need for rigorous measures of sleep in children with Down syndrome as sleep is a substantial problem in this population and there are barriers to obtaining the gold standard polysomnography (PSG). PSG is cost-prohibitive when measuring treatment effects in some clinical trials, and children with Down syndrome may not cooperate with undergoing a PSG. Minimal information is available on the validity of alternative methods of assessing sleep in children with Down syndrome, such as actigraphy and parent ratings. Our study examined the concurrent and convergent validity of different measures of sleep, including PSG, actigraphy and parent reports of sleep among children with Down syndrome. A clinic (n = 27) and a community (n = 47) sample of children with Down syndrome were examined. In clinic, children with Down syndrome wore an actigraph watch during a routine PSG. In the community, children with Down syndrome wore an actigraph watch for a week at home at night as part of a larger study on sleep and behaviour. Their parent completed ratings of the child's sleep during that same week. Actigraph watches demonstrated convergent validity with PSG when measuring a child with Down syndrome's total amount of sleep time, total wake time after sleep onset and sleep period efficiency. In contrast, actigraph watches demonstrated poor correlations with parent reports of sleep, and with PSG when measuring the total time in bed and total wake episodes. Actigraphy, PSG and parent ratings of sleep demonstrated poor concurrent validity with clinical diagnosis of obstructive sleep apnoea. Our current data suggest that actigraph watches demonstrate convergent validity and are sensitive to measuring certain sleep constructs (duration, efficiency) in children with Down syndrome. However, parent reports, such as the Children's Sleep Habits Questionnaire, may be measuring other sleep constructs. These findings highlight the importance of selecting measures of sleep related to target concerns. © 2018 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Criterion Validity of the Mood and Feelings Questionnaire for Depressive Episodes in Clinic and Non-Clinic Subjects

ERIC Educational Resources Information Center

Daviss, W. Burleson; Birmaher, Boris; Melhem, Nadine A.; Axelson, David A.; Michaels, Shana M.; Brent, David A.

2006-01-01

Background: Previous measures of pediatric depression have shown inconsistent validity in groups with differing demographics, comorbid diagnoses, and clinic or non-clinic origins. The current study re-examines the criterion validity of child- and parent-versions of the Mood and Feelings Questionnaire (MFQ-C, MFQ-P) in a heterogeneous sample of…

Derivation of a Performance Checklist for Ultrasound-Guided Arthrocentesis Using the Modified Delphi Method.

PubMed

Kunz, Derek; Pariyadath, Manoj; Wittler, Mary; Askew, Kim; Manthey, David; Hartman, Nicholas

2017-06-01

Arthrocentesis is an important skill for physicians in multiple specialties. Recent studies indicate a superior safety and performance profile for this procedure using ultrasound guidance for needle placement, and improving quality of care requires a valid measurement of competency using this modality. We endeavored to create a validated tool to assess the performance of this procedure using the modified Delphi technique and experts in multiple disciplines across the United States. We derived a 22-item checklist designed to assess competency for the completion of ultrasound-guided arthrocentesis, which demonstrated a Cronbach's alpha of 0.89, indicating an excellent degree of internal consistency. Although we were able to demonstrate content validity for this tool, further validity evidence should be acquired after the tool is used and studied in clinical and simulated contexts. © 2017 by the American Institute of Ultrasound in Medicine.

[Nursing outcomes for ineffective breathing patterns and impaired spontaneous ventilation in intensive care].

PubMed

do Canto, Débora Francisco; Almeida, Miriam de Abreu

2013-12-01

This study aimed to validate the results of Nursing selected from the link NANDA-I-NOC (Nursing Outcomes Classification--NANDA--International) for diagnosis Ineffective Breathing Pattern and Impaired Spontaneous Ventilation in adult intensive care unit. This is a content validation study conducted in a university hospital in southern Brazil with 15 expert nurses with clinical experience and knowledge of the ratings. The instruments contained five-point Likert scales to rate the importance of each outcome (1st step) and indicator (Step 2) for the diagnoses studied. We calculated weighted averages for each outcome/indicator, considering) 1 = 0. 2 = 0.25, 3 = 0.50 4 = 0.75 and 5 = 1. The outcomes suggested by the NOC with averages above 0.8 were considered validated as well as the indicators. The results Respiratory State--airway permeability (Ineffective Breathing Patterns) and 11 indicators, and Response to mechanical ventilation: adult (Impaired Spontaneous Ventilation) with 26 indicators were validated.

On the Validity of Beer-Lambert Law and its Significance for Sunscreens.

PubMed

Herzog, Bernd; Schultheiss, Amélie; Giesinger, Jochen

2018-03-01

The sun protection factor (SPF) is the most important quantity to characterize the performance of sunscreens. As the standard method for its determination is based on clinical trials involving irradiation of human volunteers, calculations of sunscreen performance have become quite popular to reduce the number of in vivo studies. Such simulations imply the calculation of UV transmittance of the sunscreen film using the amounts and spectroscopic properties of the UV absorbers employed, and presuppose the validity of the Beer-Lambert law. As sunscreen films on human skin can contain considerable concentrations of UV absorbers, it is questioned whether the Beer-Lambert law is still valid for these systems. The results of this work show that the validity of the Beer-Lambert law is still given at the high concentrations at which UV absorbers occur in sunscreen films on human skin. © 2017 The American Society of Photobiology.

Safety assessment of immunomodulatory biologics: the promise and challenges of regulatory T-cell modulation.

PubMed

Ponce, Rafael A

2011-01-01

Regulatory T-cell (T(reg)) modulation is developing as an important therapeutic opportunity for the treatment of a number of important diseases, including cancer, autoimmunity, infection, and organ transplant rejection. However, as demonstrated with IL-2 and TGN-1412, our understanding of the complex immunological interactions that occur with T(reg) modulation in both non-clinical models and in patients remains limited and appears highly contextual. This lack of understanding will challenge our ability to identify the patient population who might derive the highest benefit from T(reg) modulation and creates special challenges as we transition these therapeutics from non-clinical models into humans. Thus, in vivo testing in the most representative animal model systems, with careful progress in the clinic, will remain critical in developing therapeutics targeting T(reg) and understanding their clinical utility. Moreover, toxicology models can inform some of the potential liabilities associated with T(reg) modulation, but not all, suggesting a continued need to explore and validate predictive models.

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reliability and Validity of the Lichtenberg Financial Decision Screening Scale.

PubMed

Lichtenberg, Peter A; Teresi, Jeanne A; Ocepek-Welikson, Katja; Eimicke, Joseph P

2017-03-01

The scarcity of empirically validated assessment instruments continues to impede the work of professionals in a number of fields, including medicine, finance, and estate planning; adult protective services; and criminal justice-and, more importantly, it impedes their ability to effectively assist and, in some case, protect their clients. Other professionals (e.g. legal, financial, medical, mental health services) are in a position to prevent financial exploitation and would benefit from access to new instruments. The Lichtenberg Financial Decision Screening Scale (LFDSS) was introduced in 2016, along with evidence for its convergent validity (Lichtenberg et al., 2016). Using a sample of 213 participants, this study investigated the internal consistency of the LFDSS and its criterion validity based on ratings by professionals using the scale. Results demonstrate that the LFDSS has excellent internal consistency and clinical utility properties. This paper provides support for use of the LFDSS as a reliable and valid instrument. The LFDSS and instructions for its use are included in the article, along with information about online tools and support.

Patient-Reported Measures of Narcolepsy: The Need for Better Assessment.

PubMed

Kallweit, Ulf; Schmidt, Markus; Bassetti, Claudio L

2017-05-15

Narcolepsy, a chronic disorder of the central nervous system, is clinically characterized by a symptom pentad that includes excessive daytime sleepiness, cataplexy, sleep paralysis, hypnopompic/hypnagogic hallucinations, and disrupted nighttime sleep. Ideally, screening and diagnosis instruments that assist physicians in evaluating a patient for type 1 or type 2 narcolepsy would be brief, easy for patients to understand and physicians to score, and would identify or rule out the need for electrophysiological testing. A search of the literature was conducted to review patient-reported measures used for the assessment of narcolepsy, mainly in clinical trials, with the goal of summarizing existing scales and identifying areas that may require additional screening questions and clinical practice scales. Of the seven scales reviewed, the Epworth Sleepiness Scale continues to be an important outcome measure to screen adults for excessive daytime sleepiness, which may be associated with narcolepsy. Several narcolepsy-specific scales have demonstrated utility, such as the Ullanlinna Narcolepsy Scale, Swiss Narcolepsy Scale, and Narcolepsy Symptom Assessment Questionnaire, but further validation is required. Although the narcolepsy-specific scales currently in use may identify type 1 narcolepsy, there are no validated questionnaires to identify type 2 narcolepsy. Thus, there remains a need for short, easily understood, and well-validated instruments that can be readily used in clinical practice to distinguish narcolepsy subtypes, as well as other hypersomnias, and for assessing symptoms of these conditions during treatment. © 2017 American Academy of Sleep Medicine

Making genomic medicine evidence-based and patient-centered: a structured review and landscape analysis of comparative effectiveness research.

PubMed

Phillips, Kathryn A; Deverka, Patricia A; Sox, Harold C; Khoury, Muin J; Sandy, Lewis G; Ginsburg, Geoffrey S; Tunis, Sean R; Orlando, Lori A; Douglas, Michael P

2017-10-01

Comparative effectiveness research (CER) in genomic medicine (GM) measures the clinical utility of using genomic information to guide clinical care in comparison to appropriate alternatives. We summarized findings of high-quality systematic reviews that compared the analytic and clinical validity and clinical utility of GM tests. We focused on clinical utility findings to summarize CER-derived evidence about GM and identify evidence gaps and future research needs. We abstracted key elements of study design, GM interventions, results, and study quality ratings from 21 systematic reviews published in 2010 through 2015. More than half (N = 13) of the reviews were of cancer-related tests. All reviews identified potentially important clinical applications of the GM interventions, but most had significant methodological weaknesses that largely precluded any conclusions about clinical utility. Twelve reviews discussed the importance of patient-centered outcomes, although few described evidence about the impact of genomic medicine on these outcomes. In summary, we found a very limited body of evidence about the effect of using genomic tests on health outcomes and many evidence gaps for CER to address.Genet Med advance online publication 13 April 2017.

Idiopathic inflammatory myositis.

PubMed

Tieu, Joanna; Lundberg, Ingrid E; Limaye, Vidya

2016-02-01

Knowledge on idiopathic inflammatory myopathy (IIM) has evolved with the identification of myositis-associated and myositis-specific antibodies, development of histopathological classification and the recognition of how these correlate with clinical phenotype and response to therapy. In this paper, we outline key advances in diagnosis and histopathology, including the more recent identification of antibodies associated with immune-mediated necrotising myopathy (IMNM) and inclusion body myositis (IBM). Ongoing longitudinal observational cohorts allow further classification of these patients with IIM, their predicted clinical course and response to specific therapies. Registries have been developed worldwide for this purpose. A challenging aspect in IIM, a multisystem disease with multiple clinical subtypes, has been defining disease status and clinically relevant improvement. Tools for assessing activity and damage are now recognised to be important in determining disease activity and guiding therapeutic decision-making. The International Myositis Assessment and Clinical Studies (IMACS) group has developed such tools for use in research and clinical settings. There is limited evidence for specific treatment strategies in IIM. With significant development in the understanding of IIM and improved classification, longitudinal observational cohorts and trials using validated outcome measures are necessary, to provide important information for evidence-based care in the clinical setting. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

Making genomic medicine evidence-based and patient-centered: a structured review and landscape analysis of comparative effectiveness research

PubMed Central

Phillips, Kathryn A.; Deverka, Patricia A.; Sox, Harold C.; Khoury, Muin J.; Sandy, Lewis G.; Ginsburg, Geoffrey S.; Tunis, Sean R.; Orlando, Lori A.; Douglas, Michael P.

2017-01-01

Comparative effectiveness research (CER) in genomic medicine (GM) measures the clinical utility of using genomic information to guide clinical care in comparison to appropriate alternatives. We summarized findings of high-quality systematic reviews that compared the analytic and clinical validity and clinical utility of GM tests. We focused on clinical utility findings to summarize CER-derived evidence about GM and identify evidence gaps and future research needs. We abstracted key elements of study design, GM interventions, results, and study quality ratings from 21 systematic reviews published in 2010 through 2015. More than half (N = 13) of the reviews were of cancer-related tests. All reviews identified potentially important clinical applications of the GM interventions, but most had significant methodological weaknesses that largely precluded any conclusions about clinical utility. Twelve reviews discussed the importance of patient-centered outcomes, although few described evidence about the impact of genomic medicine on these outcomes. In summary, we found a very limited body of evidence about the effect of using genomic tests on health outcomes and many evidence gaps for CER to address. Genet Med advance online publication 13 April 2017 PMID:28406488

Validity and reliability of the de Morton Mobility Index in the subacute hospital setting in a geriatric evaluation and management population.

PubMed

de Morton, Natalie A; Lane, Kylie

2010-11-01

To investigate the clinimetric properties of the de Morton Mobility Index (DEMMI) in a Geriatric Evaluation and Management (GEM) population. A longitudinal validation study (n = 100) and inter-rater reliability study (n = 29) in a GEM population. Consecutive patients admitted to a GEM rehabilitation ward were eligible for inclusion. At hospital admission and discharge, a physical therapist assessed patients with physical performance instruments that included the 6-metre walk test, step test, Clinical Test of Sensory Organization and Balance, Timed Up and Go test, 6-minute walk test and the DEMMI. Consecutively eligible patients were included in an inter-rater reliability study between physical therapists. DEMMI admission scores were normally distributed (mean 30.2, standard deviation 16.7) and other activity limitation instruments had either a floor or a ceiling effect. Evidence of convergent, discriminant and known groups validity for the DEMMI were obtained. The minimal detectable change with 90% confidence was 10.5 (95% confidence interval 6.1-17.9) points and the minimally clinically important difference was 8.4 points on the 100-point interval DEMMI scale. The DEMMI provides clinicians with an accurate and valid method of measuring mobility for geriatric patients in the subacute hospital setting.

Impact of imaging measurements on response assessment in glioblastoma clinical trials

PubMed Central

Reardon, David A.; Ballman, Karla V.; Buckner, Jan C.; Chang, Susan M.; Ellingson, Benjamin M.

2014-01-01

We provide historical and scientific guidance on imaging response assessment for incorporation into clinical trials to stimulate effective and expedited drug development for recurrent glioblastoma by addressing 3 fundamental questions: (i) What is the current validation status of imaging response assessment, and when are we confident assessing response using today's technology? (ii) What imaging technology and/or response assessment paradigms can be validated and implemented soon, and how will these technologies provide benefit? (iii) Which imaging technologies need extensive testing, and how can they be prospectively validated? Assessment of T1 +/− contrast, T2/FLAIR, diffusion, and perfusion-imaging sequences are routine and provide important insight into underlying tumor activity. Nonetheless, utility of these data within and across patients, as well as across institutions, are limited by challenges in quantifying measurements accurately and lack of consistent and standardized image acquisition parameters. Currently, there exists a critical need to generate guidelines optimizing and standardizing MRI sequences for neuro-oncology patients. Additionally, more accurate differentiation of confounding factors (pseudoprogression or pseudoresponse) may be valuable. Although promising, diffusion MRI, perfusion MRI, MR spectroscopy, and amino acid PET require extensive standardization and validation. Finally, additional techniques to enhance response assessment, such as digital T1 subtraction maps, warrant further investigation. PMID:25313236

Non-technical skills assessment for prelicensure nursing students: An integrative review.

PubMed

Pires, Sara; Monteiro, Sara; Pereira, Anabela; Chaló, Daniela; Melo, Elsa; Rodrigues, Alexandre

2017-11-01

In nursing, non-technical skills are recognized as playing an important role to increase patient safety and successful clinical outcomes (Pearson and McLafferty, 2011). Non-technical skills are cognitive and social resource skills that complement technical skills and contribute to safe and efficient task performance (Flin et al., 2008). In order to effectively provide non-technical skills training, it is essential to have an instrument to measure these skills. An online search was conducted. Articles were selected if they referred to and/or described instruments assessing non-technical skills for nurses and/or prelicensure nursing students in educational, clinical and/or simulated settings with validation evidence (inclusion criteria). Of the 53 articles located, 26 met the inclusion criteria. Those referred to and/or described 16 instruments with validation evidence developed to assess non-technical skills in multidisciplinary teams including nurses. Although articles have shown 16 valid and reliable instruments, to our knowledge, no instrument has been published or developed and validated for the assessment of non-technical skills of only nurses in general, relevant for use in high-fidelity simulation-based training for prelicensure nursing students. Therefore, there is a need for the development of such an instrument. Copyright © 2017 Elsevier Ltd. All rights reserved.

Surrogate clinical endpoints to predict overall survival in non-small cell lung cancer trials-are we in a new era?

PubMed

Clarke, Jeffrey M; Wang, Xiaofei; Ready, Neal E

2015-12-01

Surrogate endpoints for clinical trials in oncology offer an alternative metric for measuring clinical benefit, allowing for shorter trial duration, smaller patient cohorts, and single arm design. The correlation of surrogate endpoints with overall survival (OS) in therapeutic studies is a central consideration to their validity. The Food and Drug Administration (FDA) recently published an analysis of fourteen clinical trials in advanced non-small cell lung cancer (NSCLC), and discovered a strong association between response rate and progression free survival. Furthermore, a correlation between response rate and OS is demonstrated when analyzing the experimental treatment arm separately, minimizing bias from patient crossover. We also highlight multiple, important considerations when using response as an endpoint in clinical trials involving NSCLC patients.

Multisource feedback: 360-degree assessment of professional skills of clinical directors.

PubMed

Palmer, Robert; Rayner, Hugh; Wall, David

2007-08-01

For measuring behaviour of National Health Service (NHS) staff, 360-degree assessment is a valuable tool. The important role of a clinical director as a medical leader is increasingly recognized, and attributes of a good clinical director can be defined. Set against these attributes, a 360-degree assessment tool has been designed. The job description for clinical directors has been used to develop a questionnaire sent to senior hospital staff. The views of staff within the hospital are similar irrespective of gender, post held or length of time in post. Analysis has shown that three independent factors can be distilled, namely operational management, interpersonal skills and creative/strategic thinking. A simple validated questionnaire has been developed and successfully introduced for the 360-degree assessment of clinical directors.

'Mechanical restraint-confounders, risk, alliance score': testing the clinical validity of a new risk assessment instrument.

PubMed

Deichmann Nielsen, Lea; Bech, Per; Hounsgaard, Lise; Alkier Gildberg, Frederik

2017-08-01

Unstructured risk assessment, as well as confounders (underlying reasons for the patient's risk behaviour and alliance), risk behaviour, and parameters of alliance, have been identified as factors that prolong the duration of mechanical restraint among forensic mental health inpatients. To clinically validate a new, structured short-term risk assessment instrument called the Mechanical Restraint-Confounders, Risk, Alliance Score (MR-CRAS), with the intended purpose of supporting the clinicians' observation and assessment of the patient's readiness to be released from mechanical restraint. The content and layout of MR-CRAS and its user manual were evaluated using face validation by forensic mental health clinicians, content validation by an expert panel, and pilot testing within two, closed forensic mental health inpatient units. The three sub-scales (Confounders, Risk, and a parameter of Alliance) showed excellent content validity. The clinical validations also showed that MR-CRAS was perceived and experienced as a comprehensible, relevant, comprehensive, and useable risk assessment instrument. MR-CRAS contains 18 clinically valid items, and the instrument can be used to support the clinical decision-making regarding the possibility of releasing the patient from mechanical restraint. The present three studies have clinically validated a short MR-CRAS scale that is currently being psychometrically tested in a larger study.

The Utrecht questionnaire (U-CEP) measuring knowledge on clinical epidemiology proved to be valid.

PubMed

Kortekaas, Marlous F; Bartelink, Marie-Louise E L; de Groot, Esther; Korving, Helen; de Wit, Niek J; Grobbee, Diederick E; Hoes, Arno W

2017-02-01

Knowledge on clinical epidemiology is crucial to practice evidence-based medicine. We describe the development and validation of the Utrecht questionnaire on knowledge on Clinical epidemiology for Evidence-based Practice (U-CEP); an assessment tool to be used in the training of clinicians. The U-CEP was developed in two formats: two sets of 25 questions and a combined set of 50. The validation was performed among postgraduate general practice (GP) trainees, hospital trainees, GP supervisors, and experts. Internal consistency, internal reliability (item-total correlation), item discrimination index, item difficulty, content validity, construct validity, responsiveness, test-retest reliability, and feasibility were assessed. The questionnaire was externally validated. Internal consistency was good with a Cronbach alpha of 0.8. The median item-total correlation and mean item discrimination index were satisfactory. Both sets were perceived as relevant to clinical practice. Construct validity was good. Both sets were responsive but failed on test-retest reliability. One set took 24 minutes and the other 33 minutes to complete, on average. External GP trainees had comparable results. The U-CEP is a valid questionnaire to assess knowledge on clinical epidemiology, which is a prerequisite for practicing evidence-based medicine in daily clinical practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Multiplex PCR for rapid diagnosis and differentiation of pox and pox-like diseases in dromedary Camels.

PubMed

Khalafalla, Abdelmalik I; Al-Busada, Khalid A; El-Sabagh, Ibrahim M

2015-07-07

Pox and pox-like diseases of camels are a group of exanthematous skin conditions that have become increasingly important economically. Three distinct viruses may cause them: camelpox virus (CMLV), camel parapox virus (CPPV) and camelus dromedary papilloma virus (CdPV). These diseases are often difficult to differentiate based on clinical presentation in disease outbreaks. Molecular methods such as PCR targeting species-specific genes have been developed and used to identify these diseases, but not simultaneously in a single tube. Recently, multiplex PCR has gained reputation as a convenient diagnostic method with cost-and timesaving benefits. In the present communication, we describe the development, optimization and validation of a multiplex PCR assay able to detect simultaneously the genome of the three viruses in one single test allowing for rapid and efficient molecular diagnosis. The assay was developed based on the evaluation and combination of published and new primer sets and was validated with viral genomic DNA extracted from known virus strains (n = 14) and DNA extracted from homogenized clinical skin specimens (n = 86). The assay detects correctly the target pathogens by amplification of targeted genes, even in case of co-infection. The method showed high sensitivity, and the specificity was confirmed by PCR-product sequencing. This assay provide rapid, sensitive and specific method for identifying three important viruses in specimens collected from dromedary camels with varying clinical presentations.

Leveraging molecular datasets for biomarker-based clinical trial design in glioblastoma.

PubMed

Tanguturi, Shyam K; Trippa, Lorenzo; Ramkissoon, Shakti H; Pelton, Kristine; Knoff, David; Sandak, David; Lindeman, Neal I; Ligon, Azra H; Beroukhim, Rameen; Parmigiani, Giovanni; Wen, Patrick Y; Ligon, Keith L; Alexander, Brian M

2017-07-01

Biomarkers can improve clinical trial efficiency, but designing and interpreting biomarker-driven trials require knowledge of relationships among biomarkers, clinical covariates, and endpoints. We investigated these relationships across genomic subgroups of glioblastoma (GBM) within our institution (DF/BWCC), validated results in The Cancer Genome Atlas (TCGA), and demonstrated potential impacts on clinical trial design and interpretation. We identified genotyped patients at DF/BWCC, and clinical associations across 4 common GBM genomic biomarker groups were compared along with overall survival (OS), progression-free survival (PFS), and survival post-progression (SPP). Significant associations were validated in TCGA. Biomarker-based clinical trials were simulated using various assumptions. Epidermal growth factor receptor (EGFR)(+) and p53(-) subgroups were more likely isocitrate dehydrogenase (IDH) wild-type. Phosphatidylinositol-3 kinase (PI3K)(+) patients were older, and patients with O6-DNA methylguanine-methyltransferase (MGMT)-promoter methylation were more often female. OS, PFS, and SPP were all longer for IDH mutant and MGMT methylated patients, but there was no independent prognostic value for other genomic subgroups. PI3K(+) patients had shorter PFS among IDH wild-type tumors, however, and no DF/BWCC long-term survivors were either EGFR(+) (0% vs 7%, P = .014) or p53(-) (0% vs 10%, P = .005). The degree of biomarker overlap impacted the efficiency of Bayesian-adaptive clinical trials, while PFS and OS distribution variation had less impact. Biomarker frequency was proportionally associated with sample size in all designs. We identified several associations between GBM genomic subgroups and clinical or molecular prognostic covariates and validated known prognostic factors in all survival periods. These results are important for biomarker-based trial design and interpretation of biomarker-only and nonrandomized trials. © The Author(s) 2017. Published by Oxford University Press on behalf of the Society for Neuro-Oncology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

The importance of parent and child opinion in detecting change in movement capabilities.

PubMed

Green, Dido; Wilson, Brenda N

2008-10-01

Children and parents can make valid judgments about movement difficulties, which aids in the screening and assessment of Developmental Coordination Disorder (DCD). When considering therapy outcomes, child and family-centred practice supports the inclusion of parent and child perspectives to reflect progress made in meaningful daily contexts. This paper describes an evaluation of the use of questionnaires for parents and children to measure change in motor performance. Questionnaires were administered to 43 children with DCD and their parents five times over two-anda-quarter years in conjunction with other clinical measures. Parent report, using the Developmental Coordination Disorder Questionnaire, correlated significantly with clinical measures of motor skill, whilst parent and child perceptions differed. Children's confidence and resilience may influence their opinions of their ability. These results raise questions of whose perspective of progress is most valid and relevant - the therapist's, child's or parent's?

[Challenges in acute paediatric medicine].

PubMed

Moll, Henriette A

2016-01-01

A big drop in the number of severe infections has resulted in less experience in recognising a seriously ill child. The challenge is finding a safe and effective balance between high-quality expertise and quickly accessible care, while avoiding over-diagnosis. There are a number of tools available to aid recognition of a seriously ill child and to avoid delay in diagnostic procedures and treatment: the use of a validated paediatric triage system, validated decision rules and guidelines, listening carefully to the parents ('my child's illness is different this time'), the clinical intuition of the experienced paediatrician and the provision of good 'safety net' advice to parents concerning the alarm signals and when they should contact a care provider. Experienced paediatricians should be at the forefront in the evaluation of the acutely ill child in order to teach their younger colleagues the importance of various alarm signals and the role played by clinical intuition.

A Framework for the Development and Interpretation of Different Sepsis Definitions and Clinical Criteria

PubMed Central

Angus, Derek C.; Seymour, Christopher W.; Coopersmith, Craig M.; Deutschman, Clifford; Klompas, Michael; Levy, Mitchell M.; Martin, Greg S.; Osborn, Tiffany M.; Rhee, Chanu; Watson, R. Scott

2016-01-01

Although sepsis was described more than 2,000 years ago, and clinicians still struggle to define it, there is no “gold standard,” and multiple competing approaches and terms exist. Challenges include the ever-changing knowledge base that informs our understanding of sepsis, competing views on which aspects of any potential definition are most important, and the tendency of most potential criteria to be distributed in at-risk populations in such a way as to hinder separation into discrete sets of patients. We propose that the development and evaluation of any definition or diagnostic criteria should follow four steps: 1) define the epistemologic underpinning, 2) agree on all relevant terms used to frame the exercise, 3) state the intended purpose for any proposed set of criteria, and 4) adopt a scientific approach to inform on their usefulness with regard to the intended purpose. Usefulness can be measured across six domains: 1) reliability (stability of criteria during retesting, between raters, over time, and across settings), 2) content validity (similar to face validity), 3) construct validity (whether criteria measure what they purport to measure), 4) criterion validity (how new criteria fare compared to standards), 5) measurement burden (cost, safety, and complexity), and 6) timeliness (whether criteria are available concurrent with care decisions). The relative importance of these domains of usefulness depends on the intended purpose, of which there are four broad categories: 1) clinical care, 2) research, 3) surveillance, and 4) quality improvement and audit. This proposed methodologic framework is intended to aid understanding of the strengths and weaknesses of different approaches, provide a mechanism for explaining differences in epidemiologic estimates generated by different approaches, and guide the development of future definitions and diagnostic criteria. PMID:26901559

A Framework for the Development and Interpretation of Different Sepsis Definitions and Clinical Criteria.

PubMed

Angus, Derek C; Seymour, Christopher W; Coopersmith, Craig M; Deutschman, Clifford S; Klompas, Michael; Levy, Mitchell M; Martin, Gregory S; Osborn, Tiffany M; Rhee, Chanu; Watson, R Scott

2016-03-01

Although sepsis was described more than 2,000 years ago, and clinicians still struggle to define it, there is no "gold standard," and multiple competing approaches and terms exist. Challenges include the ever-changing knowledge base that informs our understanding of sepsis, competing views on which aspects of any potential definition are most important, and the tendency of most potential criteria to be distributed in at-risk populations in such a way as to hinder separation into discrete sets of patients. We propose that the development and evaluation of any definition or diagnostic criteria should follow four steps: 1) define the epistemologic underpinning, 2) agree on all relevant terms used to frame the exercise, 3) state the intended purpose for any proposed set of criteria, and 4) adopt a scientific approach to inform on their usefulness with regard to the intended purpose. Usefulness can be measured across six domains: 1) reliability (stability of criteria during retesting, between raters, over time, and across settings), 2) content validity (similar to face validity), 3) construct validity (whether criteria measure what they purport to measure), 4) criterion validity (how new criteria fare compared to standards), 5) measurement burden (cost, safety, and complexity), and 6) timeliness (whether criteria are available concurrent with care decisions). The relative importance of these domains of usefulness depends on the intended purpose, of which there are four broad categories: 1) clinical care, 2) research, 3) surveillance, and 4) quality improvement and audit. This proposed methodologic framework is intended to aid understanding of the strengths and weaknesses of different approaches, provide a mechanism for explaining differences in epidemiologic estimates generated by different approaches, and guide the development of future definitions and diagnostic criteria.

You can lead a horse to water … what Self-Determination Theory can contribute to our understanding of clinical policy implementation.

PubMed

Smith, Geoffrey P; Williams, Theresa M

2017-01-01

There has been increasing reliance on policy directives as instruments for shaping clinical practice in health care, despite it being widely recognized that there is a significant translation gap between clinical policy and its implementation. Self-Determination Theory, a widely researched and empirically validated theory of human needs' fulfilment and motivation, offers a potentially valuable theoretical framework for understanding not only why the current policy environment has not led to the anticipated improvement in the quality and safety of clinical care but, importantly, also provides guidance about how organizations can create an environment that can nurture behavioural change in the workforce. We describe an alternative approach to clinical policy-making underpinned by Self-Determination Theory, which we believe has broad application for the science of clinical implementation theory.

Structured assessment of microsurgery skills in the clinical setting.

PubMed

Chan, WoanYi; Niranjan, Niri; Ramakrishnan, Venkat

2010-08-01

Microsurgery is an essential component in plastic surgery training. Competence has become an important issue in current surgical practice and training. The complexity of microsurgery requires detailed assessment and feedback on skills components. This article proposes a method of Structured Assessment of Microsurgery Skills (SAMS) in a clinical setting. Three types of assessment (i.e., modified Global Rating Score, errors list and summative rating) were incorporated to develop the SAMS method. Clinical anastomoses were recorded on videos using a digital microscope system and were rated by three consultants independently and in a blinded fashion. Fifteen clinical cases of microvascular anastomoses performed by trainees and a consultant microsurgeon were assessed using SAMS. The consultant had consistently the highest scores. Construct validity was also demonstrated by improvement of SAMS scores of microsurgery trainees. The overall inter-rater reliability was strong (alpha=0.78). The SAMS method provides both formative and summative assessment of microsurgery skills. It is demonstrated to be a valid, reliable and feasible assessment tool of operating room performance to provide systematic and comprehensive feedback as part of the learning cycle. Copyright 2009 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved.

Clinical instruments: reliability and validity critical appraisal.

PubMed

Brink, Yolandi; Louw, Quinette A

2012-12-01

RATIONALE, AIM AND OBJECTIVES: There is a lack of health care practitioners using objective clinical tools with sound psychometric properties. There is also a need for researchers to improve their reporting of the validity and reliability results of these clinical tools. Therefore, to promote the use of valid and reliable tools or tests for clinical evaluation, this paper reports on the development of a critical appraisal tool to assess the psychometric properties of objective clinical tools. A five-step process was followed to develop the new critical appraisal tool: (1) preliminary conceptual decisions; (2) defining key concepts; (3) item generation; (4) assessment of face validity; and (5) formulation of the final tool. The new critical appraisal tool consists of 13 items, of which five items relate to both validity and reliability studies, four items to validity studies only and four items to reliability studies. The 13 items could be scored as 'yes', 'no' or 'not applicable'. This critical appraisal tool will aid both the health care practitioner to critically appraise the relevant literature and researchers to improve the quality of reporting of the validity and reliability of objective clinical tools. © 2011 Blackwell Publishing Ltd.

Clinical application of microsampling versus conventional sampling techniques in the quantitative bioanalysis of antibiotics: a systematic review.

PubMed

Guerra Valero, Yarmarly C; Wallis, Steven C; Lipman, Jeffrey; Stove, Christophe; Roberts, Jason A; Parker, Suzanne L

2018-03-01

Conventional sampling techniques for clinical pharmacokinetic studies often require the removal of large blood volumes from patients. This can result in a physiological or emotional burden, particularly for neonates or pediatric patients. Antibiotic pharmacokinetic studies are typically performed on healthy adults or general ward patients. These may not account for alterations to a patient's pathophysiology and can lead to suboptimal treatment. Microsampling offers an important opportunity for clinical pharmacokinetic studies in vulnerable patient populations, where smaller sample volumes can be collected. This systematic review provides a description of currently available microsampling techniques and an overview of studies reporting the quantitation and validation of antibiotics using microsampling. A comparison of microsampling to conventional sampling in clinical studies is included.

What should we mean by empirical validation in hypnotherapy: evidence-based practice in clinical hypnosis.

PubMed

Alladin, Assen; Sabatini, Linda; Amundson, Jon K

2007-04-01

This paper briefly surveys the trend of and controversy surrounding empirical validation in psychotherapy. Empirical validation of hypnotherapy has paralleled the practice of validation in psychotherapy and the professionalization of clinical psychology, in general. This evolution in determining what counts as evidence for bona fide clinical practice has gone from theory-driven clinical approaches in the 1960s and 1970s through critical attempts at categorization of empirically supported therapies in the 1990s on to the concept of evidence-based practice in 2006. Implications of this progression in professional psychology are discussed in the light of hypnosis's current quest for validation and empirical accreditation.

The role of evidence based medicine in neurotrauma.

PubMed

Honeybul, S; Ho, K M

2015-04-01

The introduction of evidence based medicine de-emphasised clinical experience and so-called "background information" and stressed the importance of evidence gained from clinical research when making clinical decisions. For many years randomised controlled trials have been seen to be the only way to advance clinical practice, however, applying this methodology in the context of severe trauma can be problematic. In addition, it is increasingly recognised that considerable clinical experience is required in order to critically evaluate the quality of the evidence and the validity of the conclusions as presented. A contemporary example is seen when considering the role of decompressive craniectomy in the management of neurotrauma. Although there is a considerable amount of evidence available attesting to the efficacy of the procedure, considerable clinical expertise is required in order to properly interpret the results of these studies and the implications for clinical practice. Given these limitations the time may have come for a redesign of the traditional pyramid of evidence, to a model that re-emphasises the importance of "background information" such as pathophysiology and acknowledges the role of clinical experience such that the evidence can be critically evaluated in its appropriate context and the subsequent implications for clinical practice be clearly and objectively defined. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

Streamlining cardiovascular clinical trials to improve efficiency and generalisability.

PubMed

Zannad, Faiez; Pfeffer, Marc A; Bhatt, Deepak L; Bonds, Denise E; Borer, Jeffrey S; Calvo-Rojas, Gonzalo; Fiore, Louis; Lund, Lars H; Madigan, David; Maggioni, Aldo Pietro; Meyers, Catherine M; Rosenberg, Yves; Simon, Tabassome; Stough, Wendy Gattis; Zalewski, Andrew; Zariffa, Nevine; Temple, Robert

2017-08-01

Controlled trials provide the most valid determination of the efficacy and safety of an intervention, but large cardiovascular clinical trials have become extremely costly and complex, making it difficult to study many important clinical questions. A critical question, and the main objective of this review, is how trials might be simplified while maintaining randomisation to preserve scientific integrity and unbiased efficacy assessments. Experience with alternative approaches is accumulating, specifically with registry-based randomised controlled trials that make use of data already collected. This approach addresses bias concerns while still capitalising on the benefits and efficiencies of a registry. Several completed or ongoing trials illustrate the feasibility of using registry-based controlled trials to answer important questions relevant to daily clinical practice. Randomised trials within healthcare organisation databases may also represent streamlined solutions for some types of investigations, although data quality (endpoint assessment) is likely to be a greater concern in those settings. These approaches are not without challenges, and issues pertaining to informed consent, blinding, data quality and regulatory standards remain to be fully explored. Collaboration among stakeholders is necessary to achieve standards for data management and analysis, to validate large data sources for use in randomised trials, and to re-evaluate ethical standards to encourage research while also ensuring that patients are protected. The rapidly evolving efforts to streamline cardiovascular clinical trials have the potential to lead to major advances in promoting better care and outcomes for patients with cardiovascular disease. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Further fMRI Validation of the Visual Half Field Technique as an Indicator of Language Laterality: A Large-Group Analysis

ERIC Educational Resources Information Center

Van der Haegen, Lise; Cai, Qing; Seurinck, Ruth; Brysbaert, Marc

2011-01-01

The best established lateralized cerebral function is speech production, with the majority of the population having left hemisphere dominance. An important question is how to best assess the laterality of this function. Neuroimaging techniques such as functional Magnetic Resonance Imaging (fMRI) are increasingly used in clinical settings to…

Improving pharmacy revenue integrity.

PubMed

Carmody, Jennifer J; Townsend, Kyle; Schwartz, Kathy

2013-09-01

Billings Clinic learned the following important lessons in implementing a pharmacy revenue integrity initiative: Integrate pharmacy data as fully as possible. Audit and review pharmacy data regularly to validate the data and identify key areas where education can be provided to support accuracy and compliance. Use technology to bridge gaps between pharmacy data, such as gaps in billable units and billed units. Establish data governance workflows.

Construct Validity of Fluency and Implications for the Factorial Structure of Memory

ERIC Educational Resources Information Center

Jewsbury, Paul A.; Bowden, Stephen C.

2017-01-01

Fluency is an important construct in clinical assessment and in cognitive taxonomies. In the Cattell-Horn-Carroll (CHC) model, Fluency is represented by several narrow factors that form a subset of the long-term memory encoding and retrieval (Glr) broad factor. The CHC broad classification of Fluency was evaluated in five data sets, and the CHC…

A clinical perspective on the utility of alpha 1 antichymotrypsin for the early diagnosis of calcific aortic stenosis.

PubMed

Martin-Rojas, Tatiana; Mourino-Alvarez, Laura; Gil-Dones, Felix; de la Cuesta, Fernando; Rosello-Lleti, Esther; Laborde, Carlos M; Rivera, Miguel; Lopez-Almodovar, Luis Fernando; Lopez, Juan Antonio; Akerstrom, Finn; Padial, Luis R; Barderas, Maria G

2017-01-01

Calcific aortic stenosis (CAS) is the most common heart valve disease in the elderly, representing an important economic and social burden in developed countries. Currently, there is no way to predict either the onset or progression of CAS, emphasizing the need to identify useful biomarkers for this condition. We performed a multi-proteomic analysis on different kinds of samples from CAS patients and healthy donors: tissue, secretome and plasma. The results were validated in an independent cohort of subjects by immunohistochemistry, western blotting and selected reaction monitoring. Alpha 1 antichymotrypsin (AACT) abundance was altered in the CAS samples, as confirmed in the validation phase. The significant changes observed in the amounts of this protein strongly suggest that it could be involved in the molecular mechanisms underlying CAS. In addition, our results suggest there is enhanced release of AACT into the extracellular fluids when the disease commences. The significant increase of AACT in CAS patients suggests it fulfils an important role in the physiopathology of this disease. These results permit us to propose that AACT may serve as a potential marker for the diagnosis of CAS, with considerable clinical value.

Critical thinking competence and disposition of clinical nurses in a medical center.

PubMed

Feng, Rung-Chuang; Chen, Mei-Jung; Chen, Mei-Chuan; Pai, Yu-Chu

2010-06-01

Critical thinking is essential in nursing practice. Promoting critical thinking competence in clinical nurses is an important way to improve problem solving and decision-making competence to further improve the quality of patient care. However, using an adequate tool to test nurses' critical thinking competence and disposition may provide the reference criteria for clinical nurse characterization, training planning, and resource allocation for human resource management. The purpose of this study was to measure the critical thinking competence and critical thinking disposition of clinical nurses as well as to explore the related factors of critical thinking competence. Clinical nurses from four different clinical ladders selected from one medical center were stratified randomly. All qualified subjects who submitted valid questionnaires were included in the study. A Taiwan version of the modified Watson-Glaser Critical Thinking Appraisal and Critical Thinking Disposition Inventory was developed to measure the critical thinking competence and critical thinking disposition of clinical nurses. Validity was evaluated using the professional content test (content validity index = .93). Reliability was assessed with a Cronbach's alpha coefficient of .85. Data were analyzed using the SPSS for Windows (Version 12.0; SPSS Inc., Chicago, IL). Results showed that competence of interpretation was the highest critical thinking competence factor. Inference was the lowest, and reflective thinking as a critical thinking disposition was more positive. In addition, age, years of nursing experience, and experiences in other hospitals significantly influenced critical thinking competence (p < .05). Factors of age, years of experience, and nurses clinical ladder were shown to affect critical thinking disposition scores. Clinical ladder N4 nurses had the highest scores in both competence and disposition. A significant relationship was found between critical thinking competence and disposition scores, with 29.3% of the variance in critical thinking competence potentially explained by total years of nurse hospital experience. Clinical ladder and age were predictive factors for critical thinking disposition. Commonality was 27.9%. Nursing experience and clinical ladders positively affect critical thinking competence and disposition. Issues of critical thinking competence increasingly need to be measured. Therefore, appropriate tools for nursing professions should be further developed and explored for specific areas of practice.

Validation of a Plasma-Based Comprehensive Cancer Genotyping Assay Utilizing Orthogonal Tissue- and Plasma-Based Methodologies.

PubMed

Odegaard, Justin I; Vincent, John J; Mortimer, Stefanie; Vowles, James V; Ulrich, Bryan C; Banks, Kimberly C; Fairclough, Stephen R; Zill, Oliver A; Sikora, Marcin; Mokhtari, Reza; Abdueva, Diana; Nagy, Rebecca J; Lee, Christine E; Kiedrowski, Lesli A; Paweletz, Cloud P; Eltoukhy, Helmy; Lanman, Richard B; Chudova, Darya I; Talasaz, AmirAli

2018-04-24

Purpose: To analytically and clinically validate a circulating cell-free tumor DNA sequencing test for comprehensive tumor genotyping and demonstrate its clinical feasibility. Experimental Design: Analytic validation was conducted according to established principles and guidelines. Blood-to-blood clinical validation comprised blinded external comparison with clinical droplet digital PCR across 222 consecutive biomarker-positive clinical samples. Blood-to-tissue clinical validation comprised comparison of digital sequencing calls to those documented in the medical record of 543 consecutive lung cancer patients. Clinical experience was reported from 10,593 consecutive clinical samples. Results: Digital sequencing technology enabled variant detection down to 0.02% to 0.04% allelic fraction/2.12 copies with ≤0.3%/2.24-2.76 copies 95% limits of detection while maintaining high specificity [prevalence-adjusted positive predictive values (PPV) >98%]. Clinical validation using orthogonal plasma- and tissue-based clinical genotyping across >750 patients demonstrated high accuracy and specificity [positive percent agreement (PPAs) and negative percent agreement (NPAs) >99% and PPVs 92%-100%]. Clinical use in 10,593 advanced adult solid tumor patients demonstrated high feasibility (>99.6% technical success rate) and clinical sensitivity (85.9%), with high potential actionability (16.7% with FDA-approved on-label treatment options; 72.0% with treatment or trial recommendations), particularly in non-small cell lung cancer, where 34.5% of patient samples comprised a directly targetable standard-of-care biomarker. Conclusions: High concordance with orthogonal clinical plasma- and tissue-based genotyping methods supports the clinical accuracy of digital sequencing across all four types of targetable genomic alterations. Digital sequencing's clinical applicability is further supported by high rates of technical success and biomarker target discovery. Clin Cancer Res; 1-11. ©2018 AACR. ©2018 American Association for Cancer Research.

Contemporary Aspects of Marketing in Clinical Trials Including Segments of IT and Technology Transfer.

PubMed

Stamenovic, Milorad; Dobraca, Amra; Smajlovic, Mersiha

2018-01-01

The aim of this paper is to present the marketing strategy and the application of management (marketing management) and advertising in order to increase the efficiency of innovative approach in clinical trials that include and involve the use of new technologies and transfer of technologies. This paper has a descriptive character and represents a narrative review of the literature and new model implementation. Marketing models are primarily used to improve the inclusion of a larger (and appropriate) number of patients, but they can be credited for the stay and monitoring of patients in the trial. Regulatory mechanisms play an important role in the application of various marketing strategies within clinical trials. The value for the patient as the most important stakeholder is defined in the field of clinical trials according to Kotler's value model for the consumer. In order to achieve the best results it is important to adequately examine all the elements of clinical trials and apply this knowledge in creation of a marketing plan that will be made in accordance with the legal regulations defined globally and locally. In this paper, two challenges have been highlighted for the adequate application of marketing tools in the field of clinical trials, namely: defining business elements in order to provide an adequate marketing approach for clinical trials and technology transfer and ensuring uniformity and regulatory affirmation of marketing attitudes in clinical trials in all regions in which they are carried out in accordance with ICH-GCP and valid regulations.

Patient-specific bone modeling and analysis: the role of integration and automation in clinical adoption.

PubMed

Zadpoor, Amir A; Weinans, Harrie

2015-03-18

Patient-specific analysis of bones is considered an important tool for diagnosis and treatment of skeletal diseases and for clinical research aimed at understanding the etiology of skeletal diseases and the effects of different types of treatment on their progress. In this article, we discuss how integration of several important components enables accurate and cost-effective patient-specific bone analysis, focusing primarily on patient-specific finite element (FE) modeling of bones. First, the different components are briefly reviewed. Then, two important aspects of patient-specific FE modeling, namely integration of modeling components and automation of modeling approaches, are discussed. We conclude with a section on validation of patient-specific modeling results, possible applications of patient-specific modeling procedures, current limitations of the modeling approaches, and possible areas for future research. Copyright © 2014 Elsevier Ltd. All rights reserved.

[Critical revision of the available methods for evaluate the body composition in population-based and clinical studies].

PubMed

Rezende, Fabiane; Rosado, Lina; Franceschinni, Sylvia; Rosado, Gilberto; Ribeiro, Rita; Marins, João Carlos Bouzas

2007-12-01

The corporal composition evaluation is extremely important for the individual and population nutritional state diagnosis and for the establishment of appropriate clinical-nutritional conducts. An excess of body fat is frequently associated with important metabolic alterations and chronic diseases, such as diabetes, hypertension and dyslipidemia The availability of methods to assess body composition is essential to evaluate health status of individuals. There are several methods for the corporal composition analysis, and it is important to know the limitation of each one and his/her validity so that the obtained estimates are reliable and correctly interpreted. The purpose of this study was to revise the applicability of some nutritional state indicators and corporal composition evaluation methods, such as corporal mass index, waist circumference and waist-hip relation, skinfold measurements, bioelectrical impedance analysis and near-infrared interactance.

The Potential Role of Sensory Testing, Skin Biopsy, and Functional Brain Imaging as Biomarkers in Chronic Pain Clinical Trials: IMMPACT Considerations.

PubMed

Smith, Shannon M; Dworkin, Robert H; Turk, Dennis C; Baron, Ralf; Polydefkis, Michael; Tracey, Irene; Borsook, David; Edwards, Robert R; Harris, Richard E; Wager, Tor D; Arendt-Nielsen, Lars; Burke, Laurie B; Carr, Daniel B; Chappell, Amy; Farrar, John T; Freeman, Roy; Gilron, Ian; Goli, Veeraindar; Haeussler, Juergen; Jensen, Troels; Katz, Nathaniel P; Kent, Jeffrey; Kopecky, Ernest A; Lee, David A; Maixner, William; Markman, John D; McArthur, Justin C; McDermott, Michael P; Parvathenani, Lav; Raja, Srinivasa N; Rappaport, Bob A; Rice, Andrew S C; Rowbotham, Michael C; Tobias, Jeffrey K; Wasan, Ajay D; Witter, James

2017-07-01

Valid and reliable biomarkers can play an important role in clinical trials as indicators of biological or pathogenic processes or as a signal of treatment response. Currently, there are no biomarkers for pain qualified by the U.S. Food and Drug Administration or the European Medicines Agency for use in clinical trials. This article summarizes an Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials meeting in which 3 potential biomarkers were discussed for use in the development of analgesic treatments: 1) sensory testing, 2) skin punch biopsy, and 3) brain imaging. The empirical evidence supporting the use of these tests is described within the context of the 4 categories of biomarkers: 1) diagnostic, 2) prognostic, 3) predictive, and 4) pharmacodynamic. Although sensory testing, skin punch biopsy, and brain imaging are promising tools for pain in clinical trials, additional evidence is needed to further support and standardize these tests for use as biomarkers in pain clinical trials. The applicability of sensory testing, skin biopsy, and brain imaging as diagnostic, prognostic, predictive, and pharmacodynamic biomarkers for use in analgesic treatment trials is considered. Evidence in support of their use and outlining problems is presented, as well as a call for further standardization and demonstrations of validity and reliability. Copyright © 2017 American Pain Society. All rights reserved.

Psychometric Properties of Language Assessments for Children Aged 4–12 Years: A Systematic Review

PubMed Central

Denman, Deborah; Speyer, Renée; Munro, Natalie; Pearce, Wendy M.; Chen, Yu-Wei; Cordier, Reinie

2017-01-01

Introduction: Standardized assessments are widely used by speech pathologists in clinical and research settings to evaluate the language abilities of school-aged children and inform decisions about diagnosis, eligibility for services and intervention. Given the significance of these decisions, it is important that assessments have sound psychometric properties. Objective: The aim of this systematic review was to examine the psychometric quality of currently available comprehensive language assessments for school-aged children and identify assessments with the best evidence for use. Methods: Using the PRISMA framework as a guideline, a search of five databases and a review of websites and textbooks was undertaken to identify language assessments and published material on the reliability and validity of these assessments. The methodological quality of selected studies was evaluated using the COSMIN taxonomy and checklist. Results: Fifteen assessments were evaluated. For most assessments evidence of hypothesis testing (convergent and discriminant validity) was identified; with a smaller number of assessments having some evidence of reliability and content validity. No assessments presented with evidence of structural validity, internal consistency or error measurement. Overall, all assessments were identified as having limitations with regards to evidence of psychometric quality. Conclusions: Further research is required to provide good evidence of psychometric quality for currently available language assessments. Of the assessments evaluated, the Assessment of Literacy and Language, the Clinical Evaluation of Language Fundamentals-5th Edition, the Clinical Evaluation of Language Fundamentals-Preschool: 2nd Edition and the Preschool Language Scales-5th Edition presented with most evidence and are thus recommended for use. PMID:28936189

Application of the OMERACT filter to measures of core outcome domains in recent clinical studies of acute gout.

PubMed

Taylor, William J; Redden, David; Dalbeth, Nicola; Schumacher, H Ralph; Edwards, N Lawrence; Simon, Lee S; John, Markus R; Essex, Margaret N; Watson, Douglas J; Evans, Robert; Rome, Keith; Singh, Jasvinder A

2014-03-01

To determine the extent to which instruments that measure core outcome domains in acute gout fulfill the Outcome Measures in Rheumatology (OMERACT) filter requirements of truth, discrimination, and feasibility. Patient-level data from 4 randomized controlled trials of agents designed to treat acute gout and 1 observational study of acute gout were analyzed. For each available measure, construct validity, test-retest reliability, within-group change using effect size, between-group change using the Kruskall-Wallis statistic, and repeated measures generalized estimating equations were assessed. Floor and ceiling effects were also assessed and minimal clinically important difference was estimated. These analyses were presented to participants at OMERACT 11 to help inform voting for possible endorsement. There was evidence for construct validity and discriminative ability for 3 measures of pain [0 to 4 Likert, 0 to 10 numeric rating scale (NRS), 0 to 100 mm visual analog scale (VAS)]. Likewise, there appears to be sufficient evidence for a 4-point Likert scale to possess construct validity and discriminative ability for physician assessment of joint swelling and joint tenderness. There was some evidence for construct validity and within-group discriminative ability for the Health Assessment Questionnaire as a measure of activity limitations, but not for discrimination between groups allocated to different treatment. There is sufficient evidence to support measures of pain (using Likert, NRS, or VAS), joint tenderness, and swelling (using Likert scale) as fulfilling the requirements of the OMERACT filter. Further research on a measure of activity limitations in acute gout clinical trials is required.

Assessing birth experience in fathers as an important aspect of clinical obstetrics: how applicable is Salmon's Item List for men?

PubMed

Gawlik, Stephanie; Müller, Mitho; Hoffmann, Lutz; Dienes, Aimée; Reck, Corinna

2015-01-01

validated questionnaire assessment of fathers' experiences during childbirth is lacking in routine clinical practice. Salmon's Item List is a short, validated method used for the assessment of birth experience in mothers in both English- and German-speaking communities. With little to no validated data available for fathers, this pilot study aimed to assess the applicability of the German version of Salmon's Item List, including a multidimensional birth experience concept, in fathers. longitudinal study. Data were collected by questionnaires. University hospital in Germany. the birth experiences of 102 fathers were assessed four to six weeks post partum using the German version of Salmon's Item List. construct validity testing with exploratory factor analysis using principal component analysis with varimax rotation was performed to identify the dimensions of childbirth experiences. Internal consistency was also analysed. factor analysis yielded a four-factor solution comprising 17 items that accounted for 54.5% of the variance. The main domain was 'fulfilment', and the secondary domains were 'emotional distress', 'physical discomfort' and 'emotional adaption'. For fulfilment, Cronbach's α met conventional reliability standards (0.87). Salmon's Item List is an appropriate instrument to assess birth experience in fathers in terms of fulfilment. Larger samples need to be examined in order to prove the stability of the factor structure before this can be extended to routine clinical assessment. a reduced version of Salmon's Item List may be useful as a screening tool for general assessment. Copyright © 2014 Elsevier Ltd. All rights reserved.

From bedside to bench and back again: research issues in animal models of human disease.

PubMed

Tkacs, Nancy C; Thompson, Hilaire J

2006-07-01

To improve outcomes for patients with many serious clinical problems, multifactorial research approaches by nurse scientists, including the use of animal models, are necessary. Animal models serve as analogies for clinical problems seen in humans and must meet certain criteria, including validity and reliability, to be useful in moving research efforts forward. This article describes research considerations in the development of rodent models. As the standard of diabetes care evolves to emphasize intensive insulin therapy, rates of severe hypoglycemia are increasing among patients with type 1 and type 2 diabetes mellitus. A consequence of this change in clinical practice is an increase in rates of two hypoglycemia-related diabetes complications: hypoglycemia-associated autonomic failure (HAAF) and resulting hypoglycemia unawareness. Work on an animal model of HAAF is in an early developmental stage, with several labs reporting different approaches to model this complication of type 1 diabetes mellitus. This emerging model serves as an example illustrating how evaluation of validity and reliability is critically important at each stage of developing and testing animal models to support inquiry into human disease.

Counting seizures: The primary outcome measure in epileptology from the patients' perspective.

PubMed

Blachut, Barbara; Hoppe, Christian; Surges, Rainer; Stahl, Jutta; Elger, Christian E; Helmstaedter, Christoph

2015-07-01

Patient-reported seizure counts represent a key outcome measure for individual treatments and clinical studies in epileptology. Video-EEG based research, however, demonstrated lack of validity due to underreporting. Here we examined the practice of keeping seizure diaries and the patients' attitudes toward seizure counting. Anticipating a low return rate, a comprehensive survey was mailed to 1100 adult outpatients. Besides methods and reasons to document or not to document seizures, the questionnaire addressed clinical, personality and sociodemographic characteristics as well as the subjective experience of seizures. Questionnaires from 170 patients (15%) could be included in our analysis. Patients estimated to be aware of 5.3 out of 10 daytime seizures (nocturnal seizures: 2.6) while they supposed that relatives/colleagues noticed 7.1 (nocturnal: 4.6). Almost two-thirds of the patients reported to keep a seizure diary with a self-estimated documentation rate of 8.7 out of 10 noticed daytime seizures (nocturnal: 7.7). Documenters and non-documenters showed only marginal group differences with regard to clinical, personality and sociodemographic characteristics. Importantly, patients were more committed to keep a seizure diary when they judged it to be relevant for clinical treatment decisions. Patients appear to know that they underreport seizures. According to their view, seizure unawareness as induced by seizures themselves seems to be a more important factor than omitting documentation of noticed seizures. Thus, the potential to improve the validity of seizure diaries of electronic devices which facilitate documenting noticed seizures appears limited. Copyright © 2015 British Epilepsy Association. Published by Elsevier Ltd. All rights reserved.

Validity Issues in Clinical Assessment.

ERIC Educational Resources Information Center

Foster, Sharon L.; Cone, John D.

1995-01-01

Validation issues that arise with measures of constructs and behavior are addressed with reference to general reasons for using assessment procedures in clinical psychology. A distinction is made between the representational phase of validity assessment and the elaborative validity phase in which the meaning and utility of scores are examined.…

Criteria for the validity of clinical trials of treatments of cohorts of cancer patients based on the Hardin Jones principle.

PubMed Central

Pauling, L; Herman, Z S

1989-01-01

With the assumption of the validity of the Hardin Jones principle that the death rate of members of a homogeneous cohort of cancer patients is constant, three criteria for the validity of clinical trials of cancer treatments are formulated. These criteria are satisfied by most published clinical trials, but one trial was found to violate all three, rendering the validity of its reported results uncertain. PMID:2780542

Validity and reliability of the attention deficit hyperactivity disorder self-report scale (ASRS-v1.1) in a clinical sample with eating disorders.

PubMed

Carlucci, Samantha; Ivanova, Iryna; Bissada, Hany; Tasca, Giorgio A

2017-08-01

Individuals with eating disorders (EDs) commonly experience comorbid attention deficit hyperactivity disorder (ADHD). The shared features of EDs and ADHD, such as inattention, impulsivity and hyperactivity, may exacerbate ED symptomatology and pose challenges to treatment. It is important to screen patients with EDs for symptoms of ADHD to optimize their treatment outcomes. However, the psychometrics of common measures of ADHD have not yet been examined within an ED population. An example of such a measure is the ADHD self-report scale (ASRS-v1.1) symptom checklist, which identifies the presence of ADHD symptoms. This study reports a psychometric study of the ASRS-v1.1 in a clinical sample of 500 adults with an ED. A confirmatory factor analysis indicated the ASRS-v1.1 maintained its two-factor structure of inattention and impulsivity/hyperactivity. The item loadings demonstrated path invariance across ED diagnostic groups indicating construct validity. Further, the subscales exhibited good internal consistency and they were significantly correlated with other measures of impulsivity indicating convergent validity. The ED sample had significantly higher mean scores than published nonclinical norms indicating predictive validity, but the ASRS-v1.1 scores were not significantly different among ED diagnostic groups. Results suggest the ASRS-v1.1 is a valid and reliable screening tool for identifying symptoms of ADHD among adults seeking treatment for ED. Copyright © 2017 Elsevier Ltd. All rights reserved.

[Validation of interaction databases in psychopharmacotherapy].

PubMed

Hahn, M; Roll, S C

2018-03-01

Drug-drug interaction databases are an important tool to increase drug safety in polypharmacy. There are several drug interaction databases available but it is unclear which one shows the best results and therefore increases safety for the user of the databases and the patients. So far, there has been no validation of German drug interaction databases. Validation of German drug interaction databases regarding the number of hits, mechanisms of drug interaction, references, clinical advice, and severity of the interaction. A total of 36 drug interactions which were published in the last 3-5 years were checked in 5 different databases. Besides the number of hits, it was also documented if the mechanism was correct, clinical advice was given, primary literature was cited, and the severity level of the drug-drug interaction was given. All databases showed weaknesses regarding the hit rate of the tested drug interactions, with a maximum of 67.7% hits. The highest score in this validation was achieved by MediQ with 104 out of 180 points. PsiacOnline achieved 83 points, arznei-telegramm® 58, ifap index® 54 and the ABDA-database 49 points. Based on this validation MediQ seems to be the most suitable databank for the field of psychopharmacotherapy. The best results in this comparison were achieved by MediQ but this database also needs improvement with respect to the hit rate so that the users can rely on the results and therefore increase drug therapy safety.

Development of the Assessment of Belief Conflict in Relationship-14 (ABCR-14)

PubMed Central

Kyougoku, Makoto; Teraoka, Mutsumi; Masuda, Noriko; Ooura, Mariko; Abe, Yasushi

2015-01-01

Purpose Nurses and other healthcare workers frequently experience belief conflict, one of the most important, new stress-related problems in both academic and clinical fields. Methods In this study, using a sample of 1,683 nursing practitioners, we developed The Assessment of Belief Conflict in Relationship-14 (ABCR-14), a new scale that assesses belief conflict in the healthcare field. Standard psychometric procedures were used to develop and test the scale, including a qualitative framework concept and item-pool development, item reduction, and scale development. We analyzed the psychometric properties of ABCR-14 according to entropy, polyserial correlation coefficient, exploratory factor analysis, confirmatory factor analysis, average variance extracted, Cronbach’s alpha, Pearson product-moment correlation coefficient, and multidimensional item response theory (MIRT). Results The results of the analysis supported a three-factor model consisting of 14 items. The validity and reliability of ABCR-14 was suggested by evidence from high construct validity, structural validity, hypothesis testing, internal consistency reliability, and concurrent validity. The result of the MIRT offered strong support for good item response of item slope parameters and difficulty parameters. However, the ABCR-14 Likert scale might need to be explored from the MIRT point of view. Yet, as mentioned above, there is sufficient evidence to support that ABCR-14 has high validity and reliability. Conclusion The ABCR-14 demonstrates good psychometric properties for nursing belief conflict. Further studies are recommended to confirm its application in clinical practice. PMID:26247356

IMPROVING THE REPORTING OF THERAPEUTIC EXERCISE INTERVENTIONS IN REHABILITATION RESEARCH.

PubMed

Page, Phil; Hoogenboom, Barb; Voight, Michael

2017-04-01

The foundation of evidence-based practice lies in clinical research, which is based on the utilization of the scientific method. The scientific method requires that all details of the experiment be provided in publications to support replication of the study in order to evaluate and validate the results. More importantly, clinical research can only be translated into practice when researchers provide explicit details of the study. Too often, rehabilitation exercise intervention studies lack the appropriate detail to allow clinicians to replicate the exercise protocol in their patient populations. Therefore, the purpose of this clinical commentary is to provide guidelines for optimal reporting of therapeutic exercise interventions in rehabilitation research. 5.

Autopsy validation of 123I-FP-CIT dopaminergic neuroimaging for the diagnosis of DLB.

PubMed

Thomas, Alan J; Attems, Johannes; Colloby, Sean J; O'Brien, John T; McKeith, Ian; Walker, Rodney; Lee, Lean; Burn, David; Lett, Debra J; Walker, Zuzana

2017-01-17

To conduct a validation study of 123 I-N-fluoropropyl-2b-carbomethoxy-3b-(4-iodophenyl) nortropane ( 123 I-FP-CIT) SPECT dopaminergic imaging in the clinical diagnosis of dementia with Lewy bodies (DLB) with autopsy as the gold standard. Patients >60 years of age with dementia who had undergone 123 I-FP-CIT imaging in research studies and who had donated their brain tissue to the Newcastle Brain Tissue Resource were included. All had structured clinical research assessments, and clinical diagnoses were applied by consensus panels using international diagnostic criteria. All underwent 123 I-FP-CIT imaging at baseline, and scans were rated as normal or abnormal by blinded raters. Patients were reviewed in prospective studies and after death underwent detailed autopsy assessment, and neuropathologic diagnoses were applied with the use of standard international criteria. Fifty-five patients (33 with DLB and 22 with Alzheimer disease) were included. Against autopsy diagnosis, 123 I-FP-CIT had a balanced diagnostic accuracy of 86% (sensitivity 80%, specificity 92%) compared with clinical diagnosis, which had an accuracy of 79% (sensitivity 87%, specificity 72%). Among patients with DLB, 10% (3 patients) met pathologic criteria for Lewy body disease but had normal 123 I-FP-CIT imaging. This large autopsy analysis of 123 I-FP-CIT imaging in dementia demonstrates that it is a valid and accurate biomarker for DLB, and the high specificity compared with clinical diagnosis (20% higher) is clinically important. The results need to be replicated with patients recruited from a wider range of settings, including movement disorder clinics and general practice. While an abnormal 123 I-FP-CIT scan strongly supports Lewy body disease, a normal scan does not exclude DLB with minimal brainstem involvement. This study provides Class I evidence that 123 I-FP-CIT dopaminergic neuroimaging accurately identifies patients with DLB. Copyright © 2016 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American Academy of Neurology.

World Workshop on Oral Medicine VI: an international validation study of clinical competencies for advanced training in oral medicine.

PubMed

Steele, John C; Clark, Hadleigh J; Hong, Catherine H L; Jurge, Sabine; Muthukrishnan, Arvind; Kerr, A Ross; Wray, David; Prescott-Clements, Linda; Felix, David H; Sollecito, Thomas P

2015-08-01

To explore international consensus for the validation of clinical competencies for advanced training in Oral Medicine. An electronic survey of clinical competencies was designed. The survey was sent to and completed by identified international stakeholders during a 10-week period. To be validated, an individual competency had to achieve 90% or greater consensus to keep it in its current format. Stakeholders from 31 countries responded. High consensus agreement was achieved with 93 of 101 (92%) competencies exceeding the benchmark for agreement. Only 8 warranted further attention and were reviewed by a focus group. No additional competencies were suggested. This is the first international validated study of clinical competencies for advanced training in Oral Medicine. These validated clinical competencies could provide a model for countries developing an advanced training curriculum for Oral Medicine and also inform review of existing curricula. Copyright © 2015 Elsevier Inc. All rights reserved.

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 2—External Validity and Correlates

PubMed Central

Reddy, L. Felice; Barch, Deanna M.; Buchanan, Robert W.; Dunayevich, Eduardo; Gold, James M.; Marder, Steven R.; Wynn, Jonathan K.; Young, Jared W.; Green, Michael F.

2015-01-01

Effort-based decision making has strong conceptual links to the motivational disturbances that define a key subdomain of negative symptoms. However, the extent to which effort-based decision-making performance relates to negative symptoms, and other clinical and functionally important variables has yet to be systematically investigated. In 94 clinically stable outpatients with schizophrenia, we examined the external validity of 5 effort-based paradigms, including the Effort Expenditure for Rewards, Balloon Effort, Grip Strength Effort, Deck Choice Effort, and Perceptual Effort tasks. These tasks covered 3 types of effort: physical, cognitive, and perceptual. Correlations between effort related performance and 6 classes of variables were examined, including: (1) negative symptoms, (2) clinically rated motivation and community role functioning, (3) self-reported motivational traits, (4) neurocognition, (5) other psychiatric symptoms and clinical/demographic characteristics, and (6) subjective valuation of monetary rewards. Effort paradigms showed small to medium relationships to clinical ratings of negative symptoms, motivation, and functioning, with the pattern more consistent for some measures than others. They also showed small to medium relations with neurocognitive functioning, but were generally unrelated to other psychiatric symptoms, self-reported traits, antipsychotic medications, side effects, and subjective valuation of money. There were relatively strong interrelationships among the effort measures. In conjunction with findings from a companion psychometric article, all the paradigms warrant further consideration and development, and 2 show the strongest potential for clinical trial use at this juncture. PMID:26209546

Sensitivity, Specificity, and Receiver Operating Characteristics: A Primer for Neuroscience Nurses.

PubMed

McNett, Molly; Amato, Shelly; Olson, DaiWai M

2017-04-01

It is important for neuroscience nurses to have a solid understanding of the instruments they use in clinical practice. Specifically, when reviewing reports of research instruments, nurses should be knowledgeable of analytical terms when determining the applicability of instruments for use in clinical practice. The purpose of this article is to review 3 such analytical terms: sensitivity, specificity, and receiver operating characteristic curves. Examples of how these terms are used in the neuroscience literature highlight the relevance of these terms to neuroscience nursing practice. As the role of the nurse continues to expand, it is important not to simply accept all instruments as valid but to be able to critically evaluate their properties for applicability to nursing practice and evidence-based care of our patients.

Validation of biomarkers to predict response to immunotherapy in cancer: Volume I - pre-analytical and analytical validation.

PubMed

Masucci, Giuseppe V; Cesano, Alessandra; Hawtin, Rachael; Janetzki, Sylvia; Zhang, Jenny; Kirsch, Ilan; Dobbin, Kevin K; Alvarez, John; Robbins, Paul B; Selvan, Senthamil R; Streicher, Howard Z; Butterfield, Lisa H; Thurin, Magdalena

2016-01-01

Immunotherapies have emerged as one of the most promising approaches to treat patients with cancer. Recently, there have been many clinical successes using checkpoint receptor blockade, including T cell inhibitory receptors such as cytotoxic T-lymphocyte-associated antigen 4 (CTLA-4) and programmed cell death-1 (PD-1). Despite demonstrated successes in a variety of malignancies, responses only typically occur in a minority of patients in any given histology. Additionally, treatment is associated with inflammatory toxicity and high cost. Therefore, determining which patients would derive clinical benefit from immunotherapy is a compelling clinical question. Although numerous candidate biomarkers have been described, there are currently three FDA-approved assays based on PD-1 ligand expression (PD-L1) that have been clinically validated to identify patients who are more likely to benefit from a single-agent anti-PD-1/PD-L1 therapy. Because of the complexity of the immune response and tumor biology, it is unlikely that a single biomarker will be sufficient to predict clinical outcomes in response to immune-targeted therapy. Rather, the integration of multiple tumor and immune response parameters, such as protein expression, genomics, and transcriptomics, may be necessary for accurate prediction of clinical benefit. Before a candidate biomarker and/or new technology can be used in a clinical setting, several steps are necessary to demonstrate its clinical validity. Although regulatory guidelines provide general roadmaps for the validation process, their applicability to biomarkers in the cancer immunotherapy field is somewhat limited. Thus, Working Group 1 (WG1) of the Society for Immunotherapy of Cancer (SITC) Immune Biomarkers Task Force convened to address this need. In this two volume series, we discuss pre-analytical and analytical (Volume I) as well as clinical and regulatory (Volume II) aspects of the validation process as applied to predictive biomarkers for cancer immunotherapy. To illustrate the requirements for validation, we discuss examples of biomarker assays that have shown preliminary evidence of an association with clinical benefit from immunotherapeutic interventions. The scope includes only those assays and technologies that have established a certain level of validation for clinical use (fit-for-purpose). Recommendations to meet challenges and strategies to guide the choice of analytical and clinical validation design for specific assays are also provided.

The Clinical Validation of the Athlete Sleep Screening Questionnaire: an Instrument to Identify Athletes that Need Further Sleep Assessment.

PubMed

Bender, Amy M; Lawson, Doug; Werthner, Penny; Samuels, Charles H

2018-06-04

Previous research has established that general sleep screening questionnaires are not valid and reliable in an athlete population. The Athlete Sleep Screening Questionnaire (ASSQ) was developed to address this need. While the initial validation of the ASSQ has been established, the clinical validity of the ASSQ has yet to be determined. The main objective of the current study was to evaluate the clinical validity of the ASSQ. Canadian National Team athletes (N = 199; mean age 24.0 ± 4.2 years, 62% females; from 23 sports) completed the ASSQ. A subset of athletes (N = 46) were randomized to the clinical validation sub-study which required subjects to complete an ASSQ at times 2 and 3 and to have a clinical sleep interview by a sleep medicine physician (SMP) who rated each subjects' category of clinical sleep problem and provided recommendations to improve sleep. To assess clinical validity, the SMP category of clinical sleep problem was compared to the ASSQ. The internal consistency (Cronbach's alpha = 0.74) and test-retest reliability (r = 0.86) of the ASSQ were acceptable. The ASSQ demonstrated good agreement with the SMP (Cohen's kappa = 0.84) which yielded a diagnostic sensitivity of 81%, specificity of 93%, positive predictive value of 87%, and negative predictive value of 90%. There were 25.1% of athletes identified to have clinically relevant sleep disturbances that required further clinical sleep assessment. Sleep improved from time 1 at baseline to after the recommendations at time 3. Sleep screening athletes with the ASSQ provides a method of accurately determining which athletes would benefit from preventative measures and which athletes suffer from clinically significant sleep problems. The process of sleep screening athletes and providing recommendations improves sleep and offers a clinical intervention output that is simple and efficient for teams and athletes to implement.

Linking the Tinnitus Questionnaire and the subjective Clinical Global Impression: Which differences are clinically important?

PubMed Central

2012-01-01

Background Development of new tinnitus treatments requires prospective placebo-controlled randomized trials to prove their efficacy. The Tinnitus Questionnaire (TQ) is a validated and commonly used instrument for assessment of tinnitus severity and has been used in many clinical studies. Defining the Minimal Clinically Important Difference (MCID) for TQ changes is an important step to a better interpretation of the clinical relevance of changes observed in clinical trials. In this study we aimed to estimate the minimum change of the TQ score that could be considered clinically relevant. Methods 757 patients with chronic tinnitus were pooled from the TRI database and the RESET study. An anchor-based approach using the Clinical Global Impression (CGI) scale and distributional approaches were used to estimate MCID. Receiver Operating Characteristic (ROC) curves were calculated to define optimal TQ change cutoffs discriminating between minimally changed and unchanged subjects. Results The relationship between TQ change scores and CGI ratings of change was good (r = 0.52, p < 0.05). Mean change scores associated with minimally better and minimally worse CGI categories were −6.65 and +2.72 respectively. According to the ROC method MCID for improvement was −5 points and for deterioration +1 points. Conclusion Distribution and anchor-based methods yielded comparable results in identifying MCIDs. ΔTQ scores of −5 and +1 points were identified as the minimal clinically relevant change for improvement and worsening respectively. The asymmetry of the MCIDs for improvement and worsening may be related to expectation effects. PMID:22781703

Identification of GRB2 and GAB1 Coexpression as an Unfavorable Prognostic Factor for Hepatocellular Carcinoma by a Combination of Expression Profile and Network Analysis

PubMed Central

Yang, Mei; Wang, Danhua; Yu, Lingxiang; Guo, Chaonan; Guo, Xiaodong; Lin, Na

2013-01-01

Aim To screen novel markers for hepatocellular carcinoma (HCC) by a combination of expression profile, interaction network analysis and clinical validation. Methods HCC significant molecules which are differentially expressed or had genetic variations in HCC tissues were obtained from five existing HCC related databases (OncoDB.HCC, HCC.net, dbHCCvar, EHCO and Liverome). Then, the protein-protein interaction (PPI) network of these molecules was constructed. Three topological features of the network ('Degree', 'Betweenness', and 'Closeness') and the k-core algorithm were used to screen candidate HCC markers which play crucial roles in tumorigenesis of HCC. Furthermore, the clinical significance of two candidate HCC markers growth factor receptor-bound 2 (GRB2) and GRB2-associated-binding protein 1 (GAB1) was validated. Results In total, 6179 HCC significant genes and 977 HCC significant proteins were collected from existing HCC related databases. After network analysis, 331 candidate HCC markers were identified. Especially, GAB1 has the highest k-coreness suggesting its central localization in HCC related network, and the interaction between GRB2 and GAB1 has the largest edge-betweenness implying it may be biologically important to the function of HCC related network. As the results of clinical validation, the expression levels of both GRB2 and GAB1 proteins were significantly higher in HCC tissues than those in their adjacent nonneoplastic tissues. More importantly, the combined GRB2 and GAB1 protein expression was significantly associated with aggressive tumor progression and poor prognosis in patients with HCC. Conclusion This study provided an integrative analysis by combining expression profile and interaction network analysis to identify a list of biologically significant HCC related markers and pathways. Further experimental validation indicated that the aberrant expression of GRB2 and GAB1 proteins may be strongly related to tumor progression and prognosis in patients with HCC. The overexpression of GRB2 in combination with upregulation of GAB1 may be an unfavorable prognostic factor for HCC. PMID:24391994

Clinical relevance in anesthesia journals.

PubMed

Lauritsen, Jakob; Møller, Ann M

2006-04-01

The purpose of this review is to present the latest knowledge and research on the definition and distribution of clinically relevant articles in anesthesia journals. It will also discuss the importance of the chosen methodology and outcome of articles. In the last few years, more attention has been paid to evidence-based medicine in anesthesia. Several articles on the subject have focused on the need to base clinical decisions on sound research employing both methodological rigor and clinically relevant outcomes. The number of systematic reviews in anesthesia literature is increasing as well as the focus on diminishing the number of surrogate outcomes. It has been shown that the impact factor is not a valid measure of establishing the level of clinical relevance to a journal. This review presents definitions of clinically relevant anesthesia articles. A clinically relevant article employs both methodological rigor and a clinically relevant outcome. The terms methodological rigor and clinical outcomes are fully discussed in the review as well as problems with journal impact factors.

Assessing the validity of surrogate endpoints in the context of a controversy about the measurement of effectiveness of hepatitis C virus treatment.

PubMed

Dobler, Claudia C; Morgan, Rebecca L; Falck-Ytter, Yngve; Montori, Victor M; Murad, M Hassan

2018-04-01

Surrogate endpoints are often used in clinical trials, as they allow for indirect measures of outcomes (eg, shorter trials with less participants). Improvements in surrogate endpoints (eg, reduction in low density lipoprotein cholesterol, normalisation of glycated haemoglobin) achieved with an intervention are, however, not always associated with improvements in patient-important outcomes. The common tendency in evidence-based medicine is to view results based on surrogate endpoints as less certain than results based on long term, final patient-important outcomes and rate them as 'lower quality evidence'. However, careful appraisal of the validity of a surrogate endpoint as a measure of the final, patient-important outcome is more useful than an automatic judgement. In this guide, we use a contemporary and currently highly debated example of the surrogate endpoint 'sustained viral response' (ie, viral eradication considered to represent successful treatment) in patients treated for chronic hepatitis C virus. We demonstrate how the validity of a surrogate endpoint can be critically appraised to assess the quality of the evidence (ie, the certainty in estimates) and the implications for decision-making. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development and validation of an instrument to measure nurse educator perceived confidence in clinical teaching.

PubMed

Nguyen, Van N B; Forbes, Helen; Mohebbi, Mohammadreza; Duke, Maxine

2017-12-01

Teaching nursing in clinical environments is considered complex and multi-faceted. Little is known about the role of the clinical nurse educator, specifically the challenges related to transition from clinician, or in some cases, from newly-graduated nurse to that of clinical nurse educator, as occurs in developing countries. Confidence in the clinical educator role has been associated with successful transition and the development of role competence. There is currently no valid and reliable instrument to measure clinical nurse educator confidence. This study was conducted to develop and psychometrically test an instrument to measure perceived confidence among clinical nurse educators. A multi-phase, multi-setting survey design was used. A total of 468 surveys were distributed, and 363 were returned. Data were analyzed using exploratory and confirmatory factor analyses. The instrument was successfully tested and modified in phase 1, and factorial validity was subsequently confirmed in phase 2. There was strong evidence of internal consistency, reliability, content, and convergent validity of the Clinical Nurse Educator Skill Acquisition Assessment instrument. The resulting instrument is applicable in similar contexts due to its rigorous development and validation process. © 2017 The Authors. Nursing & Health Sciences published by John Wiley & Sons Australia, Ltd.

National survey of emergency physicians for transient ischemic attack (TIA) risk stratification consensus and appropriate treatment for a given level of risk.

PubMed

Perry, Jeffrey J; Losier, Justin H; Stiell, Ian G; Sharma, Mukul; Abdulaziz, Kasim

2016-01-01

Five percent of transient ischemic attack (TIA) patients have a subsequent stroke within 7 days. The Canadian TIA Score uses clinical findings to calculate the subsequent stroke risk within 7 days. Our objectives were to assess 1) anticipated use; 2) component face validity; 3) risk strata for stroke within 7 days; and 4) actions required, for a given risk for subsequent stroke. After a rigorous development process, a survey questionnaire was administered to a random sample of 300 emergency physicians selected from those registered in a national medical directory. The surveys were distributed using a modified Dillman technique. From a total of 271 eligible surveys, we received 131 (48.3%) completed surveys; 96.2% of emergency physicians would use a validated Canadian TIA Score; 8 of 13 components comprising the Canadian TIA Score were rated as Very Important or Important by survey respondents. Risk categories for subsequent stroke were defined as minimal-risk: 10% risk of subsequent stroke within 7 days. A validated Canadian TIA Score will likely be used by emergency physicians. Most components of the TIA Score have high face validity. Risk strata are definable, which may allow physicians to determine immediate actions, based on subsequent stroke risk, in the emergency department.

Pyrosequencing-based validation of a simple cell-suspension polymerase chain reaction assay for Campylobacter... of high-processivity polymerase with novel internal amplification controls for rapid and specific detection.

USDA-ARS?s Scientific Manuscript database

Although Campylobacter is an important food-borne human pathogen, there remains a lack of molecular diagnostic assays that are simple to use, cost-effective, and provide rapid results in research, clinical, or regulatory laboratories. Of the numerous Campylobacter assays that do exist, to our knowl...

Clinical evidence supporting pharmacogenomic biomarker testing provided in US Food and Drug Administration drug labels.

PubMed

Wang, Bo; Canestaro, William J; Choudhry, Niteesh K

2014-12-01

Genetic biomarkers that predict a drug's efficacy or likelihood of toxicity are assuming increasingly important roles in the personalization of pharmacotherapy, but concern exists that evidence that links use of some biomarkers to clinical benefit is insufficient. Nevertheless, information about the use of biomarkers appears in the labels of many prescription drugs, which may add confusion to the clinical decision-making process. To evaluate the evidence that supports pharmacogenomic biomarker testing in drug labels and how frequently testing is recommended. Publicly available US Food and Drug Administration databases. We identified drug labels that described the use of a biomarker and evaluated whether the label contained or referenced convincing evidence of its clinical validity (ie, the ability to predict phenotype) and clinical utility (ie, the ability to improve clinical outcomes) using guidelines published by the Evaluation of Genomic Applications in Practice and Prevention Working Group. We graded the completeness of the citation of supporting studies and determined whether the label recommended incorporation of biomarker test results in therapeutic decision making. Of the 119 drug-biomarker combinations, only 43 (36.1%) had labels that provided convincing clinical validity evidence, whereas 18 (15.1%) provided convincing evidence of clinical utility. Sixty-one labels (51.3%) made recommendations about how clinical decisions should be based on the results of a biomarker test; 36 (30.3%) of these contained convincing clinical utility data. A full description of supporting studies was included in 13 labels (10.9%). Fewer than one-sixth of drug labels contained or referenced convincing evidence of clinical utility of biomarker testing, whereas more than half made recommendations based on biomarker test results. It may be premature to include biomarker testing recommendations in drug labels when convincing data that link testing to patient outcomes do not exist.

Circulating Tumor DNA Analysis in Patients With Cancer: American Society of Clinical Oncology and College of American Pathologists Joint Review.

PubMed

Merker, Jason D; Oxnard, Geoffrey R; Compton, Carolyn; Diehn, Maximilian; Hurley, Patricia; Lazar, Alexander J; Lindeman, Neal; Lockwood, Christina M; Rai, Alex J; Schilsky, Richard L; Tsimberidou, Apostolia M; Vasalos, Patricia; Billman, Brooke L; Oliver, Thomas K; Bruinooge, Suanna S; Hayes, Daniel F; Turner, Nicholas C

2018-06-01

Purpose Clinical use of analytical tests to assess genomic variants in circulating tumor DNA (ctDNA) is increasing. This joint review from ASCO and the College of American Pathologists summarizes current information about clinical ctDNA assays and provides a framework for future research. Methods An Expert Panel conducted a literature review on the use of ctDNA assays for solid tumors, including pre-analytical variables, analytical validity, interpretation and reporting, and clinical validity and utility. Results The literature search identified 1,338 references. Of those, 390, plus 31 references supplied by the Expert Panel, were selected for full-text review. There were 77 articles selected for inclusion. Conclusion The evidence indicates that testing for ctDNA is optimally performed on plasma collected in cell stabilization or EDTA tubes, with EDTA tubes processed within 6 hours of collection. Some ctDNA assays have demonstrated clinical validity and utility with certain types of advanced cancer; however, there is insufficient evidence of clinical validity and utility for the majority of ctDNA assays in advanced cancer. Evidence shows discordance between the results of ctDNA assays and genotyping tumor specimens and supports tumor tissue genotyping to confirm undetected results from ctDNA tests. There is no evidence of clinical utility and little evidence of clinical validity of ctDNA assays in early-stage cancer, treatment monitoring, or residual disease detection. There is no evidence of clinical validity and clinical utility to suggest that ctDNA assays are useful for cancer screening, outside of a clinical trial. Given the rapid pace of research, re-evaluation of the literature will shortly be required, along with the development of tools and guidance for clinical practice.

The Baptist Health Nurse Retention Questionnaire: A Methodological Study, Part 1.

PubMed

Lengerich, Alexander; Bugajski, Andrew; Marchese, Matthew; Hall, Brittany; Yackzan, Susan; Davies, Claire; Brockopp, Dorothy

2017-05-01

The purposes of this study were to develop and test the Baptist Health Nurse Retention Questionnaire (BHNRQ) and examine the importance of nurse retention factors. Multiple factors, including increasing patient acuity levels, have led to concerns regarding nurse retention. An understanding of current factors related to retention is limited. To establish the psychometric properties of the BHNRQ, data were collected from 279 bedside nurses at a 391-bed, Magnet® redesignated community hospital. A principal component analysis was conducted to determine the subscale structure of the BHNRQ. Additional analyses were conducted related to content validity and test-retest reliability. The results of the principal components analysis revealed 3 subscales: nursing practice, management, and staffing. Analyses demonstrate that the BHNRQ is a reliable and valid instrument for measuring nurse retention factors. The BHNRQ was found to be a clinically useful instrument for measuring important factors related to nurse retention.

Certified reference materials (GBW09170 and 09171) of creatinine in human serum.

PubMed

Dai, Xinhua; Fang, Xiang; Shao, Mingwu; Li, Ming; Huang, Zejian; Li, Hongmei; Jiang, You; Song, Dewei; He, Yajuan

2011-02-15

Creatinine is the most widely used clinical marker for assessing renal function. Concentrations of creatinine in human serum need to be carefully checked in order to ensure accurate diagnosis of renal function. Therefore, development of certified reference materials (CRMs) of creatinine in serum is of increasing importance. In this study, two new CRMs (Nos. GBW09170 and 09171) for creatinine in human serum have been developed. They were prepared with mixtures of several dozens of healthy people's and kidney disease patient's serum, respectively. The certified values of 8.10, 34.1 mg/kg for these two CRMs have been assigned by liquid chromatography-isotope dilution mass spectrometry (LC-IDMS) method which was validated by using standard reference material (SRM) of SRM909b (a reference material obtained from National Institute of Standards and Technology, NIST). The expanded uncertainties of certified values for low and high concentrations were estimated to be 1.2 and 1.1%, respectively. The certified values were further confirmed by an international intercomparison for the determination of creatinine in human serum (Consultative Committee for Amount of Substance, CCQM) of K80 (CCQM-K80). These new CRMs of creatinine in human serum pool are totally native without additional creatinine spiked for enrichment. These new CRMs are capable of validating routine clinical methods for ensuring accuracy, reliability and comparability of analytical results from different clinical laboratories. They can also be used for instrument validation, development of secondary reference materials, and evaluating the accuracy of high order clinical methods for the determination of creatinine in human serum. Copyright © 2011 Elsevier B.V. All rights reserved.

Assessment of published models and prognostic variables in epithelial ovarian cancer at Mayo Clinic

PubMed Central

Hendrickson, Andrea Wahner; Hawthorne, Kieran M.; Goode, Ellen L.; Kalli, Kimberly R.; Goergen, Krista M.; Bakkum-Gamez, Jamie N.; Cliby, William A.; Keeney, Gary L.; Visscher, Dan W.; Tarabishy, Yaman; Oberg, Ann L.; Hartmann, Lynn C.; Maurer, Matthew J.

2015-01-01

Objectives Epithelial ovarian cancer (EOC) is an aggressive disease in which first line therapy consists of a surgical staging/debulking procedure and platinum based chemotherapy. There is significant interest in clinically applicable, easy to use prognostic tools to estimate risk of recurrence and overall survival. In this study we used a large prospectively collected cohort of women with EOC to validate currently published models and assess prognostic variables. Methods Women with invasive ovarian, peritoneal, or fallopian tube cancer diagnosed between 2000-2011 and prospectively enrolled into the Mayo Clinic Ovarian Cancer registry were identified. Demographics and known prognostic markers as well as epidemiologic exposure variables were abstracted from the medical record and collected via questionnaire. Six previously published models of overall and recurrence-free survival were assessed for external validity. In addition, predictors of outcome were assessed in our dataset. Results Previously published models validated with a range of c-statistics (0.587-0.827), though application of models containing variables not part of routine practice were somewhat limited by missing data; utilization of all applicable models and comparison of results is suggested. Examination of prognostic variables identified only the presence of ascites and ASA score to be independent predictors of prognosis in our dataset, albeit with marginal gain in prognostic information, after accounting for stage and debulking. Conclusions Existing prognostic models for newly diagnosed EOC showed acceptable calibration in our cohort for clinical application. However, modeling of prospective variables in our dataset reiterates that stage and debulking remain the most important predictors of prognosis in this setting. PMID:25620544

Development and validation of the multidimensional vaginal penetration disorder questionnaire (MVPDQ) for assessment of lifelong vaginismus in a sample of Iranian women.

PubMed

Molaeinezhad, Mitra; Roudsari, Robab Latifnejad; Yousefy, Alireza; Salehi, Mehrdad; Khoei, Effat Merghati

2014-04-01

Vaginismus is considered as one of the most common female psychosexual dysfunctions. Although the importance of using a multidisciplinary approach for assessment of vaginal penetration disorder is emphasized, the paucity of instruments for this purpose is clear. We designed a study to develop and investigate the psychometric properties of a multidimensional vaginal penetration disorder questionnaire (MVPDQ), thereby assisting specialists for clinical assessment of women with lifelong vaginismus (LLV). MVPDQ was developed using the findings from a thematic qualitative research conducted with 20 unconsummated couples from a former study, which was followed by an extensive literature review. Then, during a cross-sectional design, a consecutive sample of 214 women, who were diagnosed as LLV based on Diagnostic and Statistical Manual of Mental Disorders (DSM)-IV-TR criteria completed MVPDQ and additional questions regarding their demographic and sexual history. Validation measures and reliability were tested by exploratory factor analysis and Cronbach's alpha coefficient via Statistical Package for the Social Sciences (SPSS) version 16. After conducting exploratory factor analysis, MVPDQ emerged with 72 items and 9 dimensions: Catastrophic cognitions and tightening, helplessness, marital adjustment, hypervigilance, avoidance, penetration motivation, sexual information, genital incompatibility, and optimism. Subscales of MVPDQ showed a significant reliability that varied between 0.70 and 0.87 and results of test-retest were satisfactory. The present study shows that MVPDQ is a valid and reliable self-report questionnaire for clinical assessment of women complaining of LLV. This instrument may assist specialists to make a clinical judgment and plan appropriately for clinical management.

Patient-Reported Measures of Narcolepsy: The Need for Better Assessment

PubMed Central

Kallweit, Ulf; Schmidt, Markus; Bassetti, Claudio L.

2017-01-01

Study Objectives: Narcolepsy, a chronic disorder of the central nervous system, is clinically characterized by a symptom pentad that includes excessive daytime sleepiness, cataplexy, sleep paralysis, hypnopompic/hypnagogic hallucinations, and disrupted nighttime sleep. Ideally, screening and diagnosis instruments that assist physicians in evaluating a patient for type 1 or type 2 narcolepsy would be brief, easy for patients to understand and physicians to score, and would identify or rule out the need for electrophysiological testing. Methods: A search of the literature was conducted to review patient-reported measures used for the assessment of narcolepsy, mainly in clinical trials, with the goal of summarizing existing scales and identifying areas that may require additional screening questions and clinical practice scales. Results: Of the seven scales reviewed, the Epworth Sleepiness Scale continues to be an important outcome measure to screen adults for excessive daytime sleepiness, which may be associated with narcolepsy. Several narcolepsy-specific scales have demonstrated utility, such as the Ullanlinna Narcolepsy Scale, Swiss Narcolepsy Scale, and Narcolepsy Symptom Assessment Questionnaire, but further validation is required. Conclusions: Although the narcolepsy-specific scales currently in use may identify type 1 narcolepsy, there are no validated questionnaires to identify type 2 narcolepsy. Thus, there remains a need for short, easily understood, and well-validated instruments that can be readily used in clinical practice to distinguish narcolepsy subtypes, as well as other hypersomnias, and for assessing symptoms of these conditions during treatment. Citation: Kallweit U, Schmidt M, Bassetti CL. Patient-reported measures of narcolepsy: the need for better assessment. J Clin Sleep Med. 2017;13(5):737–744. PMID:28162143

Testing multiple statistical hypotheses resulted in spurious associations: a study of astrological signs and health.

PubMed

Austin, Peter C; Mamdani, Muhammad M; Juurlink, David N; Hux, Janet E

2006-09-01

To illustrate how multiple hypotheses testing can produce associations with no clinical plausibility. We conducted a study of all 10,674,945 residents of Ontario aged between 18 and 100 years in 2000. Residents were randomly assigned to equally sized derivation and validation cohorts and classified according to their astrological sign. Using the derivation cohort, we searched through 223 of the most common diagnoses for hospitalization until we identified two for which subjects born under one astrological sign had a significantly higher probability of hospitalization compared to subjects born under the remaining signs combined (P<0.05). We tested these 24 associations in the independent validation cohort. Residents born under Leo had a higher probability of gastrointestinal hemorrhage (P=0.0447), while Sagittarians had a higher probability of humerus fracture (P=0.0123) compared to all other signs combined. After adjusting the significance level to account for multiple comparisons, none of the identified associations remained significant in either the derivation or validation cohort. Our analyses illustrate how the testing of multiple, non-prespecified hypotheses increases the likelihood of detecting implausible associations. Our findings have important implications for the analysis and interpretation of clinical studies.

Reference method for detection of Pgp mediated multidrug resistance in human hematological malignancies: a method validated by the laboratories of the French Drug Resistance Network.

PubMed

Huet, S; Marie, J P; Gualde, N; Robert, J

1998-12-15

Multidrug resistance (MDR) associated with overexpression of the MDR1 gene and of its product, P-glycoprotein (Pgp), plays an important role in limiting cancer treatment efficacy. Many studies have investigated Pgp expression in clinical samples of hematological malignancies but failed to give definitive conclusion on its usefulness. One convenient method for fluorescent detection of Pgp in malignant cells is flow cytometry which however gives variable results from a laboratory to another one, partly due to the lack of a reference method rigorously tested. The purpose of this technical note is to describe each step of a reference flow cytometric method. The guidelines for sample handling, staining and analysis have been established both for Pgp detection with monoclonal antibodies directed against extracellular epitopes (MRK16, UIC2 and 4E3), and for Pgp functional activity measurement with Rhodamine 123 as a fluorescent probe. Both methods have been validated on cultured cell lines and clinical samples by 12 laboratories of the French Drug Resistance Network. This cross-validated multicentric study points out crucial steps for the accuracy and reproducibility of the results, like cell viability, data analysis and expression.

Parenting stress in pediatric IBD: relations with child psychopathology, family functioning, and disease severity.

PubMed

Gray, Wendy N; Graef, Danielle M; Schuman, Shana S; Janicke, David M; Hommel, Kevin A

2013-05-01

Parenting stress in pediatric inflammatory bowel disease (IBD) has been under-examined. Data validating use of the Pediatric Inventory for Parents (PIP), a measure of parenting stress associated with caring for a chronically ill child, in chronic diseases with intermittent, unpredictable disease courses, such as IBD, are needed. This study presents validity data in support of the PIP in pediatric IBD and examines relations between parenting stress and important psychosocial and medical outcomes. Adolescents (N = 130) with IBD and their caregivers across 3 sites completed measures of parenting stress, family functioning, and emotional/behavioral functioning. Disease severity was also assessed for each participant. The PIP demonstrates excellent internal consistency. Parenting stress was significantly higher among those with unhealthy general family functioning and those with children with borderline or clinically elevated internalizing symptoms. Caregiving stress was greater among parents of youth with more active Crohn's disease. Results supported the reliability and validity of the PIP for assessing caregiving stress in pediatric IBD. Routine assessment of parenting stress is recommended, particularly among parents reporting unhealthy family functioning and parents of youth with borderline or clinically elevated internalizing symptoms and more active disease.

Kurt Goldstein's test battery.

PubMed

Eling, Paul

2015-02-01

Kurt Goldstein was a founder of clinical neuropsychology. This thesis is illustrated with a description of Goldstein's test battery that he used as a screening instrument in a special clinic for soldiers in World War I. Parts of the battery were also used for neuropsychological rehabilitation. Goldstein's early work in Germany focused on both neuropsychological assessment and rehabilitation. He was interested in how individuals go about compensating for their deficits, The notion of ecological validity (Lebenswahr vs Lebensfremd), only becoming widely popular in the nineteen-eighties, played an important role in Goldstein's selection of test procedures. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evidence base and future research directions in the management of low back pain.

PubMed

Abbott, Allan

2016-03-18

Low back pain (LBP) is a prevalent and costly condition. Awareness of valid and reliable patient history taking, physical examination and clinical testing is important for diagnostic accuracy. Stratified care which targets treatment to patient subgroups based on key characteristics is reliant upon accurate diagnostics. Models of stratified care that can potentially improve treatment effects include prognostic risk profiling for persistent LBP, likely response to specific treatment based on clinical prediction models or suspected underlying causal mechanisms. The focus of this editorial is to highlight current research status and future directions for LBP diagnostics and stratified care.

Role of imaging in testicular cancer: current and future practice.

PubMed

Barrisford, Glen W; Kreydin, Evgeniy I; Preston, Mark A; Rodriguez, Dayron; Harisighani, Mukesh G; Feldman, Adam S

2015-09-01

The article provides a summary of the epidemiologic and clinical aspects of testicular malignancy. Current standard imaging and novel techniques are reviewed. Present data and clinical treatment trends have favored surveillance protocols over adjuvant radiation or chemotherapy for low-stage testicular malignancy. This has resulted in increasing numbers of imaging studies and the potential for increased long-term exposure risks. Understanding imaging associated risks as well as strategies to minimize these risks is of increasing importance. The development, validation and incorporation of alternative lower risk highly efficacious and cost-effective imaging techniques is essential.

Development and validation of Dutch version of Lasater Clinical Judgment Rubric in hospital practice: An instrument design study.

PubMed

Vreugdenhil, Jettie; Spek, Bea

2018-03-01

Clinical reasoning in patient care is a skill that cannot be observed directly. So far, no reliable, valid instrument exists for the assessment of nursing students' clinical reasoning skills in hospital practice. Lasater's clinical judgment rubric (LCJR), based on Tanner's model "Thinking like a nurse" has been tested, mainly in academic simulation settings. The aim is to develop a Dutch version of the LCJR (D-LCJR) and to test its psychometric properties when used in a hospital traineeship context. A mixed-model approach was used to develop and to validate the instrument. Ten dedicated educational units in a university hospital. A well-mixed group of 52 nursing students, nurse coaches and nurse educators. A Delphi panel developed the D-LCJR. Students' clinical reasoning skills were assessed "live" by nurse coaches, nurse educators and students who rated themselves. The psychometric properties tested during the assessment process are reliability, reproducibility, content validity and construct validity by testing two hypothesis: 1) a positive correlation between assessed and self-reported sum scores (convergent validity) and 2) a linear relation between experience and sum score (clinical validity). The obtained D-LCJR was found to be internally consistent, Cronbach's alpha 0.93. The rubric is also reproducible with intraclass correlations between 0.69 and 0.78. Experts judged it to be content valid. The two hypothesis were both tested significant, supporting evidence for construct validity. The translated and modified LCJR, is a promising tool for the evaluation of nursing students' development in clinical reasoning in hospital traineeships, by students, nurse coaches and nurse educators. More evidence on construct validity is necessary, in particular for students at the end of their hospital traineeship. Based on our research, the D-LCJR applied in hospital traineeships is a usable and reliable tool. Copyright © 2017 Elsevier Ltd. All rights reserved.

Validation of a KHV antibody enzyme-linked immunosorbent assay (ELISA).

PubMed

Bergmann, S M; Wang, Q; Zeng, W; Li, Y; Wang, Y; Matras, M; Reichert, M; Fichtner, D; Lenk, M; Morin, T; Olesen, N J; Skall, H F; Lee, P-Y; Zheng, S; Monaghan, S; Reiche, S; Fuchs, W; Kotler, M; Way, K; Bräuer, G; Böttcher, K; Kappe, A; Kielpinska, J

2017-11-01

Koi herpesvirus (KHV) causes KHV disease (KHVD). The virus is highly contagious in carp or koi and can induce a high mortality. Latency and, in some cases, a lack of signs presents a challenge for virus detection. Appropriate immunological detection methods for anti-KHV antibodies have not yet been fully validated for KHV. Therefore, it was developed and validated an enzyme-linked immunosorbent assay (ELISA) to detect KHV antibodies. The assay was optimized with respect to plates, buffers, antigens and assay conditions. It demonstrated high diagnostic and analytical sensitivity and specificity and was particularly useful at the pond or farm levels. Considering the scale of the carp and koi industry worldwide, this assay represents an important practical tool for the indirect detection of KHV, also in the absence of clinical signs. © 2017 John Wiley & Sons Ltd.

Impact of Net Atrioventricular Compliance on Clinical Outcome in Mitral Stenosis

PubMed Central

Nunes, Maria Carmo P.; Hung, Judy; Barbosa, Marcia M.; Esteves, William A.; Carvalho, Vinicius T.; Lodi-Junqueira, Lucas; Fonseca Neto, Cirilo P.; Tan, Timothy C.; Levine, Robert A.

2014-01-01

Background Net atrioventricular compliance (Cn) has been reported to be an important determinant of pulmonary hypertension in mitral stenosis (MS). We hypothesized that, as Cn reflects hemodynamic consequences of MS, it may be useful in assessing prognosis. To date, limited data with an assumed Cn cutoff have indicated the need for larger prospective studies. This prospective study was designed to determine the impact of Cn on clinical outcome and its contribution to pulmonary pressure in MS. In addition, we aimed to identify a cutoff value of Cn for outcome prediction in this setting. Methods and Results A total of 128 patients with rheumatic MS without other significant valve disease were prospectively enrolled. Comprehensive echocardiography was performed and Doppler-derived Cn estimated using a previously validated equation. The endpoint was either mitral valve intervention or death. Cn was an important predictor of pulmonary pressure, regardless of classic measures of MS severity. During a median follow-up of 22 months, the endpoint was reached in 45 patients (35%). Baseline Cn predicted outcome, adding prognostic information beyond that provided by mitral valve area and functional status. Cn ≤ 4 mL/mmHg best predicted unfavorable outcome in derivation and validation sets. A subgroup analysis including only initially asymptomatic patients with moderate to severe MS without initial indication for intervention (40.6 % of total) demonstrated that baseline Cn predicted subsequent adverse outcome even after adjusting for classic measures of hemodynamic MS severity (hazard ratio [HR] 0.33, 95% confidence interval [CI] 0.14–0.79, p = 0.013). Conclusions Cn contributes to pulmonary hypertension beyond of stenosis severity itself. In a wide spectrum of MS severity, Cn is a powerful predictor of adverse outcome, adding prognostic value to clinical data and mitral valve area. Importantly, baseline Cn predicts a progressive course with subsequent need for intervention in initially asymptomatic patients. Cn assessment therefore has potential value for clinical risk stratification and monitoring in MS patients. PMID:24097419

Review of the Reported Measures of Clinical Validity and Clinical Utility as Arguments for the Implementation of Pharmacogenetic Testing: A Case Study of Statin-Induced Muscle Toxicity.

PubMed

Jansen, Marleen E; Rigter, T; Rodenburg, W; Fleur, T M C; Houwink, E J F; Weda, M; Cornel, Martina C

2017-01-01

Advances from pharmacogenetics (PGx) have not been implemented into health care to the expected extent. One gap that will be addressed in this study is a lack of reporting on clinical validity and clinical utility of PGx-tests. A systematic review of current reporting in scientific literature was conducted on publications addressing PGx in the context of statins and muscle toxicity. Eighty-nine publications were included and information was selected on reported measures of effect, arguments, and accompanying conclusions. Most authors report associations to quantify the relationship between a genetic variation an outcome, such as adverse drug responses. Conclusions on the implementation of a PGx-test are generally based on these associations, without explicit mention of other measures relevant to evaluate the test's clinical validity and clinical utility. To gain insight in the clinical impact and select useful tests, additional outcomes are needed to estimate the clinical validity and utility, such as cost-effectiveness.

Fluorescence In Situ Hybridization Probe Validation for Clinical Use.

PubMed

Gu, Jun; Smith, Janice L; Dowling, Patricia K

2017-01-01

In this chapter, we provide a systematic overview of the published guidelines and validation procedures for fluorescence in situ hybridization (FISH) probes for clinical diagnostic use. FISH probes-which are classified as molecular probes or analyte-specific reagents (ASRs)-have been extensively used in vitro for both clinical diagnosis and research. Most commercially available FISH probes in the United States are strictly regulated by the U.S. Food and Drug Administration (FDA), the Centers for Disease Control and Prevention (CDC), the Centers for Medicare & Medicaid Services (CMS) the Clinical Laboratory Improvement Amendments (CLIA), and the College of American Pathologists (CAP). Although home-brewed FISH probes-defined as probes made in-house or acquired from a source that does not supply them to other laboratories-are not regulated by these agencies, they too must undergo the same individual validation process prior to clinical use as their commercial counterparts. Validation of a FISH probe involves initial validation and ongoing verification of the test system. Initial validation includes assessment of a probe's technical specifications, establishment of its standard operational procedure (SOP), determination of its clinical sensitivity and specificity, development of its cutoff, baseline, and normal reference ranges, gathering of analytics, confirmation of its applicability to a specific research or clinical setting, testing of samples with or without the abnormalities that the probe is meant to detect, staff training, and report building. Ongoing verification of the test system involves testing additional normal and abnormal samples using the same method employed during the initial validation of the probe.

Clinical stakeholders’ opinions on the use of selective decontamination of the digestive tract in critically ill patients in intensive care units: an international Delphi study

PubMed Central

2013-01-01

Introduction Selective decontamination of the digestive tract (SDD) is a prophylactic antibiotic regimen that is not widely used in practice. We aimed to describe the opinions of key ‘stakeholders’ about the validity of the existing evidence base, likely consequences of implementation, relative importance of their opinions in influencing overall practice, likely barriers to implementation and perceptions of the requirement for further research to inform the decision about whether to embark on a further large randomised controlled trial. Methods This was a Delphi study informed by comprehensive framework of possible determinants of health professionals’ behaviour to study Critical Care practice in four countries. There were four key stakeholder participant groups including ICU physicians, pharmacists, clinical leads, and clinical microbiologists/ infectious disease physicians. Round one comprised participant interviews and Rounds two and three were online questionnaires using Delphi method. Results In this study, 141 participants were recruited of whom 82% were retained. Participants rated themselves as knowledgeable about SDD. Antibiotic resistance was identified as the most important issue. SDD was seen as a low clinical priority but few participants reported strong opposition. There was moderate agreement that research to date has not adequately addressed concerns about antibiotic resistance and lacks generalizability. Participants indicated equipoise with regard to benefits and harms of SDD, and indicated strong support for a further randomised trial. Conclusions Clinicians have clinical equipoise about the effectiveness of SDD. Future research requires longer follow up to assess antibiotic resistance as well as greater validity/generalizability to provide definitive answers on the effectiveness of decontamination and effects on antibiotic resistance. SDD was regarded as not being a high clinical priority, which may limit future trial participation. These results have identified that further large randomised controlled trial of SDD in critical care is both warranted and appropriate. PMID:24207137

Implementation of new clinical programs in the VHA healthcare system: the importance of early collaboration between clinical leadership and research.

PubMed

Wu, R Ryanne; Kinsinger, Linda S; Provenzale, Dawn; King, Heather A; Akerly, Patricia; Barnes, Lottie K; Datta, Santanu K; Grubber, Janet M; Katich, Nicholas; McNeil, Rebecca B; Monte, Robert; Sperber, Nina R; Atkins, David; Jackson, George L

2014-12-01

Collaboration between policy, research, and clinical partners is crucial to achieving proven quality care. The Veterans Health Administration has expended great efforts towards fostering such collaborations. Through this, we have learned that an ideal collaboration involves partnership from the very beginning of a new clinical program, so that the program is designed in a way that ensures quality, validity, and puts into place the infrastructure necessary for a reliable evaluation. This paper will give an example of one such project, the Lung Cancer Screening Demonstration Project (LCSDP). We will outline the ways that clinical, policy, and research partners collaborated in design, planning, and implementation in order to create a sustainable model that could be rigorously evaluated for efficacy and fidelity. We will describe the use of the Donabedian quality matrix to determine the necessary characteristics of a quality program and the importance of the linkage with engineering, information technology, and clinical paradigms to connect the development of an on-the-ground clinical program with the evaluation goal of a learning healthcare organization. While the LCSDP is the example given here, these partnerships and suggestions are salient to any healthcare organization seeking to implement new scientifically proven care in a useful and reliable way.

Development and psychometric testing of a Clinical Reasoning Evaluation Simulation Tool (CREST) for assessing nursing students' abilities to recognize and respond to clinical deterioration.

PubMed

Liaw, Sok Ying; Rashasegaran, Ahtherai; Wong, Lai Fun; Deneen, Christopher Charles; Cooper, Simon; Levett-Jones, Tracy; Goh, Hongli Sam; Ignacio, Jeanette

2018-03-01

The development of clinical reasoning skills in recognising and responding to clinical deterioration is essential in pre-registration nursing education. Simulation has been increasingly used by educators to develop this skill. To develop and evaluate the psychometric properties of a Clinical Reasoning Evaluation Simulation Tool (CREST) for measuring clinical reasoning skills in recognising and responding to clinical deterioration in a simulated environment. A scale development with psychometric testing and mixed methods study. Nursing students and academic staff were recruited at a university. A three-phase prospective study was conducted. Phase 1 involved the development and content validation of the CREST; Phase 2 included the psychometric testing of the tool with 15 second-year and 15 third-year nursing students who undertook the simulation-based assessment; Phase 3 involved the usability testing of the tool with nine academic staff through a survey questionnaire and focus group discussion. A 10-item CREST was developed based on a model of clinical reasoning. A content validity of 0.93 was obtained from the validation of 15 international experts. The construct validity was supported as the third-year students demonstrated significantly higher (p<0.001) clinical reasoning scores than the second-year students. The concurrent validity was also supported with significant positive correlations between global rating scores and almost all subscale scores, and the total scores. The predictive validity was supported with an existing tool. The internal consistency was high with a Cronbach's alpha of 0.92. A high inter-rater reliability was demonstrated with an intraclass correlation coefficient of 0.88. The usability of the tool was rated positively by the nurse educators but the need to ease the scoring process was highlighted. A valid and reliable tool was developed to measure the effectiveness of simulation in developing clinical reasoning skills for recognising and responding to clinical deterioration. Copyright © 2017. Published by Elsevier Ltd.

Validation of biomarkers to predict response to immunotherapy in cancer: Volume II - clinical validation and regulatory considerations.

PubMed

Dobbin, Kevin K; Cesano, Alessandra; Alvarez, John; Hawtin, Rachael; Janetzki, Sylvia; Kirsch, Ilan; Masucci, Giuseppe V; Robbins, Paul B; Selvan, Senthamil R; Streicher, Howard Z; Zhang, Jenny; Butterfield, Lisa H; Thurin, Magdalena

2016-01-01

There is growing recognition that immunotherapy is likely to significantly improve health outcomes for cancer patients in the coming years. Currently, while a subset of patients experience substantial clinical benefit in response to different immunotherapeutic approaches, the majority of patients do not but are still exposed to the significant drug toxicities. Therefore, a growing need for the development and clinical use of predictive biomarkers exists in the field of cancer immunotherapy. Predictive cancer biomarkers can be used to identify the patients who are or who are not likely to derive benefit from specific therapeutic approaches. In order to be applicable in a clinical setting, predictive biomarkers must be carefully shepherded through a step-wise, highly regulated developmental process. Volume I of this two-volume document focused on the pre-analytical and analytical phases of the biomarker development process, by providing background, examples and "good practice" recommendations. In the current Volume II, the focus is on the clinical validation, validation of clinical utility and regulatory considerations for biomarker development. Together, this two volume series is meant to provide guidance on the entire biomarker development process, with a particular focus on the unique aspects of developing immune-based biomarkers. Specifically, knowledge about the challenges to clinical validation of predictive biomarkers, which has been gained from numerous successes and failures in other contexts, will be reviewed together with statistical methodological issues related to bias and overfitting. The different trial designs used for the clinical validation of biomarkers will also be discussed, as the selection of clinical metrics and endpoints becomes critical to establish the clinical utility of the biomarker during the clinical validation phase of the biomarker development. Finally, the regulatory aspects of submission of biomarker assays to the U.S. Food and Drug Administration as well as regulatory considerations in the European Union will be covered.

Father for the first time - development and validation of a questionnaire to assess fathers’ experiences of first childbirth (FTFQ)

PubMed Central

2012-01-01

Background A father’s experience of the birth of his first child is important not only for his birth-giving partner but also for the father himself, his relationship with the mother and the newborn. No validated questionnaire assessing first-time fathers' experiences during childbirth is currently available. Hence, the aim of this study was to develop and validate an instrument to assess first-time fathers’ experiences of childbirth. Method Domains and items were initially derived from interviews with first-time fathers, and supplemented by a literature search and a focus group interview with midwives. The comprehensibility, comprehension and relevance of the items were evaluated by four paternity research experts and a preliminary questionnaire was pilot tested in eight first-time fathers. A revised questionnaire was completed by 200 first-time fathers (response rate = 81%) Exploratory factor analysis using principal component analysis with varimax rotation was performed and multitrait scaling analysis was used to test scaling assumptions. External validity was assessed by means of known-groups analysis. Results Factor analysis yielded four factors comprising 22 items and accounting 48% of the variance. The domains found were Worry, Information, Emotional support and Acceptance. Multitrait analysis confirmed the convergent and discriminant validity of the domains; however, Cronbach’s alpha did not meet conventional reliability standards in two domains. The questionnaire was sensitive to differences between groups of fathers hypothesized to differ on important socio demographic or clinical variables. Conclusions The questionnaire adequately measures important dimensions of first-time fathers’ childbirth experience and may be used to assess aspects of fathers’ experiences during childbirth. To obtain the FTFQ and permission for its use, please contact the corresponding author. PMID:22594834

Father for the first time--development and validation of a questionnaire to assess fathers' experiences of first childbirth (FTFQ).

PubMed

Premberg, Åsa; Taft, Charles; Hellström, Anna-Lena; Berg, Marie

2012-05-17

A father's experience of the birth of his first child is important not only for his birth-giving partner but also for the father himself, his relationship with the mother and the newborn. No validated questionnaire assessing first-time fathers' experiences during childbirth is currently available. Hence, the aim of this study was to develop and validate an instrument to assess first-time fathers' experiences of childbirth. Domains and items were initially derived from interviews with first-time fathers, and supplemented by a literature search and a focus group interview with midwives. The comprehensibility, comprehension and relevance of the items were evaluated by four paternity research experts and a preliminary questionnaire was pilot tested in eight first-time fathers. A revised questionnaire was completed by 200 first-time fathers (response rate = 81%) Exploratory factor analysis using principal component analysis with varimax rotation was performed and multitrait scaling analysis was used to test scaling assumptions. External validity was assessed by means of known-groups analysis. Factor analysis yielded four factors comprising 22 items and accounting 48% of the variance. The domains found were Worry, Information, Emotional support and Acceptance. Multitrait analysis confirmed the convergent and discriminant validity of the domains; however, Cronbach's alpha did not meet conventional reliability standards in two domains. The questionnaire was sensitive to differences between groups of fathers hypothesized to differ on important socio demographic or clinical variables. The questionnaire adequately measures important dimensions of first-time fathers' childbirth experience and may be used to assess aspects of fathers' experiences during childbirth. To obtain the FTFQ and permission for its use, please contact the corresponding author.

Factor solutions of the Social Phobia Scale (SPS) and the Social Interaction Anxiety Scale (SIAS) in a Swedish population.

PubMed

Mörtberg, Ewa; Reuterskiöld, Lena; Tillfors, Maria; Furmark, Tomas; Öst, Lars-Göran

2017-06-01

Culturally validated rating scales for social anxiety disorder (SAD) are of significant importance when screening for the disorder, as well as for evaluating treatment efficacy. This study examined construct validity and additional psychometric properties of two commonly used scales, the Social Phobia Scale and the Social Interaction Anxiety Scale, in a clinical SAD population (n = 180) and in a normal population (n = 614) in Sweden. Confirmatory factor analyses of previously reported factor solutions were tested but did not reveal acceptable fit. Exploratory factor analyses (EFA) of the joint structure of the scales in the total population yielded a two-factor model (performance anxiety and social interaction anxiety), whereas EFA in the clinical sample revealed a three-factor solution, a social interaction anxiety factor and two performance anxiety factors. The SPS and SIAS showed good to excellent internal consistency, and discriminated well between patients with SAD and a normal population sample. Both scales showed good convergent validity with an established measure of SAD, whereas the discriminant validity of symptoms of social anxiety and depression could not be confirmed. The optimal cut-off score for SPS and SIAS were 18 and 22 points, respectively. It is concluded that the factor structure and the additional psychometric properties of SPS and SIAS support the use of the scales for assessment in a Swedish population.

Design and Technical Validation of a Telemedicine Service for Rural Healthcare in Ecuador.

PubMed

Vasquez-Cevallos, Leonel A; Bobokova, Jana; González-Granda, Patricia V; Iniesta, José M; Gómez, Enrique J; Hernando, M Elena

2017-12-12

Telemedicine is becoming increasingly important in Ecuador, especially in areas such as rural primary healthcare and medical education. Rural telemedicine programs in the country need to be strengthened by means of a technological platform adapted to local surroundings and offering advantages such as access to specialized care, continuing education, and so on, combined with modest investment requirements. This present article presents the design of a Telemedicine Platform (TMP) for rural healthcare services in Ecuador and a preliminary technical validation with medical students and teachers. An initial field study was designed to capture the requirements of the TMP. In a second phase, the TMP was validated in an academic environment along three consecutive academic courses. Assessment was by means of user polls and analyzing user interactions as registered automatically by the platform. The TMP was developed using Web-based technology and open code software. One hundred twenty-four students and 6 specialized faculty members participated in the study, conducting a total of 262 teleconsultations of clinical cases and 226 responses, respectively. The validation results show that the TMP is a useful communication tool for the documentation and discussion of clinical cases. Moreover, its usage may be recommended as a teaching methodology, to strengthen the skills of medical undergraduates. The results indicate that implementing the system in rural healthcare services in Ecuador would be feasible.

The Anaclitic-Introjective Depression Assessment: Development and preliminary validity of an observer-rated measure.

PubMed

Rost, Felicitas; Luyten, Patrick; Fonagy, Peter

2018-03-01

The two-configurations model developed by Blatt and colleagues offers a comprehensive conceptual and empirical framework for understanding depression. This model suggests that depressed patients struggle, at different developmental levels, with issues related to dependency (anaclitic issues) or self-definition (introjective issues), or a combination of both. This paper reports three studies on the development and preliminary validation of the Anaclitic-Introjective Depression Assessment, an observer-rated assessment tool of impairments in relatedness and self-definition in clinical depression based on the item pool of the Shedler-Westen Assessment Procedure. Study 1 describes the development of the measure using expert consensus rating and Q-methodology. Studies 2 and 3 report the assessment of its psychometric properties, preliminary reliability, and validity in a sample of 128 patients diagnosed with treatment-resistant depression. Four naturally occurring clusters of depressed patients were identified using Q-factor analysis, which, overall, showed meaningful and theoretically expected relationships with anaclitic/introjective prototypes as formulated by experts, as well as with clinical, social, occupational, global, and relational functioning. Taken together, findings reported in this paper provide preliminary evidence for the reliability and validity of the Anaclitic-Introjective Depression Assessment, an observer-rated measure that allows the detection of important nuanced differentiations between and within anaclitic and introjective depression. Copyright © 2017 John Wiley & Sons, Ltd.

Embedded performance validity tests within the Hopkins Verbal Learning Test - Revised and the Brief Visuospatial Memory Test - Revised.

PubMed

Sawyer, R John; Testa, S Marc; Dux, Moira

2017-01-01

Various research studies and neuropsychology practice organizations have reiterated the importance of developing embedded performance validity tests (PVTs) to detect potentially invalid neurocognitive test data. This study investigated whether measures within the Hopkins Verbal Learning Test - Revised (HVLT-R) and the Brief Visuospatial Memory Test - Revised (BVMT-R) could accurately classify individuals who fail two or more PVTs during routine clinical assessment. The present sample of 109 United States military veterans (Mean age = 52.4, SD = 13.3), all consisted of clinically referred patients and received a battery of neuropsychological tests. Based on performance validity findings, veterans were assigned to valid (n = 86) or invalid (n = 23) groups. Of the 109 patients in the overall sample, 77 were administered the HLVT-R and 75 were administered the BVMT-R, which were examined for classification accuracy. The HVLT-R Recognition Discrimination Index and the BVMT-R Retention Percentage showed good to adequate discrimination with an area under the curve of .78 and .70, respectively. The HVLT-R Recognition Discrimination Index showed sensitivity of .53 with specificity of .93. The BVMT-R Retention Percentage demonstrated sensitivity of .31 with specificity of .92. When used in conjunction with other PVTs, these new embedded PVTs may be effective in the detection of invalid test data, although they are not intended for use in patients with dementia.

Validation and clinical significance of the Childhood Myositis Assessment Scale for assessment of muscle function in the juvenile idiopathic inflammatory myopathies.

PubMed

Huber, Adam M; Feldman, Brian M; Rennebohm, Robert M; Hicks, Jeanne E; Lindsley, Carol B; Perez, Maria D; Zemel, Lawrence S; Wallace, Carol A; Ballinger, Susan H; Passo, Murray H; Reed, Ann M; Summers, Ronald M; White, Patience H; Katona, Ildy M; Miller, Frederick W; Lachenbruch, Peter A; Rider, Lisa G

2004-05-01

To examine the measurement characteristics of the Childhood Myositis Assessment Scale (CMAS) in children with juvenile idiopathic inflammatory myopathy (juvenile IIM), and to obtain preliminary data on the clinical significance of CMAS scores. One hundred eight children with juvenile IIM were evaluated on 2 occasions, 7-9 months apart, using various measures of physical function, strength, and disease activity. Interrater reliability, construct validity, and responsiveness of the CMAS were examined. The minimum clinically important difference (MID) and CMAS scores corresponding to various degrees of physical disability were estimated. The intraclass correlation coefficient for 26 patients assessed by 2 examiners was 0.89, indicating very good interrater reliability. The CMAS score correlated highly with the Childhood Health Assessment Questionnaire (C-HAQ) score and with findings on manual muscle testing (MMT) (r(s) = -0.73 and 0.73, respectively) and moderately with physician-assessed global disease activity and skin activity, parent-assessed global disease severity, and muscle magnetic resonance imaging (r(s) = -0.44 to -0.61), thereby demonstrating good construct validity. The standardized response mean was 0.81 (95% confidence interval 0.53, 1.09) in patients with at least 0.8 cm improvement on a 10-cm visual analog scale for physician-assessed global disease activity, indicating strong responsiveness. In bivariate regression models predicting physician-assessed global disease activity, MMT remained significant in models containing the CMAS (P = 0.03) while the C-HAQ did not (P = 0.4). Estimates of the MID ranged from 1.5 to 3.0 points on a 0-52-point scale. CMAS scores corresponding to no, mild, mild-to-moderate, and moderate physical disability, respectively, were 48, 45, 39, and 30. The CMAS exhibits good reliability, construct validity, and responsiveness, and is therefore a valid instrument for the assessment of physical function, muscle strength, and endurance in children with juvenile IIM. Preliminary data on MID and corresponding levels of disability should aid in the clinical interpretation of CMAS scores when assessing patients with juvenile IIM.

A Psychometric Comparison of the Clinical Assessment Interview for Negative Symptoms and the Brief Negative Symptom Scale.

PubMed

Strauss, Gregory P; Gold, James M

2016-11-01

In 2005, the National Institute of Mental Health held a consensus development conference on negative symptoms of schizophrenia. Among the important conclusions of this meeting were that there are at least 5 commonly accepted domains of negative symptoms (blunted affect, alogia, avolition, anhedonia, asociality) and that new rating scales were needed to adequately assess these constructs. Two next-generation negative symptom scales resulted from this meeting: the Brief Negative Symptom Scale (BNSS) and Clinical Assessment Interview for Negative Symptoms (CAINS). Both measures are becoming widely used and studies have demonstrated good psychometric properties for each scale. The current study provides the first direct psychometric comparison of these scales. Participants included 65 outpatients diagnosed with schizophrenia or schizoaffective disorder who completed clinical interviews, questionnaires, and neuropsychological testing. Separate raters completed the BNSS and CAINS within the same week. Results indicated that both measures had good internal consistency, convergent validity, and discriminant validity. High correspondence was observed between CAINS and BNSS blunted affect and alogia items. Moderate convergence occurred for avolition and asociality items, and low convergence was seen among anhedonia items. Findings suggest that both scales have good psychometric properties, but that there are important distinctions among the items related to motivation and pleasure. © The Author 2016. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Observational studies: a valuable source for data on the true value of RA therapies.

PubMed

van Vollenhoven, Ronald F; Severens, Johan L

2011-03-01

The validity of observational studies is sometimes questioned because of the limitations of non-randomly assigned controls, various biases such as channeling bias, confounding by indication, and other pitfalls. Yet, (post-marketing) observational data can provide important information regarding not only drug safety but also the effectiveness and appropriate use of agents in the real world, outside of clinical trials. Observational studies also provide data regarding the wider value of these agents in terms of, for example, reducing the need for surgical procedures, reducing absenteeism and increasing productivity. Importantly, data from some observational registry studies have subsequently been confirmed by clinical trials, supporting the overall validity of the registry-based approach. Observational studies also allow measures such as health assessment questionnaire scores, disease activity scores, and glucocorticoid use over time to be monitored for longer periods. Furthermore, observational data in real, less strictly selected patients without the constraints of formal study populations may produce findings not observed in clinical trials but that warrant further investigation in a controlled trial environment. For example, recent data from the Stockholm tumor necrosis factor follow-up registry in Sweden showed increases in the time people worked after initiation of biologics that, surprisingly, continued into the fourth and fifth years of treatment--a finding not observed with standardized outcomes. Observational studies are truly an underappreciated and valuable source of data on the real value of anti-rheumatic therapies, and these data are essential for making sound decisions regarding coverage and reimbursement.

A post-publication analysis of the idealized upper reference value of 2.5 mIU/L for TSH: Time to support the thyroid axis with magnesium and iron especially in the setting of reproduction medicine.

PubMed

Moncayo, Roy; Moncayo, Helga

2017-06-01

Laboratory medicine approaches the evaluation of thyroid function mostly through the single determination of the blood level of thyroid stimulating hormone (TSH). Some authors have suggested an upper reference value for TSH of 2.5 mIU/L. This suggestion has not been confirmed by recent clinical studies. These studies have delivered a clinically valid reference range going from 0.3 to 3.5 mIU/L. These values are valid for both for the general population as well as in the setting of fertility and pregnancy. Current biochemical evidence about the elements required to maintain thyroid function shows that these not only include dietary iodine but also magnesium, iron, selenium and coenzyme Q10. Iron is important for the synthesis of thyroid peroxidase; magnesium-ATP contributes to the active process of iodine uptake; iodine has to be sufficiently present in the diet; selenium acts through selenoproteins to protect the thyroid cell during hormone synthesis and in deiodination of thyroxine; coenzyme Q10 influences thyroid vascularity. As a consequence, good clinical practice requires additional biochemical information on the blood levels of magnesium, selenium, coenzyme Q10 as well as iron status. Since these elements are also important for the maintenance of reproductive function, we postulate that they constitute the connecting link between both endocrine systems.

Affective Biases in Humans and Animals.

PubMed

Robinson, E S J; Roiser, J P

Depression is one of the most common but poorly understood psychiatric conditions. Although drug treatments and psychological therapies are effective in some patients, many do not achieve full remission and some patients receive no apparent benefit. Developing new improved treatments requires a better understanding of the aetiology of symptoms and evaluation of novel therapeutic targets in pre-clinical studies. Recent developments in our understanding of the basic cognitive processes that may contribute to the development of depression and its treatment offer new opportunities for both clinical and pre-clinical research. This chapter discusses the clinical evidence supporting a cognitive neuropsychological model of depression and antidepressant efficacy, and how this information may be usefully translated to pre-clinical investigation. Studies using neuropsychological tests in depressed patients and at risk populations have revealed basic negative emotional biases and disrupted reward and punishment processing, which may also impact on non-affective cognition. These affective biases are sensitive to antidepressant treatments with early onset effects observed, suggesting an important role in recovery. This clinical work into affective biases has also facilitated back-translation to animals and the development of assays to study affective biases in rodents. These animal studies suggest that, similar to humans, rodents in putative negative affective states exhibit negative affective biases on decision-making and memory tasks. Antidepressant treatments also induce positive biases in these rodent tasks, supporting the translational validity of this approach. Although still in the early stages of development and validation, affective biases in depression have the potential to offer new insights into the clinical condition, as well as facilitating the development of more translational approaches for pre-clinical studies.

Measuring the suffering of end-stage dementia: reliability and validity of the Mini-Suffering State Examination.

PubMed

Aminoff, Bechor Z; Purits, Elena; Noy, Shlomo; Adunsky, Abraham

2004-01-01

Assessment of suffering is extremely important in dying end-stage dementia patients (ESDP). We have developed and examined the reliability and validity of the Mini-Suffering State Examination (MSSE), in 103 consecutive bedridden ESDP. Main outcome measures included inter-observer reliability and concurrent validity. Reliability of the MSSE questionnaire was satisfactory, with Cronbach alpha values of 0.735 and 0.718 for the two physicians (Ph-1, Ph-2), respectively. The kappa agreement coefficient was 0.791. There was a high agreement for seven items (kappa 0.882-0.972) and a substantial agreement for the other three items (kappa 0.621-0.682) of the MSSE. MSSE was validated versus the comfort assessment in dying with dementia (CAD-EOLD) scale and resulted in a significant Pearson correlation (r=-0.796, P<0.001). We conclude that the MSSE scale is a reliable and valid clinical tool, recommended for evaluating the severity of the patient's condition and the level of suffering of ESDP. Use of MSSE may improve medical management and facilitate communication between patients and caregivers.

Validating the German Version of the Quality of Relationship Inventory: Confirming the Three-Factor Structure and Report of Psychometric Properties

PubMed Central

Reiner, Iris; Beutel, Manfred; Skaletz, Christian; Brähler, Elmar; Stöbel-Richter, Yve

2012-01-01

Research on psychosocial influences such as relationship characteristics has received increased attention in the clinical as well as social-psychological field. Several studies demonstrated that the quality of relationships, in particular with respect to the perceived support within intimate relationships, profoundly affects individuals' mental and physical health. There is, however, a limited choice of valid and internationally known assessments of relationship quality in Germany. We report the validation of the German version of the Quality of Relationships Inventory (QRI). First, we evaluated its factor structure in a representative German sample of 1.494 participants by means of confirmatory factor analysis. Our findings support the previously proposed three-factor structure. Second, importance and satisfaction with different relationship domains (family/children and relationship/sexuality) were linked with the QRI scales, demonstrating high construct validity. Finally, we report sex and age differences regarding the perceived relationship support, conflict and depth in our German sample. In conclusion, the QRI is a reliable and valid measurement to assess social support in romantic relationships in the German population. PMID:22662151

Clinical audit, a valuable tool to improve quality of care: General methodology and applications in nephrology.

PubMed

Esposito, Pasquale; Dal Canton, Antonio

2014-11-06

Evaluation and improvement of quality of care provided to the patients are of crucial importance in the daily clinical practice and in the health policy planning and financing. Different tools have been developed, including incident analysis, health technology assessment and clinical audit. The clinical audit consist of measuring a clinical outcome or a process, against well-defined standards set on the principles of evidence-based medicine in order to identify the changes needed to improve the quality of care. In particular, patients suffering from chronic renal diseases, present many problems that have been set as topics for clinical audit projects, such as hypertension, anaemia and mineral metabolism management. Although the results of these studies have been encouraging, demonstrating the effectiveness of audit, overall the present evidence is not clearly in favour of clinical audit. These findings call attention to the need to further studies to validate this methodology in different operating scenarios. This review examines the principle of clinical audit, focusing on experiences performed in nephrology settings.

Evaluation of a simple test of reaction time for baseline concussion testing in a population of high school athletes.

PubMed

MacDonald, James; Wilson, Julie; Young, Julie; Duerson, Drew; Swisher, Gail; Collins, Christy L; Meehan, William P

2015-01-01

A common sequela of concussions is impaired reaction time. Computerized neurocognitive tests commonly measure reaction time. A simple clinical test for reaction time has been studied previously in college athletes; whether this test is valid and reliable when assessing younger athletes remains unknown. Our study examines the reliability and validity of this test in a population of high school athletes. Cross-sectional study. Two American High Schools. High school athletes (N = 448) participating in American football or soccer during the academic years 2011 to 2012 and 2012 to 2013. All study participants completed a computerized baseline neurocognitive assessment that included a measure of reaction time (RT comp), in addition to a clinical measure of reaction time that assessed how far a standard measuring device would fall prior to the athlete catching it (RT clin). Validity was assessed by determining the correlation between RT clin and RT comp. Reliability was assessed by measuring the intraclass correlation coefficients (ICCs) between the repeated measures of RT clin and RT comp taken 1 year apart. In the first year of study, RT clin and RT comp were positively but weakly correlated (rs = 0.229, P < 0.001). In the second year, there was no significant correlation between RT clin and RT comp (rs = 0.084, P = 0.084). Both RT clin [ICC = 0.608; 95% confidence interval (CI), 0.434-0.728] and RT comp (ICC = 0.691; 95% CI, 0.554-0.786) had marginal reliability. In a population of high school athletes, RT clin had poor validity when compared with RT comp as a standard. Both RT clin and RT comp had marginal test-retest reliability. Before considering the clinical use of RT clin in the assessment of sport-related concussions sustained by high school athletes, the factors affecting reliability and validity should be investigated further. Reaction time impairment commonly results from concussion and is among the most clinically important measures of the condition. The device evaluated in this study has previously been investigated as a reaction time measure in college athletes. This study investigates the clinical generalizability of the device in a younger population. A video abstract showing how the RT clin device is used in practice is available as Supplemental Digital Content 1, http://links.lww.com/JSM/A43.

An artificial neural network to predict resting energy expenditure in obesity.

PubMed

Disse, Emmanuel; Ledoux, Séverine; Bétry, Cécile; Caussy, Cyrielle; Maitrepierre, Christine; Coupaye, Muriel; Laville, Martine; Simon, Chantal

2017-09-01

The resting energy expenditure (REE) determination is important in nutrition for adequate dietary prescription. The gold standard i.e. indirect calorimetry is not available in clinical settings. Thus, several predictive equations have been developed, but they lack of accuracy in subjects with extreme weight including obese populations. Artificial neural networks (ANN) are useful predictive tools in the area of artificial intelligence, used in numerous clinical fields. The aim of this study was to determine the relevance of ANN in predicting REE in obesity. A Multi-Layer Perceptron (MLP) feed-forward neural network with a back propagation algorithm was created and cross-validated in a cohort of 565 obese subjects (BMI within 30-50 kg m -2 ) with weight, height, sex and age as clinical inputs and REE measured by indirect calorimetry as output. The predictive performances of ANN were compared to those of 23 predictive REE equations in the training set and in two independent sets of 100 and 237 obese subjects for external validation. Among the 23 established prediction equations for REE evaluated, the Harris & Benedict equations recalculated by Roza were the most accurate for the obese population, followed by the USA DRI, Müller and the original Harris & Benedict equations. The final 5-fold cross-validated three-layer 4-3-1 feed-forward back propagation ANN model developed in that study improved precision and accuracy of REE prediction over linear equations (precision = 68.1%, MAPE = 8.6% and RMSPE = 210 kcal/d), independently from BMI subgroups within 30-50 kg m -2 . External validation confirmed the better predictive performances of ANN model (precision = 73% and 65%, MAPE = 7.7% and 8.6%, RMSPE = 187 kcal/d and 200 kcal/d in the 2 independent datasets) for the prediction of REE in obese subjects. We developed and validated an ANN model for the prediction of REE in obese subjects that is more precise and accurate than established REE predictive equations independent from BMI subgroups. For convenient use in clinical settings, we provide a simple ANN-REE calculator available at: https://www.crnh-rhone-alpes.fr/fr/ANN-REE-Calculator. Copyright © 2017 Elsevier Ltd and European Society for Clinical Nutrition and Metabolism. All rights reserved.

Whither lung EIT: where are we, where do we want to go and what do we need to get there?

PubMed

Adler, Andy; Amato, Marcelo B; Arnold, John H; Bayford, Richard; Bodenstein, Marc; Böhm, Stephan H; Brown, Brian H; Frerichs, Inéz; Stenqvist, Ola; Weiler, Norbert; Wolf, Gerhard K

2012-05-01

Breathing moves volumes of electrically insulating air into and out of the lungs, producing conductivity changes which can be seen by electrical impedance tomography (EIT). It has thus been apparent, since the early days of EIT research, that imaging of ventilation could become a key clinical application of EIT. In this paper, we review the current state and future prospects for lung EIT, by a synthesis of the presentations of the authors at the 'special lung sessions' of the annual biomedical EIT conferences in 2009-2011. We argue that lung EIT research has arrived at an important transition. It is now clear that valid and reproducible physiological information is available from EIT lung images. We must now ask the question: How can these data be used to help improve patient outcomes? To answer this question, we develop a classification of possible clinical scenarios in which EIT could play an important role, and we identify clinical and experimental research programmes and engineering developments required to turn EIT into a clinically useful tool for lung monitoring.

Robot-aided assessment of lower extremity functions: a review.

PubMed

Maggioni, Serena; Melendez-Calderon, Alejandro; van Asseldonk, Edwin; Klamroth-Marganska, Verena; Lünenburger, Lars; Riener, Robert; van der Kooij, Herman

2016-08-02

The assessment of sensorimotor functions is extremely important to understand the health status of a patient and its change over time. Assessments are necessary to plan and adjust the therapy in order to maximize the chances of individual recovery. Nowadays, however, assessments are seldom used in clinical practice due to administrative constraints or to inadequate validity, reliability and responsiveness. In clinical trials, more sensitive and reliable measurement scales could unmask changes in physiological variables that would not be visible with existing clinical scores.In the last decades robotic devices have become available for neurorehabilitation training in clinical centers. Besides training, robotic devices can overcome some of the limitations in traditional clinical assessments by providing more objective, sensitive, reliable and time-efficient measurements. However, it is necessary to understand the clinical needs to be able to develop novel robot-aided assessment methods that can be integrated in clinical practice.This paper aims at providing researchers and developers in the field of robotic neurorehabilitation with a comprehensive review of assessment methods for the lower extremities. Among the ICF domains, we included those related to lower extremities sensorimotor functions and walking; for each chapter we present and discuss existing assessments used in routine clinical practice and contrast those to state-of-the-art instrumented and robot-aided technologies. Based on the shortcomings of current assessments, on the identified clinical needs and on the opportunities offered by robotic devices, we propose future directions for research in rehabilitation robotics. The review and recommendations provided in this paper aim to guide the design of the next generation of robot-aided functional assessments, their validation and their translation to clinical practice.

Parent proxy-report of their children's health-related quality of life: an analysis of 13,878 parents' reliability and validity across age subgroups using the PedsQL 4.0 Generic Core Scales.

PubMed

Varni, James W; Limbers, Christine A; Burwinkle, Tasha M

2007-01-03

Health-related quality of life (HRQOL) measurement has emerged as an important health outcome in clinical trials, clinical practice improvement strategies, and healthcare services research and evaluation. While pediatric patient self-report should be considered the standard for measuring perceived HRQOL, there are circumstances when children are too young, too cognitively impaired, too ill or fatigued to complete a HRQOL instrument, and reliable and valid parent proxy-report instruments are needed in such cases. Further, it is typically parents' perceptions of their children's HRQOL that influences healthcare utilization. Data from the PedsQL DatabaseSM were utilized to test the reliability and validity of parent proxy-report at the individual age subgroup level for ages 2-16 years as recommended by recent FDA guidelines. The sample analyzed represents parent proxy-report age data on 13,878 children ages 2 to 16 years from the PedsQL 4.0 Generic Core Scales DatabaseSM. Parents were recruited from general pediatric clinics, subspecialty clinics, and hospitals in which their children were being seen for well-child checks, mild acute illness, or chronic illness care (n = 3,718, 26.8%), and from a State Children's Health Insurance Program (SCHIP) in California (n = 10,160, 73.2%). The percentage of missing item responses for the parent proxy-report sample as a whole was 2.1%, supporting feasibility. The majority of the parent proxy-report scales across the age subgroups exceeded the minimum internal consistency reliability standard of 0.70 required for group comparisons, while the Total Scale Scores across the age subgroups approached or exceeded the reliability criterion of 0.90 recommended for analyzing individual patient scale scores. Construct validity was demonstrated utilizing the known groups approach. For each PedsQL scale and summary score, across age subgroups, healthy children demonstrated a statistically significant difference in HRQOL (better HRQOL) than children with a known chronic health condition, with most effect sizes in the medium to large effect size range. The results demonstrate the feasibility, reliability, and validity of parent proxy-report at the individual age subgroup for ages 2-16 years. These analyses are consistent with recent FDA guidelines which require instrument development and validation testing for children and adolescents within fairly narrow age groupings and which determine the lower age limit at which reliable and valid responses across age categories are achievable. Even as pediatric patient self-report is advocated, there remains a fundamental role for parent proxy-report in pediatric clinical trials and health services research.

Contemporary Aspects of Marketing in Clinical Trials Including Segments of IT and Technology Transfer

PubMed Central

Stamenovic, Milorad; Dobraca, Amra; Smajlovic, Mersiha

2018-01-01

Introduction: The aim of this paper is to present the marketing strategy and the application of management (marketing management) and advertising in order to increase the efficiency of innovative approach in clinical trials that include and involve the use of new technologies and transfer of technologies. Material and Methods: This paper has a descriptive character and represents a narrative review of the literature and new model implementation. Results: Marketing models are primarily used to improve the inclusion of a larger (and appropriate) number of patients, but they can be credited for the stay and monitoring of patients in the trial. Regulatory mechanisms play an important role in the application of various marketing strategies within clinical trials. The value for the patient as the most important stakeholder is defined in the field of clinical trials according to Kotler’s value model for the consumer. Conclusion: In order to achieve the best results it is important to adequately examine all the elements of clinical trials and apply this knowledge in creation of a marketing plan that will be made in accordance with the legal regulations defined globally and locally. In this paper, two challenges have been highlighted for the adequate application of marketing tools in the field of clinical trials, namely: defining business elements in order to provide an adequate marketing approach for clinical trials and technology transfer and ensuring uniformity and regulatory affirmation of marketing attitudes in clinical trials in all regions in which they are carried out in accordance with ICH-GCP and valid regulations. PMID:29719318

The DSM-5 Trait Measure in a Psychiatric Sample of Late Adolescents and Emerging Adults: Structure, Reliability, and Validity.

PubMed

De Caluwé, Elien; Verbeke, Lize; van Aken, Marcel; van der Heijden, Paul T; De Clercq, Barbara

2018-02-22

The inclusion of a dimensional trait model of personality pathology in DSM-5 creates new opportunities for research on developmental antecedents of personality pathology. The traits of this model can be measured with the Personality Inventory for DSM-5 (PID-5), initially developed for adults, but also demonstrating validity in adolescents. The present study adds to the growing body of literature on the psychometrics of the PID-5, by examining its structure, validity, and reliability in 187 psychiatric-referred late adolescents and emerging adults. PID-5, Big Five Inventory, and Kidscreen self-reports were provided, and 88 non-clinical matched controls completed the PID-5. Results confirm the PID-5's five-factor structure, indicate adequate psychometric properties, and underscore the construct and criterion validity, showing meaningful associations with adaptive traits and quality of life. Results are discussed in terms of the PID-5's applicability in vulnerable populations who are going through important developmental transition phases, such as the step towards early adulthood.

Different Diagnosis, Shared Vulnerabilities: The Value of Cross Disorder Validation of Capacity to Consent.

PubMed

Rosen, Allyson; Weitlauf, Julie C

2015-01-01

A screening measure of capacity to consent can provide an efficient method of determining the appropriateness of including individuals from vulnerable patient populations in research, particularly in circumstances in which no caregiver is available to provide surrogate consent. Seaman et al. (2015) cross-validate a measure of capacity to consent to research developed by Jeste et al. (2007). They provide data on controls, caregivers, and patients with mild cognitive impairment and dementia. The study demonstrates the importance of validating measures across disorders with different domains of incapacity, as well as the need for timely and appropriate follow-up with potential participants who yield positive screens. Ultimately clinical measures need to adapt to the dimensional diagnostic approaches put forward in DSM 5. Integrative models of constructs, such as capacity to consent, will make this process more efficient by avoiding the need to test measures in each disorder. Until then, cross-validation studies, such as the work by Seaman et al. (2015) are critical.

Under-coding of secondary conditions in coded hospital health data: Impact of co-existing conditions, death status and number of codes in a record.

PubMed

Peng, Mingkai; Southern, Danielle A; Williamson, Tyler; Quan, Hude

2017-12-01

This study examined the coding validity of hypertension, diabetes, obesity and depression related to the presence of their co-existing conditions, death status and the number of diagnosis codes in hospital discharge abstract database. We randomly selected 4007 discharge abstract database records from four teaching hospitals in Alberta, Canada and reviewed their charts to extract 31 conditions listed in Charlson and Elixhauser comorbidity indices. Conditions associated with the four study conditions were identified through multivariable logistic regression. Coding validity (i.e. sensitivity, positive predictive value) of the four conditions was related to the presence of their associated conditions. Sensitivity increased with increasing number of diagnosis code. Impact of death on coding validity is minimal. Coding validity of conditions is closely related to its clinical importance and complexity of patients' case mix. We recommend mandatory coding of certain secondary diagnosis to meet the need of health research based on administrative health data.

Development and Psychometric Testing of a Scale for Evaluating Self-Management Needs of Knee Osteoarthritis (SMNKOA) in Taiwan.

PubMed

Kao, Mei-Hua; Tsai, Yun-Fang

2017-06-01

Self-management of osteoarthritis (OA) of the knee is important for treating this chronic disease. This study developed and psychometrically tested a new instrument for measuring adult patients' self-management needs of knee osteoarthritis (SMNKOA). The theoretical framework of self-care guided the development of the 35-item SMNKOA scale. Participants ( N = 372) were purposively sampled from orthopedic clinics at medical centers in Taiwan. The content validity index was 0.83. Principal components analysis identified a three-factor solution, accounting for 53.19% of the variance. The divergent validity was -0.67; convergent validity was -0.51. Cronbach's alpha was .95, Pearson's correlation coefficient was .88, and the intraclass correlation coefficient was .95. The scale's reliability and validity supports the SMNKOA, as a tool to measure self-management needs of adults with knee OA. Nurses and other health care providers can use this instrument to evaluate knee OA patients and identify strategies for improving health-related outcomes and patient education.

The novel biomarker-based ABC (age, biomarkers, clinical history)-bleeding risk score for patients with atrial fibrillation: a derivation and validation study.

PubMed

Hijazi, Ziad; Oldgren, Jonas; Lindbäck, Johan; Alexander, John H; Connolly, Stuart J; Eikelboom, John W; Ezekowitz, Michael D; Held, Claes; Hylek, Elaine M; Lopes, Renato D; Siegbahn, Agneta; Yusuf, Salim; Granger, Christopher B; Wallentin, Lars

2016-06-04

The benefit of oral anticoagulation in atrial fibrillation is based on a balance between reduction in ischaemic stroke and increase in major bleeding. We aimed to develop and validate a new biomarker-based risk score to improve the prognostication of major bleeding in patients with atrial fibrillation. We developed and internally validated a new biomarker-based risk score for major bleeding in 14,537 patients with atrial fibrillation randomised to apixaban versus warfarin in the ARISTOTLE trial and externally validated it in 8468 patients with atrial fibrillation randomised to dabigatran versus warfarin in the RE-LY trial. Plasma samples for determination of candidate biomarker concentrations were obtained at randomisation. Major bleeding events were centrally adjudicated. The predictive values of biomarkers and clinical variables were assessed with Cox regression models. The most important variables were included in the score with weights proportional to the model coefficients. The ARISTOTLE and RE-LY trials are registered with ClinicalTrials.gov, numbers NCT00412984 and NCT00262600, respectively. The most important predictors for major bleeding were the concentrations of the biomarkers growth differentiation factor-15 (GDF-15), high-sensitivity cardiac troponin T (cTnT-hs) and haemoglobin, age, and previous bleeding. The ABC-bleeding score (age, biomarkers [GDF-15, cTnT-hs, and haemoglobin], and clinical history [previous bleeding]) score yielded a higher c-index than the conventional HAS-BLED and the newer ORBIT scores for major bleeding in both the derivation cohort (0·68 [95% CI 0·66-0·70] vs 0·61 [0·59-0·63] vs 0·65 [0·62-0·67], respectively; ABC-bleeding vs HAS-BLED p<0·0001 and ABC-bleeding vs ORBIT p=0·0008). ABC-bleeding score also yielded a higher c-index score in the the external validation cohort (0·71 [95% CI 0·68-0·73] vs 0·62 [0·59-0·64] for HAS-BLED vs 0·68 [0·65-0·70] for ORBIT; ABC-bleeding vs HAS-BLED p<0·0001 and ABC-bleeding vs ORBIT p=0·0016). A modified ABC-bleeding score using alternative biomarkers (haematocrit, cTnI-hs, cystatin C, or creatinine clearance) also outperformed the HAS-BLED and ORBIT scores. The ABC-bleeding score, using age, history of bleeding, and three biomarkers (haemoglobin, cTn-hs, and GDF-15 or cystatin C/CKD-EPI) was internally and externally validated and calibrated in large cohorts of patients with atrial fibrillation receiving anticoagulation therapy. The ABC-bleeding score performed better than HAS-BLED and ORBIT scores and should be useful as decision support on anticoagulation treatment in patients with atrial fibrillation. BMS, Pfizer, Boehringer Ingelheim, Roche Diagnostics. Copyright © 2016 Elsevier Ltd. All rights reserved.

Oncology biomarkers: discovery, validation, and clinical use.

PubMed

Heckman-Stoddard, Brandy M

2012-05-01

To discuss the discovery, validation, and clinical use of multiple types of biomarkers. Medical literature and published guidelines. Formal validation of biomarkers should include both retrospective analyses of well-characterized samples as well as a prospective clinical trial in which the biomarker is tested for its ability to predict the presence of disease or the efficacy of a cancer therapy. Biomarker development is complicated, with very few biomarker discoveries leading to clinically useful tests. Nurses should understand how a biomarker was developed, including the sensitivity and specificity before applying new biomarkers in the clinical setting. Copyright © 2012. Published by Elsevier Inc.

Validating genetic markers of response to recombinant human growth hormone in children with growth hormone deficiency and Turner syndrome: the PREDICT validation study

PubMed Central

Stevens, Adam; Murray, Philip; Wojcik, Jerome; Raelson, John; Koledova, Ekaterina; Chatelain, Pierre

2016-01-01

Objective Single-nucleotide polymorphisms (SNPs) associated with the response to recombinant human growth hormone (r-hGH) have previously been identified in growth hormone deficiency (GHD) and Turner syndrome (TS) children in the PREDICT long-term follow-up (LTFU) study (Nbib699855). Here, we describe the PREDICT validation (VAL) study (Nbib1419249), which aimed to confirm these genetic associations. Design and methods Children with GHD (n = 293) or TS (n = 132) were recruited retrospectively from 29 sites in nine countries. All children had completed 1 year of r-hGH therapy. 48 SNPs previously identified as associated with first year growth response to r-hGH were genotyped. Regression analysis was used to assess the association between genotype and growth response using clinical/auxological variables as covariates. Further analysis was undertaken using random forest classification. Results The children were younger, and the growth response was higher in VAL study. Direct genotype analysis did not replicate what was found in the LTFU study. However, using exploratory regression models with covariates, a consistent relationship with growth response in both VAL and LTFU was shown for four genes – SOS1 and INPPL1 in GHD and ESR1 and PTPN1 in TS. The random forest analysis demonstrated that only clinical covariates were important in the prediction of growth response in mild GHD (>4 to <10 μg/L on GH stimulation test), however, in severe GHD (≤4 μg/L) several SNPs contributed (in IGF2, GRB10, FOS, IGFBP3 and GHRHR). Conclusions The PREDICT validation study supports, in an independent cohort, the association of four of 48 genetic markers with growth response to r-hGH treatment in both pre-pubertal GHD and TS children after controlling for clinical/auxological covariates. However, the contribution of these SNPs in a prediction model of first-year response is not sufficient for routine clinical use. PMID:27651465

Validating genetic markers of response to recombinant human growth hormone in children with growth hormone deficiency and Turner syndrome: the PREDICT validation study.

PubMed

Stevens, Adam; Murray, Philip; Wojcik, Jerome; Raelson, John; Koledova, Ekaterina; Chatelain, Pierre; Clayton, Peter

2016-12-01

Single-nucleotide polymorphisms (SNPs) associated with the response to recombinant human growth hormone (r-hGH) have previously been identified in growth hormone deficiency (GHD) and Turner syndrome (TS) children in the PREDICT long-term follow-up (LTFU) study (Nbib699855). Here, we describe the PREDICT validation (VAL) study (Nbib1419249), which aimed to confirm these genetic associations. Children with GHD (n = 293) or TS (n = 132) were recruited retrospectively from 29 sites in nine countries. All children had completed 1 year of r-hGH therapy. 48 SNPs previously identified as associated with first year growth response to r-hGH were genotyped. Regression analysis was used to assess the association between genotype and growth response using clinical/auxological variables as covariates. Further analysis was undertaken using random forest classification. The children were younger, and the growth response was higher in VAL study. Direct genotype analysis did not replicate what was found in the LTFU study. However, using exploratory regression models with covariates, a consistent relationship with growth response in both VAL and LTFU was shown for four genes - SOS1 and INPPL1 in GHD and ESR1 and PTPN1 in TS. The random forest analysis demonstrated that only clinical covariates were important in the prediction of growth response in mild GHD (>4 to <10 μg/L on GH stimulation test), however, in severe GHD (≤4 μg/L) several SNPs contributed (in IGF2, GRB10, FOS, IGFBP3 and GHRHR). The PREDICT validation study supports, in an independent cohort, the association of four of 48 genetic markers with growth response to r-hGH treatment in both pre-pubertal GHD and TS children after controlling for clinical/auxological covariates. However, the contribution of these SNPs in a prediction model of first-year response is not sufficient for routine clinical use. © 2016 European Society of Endocrinology.

Classification and regression tree (CART) model to predict pulmonary tuberculosis in hospitalized patients.

PubMed

Aguiar, Fabio S; Almeida, Luciana L; Ruffino-Netto, Antonio; Kritski, Afranio Lineu; Mello, Fernanda Cq; Werneck, Guilherme L

2012-08-07

Tuberculosis (TB) remains a public health issue worldwide. The lack of specific clinical symptoms to diagnose TB makes the correct decision to admit patients to respiratory isolation a difficult task for the clinician. Isolation of patients without the disease is common and increases health costs. Decision models for the diagnosis of TB in patients attending hospitals can increase the quality of care and decrease costs, without the risk of hospital transmission. We present a predictive model for predicting pulmonary TB in hospitalized patients in a high prevalence area in order to contribute to a more rational use of isolation rooms without increasing the risk of transmission. Cross sectional study of patients admitted to CFFH from March 2003 to December 2004. A classification and regression tree (CART) model was generated and validated. The area under the ROC curve (AUC), sensitivity, specificity, positive and negative predictive values were used to evaluate the performance of model. Validation of the model was performed with a different sample of patients admitted to the same hospital from January to December 2005. We studied 290 patients admitted with clinical suspicion of TB. Diagnosis was confirmed in 26.5% of them. Pulmonary TB was present in 83.7% of the patients with TB (62.3% with positive sputum smear) and HIV/AIDS was present in 56.9% of patients. The validated CART model showed sensitivity, specificity, positive predictive value and negative predictive value of 60.00%, 76.16%, 33.33%, and 90.55%, respectively. The AUC was 79.70%. The CART model developed for these hospitalized patients with clinical suspicion of TB had fair to good predictive performance for pulmonary TB. The most important variable for prediction of TB diagnosis was chest radiograph results. Prospective validation is still necessary, but our model offer an alternative for decision making in whether to isolate patients with clinical suspicion of TB in tertiary health facilities in countries with limited resources.

Quasi-experiments to establish causal effects of HIV care and treatment and to improve the cascade of care

PubMed Central

Bor, Jacob; Geldsetzer, Pascal; Venkataramani, Atheendar; Bärnighausen, Till

2015-01-01

Purpose of review Randomized, population-representative trials of clinical interventions are rare. Quasi-experiments have been used successfully to generate causal evidence on the cascade of HIV care in a broad range of real-world settings. Recent findings Quasi-experiments exploit exogenous, or quasi-random, variation occurring naturally in the world or because of an administrative rule or policy change to estimate causal effects. Well designed quasi-experiments have greater internal validity than typical observational research designs. At the same time, quasi-experiments may also have potential for greater external validity than experiments and can be implemented when randomized clinical trials are infeasible or unethical. Quasi-experimental studies have established the causal effects of HIV testing and initiation of antiretroviral therapy on health, economic outcomes and sexual behaviors, as well as indirect effects on other community members. Recent quasi-experiments have evaluated specific interventions to improve patient performance in the cascade of care, providing causal evidence to optimize clinical management of HIV. Summary Quasi-experiments have generated important data on the real-world impacts of HIV testing and treatment and on interventions to improve the cascade of care. With the growth in large-scale clinical and administrative data, quasi-experiments enable rigorous evaluation of policies implemented in real-world settings. PMID:26371463

Quasi-experiments to establish causal effects of HIV care and treatment and to improve the cascade of care.

PubMed

Bor, Jacob; Geldsetzer, Pascal; Venkataramani, Atheendar; Bärnighausen, Till

2015-11-01

Randomized, population-representative trials of clinical interventions are rare. Quasi-experiments have been used successfully to generate causal evidence on the cascade of HIV care in a broad range of real-world settings. Quasi-experiments exploit exogenous, or quasi-random, variation occurring naturally in the world or because of an administrative rule or policy change to estimate causal effects. Well designed quasi-experiments have greater internal validity than typical observational research designs. At the same time, quasi-experiments may also have potential for greater external validity than experiments and can be implemented when randomized clinical trials are infeasible or unethical. Quasi-experimental studies have established the causal effects of HIV testing and initiation of antiretroviral therapy on health, economic outcomes and sexual behaviors, as well as indirect effects on other community members. Recent quasi-experiments have evaluated specific interventions to improve patient performance in the cascade of care, providing causal evidence to optimize clinical management of HIV. Quasi-experiments have generated important data on the real-world impacts of HIV testing and treatment and on interventions to improve the cascade of care. With the growth in large-scale clinical and administrative data, quasi-experiments enable rigorous evaluation of policies implemented in real-world settings.

Ethical considerations in clinical research on herbal medicine for prevention of cardiovascular disease in the ageing.

PubMed

Koonrungsesomboon, Nut; Karbwang, Juntra

2016-10-15

Cardiovascular disease (CVD) in the ageing is a major public health problem worldwide. The nature of most CVD is subclinical with pathological processes that can span over years. Use of preventive measures could be an appropriate approach to prevailing over CVD in the ageing, and herbal medicine is one of the promising preventive approaches and is currently of interest among medical societies. In the evidence-based era, herbal medicine is, however, often underestimated and approached with skepticism, mainly due to the paucity of scientific evidence. Properly designed clinical trials on herbal medicine for prevention of CVD in a geriatric population are thus of importance and of clinical value. To review ethical issues and discuss considerations when such research is proposed. Four ethical issues, including the scientific validity of research, risk-benefit assessments, subject selection and vulnerability, and informed consent, are structured and extensively discussed in this article. Ethical core considerations of prevention research of CVD on herbal medicine involve particular attention on the scientific validity of research, risk-benefit assessments, subject selection and vulnerability, and informed consent. These issues and considerations are keys, although they must be adapted to an individual research setting in which a clinical study is proposed. Copyright © 2015 Elsevier GmbH. All rights reserved.

Validation of the Chinese Challenging Behaviour Scale: clinical correlates of challenging behaviours in nursing home residents with dementia.

PubMed

Lam, Chi Leung; Chan, W C; Mok, Cycbie C M; Li, S W; Lam, Linda C W

2006-08-01

Behavioural and psychological symptoms of dementia (BPSD) are associated with considerable burden to patients with dementia and their caregivers. Formal caregivers in residential care settings face different challenges when delivering care. This study aimed at assessing the clinical correlates of challenging BPSD using the Chinese version of the Challenging Behaviour Scale (CCBS) designed for residential care settings. One hundred and twenty-five participants were recruited from three care-and-attention homes in Hong Kong. The CCBS was administered together with the Cantonese version of Mini-Mental State Examination (MMSE), Clinical Dementia Rating (CDR), Disability Assessment for Dementia (DAD) and Neuropsychiatric Inventory (NPI) to explore the relationships between challenging behaviour and important clinical correlates. The CCBS had good internal consistency (alpha = 0.86), inter-rater (ICC = 0.79) and test-retest reliability (ICC = 0.98). A four-factor structure is demonstrated by factor analysis: hyperactivity behaviours, hypoactivity behaviours, verbally aggressive and aberrant behaviours. Challenging behaviours were associated with male gender, cognitive impairment, functional disability, neuropsychiatric symptoms, and higher caregiver's workload. The CCBS is a valid and reliable measure to assess BPSD in residential care settings in local Chinese community. It is useful in evaluating the challenges faced by formal caregivers during daily care of the dementia patients.

Mock Pages Are a Valid Construct for Assessment of Clinical Decision Making and Interprofessional Communication.

PubMed

Boehler, Margaret L; Schwind, Cathy J; Markwell, Stephen J; Minter, Rebecca M

2017-01-01

Answering pages from nurses about patients in need of immediate attention is one of the most difficult challenges a resident faces during their first days as a physician. A Mock Page program has been developed and adopted into a national surgical resident preparatory curriculum to prepare senior medical students for this important skill. The purpose of this study is to assess standardized mock page cases as a valid construct to assess clinical decision making and interprofessional communication skills. Mock page cases (n = 16) were administered to 213 senior medical students from 12 medical schools participating in a national surgical resident preparatory curriculum in 2013 and 2014. Clinical decision making and interprofessional communication were measured by case-specific assessments evaluating these skills which have undergone rigorous standard-setting to determine pass/fail cut points. Students' performance improved in general for both communication and clinical decision making over the 4-week course. Cases have been identified that seem to be best suited for differentiating high- from low-performing students. Chest pain, pulmonary embolus, and mental status change cases posed the greatest difficulty for student learners. Simulated mock pages demonstrate an innovative technique for training students in both effective interprofessional communication and management of common postoperative conditions they will encounter as new surgical interns.

The Professionalism Assessment of Clinical Teachers (PACT): The Reliability and Validity of a Novel Tool to Evaluate Professional and Clinical Teaching Behaviors

ERIC Educational Resources Information Center

Young, Meredith E.; Cruess, Sylvia R.; Cruess, Richard L.; Steinert, Yvonne

2014-01-01

Physicians function as clinicians, teachers, and role models within the clinical environment. Negative learning environments have been shown to be due to many factors, including the presence of unprofessional behaviors among clinical teachers. Reliable and valid assessments of clinical teacher performance, including professional behaviors, may…

Evaluative frailty index for physical activity (EFIP): a reliable and valid instrument to measure changes in level of frailty.

PubMed

de Vries, Nienke M; Staal, J Bart; Olde Rikkert, Marcel G M; Nijhuis-van der Sanden, Maria W G

2013-04-01

Physical activity is assumed to be important in the prevention and treatment of frailty. It is unclear, however, to what extent frailty can be influenced because instruments designed to assess frailty have not been validated as evaluative outcome instruments in clinical practice. The aims of this study were: (1) to develop a frailty index (i.e., the evaluative frailty index for physical activity [EFIP]) based on the method of deficit accumulation and (2) to test the clinimetric properties of the EFIP. The content of the EFIP was determined using a written Delphi procedure. Intrarater reliability, interrater reliability, and construct validity were determined in an observational study (n=24). Intrarater reliability and interrater reliability were calculated using Cohen kappa and intraclass correlation coefficients (ICCs). Construct validity was determined by correlating the score on the EFIP with those on the timed "up & go" test (TUG), the performance-oriented mobility assessment (POMA), and the Cumulative Illness Rating Scale for Geriatrics (CIRS-G). Fifty items were included in the EFIP. Interrater reliability (Cohen kappa=0.72, ICC=.96) and intrarater reliability (Cohen kappa=0.77 and 0.80, ICC=.93 and .98) were good. As expected, a fair to moderate correlation with the TUG, POMA, and CIRS-G was found (.61, -.70, and .66, respectively). Reliability and validity of the EFIP have been tested in a small sample. These and other clinimetric properties, such as responsiveness, will be assessed or reassessed in a larger study population. The EFIP is a reliable and valid instrument to evaluate the effect of physical activity on frailty in research and in clinical practice.

RENZI SCORE FOR OBSTRUCTED DEFECATION SYNDROME - VALIDATION OF THE PORTUGUESE VERSION ACCORDING TO THE COSMIN CHECKLIST.

PubMed

Caetano, Ana Celia; Dias, Sara; Santa-Cruz, André; Rolanda, Carla

2018-01-01

Recently, the Obstructed Defecation Syndrome score (ODS score) was developed and validated by Renzi to assess clinical staging and to allow evaluation and comparison of the efficacy of treatment of this disorder. Our goal is to validate the Portuguese version of Renzi ODS score, according to the Consensus based Standards for the selection of the Health Measurement Instruments (COSMIN) checklist. Following guidelines for cross-cultural validity, Renzi ODS score was translated into the Portuguese language. Then, a group of patients and healthy controls were invited to fill in the Renzi ODS score at baseline, after 2 weeks and 3 months, respectively. We assessed internal consistency, reliability and measurement error, content and construct validity, responsiveness and interpretability. A total of 113 individuals (77 patients; 36 healthy controls) completed the questionnaire. Seventy and 30 patients repeated the Renzi ODS score after 2 weeks and 3 months respectively. Factor analysis confirmed the unidimensionality of the scale. Cronbach's α coefficient of 0.77 supported item's homogeneity. Weighted quadratic kappa of 0.89 established test-retest reliability. The smallest detectable change at the individual level was 2.66 and at the group level was 0.30. Renzi ODS score and the total (-0.32) and physical (-0.43) SF-36 scores correlated negatively. Patient and control's groups significantly differed (11 points). The change score of Renzi ODS score between baseline and 3 months correlated negatively with the clinical evolution (-0.86). ROC analysis showed minimal important change of 2.00 with AUC 0.97. Neither floor nor ceiling effects were observed. This work validated the Portuguese version of Renzi ODS score. We can now use this reliable, responsive, and interpretable (at the group level) tool to evaluate Portuguese ODS patients.

Further validation and definition of the psychometric properties of the Asthma Impact Survey.

PubMed

Schatz, Michael; Zeiger, Robert S; Yang, Su-Jau; Chen, Wansu; Kosinski, Mark

2011-07-01

The Asthma Impact Survey (AIS-6) is a brief disease-specific quality-of-life instrument with limited published validation data. To obtain additional validation data and psychometric properties of the AIS-6. In November, 2007, patients with persistent asthma were mailed a survey that included the AIS-6, the mini-Asthma Quality of Life Questionnaire (mAQLQ), and the Asthma Control Test (ACT). Follow-up surveys were sent in April, July, and October 2008. Year 2008 exacerbations and short-acting β-agonist (SABA) dispensings were captured from administrative data. A total of 2680 patients had complete baseline survey data. Criterion validity was demonstrated by the strong correlations of the AIS-6 with the mAQLQ (r = -0.84 to -0.86); construct validity by significant relationships (P < .0001) of the AIS-6 with mAQLQ domain scores, ACT score, and history of exacerbations; and predictive validity by significant relationships (P < .0001) between AIS-6 scores at the end of 2007 and year 2008 exacerbations and high SABA dispensings. Responsiveness was demonstrated by significant (P < .0001) correlations (r = -0.39 to -0.58) between changes in AIS-6 scores and changes in mAQLQ and ACT scores over time. A preliminary minimally important difference (MID) in AIS-6 was estimated to be 4 by using the mAQLQ MID as an anchor. Excellent internal consistency (α = 0.94) and test-retest reliability (intraclass correlation coefficient = 0.86-0.91) were also demonstrated. The AIS-6 demonstrated good psychometric properties in a large independent sample and could be used to assess asthma-specific quality of life in clinical practice and clinical research. Copyright © 2011 American Academy of Allergy, Asthma & Immunology. Published by Mosby, Inc. All rights reserved.

Measuring personal recovery - psychometric properties of the Swedish Questionnaire about the Process of Recovery (QPR-Swe).

PubMed

Argentzell, Elisabeth; Hultqvist, Jenny; Neil, Sandra; Eklund, Mona

2017-10-01

Personal recovery, defined as an individual process towards meaning, is an important target within mental health services. Measuring recovery hence requires reliable and valid measures. The Process of Recovery Questionnaire (QPR) was developed for that purpose. The aim was to develop a Swedish version of the QPR (QPR-Swe) and explore its psychometric properties in terms of factor structure, internal consistency, construct validity and sensitivity to change. A total of 226 participants entered the study. The factor structure was investigated by Principal Component Analysis and Scree plot. Construct validity was addressed in terms of convergent validity against indicators of self-mastery, self-esteem, quality of life and self-rated health. A one-factor solution of QPR-Swe received better support than a two-factor solution. Good internal consistency was indicated, α = 0.92, and construct validity was satisfactory. The QPR-Swe showed preliminary sensitivity to change. The QPR-Swe showed promising initial psychometric properties in terms of internal consistency, convergent validity and sensitivity to change. The QPR-Swe is recommended for use in research and clinical contexts to assess personal recovery among people with mental illness.

Assessing Clinical Reasoning (ASCLIRE): Instrument Development and Validation

ERIC Educational Resources Information Center

Kunina-Habenicht, Olga; Hautz, Wolf E.; Knigge, Michel; Spies, Claudia; Ahlers, Olaf

2015-01-01

Clinical reasoning is an essential competency in medical education. This study aimed at developing and validating a test to assess diagnostic accuracy, collected information, and diagnostic decision time in clinical reasoning. A norm-referenced computer-based test for the assessment of clinical reasoning (ASCLIRE) was developed, integrating the…

Finding "truth" across different data sources.

PubMed

Rein, Alison; Simpson, Lisa A

2017-01-01

The proliferation of new technology platforms and tools is dramatically advancing our ability to capture, integrate and use clinical and other health related data for research and care. Another critical and increasingly common source of data comes directly from patients - often in the form of Patient Reported Outcomes (PRO). As more providers and payers recognize that patient experiences reflect a critical dimension of the value proposition, these data are informing broader strategies to achieve performance improvement and accountability in health systems. Combined with other traditional (e.g., claims) and more recent (e.g., Electronic Health Record) data assets, PROs can help to examine experiences and outcomes that convey a more complete picture of both individual and population health. One of the areas of research where this is most evident is cancer survivorship, including long-term adverse effects, as the population of survivors is increasing given advances in detection and treatment. Key questions remain as to how and under what conditions these new data resources can be used for research, and which are the best "sources of truth" for specific types of information. A recent IJHPR validation study by Hamood et al. reflects important progress in this regard, and establishes the necessary groundwork for a larger planned study. There are some important limitations worth noting, such as a small sample size (which does not support adequate subgroup analysis); a relatively narrow focus on women with only early stage or regionally advanced breast cancer; and a limited focus on outcomes that are primarily clinical and relatively severe in nature (e.g., cardiovascular disease). Finally, as use of EHRs becomes ubiquitous, as patient perspectives and outcome measures are considered, and as more types of data are systematically collected via electronic systems, further comparison and validation of non-clinical data elements captured via such tools will become increasingly possible and important. This will further enhance the capacity of cancer survivorship researchers to address a broader range of important questions to many more types of patients.

Symptom and performance validity with veterans assessed for attention-deficit/hyperactivity disorder (ADHD).

PubMed

Shura, Robert D; Denning, John H; Miskey, Holly M; Rowland, Jared A

2017-12-01

Little is known about attention-deficit/hyperactivity disorder (ADHD) in veterans. Practice standards recommend the use of both symptom and performance validity measures in any assessment, and there are salient external incentives associated with ADHD evaluation (stimulant medication access and academic accommodations). The purpose of this study was to evaluate symptom and performance validity measures in a clinical sample of veterans presenting for specialty ADHD evaluation. Patients without a history of a neurocognitive disorder and for whom data were available on all measures (n = 114) completed a clinical interview structured on DSM-5 ADHD symptoms, the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF), and the Test of Memory Malingering Trial 1 (TOMM1) as part of a standardized ADHD diagnostic evaluation. Veterans meeting criteria for ADHD were not more likely to overreport symptoms on the MMPI-2-RF nor to fail TOMM1 (score ≤ 41) compared with those who did not meet criteria. Those who overreported symptoms did not endorse significantly more ADHD symptoms; however, those who failed TOMM1 did report significantly more ADHD symptoms (g = 0.90). In the total sample, 19.3% failed TOMM1, 44.7% overreported on the MMPI-2-RF, and 8.8% produced both an overreported MMPI-2-RF and invalid TOMM1. F-r had the highest correlation to TOMM1 scores (r = -.30). These results underscore the importance of assessing both symptom and performance validity in a clinical ADHD evaluation with veterans. In contrast to certain other conditions (e.g., mild traumatic brain injury), ADHD as a diagnosis is not related to higher rates of invalid report/performance in veterans. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Validation and real-world assessment of the Functional Assessment of Anorexia-Cachexia Therapy (FAACT) scale in patients with advanced non-small cell lung cancer and the cancer anorexia-cachexia syndrome (CACS).

PubMed

LeBlanc, Thomas W; Samsa, Greg P; Wolf, Steven P; Locke, Susan C; Cella, David F; Abernethy, Amy P

2015-08-01

Patients with cancer anorexia-cachexia syndrome (CACS) suffer a significant symptom burden, impaired quality of life (QoL), and shorter survival. Measurement of QoL impairments related to CACS is thereby important both in clinical practice and in research. We aimed to further validate the Functional Assessment of Anorexia-Cachexia Therapy (FAACT) scale in an advanced lung cancer population. We tested the performance of the FAACT and its anorexia-cachexia subscale (ACS) within a dataset of patients with advanced non-small cell lung cancer (aNSCLC), using standard statistical methods. We then compared the performance of commonly used QoL measures stratified by CACS status and by patient self-report of appetite and weight loss. The FAACT and its ACS demonstrate internal validity consistent with acceptable published ranges for other QoL scales (Cronbach alpha = 0.9 and 0.79, respectively). Correlation coefficients demonstrate moderate correlations in the expected directions between FAACT and ACS and scales that measure related constructs. Comparing patients with and without CACS, the ACS is more sensitive to change than other QoL instruments (mean score 33.1 vs. 37.2, p = 0.011, ES = 0.58). In patients with aNSCLC, the FAACT and its ACS performed well compared with other instruments, further supporting their validity and value in clinical research. FAACT and ACS scores covaried with symptoms and other QoL changes that are typical hallmarks of CACS, lending further support to their use as QoL endpoints in clinical trials among patients with CACS.

Validation of the Leap Motion Controller using markered motion capture technology.

PubMed

Smeragliuolo, Anna H; Hill, N Jeremy; Disla, Luis; Putrino, David

2016-06-14

The Leap Motion Controller (LMC) is a low-cost, markerless motion capture device that tracks hand, wrist and forearm position. Integration of this technology into healthcare applications has begun to occur rapidly, making validation of the LMC׳s data output an important research goal. Here, we perform a detailed evaluation of the kinematic data output from the LMC, and validate this output against gold-standard, markered motion capture technology. We instructed subjects to perform three clinically-relevant wrist (flexion/extension, radial/ulnar deviation) and forearm (pronation/supination) movements. The movements were simultaneously tracked using both the LMC and a marker-based motion capture system from Motion Analysis Corporation (MAC). Adjusting for known inconsistencies in the LMC sampling frequency, we compared simultaneously acquired LMC and MAC data by performing Pearson׳s correlation (r) and root mean square error (RMSE). Wrist flexion/extension and radial/ulnar deviation showed good overall agreement (r=0.95; RMSE=11.6°, and r=0.92; RMSE=12.4°, respectively) with the MAC system. However, when tracking forearm pronation/supination, there were serious inconsistencies in reported joint angles (r=0.79; RMSE=38.4°). Hand posture significantly influenced the quality of wrist deviation (P<0.005) and forearm supination/pronation (P<0.001), but not wrist flexion/extension (P=0.29). We conclude that the LMC is capable of providing data that are clinically meaningful for wrist flexion/extension, and perhaps wrist deviation. It cannot yet return clinically meaningful data for measuring forearm pronation/supination. Future studies should continue to validate the LMC as updated versions of their software are developed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

PubMed

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

Current state of prognostication and risk stratification in myelodysplastic syndromes.

PubMed

Zeidan, Amer M; Gore, Steven D; Padron, Eric; Komrokji, Rami S

2015-03-01

Myelodysplastic syndromes (MDS) are characterized by significant biologic and clinical heterogeneity. Because of the wide outcome variability, accurate prognostication is vital to high-quality risk-adaptive care of MDS patients. In this review, we discuss the current state of prognostic schemes for MDS and overview efforts aimed at utilizing molecular aberrations for prognostication in clinical practice. Several prognostic instruments have been developed and validated with increasing accuracy and complexity. Oncologists should be aware of the inherent limitations of these prognostic tools as they counsel patients and make clinical decisions. As more therapies are becoming available for MDS, the focus of model development is shifting from prognostic to treatment-specific predictive instruments. In addition to providing additional prognostic data beyond traditional clinical and pathologic parameters, the improved understanding of the genetic landscape and pathophysiologic consequences in MDS may allow the construction of treatment-specific predictive instruments. How to best use the results of molecular mutation testing to inform clinical decision making in MDS is still a work in progress. Important steps in this direction include standardization in performance and interpretation of assays and better understanding of the independent prognostic importance of the recurrent mutations, especially the less frequent ones.

Epidemiology and Long-term Clinical and Biologic Risk Factors for Pneumonia in Community-Dwelling Older Americans

PubMed Central

Alvarez, Karina; Loehr, Laura; Folsom, Aaron R.; Newman, Anne B.; Weissfeld, Lisa A.; Wunderink, Richard G.; Kritchevsky, Stephen B.; Mukamal, Kenneth J.; London, Stephanie J.; Harris, Tamara B.; Bauer, Doug C.; Angus, Derek C.

2013-01-01

Background: Preventing pneumonia requires better understanding of incidence, mortality, and long-term clinical and biologic risk factors, particularly in younger individuals. Methods: This was a cohort study in three population-based cohorts of community-dwelling individuals. A derivation cohort (n = 16,260) was used to determine incidence and survival and develop a risk prediction model. The prediction model was validated in two cohorts (n = 8,495). The primary outcome was 10-year risk of pneumonia hospitalization. Results: The crude and age-adjusted incidences of pneumonia were 6.71 and 9.43 cases/1,000 person-years (10-year risk was 6.15%). The 30-day and 1-year mortality were 16.5% and 31.5%. Although age was the most important risk factor (range of crude incidence rates, 1.69-39.13 cases/1,000 person-years for each 5-year increment from 45-85 years), 38% of pneumonia cases occurred in adults < 65 years of age. The 30-day and 1-year mortality were 12.5% and 25.7% in those < 65 years of age. Although most comorbidities were associated with higher risk of pneumonia, reduced lung function was the most important risk factor (relative risk = 6.61 for severe reduction based on FEV1 by spirometry). A clinical risk prediction model based on age, smoking, and lung function predicted 10-year risk (area under curve [AUC] = 0.77 and Hosmer-Lemeshow [HL] C statistic = 0.12). Model discrimination and calibration were similar in the internal validation cohort (AUC = 0.77; HL C statistic, 0.65) but lower in the external validation cohort (AUC = 0.62; HL C statistic, 0.45). The model also calibrated well in blacks and younger adults. C-reactive protein and IL-6 were associated with higher pneumonia risk but did not improve model performance. Conclusions: Pneumonia hospitalization is common and associated with high mortality, even in younger healthy adults. Long-term risk of pneumonia can be predicted in community-dwelling adults with a simple clinical risk prediction model. PMID:23744106

Chronic obstructive lung disease "expert system": validation of a predictive tool for assisting diagnosis.

PubMed

Braido, Fulvio; Santus, Pierachille; Corsico, Angelo Guido; Di Marco, Fabiano; Melioli, Giovanni; Scichilone, Nicola; Solidoro, Paolo

2018-01-01

The purposes of this study were development and validation of an expert system (ES) aimed at supporting the diagnosis of chronic obstructive lung disease (COLD). A questionnaire and a WebFlex code were developed and validated in silico. An expert panel pilot validation on 60 cases and a clinical validation on 241 cases were performed. The developed questionnaire and code validated in silico resulted in a suitable tool to support the medical diagnosis. The clinical validation of the ES was performed in an academic setting that included six different reference centers for respiratory diseases. The results of the ES expressed as a score associated with the risk of suffering from COLD were matched and compared with the final clinical diagnoses. A set of 60 patients were evaluated by a pilot expert panel validation with the aim of calculating the sample size for the clinical validation study. The concordance analysis between these preliminary ES scores and diagnoses performed by the experts indicated that the accuracy was 94.7% when both experts and the system confirmed the COLD diagnosis and 86.3% when COLD was excluded. Based on these results, the sample size of the validation set was established in 240 patients. The clinical validation, performed on 241 patients, resulted in ES accuracy of 97.5%, with confirmed COLD diagnosis in 53.6% of the cases and excluded COLD diagnosis in 32% of the cases. In 11.2% of cases, a diagnosis of COLD was made by the experts, although the imaging results showed a potential concomitant disorder. The ES presented here (COLD ES ) is a safe and robust supporting tool for COLD diagnosis in primary care settings.

Embedded performance validity testing in neuropsychological assessment: Potential clinical tools.

PubMed

Rickards, Tyler A; Cranston, Christopher C; Touradji, Pegah; Bechtold, Kathleen T

2018-01-01

The article aims to suggest clinically-useful tools in neuropsychological assessment for efficient use of embedded measures of performance validity. To accomplish this, we integrated available validity-related and statistical research from the literature, consensus statements, and survey-based data from practicing neuropsychologists. We provide recommendations for use of 1) Cutoffs for embedded performance validity tests including Reliable Digit Span, California Verbal Learning Test (Second Edition) Forced Choice Recognition, Rey-Osterrieth Complex Figure Test Combination Score, Wisconsin Card Sorting Test Failure to Maintain Set, and the Finger Tapping Test; 2) Selecting number of performance validity measures to administer in an assessment; and 3) Hypothetical clinical decision-making models for use of performance validity testing in a neuropsychological assessment collectively considering behavior, patient reporting, and data indicating invalid or noncredible performance. Performance validity testing helps inform the clinician about an individual's general approach to tasks: response to failure, task engagement and persistence, compliance with task demands. Data-driven clinical suggestions provide a resource to clinicians and to instigate conversation within the field to make more uniform, testable decisions to further the discussion, and guide future research in this area.

Comparison of Validated Assessment Scales and 3D digital fringe projection method to assess lifetime development of wrinkles in men.

PubMed

Luebberding, Stefanie; Krueger, Nils; Kerscher, Martina

2014-02-01

The assessment of wrinkle severity is an important evaluation criterion to determine the efficacy of aesthetic treatments. Aim of the present study was to compare Validated Assessment Scales (VAS) and 3D fringe projection (PRIMOS(®) ) for the evaluation of facial wrinkles in men and to determine standard values for each level of the VAS. 150 male subjects (20 to 70 years) were selected following strict criteria. Wrinkle severity at periorbital, glabella and forehead lines was evaluated using the 3D fringe projection and 5-point photonumeric VAS. The results of both methods were matched by determining quantitative values for each level of the clinical rating scale. High average correlation with age was found for VAS, Wd, maxWd, lWd, Wv, aWa and pWa. With a Wd of 60 to 70μm crow's feet and forehead lines are pronounced first, whereas glabella lines develop in subject's mid-forties, by an Wd of 180μm. Wrinkle severity increases at all locations every 10 years of age by one level of the VAS. This increase corresponds to an increase of Wd about 100 μm at glabella and forehead lines, and about 50 μm at crow's feet. The presented reference values for the Validated Assessment Scale are an important step towards an optimized assessment of skin aging and aesthetic dermatological treatments. The data helps to combine the precession of a biophysical measurement with the practical relevance of a clinical rating. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Measurement Properties of the Brief Michigan Hand Outcomes Questionnaire in Patients With Dupuytren Contracture.

PubMed

Wehrli, Martina; Hensler, Stefanie; Schindele, Stephan; Herren, Daniel B; Marks, Miriam

2016-09-01

The brief Michigan Hand Outcomes Questionnaire (briefMHQ) was developed as a shorter version of the Michigan Hand Outcomes Questionnaire (MHQ), but its measurement properties have not been investigated in patients with Dupuytren contracture. The objective of the study was to investigate the reliability, validity, responsiveness, and interpretability of the briefMHQ. Fifty-seven patients diagnosed with Dupuytren contracture completed the briefMHQ as well as the full-length MHQ and Quick Disabilities of the Arm, Shoulder, and Hand (QuickDASH) questionnaire at baseline. Two to 14 days after baseline and 1 year after collagenase injection or surgery, patients again filled out the briefMHQ. Reliability was determined using the intraclass correlation coefficient and by calculating internal consistency (Cronbach alpha). Validity was tested by quantifying correlations with the full-length MHQ and QuickDASH. Responsiveness, based on the standardized response mean and the minimally clinically important change, was also determined. The briefMHQ had an intraclass correlation coefficient of 0.87, Cronbach alpha of 0.88, and correlations of r = 0.88 and -0.82 with the original MHQ and QuickDASH, respectively. The standardized response mean was 0.9 and the minimally clinically important change was 7 points. Overall, the briefMHQ demonstrates excellent reliability, good validity, and high responsiveness in patients with Dupuytren contracture. The briefMHQ is an accurate and time-saving tool to evaluate patients with Dupuytren contracture and the effect of a corresponding treatment. Copyright © 2016 American Society for Surgery of the Hand. Published by Elsevier Inc. All rights reserved.

Validity, cut-points, and minimally important differences for two hot flash-related daily interference scales.

PubMed

Carpenter, Janet S; Bakoyannis, Giorgos; Otte, Julie L; Chen, Chen X; Rand, Kevin L; Woods, Nancy; Newton, Katherine; Joffe, Hadine; Manson, JoAnn E; Freeman, Ellen W; Guthrie, Katherine A

2017-08-01

To conduct psychometric analyses to condense the Hot Flash-Related Daily Interference Scale (HFRDIS) into a shorter form termed the Hot Flash Interference (HFI) scale; evaluate cut-points for both scales; and establish minimally important differences (MIDs) for both scales. We analyzed baseline and postrandomization patient-reported data pooled across three randomized trials aimed at reducing vasomotor symptoms (VMS) in 899 midlife women. Trials were conducted across five MsFLASH clinical sites between July 2009 and October 2012. We eliminated HFRDIS items based on experts' content validity ratings and confirmatory factor analysis, and evaluated cut-points and established MIDs by mapping HFRDIS and HFI to other measures. The three-item HFI (interference with sleep, mood, and concentration) demonstrated strong internal consistency (alphas of 0.830 and 0.856), showed good fit to the unidimensional "hot flash interference factor," and strong convergent validity with HFRDIS scores, diary VMS, and menopausal quality of life. For both scales, cut-points of mild (0-3.9), moderate (4-6.9), and severe (7-10) interference were associated with increasing diary VMS ratings, sleep, and anxiety. The average MID was 1.66 for the HFRDIS and 2.34 for the HFI. The HFI is a brief assessment of VMS interference and will be useful in busy clinics to standardize VMS assessment or in research studies where response burden may be an issue. The scale cut-points and MIDs should prove useful in targeting those most in need of treatment, monitoring treatment response, and interpreting existing and future research findings.

Institutional profile: Karolinska Institutet.

PubMed

Eliasson, Erik; Sim, Sarah C; Rane, Anders; Ingelman-Sundberg, Magnus

2012-12-01

Research in pharmacogenomics has been intensive at Karolinska Institutet (KI) for approximately 25 years. Initial initiatives were focused on the identification and characterization of novel CYP2D6 alleles causing ultrarapid or defective drug metabolism. Such discoveries were possible owing to the early implementation of therapeutic drug monitoring and the access to individuals phenotyped with respect to drug metabolism. The translational work at KI has been of utmost importance for successful research, including functional characterization and clinical validation of allelic variants in drug metabolism, as well as discoveries of novel polymorphisms, recent examples being the CYP2C19 and UGT2B17 genes. The clinical pharmacology laboratory at KI campus Huddinge is one of the leading sites for therapeutic drug monitoring in northern Europe and obtains an increasing number of clinical requests, also important for pharmacogenetic research. Furthermore, the recently opened Center for Hematology and Regenerative Medicine, with a clear translational emphasis, offers an opportunity for studying drug metabolism and toxicity in vitro by use of human hepatocytes.

Analytical validation of a novel multiplex test for detection of advanced adenoma and colorectal cancer in symptomatic patients.

PubMed

Dillon, Roslyn; Croner, Lisa J; Bucci, John; Kairs, Stefanie N; You, Jia; Beasley, Sharon; Blimline, Mark; Carino, Rochele B; Chan, Vicky C; Cuevas, Danissa; Diggs, Jeff; Jennings, Megan; Levy, Jacob; Mina, Ginger; Yee, Alvin; Wilcox, Bruce

2018-05-30

Early detection of colorectal cancer (CRC) is key to reducing associated mortality. Despite the importance of early detection, approximately 40% of individuals in the United States between the ages of 50-75 have never been screened for CRC. The low compliance with colonoscopy and fecal-based screening may be addressed with a non-invasive alternative such as a blood-based test. We describe here the analytical validation of a multiplexed blood-based assay that measures the plasma concentrations of 15 proteins to assess advanced adenoma (AA) and CRC risk in symptomatic patients. The test was developed on an electrochemiluminescent immunoassay platform employing four multi-marker panels, to be implemented in the clinic as a laboratory developed test (LDT). Under the Clinical Laboratory Improvement Amendments (CLIA) and College of American Pathologists (CAP) regulations, a United States-based clinical laboratory utilizing an LDT must establish performance characteristics relating to analytical validity prior to releasing patient test results. This report describes a series of studies demonstrating the precision, accuracy, analytical sensitivity, and analytical specificity for each of the 15 assays, as required by CLIA/CAP. In addition, the report describes studies characterizing each of the assays' dynamic range, parallelism, tolerance to common interfering substances, spike recovery, and stability to sample freeze-thaw cycles. Upon completion of the analytical characterization, a clinical accuracy study was performed to evaluate concordance of AA and CRC classifier model calls using the analytical method intended for use in the clinic. Of 434 symptomatic patient samples tested, the percent agreement with original CRC and AA calls was 87% and 92% respectively. All studies followed CLSI guidelines and met the regulatory requirements for implementation of a new LDT. The results provide the analytical evidence to support the implementation of the novel multi-marker test as a clinical test for evaluating CRC and AA risk in symptomatic individuals. Copyright © 2018 Elsevier B.V. All rights reserved.

The Structured Interview & Scoring Tool-Massachusetts Alzheimer's Disease Research Center (SIST-M): development, reliability, and cross-sectional validation of a brief structured clinical dementia rating interview.

PubMed

Okereke, Olivia I; Copeland, Maura; Hyman, Bradley T; Wanggaard, Taylor; Albert, Marilyn S; Blacker, Deborah

2011-03-01

The Clinical Dementia Rating (CDR) and CDR Sum-of-Boxes can be used to grade mild but clinically important cognitive symptoms of Alzheimer disease. However, sensitive clinical interview formats are lengthy. To develop a brief instrument for obtaining CDR scores and to assess its reliability and cross-sectional validity. Using legacy data from expanded interviews conducted among 347 community-dwelling older adults in a longitudinal study, we identified 60 questions (from a possible 131) about cognitive functioning in daily life using clinical judgment, inter-item correlations, and principal components analysis. Items were selected in 1 cohort (n=147), and a computer algorithm for generating CDR scores was developed in this same cohort and re-run in a replication cohort (n=200) to evaluate how well the 60 items retained information from the original 131 items. Short interviews based on the 60 items were then administered to 50 consecutively recruited older individuals, with no symptoms or mild cognitive symptoms, at an Alzheimer's Disease Research Center. Clinical Dementia Rating scores based on short interviews were compared with those from independent long interviews. In the replication cohort, agreement between short and long CDR interviews ranged from κ=0.65 to 0.79, with κ=0.76 for Memory, κ=0.77 for global CDR, and intraclass correlation coefficient for CDR Sum-of-Boxes=0.89. In the cross-sectional validation, short interview scores were slightly lower than those from long interviews, but good agreement was observed for global CDR and Memory (κ≥0.70) as well as for CDR Sum-of-Boxes (intraclass correlation coefficient=0.73). The Structured Interview & Scoring Tool-Massachusetts Alzheimer's Disease Research Center is a brief, reliable, and sensitive instrument for obtaining CDR scores in persons with symptoms along the spectrum of mild cognitive change.

[Design and validation of an instrument to assess families at risk for health problems].

PubMed

Puschel, Klaus; Repetto, Paula; Solar, María Olga; Soto, Gabriela; González, Karla

2012-04-01

There is a paucity of screening instruments with a high clinical predictive value to identify families at risk and therefore, develop focused interventions in primary care. To develop an easy to apply screening instrument with a high clinical predictive value to identify families with a higher health vulnerability. In the first stage of the study an instrument with a high content validity was designed through a review of existent instruments, qualitative interviews with families and expert opinions following a Delphi approach of three rounds. In the second stage, concurrent validity was tested through a comparative analysis between the pilot instrument and a family clinical interview conducted to 300 families randomly selected from a population registered at a primary care clinic in Santiago. The sampling was blocked based on the presence of diabetes, depression, child asthma, behavioral disorders, presence of an older person or the lack of previous conditions among family members. The third stage, was directed to test the clinical predictive validity of the instrument by comparing the baseline vulnerability obtained by the instrument and the change in clinical status and health related quality of life perceptions of the family members after nine months of follow-up. The final SALUFAM instrument included 13 items and had a high internal consistency (Cronbach's alpha: 0.821), high test re-test reproducibility (Pearson correlation: 0.84) and a high clinical predictive value for clinical deterioration (Odds ratio: 1.826; 95% confidence intervals: 1.101-3.029). SALUFAM instrument is applicable, replicable, has a high content validity, concurrent validity and clinical predictive value.

Validating EHR clinical models using ontology patterns.

PubMed

Martínez-Costa, Catalina; Schulz, Stefan

2017-12-01

Clinical models are artefacts that specify how information is structured in electronic health records (EHRs). However, the makeup of clinical models is not guided by any formal constraint beyond a semantically vague information model. We address this gap by advocating ontology design patterns as a mechanism that makes the semantics of clinical models explicit. This paper demonstrates how ontology design patterns can validate existing clinical models using SHACL. Based on the Clinical Information Modelling Initiative (CIMI), we show how ontology patterns detect both modeling and terminology binding errors in CIMI models. SHACL, a W3C constraint language for the validation of RDF graphs, builds on the concept of "Shape", a description of data in terms of expected cardinalities, datatypes and other restrictions. SHACL, as opposed to OWL, subscribes to the Closed World Assumption (CWA) and is therefore more suitable for the validation of clinical models. We have demonstrated the feasibility of the approach by manually describing the correspondences between six CIMI clinical models represented in RDF and two SHACL ontology design patterns. Using a Java-based SHACL implementation, we found at least eleven modeling and binding errors within these CIMI models. This demonstrates the usefulness of ontology design patterns not only as a modeling tool but also as a tool for validation. Copyright © 2017 Elsevier Inc. All rights reserved.

Assessing clinical reasoning (ASCLIRE): Instrument development and validation.

PubMed

Kunina-Habenicht, Olga; Hautz, Wolf E; Knigge, Michel; Spies, Claudia; Ahlers, Olaf

2015-12-01

Clinical reasoning is an essential competency in medical education. This study aimed at developing and validating a test to assess diagnostic accuracy, collected information, and diagnostic decision time in clinical reasoning. A norm-referenced computer-based test for the assessment of clinical reasoning (ASCLIRE) was developed, integrating the entire clinical decision process. In a cross-sectional study participants were asked to choose as many diagnostic measures as they deemed necessary to diagnose the underlying disease of six different cases with acute or sub-acute dyspnea and provide a diagnosis. 283 students and 20 content experts participated. In addition to diagnostic accuracy, respective decision time and number of used relevant diagnostic measures were documented as distinct performance indicators. The empirical structure of the test was investigated using a structural equation modeling approach. Experts showed higher accuracy rates and lower decision times than students. In a cross-sectional comparison, the diagnostic accuracy of students improved with the year of study. Wrong diagnoses provided by our sample were comparable to wrong diagnoses in practice. We found an excellent fit for a model with three latent factors-diagnostic accuracy, decision time, and choice of relevant diagnostic information-with diagnostic accuracy showing no significant correlation with decision time. ASCLIRE considers decision time as an important performance indicator beneath diagnostic accuracy and provides evidence that clinical reasoning is a complex ability comprising diagnostic accuracy, decision time, and choice of relevant diagnostic information as three partly correlated but still distinct aspects.

Are reports of cognitive testing among older electroconvulsive therapy recipients clinically valid?

PubMed

Plakiotis, Chris; Chin, Loi Fei; O'Connor, Daniel W

2014-03-01

Electroconvulsive therapy (ECT) administration rises in frequency with age, with older depressed adults often showing clinical features predictive of good response. Recent reviews suggest that older people experience few if any long-term cognitive adverse effects after contemporary ECT, despite their increased vulnerability to these. However, the broader clinical validity of research findings is not assured as most studies of ECT-related cognitive effects do not discuss cognitive test nonparticipants. This study examines whether cognitive test participants and nonparticipants are comparable. We recently completed a study of cognition in depressed patients 65 years and older treated with ECT. Only 35% of eligible patients completed neuropsychological testing at 2 time points, the remainder either refusing or unable to consent. To examine whether exclusion of most eligible patients from cognitive testing might have affected the clinical applicability of findings, we compared demographic and clinical characteristics of patients who participated with those who did not based on a subset of patients from our original study. The 2 patient groups differed in several respects. Most notably, nonparticipants were significantly more likely to be involuntary patients; to refuse food and fluids; and to require treatment with a bitemporal or mixed electrode placement. Our findings suggest cognitive test nonparticipants to be more severely psychiatrically unwell than test participants. As their exclusion might bias results and confound understanding of this important ECT-related topic, special mention of participation rates and comparison of participants and nonparticipants is recommended to establish the clinical relevance of future study findings.

Recommendations for the definition of clinical responder in insulin preservation studies.

PubMed

Beam, Craig A; Gitelman, Stephen E; Palmer, Jerry P

2014-09-01

Clinical responder studies should contribute to the translation of effective treatments and interventions to the clinic. Since ultimately this translation will involve regulatory approval, we recommend that clinical trials prespecify a responder definition that can be assessed against the requirements and suggestions of regulatory agencies. In this article, we propose a clinical responder definition to specifically assist researchers and regulatory agencies in interpreting the clinical importance of statistically significant findings for studies of interventions intended to preserve β-cell function in newly diagnosed type 1 diabetes. We focus on studies of 6-month β-cell preservation in type 1 diabetes as measured by 2-h-stimulated C-peptide. We introduce criteria (bias, reliability, and external validity) for the assessment of responder definitions to ensure they meet U.S. Food and Drug Administration and European Medicines Agency guidelines. Using data from several published TrialNet studies, we evaluate our definition (no decrease in C-peptide) against published alternatives and determine that our definition has minimum bias with external validity. We observe that reliability could be improved by using changes in C-peptide later than 6 months beyond baseline. In sum, to support efficacy claims of β-cell preservation therapies in type 1 diabetes submitted to U.S. and European regulatory agencies, we recommend use of our definition. © 2014 by the American Diabetes Association. Readers may use this article as long as the work is properly cited, the use is educational and not for profit, and the work is not altered.

Patient burden of Sjögren’s: a comprehensive literature review revealing the range and heterogeneity of measures used in assessments of severity

PubMed Central

Hammitt, Katherine M; Naegeli, April N; van den Broek, Remon W M; Birt, Julie A

2017-01-01

Context The severity of Sjögren’s syndrome has been evaluated using a wide variety of clinical measures and patient-reported outcomes (PROs). This may contribute to the lack of clarity concerning the burden of Sjögren’s from the patient perspective. Objective To perform a comprehensive peer-reviewed literature analysis of the patient aspects of Sjögren’s, focusing on PROs, to investigate the complexity underlying the evaluation of the syndrome and to elucidate the discordance between the different measures. Methods We searched Embase for articles published between January 2005 and September 2015. Research articles, clinical and diagnostic reviews, and validation studies with a focus on patient aspects of Sjögren’s were selected as the primary information source. Results 157 articles met the eligibility criteria. A wide variety of assessment measures used to evaluate glandular, extraglandular and functional domains were observed. Many different, non-validated Visual Analogue Scales, with a wide range of anchor words, were used in the quantification of Sjögren’s disease burden, impeding comparisons between studies. Relatively few clinical trials of drug therapies used validated scales: European League Against Rheumatism Sjögren’s Syndrome Patient Reported Index was used most often for symptom assessment and 36 Item Short Form Survey for quality of life (QoL). Conclusion A wide range and diversity of measures are used to evaluate the patient burden of Sjögren’s; most are not validated for use in this disease. PRO endpoints, validated specifically in Sjögren’s, that demonstrate improvement are needed. These measures should focus on QoL aspects important to patients and will most likely involve gauging change in function rather than patient-reported symptoms. PMID:28955493

Measurement Properties of the Lower Extremity Functional Scale: A Systematic Review.

PubMed

Mehta, Saurabh P; Fulton, Allison; Quach, Cedric; Thistle, Megan; Toledo, Cesar; Evans, Neil A

2016-03-01

Systematic review of measurement properties. Many primary studies have examined the measurement properties, such as reliability, validity, and sensitivity to change, of the Lower Extremity Functional Scale (LEFS) in different clinical populations. A systematic review summarizing these properties for the LEFS may provide an important resource. To locate and synthesize evidence on the measurement properties of the LEFS and to discuss the clinical implications of the evidence. A literature search was conducted in 4 databases (PubMed, MEDLINE, Embase, and CINAHL), using predefined search terms. Two reviewers performed a critical appraisal of the included studies using a standardized assessment form. A total of 27 studies were included in the review, of which 18 achieved a very good to excellent methodological quality level. The LEFS scores demonstrated excellent test-retest reliability (intraclass correlation coefficients ranging between 0.85 and 0.99) and demonstrated the expected relationships with measures assessing similar constructs (Pearson correlation coefficient values of greater than 0.7). The responsiveness of the LEFS scores was excellent, as suggested by consistently high effect sizes (greater than 0.8) in patients with different lower extremity conditions. Minimal detectable change at the 90% confidence level (MDC90) for the LEFS scores varied between 8.1 and 15.3 across different reassessment intervals in a wide range of patient populations. The pooled estimate of the MDC90 was 6 points and the minimal clinically important difference was 9 points in patients with lower extremity musculoskeletal conditions, which are indicative of true change and clinically meaningful change, respectively. The results of this review support the reliability, validity, and responsiveness of the LEFS scores for assessing functional impairment in a wide array of patient groups with lower extremity musculoskeletal conditions.

Validation of Different Combination of Three Reversing Half-Hitches Alternating Posts (RHAPs) Effects on Arthroscopic Knot Integrity.

PubMed

Chong, Alexander Cm; Prohaska, Daniel J; Bye, Brian P

2017-05-01

With arthroscopic techniques being used, the importance of knot tying has been examined. Previous literature has examined the use of reversing half-hitches on alternating posts (RHAPs) on knot security. Separately, there has been research regarding different suture materials commonly used in the operating room. The specific aim of this study was to validate the effect of different stacked half-hitch configuration and different braided suture materials on arthroscopic knot integrity. Three different suture materials tied with five different RHAPs in arthroscopic knots were compared. A single load-to-failure test was performed and the mean ultimate clinical failure load was obtained. Significant knot holding strength improvement was found when one half-hitch was reversed as compared to baseline knot. When two of the half-hitches were reversed, there was a greater improvement with all knots having a mean ultimate clinical failure load greater than 150 newtons (N). Comparison of the suture materials demonstrated a higher mean ultimate clinical failure load when Force Fiber ® was used and at least one half-hitch was reversed. Knots tied with either Force Fiber ® or Orthocord ® showed 0% chance of knot slippage while knots tied with FiberWire ® or braided fishing line had about 10 and 30% knot slippage chances, respectively. A significant effect was observed in regards to both stacked half-hitch configuration and suture materials used on knot loop and knot security. Caution should be used with tying three RHAPs in arthroscopic surgery, particularly with a standard knot pusher and arthroscopic cannulas. The findings of this study indicated the importance of three RHAPs in performing arthroscopic knot tying and provided evidence regarding discrepancies of maximum clinical failure loads observed between orthopaedic surgeons, thereby leading to better surgical outcomes in the future.

Self-administration of cocaine, cannabis and heroin in the human laboratory: benefits and pitfalls.

PubMed

Haney, Margaret

2009-01-01

The objective of this review is to describe self-administration procedures for modeling addiction to cocaine, cannabis and heroin in the human laboratory, the benefits and pitfalls of the approach, and the methodological issues unique to each drug. In addition, the predictive validity of the model for testing treatment medications will be addressed. The results show that all three drugs of abuse are reliably and robustly self-administered by non-treatment-seeking research volunteers. In terms of pharmacotherapies, cocaine use is extraordinarily difficult to disrupt either in the laboratory or in the clinic. A range of medications has been shown to significantly decrease cocaine's subjective effects and craving without decreasing either cocaine self-administration or cocaine abuse by patients. These negative data combined with recent positive findings with modafinil suggest that self-administration procedures are an important intermediary step between pre-clinical and clinical studies. In terms of cannabis, a recent study suggests that medications that improve sleep and mood during cannabis withdrawal decrease the resumption of marijuana self-administration in abstinent volunteers. Clinical data on patients seeking treatment for their marijuana use are needed to validate these laboratory findings. Finally, in contrast to cannabis or cocaine dependence, there are three efficacious Food and Drug Administration-approved medications to treat opioid dependence, all of which decrease both heroin self-administration and subjective effects in the human laboratory. In summary, self-administration procedures provide meaningful behavioral data in a small number of individuals. These studies contribute to our understanding of the variables maintaining cocaine, marijuana and heroin intake, and are important in guiding the development of more effective drug treatment programs.

Validation of the Novaco Anger Scale-Provocation Inventory (Danish) With Nonclinical, Clinical, and Offender Samples.

PubMed

Moeller, Stine Bjerrum; Novaco, Raymond W; Heinola-Nielsen, Vivian; Hougaard, Helle

2016-10-01

Anger has high prevalence in clinical and forensic settings, and it is associated with aggressive behavior and ward atmosphere on psychiatric units. Dysregulated anger is a clinical problem in Danish mental health care systems, but no anger assessment instruments have been validated in Danish. Because the Novaco Anger Scale and Provocation Inventory (NAS-PI) has been extensively validated with different clinical populations and lends itself to clinical case formulation, it was selected for translation and evaluation in the present multistudy project. Psychometric properties of the NAS-PI were investigated with samples of 477 nonclinical, 250 clinical, 167 male prisoner, and 64 male forensic participants. Anger prevalence and its relationship with other anger measures, anxiety/depression, and aggression were examined. NAS-PI was found to have high reliability, concurrent validity, and discriminant validity, and its scores discriminated the samples. High scores in the offender group demonstrated the feasibility of obtaining self-report assessments of anger with this population. Retrospective and prospective validity of the NAS were tested with the forensic patient sample regarding physically aggressive behavior in hospital. Regression analyses showed that higher scores on NAS increase the risk of having acted aggressively in the past and of acting aggressively in the future. © The Author(s) 2015.

Aspergillus Section Fumigati Typing by PCR-Restriction Fragment Polymorphism▿

PubMed Central

Staab, Janet F.; Balajee, S. Arunmozhi; Marr, Kieren A.

2009-01-01

Recent studies have shown that there are multiple clinically important members of the Aspergillus section Fumigati that are difficult to distinguish on the basis of morphological features (e.g., Aspergillus fumigatus, A. lentulus, and Neosartorya udagawae). Identification of these organisms may be clinically important, as some species vary in their susceptibilities to antifungal agents. In a prior study, we utilized multilocus sequence typing to describe A. lentulus as a species distinct from A. fumigatus. The sequence data show that the gene encoding β-tubulin, benA, has high interspecies variability at intronic regions but is conserved among isolates of the same species. These data were used to develop a PCR-restriction fragment length polymorphism (PCR-RFLP) method that rapidly and accurately distinguishes A. fumigatus, A. lentulus, and N. udagawae, three major species within the section Fumigati that have previously been implicated in disease. Digestion of the benA amplicon with BccI generated unique banding patterns; the results were validated by screening a collection of clinical strains and by in silico analysis of the benA sequences of Aspergillus spp. deposited in the GenBank database. PCR-RFLP of benA is a simple method for the identification of clinically important, similar morphotypes of Aspergillus spp. within the section Fumigati. PMID:19403766

Aspergillus section Fumigati typing by PCR-restriction fragment polymorphism.

PubMed

Staab, Janet F; Balajee, S Arunmozhi; Marr, Kieren A

2009-07-01

Recent studies have shown that there are multiple clinically important members of the Aspergillus section Fumigati that are difficult to distinguish on the basis of morphological features (e.g., Aspergillus fumigatus, A. lentulus, and Neosartorya udagawae). Identification of these organisms may be clinically important, as some species vary in their susceptibilities to antifungal agents. In a prior study, we utilized multilocus sequence typing to describe A. lentulus as a species distinct from A. fumigatus. The sequence data show that the gene encoding beta-tubulin, benA, has high interspecies variability at intronic regions but is conserved among isolates of the same species. These data were used to develop a PCR-restriction fragment length polymorphism (PCR-RFLP) method that rapidly and accurately distinguishes A. fumigatus, A. lentulus, and N. udagawae, three major species within the section Fumigati that have previously been implicated in disease. Digestion of the benA amplicon with BccI generated unique banding patterns; the results were validated by screening a collection of clinical strains and by in silico analysis of the benA sequences of Aspergillus spp. deposited in the GenBank database. PCR-RFLP of benA is a simple method for the identification of clinically important, similar morphotypes of Aspergillus spp. within the section Fumigati.

Opportunities and challenges of disease biomarkers: a new section in the Journal of Translational Medicine.

PubMed

Wang, Xiangdong; Ward, Peter A

2012-12-05

Disease biomarkers are defined to diagnose various phases of diseases, monitor severities of diseases and responses to therapies, or predict prognosis of patients. Disease-specific biomarkers should benefit drug discovery and development, integrate multidisciplinary sciences, be validated by molecular imaging. The opportunities and challenges in biomarker development are emphasized and considered. The Journal of Translational Medicine opens a new Section of Disease Biomarkers to bridge identification and validation of gene or protein-based biomarkers, network biomarkers, dynamic network biomarkers in human diseases, patient phenotypes, and clinical applications. Disease biomarkers are also important for determining drug effects, target specificities and binding, dynamic metabolism and pharmacological kinetics, or toxicity profiles.

[Wound microbial sampling methods in surgical practice, imprint techniques].

PubMed

Chovanec, Z; Veverková, L; Votava, M; Svoboda, J; Peštál, A; Doležel, J; Jedlička, V; Veselý, M; Wechsler, J; Čapov, I

2012-12-01

The wound is a damage of tissue. The process of healing is influenced by many systemic and local factors. The most crucial and the most discussed local factor of wound healing is infection. Surgical site infection in the wound is caused by micro-organisms. This information is known for many years, however the conditions leading to an infection occurrence have not been sufficiently described yet. Correct sampling technique, correct storage, transportation, evaluation, and valid interpretation of these data are very important in clinical practice. There are many methods for microbiological sampling, but the best one has not been yet identified and validated. We aim to discuss the problem with the focus on the imprint technique.

Study on TCM Syndrome Differentiation of Primary Liver Cancer Based on the Analysis of Latent Structural Model.

PubMed

Gu, Zhan; Qi, Xiuzhong; Zhai, Xiaofeng; Lang, Qingbo; Lu, Jianying; Ma, Changping; Liu, Long; Yue, Xiaoqiang

2015-01-01

Primary liver cancer (PLC) is one of the most common malignant tumors because of its high incidence and high mortality. Traditional Chinese medicine (TCM) plays an active role in the treatment of PLC. As the most important part in the TCM system, syndrome differentiation based on the clinical manifestations from traditional four diagnostic methods has met great challenges and questions with the lack of statistical validation support. In this study, we provided evidences for TCM syndrome differentiation of PLC using the method of analysis of latent structural model from clinic data, thus providing basis for establishing TCM syndrome criteria. And also we obtain the common syndromes of PLC as well as their typical clinical manifestations, respectively.

The FDA's role in medical device clinical studies of human subjects

NASA Astrophysics Data System (ADS)

Saviola, James

2005-03-01

This paper provides an overview of the United States Food and Drug Administration's (FDA) role as a regulatory agency in medical device clinical studies involving human subjects. The FDA's regulations and responsibilities are explained and the device application process discussed. The specific medical device regulatory authorities are described as they apply to the development and clinical study of retinal visual prosthetic devices. The FDA medical device regulations regarding clinical studies of human subjects are intended to safeguard the rights and safety of subjects. The data gathered in pre-approval clinical studies provide a basis of valid scientific evidence in order to demonstrate the safety and effectiveness of a medical device. The importance of a working understanding of applicable medical device regulations from the beginning of the device development project is emphasized particularly for novel, complex products such as implantable visual prosthetic devices.

A clinical prognostic model compared to the newly adopted UICC staging in an independent validation cohort of P16 negative/positive head and neck cancer patients.

PubMed

Rasmussen, Jacob H; Håkansson, Katrin; Rasmussen, Gregers B; Vogelius, Ivan R; Friborg, Jeppe; Fischer, Barbara M; Bentzen, Søren M; Specht, Lena

2018-06-01

A previously published prognostic model in patients with head and neck squamous cell carcinoma (HNSCC) was validated in both a p16-negative and a p16-positive independent patient cohort and the performance was compared with the newly adopted 8th edition of the UICC staging system. Consecutive patients with HNSCC treated at a single institution from 2005 to 2012 were included. The cohort was divided in three. 1.) Training cohort, patients treated from 2005 to 2009 excluding patients with p16-positive oropharyngeal squamous cell carcinomas (OPSCC); 2.) A p16-negative validation cohort and 3.) A p16-positive validation cohort. A previously published prognostic model (clinical model) with the significant covariates (smoking status, FDG uptake, and tumor volume) was refitted in the training cohort and validated in the two validation cohorts. The clinical model was used to generate four risk groups based on the predicted risk of disease recurrence after 2 years and the performance was compared with UICC staging 8th edition using concordance index. Overall 568 patients were included. Compared to UICC the clinical model had a significantly better concordance index in the p16-negative validation cohort (AUC = 0.63 for UICC and AUC = 0.73 for the clinical model; p = 0.003) and a borderline significantly better concordance index in the p16-positive cohort (AUC = 0.63 for UICC and 0.72 for the clinical model; p = 0.088). The validated clinical model provided a better prognostication of risk of disease recurrence than UICC stage in the p16-negative validation cohort, and similar prognostication as the newly adopted 8th edition of the UICC staging in the p16-positive patient cohort. Copyright © 2018 Elsevier Ltd. All rights reserved.

The analytical validation of the Oncotype DX Recurrence Score assay

PubMed Central

Baehner, Frederick L

2016-01-01

In vitro diagnostic multivariate index assays are highly complex molecular assays that can provide clinically actionable information regarding the underlying tumour biology and facilitate personalised treatment. These assays are only useful in clinical practice if all of the following are established: analytical validation (i.e., how accurately/reliably the assay measures the molecular characteristics), clinical validation (i.e., how consistently/accurately the test detects/predicts the outcomes of interest), and clinical utility (i.e., how likely the test is to significantly improve patient outcomes). In considering the use of these assays, clinicians often focus primarily on the clinical validity/utility; however, the analytical validity of an assay (e.g., its accuracy, reproducibility, and standardisation) should also be evaluated and carefully considered. This review focuses on the rigorous analytical validation and performance of the Oncotype DX® Breast Cancer Assay, which is performed at the Central Clinical Reference Laboratory of Genomic Health, Inc. The assay process includes tumour tissue enrichment (if needed), RNA extraction, gene expression quantitation (using a gene panel consisting of 16 cancer genes plus 5 reference genes and quantitative real-time RT-PCR), and an automated computer algorithm to produce a Recurrence Score® result (scale: 0–100). This review presents evidence showing that the Recurrence Score result reported for each patient falls within a tight clinically relevant confidence interval. Specifically, the review discusses how the development of the assay was designed to optimise assay performance, presents data supporting its analytical validity, and describes the quality control and assurance programmes that ensure optimal test performance over time. PMID:27729940

The analytical validation of the Oncotype DX Recurrence Score assay.

PubMed

Baehner, Frederick L

2016-01-01

In vitro diagnostic multivariate index assays are highly complex molecular assays that can provide clinically actionable information regarding the underlying tumour biology and facilitate personalised treatment. These assays are only useful in clinical practice if all of the following are established: analytical validation (i.e., how accurately/reliably the assay measures the molecular characteristics), clinical validation (i.e., how consistently/accurately the test detects/predicts the outcomes of interest), and clinical utility (i.e., how likely the test is to significantly improve patient outcomes). In considering the use of these assays, clinicians often focus primarily on the clinical validity/utility; however, the analytical validity of an assay (e.g., its accuracy, reproducibility, and standardisation) should also be evaluated and carefully considered. This review focuses on the rigorous analytical validation and performance of the Oncotype DX ® Breast Cancer Assay, which is performed at the Central Clinical Reference Laboratory of Genomic Health, Inc. The assay process includes tumour tissue enrichment (if needed), RNA extraction, gene expression quantitation (using a gene panel consisting of 16 cancer genes plus 5 reference genes and quantitative real-time RT-PCR), and an automated computer algorithm to produce a Recurrence Score ® result (scale: 0-100). This review presents evidence showing that the Recurrence Score result reported for each patient falls within a tight clinically relevant confidence interval. Specifically, the review discusses how the development of the assay was designed to optimise assay performance, presents data supporting its analytical validity, and describes the quality control and assurance programmes that ensure optimal test performance over time.

Quality of Life Questionnaire-Bronchiectasis: final psychometric analyses and determination of minimal important difference scores.

PubMed

Quittner, Alexandra L; O'Donnell, Anne E; Salathe, Matthias A; Lewis, Sandra A; Li, Xiaoming; Montgomery, A Bruce; O'Riordan, Thomas G; Barker, Alan F

2015-01-01

The Quality of Life-Bronchiectasis (QOL-B), a self-administered, patient-reported outcome measure assessing symptoms, functioning and health-related quality of life for patients with non-cystic fibrosis (CF) bronchiectasis, contains 37 items on 8 scales (Respiratory Symptoms, Physical, Role, Emotional and Social Functioning, Vitality, Health Perceptions and Treatment Burden). Psychometric analyses of QOL-B V.3.0 used data from two double-blind, multicentre, randomised, placebo-controlled, phase III trials of aztreonam for inhalation solution (AZLI) in 542 patients with non-CF bronchiectasis and Gram-negative endobronchial infection. Excellent internal consistency (Cronbach's α ≥0.70) and 2-week test-retest reliability (intraclass correlation coefficients ≥0.72) were demonstrated for each scale. Convergent validity with 6 min walk test was observed for Physical and Role Functioning scores. No floor or ceiling effects (baseline scores of 0 or 100) were found for the Respiratory Symptoms scale (primary endpoint of trials). Baseline Respiratory Symptoms scores discriminated between patients based on baseline FEV₁% predicted in only one trial. The minimal important difference score for the Respiratory Symptoms scale was 8.0 points. AZLI did not show efficacy in the two phase III trials. QOL-B responsivity to treatment was assessed by examining changes from baseline QOL-B scores at study visits at which protocol-defined pulmonary exacerbations were reported. Mean Respiratory Symptoms scores decreased 14.0 and 14.2 points from baseline for placebo-treated and AZLI-treated patients with exacerbations, indicating that worsening respiratory symptoms were reflected in clinically meaningful changes in QOL-B scores. Previously established content validity, reliability and responsivity of the QOL-B are confirmed by this final validation study. The QOL-B is available for use in clinical trials and routine clinical practice. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Taking advantage of continuity of care documents to populate a research repository.

PubMed

Klann, Jeffrey G; Mendis, Michael; Phillips, Lori C; Goodson, Alyssa P; Rocha, Beatriz H; Goldberg, Howard S; Wattanasin, Nich; Murphy, Shawn N

2015-03-01

Clinical data warehouses have accelerated clinical research, but even with available open source tools, there is a high barrier to entry due to the complexity of normalizing and importing data. The Office of the National Coordinator for Health Information Technology's Meaningful Use Incentive Program now requires that electronic health record systems produce standardized consolidated clinical document architecture (C-CDA) documents. Here, we leverage this data source to create a low volume standards based import pipeline for the Informatics for Integrating Biology and the Bedside (i2b2) clinical research platform. We validate this approach by creating a small repository at Partners Healthcare automatically from C-CDA documents. We designed an i2b2 extension to import C-CDAs into i2b2. It is extensible to other sites with variances in C-CDA format without requiring custom code. We also designed new ontology structures for querying the imported data. We implemented our methodology at Partners Healthcare, where we developed an adapter to retrieve C-CDAs from Enterprise Services. Our current implementation supports demographics, encounters, problems, and medications. We imported approximately 17 000 clinical observations on 145 patients into i2b2 in about 24 min. We were able to perform i2b2 cohort finding queries and view patient information through SMART apps on the imported data. This low volume import approach can serve small practices with local access to C-CDAs and will allow patient registries to import patient supplied C-CDAs. These components will soon be available open source on the i2b2 wiki. Our approach will lower barriers to entry in implementing i2b2 where informatics expertise or data access are limited. © The Author 2014. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Student-Directed Video Validation of Psychomotor Skills Performance: A Strategy to Facilitate Deliberate Practice, Peer Review, and Team Skill Sets.

PubMed

DeBourgh, Gregory A; Prion, Susan K

2017-03-22

Background Essential nursing skills for safe practice are not limited to technical skills, but include abilities for determining salience among clinical data within dynamic practice environments, demonstrating clinical judgment and reasoning, problem-solving abilities, and teamwork competence. Effective instructional methods are needed to prepare new nurses for entry-to-practice in contemporary healthcare settings. Method This mixed-methods descriptive study explored self-reported perceptions of a process to self-record videos for psychomotor skill performance evaluation in a convenience sample of 102 pre-licensure students. Results Students reported gains in confidence and skill acquisition using team skills to record individual videos of skill performance, and described the importance of teamwork, peer support, and deliberate practice. Conclusion Although time consuming, the production of student-directed video validations of psychomotor skill performance is an authentic task with meaningful accountabilities that is well-received by students as an effective, satisfying learner experience to increase confidence and competence in performing psychomotor skills.

Voice care knowledge among clinicians and people with healthy voices or dysphonia.

PubMed

Fletcher, Helen M; Drinnan, Michael J; Carding, Paul N

2007-01-01

An important clinical component in the prevention and treatment of voice disorders is voice care and hygiene. Research in voice care knowledge has mainly focussed on specific groups of professional voice users with limited reporting on the tool and evidence base used. In this study, a questionnaire to measure voice care knowledge was developed based on "best evidence." The questionnaire was validated by measuring specialist voice clinicians' agreement. Preliminary data are then presented using the voice care knowledge questionnaire with 17 subjects with nonorganic dysphonia and 17 with healthy voices. There was high (89%) agreement among the clinicians. There was a highly significant difference between the dysphonic and the healthy group scores (P = 0.00005). Furthermore, the dysphonic subjects (63% agreement) presented with less voice care knowledge than the subjects with healthy voices (72% agreement). The questionnaire provides a useful and valid tool to investigate voice care knowledge. The findings have implications for clinical intervention, voice therapy, and health prevention.

Concepts for the translation of genome-based innovations into public health: a comprehensive overview.

PubMed

Syurina, Elena V; Schulte In den Bäumen, Tobias; Brand, Angela; Ambrosino, Elena; Feron, Frans Jm

2013-03-01

Recent vast and rapid development of genome-related sciences is followed by the development of different assessment techniques or attempts to adapt the existing ones. The aim of this article is to give an overview of existing concepts for the assessment and translation of innovations into healthcare, applying a descriptive analysis of their present use by public health specialists and policy makers. The international literature review identified eight concepts including Health Technology Assessment, analytic validity, clinical validity, clinical utility, ethical, legal and social implications, Public Health Wheel and others. This study gives an overview of these concepts (including the level of current use) applying a descriptive analysis of their present use by public health specialists and policy makers. Despite the heterogeneity of the analyzed concepts and difference in use in everyday healthcare practice, the cross-integration of these concepts is important in order to improve translation speed and quality. Finally, some recommendations are made regarding the most applicable translational concepts.

Bayesian Adaptive Trial Design for a Newly Validated Surrogate Endpoint

PubMed Central

Renfro, Lindsay A.; Carlin, Bradley P.; Sargent, Daniel J.

2011-01-01

Summary The evaluation of surrogate endpoints for primary use in future clinical trials is an increasingly important research area, due to demands for more efficient trials coupled with recent regulatory acceptance of some surrogates as ‘valid.’ However, little consideration has been given to how a trial which utilizes a newly-validated surrogate endpoint as its primary endpoint might be appropriately designed. We propose a novel Bayesian adaptive trial design that allows the new surrogate endpoint to play a dominant role in assessing the effect of an intervention, while remaining realistically cautious about its use. By incorporating multi-trial historical information on the validated relationship between the surrogate and clinical endpoints, then subsequently evaluating accumulating data against this relationship as the new trial progresses, we adaptively guard against an erroneous assessment of treatment based upon a truly invalid surrogate. When the joint outcomes in the new trial seem plausible given similar historical trials, we proceed with the surrogate endpoint as the primary endpoint, and do so adaptively–perhaps stopping the trial for early success or inferiority of the experimental treatment, or for futility. Otherwise, we discard the surrogate and switch adaptive determinations to the original primary endpoint. We use simulation to test the operating characteristics of this new design compared to a standard O’Brien-Fleming approach, as well as the ability of our design to discriminate trustworthy from untrustworthy surrogates in hypothetical future trials. Furthermore, we investigate possible benefits using patient-level data from 18 adjuvant therapy trials in colon cancer, where disease-free survival is considered a newly-validated surrogate endpoint for overall survival. PMID:21838811

Potential serum biomarkers from a metabolomics study of autism

PubMed Central

Wang, Han; Liang, Shuang; Wang, Maoqing; Gao, Jingquan; Sun, Caihong; Wang, Jia; Xia, Wei; Wu, Shiying; Sumner, Susan J.; Zhang, Fengyu; Sun, Changhao; Wu, Lijie

2016-01-01

Background Early detection and diagnosis are very important for autism. Current diagnosis of autism relies mainly on some observational questionnaires and interview tools that may involve a great variability. We performed a metabolomics analysis of serum to identify potential biomarkers for the early diagnosis and clinical evaluation of autism. Methods We analyzed a discovery cohort of patients with autism and participants without autism in the Chinese Han population using ultra-performance liquid chromatography quadrupole time-of-flight tandem mass spectrometry (UPLC/Q-TOF MS/MS) to detect metabolic changes in serum associated with autism. The potential metabolite candidates for biomarkers were individually validated in an additional independent cohort of cases and controls. We built a multiple logistic regression model to evaluate the validated biomarkers. Results We included 73 patients and 63 controls in the discovery cohort and 100 cases and 100 controls in the validation cohort. Metabolomic analysis of serum in the discovery stage identified 17 metabolites, 11 of which were validated in an independent cohort. A multiple logistic regression model built on the 11 validated metabolites fit well in both cohorts. The model consistently showed that autism was associated with 2 particular metabolites: sphingosine 1-phosphate and docosahexaenoic acid. Limitations While autism is diagnosed predominantly in boys, we were unable to perform the analysis by sex owing to difficulty recruiting enough female patients. Other limitations include the need to perform test–retest assessment within the same individual and the relatively small sample size. Conclusion Two metabolites have potential as biomarkers for the clinical diagnosis and evaluation of autism. PMID:26395811

Critical appraisal of published literature

PubMed Central

Umesh, Goneppanavar; Karippacheril, John George; Magazine, Rahul

2016-01-01

With a large output of medical literature coming out every year, it is impossible for readers to read every article. Critical appraisal of scientific literature is an important skill to be mastered not only by academic medical professionals but also by those involved in clinical practice. Before incorporating changes into the management of their patients, a thorough evaluation of the current or published literature is an important step in clinical practice. It is necessary for assessing the published literature for its scientific validity and generalizability to the specific patient community and reader's work environment. Simple steps have been provided by Consolidated Standard for Reporting Trial statements, Scottish Intercollegiate Guidelines Network and several other resources which if implemented may help the reader to avoid reading flawed literature and prevent the incorporation of biased or untrustworthy information into our practice. PMID:27729695

Clinical validation of the Tempus xO assay

PubMed Central

Beaubier, Nike; Tell, Robert; Huether, Robert; Bontrager, Martin; Bush, Stephen; Parsons, Jerod; Shah, Kaanan; Baker, Tim; Selkov, Gene; Taxter, Tim; Thomas, Amber; Bettis, Sam; Khan, Aly; Lau, Denise; Lee, Christina; Barber, Matthew; Cieslik, Marcin; Frankenberger, Casey; Franzen, Amy; Weiner, Ali; Palmer, Gary; Lonigro, Robert; Robinson, Dan; Wu, Yi-Mi; Cao, Xuhong; Lefkofsky, Eric; Chinnaiyan, Arul; White, Kevin P.

2018-01-01

We have developed a clinically validated NGS assay that includes tumor, germline and RNA sequencing. We apply this assay to clinical specimens and cell lines, and we demonstrate a clinical sensitivity of 98.4% and positive predictive value of 100% for the clinically actionable variants measured by the assay. We also demonstrate highly accurate copy number measurements and gene rearrangement identification. PMID:29899824

Modernization of Physical Appearance and Solution Color Tests Using Quantitative Tristimulus Colorimetry: Advantages, Harmonization, and Validation Strategies.

PubMed

Pack, Brian W; Montgomery, Laura L; Hetrick, Evan M

2015-10-01

Color measurements, including physical appearance, are important yet often misunderstood and underappreciated aspects of a control strategy for drug substances and drug products. From a patient safety perspective, color can be an important control point for detecting contamination, impurities, and degradation products, with human visual acuity often more sensitive for colored impurities than instrumental techniques such as HPLC. Physical appearance tests and solution color tests can also serve an important role in ensuring that appropriate steps are taken such that clinical trials do not become unblinded when the active material is compared with another product or a placebo. Despite the importance of color tests, compendial visual tests are not harmonized across the major pharmacopoeias, which results in ambiguous specifications of little value, difficult communication of true sample color, and significant extra work required for global registration. Some pharmacopoeias have not yet recognized or adopted technical advances in the instrumental measurement of color and appearance, whereas others begin to acknowledge the advantage of instrumental colorimetry, yet leave implementation of the technology ambiguous. This commentary will highlight the above-mentioned inconsistencies, provide an avenue toward harmonization and modernization, and outline a scientifically sound approach for implementing quantitative technologies for improved measurement, communication, and control of color and appearance for both solutions and solids. Importantly, this manuscript, for the first time, outlines a color method validation approach that is consistent with the International Conference on Harmonization's guidance on the topic of method validation. © 2015 Wiley Periodicals, Inc. and the American Pharmacists Association.

Refining and validating a conceptual model of Clinical Nurse Leader integrated care delivery.

PubMed

Bender, Miriam; Williams, Marjory; Su, Wei; Hites, Lisle

2017-02-01

To empirically validate a conceptual model of Clinical Nurse Leader integrated care delivery. There is limited evidence of frontline care delivery models that consistently achieve quality patient outcomes. Clinical Nurse Leader integrated care delivery is a promising nursing model with a growing record of success. However, theoretical clarity is necessary to generate causal evidence of effectiveness. Sequential mixed methods. A preliminary Clinical Nurse Leader practice model was refined and survey items developed to correspond with model domains, using focus groups and a Delphi process with a multi-professional expert panel. The survey was administered in 2015 to clinicians and administrators involved in Clinical Nurse Leader initiatives. Confirmatory factor analysis and structural equation modelling were used to validate the measurement and model structure. Final sample n = 518. The model incorporates 13 components organized into five conceptual domains: 'Readiness for Clinical Nurse Leader integrated care delivery'; 'Structuring Clinical Nurse Leader integrated care delivery'; 'Clinical Nurse Leader Practice: Continuous Clinical Leadership'; 'Outcomes of Clinical Nurse Leader integrated care delivery'; and 'Value'. Sample data had good fit with specified model and two-level measurement structure. All hypothesized pathways were significant, with strong coefficients suggesting good fit between theorized and observed path relationships. The validated model articulates an explanatory pathway of Clinical Nurse Leader integrated care delivery, including Clinical Nurse Leader practices that result in improved care dynamics and patient outcomes. The validated model provides a basis for testing in practice to generate evidence that can be deployed across the healthcare spectrum. © 2016 John Wiley & Sons Ltd.

Spontaneous Swallow Frequency Compared with Clinical Screening in the Identification of Dysphagia in Acute Stroke

PubMed Central

Crary, Michael A.; Carnaby, Giselle D.; Sia, Isaac

2017-01-01

Background The aim of this study was to compare spontaneous swallow frequency analysis (SFA) with clinical screening protocols for identification of dysphagia in acute stroke. Methods In all, 62 patients with acute stroke were evaluated for spontaneous swallow frequency rates using a validated acoustic analysis technique. Independent of SFA, these same patients received a routine nurse-administered clinical dysphagia screening as part of standard stroke care. Both screening tools were compared against a validated clinical assessment of dysphagia for acute stroke. In addition, psychometric properties of SFA were compared against published, validated clinical screening protocols. Results Spontaneous SFA differentiates patients with versus without dysphagia after acute stroke. Using a previously identified cut point based on swallows per minute, spontaneous SFA demonstrated superior ability to identify dysphagia cases compared with a nurse-administered clinical screening tool. In addition, spontaneous SFA demonstrated equal or superior psychometric properties to 4 validated, published clinical dysphagia screening tools. Conclusions Spontaneous SFA has high potential to identify dysphagia in acute stroke with psychometric properties equal or superior to clinical screening protocols. PMID:25088166

Spontaneous swallow frequency compared with clinical screening in the identification of dysphagia in acute stroke.

PubMed

Crary, Michael A; Carnaby, Giselle D; Sia, Isaac

2014-09-01

The aim of this study was to compare spontaneous swallow frequency analysis (SFA) with clinical screening protocols for identification of dysphagia in acute stroke. In all, 62 patients with acute stroke were evaluated for spontaneous swallow frequency rates using a validated acoustic analysis technique. Independent of SFA, these same patients received a routine nurse-administered clinical dysphagia screening as part of standard stroke care. Both screening tools were compared against a validated clinical assessment of dysphagia for acute stroke. In addition, psychometric properties of SFA were compared against published, validated clinical screening protocols. Spontaneous SFA differentiates patients with versus without dysphagia after acute stroke. Using a previously identified cut point based on swallows per minute, spontaneous SFA demonstrated superior ability to identify dysphagia cases compared with a nurse-administered clinical screening tool. In addition, spontaneous SFA demonstrated equal or superior psychometric properties to 4 validated, published clinical dysphagia screening tools. Spontaneous SFA has high potential to identify dysphagia in acute stroke with psychometric properties equal or superior to clinical screening protocols. Copyright © 2014 National Stroke Association. Published by Elsevier Inc. All rights reserved.

The role of self-efficacy in inflammatory bowel disease management: preliminary validation of a disease-specific measure.

PubMed

Keefer, Laurie; Kiebles, Jennifer L; Taft, Tiffany H

2011-02-01

Inflammatory bowel diseases (IBDs) require self-management skills that may be influenced by self-efficacy (SE). Self-efficacy represents an individual's perception of his or her ability to organize and execute the behaviors necessary to manage disease. The goal of this study was to develop a valid and reliable measure of IBD-specific SE that can be used in clinical and research contexts. One hundred and twenty-two adults with a verified IBD diagnosis participated in the study. Data were pooled from 2 sources: patients from an outpatient university gastroenterology clinic (n=42) and a sample of online respondents (n=80). All participants (N=122) completed the IBD Self-Efficacy Scale (IBD-SES) and the Inflammatory Bowel Disease Questionnaire. Additionally, online participants completed the Brief Symptom Inventory-18 and the Rosenberg Self-Esteem Scale, whereas those in the clinic sample completed the Perceived Health Competence Scale, the Perceived Stress Questionnaire, and the Short Form Version 2 Health Survey. The IBD-SES was initially constructed to identify 4 distinct theoretical domains of self-efficacy: (1) managing stress and emotions, (2) managing medical care, (3) managing symptoms and disease, and (4) maintaining remission. The 29-item IBD-SES has high internal consistency (r=0.96), high test-retest reliability (r=0.90), and demonstrates strong construct and concurrent validity with established measures. The IBD-SES is a critical first step toward addressing an important psychological construct that could influence treatment outcomes in IBD.

Importance of multi-modal approaches to effectively identify cataract cases from electronic health records.

PubMed

Peissig, Peggy L; Rasmussen, Luke V; Berg, Richard L; Linneman, James G; McCarty, Catherine A; Waudby, Carol; Chen, Lin; Denny, Joshua C; Wilke, Russell A; Pathak, Jyotishman; Carrell, David; Kho, Abel N; Starren, Justin B

2012-01-01

There is increasing interest in using electronic health records (EHRs) to identify subjects for genomic association studies, due in part to the availability of large amounts of clinical data and the expected cost efficiencies of subject identification. We describe the construction and validation of an EHR-based algorithm to identify subjects with age-related cataracts. We used a multi-modal strategy consisting of structured database querying, natural language processing on free-text documents, and optical character recognition on scanned clinical images to identify cataract subjects and related cataract attributes. Extensive validation on 3657 subjects compared the multi-modal results to manual chart review. The algorithm was also implemented at participating electronic MEdical Records and GEnomics (eMERGE) institutions. An EHR-based cataract phenotyping algorithm was successfully developed and validated, resulting in positive predictive values (PPVs) >95%. The multi-modal approach increased the identification of cataract subject attributes by a factor of three compared to single-mode approaches while maintaining high PPV. Components of the cataract algorithm were successfully deployed at three other institutions with similar accuracy. A multi-modal strategy incorporating optical character recognition and natural language processing may increase the number of cases identified while maintaining similar PPVs. Such algorithms, however, require that the needed information be embedded within clinical documents. We have demonstrated that algorithms to identify and characterize cataracts can be developed utilizing data collected via the EHR. These algorithms provide a high level of accuracy even when implemented across multiple EHRs and institutional boundaries.

[Hand fine motor skills and use of both hand and arm in subjects after a stroke: a systematic review].

PubMed

Ostolaza, M; Abudarham, J; Dilascio, S; Drault-Boedo, E; Gallo, S; Garcete, A; Kramer, M; Maiaru, M; Mendelevich, A; Modica, M; Peralta, F; Sanchez-Correa, C

2017-04-01

In clinical practice it is important to be able to assess the function of the upper limb of the patient who has suffered a stroke. There is currently no systemic review that could identify assessment tools for the 'fine use of the hand' and 'use of both hand and arm'. Primary, to identify observational tools which can assess the fine use of the hand and the use of both hand and arm in patients with stroke sequels. Secondary, to analyze the bias risk in the included articles, describing and categorizing the clinical utility, validity and reliability. A search was carried in Medline, LILACS, SciELO and Open Grey, which included articles published until October 2015. Studies that validate assessing tools of the upper limb in subjects with a stroke sequel which evaluate the fine use of the hand and the use of both hand and arm were included. Eleven tools in evaluate observational haven been selected, which assess the fine use of the hand and the use of hand and arm. In every case both validity and reliability have been reported, but clinical utility has been less considered for assessment. The studies that researched these tools showed a high risk of bias in their development. ARAT-19 showed a lower bias risk, but when it has to do with applicability and the reference trial is taken into account, the level of concern is high.

The Fatigue Assessment Scale: quality and availability in sarcoidosis and other diseases.

PubMed

Hendriks, Celine; Drent, Marjolein; Elfferich, Marjon; De Vries, Jolanda

2018-06-07

Fatigue is a problem experienced by many patients suffering from chronic diseases, including sarcoidosis patients. It has a substantial influence on patients' quality of life (QoL). It is, therefore, important to properly assess fatigue with a valid and reliable measure. The Fatigue Assessment Scale (FAS) is the only validated self-reporting instrument classifying fatigue in sarcoidosis. The aim of this review was to examine the psychometric properties of the FAS and the diseases and languages in which it has been used. Studies among sarcoidosis patients were also reviewed in terms of outcomes. Studies were identified by searching the electronic bibliographic database Pubmed. Search terms used were: FAS and fatigue. Articles were included in the review if the FAS had been used to assess fatigue. Since its introduction, the FAS was used in 26 different diseases or conditions, including stroke, neurologic disorders, rheumatoid arthritis, idiopathic pulmonary fibrosis and sarcoidosis. Its reliability and validity have proved to be good. Unidimensionality has been established. So far, the FAS is available in 20 languages and widely used in sarcoidosis. Digital versions as well as PDFs of various languages are available online (www.wasog.org). The FAS has good psychometric qualities for the diseases in which it has been examined, including sarcoidosis, and can be used in clinical practice. Healthcare workers can use the FAS to assess fatigue in the management, follow-up and clinical care programmes for their patients consistently across countries, as well as in clinical research.

Development and Validation of a Photonumeric Scale for Assessment of Chin Retrusion.

PubMed

Sykes, Jonathan M; Carruthers, Alastair; Hardas, Bhushan; Murphy, Diane K; Jones, Derek; Carruthers, Jean; Donofrio, Lisa; Creutz, Lela; Marx, Ann; Dill, Sara

2016-10-01

A validated scale is needed for objective and reproducible comparisons of chin appearance before and after chin augmentation in practice and clinical studies. To describe the development and validation of the 5-point photonumeric Allergan Chin Retrusion Scale. The Allergan Chin Retrusion Scale was developed to include an assessment guide, verbal descriptors, morphed images, and real subject images for each scale grade. The clinical significance of a 1-point score difference was evaluated in a review of multiple image pairs representing varying differences in severity. Interrater and intrarater reliability was evaluated in a live-subject validation study (N = 298) completed during 2 sessions occurring 3 weeks apart. A difference of ≥1 point on the scale was shown to reflect a clinically meaningful difference (mean [95% confidence interval] absolute score difference, 1.07 [0.94-1.20] for clinically different image pairs and 0.51 [0.39-0.63] for not clinically different pairs). Intrarater agreement between the 2 live-subject validation sessions was substantial (mean weighted kappa = 0.79). Interrater agreement was substantial during the second rating session (0.68, primary end point). The Allergan Chin Retrusion Scale is a validated and reliable scale for physician rating of severity of chin retrusion.

The validity and clinical utility of purging disorder.

PubMed

Keel, Pamela K; Striegel-Moore, Ruth H

2009-12-01

To review evidence of the validity and clinical utility of Purging Disorder and examine options for the Diagnostic and Statistical Manual of Mental Disorders fifth edition (DSM-V). Articles were identified by computerized and manual searches and reviewed to address five questions about Purging Disorder: Is there "ample" literature? Is the syndrome clearly defined? Can it be measured and diagnosed reliably? Can it be differentiated from other eating disorders? Is there evidence of syndrome validity? Although empirical classification and concurrent validity studies provide emerging support for the distinctiveness of Purging Disorder, questions remain about definition, diagnostic reliability in clinical settings, and clinical utility (i.e., prognostic validity). We discuss strengths and weaknesses associated with various options for the status of Purging Disorder in the DSM-V ranging from making no changes from DSM-IV to designating Purging Disorder a diagnosis on equal footing with Anorexia Nervosa and Bulimia Nervosa.

GMP-compliant human adipose tissue-derived mesenchymal stem cells for cellular therapy.

PubMed

Aghayan, Hamid-Reza; Goodarzi, Parisa; Arjmand, Babak

2015-01-01

Stem cells, which can be derived from different sources, demonstrate promising therapeutic evidences for cellular therapies. Among various types of stem cell, mesenchymal stem cells are one of the most common stem cells that are used in cellular therapy. Human subcutaneous adipose tissue provides an easy accessible source of mesenchymal stem cells with some considerable advantages. Accordingly, various preclinical and clinical investigations have shown enormous potential of adipose-derived stromal cells in regenerative medicine. Consequently, increasing clinical applications of these cells has elucidated the importance of safety concerns regarding clinical transplantation. Therefore, clinical-grade preparation of adipose-derived stromal cells in accordance with current good manufacturing practice guidelines is an essential part of their clinical applications to ensure the safety, quality, characteristics, and identity of cell products. Additionally, GMP-compliant cell manufacturing involves several issues to provide a quality assurance system during translation from the basic stem cell sciences into clinical investigations and applications. On the other hand, advanced cellular therapy requires extensive validation, process control, and documentation. It also evidently elucidates the critical importance of production methods and probable risks. Therefore, implementation of a quality management and assurance system in accordance with GMP guidelines can greatly reduce these risks particularly in the higher-risk category or "more than minimally manipulated" products.

Medications Development for the Treatment of Alcohol Use Disorder: Insights into the Predictive Value of Animal and Human Laboratory Models

PubMed Central

Yardley, Megan M.; Ray, Lara A.

2016-01-01

Development of effective treatments for alcohol use disorder (AUD) represents an important public health goal. This review provides a summary of completed preclinical and clinical studies testing pharmacotherapies for treatment of AUD. We discuss opportunities for improving the translation from preclinical findings to clinical trial outcomes, focusing on the validity and predictive value of animal and human laboratory models of AUD. Specifically, while preclinical studies of medications development have offered important insights into the neurobiology of the disorder and alcohol's molecular targets, limitations include the lack of standardized methods and streamlined processes whereby animal studies can readily inform human studies. Behavioral pharmacology studies provide a less expensive and valuable opportunity to assess the feasibility of a pharmacotherapy prior to initiating larger scale clinical trials by providing insights into the mechanism of the drug, which can then inform recruitment, analyses, and assessments. Summary tables are provided to illustrate the wide range of preclinical, human laboratory, and clinical studies of medications development for alcoholism. Taken together, this review highlights the challenges associated with animal paradigms, human laboratory studies and clinical trials with the overarching goal of advancing treatment development and highlighting opportunities to bridge the gap between preclinical and clinical research. PMID:26833803

Therapeutic risk management of the suicidal patient: augmenting clinical suicide risk assessment with structured instruments.

PubMed

Homaifar, Beeta; Matarazzo, Bridget; Wortzel, Hal S

2013-09-01

This column is the second in a series presenting a model for therapeutic risk management of the suicidal patient. As discussed in the first part of the series, the model involves several elements including augmenting clinical risk assessment with structured instruments, stratifying risk in terms of both severity and temporality, and developing and documenting a safety plan. This column explores in more detail how to augment clinical risk assessment with structured instruments. Unstructured clinical interviews have the potential to miss important aspects of suicide risk assessment. By augmenting the free-form clinical interview with structured instruments that demonstrate reliability and validity, a more nuanced and multifaceted approach to suicide risk assessment is achieved. Incorporating structured instruments into practice also serves a medicolegal function, since these instruments may become a living part of the medical record, establishing baseline levels of suicidal thoughts and behaviors and facilitating future clinical determinations regarding safety needs. We describe several instruments used in a multidisciplinary suicide consultation service, each of which has demonstrated relevance to suicide risk assessment and screening, ease of administration, and strong psychometric properties. In addition, we emphasize the importance of viewing suicide risk assessment as an ongoing process rather than as a singular event. Finally, we discuss special considerations in the evolving practice of risk assessment.

Developability assessment of clinical drug products with maximum absorbable doses.

PubMed

Ding, Xuan; Rose, John P; Van Gelder, Jan

2012-05-10

Maximum absorbable dose refers to the maximum amount of an orally administered drug that can be absorbed in the gastrointestinal tract. Maximum absorbable dose, or D(abs), has proved to be an important parameter for quantifying the absorption potential of drug candidates. The purpose of this work is to validate the use of D(abs) in a developability assessment context, and to establish appropriate protocol and interpretation criteria for this application. Three methods for calculating D(abs) were compared by assessing how well the methods predicted the absorption limit for a set of real clinical candidates. D(abs) was calculated for these clinical candidates by means of a simple equation and two computer simulation programs, GastroPlus and an program developed at Eli Lilly and Company. Results from single dose escalation studies in Phase I clinical trials were analyzed to identify the maximum absorbable doses for these compounds. Compared to the clinical results, the equation and both simulation programs provide conservative estimates of D(abs), but in general D(abs) from the computer simulations are more accurate, which may find obvious advantage for the simulations in developability assessment. Computer simulations also revealed the complex behavior associated with absorption saturation and suggested in most cases that the D(abs) limit is not likely to be achieved in a typical clinical dose range. On the basis of the validation findings, an approach is proposed for assessing absorption potential, and best practices are discussed for the use of D(abs) estimates to inform clinical formulation development strategies. Copyright © 2012 Elsevier B.V. All rights reserved.

Leveling the Playing Field: Bringing Development of Biomarkers and Molecular Diagnostics up to the Standards for Drug Development

PubMed Central

Poste, George; Carbone, David P.; Parkinson, David R.; Verweij, Jaap; Hewitt, Stephen; Jessup, J. Milburn

2012-01-01

Molecular diagnostics are increasingly important in clinical research to stratify or identify molecularly profiled patient cohorts for targeted therapies, to modify the dose of a therapeutic, or to assess early response to therapy or monitor patients. Molecular diagnostics can also be used to identify pharmocogenetic risk of adverse drug reactions. The articles of this CCR Focus section on Molecular Diagnosis describe the development and use of markers for medical decision-making in the cancer patient. They define the sources of preanalytic variability to minimize as well as the regulatory and financial challenges in diagnostic development and integration into clinical practice. They also outline an NCI program to assist diagnostic development. Molecular diagnostic clinical tests require rigor in their development and clinical validation with sufficient sensitivity, specificity and validity that is comparable to that used for development of therapeutics. These diagnostics must be offered at a realistic cost that reflects both their clinical value and the costs associated with their development. When genome sequencing technologies move into the clinic, they must be integrated with and traceable to current technology because they may identify more efficient and accurate approaches to drug development. In addition, regulators may define progressive drug approval for companion diagnostics that requires further evidence regarding efficacy and safety before full approval. A way to accomplish this is to emphasize Phase IV post-marketing hypothesis driven clinical trials with biological characterization that permits accurate definition of the association of low prevalence gene alterations with toxicity or response in large cohorts. PMID:22422403

Leveling the playing field: bringing development of biomarkers and molecular diagnostics up to the standards for drug development.

PubMed

Poste, George; Carbone, David P; Parkinson, David R; Verweij, Jaap; Hewitt, Stephen M; Jessup, J Milburn

2012-03-15

Molecular diagnostics are becoming increasingly important in clinical research to stratify or identify molecularly profiled patient cohorts for targeted therapies, to modify the dose of a therapeutic, and to assess early response to therapy or monitor patients. Molecular diagnostics can also be used to identify the pharmacogenetic risk of adverse drug reactions. The articles in this CCR Focus section on molecular diagnosis describe the development and use of markers to guide medical decisions regarding cancer patients. They define sources of preanalytic variability that need to be minimized, as well as the regulatory and financial challenges involved in developing diagnostics and integrating them into clinical practice. They also outline a National Cancer Institute program to assist diagnostic development. Molecular diagnostic clinical tests require rigor in their development and clinical validation, with sensitivity, specificity, and validity comparable to those required for the development of therapeutics. These diagnostics must be offered at a realistic cost that reflects both their clinical value and the costs associated with their development. When genome-sequencing technologies move into the clinic, they must be integrated with and traceable to current technology because they may identify more efficient and accurate approaches to drug development. In addition, regulators may define progressive drug approval for companion diagnostics that requires further evidence regarding efficacy and safety before full approval can be achieved. One way to accomplish this is to emphasize phase IV postmarketing, hypothesis-driven clinical trials with biological characterization that would permit an accurate definition of the association of low-prevalence gene alterations with toxicity or response in large cohorts.

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 2—External Validity and Correlates.

PubMed

Horan, William P; Reddy, L Felice; Barch, Deanna M; Buchanan, Robert W; Dunayevich, Eduardo; Gold, James M; Marder, Steven R; Wynn, Jonathan K; Young, Jared W; Green, Michael F

2015-09-01

Effort-based decision making has strong conceptual links to the motivational disturbances that define a key subdomain of negative symptoms. However, the extent to which effort-based decision-making performance relates to negative symptoms, and other clinical and functionally important variables has yet to be systematically investigated. In 94 clinically stable outpatients with schizophrenia, we examined the external validity of 5 effort-based paradigms, including the Effort Expenditure for Rewards, Balloon Effort, Grip Strength Effort, Deck Choice Effort, and Perceptual Effort tasks. These tasks covered 3 types of effort: physical, cognitive, and perceptual. Correlations between effort related performance and 6 classes of variables were examined, including: (1) negative symptoms, (2) clinically rated motivation and community role functioning, (3) self-reported motivational traits, (4) neurocognition, (5) other psychiatric symptoms and clinical/demographic characteristics, and (6) subjective valuation of monetary rewards. Effort paradigms showed small to medium relationships to clinical ratings of negative symptoms, motivation, and functioning, with the pattern more consistent for some measures than others. They also showed small to medium relations with neurocognitive functioning, but were generally unrelated to other psychiatric symptoms, self-reported traits, antipsychotic medications, side effects, and subjective valuation of money. There were relatively strong interrelationships among the effort measures. In conjunction with findings from a companion psychometric article, all the paradigms warrant further consideration and development, and 2 show the strongest potential for clinical trial use at this juncture. © The Author 2015. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Experience from mental health clinics held during medical service camps in Fiji.

PubMed

Sivakumaran, Hemalatha; George, Kuruvilla; Naker, Gunu; Nadanachandran, Kathir

2015-12-01

We aim to describe the experience and findings of mental health clinics held during medical service camps in the rural settings of Fiji. Descriptive data collated at the end of the medical camps across 2011-2014 are used to highlight the main findings. The exposure to mental health assessments and brief interventions at these camps was a validating experience for both individuals and medical students attending the clinics. The most common presentations can be categorised under symptoms of depression, anxiety and relationship problems. The accessibility of mental health support services is a challenge in Fiji. Medical service camps can form an important pathway in promoting mental health awareness, especially amongst the rural communities of Fiji, and a useful platform for medical students to acquire some clinical exposure. © The Royal Australian and New Zealand College of Psychiatrists 2015.

Risk of malnutrition (over and under-nutrition): validation of the JaNuS screening tool.

PubMed

Donini, Lorenzo M; Ricciardi, Laura Maria; Neri, Barbara; Lenzi, Andrea; Marchesini, Giulio

2014-12-01

Malnutrition (over and under-nutrition) is highly prevalent in patients admitted to hospital and it is a well-known risk factor for increased morbidity and mortality. Nutritional problems are often misdiagnosed, and especially the coexistence of over and undernutrition is not usually recognized. We aimed to develop and validate a screening tool for the easy detection and reporting of both undernutrition and overnutrition, specifically identifying the clinical conditions where the two types of malnutrition coexist. The study consisted of three phases: 1) selection of an appropriate study population (estimation sample) and of the hospital admission parameters to identify overnutrition and undernutrition; 2) combination of selected variables to create a screening tool to assess the nutritional risk in case of undernutrition, overnutrition, or the copresence of both the conditions, to be used by non-specialist health care professionals; 3) validation of the screening tool in a different patient sample (validation sample). Two groups of variables (12 for undernutrition, 7 for overnutrition) were identified in separate logistic models for their correlation with the outcome variables. Both models showed high efficacy, sensitivity and specificity (overnutrition, 97.7%, 99.6%, 66.6%, respectively; undernutrition, 84.4%, 83.6%, 84.8%). The logistic models were used to construct a two-faced test (named JaNuS - Just A Nutritional Screening) fitting into a two-dimension Cartesian coordinate graphic system. In the validation sample the JaNuS test confirmed its predictive value. Internal consistency and test-retest analysis provide evidence for the reliability of the test. The study provides a screening tool for the assessment of the nutritional risk, based on parameters easy-to-use by health care personnel lacking nutritional competence and characterized by excellent predictive validity. The test might be confidently applied in the clinical setting to determine the importance of malnutrition (including the copresence of over and undernutrition) as a risk factor for morbidity and mortality. Copyright © 2013 Elsevier Ltd and European Society for Clinical Nutrition and Metabolism. All rights reserved.

The contribution of an animal model toward uncovering biological risk factors for PTSD.

PubMed

Cohen, Hagit; Matar, Michael A; Richter-Levin, Gal; Zohar, Joseph

2006-07-01

Clinical studies of posttraumatic stress disorder (PTSD) have elicited proposed risk factors for developing PTSD in the aftermath of stress exposure. Generally, these risk factors have arisen from retrospective analysis of premorbid characteristics of study populations. A valid animal model of PTSD can complement clinical studies and help to elucidate issues, such as the contribution of proposed risk factors, in ways which are not practicable in the clinical arena. Important qualities of animal models include the possibility to conduct controlled prospective studies, easy access to postmortem brains, and the availability of genetically manipulated subjects, which can be tailored to specific needs. When these qualities are further complemented by an approach which defines phenomenologic criteria to address the variance in individual response pattern and magnitude, enabling the animal subjects to be classified into definable groups for focused study, the model acquires added validity. This article presents an overview of a series of studies in such an animal model which examine the contribution of two proposed risk factors and the value of two early postexposure pharmacological manipulations on the prevalence rates of subjects displaying an extreme magnitude of behavioral response to a predator stress paradigm.

Using computerised patient-level costing data for setting DRG weights: the Victorian (Australia) cost weight studies.

PubMed

Jackson, T

2001-05-01

Casemix-funding systems for hospital inpatient care require a set of resource weights which will not inadvertently distort patterns of patient care. Few health systems have very good sources of cost information, and specific studies to derive empirical cost relativities are themselves costly. This paper reports a 5 year program of research into the use of data from hospital management information systems (clinical costing systems) to estimate resource relativities for inpatient hospital care used in Victoria's DRG-based payment system. The paper briefly describes international approaches to cost weight estimation. It describes the architecture of clinical costing systems, and contrasts process and job costing approaches to cost estimation. Techniques of data validation and reliability testing developed in the conduct of four of the first five of the Victorian Cost Weight Studies (1993-1998) are described. Improvement in sampling, data validity and reliability are documented over the course of the research program, the advantages of patient-level data are highlighted. The usefulness of these byproduct data for estimation of relative resource weights and other policy applications may be an important factor in hospital and health system decisions to invest in clinical costing technology.

SITC/iSBTc Cancer Immunotherapy Biomarkers Resource Document: Online resources and useful tools - a compass in the land of biomarker discovery

PubMed Central

2011-01-01

Recent positive clinical results in cancer immunotherapy point to the potential of immune-based strategies to provide effective treatment of a variety of cancers. In some patients, the responses to cancer immunotherapy are durable, dramatically extending survival. Extensive research efforts are being made to identify and validate biomarkers that can help identify subsets of cancer patients that will benefit most from these novel immunotherapies. In addition to the clear advantage of such predictive biomarkers, immune biomarkers are playing an important role in the development, clinical evaluation and monitoring of cancer immunotherapies. This Cancer Immunotherapy Resource Document, prepared by the Society for Immunotherapy of Cancer (SITC, formerly the International Society for Biological Therapy of Cancer, iSBTc), provides key references and online resources relevant to the discovery, evaluation and clinical application of immune biomarkers. These key resources were identified by experts in the field who are actively pursuing research in biomarker identification and validation. This organized collection of the most useful references, online resources and tools serves as a compass to guide discovery of biomarkers essential to advancing novel cancer immunotherapies. PMID:21929757

The Added Value of the Combined Use of the Autism Diagnostic Interview-Revised and the Autism Diagnostic Observation Schedule: Diagnostic Validity in a Clinical Swedish Sample of Toddlers and Young Preschoolers

ERIC Educational Resources Information Center

Zander, Eric; Sturm, Harald; Bölte, Sven

2015-01-01

The diagnostic validity of the new research algorithms of the Autism Diagnostic Interview-Revised and the revised algorithms of the Autism Diagnostic Observation Schedule was examined in a clinical sample of children aged 18-47 months. Validity was determined for each instrument separately and their combination against a clinical consensus…

Validity of the Modified Child Psychopathy Scale for Juvenile Justice Center Residents.

PubMed

Verschuere, Bruno; Candel, Ingrid; Van Reenen, Lique; Korebrits, Andries

2012-06-01

Adult psychopathy has proven to be an important clinical and forensic construct, but much less is known about juvenile psychopathy. In the present study, we examined the construct validity of the self report modified Child Psychopathy Scale mCPS; Lynam (Psychological Bulletin 120:(2), 209-234, 1997) in a sample of 57 adolescents residing in a Dutch juvenile justice center, aged between 13 and 22 years. The mCPS total score was reliably related to high externalizing problems, low empathy, high anger and aggression, high impulsivity, high (violent) delinquency, and high alcohol/drug use. Unique relations were found for the antisocial-impulsive (mCPS Factor 2), but not the callous-unemotional facet of psychopathy (mCPS Factor 1). Our findings support the validity of the mCPS in that it encompasses the antisocial-impulsive facet of psychopathy, but it is less clear whether the mCPS sufficiently captures the affective-interpersonal facet of psychopathy.

Optimization and Validation of ELISA for Pre-Clinical Trials of Influenza Vaccine.

PubMed

Mitic, K; Muhandes, L; Minic, R; Petrusic, V; Zivkovic, I

2016-01-01

Testing of every new vaccine involves investigation of its immunogenicity, which is based on monitoring its ability to induce specific antibodies in animals. The fastest and most sensitive method used for this purpose is enzyme-linked immunosorbent assay (ELISA). However, commercial ELISA kits with whole influenza virus antigens are not available on the market, and it is therefore essential to establish an adequate assay for testing influenza virusspecific antibodies. We developed ELISA with whole influenza virus strains for the season 2011/2012 as antigens and validated it by checking its specificity, accuracy, linearity, range, precision, and sensitivity. The results show that we developed high-quality ELISA that can be used to test immunogenicity of newly produced seasonal or pandemic vaccines in mice. The pre-existence of validated ELISA enables shortening the time from the process of vaccine production to its use in patients, which is particularly important in the case of a pandemic.

Validation of the CoRE Questionnaire for a Medical Journal Peer Review.

PubMed

Doi, Suhail A R; Salzman-Scott, Sherry A; Onitilo, Adedayo A

2016-01-01

If a peer review instrument asks concrete questions (defined as items that can only generate disagreement if reviewers have different degrees of expertise), then questionnaires could become more meaningful in terms of resolving subjectivity thus leading to more reviewer agreement. A concrete item questionnaire with well-chosen questions can also help resolve disagreement when reviewers have the same level of expertise. We have recently created the core-item reviewer evaluation (CoRE) questionnaire for which decision-threshold score levels have been created, but which have not been validated. This prospective validation of these thresholds for the CoRE questionnaire demonstrated strong agreement between reviewer recommendations and their reported score levels when tested prospectively at Clinical Medicine and Research. We conclude that using the CoRE questionnaire will help reduce peer reviewer disagreement. More importantly, when reviewer expertise varies, editors can more easily detect this and decide which opinion reflects the greater expertise.

Annual Research Review: Threats to the validity of child psychiatry and psychology.

PubMed

Rutter, Michael; Pickles, Andrew

2016-03-01

Suggestions have been made that many claims concern false-positive findings in the field of child psychology and psychiatry. The literature was searched for concepts and findings on the validity of child psychiatry and psychology. Substantial progress has been made in some, but not all, areas and considerable challenges remain in all. The two major threats to validity concern the inability to examine brain tissues in life and the evidence that there is a high overlap among disorders. We emphasize the need to follow published guidelines on preplanned analyses and we note the dangers associated with unregulated flexibility in data analysis. We note the very important clinical and developmental findings that have been ignored, perhaps partly because of an excessive focus on technologies. Nevertheless, we are positive about both the accomplishments and the ways in which challenges are being met. © 2015 Association for Child and Adolescent Mental Health.

The expert explorer: a tool for hospital data visualization and adverse drug event rules validation.

PubMed

Băceanu, Adrian; Atasiei, Ionuţ; Chazard, Emmanuel; Leroy, Nicolas

2009-01-01

An important part of adverse drug events (ADEs) detection is the validation of the clinical cases and the assessment of the decision rules to detect ADEs. For that purpose, a software called "Expert Explorer" has been designed by Ideea Advertising. Anonymized datasets have been extracted from hospitals into a common repository. The tool has 3 main features. (1) It can display hospital stays in a visual and comprehensive way (diagnoses, drugs, lab results, etc.) using tables and pretty charts. (2) It allows designing and executing dashboards in order to generate knowledge about ADEs. (3) It finally allows uploading decision rules obtained from data mining. Experts can then review the rules, the hospital stays that match the rules, and finally give their advice thanks to specialized forms. Then the rules can be validated, invalidated, or improved (knowledge elicitation phase).

Research Driven Policy: Is Financial Capacity Related to Dangerousness?

PubMed

DeLeon, Patrick H; Paxton, Maegan M; Spencer, Tonya; Bajjani-Gebara, Jouhayna E

2018-05-22

Current Veterans administration policy directly links a Veteran's adjudged capacity to manage personal financial resources with their ability to purchase or possess a firearm, pursuant to the regulatory authority of the National Instant Criminal Background Check System (NICS). Preventing Veterans' suicide is a highly laudable public health objective. Effectively utilizing scientific research to "inform" public policy is equally important. The authors should be congratulated for their efforts. However, it is important in utilizing large set population-based data, especially social science data, to evaluate policy alternatives that there be substantial face (i.e., clinical) validity. Correlation does not necessarily represent causation.

Evidence for the Criterion Validity and Clinical Utility of the Pathological Narcissism Inventory

ERIC Educational Resources Information Center

Thomas, Katherine M.; Wright, Aidan G. C.; Lukowitsky, Mark R.; Donnellan, M. Brent; Hopwood, Christopher J.

2012-01-01

In this study, the authors evaluated aspects of criterion validity and clinical utility of the grandiosity and vulnerability components of the Pathological Narcissism Inventory (PNI) using two undergraduate samples (N = 299 and 500). Criterion validity was assessed by evaluating the correlations of narcissistic grandiosity and narcissistic…

Decision analysis. Clinical art or Clinical Science

DTIC Science & Technology

1977-05-01

having helped some clients. Over the past half century, psychotherapy has faced a series of crises concerned with its transformation from an art to a...clinical science . These include validation of the effectiveness of various forms of therapy, validating elements of treatment programs and

The use of laboratory tests in the diagnosis of SLE.

PubMed

Egner, W

2000-06-01

ANA IIF is an effective screening assay in patients with clinical features of SLE and will detect most anti-ssDNA, anti-dsDNA, ENAs, and other autoantibodies. False positives are common. The clinical importance cannot be extrapolated from the ANA titre or pattern, although higher titres (> 1/160) are more likely to be important. HEp-2 cells are the most sensitive substrate for ANA detection, but this must be balanced against an increased incidence of insignificant positivity. ANA positive samples should be subjected to more specific assays for the diagnosis of SLE. A combination of ENA (Ro/La/Sm/RNP) and dsDNA assays will detect most patients with SLE as long as the characteristics of the assays used are well understood. ESR and CRP measurements provide useful additional information. Sjogren's syndrome and MCTD will produce overlapping serology with SLE, and anti-dsDNA titres are sometimes seen in autoimmune hepatitis and rheumatoid arthritis. All results should be reported in the light of the clinical details, by an experienced immunologist. A suggested diagnostic protocol is outlined in fig 1. The type of assay used crucially influences the predictive value of the tests. ELISA technology dominates routine laboratory practice, but tends to produce more false positive and true weak positive results, which may reduce the PPV of the test. This can be minimised by using IgG specific conjugates and careful assay validation. The NPV for SLE [figure: see text] is high for most assays but the PPV varies. Where necessary, laboratories should use crithidia or Farr dsDNA assays to confirm dubious ELISA dsDNA results, and ID/IB to confirm dubious ENA results. For monitoring, a precise, quantitative assay is required. It is unclear whether the detection of IgM or low affinity antibodies has a role here. A combination of anti-dsDNA, C3, C4, CRP, and ESR assays provides the most useful clinical information. Anti-ssDNA assays are likely to be useful, and are potentially more robust than anti-dsDNA assays, but require more validation. Local validation of individual assays and EQA participation is essential. Not all assays that apparently measure the same antibody specificities have equal clinical relevance, even within a single technology. Insufficient international or national reference preparations are currently available for many antibody specificities to enable effective standardisation. Quality assurance schemes reveal large differences in units reported by different assays for some analytes, even when calibrated against an IRP or equivalent reference preparation. Serial results can therefore only be compared from the same laboratory at present. Most autoantibodies increase during active disease, but few prospective data are currently available to justify treatment on the basis of rising titres. Further randomised prospective studies are required to examine the importance of antibody isotype and affinity in the monitoring of SLE by individual assay methods. The most important aspect of the appropriate use of laboratory assays is to become familiar with the limitations of the technology currently in use in your local laboratory, and to consult with your clinical immunologist in cases of doubt, preferably before commencing serological screening.

A prospective observational study to assess the diagnostic accuracy of clinical decision rules for children presenting to emergency departments after head injuries (protocol): the Australasian Paediatric Head Injury Rules Study (APHIRST).

PubMed

Babl, Franz E; Lyttle, Mark D; Bressan, Silvia; Borland, Meredith; Phillips, Natalie; Kochar, Amit; Dalziel, Stuart R; Dalton, Sarah; Cheek, John A; Furyk, Jeremy; Gilhotra, Yuri; Neutze, Jocelyn; Ward, Brenton; Donath, Susan; Jachno, Kim; Crowe, Louise; Williams, Amanda; Oakley, Ed

2014-06-13

Head injuries in children are responsible for a large number of emergency department visits. Failure to identify a clinically significant intracranial injury in a timely fashion may result in long term neurodisability and death. Whilst cranial computed tomography (CT) provides rapid and definitive identification of intracranial injuries, it is resource intensive and associated with radiation induced cancer. Evidence based head injury clinical decision rules have been derived to aid physicians in identifying patients at risk of having a clinically significant intracranial injury. Three rules have been identified as being of high quality and accuracy: the Canadian Assessment of Tomography for Childhood Head Injury (CATCH) from Canada, the Children's Head Injury Algorithm for the Prediction of Important Clinical Events (CHALICE) from the UK, and the prediction rule for the identification of children at very low risk of clinically important traumatic brain injury developed by the Pediatric Emergency Care Applied Research Network (PECARN) from the USA. This study aims to prospectively validate and compare the performance accuracy of these three clinical decision rules when applied outside the derivation setting. This study is a prospective observational study of children aged 0 to less than 18 years presenting to 10 emergency departments within the Paediatric Research in Emergency Departments International Collaborative (PREDICT) research network in Australia and New Zealand after head injuries of any severity. Predictor variables identified in CATCH, CHALICE and PECARN clinical decision rules will be collected. Patients will be managed as per the treating clinicians at the participating hospitals. All patients not undergoing cranial CT will receive a follow up call 14 to 90 days after the injury. Outcome data collected will include results of cranial CTs (if performed) and details of admission, intubation, neurosurgery and death. The performance accuracy of each of the rules will be assessed using rule specific outcomes and inclusion and exclusion criteria. This study will allow the simultaneous comparative application and validation of three major paediatric head injury clinical decision rules outside their derivation setting. The study is registered with the Australian New Zealand Clinical Trials Registry (ANZCTR)- ACTRN12614000463673 (registered 2 May 2014).

Behavioral Indicators on a Mobile Sensing Platform Predict Clinically Validated Psychiatric Symptoms of Mood and Anxiety Disorders

PubMed Central

Place, Skyler; Rubin, Channah; Gorrostieta, Cristina; Mead, Caroline; Kane, John; Marx, Brian P; Feast, Joshua; Deckersbach, Thilo; Pentland, Alex “Sandy”; Nierenberg, Andrew; Azarbayejani, Ali

2017-01-01

Background There is a critical need for real-time tracking of behavioral indicators of mental disorders. Mobile sensing platforms that objectively and noninvasively collect, store, and analyze behavioral indicators have not yet been clinically validated or scalable. Objective The aim of our study was to report on models of clinical symptoms for post-traumatic stress disorder (PTSD) and depression derived from a scalable mobile sensing platform. Methods A total of 73 participants (67% [49/73] male, 48% [35/73] non-Hispanic white, 33% [24/73] veteran status) who reported at least one symptom of PTSD or depression completed a 12-week field trial. Behavioral indicators were collected through the noninvasive mobile sensing platform on participants’ mobile phones. Clinical symptoms were measured through validated clinical interviews with a licensed clinical social worker. A combination hypothesis and data-driven approach was used to derive key features for modeling symptoms, including the sum of outgoing calls, count of unique numbers texted, absolute distance traveled, dynamic variation of the voice, speaking rate, and voice quality. Participants also reported ease of use and data sharing concerns. Results Behavioral indicators predicted clinically assessed symptoms of depression and PTSD (cross-validated area under the curve [AUC] for depressed mood=.74, fatigue=.56, interest in activities=.75, and social connectedness=.83). Participants reported comfort sharing individual data with physicians (Mean 3.08, SD 1.22), mental health providers (Mean 3.25, SD 1.39), and medical researchers (Mean 3.03, SD 1.36). Conclusions Behavioral indicators passively collected through a mobile sensing platform predicted symptoms of depression and PTSD. The use of mobile sensing platforms can provide clinically validated behavioral indicators in real time; however, further validation of these models and this platform in large clinical samples is needed. PMID:28302595

Clinimetrics and clinical psychometrics: macro- and micro-analysis.

PubMed

Tomba, Elena; Bech, Per

2012-01-01

Clinimetrics was introduced three decades ago to specify the domain of clinical markers in clinical medicine (indexes or rating scales). In this perspective, clinical validity is the platform for selecting the various indexes or rating scales (macro-analysis). Psychometric validation of these indexes or rating scales is the measuring aspect (micro-analysis). Clinical judgment analysis by experienced psychiatrists is included in the macro-analysis and the item response theory models are especially preferred in the micro-analysis when using the total score as a sufficient statistic. Clinical assessment tools covering severity of illness scales, prognostic measures, issues of co-morbidity, longitudinal assessments, recovery, stressors, lifestyle, psychological well-being, and illness behavior have been identified. The constructive dialogue in clinimetrics between clinical judgment and psychometric validation procedures is outlined for generating developments of clinical practice in psychiatry. Copyright © 2012 S. Karger AG, Basel.

Validity and clinical utility of the DSM-5 severity specifier for bulimia nervosa: results from a multisite sample of patients who received evidence-based treatment.

PubMed

Dakanalis, Antonios; Bartoli, Francesco; Caslini, Manuela; Crocamo, Cristina; Zanetti, Maria Assunta; Riva, Giuseppe; Clerici, Massimo; Carrà, Giuseppe

2017-12-01

A new "severity specifier" for bulimia nervosa (BN), based on the frequency of inappropriate weight compensatory behaviours (IWCBs), was added to the DSM-5 as a means of documenting heterogeneity and variability in the severity of the disorder. Yet, evidence for its validity in clinical populations, including prognostic significance for treatment outcome, is currently lacking. Existing data from 281 treatment-seeking patients with DSM-5 BN, who received the best available treatment for their disorder (manual-based cognitive behavioural therapy; CBT) in an outpatient setting, were re-analysed to examine whether these patients subgrouped based on the DSM-5 severity levels would show meaningful and consistent differences on (a) a range of clinical variables assessed at pre-treatment and (b) post-treatment abstinence from IWCBs. Results highlight that the mild, moderate, severe, and extreme severity groups were statistically distinguishable on 22 variables assessed at pre-treatment regarding eating disorder pathological features, maintenance factors of BN, associated (current) and lifetime psychopathology, social maladjustment and illness-specific functional impairment, and abstinence outcome. Mood intolerance, a maintenance factor of BN but external to eating disorder pathological features (typically addressed within CBT), emerged as the primary clinical variable distinguishing the severity groups showing a differential treatment response. Overall, the findings speak to the concurrent and predictive validity of the new DSM-5 severity criterion for BN and are important because a common benchmark informing patients, clinicians, and researchers about severity of the disorder and allowing severity fluctuation and patient's progress to be tracked does not exist so far. Implications for future research are outlined.

Specific entrustable professional activities for undergraduate medical internships: a method compatible with the academic curriculum.

PubMed

Hamui-Sutton, Alicia; Monterrosas-Rojas, Ana María; Ortiz-Montalvo, Armando; Flores-Morones, Felipe; Torruco-García, Uri; Navarrete-Martínez, Andrea; Arrioja-Guerrero, Araceli

2017-08-25

Competency-based education has been considered the most important pedagogical trend in Medicine in the last two decades. In clinical contexts, competencies are implemented through Entrustable Professional Activities (EPAs) which are observable and measurable. The aim of this paper is to describe the methodology used in the design of educational tools to assess students´ competencies in clinical practice during their undergraduate internship (UI). In this paper, we present the construction of specific APROCs (Actividades Profesionales Confiables) in Surgery (S), Gynecology and Obstetrics (GO) and Family Medicine (FM) rotations with three levels of performance. The study considered a mixed method exploratory type design, a qualitative phase followed by a quantitative validation exercise. In the first stage data was obtained from three rotations (FM, GO and S) through focus groups about real and expected activities of medical interns. Triangulation with other sources was made to construct benchmarks. In the second stage, narrative descriptions with the three levels were validated by professors who teach the different subjects using the Delphi technique. The results may be described both curricular and methodological wise. From the curricular point of view, APROCs were identified in three UI rotations within clinical contexts in Mexico City, benchmarks were developed by levels and validated by experts' consensus. In regard to methodological issues, this research contributed to the development of a strategy, following six steps, to build APROCs using mixed methods. Developing benchmarks provides a regular and standardized language that helps to evaluate student's performance and define educational strategies efficiently and accurately. The university academic program was aligned with APROCs in clinical contexts to assure the acquisition of competencies by students.

Evaluating Validity Evidence for USMLE Step 2 Clinical Skills Data Gathering and Data Interpretation Scores: Does Performance Predict History-Taking and Physical Examination Ratings for First-Year Internal Medicine Residents?

PubMed

Cuddy, Monica M; Winward, Marcia L; Johnston, Mary M; Lipner, Rebecca S; Clauser, Brian E

2016-01-01

To add to the small body of validity research addressing whether scores from performance assessments of clinical skills are related to performance in supervised patient settings, the authors examined relationships between United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) data gathering and data interpretation scores and subsequent performance in history taking and physical examination in internal medicine residency training. The sample included 6,306 examinees from 238 internal medicine residency programs who completed Step 2 CS for the first time in 2005 and whose performance ratings from their first year of residency training were available. Hierarchical linear modeling techniques were used to examine the relationships among Step 2 CS data gathering and data interpretation scores and history-taking and physical examination ratings. Step 2 CS data interpretation scores were positively related to both history-taking and physical examination ratings. Step 2 CS data gathering scores were not related to either history-taking or physical examination ratings after other USMLE scores were taken into account. Step 2 CS data interpretation scores provide useful information for predicting subsequent performance in history taking and physical examination in supervised practice and thus provide validity evidence for their intended use as an indication of readiness to enter supervised practice. The results show that there is less evidence to support the usefulness of Step 2 CS data gathering scores. This study provides important information for practitioners interested in Step 2 CS specifically or in performance assessments of medical students' clinical skills more generally.

Validation of the partner version of the multidimensional vaginal penetration disorder questionnaire: A tool for clinical assessment of lifelong vaginismus in a sample of Iranian population.

PubMed

Molaeinezhad, Mitra; Khoei, Effat Merghati; Salehi, Mehrdad; Yousfy, Alireza; Roudsari, Robab Latifnejad

2014-01-01

The role of spousal response in woman's experience of pain during the vaginal penetration attempts believed to be an important factor; however, studies are rather limited in this area. The aim of this study was to develop and investigate the psychometric indexes of the partner version of a multidimensional vaginal penetration disorder questionnaire (PV-MVPDQ); hence, the clinical assessment of spousal psychosexual reactions to vaginismus by specialists will be easier. A mixed-methods sequential exploratory design was used, through that, the findings from a thematic qualitative research with 20 unconsummated couples, which followed by an extensive literature review used for development of PV-MVPDQ. A consecutive sample of 214 men who their wives' suffered from lifelong vaginismus (LLV) based on Diagnostic and Statistical Manual of Mental Disorders 4(th) version (DSM)-IVTR criteria during a cross-sectional design, completed the questionnaire and additional questions regarding their demographic and sexual history. Validation measures and reliability were conducted by exploratory factor analysis (EFA) and Cronbach's alpha coefficient through SPSS version 16 manufactured by SPSS Inc. (IBM corporation, Armonk, USA). After conducting EFA PV-MVPDQ emerged as having 40 items and 7 dimensions: Helplessness, sexual information, vicious cycle of penetration, hypervigilance and solicitous, catastrophic cognitions, sexual and marital adjustment and optimism. Subscales of PV-MVPDQ showed a significant reliability (0.71-0.85) and results of test-retest were satisfactory. The present study shows PV-MVPDQ is a multi-dimensional valid and reliable self-report questionnaire for assessment of cognitions, sexual and marital relations related to vaginal penetrations in spouses of women with LLV. It may assist specialists to base on which clinical judgment and appropriate planning for clinical management.

Assessing the clinical utility of combined movement examination in symptomatic degenerative lumbar spondylosis.

PubMed

Monie, A P; Price, R I; Lind, C R P; Singer, K P

2015-07-01

The aim of this study is to report the development and validation of a low back computer-aided combined movement examination protocol in normal individuals and record treatment outcomes of cases with symptomatic degenerative lumbar spondylosis. Test-retest, following intervention. Self-report assessments and combined movement examination were used to record composite spinal motion, before and following neurosurgical and pain medicine interventions. 151 normal individuals aged from 20 years to 69 years were assessed using combined movement examination between L1 and S1 spinal levels to establish a reference range. Cases with degenerative low back pain and sciatica were assessed before and after therapeutic interventions with combined movement examination and a battery of self-report pain and disability questionnaires. Change scores for combined movement examination and all outcome measures were derived. Computer-aided combined movement examination validation and intraclass correlation coefficient with 95% confidence interval and least significant change scores indicated acceptable reliability of combined movement examination when recording lumbar movement in normal subjects. In both clinical cases lumbar spine movement restrictions corresponded with self-report scores for pain and disability. Post-intervention outcomes all showed significant improvement, particularly in the most restricted combined movement examination direction. This study provides normative reference data for combined movement examination that may inform future clinical studies of the technique as a convenient objective surrogate for important clinical outcomes in lumbar degenerative spondylosis. It can be used with good reliability, may be well tolerated by individuals in pain and appears to change in concert with validated measures of lumbar spinal pain, functional limitation and quality of life. Copyright © 2015 Elsevier Ltd. All rights reserved.