The Johns Hopkins Fall Risk Assessment Tool: A Study of Reliability and Validity.

PubMed

Poe, Stephanie S; Dawson, Patricia B; Cvach, Maria; Burnett, Margaret; Kumble, Sowmya; Lewis, Maureen; Thompson, Carol B; Hill, Elizabeth E

Patient falls and fall-related injury remain a safety concern. The Johns Hopkins Fall Risk Assessment Tool (JHFRAT) was developed to facilitate early detection of risk for anticipated physiologic falls in adult inpatients. Psychometric properties in acute care settings have not yet been fully established; this study sought to fill that gap. Results indicate that the JHFRAT is reliable, with high sensitivity and negative predictive validity. Specificity and positive predictive validity were lower than expected.

The Validity and Utility of the California Family Risk Assessment under Practice Conditions in the Field: A Prospective Study

ERIC Educational Resources Information Center

Johnson, Will L.

2011-01-01

Objective: Analysis of the validity and implementation of a child maltreatment actuarial risk assessment model, the California Family Risk Assessment (CFRA). Questions addressed: (1) Is there evidence of the validity of the CFRA under field operating conditions? (2) Do actuarial risk assessment results influence child welfare workers' service…

Improving the Validity of Activity of Daily Living Dependency Risk Assessment

PubMed Central

Clark, Daniel O.; Stump, Timothy E.; Tu, Wanzhu; Miller, Douglas K.

2015-01-01

Objectives Efforts to prevent activity of daily living (ADL) dependency may be improved through models that assess older adults’ dependency risk. We evaluated whether cognition and gait speed measures improve the predictive validity of interview-based models. Method Participants were 8,095 self-respondents in the 2006 Health and Retirement Survey who were aged 65 years or over and independent in five ADLs. Incident ADL dependency was determined from the 2008 interview. Models were developed using random 2/3rd cohorts and validated in the remaining 1/3rd. Results Compared to a c-statistic of 0.79 in the best interview model, the model including cognitive measures had c-statistics of 0.82 and 0.80 while the best fitting gait speed model had c-statistics of 0.83 and 0.79 in the development and validation cohorts, respectively. Conclusion Two relatively brief models, one that requires an in-person assessment and one that does not, had excellent validity for predicting incident ADL dependency but did not significantly improve the predictive validity of the best fitting interview-based models. PMID:24652867

Validation of an early childhood caries risk assessment tool in a low-income Hispanic population.

PubMed

Custodio-Lumsden, Christie L; Wolf, Randi L; Contento, Isobel R; Basch, Charles E; Zybert, Patricia A; Koch, Pamela A; Edelstein, Burton L

2016-03-01

There is a recognized need for valid risk assessment tools for use by both dental and nondental personnel to identify young children at risk for, or with, precavitated stages of early childhood caries (i.e., early stage decalcifications or white spot lesions).The aim of this study is to establish concurrent criterion validity of "MySmileBuddy" (MSB), a novel technology-assisted ECC risk assessment and behavioral intervention tool against four measures of ECC activity: semi-quantitative assays of salivary mutans streptococci levels, visible quantity of dental plaque, visual evidence of enamel decalcifications, and cavitation status (none, ECC, severe ECC). One hundred eight children 2-6 years of age presenting to a pediatric dental clinic were recruited from a predominantly Spanish-speaking, low-income, urban population. All children received a comprehensive oral examination and saliva culture for assessment of ECC indicators. Their caregivers completed the iPad-based MSB assessment in its entirety (15-20 minutes). MSB calculated both diet and comprehensive ECC risk scores. Associations between all variables were determined using ordinal logistic regression. MSB diet risk scores were significantly positively associated with salivary mutans (P < 0.05), and approached significance with visible plaque levels (P < 0.1). MSB comprehensive risk scores were significantly associated with both oral mutans and visible plaque (P < 0.05). Neither was associated with visually evident decalcifications or cavitations. Findings suggest that MSB may have clinical utility as a valid risk assessment tool for identifying children with early precursors of cavitations but does not add value in identifying children with extant lesions. © 2015 American Association of Public Health Dentistry.

Further validation of the Internet-based Dementia Risk Assessment.

PubMed

Brandt, Jason; Blehar, Justin; Anderson, Allan; Gross, Alden L

2014-01-01

Most approaches to the detection of presymptomatic or prodromal Alzheimer's disease require the costly collection and analysis of biological samples or neuroimaging measurements. The Dementia Risk Assessment (DRA) was developed to facilitate this detection by collecting self-report and proxy-report of dementia risk variables and episodic memory performance on a free Internet website. We now report two validation studies. In Study 1, 130 community-residing older adults seeking memory screening at senior health fairs were tested using the Mini-Cog, and were then observed while taking the DRA. They were compared to a demographically-matched subsample from our anonymous Internet sample. Participants seeking memory screening had more dementia risk factors and obtained lower scores on the DRA's recognition memory test (RMT) than their Internet controls. In addition, those who failed the Mini-Cog obtained much lower scores on the RMT than those who passed the Mini-Cog. In Study 2, 160 older adults seeking evaluation of cognitive difficulties took the DRA prior to diagnostic evaluations at outpatient dementia clinics. Patients who ultimately received the diagnosis of a dementia syndrome scored significantly lower on the RMT than those diagnosed with other conditions or deemed normal. Lower education, family history of dementia, presence of hypercholesterolemia and diabetes, and memory test score distinguished the dementia and no-dementia groups with around 82% accuracy. In addition, score on the RMT correlated highly with scores on other instruments widely used to detect cognitive decline. These findings support the concurrent validity of the DRA for detecting prevalent cognitive impairment. Prospective studies of cognitively normal persons who subsequently develop dementia will be necessary to establish its predictive validity.

Cross-cultural adaptation and validation of the neonatal/infant Braden Q risk assessment scale.

PubMed

de Lima, Edson Luiz; de Brito, Maria José Azevedo; de Souza, Diba Maria Sebba Tosta; Salomé, Geraldo Magela; Ferreira, Lydia Masako

2016-02-01

To translate into Brazilian Portuguese and cross-culturally adapt the Neonatal/Infant Braden Q Risk Assessment Scale (Neonatal/Infant Braden Q Scale), and test the psychometric properties, reproducibility and validity of the instrument. There is a lack of studies on the development of pressure ulcers in children, especially in neonates. Thirty professionals participated in the cross-cultural adaptation of the Brazilian-Portuguese version of the scale. Fifty neonates of both sexes were assessed between July 2013 and June 2014. Reliability and reproducibility were tested in 20 neonates and construct validity was measured by correlating the Neonatal/Infant Braden Q Scale with the Braden Q Risk Assessment Scale (Braden Q Scale). Discriminant validity was assessed by comparing the scores of neonates with and without ulcers. The scale showed inter-rater reliability (ICC = 0.98; P < 0.001) and intra-rater reliability (ICC = 0.79; P < 0.001). A strong correlation was found between the Neonatal/Infant Braden Q Scale and Braden Q Scale (r = 0.96; P < 0.001). The cross-culturally adapted Brazilian version of the Neonatal/Infant Braden Q Scale is a reliable instrument, showing face, content and construct validity. Copyright © 2015 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

Optimizing prevention of hospital-acquired venous thromboembolism (VTE): prospective validation of a VTE risk assessment model.

PubMed

Maynard, Gregory A; Morris, Timothy A; Jenkins, Ian H; Stone, Sarah; Lee, Joshua; Renvall, Marian; Fink, Ed; Schoenhaus, Robert

2010-01-01

Hospital-acquired (HA) venous thromboembolism (VTE) is a common source of morbidity/mortality. Prophylactic measures are underutilized. Available risk assessment models/protocols are not prospectively validated. Improve VTE prophylaxis, reduce HA VTE, and prospectively validate a VTE risk-assessment model. Observational design. Academic medical center. Adult inpatients on medical/surgical services. A simple VTE risk assessment linked to a menu of preferred VTE prophylaxis methods, embedded in order sets. Education, audit/feedback, and concurrent identification of nonadherence. Randomly sampled inpatient audits determined the percent of patients with "adequate" VTE prevention. HA VTE cases were identified concurrently via digital imaging system. Interobserver agreement for VTE risk level and judgment of adequate prophylaxis were calculated from 150 random audits. Interobserver agreement with 5 observers was high (kappa score for VTE risk level = 0.81, and for judgment of "adequate" prophylaxis = 0.90). The percent of patients on adequate prophylaxis improved each of the 3 years (58%, 78%, and 93%; P < 0.001) and reached 98% in the last 6 months of 2007; 361 cases of HA VTE occurred over 3 years. Significant reductions for the risk of HA VTE (risk ratio [RR] = 0.69; 95% confidence interval [CI] = 0.47-0.79) and preventable HA VTE (RR = 0.14; 95% CI = 0.06-0.31) occurred. We detected no increase in heparin-induced thrombocytopenia (HIT) or prophylaxis-related bleeding using administrative data/chart review. We prospectively validated a VTE risk-assessment/prevention protocol by demonstrating ease of use, good interobserver agreement, and effectiveness. Improved VTE prophylaxis resulted in a substantial reduction in HA VTE. (c) 2010 Society of Hospital Medicine.

Validation of a Delirium Risk Assessment Using Electronic Medical Record Information.

PubMed

Rudolph, James L; Doherty, Kelly; Kelly, Brittany; Driver, Jane A; Archambault, Elizabeth

2016-03-01

Identifying patients at risk for delirium allows prompt application of prevention, diagnostic, and treatment strategies; but is rarely done. Once delirium develops, patients are more likely to need posthospitalization skilled care. This study developed an a priori electronic prediction rule using independent risk factors identified in a National Center of Clinical Excellence meta-analysis and validated the ability to predict delirium in 2 cohorts. Retrospective analysis followed by prospective validation. Tertiary VA Hospital in New England. A total of 27,625 medical records of hospitalized patients and 246 prospectively enrolled patients admitted to the hospital. The electronic delirium risk prediction rule was created using data obtained from the patient electronic medical record (EMR). The primary outcome, delirium, was identified 2 ways: (1) from the EMR (retrospective cohort) and (2) clinical assessment on enrollment and daily thereafter (prospective participants). We assessed discrimination of the delirium prediction rule with the C-statistic. Secondary outcomes were length of stay and discharge to rehabilitation. Retrospectively, delirium was identified in 8% of medical records (n = 2343); prospectively, delirium during hospitalization was present in 26% of participants (n = 64). In the retrospective cohort, medical record delirium was identified in 2%, 3%, 11%, and 38% of the low, intermediate, high, and very high-risk groups, respectively (C-statistic = 0.81; 95% confidence interval 0.80-0.82). Prospectively, the electronic prediction rule identified delirium in 15%, 18%, 31%, and 55% of these groups (C-statistic = 0.69; 95% confidence interval 0.61-0.77). Compared with low-risk patients, those at high- or very high delirium risk had increased length of stay (5.7 ± 5.6 vs 3.7 ± 2.7 days; P = .001) and higher rates of discharge to rehabilitation (8.9% vs 20.8%; P = .02). Automatic calculation of delirium risk using an EMR algorithm identifies patients at

Different type 2 diabetes risk assessments predict dissimilar numbers at 'high risk': a retrospective analysis of diabetes risk-assessment tools.

PubMed

Gray, Benjamin J; Bracken, Richard M; Turner, Daniel; Morgan, Kerry; Thomas, Michael; Williams, Sally P; Williams, Meurig; Rice, Sam; Stephens, Jeffrey W

2015-12-01

Use of a validated risk-assessment tool to identify individuals at high risk of developing type 2 diabetes is currently recommended. It is under-reported, however, whether a different risk tool alters the predicted risk of an individual. This study explored any differences between commonly used validated risk-assessment tools for type 2 diabetes. Cross-sectional analysis of individuals who participated in a workplace-based risk assessment in Carmarthenshire, South Wales. Retrospective analysis of 676 individuals (389 females and 287 males) who participated in a workplace-based diabetes risk-assessment initiative. Ten-year risk of type 2 diabetes was predicted using the validated QDiabetes(®), Leicester Risk Assessment (LRA), FINDRISC, and Cambridge Risk Score (CRS) algorithms. Differences between the risk-assessment tools were apparent following retrospective analysis of individuals. CRS categorised the highest proportion (13.6%) of individuals at 'high risk' followed by FINDRISC (6.6%), QDiabetes (6.1%), and, finally, the LRA was the most conservative risk tool (3.1%). Following further analysis by sex, over one-quarter of males were categorised at high risk using CRS (25.4%), whereas a greater percentage of females were categorised as high risk using FINDRISC (7.8%). The adoption of a different valid risk-assessment tool can alter the predicted risk of an individual and caution should be used to identify those individuals who really are at high risk of type 2 diabetes. © British Journal of General Practice 2015.

Assessing Risk for Sexual Offenders in New Zealand: Development and Validation of a Computer-Scored Risk Measure

ERIC Educational Resources Information Center

Skelton, Alexander; Riley, David; Wales, David; Vess, James

2006-01-01

A growing research base supports the predictive validity of actuarial methods of risk assessment with sexual offenders. These methods use clearly defined variables with demonstrated empirical association with re-offending. The advantages of actuarial measures for screening large numbers of offenders quickly and economically are further enhanced…

Predictive validity of the structured assessment of violence risk in youth: A 4-year follow-up.

PubMed

Gammelgård, Monica; Koivisto, Anna-Maija; Eronen, Markku; Kaltiala-Heino, Riittakerttu

2015-07-01

Structured violence risk assessment is an essential part of treatment planning for violent young people. The Structured Assessment of Violence Risk in Youth (SAVRY) has been shown to have good reliability and validity in a range of settings but has hardly been studied in adolescent mental health services. This study aimed to evaluate the long-term predictive validity of the SAVRY in adolescent psychiatry settings. In a prospective study, 200 SAVRY assessments of adolescents were acquired from psychiatric, forensic and correctional settings. Re-offending records from the Finnish National Crime Register were collected. Receiver operating curve statistics were applied. High SAVRY total and individual subscale scores and low values on the protective factor subscale were significantly associated with subsequent adverse outcomes, but the predictive value of the total score was weak. At the risk item level, those indicating antisocial lifestyle, absence of social support and pro-social involvement were strong indicators of subsequent criminal convictions, with or without violence. The SAVRY summary risk rating was the best indicator of likelihood of being convicted of a violent crime. After allowing for sex, age, psychiatric diagnosis and treatment setting, for example, conviction for a violent crime was over nine times more likely among those young people given high SAVRY summary risk ratings. The SAVRY is a valid and useful method for assessing both short-term and long-term risks of violent and non-violent crime by young people in psychiatric as well as criminal justice settings, adding to a traditional risk-centred assessment approach by also indicating where future preventive treatment efforts should be targeted. The next steps should be to evaluate its role in everyday clinical practice when using the knowledge generated to inform and monitor management and treatment strategies. Copyright © 2014 John Wiley & Sons, Ltd.

Measurement of predictive validity in violence risk assessment studies: a second-order systematic review.

PubMed

Singh, Jay P; Desmarais, Sarah L; Van Dorn, Richard A

2013-01-01

The objective of the present review was to examine how predictive validity is analyzed and reported in studies of instruments used to assess violence risk. We reviewed 47 predictive validity studies published between 1990 and 2011 of 25 instruments that were included in two recent systematic reviews. Although all studies reported receiver operating characteristic curve analyses and the area under the curve (AUC) performance indicator, this methodology was defined inconsistently and findings often were misinterpreted. In addition, there was between-study variation in benchmarks used to determine whether AUCs were small, moderate, or large in magnitude. Though virtually all of the included instruments were designed to produce categorical estimates of risk - through the use of either actuarial risk bins or structured professional judgments - only a minority of studies calculated performance indicators for these categorical estimates. In addition to AUCs, other performance indicators, such as correlation coefficients, were reported in 60% of studies, but were infrequently defined or interpreted. An investigation of sources of heterogeneity did not reveal significant variation in reporting practices as a function of risk assessment approach (actuarial vs. structured professional judgment), study authorship, geographic location, type of journal (general vs. specialized audience), sample size, or year of publication. Findings suggest a need for standardization of predictive validity reporting to improve comparison across studies and instruments. Copyright © 2013 John Wiley & Sons, Ltd.

Validation of Fall Risk Assessment Specific to the Inpatient Rehabilitation Facility Setting.

PubMed

Thomas, Dan; Pavic, Andrea; Bisaccia, Erin; Grotts, Jonathan

2016-09-01

To evaluate and compare the Morse Fall Scale (MFS) and the Casa Colina Fall Risk Assessment Scale (CCFRA) for identification of patients at risk for falling in an acute inpatient rehabilitation facility. The primary objective of this study was to perform a retrospective validation study of the CCFRAS, specifically for use in the inpatient rehabilitation facility (IRF) setting. Retrospective validation study. The study was approved under expedited review by the local Institutional Review Board. Data were collected on all patients admitted to Cottage Rehabiliation Hospital (CRH), a 38-bed acute inpatient rehabilitation hospital, from March 2012 to August 2013. Patients were excluded from the study if they had a length of stay less than 3 days or age less than 18. The area under the receiver operating characteristic curve (AUC) and the diagnostic odds ratio were used to examine the differences between the MFS and CCFRAS. AUC between fall scales was compared using the DeLong Test. There were 931 patients included in the study with 62 (6.7%) patient falls. The average age of the population was 68.8 with 503 males (51.2%). The AUC was 0.595 and 0.713 for the MFS and CCFRAS, respectively (0.006). The diagnostic odds ratio of the MFS was 2.0 and 3.6 for the CCFRAS using the recommended cutoffs of 45 for the MFS and 80 for the CCFRAS. The CCFRAS appears to be a better tool in detecting fallers vs. nonfallers specific to the IRF setting. The assessment and identification of patients at high risk for falling is important to implement specific precautions and care for these patients to reduce their risk of falling. The CCFRAS is more clinically relevant in identifying patients at high risk for falling in the IRF setting compared to other fall risk assessments. Implementation of this scale may lead to a reduction in fall rate and injuries from falls as it more appropriately identifies patients at high risk for falling. © 2015 Association of Rehabilitation Nurses.

Risk assessment for juvenile justice: a meta-analysis.

PubMed

Schwalbe, Craig S

2007-10-01

Risk assessment instruments are increasingly employed by juvenile justice settings to estimate the likelihood of recidivism among delinquent juveniles. In concert with their increased use, validation studies documenting their predictive validity have increased in number. The purpose of this study was to assess the average predictive validity of juvenile justice risk assessment instruments and to identify risk assessment characteristics that are associated with higher predictive validity. A search of the published and grey literature yielded 28 studies that estimated the predictive validity of 28 risk assessment instruments. Findings of the meta-analysis were consistent with effect sizes obtained in larger meta-analyses of criminal justice risk assessment instruments and showed that brief risk assessment instruments had smaller effect sizes than other types of instruments. However, this finding is tentative owing to limitations of the literature.

Novel Risk Engine for Diabetes Progression and Mortality in USA: Building, Relating, Assessing, and Validating Outcomes (BRAVO).

PubMed

Shao, Hui; Fonseca, Vivian; Stoecker, Charles; Liu, Shuqian; Shi, Lizheng

2018-05-03

There is an urgent need to update diabetes prediction, which has relied on the United Kingdom Prospective Diabetes Study (UKPDS) that dates back to 1970 s' European populations. The objective of this study was to develop a risk engine with multiple risk equations using a recent patient cohort with type 2 diabetes mellitus reflective of the US population. A total of 17 risk equations for predicting diabetes-related microvascular and macrovascular events, hypoglycemia, mortality, and progression of diabetes risk factors were estimated using the data from the Action to Control Cardiovascular Risk in Diabetes (ACCORD) trial (n = 10,251). Internal and external validation processes were used to assess performance of the Building, Relating, Assessing, and Validating Outcomes (BRAVO) risk engine. One-way sensitivity analysis was conducted to examine the impact of risk factors on mortality at the population level. The BRAVO risk engine added several risk factors including severe hypoglycemia and common US racial/ethnicity categories compared with the UKPDS risk engine. The BRAVO risk engine also modeled mortality escalation associated with intensive glycemic control (i.e., glycosylated hemoglobin < 6.5%). External validation showed a good prediction power on 28 endpoints observed from other clinical trials (slope = 1.071, R 2  = 0.86). The BRAVO risk engine for the US diabetes cohort provides an alternative to the UKPDS risk engine. It can be applied to assist clinical and policy decision making such as cost-effective resource allocation in USA.

Assessing the Validity of a Single-Item HIV Risk Stage-of-Change Measure

ERIC Educational Resources Information Center

Napper, Lucy E.; Branson, Catherine M.; Fisher, Dennis G.; Reynolds, Grace L.; Wood, Michelle M.

2008-01-01

This study examined the validity of a single-item measure of HIV risk stage of change that HIV prevention contractors were required to collect by the California State Office of AIDS. The single-item measure was compared to the more conventional University of Rhode Island Change Assessment (URICA). Participants were members of Los Angeles…

Development and Validation of a Video Measure for Assessing Women’s Risk Perception for Alcohol-Related Sexual Assault

PubMed Central

Parks, Kathleen A.; Levonyan-Radloff, Kristine; Dearing, Ronda L.; Hequembourg, Amy; Testa, Maria

2016-01-01

Objective Using an iterative process, a series of three video scenarios were developed for use as a standardized measure for assessing women’s perception of risks for alcohol-related sexual assault (SA). The videos included ambiguous and clear behavioral and environmental risk cues. Method Focus group discussions with young, female heavy drinkers (N = 42) were used to develop three videos at different risk levels (low, moderate, and high) in Study 1. Realism, reliability, and validity of the videos were assessed using multiple methods in Studies 2 and 3. One hundred-four women were used to compare differences in risk perception across the video risk level in Study 2. In Study 3 (N = 60), we assessed women’s perceptions of the low and high risk videos under conditions of no alcohol and alcohol. Results The realism and reliability of the videos were good. Women who viewed the low risk video compared to women who viewed the moderate and high risk videos perceived less risk for SA. We found an interaction between alcohol and risk perception such that, women in the alcohol condition were less likely to perceive risk when watching the high risk video. Conclusions As the video risk level increased, women’s perception of risk increased. These findings provide convergent evidence for the validity of the video measure. Given the limited number of standardized scenarios for assessing risk perception for sexual assault, our findings suggest that these videos may provide a needed standardized measure. PMID:27747131

The Development and Validation of the Contextualized Assessment Tool for Risk and Protection Management (CAT-RPM)

ERIC Educational Resources Information Center

Bower, Julie M.; Carroll, Annemaree; Ashman, Adrian

2014-01-01

Traditional resources for ascertaining risk and protection for disengaged youth are often unsuitable, due to the stamina and skill required to complete them. Many of these tools assess risk without considering participants' potential for personal growth. The present study outlines the development and initial validation of a tool titled the…

Assessing college-level learning difficulties and "at riskness" for learning disabilities and ADHD: development and validation of the learning difficulties assessment.

PubMed

Kane, Steven T; Walker, John H; Schmidt, George R

2011-01-01

This article describes the development and validation of the Learning Difficulties Assessment (LDA), a normed and web-based survey that assesses perceived difficulties with reading, writing, spelling, mathematics, listening, concentration, memory, organizational skills, sense of control, and anxiety in college students. The LDA is designed to (a) map individual learning strengths and weaknesses, (b) provide users with a comparative sense of their academic skills, (c) integrate research in user-interface design to assist those with reading and learning challenges, and (d) identify individuals who may be at risk for learning disabilities and attention-deficit/hyperactivity disorder (ADHD) and who should thus be further assessed. Data from a large-scale 5-year study describing the instrument's validity as a screening tool for learning disabilities and ADHD are presented. This article also describes unique characteristics of the LDA including its user-interface design, normative characteristics, and use as a no-cost screening tool for identifying college students at risk for learning disorders and ADHD.

Dynamic Risk Assessment of Sexual Offenders: Validity and Dimensional Structure of the Stable-2007.

PubMed

Etzler, Sonja; Eher, Reinhard; Rettenberger, Martin

2018-02-01

In this study, the predictive and incremental validity of the Stable-2007 beyond the Static-99 was evaluated in an updated sample of N = 638 adult male sexual offenders followed-up for an average of M = 8.2 years. Data were collected at the Federal Evaluation Center for Violent and Sexual Offenders (FECVSO) in Austria within a prospective-longitudinal research design. Scores and risk categories of the Static-99 (AUC = .721; p < .001) and of the Stable-2007 (AUC = .623, p = .005) were found to be significantly related to sexual recidivism. The Stable-2007 risk categories contributed incrementally to the prediction of sexual recidivism beyond the Static-99. Analyzing the dimensional structure of the Stable-2007 yielded three factors, named Antisociality, Sexual Deviance, and Hypersexuality. Antisociality and Sexual Deviance were significant predictors for sexual recidivism. Sexual Deviance was negatively associated with non-sexual violent recidivism. Comparisons with latent dimensions of other risk assessment instruments are made and implications for applied risk assessment are discussed.

Refining and validating a two-stage and web-based cancer risk assessment tool for village doctors in China.

PubMed

Shen, Xing-Rong; Chai, Jing; Feng, Rui; Liu, Tong-Zhu; Tong, Gui-Xian; Cheng, Jing; Li, Kai-Chun; Xie, Shao-Yu; Shi, Yong; Wang, De-Bin

2014-01-01

The big gap between efficacy of population level prevention and expectations due to heterogeneity and complexity of cancer etiologic factors calls for selective yet personalized interventions based on effective risk assessment. This paper documents our research protocol aimed at refining and validating a two-stage and web- based cancer risk assessment tool, from a tentative one in use by an ongoing project, capable of identifying individuals at elevated risk for one or more types of the 80% leading cancers in rural China with adequate sensitivity and specificity and featuring low cost, easy application and cultural and technical sensitivity for farmers and village doctors. The protocol adopted a modified population-based case control design using 72, 000 non-patients as controls, 2, 200 cancer patients as cases, and another 600 patients as cases for external validation. Factors taken into account comprised 8 domains including diet and nutrition, risk behaviors, family history, precancerous diseases, related medical procedures, exposure to environment hazards, mood and feelings, physical activities and anthropologic and biologic factors. Modeling stresses explored various methodologies like empirical analysis, logistic regression, neuro-network analysis, decision theory and both internal and external validation using concordance statistics, predictive values, etc..

Assessing Predictive Validity of Pressure Ulcer Risk Scales- A Systematic Review and Meta-Analysis

PubMed Central

PARK, Seong-Hi; LEE, Hea Shoon

2016-01-01

Background: The purpose of this study was to present a scientific reason for pressure ulcer risk scales: Cubbin& Jackson modified Braden, Norton, and Waterlow, as a nursing diagnosis tool by utilizing predictive validity of pressure sores. Methods: Articles published between 1966 and 2013 from periodicals indexed in the Ovid Medline, Embase, CINAHL, KoreaMed, NDSL, and other databases were selected using the key word “pressure ulcer”. QUADAS-II was applied for assessment for internal validity of the diagnostic studies. Selected studies were analyzed using meta-analysis with MetaDisc 1.4. Results: Seventeen diagnostic studies with high methodological quality, involving 5,185 patients, were included. In the results of the meta-analysis, sROC AUC of Braden, Norton, and Waterflow scale was over 0.7, showing moderate predictive validity, but they have limited interpretation due to significant differences between studies. In addition, Waterlow scale is insufficient as a screening tool owing to low sensitivity compared with other scales. Conclusion: The contemporary pressure ulcer risk scale is not suitable for uninform practice on patients under standardized criteria. Therefore, in order to provide more effective nursing care for bedsores, a new or modified pressure ulcer risk scale should be developed upon strength and weaknesses of existing tools. PMID:27114977

Different type 2 diabetes risk assessments predict dissimilar numbers at ‘high risk’: a retrospective analysis of diabetes risk-assessment tools

PubMed Central

Gray, Benjamin J; Bracken, Richard M; Turner, Daniel; Morgan, Kerry; Thomas, Michael; Williams, Sally P; Williams, Meurig; Rice, Sam; Stephens, Jeffrey W

2015-01-01

Background Use of a validated risk-assessment tool to identify individuals at high risk of developing type 2 diabetes is currently recommended. It is under-reported, however, whether a different risk tool alters the predicted risk of an individual. Aim This study explored any differences between commonly used validated risk-assessment tools for type 2 diabetes. Design and setting Cross-sectional analysis of individuals who participated in a workplace-based risk assessment in Carmarthenshire, South Wales. Method Retrospective analysis of 676 individuals (389 females and 287 males) who participated in a workplace-based diabetes risk-assessment initiative. Ten-year risk of type 2 diabetes was predicted using the validated QDiabetes®, Leicester Risk Assessment (LRA), FINDRISC, and Cambridge Risk Score (CRS) algorithms. Results Differences between the risk-assessment tools were apparent following retrospective analysis of individuals. CRS categorised the highest proportion (13.6%) of individuals at ‘high risk’ followed by FINDRISC (6.6%), QDiabetes (6.1%), and, finally, the LRA was the most conservative risk tool (3.1%). Following further analysis by sex, over one-quarter of males were categorised at high risk using CRS (25.4%), whereas a greater percentage of females were categorised as high risk using FINDRISC (7.8%). Conclusion The adoption of a different valid risk-assessment tool can alter the predicted risk of an individual and caution should be used to identify those individuals who really are at high risk of type 2 diabetes. PMID:26541180

Development and validation of an automated delirium risk assessment system (Auto-DelRAS) implemented in the electronic health record system.

PubMed

Moon, Kyoung-Ja; Jin, Yinji; Jin, Taixian; Lee, Sun-Mi

2018-01-01

A key component of the delirium management is prevention and early detection. To develop an automated delirium risk assessment system (Auto-DelRAS) that automatically alerts health care providers of an intensive care unit (ICU) patient's delirium risk based only on data collected in an electronic health record (EHR) system, and to evaluate the clinical validity of this system. Cohort and system development designs were used. Medical and surgical ICUs in two university hospitals in Seoul, Korea. A total of 3284 patients for the development of Auto-DelRAS, 325 for external validation, 694 for validation after clinical applications. The 4211 data items were extracted from the EHR system and delirium was measured using CAM-ICU (Confusion Assessment Method for Intensive Care Unit). The potential predictors were selected and a logistic regression model was established to create a delirium risk scoring algorithm to construct the Auto-DelRAS. The Auto-DelRAS was evaluated at three months and one year after its application to clinical practice to establish the predictive validity of the system. Eleven predictors were finally included in the logistic regression model. The results of the Auto-DelRAS risk assessment were shown as high/moderate/low risk on a Kardex screen. The predictive validity, analyzed after the clinical application of Auto-DelRAS after one year, showed a sensitivity of 0.88, specificity of 0.72, positive predictive value of 0.53, negative predictive value of 0.94, and a Youden index of 0.59. A relatively high level of predictive validity was maintained with the Auto-DelRAS system, even one year after it was applied to clinical practice. Copyright © 2017. Published by Elsevier Ltd.

The Predictive Validity of the Short-Term Assessment of Risk and Treatability (START) for Multiple Adverse Outcomes in a Secure Psychiatric Inpatient Setting.

PubMed

O'Shea, Laura E; Picchioni, Marco M; Dickens, Geoffrey L

2016-04-01

The Short-Term Assessment of Risk and Treatability (START) aims to assist mental health practitioners to estimate an individual's short-term risk for a range of adverse outcomes via structured consideration of their risk ("Vulnerabilities") and protective factors ("Strengths") in 20 areas. It has demonstrated predictive validity for aggression but this is less established for other outcomes. We collated START assessments for N = 200 adults in a secure mental health hospital and ascertained 3-month risk event incidence using the START Outcomes Scale. The specific risk estimates, which are the tool developers' suggested method of overall assessment, predicted aggression, self-harm/suicidality, and victimization, and had incremental validity over the Strength and Vulnerability scales for these outcomes. The Strength scale had incremental validity over the Vulnerability scale for aggressive outcomes; therefore, consideration of protective factors had demonstrable value in their prediction. Further evidence is required to support use of the START for the full range of outcomes it aims to predict. © The Author(s) 2015.

Appraising the risk matrix 2000 static sex offender risk assessment tool.

PubMed

Tully, Ruth J; Browne, Kevin D

2015-02-01

This critical appraisal explores the reliability and validity of the Risk Matrix 2000 static sex offender risk assessment tool that is widely used in the United Kingdom. The Risk Matrix 2000 has to some extent been empirically validated for use with adult male sex offenders; however, this review highlights that further research into the validity of this static tool with sex offender subgroups or types is necessary in order to improve practical utility. The Risk Matrix 2000 relies on static risk predictors, thus it is limited in scope. This article argues that the addition of dynamic items that have been shown to be predictive of sexual recidivism would further enhance the tool. The paper argues that adding dynamic risk items would fit better with a rehabilitative approach to sex offender risk management and assessment. This would also provide a means by which to effectively plan sex offender treatment and evaluate individual offenders' progress in treatment; however, difficulties remain in identifying and assessing dynamic risk factors of sexual offending and so further research is required. © The Author(s) 2013.

Expert opinion as 'validation' of risk assessment applied to calf welfare.

PubMed

Bracke, Marc B M; Edwards, Sandra A; Engel, Bas; Buist, Willem G; Algers, Bo

2008-07-14

Recently, a Risk Assessment methodology was applied to animal welfare issues in a report of the European Food Safety Authority (EFSA) on intensively housed calves. Because this is a new and potentially influential approach to derive conclusions on animal welfare issues, a so-called semantic-modelling type 'validation' study was conducted by asking expert scientists, who had been involved or quoted in the report, to give welfare scores for housing systems and for welfare hazards. Kendall's coefficient of concordance among experts (n = 24) was highly significant (P < 0.001), but low (0.29 and 0.18 for housing systems and hazards respectively). Overall correlations with EFSA scores were significant only for experts with a veterinary or mixed (veterinary and applied ethological) background. Significant differences in welfare scores were found between housing systems, between hazards, and between experts with different backgrounds. For example, veterinarians gave higher overall welfare scores for housing systems than ethologists did, probably reflecting a difference in their perception of animal welfare. Systems with the lowest scores were veal calves kept individually in so-called "baby boxes" (veal crates) or in small groups, and feedlots. A suckler herd on pasture was rated as the best for calf welfare. The main hazards were related to underfeeding, inadequate colostrum intake, poor stockperson education, insufficient space, inadequate roughage, iron deficiency, inadequate ventilation, poor floor conditions and no bedding. Points for improvement of the Risk Assessment applied to animal welfare include linking information, reporting uncertainty and transparency about underlying values. The study provides novel information on expert opinion in relation to calf welfare and shows that Risk Assessment applied to animal welfare can benefit from a semantic modelling approach.

Testing the Predictive Validity of the Hendrich II Fall Risk Model.

PubMed

Jung, Hyesil; Park, Hyeoun-Ae

2018-03-01

Cumulative data on patient fall risk have been compiled in electronic medical records systems, and it is possible to test the validity of fall-risk assessment tools using these data between the times of admission and occurrence of a fall. The Hendrich II Fall Risk Model scores assessed during three time points of hospital stays were extracted and used for testing the predictive validity: (a) upon admission, (b) when the maximum fall-risk score from admission to falling or discharge, and (c) immediately before falling or discharge. Predictive validity was examined using seven predictive indicators. In addition, logistic regression analysis was used to identify factors that significantly affect the occurrence of a fall. Among the different time points, the maximum fall-risk score assessed between admission and falling or discharge showed the best predictive performance. Confusion or disorientation and having a poor ability to rise from a sitting position were significant risk factors for a fall.

Predictive Validity of the HKT-R Risk Assessment Tool: Two and 5-Year Violent Recidivism in a Nationwide Sample of Dutch Forensic Psychiatric Patients.

PubMed

Bogaerts, Stefan; Spreen, Marinus; Ter Horst, Paul; Gerlsma, Coby

2018-06-01

This study has examined the predictive validity of the Historical Clinical Future [ Historisch Klinisch Toekomst] Revised risk assessment scheme in a cohort of 347 forensic psychiatric patients, which were discharged between 2004 and 2008 from any of 12 highly secure forensic centers in the Netherlands. Predictive validity was measured 2 and 5 years after release. Official reconviction data obtained from the Dutch Ministry of Security and Justice were used as outcome measures. Violent reoffending within 2 and 5 years after discharge was assessed. With regard to violent reoffending, results indicated that the predictive validity of the Historical domain was modest for 2 (area under the curve [AUC] = .75) and 5 (AUC = .74) years. The predictive validity of the Clinical domain was marginal for 2 (admission: AUC = .62; discharge: AUC = .63) and 5 (admission: AUC = .69; discharge: AUC = .62) years after release. The predictive validity of the Future domain was modest (AUC = .71) for 2 years and low for 5 (AUC = .58) years. The total score of the instrument was modest for 2 years (AUC = .78) and marginal for 5 (AUC = .68) years. Finally, the Final Risk Judgment was modest for 2 years (AUC = .78) and marginal for 5 (AUC = .63) years time at risk. It is concluded that this risk assessment instrument appears to be a satisfactory instrument for risk assessment.

Assessing the reliability, predictive and construct validity of historical, clinical and risk management-20 (HCR-20) in Mexican psychiatric inpatients.

PubMed

Sada, Andrea; Robles-García, Rebeca; Martínez-López, Nicolás; Hernández-Ramírez, Rafael; Tovilla-Zarate, Carlos-Alfonso; López-Munguía, Fernando; Suárez-Alvarez, Enrique; Ayala, Xochitl; Fresán, Ana

2016-08-01

Assessing dangerousness to gauge the likelihood of future violent behaviour has become an integral part of clinical mental health practice in forensic and non-forensic psychiatric settings, one of the most effective instruments for this being the Historical, Clinical and Risk Management-20 (HCR-20). To examine the HCR-20 factor structure in Mexican psychiatric inpatients and to obtain its predictive validity and reliability for use in this population. In total, 225 patients diagnosed with psychotic, affective or personality disorders were included. The HCR-20 was applied at hospital admission and violent behaviours were assessed during psychiatric hospitalization using the Overt Aggression Scale (OAS). Construct validity, predictive validity and internal consistency were determined. Violent behaviour remains more severe in patients classified in the high-risk group during hospitalization. Fifteen items displayed adequate communalities in the original designated domains of the HCR-20 and internal consistency of the instruments was high. The HCR-20 is a suitable instrument for predicting violence risk in Mexican psychiatric inpatients.

External validation of a risk assessment model for venous thromboembolism in the hospitalised acutely-ill medical patient (VTE-VALOURR).

PubMed

Mahan, Charles E; Liu, Yang; Turpie, A Graham; Vu, Jennifer T; Heddle, Nancy; Cook, Richard J; Dairkee, Undaleeb; Spyropoulos, Alex C

2014-10-01

Venous thromboembolic (VTE) risk assessment remains an important issue in hospitalised, acutely-ill medical patients, and several VTE risk assessment models (RAM) have been proposed. The purpose of this large retrospective cohort study was to externally validate the IMPROVE RAM using a large database of three acute care hospitals. We studied 41,486 hospitalisations (28,744 unique patients) with 1,240 VTE hospitalisations (1,135 unique patients) in the VTE cohort and 40,246 VTE-free hospitalisations (27,609 unique patients) in the control cohort. After chart review, 139 unique VTE patients were identified and 278 randomly-selected matched patients in the control cohort. Seven independent VTE risk factors as part of the RAM in the derivation cohort were identified. In the validation cohort, the incidence of VTE was 0.20%; 95% confidence interval (CI) 0.18-0.22, 1.04%; 95%CI 0.88-1.25, and 4.15%; 95%CI 2.79-8.12 in the low, moderate, and high VTE risk groups, respectively, which compared to rates of 0.45%, 1.3%, and 4.74% in the three risk categories of the derivation cohort. For the derivation and validation cohorts, the total percentage of patients in low, moderate and high VTE risk occurred in 68.6% vs 63.3%, 24.8% vs 31.1%, and 6.5% vs 5.5%, respectively. Overall, the area under the receiver-operator characteristics curve for the validation cohort was 0.7731. In conclusion, the IMPROVE RAM can accurately identify medical patients at low, moderate, and high VTE risk. This will tailor future thromboprophylactic strategies in this population as well as identify particularly high VTE risk patients in whom multimodal or more intensive prophylaxis may be beneficial.

The Validity and Reliability of the Turkish Version of the Neonatal Skin Risk Assessment Scale.

PubMed

Sari, Çiğdem; Altay, Naime

2017-03-01

The study created a Turkish translation of the Neonatal Skin Risk Assessment Scale (NSRAS) that was developed by Huffines and Longsdon in 1997. Study authors used a cross-sectional survey design in order to determine the validity and reliability of the Turkish translation. The study was conducted at the neonatal intensive care unit of a university hospital in Ankara between March 15 and June 30, 2014. The research sample included 130 neonatal assessments from 17 patients. Data were collected by questionnaire regarding the characteristics of the participating neonates, 7 nurse observers, and the NSRAS and its subarticles. After translation and back-translation were performed to assess language validity of the scale, necessary corrections were made in line with expert suggestions, and content validity was ensured. Internal consistency of the scale was assessed by its homogeneity, Cronbach's α, and subarticle-general scale grade correlation. Cronbach's α for the scale overall was .88, and Cronbach's α values for the subarticles were between .83 and .90. Results showed a positive relationship among all the subarticles and the overall NSRAS scale grade (P < .01) with correlation values between 0.333 and 0.721. Explanatory and predicative factor analysis was applied for structural validity. Kaiser-Meyer-Olkin analysis was applied for sample sufficiency, and Bartlett test analysis was applied in order to assess the factor analysis of the sample. The Kaiser-Meyer-Olkin coefficient was 0.73, and the χ value found according to the Bartlett test was statistically significant at an advanced level (P < .05). In the 6 subarticles of the scale and in the general scale total grade, a high, positive, and significant relationship among the grades given by the researcher and the nurse observers was found (P < .05). The Turkish NSRAS is reliable and valid.

Validation of Nutritional Risk Screening-2002 in a Hospitalized Adult Population.

PubMed

Bolayir, Başak; Arik, Güneş; Yeşil, Yusuf; Kuyumcu, Mehmet Emin; Varan, Hacer Doğan; Kara, Özgür; Güngör, Anil Evrim; Yavuz, Burcu Balam; Cankurtaran, Mustafa; Halil, Meltem Gülhan

2018-03-30

Malnutrition in hospitalized patients is a serious problem and is associated with a number of adverse outcomes. The Nutritional Risk Screening-2002 (NRS-2002) tool was designed to identify patients at nutrition risk. The validation of NRS-2002 compared with detailed clinical assessment of nutrition status was not studied before in hospitalized Turkish adults. The aim of this study is to determine validity, sensitivity, and specificity of the Turkish version of NRS-2002 in a hospitalized adult population. A total of 271 consecutive hospitalized patients aged >18 years admitted to surgical and medical wards of a university hospital in Turkey were included in this single-center non interventional validity study. Assessment by geriatricians was used as the reference method. Two geriatricians experienced in the field of malnutrition interpreted the patients' nutrition status after the evaluation of several parameters. Patients were divided into "at nutrition risk" and "not at nutrition risk" groups by geriatricians. Concordance between the 2 geriatricians' clinical assessments was analyzed by κ statistics. Excellent concordance was found; therefore, the first geriatrician's decisions were accepted as the gold standard. The correlation of nutrition status of the patients, determined with NRS-2002 and experienced geriatrician's decisions, was evaluated for the validity. NRS-2002 has a sensitivity of 88% and specificity of 92% when compared with professional assessment. The positive and negative predictive values were 87% and 92%, respectively. Testretest agreement was excellent as represented by a κ coefficient of 0.956. NRS-2002 is a valid tool to assess malnutrition risk in Turkish hospitalized patients. © 2018 American Society for Parenteral and Enteral Nutrition.

Drug-Associated Risk Tool: development and validation of a self-assessment questionnaire to screen for hospitalised patients at risk for drug-related problems.

PubMed

Kaufmann, Carole P; Stämpfli, Dominik; Mory, Nadine; Hersberger, Kurt E; Lampert, Markus L

2018-03-09

Identifying patients with a high risk for drug-related problems (DRPs) might optimise the allocation of targeted pharmaceutical care during the hospital stay and on discharge. To develop a self-assessment screening tool to identify patients at risk for DRPs and validate the tool regarding feasibility, acceptability and the reliability of the patients' answers. Prospective validation study. Two mid-sized hospitals (300-400 beds). 195 patients, exclusion criteria: under 18 years old, patients with a health status not allowing a meaningful communication (eg, delirium, acute psychosis, advanced dementia, aphasia, clouded consciousness state), palliative or terminally ill patients. Twenty-seven risk factors for the development of DRPs, identified in a previous study, provided the basis of the self-assessment questionnaire, the Drug-Associated Risk Tool (DART). Consenting patients filled in DART, and we compared their answers with objective patient data from medical records and laboratory data. One hundred and sixty-four patients filled in DART V.1.0 in an average time of 7 min. After a first validation, we identified statements with a low sensitivity and revised the wording of the questions related to heart insufficiency, renal impairment or liver impairment. The revised DART (V.2.0) was validated in 31 patients presenting heart insufficiency, renal impairment or liver impairment as comorbidity and reached an average specificity of 88% (range 27-100) and an average sensitivity of 67% (range 21-100). DART showed a satisfying feasibility and reliability. The specificity of the statements was mostly high. The sensitivity varied and was higher in statements concerning diseases that require regular disease control and attention to self-care and drug management. Asking patients about their conditions, medications and related problems can facilitate getting a first, broad picture of the risk for DRPs and possible pharmaceutical needs. © Article author(s) (or their employer

Validation of American Thyroid Association Ultrasound Risk Assessment of Thyroid Nodules Selected for Ultrasound Fine-Needle Aspiration.

PubMed

Tang, Alice L; Falciglia, Mercedes; Yang, Huaitao; Mark, Jonathan R; Steward, David L

2017-08-01

The aim of this study was to validate the American Thyroid Association (ATA) sonographic risk assessment of thyroid nodules. The ATA sonographic risk assessment was prospectively applied to 206 thyroid nodules selected for ultrasound-guided fine-needle aspiration (US-FNA), and analyzed with The Bethesda System for Reporting Thyroid Cytopathology (TBSRTC), as well as surgical pathology for the subset undergoing surgical excision. The analysis included 206 thyroid nodules averaging 2.4 cm (range 1-7 cm; standard error of the mean 0.07). Using the ATA US pattern risk assessment, nodules were classified as high (4%), intermediate (31%), low (38%), and very low (26%) risk of malignancy. Nodule size was inversely correlated with sonographic risk assessment, as lower risk nodules were larger on average (p < 0.0001). Malignancy rates determined by cytology/surgical pathology were high 100%, intermediate 11%, low 8%, and very low 2%, which were closely aligned with ATA malignancy risk estimates (high 70-90%, intermediate 10-20%, low 5-10%, and very low 3%). ATA US pattern risk assessment also appropriately predicted the proportion of nodules classified as malignant or suspicious for malignancy through TBSRTC classification-high (77%), intermediate (6%), low (1%), and very low 0%-as well as benign TBSRTC classification-high (0%), intermediate (47%), low (61%), and very low (70%) (p < 0.0001). Malignancy rates of surgically excised, cytologically indeterminate nodules followed ATA sonographic risk stratification (high 100%, intermediate 21%, low 17%, and very low 12%; p = 0.003). This prospective study supports the new ATA sonographic pattern risk assessment for selection of thyroid nodules for US-FNA based upon TBSRTC and surgical pathology results. In the setting of indeterminate cytopathology, nodules categorized as atypia of undetermined significance/follicular lesion of undetermined significance with ATA high-risk sonographic patterns have a high

Development and evaluation of an automated fall risk assessment system.

PubMed

Lee, Ju Young; Jin, Yinji; Piao, Jinshi; Lee, Sun-Mi

2016-04-01

Fall risk assessment is the first step toward prevention, and a risk assessment tool with high validity should be used. This study aimed to develop and validate an automated fall risk assessment system (Auto-FallRAS) to assess fall risks based on electronic medical records (EMRs) without additional data collected or entered by nurses. This study was conducted in a 1335-bed university hospital in Seoul, South Korea. The Auto-FallRAS was developed using 4211 fall-related clinical data extracted from EMRs. Participants included fall patients and non-fall patients (868 and 3472 for the development study; 752 and 3008 for the validation study; and 58 and 232 for validation after clinical application, respectively). The system was evaluated for predictive validity and concurrent validity. The final 10 predictors were included in the logistic regression model for the risk-scoring algorithm. The results of the Auto-FallRAS were shown as high/moderate/low risk on the EMR screen. The predictive validity analyzed after clinical application of the Auto-FallRAS was as follows: sensitivity = 0.95, NPV = 0.97 and Youden index = 0.44. The validity of the Morse Fall Scale assessed by nurses was as follows: sensitivity = 0.68, NPV = 0.88 and Youden index = 0.28. This study found that the Auto-FallRAS results were better than were the nurses' predictions. The advantage of the Auto-FallRAS is that it automatically analyzes information and shows patients' fall risk assessment results without requiring additional time from nurses. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Assessment scale of risk for surgical positioning injuries 1

PubMed Central

Lopes, Camila Mendonça de Moraes; Haas, Vanderlei José; Dantas, Rosana Aparecida Spadoti; de Oliveira, Cheila Gonçalves; Galvão, Cristina Maria

2016-01-01

ABSTRACT Objective: to build and validate a scale to assess the risk of surgical positioning injuries in adult patients. Method: methodological research, conducted in two phases: construction and face and content validation of the scale and field research, involving 115 patients. Results: the Risk Assessment Scale for the Development of Injuries due to Surgical Positioning contains seven items, each of which presents five subitems. The scale score ranges between seven and 35 points in which, the higher the score, the higher the patient's risk. The Content Validity Index of the scale corresponded to 0.88. The application of Student's t-test for equality of means revealed the concurrent criterion validity between the scores on the Braden scale and the constructed scale. To assess the predictive criterion validity, the association was tested between the presence of pain deriving from surgical positioning and the development of pressure ulcer, using the score on the Risk Assessment Scale for the Development of Injuries due to Surgical Positioning (p<0.001). The interrater reliability was verified using the intraclass correlation coefficient, equal to 0.99 (p<0.001). Conclusion: the scale is a valid and reliable tool, but further research is needed to assess its use in clinical practice. PMID:27579925

The Reliability and Predictive Validity of the Stalking Risk Profile.

PubMed

McEwan, Troy E; Shea, Daniel E; Daffern, Michael; MacKenzie, Rachel D; Ogloff, James R P; Mullen, Paul E

2018-03-01

This study assessed the reliability and validity of the Stalking Risk Profile (SRP), a structured measure for assessing stalking risks. The SRP was administered at the point of assessment or retrospectively from file review for 241 adult stalkers (91% male) referred to a community-based forensic mental health service. Interrater reliability was high for stalker type, and moderate-to-substantial for risk judgments and domain scores. Evidence for predictive validity and discrimination between stalking recidivists and nonrecidivists for risk judgments depended on follow-up duration. Discrimination was moderate (area under the curve = 0.66-0.68) and positive and negative predictive values good over the full follow-up period ( Mdn = 170.43 weeks). At 6 months, discrimination was better than chance only for judgments related to stalking of new victims (area under the curve = 0.75); however, high-risk stalkers still reoffended against their original victim(s) 2 to 4 times as often as low-risk stalkers. Implications for the clinical utility and refinement of the SRP are discussed.

Development and Validation of a Questionnaire for the Assessment of Pelvic Floor Disorders and Their Risk Factors During Pregnancy and Post Partum.

PubMed

Metz, Melanie; Junginger, Bärbel; Henrich, Wolfgang; Baeßler, Kaven

2017-04-01

Introduction The aim of this study was to develop and validate a questionnaire for the assessment of pelvic floor disorders, their symptoms and risk factors in pregnancy and after birth including symptom course, severity and impact on quality of life. Methods The validated German pelvic floor questionnaire was modified and a new risk factor domain developed. The questionnaire was initially completed by 233 nulliparous women in the third trimester of pregnancy and at six weeks (n = 148) and one year (n = 120) post partum. Full pyschometric testing was performed. The clinical course of symptoms and the influence of risk factors were analysed. Results Study participants had a median age of 31 (19-46) years. 63 % had spontaneous vaginal deliveries, 15 % operative vaginal deliveries and 22 % were delivered by caesarean section. Content validity: Missing answers never exceeded 4 %. Construct validity: The questionnaire distinguished significantly between women who reported bothersome symptoms and those who did not. Reliability: Cronbach's alpha values exceeded 0.7 for bladder, bowel and support function, and 0.65 for sexual function. The test-retest analysis showed moderate to almost complete concordance. The intraclass coefficients for domain scores (between 0.732 and 0.818) were in acceptable to optimal range. Reactivity: The questionnaire was able to track changes significantly with good effect size for each domain. Risk factors for pelvic floor symptoms included familial predisposition, maternal age over 35 years, BMI above 25, nicotine abuse, subjective inability to voluntarily contract the pelvic floor musculature and postpartum wound pain. Conclusion This pelvic floor questionnaire proved to be valid, reliable and reactive for the assessment of pelvic floor disorders, their risk factors, incidence and impact on quality of life during pregnancy and post partum. The questionnaire can be utilised to assess the course of symptoms and treatment effects

How Nonrecidivism Affects Predictive Accuracy: Evidence from a Cross-Validation of the Ontario Domestic Assault Risk Assessment (ODARA)

ERIC Educational Resources Information Center

Hilton, N. Zoe; Harris, Grant T.

2009-01-01

Prediction effect sizes such as ROC area are important for demonstrating a risk assessment's generalizability and utility. How a study defines recidivism might affect predictive accuracy. Nonrecidivism is problematic when predicting specialized violence (e.g., domestic violence). The present study cross-validates the ability of the Ontario…

Neurobehavioral epidemiology: application in risk assessment.

PubMed Central

Grandjean, P; White, R F; Weihe, P

1996-01-01

Neurobehavioral epidemiology may contribute information to risk assessment in relation to a) characterization of neurotoxicity and its time course; b) the dose-effect relationship; c) the dose-response relationship; and d) predisposing factors. The quality of this information relies on the validity of the exposure data, the validity and sensitivity of neurobehavioral function tests, and the degree to which sources of bias are controlled. With epidemiologic studies of methylmercury-associated neurotoxicity as an example, the field of research involves numerous uncertainties that should be taken into account in the risk assessment process. PMID:9182047

Assessing the validity and reliability of three indicators self-reported on the pregnancy risk assessment monitoring system survey.

PubMed

Ahluwalia, Indu B; Helms, Kristen; Morrow, Brian

2013-01-01

We investigated the reliability and validity of three self-reported indicators from the Pregnancy Risk Assessment Monitoring System (PRAMS) survey. We used 2008 PRAMS (n=15,646) data from 12 states that had implemented the 2003 revised U.S. Certificate of Live Birth. We estimated reliability by kappa coefficient and validity by sensitivity and specificity using the birth certificate data as the reference for the following: prenatal participation in the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC); Medicaid payment for delivery; and breastfeeding initiation. These indicators were examined across several demographic subgroups. The reliability was high for all three measures: 0.81 for WIC participation, 0.67 for Medicaid payment of delivery, and 0.72 for breastfeeding initiation. The validity of PRAMS indicators was also high: WIC participation (sensitivity = 90.8%, specificity = 90.6%), Medicaid payment for delivery (sensitivity = 82.4%, specificity = 85.6%), and breastfeeding initiation (sensitivity = 94.3%, specificity = 76.0%). The prevalence estimates were higher on PRAMS than the birth certificate for each of the indicators except Medicaid-paid delivery among non-Hispanic black women. Kappa values within most subgroups remained in the moderate range (0.40-0.80). Sensitivity and specificity values were lower for Hispanic women who responded to the PRAMS survey in Spanish and for breastfeeding initiation among women who delivered very low birthweight and very preterm infants. The validity and reliability of the PRAMS data for measures assessed were high. Our findings support the use of PRAMS data for epidemiological surveillance, research, and planning.

Validation of the Danish version of the constipation risk assessment scale (CRAS).

PubMed

Trads, Mette; Håkonson, Sasja J; Pedersen, Preben U

2017-11-01

The Constipation Assessment Scale (CRAS) was developed in order to enable the prediction of the risk of developing constipation. The scale needs validation in acute and elective patients with common disorders. Two hundred and six acute patients with hip fracture and 200 elective patients with total knee or hip replacement were included. They were assessed with CRAS before surgery and their defecation pattern, stool consistency and degree of straining were measured at admission and 30 days after surgery. The prevalence of constipation was 0.49 for the acute patients and 0.34 for the elective patients. Sensitivity was 0.67 and 0.57. Specificity was 0.54 and 0.52. Positive predictive value was 0.59 and 0.38, whereas the negative predictive value was 0.63 and 0.7. When used in an orthopaedic ward, the prognostic accuracy of CRAS is poor and it cannot be recommended as a screening tool. Copyright © 2016 Elsevier Ltd. All rights reserved.

HIV-Risk Index: Development and Validation of a Brief Risk Index for Hispanic Young People.

PubMed

Ballester-Arnal, Rafael; Gil-Llario, María Dolores; Castro-Calvo, Jesús; Giménez-García, Cristina

2016-08-01

The prevalence of HIV risk behaviors among young people facilitates the spread of HIV, in particular regarding unsafe sex behavior, although this trend is different within this population. For this reason, identifying the riskier young population is required to prevent HIV infection. The main purpose of this study was to develop and validate a risk index to assess the different sexual HIV risk exposure among Hispanic Young people. For this purpose, 9861 Spanish young people were randomly distributed into two groups (derivation and validation group). According to the results, the factor analyses grouped the nine items of the HIV- risk index into two factors (factor 1, direct sexual risk indicators and factor 2, indirect sexual risk indicators) with an equal structure for men and women by a multi-group confirmatory factor analysis. The variance explained was 54.26 %. Moreover, the Cronbach's alpha coefficient revealed high internal reliability (α = .79) and the convergent validity supported its evidence based on different HIV risk indexes. Therefore, the HIV-risk index seem to be a rigorous and valid measure to estimate HIV risk exposure among young people.

Initial Validation of a Comprehensive Assessment Instrument for Bereavement-Related Grief Symptoms and Risk of Complications: The Indicator of Bereavement Adaptation—Cruse Scotland (IBACS)

PubMed Central

Schut, Henk; Stroebe, Margaret S.; Wilson, Stewart; Birrell, John

2016-01-01

Objective This study assessed the validity of the Indicator of Bereavement Adaptation Cruse Scotland (IBACS). Designed for use in clinical and non-clinical settings, the IBACS measures severity of grief symptoms and risk of developing complications. Method N = 196 (44 male, 152 female) help-seeking, bereaved Scottish adults participated at two timepoints: T1 (baseline) and T2 (after 18 months). Four validated assessment instruments were administered: CORE-R, ICG-R, IES-R, SCL-90-R. Discriminative ability was assessed using ROC curve analysis. Concurrent validity was tested through correlation analysis at T1. Predictive validity was assessed using correlation analyses and ROC curve analysis. Optimal IBACS cutoff values were obtained by calculating a maximal Youden index J in ROC curve analysis. Clinical implications were compared across instruments. Results ROC curve analysis results (AUC = .84, p < .01, 95% CI between .77 and .90) indicated the IBACS is a good diagnostic instrument for assessing complicated grief. Positive correlations (p < .01, 2-tailed) with all four instruments at T1 demonstrated the IBACS' concurrent validity, strongest with complicated grief measures (r = .82). Predictive validity was shown to be fair in T2 ROC curve analysis results (n = 67, AUC = .78, 95% CI between .65 and .92; p < .01). Predictive validity was also supported by stable positive correlations between IBACS and other instruments at T2. Clinical indications were found not to differ across instruments. Conclusions The IBACS offers effective grief symptom and risk assessment for use by non-clinicians. Indications are sufficient to support intake assessment for a stepped model of bereavement intervention. PMID:27741246

Evaluation of the validity of osteoporosis and fracture risk assessment tools (IOF One Minute Test, SCORE, and FRAX) in postmenopausal Palestinian women.

PubMed

Kharroubi, Akram; Saba, Elias; Ghannam, Ibrahim; Darwish, Hisham

2017-12-01

The need for simple self-assessment tools is necessary to predict women at high risk for developing osteoporosis. In this study, tools like the IOF One Minute Test, Fracture Risk Assessment Tool (FRAX), and Simple Calculated Osteoporosis Risk Estimation (SCORE) were found to be valid for Palestinian women. The threshold for predicting women at risk for each tool was estimated. The purpose of this study is to evaluate the validity of the updated IOF (International Osteoporosis Foundation) One Minute Osteoporosis Risk Assessment Test, FRAX, SCORE as well as age alone to detect the risk of developing osteoporosis in postmenopausal Palestinian women. Three hundred eighty-two women 45 years and older were recruited including 131 women with osteoporosis and 251 controls following bone mineral density (BMD) measurement, 287 completed questionnaires of the different risk assessment tools. Receiver operating characteristic (ROC) curves were evaluated for each tool using bone BMD as the gold standard for osteoporosis. The area under the ROC curve (AUC) was the highest for FRAX calculated with BMD for predicting hip fractures (0.897) followed by FRAX for major fractures (0.826) with cut-off values ˃1.5 and ˃7.8%, respectively. The IOF One Minute Test AUC (0.629) was the lowest compared to other tested tools but with sufficient accuracy for predicting the risk of developing osteoporosis with a cut-off value ˃4 total yes questions out of 18. SCORE test and age alone were also as good predictors of risk for developing osteoporosis. According to the ROC curve for age, women ≥64 years had a higher risk of developing osteoporosis. Higher percentage of women with low BMD (T-score ≤-1.5) or osteoporosis (T-score ≤-2.5) was found among women who were not exposed to the sun, who had menopause before the age of 45 years, or had lower body mass index (BMI) compared to controls. Women who often fall had lower BMI and approximately 27% of the recruited postmenopausal

Risk-based Methodology for Validation of Pharmaceutical Batch Processes.

PubMed

Wiles, Frederick

2013-01-01

In January 2011, the U.S. Food and Drug Administration published new process validation guidance for pharmaceutical processes. The new guidance debunks the long-held industry notion that three consecutive validation batches or runs are all that are required to demonstrate that a process is operating in a validated state. Instead, the new guidance now emphasizes that the level of monitoring and testing performed during process performance qualification (PPQ) studies must be sufficient to demonstrate statistical confidence both within and between batches. In some cases, three qualification runs may not be enough. Nearly two years after the guidance was first published, little has been written defining a statistical methodology for determining the number of samples and qualification runs required to satisfy Stage 2 requirements of the new guidance. This article proposes using a combination of risk assessment, control charting, and capability statistics to define the monitoring and testing scheme required to show that a pharmaceutical batch process is operating in a validated state. In this methodology, an assessment of process risk is performed through application of a process failure mode, effects, and criticality analysis (PFMECA). The output of PFMECA is used to select appropriate levels of statistical confidence and coverage which, in turn, are used in capability calculations to determine when significant Stage 2 (PPQ) milestones have been met. The achievement of Stage 2 milestones signals the release of batches for commercial distribution and the reduction of monitoring and testing to commercial production levels. Individuals, moving range, and range/sigma charts are used in conjunction with capability statistics to demonstrate that the commercial process is operating in a state of statistical control. The new process validation guidance published by the U.S. Food and Drug Administration in January of 2011 indicates that the number of process validation batches

Absolute fracture risk assessment using lumbar spine and femoral neck bone density measurements: derivation and validation of a hybrid system.

PubMed

Leslie, William D; Lix, Lisa M

2011-03-01

The World Health Organization (WHO) Fracture Risk Assessment Tool (FRAX) computes 10-year probability of major osteoporotic fracture from multiple risk factors, including femoral neck (FN) T-scores. Lumbar spine (LS) measurements are not currently part of the FRAX formulation but are used widely in clinical practice, and this creates confusion when there is spine-hip discordance. Our objective was to develop a hybrid 10-year absolute fracture risk assessment system in which nonvertebral (NV) fracture risk was assessed from the FN and clinical vertebral (V) fracture risk was assessed from the LS. We identified 37,032 women age 45 years and older undergoing baseline FN and LS dual-energy X-ray absorptiometry (DXA; 1990-2005) from a population database that contains all clinical DXA results for the Province of Manitoba, Canada. Results were linked to longitudinal health service records for physician billings and hospitalizations to identify nontrauma vertebral and nonvertebral fracture codes after bone mineral density (BMD) testing. The population was randomly divided into equal-sized derivation and validation cohorts. Using the derivation cohort, three fracture risk prediction systems were created from Cox proportional hazards models (adjusted for age and multiple FRAX risk factors): FN to predict combined all fractures, FN to predict nonvertebral fractures, and LS to predict vertebral (without nonvertebral) fractures. The hybrid system was the sum of nonvertebral risk from the FN model and vertebral risk from the LS model. The FN and hybrid systems were both strongly predictive of overall fracture risk (p < .001). In the validation cohort, ROC analysis showed marginally better performance of the hybrid system versus the FN system for overall fracture prediction (p = .24) and significantly better performance for vertebral fracture prediction (p < .001). In a discordance subgroup with FN and LS T-score differences greater than 1 SD, there was a significant

The predictive validity of common risk assessment tools in men with intellectual disabilities and problematic sexual behaviors.

PubMed

Fedoroff, J Paul; Richards, Deborah; Ranger, Rebekah; Curry, Susan

2016-10-01

This CIHR-funded study examined whether certain current risk assessment tools were effective in appraising risk of recidivism in a sample of sex offenders with intellectual disabilities (ID). Fifty men with ID who had engaged in problematic sexual behavior (PSB) were followed for an average of 2.5 years. Recidivism was defined and measured as any illegal or problematic behavior, as well as any problematic but not necessarily illegal behavior. At the beginning of the study, each participant was rated on two risk assessment tools: the Violence Risk Appraisal Guide (VRAG) and the Sex Offender Risk Appraisal Guide (SORAG). During each month of follow-up, participants were also rated on the Short-Dynamic Risk Scale (SDRS), an assessment tool intended to measure the risk of future problematic behaviors. Data was analyzed using t-tests, Cohen's d and area under the curve (AUC) to test predictive validity of the assessment tools. Using the AUC, results showed that the VRAG was predictive of sexual (AUC=0.74), sexual and/or violent (AUC=0.71) and of any criminally chargeable event (AUC=0.69). The SORAG was only significantly predictive of sexual events (AUC=0.70) and the SDRS was predictive of violent events (AUC=0.71). The t-test and Cohen's d analyses, which are less robust to deviations from the assumptions of normal and continuous distribution than AUC, did not yield significant results in each category, and therefore, while the results of this study suggest that the VRAG and the SORAG may be effective tools in measuring the short term risk of sexual recidivism; and the VRAG and SDRS may be effective tools in appraising long term risk of sexual and/or violent recidivism in this population, it should be used with caution. Regardless of the assessment tool used, risk assessments should take into account the differences between sex offenders with and without ID to ensure effective measurement. Copyright © 2016. Published by Elsevier Ltd.

Validating the Octave Allegro Information Systems Risk Assessment Methodology: A Case Study

ERIC Educational Resources Information Center

Keating, Corland G.

2014-01-01

An information system (IS) risk assessment is an important part of any successful security management strategy. Risk assessments help organizations to identify mission-critical IS assets and prioritize risk mitigation efforts. Many risk assessment methodologies, however, are complex and can only be completed successfully by highly qualified and…

Twenty Years of Progress in Violence Risk Assessment

ERIC Educational Resources Information Center

Hanson, R. Karl

2005-01-01

Violence risk assessment has advanced considerably in the last 20 years. In the 1980s, leading professionals questioned the very possibility of valid violence risk assessments; now, many of the major risk factors have been identified, and professional debate focuses on how best to combine these risk factors into meaningful evaluations. An…

Validation of the Behavioral Risk Factor Surveillance System Sleep Questions

PubMed Central

Jungquist, Carla R.; Mund, Jaime; Aquilina, Alan T.; Klingman, Karen; Pender, John; Ochs-Balcom, Heather; van Wijngaarden, Edwin; Dickerson, Suzanne S.

2016-01-01

Study Objective: Sleep problems may constitute a risk for health problems, including cardiovascular disease, depression, diabetes, poor work performance, and motor vehicle accidents. The primary purpose of this study was to assess the validity of the current Behavioral Risk Factor Surveillance System (BRFSS) sleep questions by establishing the sensitivity and specificity for detection of sleep/ wake disturbance. Methods: Repeated cross-sectional assessment of 300 community dwelling adults over the age of 18 who did not wear CPAP or oxygen during sleep. Reliability and validity testing of the BRFSS sleep questions was performed comparing to BFRSS responses to data from home sleep study, actigraphy for 14 days, Insomnia Severity Index, Epworth Sleepiness Scale, and PROMIS-57. Results: Only two of the five BRFSS sleep questions were found valid and reliable in determining total sleep time and excessive daytime sleepiness. Conclusions: Refinement of the BRFSS questions is recommended. Citation: Jungquist CR, Mund J, Aquilina AT, Klingman K, Pender J, Ochs-Balcom H, van Wijngaarden E, Dickerson SS. Validation of the behavioral risk factor surveillance system sleep questions. J Clin Sleep Med 2016;12(3):301–310. PMID:26446246

Validation of a multifactorial risk factor model used for predicting future caries risk with Nevada adolescents.

PubMed

Ditmyer, Marcia M; Dounis, Georgia; Howard, Katherine M; Mobley, Connie; Cappelli, David

2011-05-20

The objective of this study was to measure the validity and reliability of a multifactorial Risk Factor Model developed for use in predicting future caries risk in Nevada adolescents in a public health setting. This study examined retrospective data from an oral health surveillance initiative that screened over 51,000 students 13-18 years of age, attending public/private schools in Nevada across six academic years (2002/2003-2007/2008). The Risk Factor Model included ten demographic variables: exposure to fluoridation in the municipal water supply, environmental smoke exposure, race, age, locale (metropolitan vs. rural), tobacco use, Body Mass Index, insurance status, sex, and sealant application. Multiple regression was used in a previous study to establish which significantly contributed to caries risk. Follow-up logistic regression ascertained the weight of contribution and odds ratios of the ten variables. Researchers in this study computed sensitivity, specificity, positive predictive value (PVP), negative predictive value (PVN), and prevalence across all six years of screening to assess the validity of the Risk Factor Model. Subjects' overall mean caries prevalence across all six years was 66%. Average sensitivity across all six years was 79%; average specificity was 81%; average PVP was 89% and average PVN was 67%. Overall, the Risk Factor Model provided a relatively constant, valid measure of caries that could be used in conjunction with a comprehensive risk assessment in population-based screenings by school nurses/nurse practitioners, health educators, and physicians to guide them in assessing potential future caries risk for use in prevention and referral practices.

[Evaluation of Suicide Risk Levels in Hospitals: Validity and Reliability Tests].

PubMed

Macagnino, Sandro; Steinert, Tilman; Uhlmann, Carmen

2018-05-01

Examination of in-hospital suicide risk levels concerning their validity and their reliability. The internal suicide risk levels were evaluated in a cross sectional study of in 163 inpatients. A reliability check was performed via determining interrater-reliability of senior physician, therapist and the responsible nurse. Within the scope of the validity check, we conducted analyses of criterion validity and construct validity. For the total sample an "acceptable" to "good" interrater-reliability (Kendalls W = .77) of suicide risk levels were obtained. Schizophrenic disorders showed the lowest values, for personality disorders we found the highest level of interrater-reliability. When examining the criterion validity, Item-9 of the BDI-II is substantial correlated to our suicide risk levels (ρ m  = .54, p < .01). Within the scope of construct validity check, affective disorders showed the highest correlation (ρ = .77), compatible also with "convergent validity". They differed with schizophrenic disorders which showed the least concordance (ρ = .43). In-hospital suicide risk levels may represent an important contribution to the assessment of suicidal behavior of inpatients experiencing psychiatric treatment due to their overall good validity and reliability. © Georg Thieme Verlag KG Stuttgart · New York.

Fall Risk Assessment Through Automatic Combination of Clinical Fall Risk Factors and Body-Worn Sensor Data.

PubMed

Greene, Barry R; Redmond, Stephen J; Caulfield, Brian

2017-05-01

Falls are the leading global cause of accidental death and disability in older adults and are the most common cause of injury and hospitalization. Accurate, early identification of patients at risk of falling, could lead to timely intervention and a reduction in the incidence of fall-related injury and associated costs. We report a statistical method for fall risk assessment using standard clinical fall risk factors (N = 748). We also report a means of improving this method by automatically combining it, with a fall risk assessment algorithm based on inertial sensor data and the timed-up-and-go test. Furthermore, we provide validation data on the sensor-based fall risk assessment method using a statistically independent dataset. Results obtained using cross-validation on a sample of 292 community dwelling older adults suggest that a combined clinical and sensor-based approach yields a classification accuracy of 76.0%, compared to either 73.6% for sensor-based assessment alone, or 68.8% for clinical risk factors alone. Increasing the cohort size by adding an additional 130 subjects from a separate recruitment wave (N = 422), and applying the same model building and validation method, resulted in a decrease in classification performance (68.5% for combined classifier, 66.8% for sensor data alone, and 58.5% for clinical data alone). This suggests that heterogeneity between cohorts may be a major challenge when attempting to develop fall risk assessment algorithms which generalize well. Independent validation of the sensor-based fall risk assessment algorithm on an independent cohort of 22 community dwelling older adults yielded a classification accuracy of 72.7%. Results suggest that the present method compares well to previously reported sensor-based fall risk assessment methods in assessing falls risk. Implementation of objective fall risk assessment methods on a large scale has the potential to improve quality of care and lead to a reduction in associated hospital

Development and validation of QMortality risk prediction algorithm to estimate short term risk of death and assess frailty: cohort study.

PubMed

Hippisley-Cox, Julia; Coupland, Carol

2017-09-20

, Parkinson's disease, poor mobility, rheumatoid arthritis, chronic kidney disease, type 1 diabetes, type 2 diabetes, venous thromboembolism, anaemia, abnormal liver function test result, high platelet count, visited doctor in the past year with either appetite loss, unexpected weight loss, or breathlessness. The model had good calibration and high levels of explained variation and discrimination. In women, the equation explained 55.6% of the variation in time to death (R 2 ), and had very good discrimination-the D statistic was 2.29, and Harrell's C statistic value was 0.85. The corresponding values for men were 53.1%, 2.18, and 0.84. By combining predicted risks of mortality and unplanned hospital admissions, 2.7% of patients (n=13 665) were classified as severely frail, 9.4% (n=46 770) as moderately frail, 43.1% (n=215 253) as mildly frail, and 44.8% (n=223 790) as fit. Conclusions  We have developed new equations to predict the short term risk of death in men and women aged 65 or more, taking account of demographic, social, and clinical variables. The equations had good performance on a separate validation cohort. The QMortality equations can be used in conjunction with the QAdmissions equations, to classify patients into four frailty groups (known as QFrailty categories) to enable patients to be identified for further assessment or interventions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Ethics and transparent risk communication start with proper risk assessment methodologies

NASA Astrophysics Data System (ADS)

Oboni, Franco; Oboni, Cesar

2014-05-01

We will use throught this paper a "dialogue" between two professionals. One is aware of the misleading character of many risk assessments and wants to foster better approaches. A discomforting set of statements sets the background of the "story": public reactions to risk assessments are generally negative, the developer find it difficult to understand the reasons for general public negative reactions, many projects get often rejected without valid reasons by the public, anywhere in the world. Common practice approaches in Risk Assessment are discussed from the angle of public rejection, taking into account various studies that explicitly expose common practices limitations and voids. The hiatus between rational and well-balanced risk assessments and common practices is explored. Finally solutions to overcome the limitations of common practices and deliver to the public more realistic risk assessment on which to build a widespread consensus are reviewed. The paper conclusions relate to the need of: properly communicating risk throughout the life of a project, from cradle to grave, avoiding conflict of interest, having estimates that are understandable to foster good understanding of what a risk assessment can bring to better Human existence, in an ethical and fair way. The paper delivers a list of possible remedies and shows that "Common Practices" do not equate to "Best Practices": common practices are not to be proposed/used any longer if we want to avoid public distrust and misrepresentations. Many of the "modern" issues ranging from public distrust to insurance denial could be relieved or mitigated ahead of time if misrepresentation was kept at bay using five simple rules. Common practice Risk Assessments, especially those developed under conflict of interest situations, generally misrepresent risks and fail to give the "big picture", hence do not help taking valid decision and are prone to generating/fostering public distrust.

Automated Pressure Injury Risk Assessment System Incorporated Into an Electronic Health Record System.

PubMed

Jin, Yinji; Jin, Taixian; Lee, Sun-Mi

Pressure injury risk assessment is the first step toward preventing pressure injuries, but traditional assessment tools are time-consuming, resulting in work overload and fatigue for nurses. The objectives of the study were to build an automated pressure injury risk assessment system (Auto-PIRAS) that can assess pressure injury risk using data, without requiring nurses to collect or input additional data, and to evaluate the validity of this assessment tool. A retrospective case-control study and a system development study were conducted in a 1,355-bed university hospital in Seoul, South Korea. A total of 1,305 pressure injury patients and 5,220 nonpressure injury patients participated for the development of a risk scoring algorithm: 687 and 2,748 for the validation of the algorithm and 237 and 994 for validation after clinical implementation, respectively. A total of 4,211 pressure injury-related clinical variables were extracted from the electronic health record (EHR) systems to develop a risk scoring algorithm, which was validated and incorporated into the EHR. That program was further evaluated for predictive and concurrent validity. Auto-PIRAS, incorporated into the EHR system, assigned a risk assessment score of high, moderate, or low and displayed this on the Kardex nursing record screen. Risk scores were updated nightly according to 10 predetermined risk factors. The predictive validity measures of the algorithm validation stage were as follows: sensitivity = .87, specificity = .90, positive predictive value = .68, negative predictive value = .97, Youden index = .77, and the area under the receiver operating characteristic curve = .95. The predictive validity measures of the Braden Scale were as follows: sensitivity = .77, specificity = .93, positive predictive value = .72, negative predictive value = .95, Youden index = .70, and the area under the receiver operating characteristic curve = .85. The kappa of the Auto-PIRAS and Braden Scale risk

Developing a pressure ulcer risk factor minimum data set and risk assessment framework.

PubMed

Coleman, Susanne; Nelson, E Andrea; Keen, Justin; Wilson, Lyn; McGinnis, Elizabeth; Dealey, Carol; Stubbs, Nikki; Muir, Delia; Farrin, Amanda; Dowding, Dawn; Schols, Jos M G A; Cuddigan, Janet; Berlowitz, Dan; Jude, Edward; Vowden, Peter; Bader, Dan L; Gefen, Amit; Oomens, Cees W J; Schoonhoven, Lisette; Nixon, Jane

2014-10-01

To agree a draft pressure ulcer risk factor Minimum Data Set to underpin the development of a new evidenced-based Risk Assessment Framework. A recent systematic review identified the need for a pressure ulcer risk factor Minimum Data Set and development and validation of an evidenced-based pressure ulcer Risk Assessment Framework. This was undertaken through the Pressure UlceR Programme Of reSEarch (RP-PG-0407-10056), funded by the National Institute for Health Research and incorporates five phases. This article reports phase two, a consensus study. Consensus study. A modified nominal group technique based on the Research and Development/University of California at Los Angeles appropriateness method. This incorporated an expert group, review of the evidence and the views of a Patient and Public Involvement service user group. Data were collected December 2010-December 2011. The risk factors and assessment items of the Minimum Data Set (including immobility, pressure ulcer and skin status, perfusion, diabetes, skin moisture, sensory perception and nutrition) were agreed. In addition, a draft Risk Assessment Framework incorporating all Minimum Data Set items was developed, comprising a two stage assessment process (screening and detailed full assessment) and decision pathways. The draft Risk Assessment Framework will undergo further design and pre-testing with clinical nurses to assess and improve its usability. It will then be evaluated in clinical practice to assess its validity and reliability. The Minimum Data Set could be used in future for large scale risk factor studies informing refinement of the Risk Assessment Framework. © 2014 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Development and validation of the ORACLE score to predict risk of osteoporosis.

PubMed

Richy, Florent; Deceulaer, Fréderic; Ethgen, Olivier; Bruyère, Olivier; Reginster, Jean-Yves

2004-11-01

To develop and validate a composite index, the Osteoporosis Risk Assessment by Composite Linear Estimate (ORACLE), that includes risk factors and ultrasonometric outcomes to screen for osteoporosis. Two cohorts of postmenopausal women aged 45 years and older participated in the development (n = 407) and the validation (n = 202) of ORACLE. Their bone mineral density was determined by dual energy x-ray absorptiometry and quantitative ultrasonometry (QUS), and their historical and clinical risk factors were assessed (January to June 2003). Logistic regression analysis was used to select significant predictors of bone mineral density, whereas receiver operating characteristic (ROC) analysis was used to assess the discriminatory performance of ORACLE. The final logistic regression model retained 4 biometric or historical variables and 1 ultrasonometric outcome. The ROC areas under the curves (AUCs) for ORACLE were 84% for the prediction of osteoporosis and 78% for low bone mass. A sensitivity of 90% corresponded to a specificity of 50% for identification of women at risk of developing osteoporosis. The corresponding positive and negative predictive values were 86% and 54%, respectively, in the development cohort. In the validation cohort, the AUCs for identification of osteoporosis and low bone mass were 81% and 76% for ORACLE, 69% and 64% for QUS T score, 71% and 68% for QUS ultrasonometric bone profile index, and 76% and 75% for Osteoporosis Self-assessment Tool, respectively. ORACLE had the best discriminatory performance in identifying osteoporosis compared with the other approaches (P < .05). ORACLE exhibited the highest discriminatory properties compared with ultrasonography alone or other previously validated risk indices. It may be helpful to enhance the predictive value of QUS.

How Confident can we be in Flood Risk Assessments?

NASA Astrophysics Data System (ADS)

Merz, B.

2017-12-01

Flood risk management should be based on risk analyses quantifying the risk and its reduction for different risk reduction strategies. However, validating risk estimates by comparing model simulations with past observations is hardly possible, since the assessment typically encompasses extreme events and their impacts that have not been observed before. Hence, risk analyses are strongly based on assumptions and expert judgement. This situation opens the door for cognitive biases, such as `illusion of certainty', `overconfidence' or `recency bias'. Such biases operate specifically in complex situations with many factors involved, when uncertainty is high and events are probabilistic, or when close learning feedback loops are missing - aspects that all apply to risk analyses. This contribution discusses how confident we can be in flood risk assessments, and reflects about more rigorous approaches towards their validation.

The development and testing of a skin tear risk assessment tool.

PubMed

Newall, Nelly; Lewin, Gill F; Bulsara, Max K; Carville, Keryln J; Leslie, Gavin D; Roberts, Pam A

2017-02-01

The aim of the present study is to develop a reliable and valid skin tear risk assessment tool. The six characteristics identified in a previous case control study as constituting the best risk model for skin tear development were used to construct a risk assessment tool. The ability of the tool to predict skin tear development was then tested in a prospective study. Between August 2012 and September 2013, 1466 tertiary hospital patients were assessed at admission and followed up for 10 days to see if they developed a skin tear. The predictive validity of the tool was assessed using receiver operating characteristic (ROC) analysis. When the tool was found not to have performed as well as hoped, secondary analyses were performed to determine whether a potentially better performing risk model could be identified. The tool was found to have high sensitivity but low specificity and therefore have inadequate predictive validity. Secondary analysis of the combined data from this and the previous case control study identified an alternative better performing risk model. The tool developed and tested in this study was found to have inadequate predictive validity. The predictive validity of an alternative, more parsimonious model now needs to be tested. © 2015 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

The East London glaucoma prediction score: web-based validation of glaucoma risk screening tool

PubMed Central

Stephen, Cook; Benjamin, Longo-Mbenza

2013-01-01

AIM It is difficult for Optometrists and General Practitioners to know which patients are at risk. The East London glaucoma prediction score (ELGPS) is a web based risk calculator that has been developed to determine Glaucoma risk at the time of screening. Multiple risk factors that are available in a low tech environment are assessed to provide a risk assessment. This is extremely useful in settings where access to specialist care is difficult. Use of the calculator is educational. It is a free web based service. Data capture is user specific. METHOD The scoring system is a web based questionnaire that captures and subsequently calculates the relative risk for the presence of Glaucoma at the time of screening. Three categories of patient are described: Unlikely to have Glaucoma; Glaucoma Suspect and Glaucoma. A case review methodology of patients with known diagnosis is employed to validate the calculator risk assessment. RESULTS Data from the patient records of 400 patients with an established diagnosis has been captured and used to validate the screening tool. The website reports that the calculated diagnosis correlates with the actual diagnosis 82% of the time. Biostatistics analysis showed: Sensitivity = 88%; Positive predictive value = 97%; Specificity = 75%. CONCLUSION Analysis of the first 400 patients validates the web based screening tool as being a good method of screening for the at risk population. The validation is ongoing. The web based format will allow a more widespread recruitment for different geographic, population and personnel variables. PMID:23550097

Risk assessment instruments in clinical practice.

PubMed

Côté, Gilles; Crocker, Anne G; Nicholls, Tonia L; Seto, Michael C

2012-04-01

To determine whether the items in one of the most widely validated instruments of violence risk assessment, the Historical-Clinical-Risk Management-20 (HCR-20), are used in review board hearings to assess the risk of violence by people found Not Criminally Responsible on account of Mental Disorder (NCRMD). This study was conducted from October 2004 to August 2006 in Quebec's sole forensic psychiatric hospital and 2 large civil psychiatric hospitals designated for the care of people declared NCRMD in the Montreal metropolitan area. The risk assessments presented by clinicians at annual review board hearings and the boards' rationale for the release or detention of people found NCRMD were contrasted with the risk assessments conducted by the research team using the HCR-20. The final sample was comprised of 96 men. Very few of the risk factors identified by prior research (HCR-20 items) were mentioned in the hearing process, whether in clinical reports, discussions during the hearing, or in the disposition justification. The findings confirm that there remains a significant gap between research evidence and risk assessment practice.

Validity and inter-observer reliability of subjective hand-arm vibration assessments.

PubMed

Coenen, Pieter; Formanoy, Margriet; Douwes, Marjolein; Bosch, Tim; de Kraker, Heleen

2014-07-01

Exposure to mechanical vibrations at work (e.g., due to handling powered tools) is a potential occupational risk as it may cause upper extremity complaints. However, reliable and valid assessment methods for vibration exposure at work are lacking. Measuring hand-arm vibration objectively is often difficult and expensive, while often used information provided by manufacturers lacks detail. Therefore, a subjective hand-arm vibration assessment method was tested on validity and inter-observer reliability. In an experimental protocol, sixteen tasks handling powered tools were executed by two workers. Hand-arm vibration was assessed subjectively by 16 observers according to the proposed subjective assessment method. As a gold standard reference, hand-arm vibration was measured objectively using a vibration measurement device. Weighted κ's were calculated to assess validity, intra-class-correlation coefficients (ICCs) were calculated to assess inter-observer reliability. Inter-observer reliability of the subjective assessments depicting the agreement among observers can be expressed by an ICC of 0.708 (0.511-0.873). The validity of the subjective assessments as compared to the gold-standard reference can be expressed by a weighted κ of 0.535 (0.285-0.785). Besides, the percentage of exact agreement of the subjective assessment compared to the objective measurement was relatively low (i.e., 52% of all tasks). This study shows that subjectively assessed hand-arm vibrations are fairly reliable among observers and moderately valid. This assessment method is a first attempt to use subjective risk assessments of hand-arm vibration. Although, this assessment method can benefit from some future improvement, it can be of use in future studies and in field-based ergonomic assessments. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

A systematic review of publications assessing reliability and validity of the Behavioral Risk Factor Surveillance System (BRFSS), 2004–2011

PubMed Central

2013-01-01

Background In recent years response rates on telephone surveys have been declining. Rates for the behavioral risk factor surveillance system (BRFSS) have also declined, prompting the use of new methods of weighting and the inclusion of cell phone sampling frames. A number of scholars and researchers have conducted studies of the reliability and validity of the BRFSS estimates in the context of these changes. As the BRFSS makes changes in its methods of sampling and weighting, a review of reliability and validity studies of the BRFSS is needed. Methods In order to assess the reliability and validity of prevalence estimates taken from the BRFSS, scholarship published from 2004–2011 dealing with tests of reliability and validity of BRFSS measures was compiled and presented by topics of health risk behavior. Assessments of the quality of each publication were undertaken using a categorical rubric. Higher rankings were achieved by authors who conducted reliability tests using repeated test/retest measures, or who conducted tests using multiple samples. A similar rubric was used to rank validity assessments. Validity tests which compared the BRFSS to physical measures were ranked higher than those comparing the BRFSS to other self-reported data. Literature which undertook more sophisticated statistical comparisons was also ranked higher. Results Overall findings indicated that BRFSS prevalence rates were comparable to other national surveys which rely on self-reports, although specific differences are noted for some categories of response. BRFSS prevalence rates were less similar to surveys which utilize physical measures in addition to self-reported data. There is very little research on reliability and validity for some health topics, but a great deal of information supporting the validity of the BRFSS data for others. Conclusions Limitations of the examination of the BRFSS were due to question differences among surveys used as comparisons, as well as mode of data

IV&V Project Assessment Process Validation

NASA Technical Reports Server (NTRS)

Driskell, Stephen

2012-01-01

The Space Launch System (SLS) will launch NASA's Multi-Purpose Crew Vehicle (MPCV). This launch vehicle will provide American launch capability for human exploration and travelling beyond Earth orbit. SLS is designed to be flexible for crew or cargo missions. The first test flight is scheduled for December 2017. The SLS SRR/SDR provided insight into the project development life cycle. NASA IV&V ran the standard Risk Based Assessment and Portfolio Based Risk Assessment to identify analysis tasking for the SLS program. This presentation examines the SLS System Requirements Review/System Definition Review (SRR/SDR), IV&V findings for IV&V process validation correlation to/from the selected IV&V tasking and capabilities. It also provides a reusable IEEE 1012 scorecard for programmatic completeness across the software development life cycle.

Assessment and management of risk for intimate partner violence by police officers using the Spousal Assault Risk Assessment Guide.

PubMed

Belfrage, Henrik; Strand, Susanne; Storey, Jennifer E; Gibas, Andrea L; Kropp, P Randall; Hart, Stephen D

2012-02-01

Intimate partner violence (IPV) is a crime that is present in all countries, seriously impacts victims, and demands a great deal of time and resources from the criminal justice system. The current study examined the use of the Spousal Assault Risk Assessment Guide, 2nd ed. (SARA; Kropp, Hart, Webster, & Eaves, 1995), a structured professional judgment risk assessment and management tool for IPV, by police officers in Sweden over a follow-up of 18 months. SARA risk assessments had significant predictive validity with respect to risk management recommendations made by police, as well as with recidivism as indexed by subsequent contacts with police. Risk management mediated the association between risk assessment and recidivism: High levels of intervention were associated with decreased recidivism in high risk cases, but with increased recidivism in low risk cases. The findings support the potential utility of police-based risk assessment and management of IPV, and in particular the belief that appropriately structured risk assessment and management decisions can prevent violence. (c) 2012 APA, all rights reserved.

Validation of the Beck Hopelessness Scale in patients with suicide risk.

PubMed

Rueda-Jaimes, German Eduardo; Castro-Rueda, Vanessa Alexandra; Rangel-Martínez-Villalba, Andrés Mauricio; Moreno-Quijano, Catalina; Martinez-Salazar, Gustavo Adolfo; Camacho, Paul Anthony

Only a few scales have been validated in Spanish for the assessment of suicide risk, and none of them have achieved predictive validity. To determine the validity and reliability of the Beck Hopelessness Scale in patients with suicide risk attending the specialist clinic. The Beck Hopelessness Scale, reasons for living inventory, and the suicide behaviour questionnaire were applied in patients with suicide risk attending the psychiatric clinic and the emergency department. A new assessment was made 30 days later to determine the predictive validity of suicide or suicide attempt. The evaluation included a total of 244 patients, with a mean age of 30.7±13.2 years, and the majority were women. The internal consistency was .9 (Kuder-Richardson formula 20). Four dimensions were found which accounted for 50% of the variance. It was positively correlated with the suicidal behaviour questionnaire (Spearman .48, P<.001), number of suicide attempts (Spearman .25, P<.001), severity of suicide risk (Spearman .23, P<.001). The correlation with the reasons for living inventory was negative (Spearman -.52, P<.001). With a cut-off ≥12, the negative predictive value was 98.4% (95% CI: 94.2-99.8), and the positive predictive value was 14.8% (95% CI: 6.6-27.1). The Beck Hopelessness Scale in Colombian patients with suicidality shows results similar to the original version, with adequate reliability and moderate concurrent and predictive validity. Copyright © 2016 SEP y SEPB. Publicado por Elsevier España, S.L.U. All rights reserved.

Reliability and validity of a treatment fidelity assessment for motivational interviewing targeting sexual risk behaviors in people living with HIV/AIDS.

PubMed

Seng, Elizabeth K; Lovejoy, Travis I

2013-12-01

This study psychometrically evaluates the Motivational Interviewing Treatment Integrity Code (MITI) to assess fidelity to motivational interviewing to reduce sexual risk behaviors in people living with HIV/AIDS. 74 sessions from a pilot randomized controlled trial of motivational interviewing to reduce sexual risk behaviors in people living with HIV were coded with the MITI. Participants reported sexual behavior at baseline, 3-month, and 6-months. Regarding reliability, excellent inter-rater reliability was achieved for measures of behavior frequency across the 12 sessions coded by both coders; global scales demonstrated poor intraclass correlations, but adequate percent agreement. Regarding validity, principle components analyses indicated that a two-factor model accounted for an adequate amount of variance in the data. These factors were associated with decreases in sexual risk behaviors after treatment. The MITI is a reliable and valid measurement of treatment fidelity for motivational interviewing targeting sexual risk behaviors in people living with HIV/AIDS.

The development and validation of a carer questionnaire to assess cognitive function in neuropsychiatric patients.

PubMed

Randhawa, Sharan; Walterfang, Mark; Miller, Kathryn; Scholes, Amelia; Mocellin, Ramon; Velakoulis, Dennis

2007-07-01

The carer history is an integral part of the assessment of patients with cognitive impairment. We aimed to develop a comprehensive yet concise carer questionnaire, the CogRisk, which captures actuarial risk variables for cognitive impairment in addition to key symptoms suggestive of cognitive decline in a number of cognitive domains, and to then assess its validity and reliability in a neuropsychiatric population. Carers of patients assessed for cognitive impairment completed the CogRisk, and patients were clinically assessed using the Mini-Mental State Examination (MMSE) and Neuropsychiatry Unit COGnitive assessment tool (NUCOG). Reliability was assessed using test-retest and interrater measures and measures of internal consistency. Construct and concurrent validity was assessed using correlation between total and subscale scores on the CogRisk, total scores on the NUCOG and MMSE, and subscale scores on the NUCOG. Predictive validity was determined using measures of sensitivity and specificity and using receiver operating characteristic (ROC) methods. The CogRisk was completed by all carers in less than 10 min. The total CogRisk score correlated significantly with total MMSE and NUCOG scores (r=-0.511 and -0.563, respectively) and remained highly significant when age and education were controlled for. Internal consistency of CogRisk items was high (alpha=0.943). Intrarater reliability of the CogRisk was high with an intraclass correlation coefficient of .978 (P<.001), and interrater reliability between carers was also high at 0.868 (P<.05). Sensitivity and specificity for the detection of dementia were .70 and .73, respectively, with area under the ROC curve not significantly different from that of the MMSE or NUCOG. The CogRisk is a brief carer-rated tool of a patient's cognitive functioning developed for use within a neuropsychiatric setting. It exhibited good concurrent validity, internal consistency, and interrater and intrarater reliability. The CogRisk also

Risk Assessments by Female Victims of Intimate Partner Violence: Predictors of Risk Perceptions and Comparison to an Actuarial Measure

ERIC Educational Resources Information Center

Connor-Smith, Jennifer K.; Henning, Kris; Moore, Stephanie; Holdford, Robert

2011-01-01

Recent studies support the validity of both structured risk assessment tools and victim perceptions as predictors of risk for repeat intimate partner violence (IPV). Combining structured risk assessments and victim risk assessments leads to better predictions of repeat violence than either alone, suggesting that the two forms of assessment provide…

Braden scale (ALB) for assessing pressure ulcer risk in hospital patients: A validity and reliability study.

PubMed

Chen, Hong-Lin; Cao, Ying-Juan; Zhang, Wei; Wang, Jing; Huai, Bao-Sha

2017-02-01

The inter-rater reliability of Braden Scale is not so good. We modified the Braden(ALB) scale by defining nutrition subscale based on serum albumin, then assessed it's the validity and reliability in hospital patients. We designed a retrospective study for validity analysis, and a prospective study for reliability analysis. Receiver operating curve (ROC) and area under the curve (AUC) were used to evaluate the predictive validity. Intra-class correlation coefficient (ICC) was used to investigate the inter-rater reliability. Two thousand five hundred twenty-five patients were included for validity analysis, 76 patients (3.0%) developed pressure ulcer. Positive correlation was found between serum albumin and nutrition score in Braden scale (Spearman's coefficient 0.2203, P<0.0001). The AUCs for Braden scale and Braden(ALB) scale predicting pressure ulcer risk were 0.813 (95% CI 0.797-0.828; P<0.0001), and 0.859 (95% CI 0.845-0.872; P<0.0001), respectively. The Braden(ALB) scale was even more valid than the Braden scale (z=1.860, P=0.0628). In different age subgroups, the Braden(ALB) scale seems also more valid than the original Braden scale, but no statistically significant differences were found (P>0.05). The inter-rater reliability study showed the ICC-value for nutrition increased 45.9%, and increased 4.3% for total score. The Braden(ALB) scale has similar validity compared with the original Braden scale for in hospital patients. However, the inter-rater reliability was significantly increased. Copyright © 2016 Elsevier Inc. All rights reserved.

Health risk assessment and the practice of industrial hygiene.

PubMed

Paustenbach, D J

1990-07-01

It has been claimed that there may be as many as 2000 airborne chemicals to which persons could be exposed in the workplace and in the community. Of these, occupational exposure limits have been set for approximately 700 chemicals, and only about 30 chemicals have limits for the ambient air. It is likely that some type of health risk assessment methodology will be used to establish limits for the remainder. Although these methods have been used for over 10 yr to set environmental limits, each step of the process (hazard identification, dose-response assessment, exposure assessment, and risk characterization) contains a number of traps into which scientists and risk managers can fall. For example, regulatory approaches to the hazard identification step have allowed little discrimination between the various animal carcinogens, even though these chemicals can vary greatly in their potency and mechanisms of action. In general, epidemiology data have been given little weight compared to the results of rodent bioassays. The dose-response extrapolation process, as generally practiced, often does not present the range of equally plausible values. Procedures which acknowledge and quantitatively account for some or all of the different classes of chemical carcinogens have not been widely adopted. For example, physiologically based pharmacokinetic (PB-PK) and biologically based models need to become a part of future risk assessments. The exposure evaluation portion of risk assessments can now be significantly more valid because of better dispersion models, validated exposure parameters, and the use of computers to account for complex environmental factors. Using these procedures, industrial hygienists are now able to quantitatively estimate the risks caused not only by the inhalation of chemicals but also those caused by dermal contact and incidental ingestion. The appropriate use of risk assessment methods should allow scientists and risk managers to set scientifically valid

The Structured Assessment of Violence Risk in Adults with Intellectual Disability: A Systematic Review.

PubMed

Hounsome, J; Whittington, R; Brown, A; Greenhill, B; McGuire, J

2018-01-01

While structured professional judgement approaches to assessing and managing the risk of violence have been extensively examined in mental health/forensic settings, the application of the findings to people with an intellectual disability is less extensively researched and reviewed. This review aimed to assess whether risk assessment tools have adequate predictive validity for violence in adults with an intellectual disability. Standard systematic review methodology was used to identify and synthesize appropriate studies. A total of 14 studies were identified as meeting the inclusion criteria. These studies assessed the predictive validity of 18 different risk assessment tools, mainly in forensic settings. All studies concluded that the tools assessed were successful in predicting violence. Studies were generally of a high quality. There is good quality evidence that risk assessment tools are valid for people with intellectual disability who offend but further research is required to validate tools for use with people with intellectual disability who offend. © 2016 John Wiley & Sons Ltd.

Women's Drinking Decisions in Heterosocial Situations: Development and Validation of Scenarios to Assess Influence of Attraction and Risk-Awareness.

PubMed

Noel, Nora E; Ogle, Richard L; Maisto, Stephen A; Jackson, Lee A; Loomis, Randi B; Heaton, Jennifer A

2016-07-01

These three related studies created a set of ecologically valid scenarios for assessing relative associations of both attraction and sexual coercion risk-recognition in college women's heterosocial situational drinking decisions. The first study constructed nine scenarios using input from heterosexual drinking women in the age cohort (18-30) most likely to experience alcohol-related sexual coercion. In the second study, 50 female undergraduates (ages 18-25) assessed the salience of three important dimensions (attraction, risk, and realism) in these scenarios. The third study was a factor analysis (and a follow-up confirmatory factor analysis) of the elements of coercion-risk as perceived by the target group with two female samples recruited 1 year apart (Sample 1: N = 157, ages 18-29); Sample 2: N = 157, ages 18-30). Results confirmed that the scenarios could be a useful vehicle for assessing how women balance out risk and attraction to make in-the moment heterosocial drinking decisions. The factor analysis showed participants perceived two types of situations, based on whether the male character was "Familiar" or "Just Met" and perceived themselves as happier and more excited with Familiar males. However, in contrast to HIV risk studies, Familiar males were perceived as higher risk for unwanted sex. Future research will use the six scenarios that emerged from the factor analysis to study how attraction and risk perception differentially affect young adult women's social drinking decisions.

Operationalization Of The Professional Risks Assessment Activity

NASA Astrophysics Data System (ADS)

Ivascu, Victoria Larisa; Cirjaliu, Bianca; Draghici, Anca

2015-07-01

Professional risks assessment approach (integration of analysis and evaluation processes) is linked with the general concerns of nowadays companies for their employees' health and safety assurances, in the context of organizations sustainable development. The paper presents an approach for the operationalization of the professional risk assessment activity in companies through the implementation and use of the OnRisk platform (this have been tested in some industrial companies). The short presentation of the relevant technical reports and statistics on OSH management at the European Union level underlines the need for the development of a professional risks assessment. Finally, there have been described the designed and developed OnRisk platform as a web platform together with some case studies that have validate the created tool.

Australian validation of the Cancer of the Prostate Risk Assessment Post-Surgical score to predict biochemical recurrence after radical prostatectomy.

PubMed

Beckmann, Kerri; O'Callaghan, Michael; Vincent, Andrew; Roder, David; Millar, Jeremy; Evans, Sue; McNeil, John; Moretti, Kim

2018-03-01

The Cancer of the Prostate Risk Assessment Post-Surgical (CAPRA-S) score is a simple post-operative risk assessment tool predicting disease recurrence after radical prostatectomy, which is easily calculated using available clinical data. To be widely useful, risk tools require multiple external validations. We aimed to validate the CAPRA-S score in an Australian multi-institutional population, including private and public settings and reflecting community practice. The study population were all men on the South Australian Prostate Cancer Clinical Outcomes Collaborative Database with localized prostate cancer diagnosed during 1998-2013, who underwent radical prostatectomy without adjuvant therapy (n = 1664). Predictive performance was assessed via Kaplan-Meier and Cox proportional regression analyses, Harrell's Concordance index, calibration plots and decision curve analysis. Biochemical recurrence occurred in 342 (21%) cases. Five-year recurrence-free probabilities for CAPRA-S scores indicating low (0-2), intermediate (3-5) and high risk were 95, 79 and 46%, respectively. The hazard ratio for CAPRA-S score increments was 1.56 (95% confidence interval 1.49-1.64). The Concordance index for 5-year recurrence-free survival was 0.77. The calibration plot showed good correlation between predicted and observed recurrence-free survival across scores. Limitations include the retrospective nature and small numbers with higher CAPRA-S scores. The CAPRA-S score is an accurate predictor of recurrence after radical prostatectomy in our cohort, supporting its utility in the Australian setting. This simple tool can assist in post-surgical selection of patients who would benefit from adjuvant therapy while avoiding morbidity among those less likely to benefit. © 2017 Royal Australasian College of Surgeons.

Validity and reliability of a structured interview for early detection and risk assessment of parenting and developmental problems in young children: a cross-sectional study

PubMed Central

2012-01-01

Background Preventive child health care is well suited for the early detection of parenting and developmental problems. However, as far as the younger age group is concerned, there are no validated early detection instruments which cover both the child and its environment. Therefore, we have developed a broad-scope structured interview which assesses parents’ concerns and their need for support, using both the parental perspective and the experience of the child health care nurse: the Structured Problem Analysis of Raising Kids (SPARK). This study reports the psychometric characteristics of the SPARK. Method A cross-sectional study of 2012 18-month-old children, living in Zeeland, a province of the Netherlands. Inter-rater reliability was assessed in 67 children. Convergent validity was assessed by comparing SPARK-domains with domains in self-report questionnaires on child development and parenting stress. Discriminative validity was assessed by comparing different outcomes of the SPARK between groups with different levels of socio-economic status and by performing an extreme-groups comparison. The user experience of both parents and nurses was assessed with the aid of an online survey. Results The response rate was 92.1% for the SPARK. Self-report questionnaires were returned in the case of 66.9% of the remaining 1721 children. There was selective non-reporting: 33.1% of the questionnaires were not returned, covering 65.2% of the children with a high-risk label according to the SPARK (p < 0.001). Inter-rater reliability was good to excellent with intraclass correlations between 0.85 and 1.0 for physical topics; between 0.61 and 0.8 for social-emotional topics and 0.92 for the overall risk assessment. Convergent validity was unexpectedly low (all correlations ≤0.3) although the pattern was as expected. Discriminative validity was good. Users were satisfied with the SPARK and identified some topics for improvement. Conclusion The SPARK discriminates between

Automated assessment of imaging biomarkers for the PanCan lung cancer risk prediction model with validation on NLST data

NASA Astrophysics Data System (ADS)

Wiemker, Rafael; Sevenster, Merlijn; MacMahon, Heber; Li, Feng; Dalal, Sandeep; Tahmasebi, Amir; Klinder, Tobias

2017-03-01

The imaging biomarkers EmphysemaPresence and NoduleSpiculation are crucial inputs for most models aiming to predict the risk of indeterminate pulmonary nodules detected at CT screening. To increase reproducibility and to accelerate screening workflow it is desirable to assess these biomarkers automatically. Validation on NLST images indicates that standard histogram measures are not sufficient to assess EmphysemaPresence in screenees. However, automatic scoring of bulla-resembling low attenuation areas can achieve agreement with experts with close to 80% sensitivity and specificity. NoduleSpiculation can be automatically assessed with similar accuracy. We find a dedicated spiculi tracing score to slightly outperform generic combinations of texture features with classifiers.

An Integrative Review of Pediatric Fall Risk Assessment Tools.

PubMed

DiGerolamo, Kimberly; Davis, Katherine Finn

Patient fall prevention begins with accurate risk assessment. However, sustained improvements in prevention and quality of care include use of validated fall risk assessment tools (FRATs). The goal of FRATs is to identify patients at highest risk. Adult FRATs are often borrowed from to create tools for pediatric patients. Though factors associated with pediatric falls in the hospital setting are similar to those in adults, such as mobility, medication use, and cognitive impairment, adult FRATs and the factors associated with them do not adequately assess risk in children. Articles were limited to English language, ages 0-21years, and publish date 2006-2015. The search yielded 22 articles. Ten were excluded as the population was primarily adult or lacked discussion of a FRAT. Critical appraisal and findings were synthesized using the Johns Hopkins Nursing evidence appraisal system. Twelve articles relevant to fall prevention in the pediatric hospital setting that discussed fall risk assessment and use of a FRAT were reviewed. Comparison between and accuracy of FRATs is challenged when different classifications, definitions, risk stratification, and inclusion criteria are used. Though there are several pediatric FRATs published in the literature, none have been found to be reliable and valid across institutions and diverse populations. This integrative review highlights the importance of choosing a FRAT based on an institution's identified risk factors and validating the tool for one's own patient population as well as using the tool in conjunction with nursing clinical judgment to guide interventions. Copyright © 2017 Elsevier Inc. All rights reserved.

QUANTITATIVE CANCER RISK ASSESSMENT METHODOLOGY USING SHORT-TERM GENETIC BIOASSAYS: THE COMPARATIVE POTENCY METHOD

EPA Science Inventory

Quantitative risk assessment is fraught with many uncertainties. The validity of the assumptions underlying the methods employed are often difficult to test or validate. Cancer risk assessment has generally employed either human epidemiological data from relatively high occupatio...

Evaluation of biologic occupational risk control practices: quality indicators development and validation.

PubMed

Takahashi, Renata Ferreira; Gryschek, Anna Luíza F P L; Izumi Nichiata, Lúcia Yasuko; Lacerda, Rúbia Aparecida; Ciosak, Suely Itsuko; Gir, Elucir; Padoveze, Maria Clara

2010-05-01

There is growing demand for the adoption of qualification systems for health care practices. This study is aimed at describing the development and validation of indicators for evaluation of biologic occupational risk control programs. The study involved 3 stages: (1) setting up a research team, (2) development of indicators, and (3) validation of the indicators by a team of specialists recruited to validate each attribute of the developed indicators. The content validation method was used for the validation, and a psychometric scale was developed for the specialists' assessment. A consensus technique was used, and every attribute that obtained a Content Validity Index of at least 0.75 was approved. Eight indicators were developed for the evaluation of the biologic occupational risk prevention program, with emphasis on accidents caused by sharp instruments and occupational tuberculosis prevention. The indicators included evaluation of the structure, process, and results at the prevention and biologic risk control levels. The majority of indicators achieved a favorable consensus regarding all validated attributes. The developed indicators were considered validated, and the method used for construction and validation proved to be effective. Copyright (c) 2010 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Mosby, Inc. All rights reserved.

Applying a weed risk assessment approach to GM crops.

PubMed

Keese, Paul K; Robold, Andrea V; Myers, Ruth C; Weisman, Sarah; Smith, Joe

2014-12-01

Current approaches to environmental risk assessment of genetically modified (GM) plants are modelled on chemical risk assessment methods, which have a strong focus on toxicity. There are additional types of harms posed by plants that have been extensively studied by weed scientists and incorporated into weed risk assessment methods. Weed risk assessment uses robust, validated methods that are widely applied to regulatory decision-making about potentially problematic plants. They are designed to encompass a broad variety of plant forms and traits in different environments, and can provide reliable conclusions even with limited data. The knowledge and experience that underpin weed risk assessment can be harnessed for environmental risk assessment of GM plants. A case study illustrates the application of the Australian post-border weed risk assessment approach to a representative GM plant. This approach is a valuable tool to identify potential risks from GM plants.

Development of the Hand Assessment for Infants: evidence of internal scale validity.

PubMed

Krumlinde-Sundholm, Lena; Ek, Linda; Sicola, Elisa; Sjöstrand, Lena; Guzzetta, Andrea; Sgandurra, Giuseppina; Cioni, Giovanni; Eliasson, Ann-Christin

2017-12-01

The aim of this study was to develop a descriptive and evaluative assessment of upper limb function for infants aged 3 to 12 months and to investigate its internal scale validity for use with infants at risk of unilateral cerebral palsy. The concepts of the test items and scoring criteria were developed. Internal scale validity and aspects of reliability were investigated on the basis of 156 assessments of infants at 3 to 12 months corrected age (mean 7.2mo, SD 2.5) with signs of asymmetric hand use. Rasch measurement model analysis and non-parametric statistics were used. The new test, the Hand Assessment for Infants (HAI), consists of 12 unimanual and five bimanual items, each scored on a 3-point rating scale. It demonstrated a unidimensional construct and good fit to the Rasch model requirements. The excellent person reliability enabled person separation to six significant ability strata. The HAI produced an interval-level measure of bilateral hand use as well as unimanual scores of each hand, allowing a quantification of possible asymmetry expressed as an asymmetry index. The HAI can be considered a valid assessment tool for measuring bilateral hand use and quantifying side difference between hands among infants at risk of developing unilateral cerebral palsy. The Hand Assessment for Infants (HAI) measures the use of both hands and quantifies a possible asymmetry of hand use. HAI is valid for infants at 3 to 12 months corrected age at risk of unilateral cerebral palsy. © 2017 Mac Keith Press.

45 CFR 153.350 - Risk adjustment data validation standards.

Code of Federal Regulations, 2012 CFR

2012-10-01

... implementation of any risk adjustment software and ensure proper validation of a statistically valid sample of... respect to implementation of risk adjustment software or as a result of data validation conducted pursuant... implementation of risk adjustment software or data validation. ...

Prediction of prostate cancer in unscreened men: external validation of a risk calculator.

PubMed

van Vugt, Heidi A; Roobol, Monique J; Kranse, Ries; Määttänen, Liisa; Finne, Patrik; Hugosson, Jonas; Bangma, Chris H; Schröder, Fritz H; Steyerberg, Ewout W

2011-04-01

Prediction models need external validation to assess their value beyond the setting where the model was derived from. To assess the external validity of the European Randomized study of Screening for Prostate Cancer (ERSPC) risk calculator (www.prostatecancer-riskcalculator.com) for the probability of having a positive prostate biopsy (P(posb)). The ERSPC risk calculator was based on data of the initial screening round of the ERSPC section Rotterdam and validated in 1825 and 531 men biopsied at the initial screening round in the Finnish and Swedish sections of the ERSPC respectively. P(posb) was calculated using serum prostate specific antigen (PSA), outcome of digital rectal examination (DRE), transrectal ultrasound and ultrasound assessed prostate volume. The external validity was assessed for the presence of cancer at biopsy by calibration (agreement between observed and predicted outcomes), discrimination (separation of those with and without cancer), and decision curves (for clinical usefulness). Prostate cancer was detected in 469 men (26%) of the Finnish cohort and in 124 men (23%) of the Swedish cohort. Systematic miscalibration was present in both cohorts (mean predicted probability 34% versus 26% observed, and 29% versus 23% observed, both p<0.001). The areas under the curves were 0.76 and 0.78, and substantially lower for the model with PSA only (0.64 and 0.68 respectively). The model proved clinically useful for any decision threshold compared with a model with PSA only, PSA and DRE, or biopsying all men. A limitation is that the model is based on sextant biopsies results. The ERSPC risk calculator discriminated well between those with and without prostate cancer among initially screened men, but overestimated the risk of a positive biopsy. Further research is necessary to assess the performance and applicability of the ERSPC risk calculator when a clinical setting is considered rather than a screening setting. Copyright © 2010 Elsevier Ltd. All rights

Older adult mistreatment risk screening: contribution to the validation of a screening tool in a domestic setting.

PubMed

Lindenbach, Jeannette M; Larocque, Sylvie; Lavoie, Anne-Marise; Garceau, Marie-Luce

2012-06-01

ABSTRACTThe hidden nature of older adult mistreatment renders its detection in the domestic setting particularly challenging. A validated screening instrument that can provide a systematic assessment of risk factors can facilitate this detection. One such instrument, the "expanded Indicators of Abuse" tool, has been previously validated in the Hebrew language in a hospital setting. The present study has contributed to the validation of the "e-IOA" in an English-speaking community setting in Ontario, Canada. It consisted of two phases: (a) a content validity review and adaptation of the instrument by experts throughout Ontario, and (b) an inter-rater reliability assessment by home visiting nurses. The adaptation, the "Mistreatment of Older Adult Risk Factors" tool, offers a comprehensive tool for screening in the home setting. This instrument is significant to professional practice as practitioners working with older adults will be better equipped to assess for risk of mistreatment.

Bimodal fuzzy analytic hierarchy process (BFAHP) for coronary heart disease risk assessment.

PubMed

Sabahi, Farnaz

2018-04-04

Rooted deeply in medical multiple criteria decision-making (MCDM), risk assessment is very important especially when applied to the risk of being affected by deadly diseases such as coronary heart disease (CHD). CHD risk assessment is a stochastic, uncertain, and highly dynamic process influenced by various known and unknown variables. In recent years, there has been a great interest in fuzzy analytic hierarchy process (FAHP), a popular methodology for dealing with uncertainty in MCDM. This paper proposes a new FAHP, bimodal fuzzy analytic hierarchy process (BFAHP) that augments two aspects of knowledge, probability and validity, to fuzzy numbers to better deal with uncertainty. In BFAHP, fuzzy validity is computed by aggregating the validities of relevant risk factors based on expert knowledge and collective intelligence. By considering both soft and statistical data, we compute the fuzzy probability of risk factors using the Bayesian formulation. In BFAHP approach, these fuzzy validities and fuzzy probabilities are used to construct a reciprocal comparison matrix. We then aggregate fuzzy probabilities and fuzzy validities in a pairwise manner for each risk factor and each alternative. BFAHP decides about being affected and not being affected by ranking of high and low risks. For evaluation, the proposed approach is applied to the risk of being affected by CHD using a real dataset of 152 patients of Iranian hospitals. Simulation results confirm that adding validity in a fuzzy manner can accrue more confidence of results and clinically useful especially in the face of incomplete information when compared with actual results. Applying the proposed BFAHP on CHD risk assessment of the dataset, it yields high accuracy rate above 85% for correct prediction. In addition, this paper recognizes that the risk factors of diastolic blood pressure in men and high-density lipoprotein in women are more important in CHD than other risk factors. Copyright © 2018 Elsevier Inc. All

Comparison of seven fall risk assessment tools in community-dwelling Korean older women.

PubMed

Kim, Taekyoung; Xiong, Shuping

2017-03-01

This study aimed to compare seven widely used fall risk assessment tools in terms of validity and practicality, and to provide a guideline for choosing appropriate fall risk assessment tools for elderly Koreans. Sixty community-dwelling Korean older women (30 fallers and 30 matched non-fallers) were evaluated. Performance measures of all tools were compared between the faller and non-faller groups through two sample t-tests. Receiver Operating Characteristic curves were generated with odds ratios for discriminant analysis. Results showed that four tools had significant discriminative power, and the shortened version of Falls Efficacy Scale (SFES) showed excellent discriminant validity, followed by Berg Balance Scale (BBS) with acceptable discriminant validity. The Mini Balance Evaluation System Test and Timed Up and Go, however, had limited discriminant validities. In terms of practicality, SFES was also excellent. These findings suggest that SFES is the most suitable tool for assessing the fall risks of community-dwelling Korean older women, followed by BBS. Practitioner Summary: There is no general guideline on which fall risk assessment tools are suitable for community-dwelling Korean older women. This study compared seven widely used assessment tools in terms of validity and practicality. Results suggested that the short Falls Efficacy Scale is the most suitable tool, followed by Berg Balance Scale.

Determining when to conduct a violence risk assessment: Development and initial validation of the Fordham Risk Screening Tool (FRST).

PubMed

Rosenfeld, Barry; Foellmi, Melodie; Khadivi, Ali; Wijetunga, Charity; Howe, Jacqueline; Nijdam-Jones, Alicia; Grover, Shana; Rotter, Merrill

2017-08-01

Techniques to assess violence risk are increasingly common, but no systematic approach exists to help clinicians decide which psychiatric patients are most in need of a violence risk assessment. The Fordham Risk Screening Tool (FRST) was designed to fill this void, providing a structured, systematic approach to screening psychiatric patients and determining the need for further, more thorough violence risk assessment. The FRST was administered to a sample of 210 consecutive admissions to the civil psychiatric units of an urban medical center, 159 of whom were subsequently evaluated using the Historical Clinical Risk Management-20, version 3, to determine violence risk. The FRST showed a high degree of sensitivity (93%) in identifying patients subsequently deemed to be at high risk for violence (based on the Case Prioritization risk rating). The FRST also identified all of the patients (100%) rated high in potential for severe violence (based on the Serious Physical Harm Historical Clinical Risk Management-20, version 3, summary risk rating). Sensitivity was more modest when individuals rated as moderate risk were included as the criterion (rather than only those identified as high risk). Specificity was also moderate, screening out approximately half of all participants as not needing further risk assessment. A systematic approach to risk screening is clearly needed to prioritize psychiatric admissions for thorough risk assessment, and the FRST appears to be a potentially valuable step in that process. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Validity Issues in Clinical Assessment.

ERIC Educational Resources Information Center

Foster, Sharon L.; Cone, John D.

1995-01-01

Validation issues that arise with measures of constructs and behavior are addressed with reference to general reasons for using assessment procedures in clinical psychology. A distinction is made between the representational phase of validity assessment and the elaborative validity phase in which the meaning and utility of scores are examined.…

Validation of a multimarker model for assessing risk of type 2 diabetes from a five-year prospective study of 6784 Danish people (Inter99).

PubMed

Urdea, Mickey; Kolberg, Janice; Wilber, Judith; Gerwien, Robert; Moler, Edward; Rowe, Michael; Jorgensen, Paul; Hansen, Torben; Pedersen, Oluf; Jørgensen, Torben; Borch-Johnsen, Knut

2009-07-01

Improved identification of subjects at high risk for development of type 2 diabetes would allow preventive interventions to be targeted toward individuals most likely to benefit. In previous research, predictive biomarkers were identified and used to develop multivariate models to assess an individual's risk of developing diabetes. Here we describe the training and validation of the PreDx Diabetes Risk Score (DRS) model in a clinical laboratory setting using baseline serum samples from subjects in the Inter99 cohort, a population-based primary prevention study of cardiovascular disease. Among 6784 subjects free of diabetes at baseline, 215 subjects progressed to diabetes (converters) during five years of follow-up. A nested case-control study was performed using serum samples from 202 converters and 597 randomly selected nonconverters. Samples were randomly assigned to equally sized training and validation sets. Seven biomarkers were measured using assays developed for use in a clinical reference laboratory. The PreDx DRS model performed better on the training set (area under the curve [AUC] = 0.837) than fasting plasma glucose alone (AUC = 0.779). When applied to the sequestered validation set, the PreDx DRS showed the same performance (AUC = 0.838), thus validating the model. This model had a better AUC than any other single measure from a fasting sample. Moreover, the model provided further risk stratification among high-risk subpopulations with impaired fasting glucose or metabolic syndrome. The PreDx DRS provides the absolute risk of diabetes conversion in five years for subjects identified to be "at risk" using the clinical factors. Copyright 2009 Diabetes Technology Society.

Validation of risk assessment scoring systems for an audit of elective surgery for gastrointestinal cancer in elderly patients: an audit.

PubMed

Wakabayashi, Hisao; Sano, Takanori; Yachida, Shinichi; Okano, Keiichi; Izuishi, Kunihiko; Suzuki, Yasuyuki

2007-10-01

The goal of this study was to validate the usefulness of risk assessment scoring systems for a surgical audit in elective digestive surgery for elderly patients. The validated scoring systems used were the Physiological and Operative Severity Score for enUmeration of Mortality and morbidity (POSSUM) and the Portsmouth predictor equation for mortality (P-POSSUM). This study involved 153 consecutive patients aged 75 years and older who underwent elective gastric or colorectal surgery between July 2004 and June 2006. A retrospective analysis was performed on data collected prior to each surgery. The predicted mortality and morbidity risks were calculated using each of the scoring systems and were used to obtain the observed/predicted (O/E) mortality and morbidity ratios. New logistic regression equations for morbidity and mortality were then calculated using the scores from the POSSUM system and applied retrospectively. The O/E ratio for morbidity obtained from POSSUM score was 0.23. The O/E ratios for mortality from the POSSUM score and the P-POSSUM were 0.15 and 0.38, respectively. Utilizing the new equations using scores from the POSSUM, the O/E ratio increased to 0.88. Both the POSSUM and P-POSSUM over-predicted the morbidity and mortality in elective gastrointestinal surgery for malignant tumors in elderly patients. However, if a surgical unit makes appropriate calculations using its own patient series and updates these equations, the POSSUM system can be useful in the risk assessment for surgery in elderly patients.

Development and validation of risk models and molecular diagnostics to permit personalized management of cancer.

PubMed

Pu, Xia; Ye, Yuanqing; Wu, Xifeng

2014-01-01

Despite the advances made in cancer management over the past few decades, improvements in cancer diagnosis and prognosis are still poor, highlighting the need for individualized strategies. Toward this goal, risk prediction models and molecular diagnostic tools have been developed, tailoring each step of risk assessment from diagnosis to treatment and clinical outcomes based on the individual's clinical, epidemiological, and molecular profiles. These approaches hold increasing promise for delivering a new paradigm to maximize the efficiency of cancer surveillance and efficacy of treatment. However, they require stringent study design, methodology development, comprehensive assessment of biomarkers and risk factors, and extensive validation to ensure their overall usefulness for clinical translation. In the current study, the authors conducted a systematic review using breast cancer as an example and provide general guidelines for risk prediction models and molecular diagnostic tools, including development, assessment, and validation. © 2013 American Cancer Society.

The Comprehensive Risk Assessment for Bypass (CRAB) facilitates efficient perioperative risk assessment for patients with critical limb ischemia.

PubMed

Meltzer, Andrew J; Graham, Ashley; Connolly, Peter H; Meltzer, Ellen C; Karwowski, John K; Bush, Harry L; Schneider, Darren B

2013-05-01

Specific perioperative risk assessment models have been developed for bariatric, pancreatic, and colorectal surgery. A similar instrument, specific for patients with critical limb ischemia (CLI), could improve patient-centered clinical decision making. We describe a novel tool to predict 30-day major morbidity and mortality (M&M) after bypass surgery for CLI. Data for 4985 individuals from the 2007 to 2009 National Surgical Quality Improvement Program were used to develop and internally validate the model. Outcome measures included mortality, major morbidity, and a composite end point (M&M). M&M included mortality and the most severe postoperative morbidities that were highly associated with death (eg, sepsis and major cardiopulmonary complications). More than 30 preoperative factors were tested for association with 30-day mortality, major morbidity, and M&M. Significant predictors in multivariate models were assigned integer values (points), which were added to calculate a patient's Comprehensive Risk Assessment For Bypass (CRAB) score. Performance was assessed (C-index) across all outcome measures and compared with other general tools (American Society of Anesthesiologists class, Surgical Risk Scale) and existing CLI-specific survival prediction models (Finnvasc score, Edifoligide for the Prevention of Infrainguinal Vein Graft Failure [PREVENT III] score) on a distinct validation sample (n = 1620). In the derivation data set (n = 3275), the 30-day mortality rate was 2.9%. The rate of any major morbidity was 19.1%. The composite end point M&M occurred in 10.1%. Significant predictors of M&M by multivariate analysis included age >75 years, prior amputation or revascularization, tissue loss, dialysis dependence, severe cardiac disease, emergency operation, and functional dependence. Applied to a distinct validation sample of 1620 patients, higher CRAB scores were significantly associated with higher rates of mortality, all major morbidities, and M&M (P < .0001

Validation of an imaging based cardiovascular risk score in a Scottish population.

PubMed

Kockelkoren, Remko; Jairam, Pushpa M; Murchison, John T; Debray, Thomas P A; Mirsadraee, Saeed; van der Graaf, Yolanda; Jong, Pim A de; van Beek, Edwin J R

2018-01-01

A radiological risk score that determines 5-year cardiovascular disease (CVD) risk using routine care CT and patient information readily available to radiologists was previously developed. External validation in a Scottish population was performed to assess the applicability and validity of the risk score in other populations. 2915 subjects aged ≥40 years who underwent routine clinical chest CT scanning for non-cardiovascular diagnostic indications were followed up until first diagnosis of, or death from, CVD. Using a case-cohort approach, all cases and a random sample of 20% of the participant's CT examinations were visually graded for cardiovascular calcifications and cardiac diameter was measured. The radiological risk score was determined using imaging findings, age, gender, and CT indication. Performance on 5-year CVD risk prediction was assessed. 384 events occurred in 2124 subjects during a mean follow-up of 4.25 years (0-6.4 years). The risk score demonstrated reasonable performance in the studied population. Calibration showed good agreement between actual and 5-year predicted risk of CVD. The c-statistic was 0.71 (95%CI:0.67-0.75). The radiological CVD risk score performed adequately in the Scottish population offering a potential novel strategy for identifying patients at high risk for developing cardiovascular disease using routine care CT data. Copyright © 2017 Elsevier B.V. All rights reserved.

Risk assessment model for development of advanced age-related macular degeneration.

PubMed

Klein, Michael L; Francis, Peter J; Ferris, Frederick L; Hamon, Sara C; Clemons, Traci E

2011-12-01

To design a risk assessment model for development of advanced age-related macular degeneration (AMD) incorporating phenotypic, demographic, environmental, and genetic risk factors. We evaluated longitudinal data from 2846 participants in the Age-Related Eye Disease Study. At baseline, these individuals had all levels of AMD, ranging from none to unilateral advanced AMD (neovascular or geographic atrophy). Follow-up averaged 9.3 years. We performed a Cox proportional hazards analysis with demographic, environmental, phenotypic, and genetic covariates and constructed a risk assessment model for development of advanced AMD. Performance of the model was evaluated using the C statistic and the Brier score and externally validated in participants in the Complications of Age-Related Macular Degeneration Prevention Trial. The final model included the following independent variables: age, smoking history, family history of AMD (first-degree member), phenotype based on a modified Age-Related Eye Disease Study simple scale score, and genetic variants CFH Y402H and ARMS2 A69S. The model did well on performance measures, with very good discrimination (C statistic = 0.872) and excellent calibration and overall performance (Brier score at 5 years = 0.08). Successful external validation was performed, and a risk assessment tool was designed for use with or without the genetic component. We constructed a risk assessment model for development of advanced AMD. The model performed well on measures of discrimination, calibration, and overall performance and was successfully externally validated. This risk assessment tool is available for online use.

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

Initial clinical validation of Health Heritage, a patient-facing tool for personal and family history collection and cancer risk assessment.

PubMed

Baumgart, Leigh A; Postula, Kristen J Vogel; Knaus, William A

2016-04-01

Personal and family health histories remain important independent risk factors for cancer; however they are currently not being well collected or used effectively. Health Heritage was designed to address this need. The purpose of this study was to validate the ability of Health Heritage to identify patients appropriate for further genetic evaluation and to accurately stratify cancer risk. A retrospective chart review was conducted on 100 random patients seen at an adult genetics clinic presenting with concern for an inherited predisposition to cancer. Relevant personal and family history obtained from the patients' medical records was entered into Health Heritage. Recommendations by Health Heritage were compared to national guidelines of eligibility for genetic evaluation. Agreement between Health Heritage referral for genetic evaluation and guideline eligibility for genetic evaluation was 97% (sensitivity 98% and specificity 88%). Risk stratification for cancer was also compared between Health Heritage and those documented by a geneticist. For patients at increased risk for breast, ovarian, or colorectal cancer as determined by the geneticist, risk stratification by Health Heritage agreed 90, 93, and 75%, respectively. Discordances in risk stratification were attributed to both complex situations better handled by the geneticist and Health Heritage's adherence to incorporating all information into its algorithms. Health Heritage is a clinically valid tool to identify patients appropriate for further genetic evaluation and to encourage them to confirm the assessment and management recommendations with cancer genetic experts. Health Heritage also provides an estimate of cancer risk that is complementary to a genetics team.

Validation, residue analysis, and risk assessment of fipronil and flonicamid in cotton (Gossypium sp.) samples and soil.

PubMed

Chawla, Suchi; Gor, Hetal N; Patel, Hemlatta K; Parmar, Kaushik D; Patel, Anil R; Shukla, Varsha; Ilyas, Mohammad; Parsai, Satish K; Somashekar; Meena, Roop Singh; Shah, Paresh G

2018-05-04

Cotton crop is highly susceptible to attack by sucking pests. Being an important oilseed and feed crop, it is essential to monitor the pesticides and ensure health protection at consumer level. Therefore, a method was validated to estimate fipronil and flonicamid in various cotton samples and risk assessment was performed. Contamination of oil in the extracts from the various oil seeds and cake samples is a major problem as this oil contaminates the column and interferes with the detection of pesticides. The present manuscript for the first time describes successful analysis of the pesticides from various cotton samples including cotton oil, seed, and cake. Quick, easy, cheap, effective, rugged, and safe (QuEChERS)-based methods were validated for estimation of fipronil and flonicamid in cotton samples and in soil by LC-MS/MS. Recoveries were within the acceptable range of 70-120% with relative standard deviation ≤ 20% and HorRat values < 0.3-1.3. R 2 was > 0.99. Matrix effects of 150 and 13.5% were observed for fipronil and flonicamid, respectively, in cotton leaves. Limits of quantitation (LOQs) were in the range of 0.0004 to 0.004 mg kg -1 for fipronil and flonicamid. Cotton samples collected from a field study at different locations were analyzed. Half-life ranged from 2.2 to 5.8 for fipronil and 4.6 to 7.0 days for flonicamid. A pre-harvest interval of 33 days is suggested. The risk assessment studies at maximum residue level values showed HQ < 1 at pre-harvest interval (PHI). The methods being short and easy can be extended to estimate more types of pesticides in different oilseeds. Following a PHI of 33 days, fipronil and flonicamid can be used on cotton at standard dose. As the levels of fipronil and flonicamid were below determination limit in all the soils, the environmental risk is negligible.

Risk assessment of carcinogens in food.

PubMed

Barlow, Susan; Schlatter, Josef

2010-03-01

Approaches for the risk assessment of carcinogens in food have evolved as scientific knowledge has advanced. Early methods allowed little more than hazard identification and an indication of carcinogenic potency. Evaluation of the modes of action of carcinogens and their broad division into genotoxic and epigenetic (non-genotoxic, non-DNA reactive) carcinogens have played an increasing role in determining the approach followed and provide possibilities for more detailed risk characterisation, including provision of quantitative estimates of risk. Reliance on experimental animal data for the majority of risk assessments and the fact that human exposures to dietary carcinogens are often orders of magnitude below doses used in experimental studies has provided a fertile ground for discussion and diverging views on the most appropriate way to offer risk assessment advice. Approaches used by national and international bodies differ, with some offering numerical estimates of potential risks to human health, while others express considerable reservations about the validity of quantitative approaches requiring extrapolation of dose-response data below the observed range and instead offer qualitative advice. Recognising that qualitative advice alone does not provide risk managers with information on which to prioritise the need for risk management actions, a "margin of exposure" approach for substances that are both genotoxic and carcinogenic has been developed, which is now being used by the World Health Organization and the European Food Safety Authority. This review describes the evolution of risk assessment advice on carcinogens and discusses examples of ways in which carcinogens in food have been assessed in Europe.

Risk assessment of carcinogens in food

DOE Office of Scientific and Technical Information (OSTI.GOV)

Barlow, Susan, E-mail: suebarlow@mistral.co.u; Schlatter, Josef; Federal Office of Public Health, Consumer Protection Directorate, Stauffacherstrasse 101, CH-8004 Zuerich

2010-03-01

Approaches for the risk assessment of carcinogens in food have evolved as scientific knowledge has advanced. Early methods allowed little more than hazard identification and an indication of carcinogenic potency. Evaluation of the modes of action of carcinogens and their broad division into genotoxic and epigenetic (non-genotoxic, non-DNA reactive) carcinogens have played an increasing role in determining the approach followed and provide possibilities for more detailed risk characterisation, including provision of quantitative estimates of risk. Reliance on experimental animal data for the majority of risk assessments and the fact that human exposures to dietary carcinogens are often orders of magnitudemore » below doses used in experimental studies has provided a fertile ground for discussion and diverging views on the most appropriate way to offer risk assessment advice. Approaches used by national and international bodies differ, with some offering numerical estimates of potential risks to human health, while others express considerable reservations about the validity of quantitative approaches requiring extrapolation of dose-response data below the observed range and instead offer qualitative advice. Recognising that qualitative advice alone does not provide risk managers with information on which to prioritise the need for risk management actions, a 'margin of exposure' approach for substances that are both genotoxic and carcinogenic has been developed, which is now being used by the World Health Organization and the European Food Safety Authority. This review describes the evolution of risk assessment advice on carcinogens and discusses examples of ways in which carcinogens in food have been assessed in Europe.« less

Assessment Methodology for Process Validation Lifecycle Stage 3A.

PubMed

Sayeed-Desta, Naheed; Pazhayattil, Ajay Babu; Collins, Jordan; Chen, Shu; Ingram, Marzena; Spes, Jana

2017-07-01

The paper introduces evaluation methodologies and associated statistical approaches for process validation lifecycle Stage 3A. The assessment tools proposed can be applied to newly developed and launched small molecule as well as bio-pharma products, where substantial process and product knowledge has been gathered. The following elements may be included in Stage 3A: number of 3A batch determination; evaluation of critical material attributes, critical process parameters, critical quality attributes; in vivo in vitro correlation; estimation of inherent process variability (IPV) and PaCS index; process capability and quality dashboard (PCQd); and enhanced control strategy. US FDA guidance on Process Validation: General Principles and Practices, January 2011 encourages applying previous credible experience with suitably similar products and processes. A complete Stage 3A evaluation is a valuable resource for product development and future risk mitigation of similar products and processes. Elements of 3A assessment were developed to address industry and regulatory guidance requirements. The conclusions made provide sufficient information to make a scientific and risk-based decision on product robustness.

Evaluation of a model of violence risk assessment among forensic psychiatric patients.

PubMed

Douglas, Kevin S; Ogloff, James R P; Hart, Stephen D

2003-10-01

This study tested the interrater reliability and criterion-related validity of structured violence risk judgments made by using one application of the structured professional judgment model of violence risk assessment, the HCR-20 violence risk assessment scheme, which assesses 20 key risk factors in three domains: historical, clinical, and risk management. The HCR-20 was completed for a sample of 100 forensic psychiatric patients who had been found not guilty by reason of a mental disorder and were subsequently released to the community. Violence in the community was determined from multiple file-based sources. Interrater reliability of structured final risk judgments of low, moderate, or high violence risk made on the basis of the structured professional judgment model was acceptable (weighted kappa=.61). Structured final risk judgments were significantly predictive of postrelease community violence, yielding moderate to large effect sizes. Event history analyses showed that final risk judgments made with the structured professional judgment model added incremental validity to the HCR-20 used in an actuarial (numerical) sense. The findings support the structured professional judgment model of risk assessment as well as the HCR-20 specifically and suggest that clinical judgment, if made within a structured context, can contribute in meaningful ways to the assessment of violence risk.

Assessing, mapping and validating site-specific ecotoxicological risk for pesticide mixtures: a case study for small scale hot spots in aquatic and terrestrial environments.

PubMed

Vaj, Claudia; Barmaz, Stefania; Sørensen, Peter Borgen; Spurgeon, David; Vighi, Marco

2011-11-01

Mixture toxicity is a real world problem and as such requires risk assessment solutions that can be applied within different geographic regions, across different spatial scales and in situations where the quantity of data available for the assessment varies. Moreover, the need for site specific procedures for assessing ecotoxicological risk for non-target species in non-target ecosystems also has to be recognised. The work presented in the paper addresses the real world effects of pesticide mixtures on natural communities. Initially, the location of risk hotspots is theoretically estimated through exposure modelling and the use of available toxicity data to predict potential community effects. The concept of Concentration Addition (CA) is applied to describe responses resulting from exposure of multiple pesticides The developed and refined exposure models are georeferenced (GIS-based) and include environmental and physico-chemical parameters, and site specific information on pesticide usage and land use. As a test of the risk assessment framework, the procedures have been applied on a suitable study areas, notably the River Meolo basin (Northern Italy), a catchment characterised by intensive agriculture, as well as comparative area for some assessments. Within the studied areas, the risks for individual chemicals and complex mixtures have been assessed on aquatic and terrestrial aboveground and belowground communities. Results from ecological surveys have been used to validate these risk assessment model predictions. Value and limitation of the approaches are described and the possibilities for larger scale applications in risk assessment are also discussed. Copyright © 2011 Elsevier Inc. All rights reserved.

Validation of learning assessments: A primer.

PubMed

Peeters, Michael J; Martin, Beth A

2017-09-01

The Accreditation Council for Pharmacy Education's Standards 2016 has placed greater emphasis on validating educational assessments. In this paper, we describe validity, reliability, and validation principles, drawing attention to the conceptual change that highlights one validity with multiple evidence sources; to this end, we recommend abandoning historical (confusing) terminology associated with the term validity. Further, we describe and apply Kane's framework (scoring, generalization, extrapolation, and implications) for the process of validation, with its inferences and conclusions from varied uses of assessment instruments by different colleges and schools of pharmacy. We then offer five practical recommendations that can improve reporting of validation evidence in pharmacy education literature. We describe application of these recommendations, including examples of validation evidence in the context of pharmacy education. After reading this article, the reader should be able to understand the current concept of validation, and use a framework as they validate and communicate their own institution's learning assessments. Copyright © 2017 Elsevier Inc. All rights reserved.

Development and validation of the FRAGIRE tool for assessment an older person's risk for frailty.

PubMed

Vernerey, Dewi; Anota, Amelie; Vandel, Pierre; Paget-Bailly, Sophie; Dion, Michele; Bailly, Vanessa; Bonin, Marie; Pozet, Astrid; Foubert, Audrey; Benetkiewicz, Magdalena; Manckoundia, Patrick; Bonnetain, Franck

2016-11-17

Frailty is highly prevalent in elderly people. While significant progress has been made to understand its pathogenesis process, few validated questionnaire exist to assess the multidimensional concept of frailty and to detect people frail or at risk to become frail. The objectives of this study were to construct and validate a new frailty-screening instrument named Frailty Groupe Iso-Ressource Evaluation (FRAGIRE) that accurately predicts the risk for frailty in older adults. A prospective multicenter recruitment of the elderly patients was undertaken in France. The subjects were classified into financially-helped group (FH, with financial assistance) and non-financially helped group (NFH, without any financial assistance), considering FH subjects are more frail than the NFH group and thus representing an acceptable surrogate population for frailty. Psychometric properties of the FRAGIRE grid were assessed including discrimination between the FH and NFH groups. Items reduction was made according to statistical analyses and experts' point of view. The association between items response and tests with "help requested status" was assessed in univariate and multivariate unconditional logistic regression analyses and a prognostic score to become frail was finally proposed for each subject. Between May 2013 and July 2013, 385 subjects were included: 338 (88%) in the FH group and 47 (12%) in the NFH group. The initial FRAGIRE grid included 65 items. After conducting the item selection, the final grid of the FRAGIRE was reduced to 19 items. The final grid showed fair discrimination ability to predict frailty (area under the curve (AUC) = 0.85) and good calibration (Hosmer-Lemeshow P-value = 0.580), reflecting a good agreement between the prediction by the final model and actual observation. The Cronbach's alpha for the developed tool scored as high as 0.69 (95% Confidence Interval: 0.64 to 0.74). The final prognostic score was excellent, with an AUC of 0

45 CFR 153.350 - Risk adjustment data validation standards.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 45 Public Welfare 1 2013-10-01 2013-10-01 false Risk adjustment data validation standards. 153.350... validation standards. (a) General requirement. The State, or HHS on behalf of the State, must ensure proper implementation of any risk adjustment software and ensure proper validation of a statistically valid sample of...

45 CFR 153.350 - Risk adjustment data validation standards.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 1 2014-10-01 2014-10-01 false Risk adjustment data validation standards. 153.350... validation standards. (a) General requirement. The State, or HHS on behalf of the State, must ensure proper implementation of any risk adjustment software and ensure proper validation of a statistically valid sample of...

Computer-Aided Nodule Assessment and Risk Yield Risk Management of Adenocarcinoma: The Future of Imaging?

PubMed

Foley, Finbar; Rajagopalan, Srinivasan; Raghunath, Sushravya M; Boland, Jennifer M; Karwoski, Ronald A; Maldonado, Fabien; Bartholmai, Brian J; Peikert, Tobias

2016-01-01

Increased clinical use of chest high-resolution computed tomography results in increased identification of lung adenocarcinomas and persistent subsolid opacities. However, these lesions range from very indolent to extremely aggressive tumors. Clinically relevant diagnostic tools to noninvasively risk stratify and guide individualized management of these lesions are lacking. Research efforts investigating semiquantitative measures to decrease interrater and intrarater variability are emerging, and in some cases steps have been taken to automate this process. However, many such methods currently are still suboptimal, require validation and are not yet clinically applicable. The computer-aided nodule assessment and risk yield software application represents a validated tool for the automated, quantitative, and noninvasive tool for risk stratification of adenocarcinoma lung nodules. Computer-aided nodule assessment and risk yield correlates well with consensus histology and postsurgical patient outcomes, and therefore may help to guide individualized patient management, for example, in identification of nodules amenable to radiological surveillance, or in need of adjunctive therapy. Copyright © 2016 Elsevier Inc. All rights reserved.

Construct measurement quality improves predictive accuracy in violence risk assessment: an illustration using the personality assessment inventory.

PubMed

Hendry, Melissa C; Douglas, Kevin S; Winter, Elizabeth A; Edens, John F

2013-01-01

Much of the risk assessment literature has focused on the predictive validity of risk assessment tools. However, these tools often comprise a list of risk factors that are themselves complex constructs, and focusing on the quality of measurement of individual risk factors may improve the predictive validity of the tools. The present study illustrates this concern using the Antisocial Features and Aggression scales of the Personality Assessment Inventory (Morey, 1991). In a sample of 1,545 prison inmates and offenders undergoing treatment for substance abuse (85% male), we evaluated (a) the factorial validity of the ANT and AGG scales, (b) the utility of original ANT and AGG scales and newly derived ANT and AGG scales for predicting antisocial outcomes (recidivism and institutional infractions), and (c) whether items with a stronger relationship to the underlying constructs (higher factor loadings) were in turn more strongly related to antisocial outcomes. Confirmatory factor analyses (CFAs) indicated that ANT and AGG items were not structured optimally in these data in terms of correspondence to the subscale structure identified in the PAI manual. Exploratory factor analyses were conducted on a random split-half of the sample to derive optimized alternative factor structures, and cross-validated in the second split-half using CFA. Four-factor models emerged for both the ANT and AGG scales, and, as predicted, the size of item factor loadings was associated with the strength with which items were associated with institutional infractions and community recidivism. This suggests that the quality by which a construct is measured is associated with its predictive strength. Implications for risk assessment are discussed. Copyright © 2013 John Wiley & Sons, Ltd.

Assessing Protective Factors for Violence Risk in U.K. General Mental Health Services Using the Structured Assessment of Protective Factors.

PubMed

Haines, Alina; Brown, Andrew; Javaid, Syed Fahad; Khan, Fayyaz; Noblett, Steve; Omodunbi, Oladipupo; Sadiq, Khurram; Zaman, Wahid; Whittington, Richard

2017-12-01

Violence risk assessment and management are key tasks in mental health services and should be guided by validated instruments covering both risk and protective factors. This article is part of an international effort to validate the Structured Assessment of Protective Factors (SAPROF) for violence. The SAPROF, Historical, Clinical, Risk Management-20 (HCR-20) and the Psychopathy Checklist-Screening Version (PCL-SV) were administered in a sample of 261 patients in U.K. forensic, general inpatient, and community mental health settings. There was significant variation between these groups on SAPROF scores with fewer protective factors in the forensic group. The prospective validity of the SAPROF for nonviolence in the general inpatient and community samples was moderate (area under the curve [AUC] = .60). Adoption of the SAPROF or similar instruments as a supplement to risk-focused assessments has the potential to improve awareness of protective factors and enhance therapeutic engagement in a range of mental health services.

Assessing Procedural Competence: Validity Considerations.

PubMed

Pugh, Debra M; Wood, Timothy J; Boulet, John R

2015-10-01

Simulation-based medical education (SBME) offers opportunities for trainees to learn how to perform procedures and to be assessed in a safe environment. However, SBME research studies often lack robust evidence to support the validity of the interpretation of the results obtained from tools used to assess trainees' skills. The purpose of this paper is to describe how a validity framework can be applied when reporting and interpreting the results of a simulation-based assessment of skills related to performing procedures. The authors discuss various sources of validity evidence because they relate to SBME. A case study is presented.

Validation of a Multimarker Model for Assessing Risk of Type 2 Diabetes from a Five-Year Prospective Study of 6784 Danish People (Inter99)

PubMed Central

Urdea, Mickey; Kolberg, Janice; Wilber, Judith; Gerwien, Robert; Moler, Edward; Rowe, Michael; Jorgensen, Paul; Hansen, Torben; Pedersen, Oluf; Jørgensen, Torben; Borch-Johnsen, Knut

2009-01-01

Background Improved identification of subjects at high risk for development of type 2 diabetes would allow preventive interventions to be targeted toward individuals most likely to benefit. In previous research, predictive biomarkers were identified and used to develop multivariate models to assess an individual's risk of developing diabetes. Here we describe the training and validation of the PreDx™ Diabetes Risk Score (DRS) model in a clinical laboratory setting using baseline serum samples from subjects in the Inter99 cohort, a population-based primary prevention study of cardiovascular disease. Methods Among 6784 subjects free of diabetes at baseline, 215 subjects progressed to diabetes (converters) during five years of follow-up. A nested case-control study was performed using serum samples from 202 converters and 597 randomly selected nonconverters. Samples were randomly assigned to equally sized training and validation sets. Seven biomarkers were measured using assays developed for use in a clinical reference laboratory. Results The PreDx DRS model performed better on the training set (area under the curve [AUC] = 0.837) than fasting plasma glucose alone (AUC = 0.779). When applied to the sequestered validation set, the PreDx DRS showed the same performance (AUC = 0.838), thus validating the model. This model had a better AUC than any other single measure from a fasting sample. Moreover, the model provided further risk stratification among high-risk subpopulations with impaired fasting glucose or metabolic syndrome. Conclusions The PreDx DRS provides the absolute risk of diabetes conversion in five years for subjects identified to be “at risk” using the clinical factors. PMID:20144324

Field Validity of the Psychopathy Checklist--Revised in Sex Offender Risk Assessment

ERIC Educational Resources Information Center

Murrie, Daniel C.; Boccaccini, Marcus T.; Caperton, Jennifer; Rufino, Katrina

2012-01-01

Several studies have concluded that scores from Hare's (2003) Psychopathy Checklist--Revised (PCL-R) predict reoffense among sexual offenders, but most of those studies examined the predictive validity of scores from trained research staff, not clinicians in the field scoring the measure as part of actual forensic assessments. Therefore, we…

The Stroke Assessment of Fall Risk (SAFR): predictive validity in inpatient stroke rehabilitation.

PubMed

Breisinger, Terry P; Skidmore, Elizabeth R; Niyonkuru, Christian; Terhorst, Lauren; Campbell, Grace B

2014-12-01

To evaluate relative accuracy of a newly developed Stroke Assessment of Fall Risk (SAFR) for classifying fallers and non-fallers, compared with a health system fall risk screening tool, the Fall Harm Risk Screen. Prospective quality improvement study conducted at an inpatient stroke rehabilitation unit at a large urban university hospital. Patients admitted for inpatient stroke rehabilitation (N = 419) with imaging or clinical evidence of ischemic or hemorrhagic stroke, between 1 August 2009 and 31 July 2010. Not applicable. Sensitivity, specificity, and area under the curve for Receiver Operating Characteristic Curves of both scales' classifications, based on fall risk score completed upon admission to inpatient stroke rehabilitation. A total of 68 (16%) participants fell at least once. The SAFR was significantly more accurate than the Fall Harm Risk Screen (p < 0.001), with area under the curve of 0.73, positive predictive value of 0.29, and negative predictive value of 0.94. For the Fall Harm Risk Screen, area under the curve was 0.56, positive predictive value was 0.19, and negative predictive value was 0.86. Sensitivity and specificity of the SAFR (0.78 and 0.63, respectively) was higher than the Fall Harm Risk Screen (0.57 and 0.48, respectively). An evidence-derived, population-specific fall risk assessment may more accurately predict fallers than a general fall risk screen for stroke rehabilitation patients. While the SAFR improves upon the accuracy of a general assessment tool, additional refinement may be warranted. © The Author(s) 2014.

Development, Validation and Deployment of a Real Time 30 Day Hospital Readmission Risk Assessment Tool in the Maine Healthcare Information Exchange.

PubMed

Hao, Shiying; Wang, Yue; Jin, Bo; Shin, Andrew Young; Zhu, Chunqing; Huang, Min; Zheng, Le; Luo, Jin; Hu, Zhongkai; Fu, Changlin; Dai, Dorothy; Wang, Yicheng; Culver, Devore S; Alfreds, Shaun T; Rogow, Todd; Stearns, Frank; Sylvester, Karl G; Widen, Eric; Ling, Xuefeng B

2015-01-01

Identifying patients at risk of a 30-day readmission can help providers design interventions, and provide targeted care to improve clinical effectiveness. This study developed a risk model to predict a 30-day inpatient hospital readmission for patients in Maine, across all payers, all diseases and all demographic groups. Our objective was to develop a model to determine the risk for inpatient hospital readmission within 30 days post discharge. All patients within the Maine Health Information Exchange (HIE) system were included. The model was retrospectively developed on inpatient encounters between January 1, 2012 to December 31, 2012 from 24 randomly chosen hospitals, and then prospectively validated on inpatient encounters from January 1, 2013 to December 31, 2013 using all HIE patients. A risk assessment tool partitioned the entire HIE population into subgroups that corresponded to probability of hospital readmission as determined by a corresponding positive predictive value (PPV). An overall model c-statistic of 0.72 was achieved. The total 30-day readmission rates in low (score of 0-30), intermediate (score of 30-70) and high (score of 70-100) risk groupings were 8.67%, 24.10% and 74.10%, respectively. A time to event analysis revealed the higher risk groups readmitted to a hospital earlier than the lower risk groups. Six high-risk patient subgroup patterns were revealed through unsupervised clustering. Our model was successfully integrated into the statewide HIE to identify patient readmission risk upon admission and daily during hospitalization or for 30 days subsequently, providing daily risk score updates. The risk model was validated as an effective tool for predicting 30-day readmissions for patients across all payer, disease and demographic groups within the Maine HIE. Exposing the key clinical, demographic and utilization profiles driving each patient's risk of readmission score may be useful to providers in developing individualized post discharge

Assessment of Risk Manageability of Intellectually Disabled Sex Offenders

ERIC Educational Resources Information Center

Boer, Douglas P.; Tough, Susan; Haaven, James

2004-01-01

Background: There are no validated risk assessment tools for intellectually disabled (ID) sex offenders, with the exception of the work of Lindsay et al. ["Journal of Applied Research in Intellectual Disabilities" (2004) 17: 267] regarding the prediction of risk for aggressive behaviour of ID offenders in residential settings. ID sex offenders…

Predictive Validity of a Student Self-Report Screener of Behavioral and Emotional Risk in an Urban High School

ERIC Educational Resources Information Center

Dowdy, Erin; Harrell-Williams, Leigh; Dever, Bridget V.; Furlong, Michael J.; Moore, Stephanie; Raines, Tara; Kamphaus, Randy W.

2016-01-01

Increasingly, schools are implementing school-based screening for risk of behavioral and emotional problems; hence, foundational evidence supporting the predictive validity of screening instruments is important to assess. This study examined the predictive validity of the Behavior Assessment System for Children-2 Behavioral and Emotional Screening…

Validity Assessment of Low-risk SCORE Function and SCORE Function Calibrated to the Spanish Population in the FRESCO Cohorts.

PubMed

Baena-Díez, José Miguel; Subirana, Isaac; Ramos, Rafael; Gómez de la Cámara, Agustín; Elosua, Roberto; Vila, Joan; Marín-Ibáñez, Alejandro; Guembe, María Jesús; Rigo, Fernando; Tormo-Díaz, María José; Moreno-Iribas, Conchi; Cabré, Joan Josep; Segura, Antonio; Lapetra, José; Quesada, Miquel; Medrano, María José; González-Diego, Paulino; Frontera, Guillem; Gavrila, Diana; Ardanaz, Eva; Basora, Josep; García, José María; García-Lareo, Manel; Gutiérrez-Fuentes, José Antonio; Mayoral, Eduardo; Sala, Joan; Dégano, Irene R; Francès, Albert; Castell, Conxa; Grau, María; Marrugat, Jaume

2018-04-01

To assess the validity of the original low-risk SCORE function without and with high-density lipoprotein cholesterol and SCORE calibrated to the Spanish population. Pooled analysis with individual data from 12 Spanish population-based cohort studies. We included 30 919 individuals aged 40 to 64 years with no history of cardiovascular disease at baseline, who were followed up for 10 years for the causes of death included in the SCORE project. The validity of the risk functions was analyzed with the area under the ROC curve (discrimination) and the Hosmer-Lemeshow test (calibration), respectively. Follow-up comprised 286 105 persons/y. Ten-year cardiovascular mortality was 0.6%. The ratio between estimated/observed cases ranged from 9.1, 6.5, and 9.1 in men and 3.3, 1.3, and 1.9 in women with original low-risk SCORE risk function without and with high-density lipoprotein cholesterol and calibrated SCORE, respectively; differences were statistically significant with the Hosmer-Lemeshow test between predicted and observed mortality with SCORE (P < .001 in both sexes and with all functions). The area under the ROC curve with the original SCORE was 0.68 in men and 0.69 in women. All versions of the SCORE functions available in Spain significantly overestimate the cardiovascular mortality observed in the Spanish population. Despite the acceptable discrimination capacity, prediction of the number of fatal cardiovascular events (calibration) was significantly inaccurate. Copyright © 2017 Sociedad Española de Cardiología. Published by Elsevier España, S.L.U. All rights reserved.

Regulatory risk assessment approaches for synthetic mineral fibres.

PubMed

Harrison, Paul; Holmes, Philip; Bevan, Ruth; Kamps, Klaus; Levy, Leonard; Greim, Helmut

2015-10-01

Exposure to synthetic mineral fibres (SMF) may occur in a number of workplace scenarios. To protect worker health, a number of different organisations worldwide have assessed the health risk of these materials and established workplace exposure limits. This paper outlines the basic principles of risk assessment and the scientific methods used to derive valid (justifiable) occupational exposure limits (OELs) and goes on to show how, for SMF, and particularly for refractory ceramic fibre (otherwise known as aluminosilicate wool, RCF/ASW), the methods used and the associated outcomes differ widely. It is argued that the resulting differences in established OELs prevent consistent and appropriate risk management of SMF worldwide, and that development of a transparent and harmonised approach to fibre risk assessment and limit-setting is required. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

[Reliability and validity of the Braden Scale for predicting pressure sore risk].

PubMed

Boes, C

2000-12-01

For more accurate and objective pressure sore risk assessment various risk assessment tools were developed mainly in the USA and Great Britain. The Braden Scale for Predicting Pressure Sore Risk is one such example. By means of a literature analysis of German and English texts referring to the Braden Scale the scientific control criteria reliability and validity will be traced and consequences for application of the scale in Germany will be demonstrated. Analysis of 4 reliability studies shows an exclusive focus on interrater reliability. Further, even though examination of 19 validity studies occurs in many different settings, such examination is limited to the criteria sensitivity and specificity (accuracy). The range of sensitivity and specificity level is 35-100%. The recommended cut off points rank in the field of 10 to 19 points. The studies prove to be not comparable with each other. Furthermore, distortions in these studies can be found which affect accuracy of the scale. The results of the here presented analysis show an insufficient proof for reliability and validity in the American studies. In Germany, the Braden scale has not yet been tested under scientific criteria. Such testing is needed before using the scale in different German settings. During the course of such testing, construction and study procedures of the American studies can be used as a basis as can the problems be identified in the analysis presented below.

Therapeutic risk management of the suicidal patient: augmenting clinical suicide risk assessment with structured instruments.

PubMed

Homaifar, Beeta; Matarazzo, Bridget; Wortzel, Hal S

2013-09-01

This column is the second in a series presenting a model for therapeutic risk management of the suicidal patient. As discussed in the first part of the series, the model involves several elements including augmenting clinical risk assessment with structured instruments, stratifying risk in terms of both severity and temporality, and developing and documenting a safety plan. This column explores in more detail how to augment clinical risk assessment with structured instruments. Unstructured clinical interviews have the potential to miss important aspects of suicide risk assessment. By augmenting the free-form clinical interview with structured instruments that demonstrate reliability and validity, a more nuanced and multifaceted approach to suicide risk assessment is achieved. Incorporating structured instruments into practice also serves a medicolegal function, since these instruments may become a living part of the medical record, establishing baseline levels of suicidal thoughts and behaviors and facilitating future clinical determinations regarding safety needs. We describe several instruments used in a multidisciplinary suicide consultation service, each of which has demonstrated relevance to suicide risk assessment and screening, ease of administration, and strong psychometric properties. In addition, we emphasize the importance of viewing suicide risk assessment as an ongoing process rather than as a singular event. Finally, we discuss special considerations in the evolving practice of risk assessment.

Validation of the cardiac health behavior scale for Korean adults with cardiovascular risks or diseases.

PubMed

Song, Rhayun; Oh, Hyunkyoung; Ahn, Sukhee; Moorhead, Sue

2018-02-01

The purpose of this study was to validate the Cardiac Health Behavior Scale for Korean adults (CHB-K) to determine its validity and reliability. Cardiovascular diseases (CVDs) are one of the most important chronic diseases due to their high prevalence and mortality rates. Patients with cardiovascular risks or diseases need to perform appropriate cardiac health behaviors that help to prevent the progression of the disease and improve their health status. This secondary analysis obtained data from two clinical trials of cardiac rehabilitation. Data from 298 patients with cardiovascular risks or diseases were analyzed for validation. Data analyses included correlation coefficients, t-tests, and exploratory and confirmatory factor analyses using SPSS (version WIN 22.0) and AMOS (version 20.0). The Self-Efficacy Scale was used to assess convergent validity, while reliability was assessed using Cronbach's alpha coefficients. Five main factors were verified: health responsibility, physical activity, diet habit (eating habit and food choice), stress management, and smoking cessation. A set of 21 items from the 25-item scale was verified after performing item analysis, factor analyses, and critical evaluation of the statistical results. The 21-item CHB-K (CHB-K21) exhibited acceptable validity, and the model of the CHB-K21 provided a good fit to the data. Most of the factors were found to be moderately correlated with SES scores (r=0.45-0.52, p<0.001). The CHB-K21 also demonstrated acceptable reliability (Cronbach's alpha=0.83). The CHB-K21 demonstrates strong validity and reliability. It can be used to assess cardiac health behaviors in Korean adults with cardiovascular risks or diseases. Copyright © 2017 Elsevier Inc. All rights reserved.

Variable Lifting Index for Manual-Lifting Risk Assessment: A Preliminary Validation Study.

PubMed

Battevi, Natale; Pandolfi, Monica; Cortinovis, Ivan

2016-08-01

The aim of this study was to evaluate the efficacy of the new Variable Lifting Index (VLI) method, theoretically based on the Revised National Institute for Occupational Safety and Health [NIOSH] Lifting Equation (RNLE), in predicting the risk of acute low-back pain (LBP) in the past 12 months. A new risk variable termed the VLI for assessing variable manual lifting has been developed, but there has been no epidemiological study that evaluates the relationship between the VLI and LBP. A sample of 3,402 study participants from 16 companies in different industrial sectors was analyzed. Of the participants, 2,374 were in the risk exposure group involving manual materials handling (MMH), and 1,028 were in the control group without MMH. The VLI was calculated for each participant in the exposure group using a systematic approach. LBP information was collected by occupational physicians at the study sites. The risk of acute LBP was estimated by calculating the odds ratio (OR) between levels of the risk exposure and the control group using a logistic regression analysis. Both crude and adjusted ORs for body mass index, gender, and age were analyzed. Both crude and adjusted ORs showed a dose-response relationship. As the levels of VLI increased, the risk of LBP increased. This risk relationship existed when VLI was greater than 1. The VLI method can be used to assess the risk of acute LBP, although further studies are needed to confirm the outcome and to define better VLI categories. © 2016, Human Factors and Ergonomics Society.

Risk assessments for dating violence in mid to late adolescence and early adulthood.

PubMed

Tapp, James; Moore, Estelle

2016-10-01

The objective of this paper is to review risk instruments that have been used in the assessment of the potential for violence within the dating relationships of young people. A review of the dating violence literature was conducted to identify risk assessment approaches that have been used to predict harmful behaviour within the dating relationships of people aged between 15 and 30 years. Risk assessments were evaluated on recommended quality criteria: predictive validity, accuracy (sensitivity and specificity) and inter-rater reliability. Only five studies describing assessments that focused specifically on dating violence risk factors were selected for review. Three assessments encompassed dating behaviours by victims that have been associated with an increased risk of further victimisation. Drawing on this evidence, we conclude that young people appear to be at greater risk of encountering dating violence if they have experienced violence in earlier attachment relationships; if their skills for coping with conflict and responding to coercion are limited and if the presence of peer influences reinforces offence supportive attitudes. The reliability and validity of existing intimate partner violence risk assessments that conceptually overlap with elements of dating violence risk warrant investigation to inform risk assessment developments in this field and, building on this, possible interventions to minimise future harm. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Validation study of a quantitative multigene reverse transcriptase-polymerase chain reaction assay for assessment of recurrence risk in patients with stage II colon cancer.

PubMed

Gray, Richard G; Quirke, Philip; Handley, Kelly; Lopatin, Margarita; Magill, Laura; Baehner, Frederick L; Beaumont, Claire; Clark-Langone, Kim M; Yoshizawa, Carl N; Lee, Mark; Watson, Drew; Shak, Steven; Kerr, David J

2011-12-10

We developed quantitative gene expression assays to assess recurrence risk and benefits from chemotherapy in patients with stage II colon cancer. We sought validation by using RNA extracted from fixed paraffin-embedded primary colon tumor blocks from 1,436 patients with stage II colon cancer in the QUASAR (Quick and Simple and Reliable) study of adjuvant fluoropyrimidine chemotherapy versus surgery alone. A recurrence score (RS) and a treatment score (TS) were calculated from gene expression levels of 13 cancer-related genes (n = 7 recurrence genes and n = 6 treatment benefit genes) and from five reference genes with prespecified algorithms. Cox proportional hazards regression models and log-rank methods were used to analyze the relationship between the RS and risk of recurrence in patients treated with surgery alone and between TS and benefits of chemotherapy. Risk of recurrence was significantly associated with RS (hazard ratio [HR] per interquartile range, 1.38; 95% CI, 1.11 to 1.74; P = .004). Recurrence risks at 3 years were 12%, 18%, and 22% for predefined low, intermediate, and high recurrence risk groups, respectively. T stage (HR, 1.94; P < .001) and mismatch repair (MMR) status (HR, 0.31; P < .001) were the strongest histopathologic prognostic factors. The continuous RS was associated with risk of recurrence (P = .006) beyond these and other covariates. There was no trend for increased benefit from chemotherapy at higher TS (P = .95). The continuous 12-gene RS has been validated in a prospective study for assessment of recurrence risk in patients with stage II colon cancer after surgery and provides prognostic value that complements T stage and MMR. The TS was not predictive of chemotherapy benefit.

Disentangling the risk assessment and intimate partner violence relation: Estimating mediating and moderating effects.

PubMed

Williams, Kirk R; Stansfield, Richard

2017-08-01

To manage intimate partner violence (IPV), the criminal justice system has turned to risk assessment instruments to predict if a perpetrator will reoffend. Empirically determining whether offenders assessed as high risk are those who recidivate is critical for establishing the predictive validity of IPV risk assessment instruments and for guiding the supervision of perpetrators. But by focusing solely on the relation between calculated risk scores and subsequent IPV recidivism, previous studies of the predictive validity of risk assessment instruments omitted mediating factors intended to mitigate the risk of this behavioral recidivism. The purpose of this study was to examine the mediating effects of such factors and the moderating effects of risk assessment on the relation between assessed risk (using the Domestic Violence Screening Instrument-Revised [DVSI-R]) and recidivistic IPV. Using a sample of 2,520 perpetrators of IPV, results revealed that time sentenced to jail and time sentenced to probation each significantly mediated the relation between DVSI-R risk level and frequency of reoffending. The results also revealed that assessed risk moderated the relation between these mediating factors and IPV recidivism, with reduced recidivism (negative estimated effects) for high-risk perpetrators but increased recidivism (positive estimate effects) for low-risk perpetrators. The implication is to assign interventions to the level of risk so that no harm is done. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Validating SPICES as a Screening Tool for Frailty Risks among Hospitalized Older Adults

PubMed Central

Aronow, Harriet Udin; Borenstein, Jeff; Haus, Flora; Braunstein, Glenn D.; Bolton, Linda Burnes

2014-01-01

Older patients are vulnerable to adverse hospital events related to frailty. SPICES, a common screening protocol to identify risk factors in older patients, alerts nurses to initiate care plans to reduce the probability of patient harm. However, there is little published validating the association between SPICES and measures of frailty and adverse outcomes. This paper used data from a prospective cohort study on frailty among 174 older adult inpatients to validate SPICES. Almost all patients met one or more SPICES criteria. The sum of SPICES was significantly correlated with age and other well-validated assessments for vulnerability, comorbid conditions, and depression. Individuals meeting two or more SPICES criteria had a risk of adverse hospital events three times greater than individuals with either no or one criterion. Results suggest that as a screening tool used within 24 hours of admission, SPICES is both valid and predictive of adverse events. PMID:24876954

Designing trials for pressure ulcer risk assessment research: methodological challenges.

PubMed

Balzer, K; Köpke, S; Lühmann, D; Haastert, B; Kottner, J; Meyer, G

2013-08-01

For decades various pressure ulcer risk assessment scales (PURAS) have been developed and implemented into nursing practice despite uncertainty whether use of these tools helps to prevent pressure ulcers. According to current methodological standards, randomised controlled trials (RCTs) are required to conclusively determine the clinical efficacy and safety of this risk assessment strategy. In these trials, PURAS-aided risk assessment has to be compared to nurses' clinical judgment alone in terms of its impact on pressure ulcer incidence and adverse outcomes. However, RCTs evaluating diagnostic procedures are prone to specific risks of bias and threats to the statistical power which may challenge their validity and feasibility. This discussion paper critically reflects on the rigour and feasibility of experimental research needed to substantiate the clinical efficacy of PURAS-aided risk assessment. Based on reflections of the methodological literature, a critical appraisal of available trials on this subject and an analysis of a protocol developed for a methodologically robust cluster-RCT, this paper arrives at the following conclusions: First, available trials do not provide reliable estimates of the impact of PURAS-aided risk assessment on pressure ulcer incidence compared to nurses' clinical judgement alone due to serious risks of bias and insufficient sample size. Second, it seems infeasible to assess this impact by means of rigorous experimental studies since sample size would become extremely high if likely threats to validity and power are properly taken into account. Third, means of evidence linkages seem to currently be the most promising approaches for evaluating the clinical efficacy and safety of PURAS-aided risk assessment. With this kind of secondary research, the downstream effect of use of PURAS on pressure ulcer incidence could be modelled by combining best available evidence for single parts of this pathway. However, to yield reliable modelling

Evidence on existing caries risk assessment systems: are they predictive of future caries?

PubMed

Tellez, M; Gomez, J; Pretty, I; Ellwood, R; Ismail, A I

2013-02-01

To critically appraise evidence for the prediction of caries using four caries risk assessment (CRA) systems/guidelines (Cariogram, Caries Management by Risk Assessment (CAMBRA), American Dental Association (ADA), and American Academy of Pediatric Dentistry (AAPD)). This review focused on prospective cohort studies or randomized controlled trials. A systematic search strategy was developed to locate papers published in Medline Ovid and Cochrane databases. The search identified 539 scientific reports, and after title and abstract review, 137 were selected for full review and 14 met the following inclusion criteria: (i) used as validating criterion caries incidence/increment, (ii) involved human subjects and natural carious lesions, and (iii) published in peer-reviewed journals. In addition, papers were excluded if they met one or more of the following criteria: (i) incomplete description of sample selection, outcomes, or small sample size and (ii) not meeting the criteria for best evidence under the prognosis category of the Oxford Centre for Evidence-Based Medicine. There are wide variations among the systems in terms of definitions of caries risk categories, type and number of risk factors/markers, and disease indicators. The Cariogram combined sensitivity and specificity for predicting caries in permanent dentition ranges from 110 to 139 and is the only system for which prospective studies have been conducted to assess its validity. The Cariogram had limited prediction utility in preschool children, and a moderate to good performance for sorting out elderly individuals into caries risk groups. One retrospective analysis on CAMBRA's CRA reported higher incidence of cavitated lesions among those assessed as extreme-risk patients when compared with those at low risk. The evidence on the validity for existing systems for CRA is limited. It is unknown if the identification of high-risk individuals can lead to more effective long-term patient management that prevents

Development and validation of risk prediction equations to estimate future risk of blindness and lower limb amputation in patients with diabetes: cohort study

PubMed Central

Coupland, Carol

2015-01-01

Study question Is it possible to develop and externally validate risk prediction equations to estimate the 10 year risk of blindness and lower limb amputation in patients with diabetes aged 25-84 years? Methods This was a prospective cohort study using routinely collected data from general practices in England contributing to the QResearch and Clinical Practice Research Datalink (CPRD) databases during the study period 1998-2014. The equations were developed using 763 QResearch practices (n=454 575 patients with diabetes) and validated in 254 different QResearch practices (n=142 419) and 357 CPRD practices (n=206 050). Cox proportional hazards models were used to derive separate risk equations for blindness and amputation in men and women that could be evaluated at 10 years. Measures of calibration and discrimination were calculated in the two validation cohorts. Study answer and limitations Risk prediction equations to quantify absolute risk of blindness and amputation in men and women with diabetes have been developed and externally validated. In the QResearch derivation cohort, 4822 new cases of lower limb amputation and 8063 new cases of blindness occurred during follow-up. The risk equations were well calibrated in both validation cohorts. Discrimination was good in men in the external CPRD cohort for amputation (D statistic 1.69, Harrell’s C statistic 0.77) and blindness (D statistic 1.40, Harrell’s C statistic 0.73), with similar results in women and in the QResearch validation cohort. The algorithms are based on variables that patients are likely to know or that are routinely recorded in general practice computer systems. They can be used to identify patients at high risk for prevention or further assessment. Limitations include lack of formally adjudicated outcomes, information bias, and missing data. What this study adds Patients with type 1 or type 2 diabetes are at increased risk of blindness and amputation but generally do not have accurate

Development and validation of risk prediction equations to estimate future risk of blindness and lower limb amputation in patients with diabetes: cohort study.

PubMed

Hippisley-Cox, Julia; Coupland, Carol

2015-11-11

Is it possible to develop and externally validate risk prediction equations to estimate the 10 year risk of blindness and lower limb amputation in patients with diabetes aged 25-84 years? This was a prospective cohort study using routinely collected data from general practices in England contributing to the QResearch and Clinical Practice Research Datalink (CPRD) databases during the study period 1998-2014. The equations were developed using 763 QResearch practices (n=454,575 patients with diabetes) and validated in 254 different QResearch practices (n=142,419) and 357 CPRD practices (n=206,050). Cox proportional hazards models were used to derive separate risk equations for blindness and amputation in men and women that could be evaluated at 10 years. Measures of calibration and discrimination were calculated in the two validation cohorts. Risk prediction equations to quantify absolute risk of blindness and amputation in men and women with diabetes have been developed and externally validated. In the QResearch derivation cohort, 4822 new cases of lower limb amputation and 8063 new cases of blindness occurred during follow-up. The risk equations were well calibrated in both validation cohorts. Discrimination was good in men in the external CPRD cohort for amputation (D statistic 1.69, Harrell's C statistic 0.77) and blindness (D statistic 1.40, Harrell's C statistic 0.73), with similar results in women and in the QResearch validation cohort. The algorithms are based on variables that patients are likely to know or that are routinely recorded in general practice computer systems. They can be used to identify patients at high risk for prevention or further assessment. Limitations include lack of formally adjudicated outcomes, information bias, and missing data. Patients with type 1 or type 2 diabetes are at increased risk of blindness and amputation but generally do not have accurate assessments of the magnitude of their individual risks. The new algorithms calculate

Development and validation of a mortality risk model for pediatric sepsis.

PubMed

Chen, Mengshi; Lu, Xiulan; Hu, Li; Liu, Pingping; Zhao, Wenjiao; Yan, Haipeng; Tang, Liang; Zhu, Yimin; Xiao, Zhenghui; Chen, Lizhang; Tan, Hongzhuan

2017-05-01

Pediatric sepsis is a burdensome public health problem. Assessing the mortality risk of pediatric sepsis patients, offering effective treatment guidance, and improving prognosis to reduce mortality rates, are crucial.We extracted data derived from electronic medical records of pediatric sepsis patients that were collected during the first 24 hours after admission to the pediatric intensive care unit (PICU) of the Hunan Children's hospital from January 2012 to June 2014. A total of 788 children were randomly divided into a training (592, 75%) and validation group (196, 25%). The risk factors for mortality among these patients were identified by conducting multivariate logistic regression in the training group. Based on the established logistic regression equation, the logit probabilities for all patients (in both groups) were calculated to verify the model's internal and external validities.According to the training group, 6 variables (brain natriuretic peptide, albumin, total bilirubin, D-dimer, lactate levels, and mechanical ventilation in 24 hours) were included in the final logistic regression model. The areas under the curves of the model were 0.854 (0.826, 0.881) and 0.844 (0.816, 0.873) in the training and validation groups, respectively.The Mortality Risk Model for Pediatric Sepsis we established in this study showed acceptable accuracy to predict the mortality risk in pediatric sepsis patients.

Development and validation of a mortality risk model for pediatric sepsis

PubMed Central

Chen, Mengshi; Lu, Xiulan; Hu, Li; Liu, Pingping; Zhao, Wenjiao; Yan, Haipeng; Tang, Liang; Zhu, Yimin; Xiao, Zhenghui; Chen, Lizhang; Tan, Hongzhuan

2017-01-01

Abstract Pediatric sepsis is a burdensome public health problem. Assessing the mortality risk of pediatric sepsis patients, offering effective treatment guidance, and improving prognosis to reduce mortality rates, are crucial. We extracted data derived from electronic medical records of pediatric sepsis patients that were collected during the first 24 hours after admission to the pediatric intensive care unit (PICU) of the Hunan Children's hospital from January 2012 to June 2014. A total of 788 children were randomly divided into a training (592, 75%) and validation group (196, 25%). The risk factors for mortality among these patients were identified by conducting multivariate logistic regression in the training group. Based on the established logistic regression equation, the logit probabilities for all patients (in both groups) were calculated to verify the model's internal and external validities. According to the training group, 6 variables (brain natriuretic peptide, albumin, total bilirubin, D-dimer, lactate levels, and mechanical ventilation in 24 hours) were included in the final logistic regression model. The areas under the curves of the model were 0.854 (0.826, 0.881) and 0.844 (0.816, 0.873) in the training and validation groups, respectively. The Mortality Risk Model for Pediatric Sepsis we established in this study showed acceptable accuracy to predict the mortality risk in pediatric sepsis patients. PMID:28514310

Developing and validating risk prediction models in an individual participant data meta-analysis

PubMed Central

2014-01-01

Background Risk prediction models estimate the risk of developing future outcomes for individuals based on one or more underlying characteristics (predictors). We review how researchers develop and validate risk prediction models within an individual participant data (IPD) meta-analysis, in order to assess the feasibility and conduct of the approach. Methods A qualitative review of the aims, methodology, and reporting in 15 articles that developed a risk prediction model using IPD from multiple studies. Results The IPD approach offers many opportunities but methodological challenges exist, including: unavailability of requested IPD, missing patient data and predictors, and between-study heterogeneity in methods of measurement, outcome definitions and predictor effects. Most articles develop their model using IPD from all available studies and perform only an internal validation (on the same set of data). Ten of the 15 articles did not allow for any study differences in baseline risk (intercepts), potentially limiting their model’s applicability and performance in some populations. Only two articles used external validation (on different data), including a novel method which develops the model on all but one of the IPD studies, tests performance in the excluded study, and repeats by rotating the omitted study. Conclusions An IPD meta-analysis offers unique opportunities for risk prediction research. Researchers can make more of this by allowing separate model intercept terms for each study (population) to improve generalisability, and by using ‘internal-external cross-validation’ to simultaneously develop and validate their model. Methodological challenges can be reduced by prospectively planned collaborations that share IPD for risk prediction. PMID:24397587

Development and Validation of the PREMM5 Model for Comprehensive Risk Assessment of Lynch Syndrome.

PubMed

Kastrinos, Fay; Uno, Hajime; Ukaegbu, Chinedu; Alvero, Carmelita; McFarland, Ashley; Yurgelun, Matthew B; Kulke, Matthew H; Schrag, Deborah; Meyerhardt, Jeffrey A; Fuchs, Charles S; Mayer, Robert J; Ng, Kimmie; Steyerberg, Ewout W; Syngal, Sapna

2017-07-01

Purpose Current Lynch syndrome (LS) prediction models quantify the risk to an individual of carrying a pathogenic germline mutation in three mismatch repair (MMR) genes: MLH1, MSH2, and MSH6. We developed a new prediction model, PREMM 5 , that incorporates the genes PMS2 and EPCAM to provide comprehensive LS risk assessment. Patients and Methods PREMM 5 was developed to predict the likelihood of a mutation in any of the LS genes by using polytomous logistic regression analysis of clinical and germline data from 18,734 individuals who were tested for all five genes. Predictors of mutation status included sex, age at genetic testing, and proband and family cancer histories. Discrimination was evaluated by the area under the receiver operating characteristic curve (AUC), and clinical impact was determined by decision curve analysis; comparisons were made to the existing PREMM 1,2,6 model. External validation of PREMM 5 was performed in a clinic-based cohort of 1,058 patients with colorectal cancer. Results Pathogenic mutations were detected in 1,000 (5%) of 18,734 patients in the development cohort; mutations included MLH1 (n = 306), MSH2 (n = 354), MSH6 (n = 177), PMS2 (n = 141), and EPCAM (n = 22). PREMM 5 distinguished carriers from noncarriers with an AUC of 0.81 (95% CI, 0.79 to 0.82), and performance was similar in the validation cohort (AUC, 0.83; 95% CI, 0.75 to 0.92). Prediction was more difficult for PMS2 mutations (AUC, 0.64; 95% CI, 0.60 to 0.68) than for other genes. Performance characteristics of PREMM 5 exceeded those of PREMM 1,2,6 . Decision curve analysis supported germline LS testing for PREMM 5 scores ≥ 2.5%. Conclusion PREMM 5 provides comprehensive risk estimation of all five LS genes and supports LS genetic testing for individuals with scores ≥ 2.5%. At this threshold, PREMM 5 provides performance that is superior to the existing PREMM 1,2,6 model in the identification of carriers of LS, including those with weaker phenotypes and individuals

Development and Validation of the PREMM5 Model for Comprehensive Risk Assessment of Lynch Syndrome

PubMed Central

Uno, Hajime; Ukaegbu, Chinedu; Alvero, Carmelita; McFarland, Ashley; Yurgelun, Matthew B.; Kulke, Matthew H.; Schrag, Deborah; Meyerhardt, Jeffrey A.; Fuchs, Charles S.; Mayer, Robert J.; Ng, Kimmie; Steyerberg, Ewout W.; Syngal, Sapna

2017-01-01

Purpose Current Lynch syndrome (LS) prediction models quantify the risk to an individual of carrying a pathogenic germline mutation in three mismatch repair (MMR) genes: MLH1, MSH2, and MSH6. We developed a new prediction model, PREMM5, that incorporates the genes PMS2 and EPCAM to provide comprehensive LS risk assessment. Patients and Methods PREMM5 was developed to predict the likelihood of a mutation in any of the LS genes by using polytomous logistic regression analysis of clinical and germline data from 18,734 individuals who were tested for all five genes. Predictors of mutation status included sex, age at genetic testing, and proband and family cancer histories. Discrimination was evaluated by the area under the receiver operating characteristic curve (AUC), and clinical impact was determined by decision curve analysis; comparisons were made to the existing PREMM1,2,6 model. External validation of PREMM5 was performed in a clinic-based cohort of 1,058 patients with colorectal cancer. Results Pathogenic mutations were detected in 1,000 (5%) of 18,734 patients in the development cohort; mutations included MLH1 (n = 306), MSH2 (n = 354), MSH6 (n = 177), PMS2 (n = 141), and EPCAM (n = 22). PREMM5 distinguished carriers from noncarriers with an AUC of 0.81 (95% CI, 0.79 to 0.82), and performance was similar in the validation cohort (AUC, 0.83; 95% CI, 0.75 to 0.92). Prediction was more difficult for PMS2 mutations (AUC, 0.64; 95% CI, 0.60 to 0.68) than for other genes. Performance characteristics of PREMM5 exceeded those of PREMM1,2,6. Decision curve analysis supported germline LS testing for PREMM5 scores ≥ 2.5%. Conclusion PREMM5 provides comprehensive risk estimation of all five LS genes and supports LS genetic testing for individuals with scores ≥ 2.5%. At this threshold, PREMM5 provides performance that is superior to the existing PREMM1,2,6 model in the identification of carriers of LS, including those with weaker phenotypes and individuals unaffected

The development and validation of the Youth Actuarial Care Needs Assessment Tool for Non-Offenders (Y-ACNAT-NO).

PubMed

Assink, Mark; van der Put, Claudia E; Oort, Frans J; Stams, Geert Jan J M

2015-03-04

In The Netherlands, police officers not only come into contact with juvenile offenders, but also with a large number of juveniles who were involved in a criminal offense, but not in the role of a suspect (i.e., juvenile non-offenders). Until now, no valid and reliable instrument was available that can be used by Dutch police officers for estimating the risk for future care needs of juvenile non-offenders. In the present study, the Youth Actuarial Care Needs Assessment Tool for Non-Offenders (Y-ACNAT-NO) was developed for predicting the risk for future care needs that consisted of (1) a future supervision order as imposed by a juvenile court judge and (2) future worrisome incidents involving child abuse, domestic violence/strife, and/or sexual offensive behavior at the juvenile's living address (i.e., problems in the child-rearing environment). Police records of 3,200 juveniles were retrieved from the Dutch police registration system after which the sample was randomly split in a construction (n = 1,549) and validation sample (n = 1,651). The Y-ACNAT-NO was developed by performing an Exhaustive CHAID analysis using the construction sample. The predictive validity of the instrument was examined in the validation sample by calculating several performance indicators that assess discrimination and calibration. The CHAID output yielded an instrument that consisted of six variables and eleven different risk groups. The risk for future care needs ranged from 0.06 in the lowest risk group to 0.83 in the highest risk group. The AUC value in the validation sample was .764 (95% CI [.743, .784]) and Sander's calibration score indicated an average assessment error of 3.74% in risk estimates per risk category. The Y-ACNAT-NO is the first instrument that can be used by Dutch police officers for estimating the risk for future care needs of juvenile non-offenders. The predictive validity of the Y-ACNAT-NO in terms of discrimination and calibration was sufficient to justify

Comparison of two instruments for assessing risk of postoperative nausea and vomiting.

PubMed

Kapoor, Rachna; Hola, Eric T; Adamson, Robert T; Mathis, A Scott

2008-03-01

Two instruments for assessing patients' risk of postoperative nausea and vomiting (PONV) were compared. The existing protocol (protocol 1) assessed PONV risk using 16 weighted risk factors and was used for both adults and pediatric patients. The new protocol (protocol 2) included a form for adults and a pediatric-specific form. The form for adults utilized the simplified risk score, calculated using a validated, nonweighted, 4-point scale, and categorized patients' risk of PONV as low, moderate, or high. The form for pediatric patients used a 7-point, non-weighted scale and categorized patients' risk of PONV as moderate or high. A list was generated of all patients who had surgery during August 2005, for whom protocol 1 was used, and during April 2006, for whom protocol 2 was used. Fifty patients from each time period were randomly selected for data analysis. Data collected included the percentage of the form completed, the development of PONV, the number of PONV risk factors, patient demographics, and the appropriateness of prophylaxis. The mean +/- S.D. number of PONV risk factors was significantly lower in the group treated according to protocol 2 ( p = 0.001), but fewer patients in this group were categorized as low or moderate risk and more patients were identified as high risk (p < 0.001). More patients assessed by protocol 2 received fewer interventions than recommended (p < 0.001); however, the frequency of PONV did not significantly differ between groups. Implementation of a validated and simplified PONV risk-assessment tool appeared to improve form completion rates and appropriate risk assessment; however, the rates of PONV remained similar and fewer patients received appropriate prophylaxis compared with patients assessed by the existing risk-assessment tool.

Probabilistic Approaches for Multi-Hazard Risk Assessment of Structures and Systems

NASA Astrophysics Data System (ADS)

Kwag, Shinyoung

Performance assessment of structures, systems, and components for multi-hazard scenarios has received significant attention in recent years. However, the concept of multi-hazard analysis is quite broad in nature and the focus of existing literature varies across a wide range of problems. In some cases, such studies focus on hazards that either occur simultaneously or are closely correlated with each other. For example, seismically induced flooding or seismically induced fires. In other cases, multi-hazard studies relate to hazards that are not dependent or correlated but have strong likelihood of occurrence at different times during the lifetime of a structure. The current approaches for risk assessment need enhancement to account for multi-hazard risks. It must be able to account for uncertainty propagation in a systems-level analysis, consider correlation among events or failure modes, and allow integration of newly available information from continually evolving simulation models, experimental observations, and field measurements. This dissertation presents a detailed study that proposes enhancements by incorporating Bayesian networks and Bayesian updating within a performance-based probabilistic framework. The performance-based framework allows propagation of risk as well as uncertainties in the risk estimates within a systems analysis. Unlike conventional risk assessment techniques such as a fault-tree analysis, a Bayesian network can account for statistical dependencies and correlations among events/hazards. The proposed approach is extended to develop a risk-informed framework for quantitative validation and verification of high fidelity system-level simulation tools. Validation of such simulations can be quite formidable within the context of a multi-hazard risk assessment in nuclear power plants. The efficiency of this approach lies in identification of critical events, components, and systems that contribute to the overall risk. Validation of any event or

Stroke-Associated Pneumonia Risk Score: Validity in a French Stroke Unit.

PubMed

Cugy, Emmanuelle; Sibon, Igor

2017-01-01

Stroke-associated pneumonia is a leading cause of in-hospital death and post-stroke outcome. Screening patients at high risk is one of the main challenges in acute stroke units. Several screening tests have been developed, but their feasibility and validity still remain unclear. The aim of our study was to evaluate the validity of four risk scores (Pneumonia score, A2DS2, ISAN score, and AIS-APS) in a population of ischemic stroke patients admitted in a French stroke unit. Consecutive ischemic stroke patients admitted to a stroke unit were retrospectively analyzed. Data that allowed to retrospectively calculate the different pneumonia risk scores were recorded. Sensitivity and specificity of each score were assessed for in-hospital stroke-associated pneumonia and mortality. The qualitative and quantitative accuracy and utility of each diagnostic screening test were assessed by measuring the Youden Index and the Clinical Utility Index. Complete data were available for only 1960 patients. Pneumonia was observed in 8.6% of patients. Sensitivity and specificity were, respectively, .583 and .907 for Pneumonia score, .744 and .796 for A2DS2, and .696 and .812 for ISAN score. Data were insufficient to test AIS-APS. Stroke-associated pneumonia risk scores had an excellent negative Clinical Utility Index (.77-.87) to screen for in-hospital risk of pneumonia after acute ischemic stroke. All scores might be useful and applied to screen stroke-associated pneumonia in stroke patients treated in French comprehensive stroke units. Copyright © 2017 National Stroke Association. Published by Elsevier Inc. All rights reserved.

The risk of bias in systematic reviews tool showed fair reliability and good construct validity.

PubMed

Bühn, Stefanie; Mathes, Tim; Prengel, Peggy; Wegewitz, Uta; Ostermann, Thomas; Robens, Sibylle; Pieper, Dawid

2017-11-01

There is a movement from generic quality checklists toward a more domain-based approach in critical appraisal tools. This study aimed to report on a first experience with the newly developed risk of bias in systematic reviews (ROBIS) tool and compare it with A Measurement Tool to Assess Systematic Reviews (AMSTAR), that is, the most common used tool to assess methodological quality of systematic reviews while assessing validity, reliability, and applicability. Validation study with four reviewers based on 16 systematic reviews in the field of occupational health. Interrater reliability (IRR) of all four raters was highest for domain 2 (Fleiss' kappa κ = 0.56) and lowest for domain 4 (κ = 0.04). For ROBIS, median IRR was κ = 0.52 (range 0.13-0.88) for the experienced pair of raters compared to κ = 0.32 (range 0.12-0.76) for the less experienced pair of raters. The percentage of "yes" scores of each review of ROBIS ratings was strongly correlated with the AMSTAR ratings (r s  = 0.76; P = 0.01). ROBIS has fair reliability and good construct validity to assess the risk of bias in systematic reviews. More validation studies are needed to investigate reliability and applicability, in particular. Copyright © 2017 Elsevier Inc. All rights reserved.

[Reliability and external validity of a questionnaire to assess the knowledge about risk and cardiovascular disease and in patients attending Spanish community pharmacies].

PubMed

Amariles, Pedro; Pino-Marín, Daniel; Sabater-Hernández, Daniel; García-Jiménez, Emilio; Roig-Sánchez, Inés; Faus, María José

2016-11-01

To determine the test-retest reliability of a questionnaire, with a validation preliminary, to assess knowledge of cardiovascular risk (CVR) and cardiovascular disease in patients attending community pharmacies in Spain. To complement the external validity, establishing the relationship between an educational activity and the increase in knowledge about CVR and cardiovascular disease. Sub-analysis of a controlled clinical study, EMDADER-CV, in which a questionnaire about knowledge concerning CVR was applied at 4 different times. Spanish Community Pharmacies. There were 323 patients in the control group, from the 640 who completed the study. Intraclass correlation coefficient to assess the reliability in 3 comparisons (post-educational activity with week 16, post-educational activity with week 32, and week 16 with week 32); and the non-parametric Friedman test to establish the relationship between an oral and written educational activity with increasing knowledge. For the 323 patients in the 3 comparisons, the intraclass correlation coefficient values were 0.624; 0.608 and 0.801, respectively (fair-good to excellent reliability). So, the Friedman test showed a statistically significant relationship between educational activity and increased knowledge (p < .0001). According to the intraclass correlation coefficient, the questionnaire aimed at assessing the knowledge on CVR and cardiovascular disease has a reliability between acceptable and excellent, which added to the previous validation, shows that the instrument meets the criteria of validity and reliability. Furthermore, the questionnaire showed the ability to relate an increase in knowledge with an educational intervention, feature that complements its external validity. Copyright © 2016 Elsevier España, S.L.U. All rights reserved.

Multifactorial screening for fall risk in community-dwelling older adults in the primary care office: development of the fall risk assessment & screening tool.

PubMed

Renfro, Mindy Oxman; Fehrer, Steven

2011-01-01

Unintentional falls is an increasing public health problem as incidence of falls rises and the population ages. The Centers for Disease Control and Prevention reports that 1 in 3 adults aged 65 years and older will experience a fall this year; 20% to 30% of those who fall will sustain a moderate to severe injury. Physical therapists caring for older adults are usually engaged with these patients after the first injury fall and may have little opportunity to abate fall risk before the injuries occur. This article describes the content selection and development of a simple-to-administer, multifactorial, Fall Risk Assessment & Screening Tool (FRAST), designed specifically for use in primary care settings to identify those older adults with high fall risk. Fall Risk Assessment & Screening Tool incorporates previously validated measures within a new multifactorial tool and includes targeted recommendations for intervention. Development of the multifactorial FRAST used a 5-part process: identification of significant fall risk factors, review of best evidence, selection of items, creation of the scoring grid, and development of a recommended action plan. Fall Risk Assessment & Screening Tool has been developed to assess fall risk in the target population of older adults (older than 65 years) living and ambulating independently in the community. Many fall risk factors have been considered and 15 items selected for inclusion. Fall Risk Assessment & Screening Tool includes 4 previously validated measures to assess balance, depression, falls efficacy, and home safety. Reliability and validity studies of FRAST are under way. Fall risk for community-dwelling older adults is an urgent, multifactorial, public health problem. Providing primary care practitioners (PCPs) with a very simple screening tool is imperative. Fall Risk Assessment & Screening Tool was created to allow for safe, quick, and low-cost administration by minimally trained office staff with interpretation and

Risk perception and information processing: the development and validation of a questionnaire to assess self-reported information processing.

PubMed

Smerecnik, Chris M R; Mesters, Ilse; Candel, Math J J M; De Vries, Hein; De Vries, Nanne K

2012-01-01

The role of information processing in understanding people's responses to risk information has recently received substantial attention. One limitation of this research concerns the unavailability of a validated questionnaire of information processing. This article presents two studies in which we describe the development and validation of the Information-Processing Questionnaire to meet that need. Study 1 describes the development and initial validation of the questionnaire. Participants were randomized to either a systematic processing or a heuristic processing condition after which they completed a manipulation check and the initial 15-item questionnaire and again two weeks later. The questionnaire was subjected to factor reliability and validity analyses on both measurement times for purposes of cross-validation of the results. A two-factor solution was observed representing a systematic processing and a heuristic processing subscale. The resulting scale showed good reliability and validity, with the systematic condition scoring significantly higher on the systematic subscale and the heuristic processing condition significantly higher on the heuristic subscale. Study 2 sought to further validate the questionnaire in a field study. Results of the second study corresponded with those of Study 1 and provided further evidence of the validity of the Information-Processing Questionnaire. The availability of this information-processing scale will be a valuable asset for future research and may provide researchers with new research opportunities. © 2011 Society for Risk Analysis.

Above, Beyond, and Over the Side rails: Evaluating the New Memorial Emergency Department Fall-Risk-Assessment Tool.

PubMed

Scott, Robin A; Oman, Kathleen S; Flarity, Kathleen; Comer, Jennifer L

2018-03-06

Patient falls are a significant issue in hospitalized patients and financially costly to hospitals. The Joint Commission requires that patients be assessed for fall risk and interventions in place to mitigate the risk of falls. It is imperative to have a patient population/setting specific fall risk assessment tool to identify patients at risk for falling. The purpose of this study was to evaluate the reliability and validity of the 2013 Memorial ED Fall Risk Assessment tool (MEDFRAT) specifically designed for the ED population. A two-phase prospective design was used for this study. Phase one determined the interrater reliability of the MEDFRAT. Phase two assessed the validity of the MEDFRAT in an emergency department (ED) within a 600-bed academic/teaching institution; Level II Trauma Center with >100,000 annual patient visits. The Memorial ED Fall Risk Assessment Tool was validated in this ED setting. The tool demonstrated positive interrater reliability (k=0.701) and when implemented with a falls prevention strategy and staff education demonstrated a 48% decrease in ED fall rate (0.57 falls/1000 patient visits) post implementation during the study period. The MEDFRAT, an evidenced based ED-specific fall risk tool was implemented on the basis of the risk factors consistently identified in the literature: prior fall history, impaired mobility, altered mental status, altered elimination, and the use of sedative medication. The Memorial ED Fall Risk Assessment Tool demonstrated to be a valid tool for this hospital system. Copyright © 2018 Emergency Nurses Association. Published by Elsevier Inc. All rights reserved.

From Risk Assessment to Risk Management: Matching Interventions to Adolescent Offenders’ Strengths and Vulnerabilities

PubMed Central

Singh, Jay P.; Desmarais, Sarah L.; Sellers, Brian G.; Hylton, Tatiana; Tirotti, Melissa; Van Dorn, Richard A.

2013-01-01

Though considerable research has examined the validity of risk assessment tools in predicting adverse outcomes in justice-involved adolescents, the extent to which risk assessments are translated into risk management strategies and, importantly, the association between this link and adverse outcomes has gone largely unexamined. To address these shortcomings, the Risk-Need-Responsivity (RNR) model was used to examine associations between identified strengths and vulnerabilities, interventions, and institutional outcomes for justice-involved youth. Data were collected from risk assessments completed using the Short-Term Assessment of Risk and Treatability: Adolescent Version (START:AV) for 120 adolescent offenders (96 boys and 24 girls). Interventions and outcomes were extracted from institutional records. Mixed evidence of adherence to RNR principles was found. Accordant to the risk principle, adolescent offenders judged to have more strengths had more strength-based interventions in their service plans, though adolescent offenders with more vulnerabilities did not have more interventions targeting their vulnerabilities. With respect to the need and responsivity principles, vulnerabilities and strengths identified as particularly relevant to the individual youth's risk of adverse outcomes were addressed in the service plans about half and a quarter of the time, respectively. Greater adherence to the risk and need principles was found to predict significantly the likelihood of externalizing outcomes. Findings suggest some gaps between risk assessment and risk management and highlight the potential usefulness of strength-based approaches to intervention. PMID:25346561

The local lymph node assay and the assessment of relative potency: status of validation.

PubMed

Basketter, David A; Gerberick, Frank; Kimber, Ian

2007-08-01

For the prediction of skin sensitization potential, the local lymph node assay (LLNA) is a fully validated alternative to guinea-pig tests. More recently, information from LLNA dose-response analyses has been used to assess the relative potency of skin sensitizing chemicals. These data are then deployed for risk assessment and risk management. In this commentary, the utility and validity of these relative potency measurements are reviewed. It is concluded that the LLNA does provide a valuable assessment of relative sensitizing potency in the form of the estimated concentration of a chemical required to produce a threefold stimulation of draining lymph node cell proliferation compared with concurrent controls (EC3 value) and that all reasonable validation requirements have been addressed successfully. EC3 measurements are reproducible in both intra- and interlaboratory evaluations and are stable over time. It has been shown also, by several independent groups, that EC3 values correlate closely with data on relative human skin sensitization potency. Consequently, the recommendation made here is that LLNA EC3 measurements should now be regarded as a validated method for the determination of the relative potency of skin sensitizing chemicals, a conclusion that has already been reached by a number of independent expert groups.

Validation of Pre-operative Patient Self-Assessment of Cardiac Risk for Non-Cardiac Surgery: Foundations for Decision Support

PubMed Central

Manaktala, Sharad; Rockwood, Todd; Adam, Terrence J.

2013-01-01

Objectives: To better characterize patient understanding of their risk of cardiac complications from non-cardiac surgery and to develop a patient driven clinical decision support system for preoperative patient risk management. Methods: A patient-driven preoperative self-assessment decision support tool for perioperative assessment was created. Patient’ self-perception of cardiac risk and self-report data for risk factors were compared with gold standard preoperative physician assessment to evaluate agreement. Results: The patient generated cardiac risk profile was used for risk score generation and had excellent agreement with the expert physician assessment. However, patient subjective self-perception risk of cardiovascular complications had poor agreement with expert assessment. Conclusion: A patient driven cardiac risk assessment tool provides a high degree of agreement with expert provider assessment demonstrating clinical feasibility. The limited agreement between provider risk assessment and patient self-perception underscores a need for further work including focused preoperative patient education on cardiac risk. PMID:24551384

Quasi-experimental study designs series-paper 6: risk of bias assessment.

PubMed

Waddington, Hugh; Aloe, Ariel M; Becker, Betsy Jane; Djimeu, Eric W; Hombrados, Jorge Garcia; Tugwell, Peter; Wells, George; Reeves, Barney

2017-09-01

Rigorous and transparent bias assessment is a core component of high-quality systematic reviews. We assess modifications to existing risk of bias approaches to incorporate rigorous quasi-experimental approaches with selection on unobservables. These are nonrandomized studies using design-based approaches to control for unobservable sources of confounding such as difference studies, instrumental variables, interrupted time series, natural experiments, and regression-discontinuity designs. We review existing risk of bias tools. Drawing on these tools, we present domains of bias and suggest directions for evaluation questions. The review suggests that existing risk of bias tools provide, to different degrees, incomplete transparent criteria to assess the validity of these designs. The paper then presents an approach to evaluating the internal validity of quasi-experiments with selection on unobservables. We conclude that tools for nonrandomized studies of interventions need to be further developed to incorporate evaluation questions for quasi-experiments with selection on unobservables. Copyright © 2017 Elsevier Inc. All rights reserved.

Review on pen-and-paper-based observational methods for assessing ergonomic risk factors of computer work.

PubMed

Rahman, Mohd Nasrull Abdol; Mohamad, Siti Shafika

2017-01-01

Computer works are associated with Musculoskeletal Disorders (MSDs). There are several methods have been developed to assess computer work risk factor related to MSDs. This review aims to give an overview of current techniques available for pen-and-paper-based observational methods in assessing ergonomic risk factors of computer work. We searched an electronic database for materials from 1992 until 2015. The selected methods were focused on computer work, pen-and-paper observational methods, office risk factors and musculoskeletal disorders. This review was developed to assess the risk factors, reliability and validity of pen-and-paper observational method associated with computer work. Two evaluators independently carried out this review. Seven observational methods used to assess exposure to office risk factor for work-related musculoskeletal disorders were identified. The risk factors involved in current techniques of pen and paper based observational tools were postures, office components, force and repetition. From the seven methods, only five methods had been tested for reliability. They were proven to be reliable and were rated as moderate to good. For the validity testing, from seven methods only four methods were tested and the results are moderate. Many observational tools already exist, but no single tool appears to cover all of the risk factors including working posture, office component, force, repetition and office environment at office workstations and computer work. Although the most important factor in developing tool is proper validation of exposure assessment techniques, the existing observational method did not test reliability and validity. Futhermore, this review could provide the researchers with ways on how to improve the pen-and-paper-based observational method for assessing ergonomic risk factors of computer work.

ACSNSQIP Risk Calculator in Indian Patients Undergoing Surgery for Head and Neck Cancers: Is It Valid?

PubMed

Subramaniam, Narayana; Balasubramanian, Deepak; Rka, Pradeep; Murthy, Samskruthi; Rathod, Priyank; Vidhyadharan, Sivakumar; Thankappan, Krishnakumar; Iyer, Subramania

2018-06-01

Pre-operative assessment is vital to determine patient-specific risks and minimize them in order to optimize surgical outcomes. The American College of Surgeons National Surgical Quality Improvement Program (ACSNSQIP) Surgical Risk Calculator is the most comprehensive surgical risk assessment tool available. We performed this study to determine the validity of ACSNSQIP calculator when used to predict surgical complications in a cohort of patients with head and neck cancer treated in an Indian tertiary care center. Retrospective data was collected for 150 patients with head and neck cancer who were operated in the Department of Head and Neck Oncology, Amrita Institute of Medical Sciences, Kochi, in the year 2016. The predicted outcome data was compared with actual documented outcome data for the variables mentioned. Brier's score was used to estimate the predictive value of the risk assessment generated. Pearson's r coefficient was utilized to validate the prediction of length of hospital stay. Brier's score for the entire calculator was 0.32 (not significant). Additionally, when the score was determined for individual parameters (surgical site infection, pneumonia, etc.), none were significant. Pearson's r value for length of stay was also not significant ( p  = .632). The ACSNSQIP risk assessment tool did not accurately reflect surgical outcomes in our cohort of Indian patients. Although it is the most comprehensive tool available at present, modifications that may improve accuracy are allowing for input of multiple procedure codes, risk stratifying for previous radiation or surgery, and better risk assessment for microvascular flap reconstruction.

Validity of the prenatal risk overview for detecting drug use disorders in pregnancy.

PubMed

Harrison, Patricia A; Godecker, Amy; Sidebottom, Abbey

2012-11-01

To validate the Prenatal Risk Overview (PRO) drug use questions against a structured diagnostic interview among pregnant women. Prenatal care patients were administered the PRO at intake and then asked to consent to a research diagnostic interview. Of 1,367 women asked to participate, 1,274 consented and 745 completed the study. Three drug use items comprised one of 13 PRO psychosocial risk domains. The Structured Clinical Interview for DSM-IV (SCID) was used as the validation instrument. To assess criterion validity, the Moderate/High and High Risk classifications were cross-tabulated with SCID Drug Use Disorder diagnoses. In response to the PRO, almost one third of participants (29.4%) reported drug use during the 12 months pre-pregnancy awareness and 11.0% reported use post-pregnancy awareness; 7.0% met SCID diagnostic criteria for Drug Abuse, Drug Dependence, or both, primarily for marijuana use. Drug Use Disorder sensitivity and specificity rates for the PRO Moderate/High Risk classifications were 88.5% and 74.3%, respectively, and for High Risk only, 78.8% and 87.3%. The PRO yielded substantial self-reporting of drug use before and after pregnancy awareness with high sensitivity and specificity for detecting Drug Use Disorders. PRO results can inform decisions about appropriate clinical responses. © 2012 Wiley Periodicals, Inc.

Development of a Fall-Risk Self-Assessment for Community-Dwelling Seniors

PubMed Central

Vivrette, Rebecca L.; Rubenstein, Laurence Z.; Martin, Jennifer L.; Josephson, Karen R.; Kramer, B. Josea

2012-01-01

Objective To determine seniors’ beliefs about falls and design a fall-risk self-assessment and educational materials to promote early identification of evidence-based fall risks and encourage prevention behaviors. Methods Focus groups with community-dwelling seniors, conducted in two phases to identify perceptions about fall risks and risk reduction and to assess face validity of the fall-risk self-assessment and acceptability of educational materials. Results Lay perception of fall risks was in general concordance with evidence-based research. Maintaining independence and positive tone were perceived as key motivators for fall prevention. Seniors intended to use information in the educational tool to stimulate discussions about falls with health care providers. Implications An evidence-based, educational fall-risk self-assessment acceptable to older adults can build on existing lay knowledge about fall risks and perception that falls are a relevant problem and can educate seniors about their specific risks and how to minimize them. PMID:21285473

Determination and validation of soil thresholds for cadmium based on food quality standard and health risk assessment.

PubMed

Ding, Changfeng; Ma, Yibing; Li, Xiaogang; Zhang, Taolin; Wang, Xingxiang

2018-04-01

Cadmium (Cd) is an environmental toxicant with high rates of soil-plant transfer. It is essential to establish an accurate soil threshold for the implementation of soil management practices. This study takes root vegetable as an example to derive soil thresholds for Cd based on the food quality standard as well as health risk assessment using species sensitivity distribution (SSD). A soil type-specific bioconcentration factor (BCF, ratio of Cd concentration in plant to that in soil) generated from soil with a proper Cd concentration gradient was calculated and applied in the derivation of soil thresholds instead of a generic BCF value to minimize the uncertainty. The sensitivity variations of twelve root vegetable cultivars for accumulating soil Cd and the empirical soil-plant transfer model were investigated and developed in greenhouse experiments. After normalization, the hazardous concentrations from the fifth percentile of the distribution based on added Cd (HC5 add ) were calculated from the SSD curves fitted by Burr Type III distribution. The derived soil thresholds were presented as continuous or scenario criteria depending on the combination of soil pH and organic carbon content. The soil thresholds based on food quality standard were on average 0.7-fold of those based on health risk assessment, and were further validated to be reliable using independent data from field survey and published articles. The results suggested that deriving soil thresholds for Cd using SSD method is robust and also applicable to other crops as well as other trace elements that have the potential to cause health risk issues. Copyright © 2017 Elsevier B.V. All rights reserved.

When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

PubMed

Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

2016-10-01

Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

The Convergent Validities of Two Measures of Dating Behaviors Related to Risk for Sexual Victimization

ERIC Educational Resources Information Center

Breitenbecher, Kimberly Hanson

2008-01-01

The primary purpose of this investigation was to assess the convergent validities of two measures of dating behaviors related to risk for sexual victimization, the Dating Self-Protection Against Rape Scale (DSPARS) and the Dating Behavior Survey (DBS). Three hundred seventy-seven women responded to measures assessing self-protective dating…

A framework for global river flood risk assessments

NASA Astrophysics Data System (ADS)

Winsemius, H. C.; Van Beek, L. P. H.; Jongman, B.; Ward, P. J.; Bouwman, A.

2013-05-01

There is an increasing need for strategic global assessments of flood risks in current and future conditions. In this paper, we propose a framework for global flood risk assessment for river floods, which can be applied in current conditions, as well as in future conditions due to climate and socio-economic changes. The framework's goal is to establish flood hazard and impact estimates at a high enough resolution to allow for their combination into a risk estimate, which can be used for strategic global flood risk assessments. The framework estimates hazard at a resolution of ~ 1 km2 using global forcing datasets of the current (or in scenario mode, future) climate, a global hydrological model, a global flood-routing model, and more importantly, an inundation downscaling routine. The second component of the framework combines hazard with flood impact models at the same resolution (e.g. damage, affected GDP, and affected population) to establish indicators for flood risk (e.g. annual expected damage, affected GDP, and affected population). The framework has been applied using the global hydrological model PCR-GLOBWB, which includes an optional global flood routing model DynRout, combined with scenarios from the Integrated Model to Assess the Global Environment (IMAGE). We performed downscaling of the hazard probability distributions to 1 km2 resolution with a new downscaling algorithm, applied on Bangladesh as a first case study application area. We demonstrate the risk assessment approach in Bangladesh based on GDP per capita data, population, and land use maps for 2010 and 2050. Validation of the hazard estimates has been performed using the Dartmouth Flood Observatory database. This was done by comparing a high return period flood with the maximum observed extent, as well as by comparing a time series of a single event with Dartmouth imagery of the event. Validation of modelled damage estimates was performed using observed damage estimates from the EM

National-Level Multi-Hazard Risk Assessments in Sub-Saharan Africa

NASA Astrophysics Data System (ADS)

Murnane, R. J.; Balog, S.; Fraser, S. A.; Jongman, B.; Van Ledden, M.; Phillips, E.; Simpson, A.

2017-12-01

National-level risk assessments can provide important baseline information for decision-making on risk management and risk financing strategies. In this study, multi-hazard risk assessments were undertaken for 9 countries in Sub-Saharan Africa: Cape Verde, Ethiopia, Kenya, Niger, Malawi, Mali, Mozambique, Senegal and Uganda. The assessment was part of the Building Disaster Resilience in Sub-Saharan Africa Program and aimed at supporting the development of multi-risk financing strategies to help African countries make informed decisions to mitigate the socio-economic, fiscal and financial impacts of disasters. The assessments considered hazards and exposures consistent with the years 2010 and 2050. We worked with multiple firms to develop the hazard, exposure and vulnerability data and the risk results. The hazards include: coastal flood, drought, earthquake, landslide, riverine flood, tropical cyclone wind and storm surge, and volcanoes. For hazards expected to vary with climate, the 2050 hazard is based on the IPCC RCP 6.0. Geolocated exposure data for 2010 and 2050 at a 15 arc second ( 0.5 km) resolution includes: structures as a function of seven development patterns; transportation networks including roads, bridges, tunnels and rail; critical facilities such as schools, hospitals, energy facilities and government buildings; crops; population; and, gross domestic product (GDP). The 2050 exposure values for population are based on the IPCC SSP 2. Values for other exposure data are a function of population change. Vulnerability was based on openly available vulnerability functions. Losses were based on replacement values (e.g., cost/m2 or cost/km). Risk results are provided in terms of annual average loss and a variety of return periods at the national and Admin 1 levels. Assessments of recent historical events are used to validate the model results. In the future, it would be useful to use hazard footprints of historical events for validation purposes. The

Fundamentals of health risk assessment. Use, derivation, validity and limitations of safety indices.

PubMed

Putzrath, R M; Wilson, J D

1999-04-01

We investigated the way results of human health risk assessments are used, and the theory used to describe those methods, sometimes called the "NAS paradigm." Contrary to a key tenet of that theory, current methods have strictly limited utility. The characterizations now considered standard, Safety Indices such as "Acceptable Daily Intake," "Reference Dose," and so on, usefully inform only decisions that require a choice between two policy alternatives (e.g., approve a food additive or not), decided solely on the basis of a finding of safety. Risk is characterized as the quotient of one of these Safety Indices divided by an estimate of exposure: a quotient greater than one implies that the situation may be considered safe. Such decisions are very widespread, both in the U.S. federal government and elsewhere. No current method is universal; different policies lead to different practices, for example, in California's "Proposition 65," where statutory provisions specify some practices. Further, an important kind of human health risk assessment is not recognized by this theory: this kind characterizes risk as likelihood of harm, given estimates of exposure consequent to various decision choices. Likelihood estimates are necessary whenever decision makers have many possible decision choices and must weigh more than two societal values, such as in EPA's implementation of "conventional air pollutants." These estimates can not be derived using current methods; different methods are needed. Our analysis suggests changes needed in both the theory and practice of human health risk assessment, and how what is done is depicted.

A systematic review and appraisal of methods of developing and validating lifestyle cardiovascular disease risk factors questionnaires.

PubMed

Nse, Odunaiya; Quinette, Louw; Okechukwu, Ogah

2015-09-01

Well developed and validated lifestyle cardiovascular disease (CVD) risk factors questionnaires is the key to obtaining accurate information to enable planning of CVD prevention program which is a necessity in developing countries. We conducted this review to assess methods and processes used for development and content validation of lifestyle CVD risk factors questionnaires and possibly develop an evidence based guideline for development and content validation of lifestyle CVD risk factors questionnaires. Relevant databases at the Stellenbosch University library were searched for studies conducted between 2008 and 2012, in English language and among humans. Using the following databases; pubmed, cinahl, psyc info and proquest. Search terms used were CVD risk factors, questionnaires, smoking, alcohol, physical activity and diet. Methods identified for development of lifestyle CVD risk factors were; review of literature either systematic or traditional, involvement of expert and /or target population using focus group discussion/interview, clinical experience of authors and deductive reasoning of authors. For validation, methods used were; the involvement of expert panel, the use of target population and factor analysis. Combination of methods produces questionnaires with good content validity and other psychometric properties which we consider good.

The Validity of the Child and Adolescent Needs and Strengths Assessment

ERIC Educational Resources Information Center

Dilley, Joseph B.; Weiner, Dana A.; Lyons, John S.; Martinovich, Zoran

2007-01-01

The Child and Adolescent Needs and Strengths (CANS) is a functional assessment used in approximately 27 states to evaluate youth service outcomes. The CANS purports to measure both the youth's risk and protective factors, but its validity is largely un-researched. This study compares ratings of 304 delinquent youth on the CANS and ratings on a…

Development, reliability, and validity testing of Toddler NutriSTEP: a nutrition risk screening questionnaire for children 18-35 months of age.

PubMed

Randall Simpson, Janis; Gumbley, Jillian; Whyte, Kylie; Lac, Jane; Morra, Crystal; Rysdale, Lee; Turfryer, Mary; McGibbon, Kim; Beyers, Joanne; Keller, Heather

2015-09-01

Nutrition is vital for optimal growth and development of young children. Nutrition risk screening can facilitate early intervention when followed by nutritional assessment and treatment. NutriSTEP (Nutrition Screening Tool for Every Preschooler) is a valid and reliable nutrition risk screening questionnaire for preschoolers (aged 3-5 years). A need was identified for a similar questionnaire for toddlers (aged 18-35 months). The purpose was to develop a reliable and valid Toddler NutriSTEP. Toddler NutriSTEP was developed in 4 phases. Content and face validity were determined with a literature review, parent focus groups (n = 6; 48 participants), and experts (n = 13) (phase A). A draft questionnaire was refined with key intercept interviews of 107 parents/caregivers (phase B). Test-retest reliability (phase C), based on intra-class correlations (ICC), Kappa (κ) statistics, and Wilcoxon tests was assessed with 133 parents/caregivers. Criterion validity (phase D) was assessed using Receiver Operating Characteristic (ROC) curves by comparing scores on the Toddler NutriSTEP to a comprehensive nutritional assessment of 200 toddlers with a registered dietitian (RD). The Toddler NutriSTEP was reliable between 2 administrations (ICC = 0.951, F = 20.53, p < 0.001); most questions had moderate (κ ≥ 0.6) or excellent (κ ≥ 0.8) agreement. Scores on the RD nutrition risk rating and the Toddler NutriSTEP were correlated (r = 0.67, p < 0.000). The area under the ROC curve for moderate and high RD risk ratings were 84.6% and 82.7%, respectively. Cut-points of ≥21 (sensitivity 86%; specificity 61%) (moderate risk) and ≥26 (sensitivity 95%; specificity 63%) (high risk) were determined. The Toddler NutriSTEP questionnaire is both reliable and valid for screening for nutritional risk in toddlers.

Improving risk assessment in schizophrenia: epidemiological investigation of criminal history factors

PubMed Central

Witt, Katrina; Lichtenstein, Paul; Fazel, Seena

2015-01-01

Background Violence risk assessment in schizophrenia relies heavily on criminal history factors. Aims To investigate which criminal history factors are most strongly associated with violent crime in schizophrenia. Method A total of 13 806 individuals (8891 men and 4915 women) with two or more hospital admissions for schizophrenia were followed up for violent convictions. Multivariate hazard ratios for 15 criminal history factors included in different risk assessment tools were calculated. The incremental predictive validity of these factors was estimated using tests of discrimination, calibration and reclassification. Results Over a mean follow-up of 12.0 years, 17.3% of men (n = 1535) and 5.7% of women (n = 281) were convicted of a violent offence. Criminal history factors most strongly associated with subsequent violence for both men and women were a previous conviction for a violent offence; for assault, illegal threats and/or intimidation; and imprisonment. However, only a previous conviction for a violent offence was associated with incremental predictive validity in both genders following adjustment for young age and comorbid substance use disorder. Conclusions Clinical and actuarial approaches to assess violence risk can be improved if included risk factors are tested using multiple measures of performance. PMID:25657352

Improving risk assessment in schizophrenia: epidemiological investigation of criminal history factors.

PubMed

Witt, Katrina; Lichtenstein, Paul; Fazel, Seena

2015-05-01

Violence risk assessment in schizophrenia relies heavily on criminal history factors. To investigate which criminal history factors are most strongly associated with violent crime in schizophrenia. A total of 13 806 individuals (8891 men and 4915 women) with two or more hospital admissions for schizophrenia were followed up for violent convictions. Multivariate hazard ratios for 15 criminal history factors included in different risk assessment tools were calculated. The incremental predictive validity of these factors was estimated using tests of discrimination, calibration and reclassification. Over a mean follow-up of 12.0 years, 17.3% of men (n = 1535) and 5.7% of women (n = 281) were convicted of a violent offence. Criminal history factors most strongly associated with subsequent violence for both men and women were a previous conviction for a violent offence; for assault, illegal threats and/or intimidation; and imprisonment. However, only a previous conviction for a violent offence was associated with incremental predictive validity in both genders following adjustment for young age and comorbid substance use disorder. Clinical and actuarial approaches to assess violence risk can be improved if included risk factors are tested using multiple measures of performance. © The Royal College of Psychiatrists 2015.

Structural Validation of the Holistic Wellness Assessment

ERIC Educational Resources Information Center

Brown, Charlene; Applegate, E. Brooks; Yildiz, Mustafa

2015-01-01

The Holistic Wellness Assessment (HWA) is a relatively new assessment instrument based on an emergent transdisciplinary model of wellness. This study validated the factor structure identified via exploratory factor analysis (EFA), assessed test-retest reliability, and investigated concurrent validity of the HWA in three separate samples. The…

Assessing the Validity and Reliability of the Peristomal Skin Lesion Assessment Instrument Adapted for Use in Turkey.

PubMed

Ay, Ali; Bulut, Hulya

2015-08-01

Many ostomy patients experience peristomal skin lesions. A descriptive study was conducted to assess the validity, usability, and reliability of the Peristomal Skin Lesions Assessment instrument (SACS instrument) adapted to Turkish from English. The SACS Instrument consists of 2 main assessments: lesion type (utilizing definitions and photographs) and lesion area by location around the ostomy. The study was performed in 2 stages: 1) the SACS language was changed and its content validity established; and 2) the instrument\\'92s content validity and inter-observer agreement (consistency) were determined among pairs of nurses who used the tool to assess peristomal skin lesions. Patients (included if they were >18 years old and receiving treatment/observation at 1 of the 4 participating stomatherapy units) and 8 stomatherapy nurses also completed appropriate sociodemographic questionnaires. Of the 393 patients screened during the 7-month study, 100 (average age 56.74 \\'b1 14.03 years, 55 men) participated; most (79) had a planned operation. A little more than half (59) of the patients had colorectal cancer and 28 had their stoma site marked preoperatively by a stomatherapy nurse. The most common peristomal skin lesion risk factors were having an ileostomy and unplanned surgery. The content validity index of the entire Turkish SACS instrument was 1, and the inter-observer agreement Kappa statistic was very good (K = 0.90, 95% CI 0.80- 0.99). Individual SACS item K values ranged from K = 0.84 (95% CI 0.63\\'961) to K = 1 (95% CI 1). Most (62.5%) nurses found the terms and pictures used in the SACS classification adequate and suitable, and 50% believed the Turkish version of the SACS instrument was a valid and suitable assessment tool for use by Turkish stomatherapy nurses. Validity and reliability studies involving larger and more diverse patient and nurse samples are warranted.

Risk Assessment Overview

NASA Technical Reports Server (NTRS)

Prassinos, Peter G.; Lyver, John W., IV; Bui, Chinh T.

2011-01-01

Risk assessment is used in many industries to identify and manage risks. Initially developed for use on aeronautical and nuclear systems, risk assessment has been applied to transportation, chemical, computer, financial, and security systems among others. It is used to gain an understanding of the weaknesses or vulnerabilities in a system so modification can be made to increase operability, efficiency, and safety and to reduce failure and down-time. Risk assessment results are primary inputs to risk-informed decision making; where risk information including uncertainty is used along with other pertinent information to assist management in the decision-making process. Therefore, to be useful, a risk assessment must be directed at specific objectives. As the world embraces the globalization of trade and manufacturing, understanding the associated risk become important to decision making. Applying risk assessment techniques to a global system of development, manufacturing, and transportation can provide insight into how the system can fail, the likelihood of system failure and the consequences of system failure. The risk assessment can identify those elements that contribute most to risk and identify measures to prevent and mitigate failures, disruptions, and damaging outcomes. In addition, risk associated with public and environment impact can be identified. The risk insights gained can be applied to making decisions concerning suitable development and manufacturing locations, supply chains, and transportation strategies. While risk assessment has been mostly applied to mechanical and electrical systems, the concepts and techniques can be applied across other systems and activities. This paper provides a basic overview of the development of a risk assessment.

Tools for assessing fall risk in the elderly: a systematic review and meta-analysis.

PubMed

Park, Seong-Hi

2018-01-01

The prevention of falls among the elderly is arguably one of the most important public health issues in today's aging society. The aim of this study was to assess which tools best predict the risk of falls in the elderly. Electronic searches were performed using Medline, EMBASE, the Cochrane Library, CINAHL, etc., using the following keywords: "fall risk assessment", "elderly fall screening", and "elderly mobility scale". The QUADAS-2 was applied to assess the internal validity of the diagnostic studies. Selected studies were meta-analyzed with MetaDisc 1.4. A total of 33 studies were eligible out of the 2,321 studies retrieved from selected databases. Twenty-six assessment tools for fall risk were used in the selected articles, and they tended to vary based on the setting. The fall risk assessment tools currently used for the elderly did not show sufficiently high predictive validity for differentiating high and low fall risks. The Berg Balance scale and Mobility Interaction Fall chart showed stable and high specificity, while the Downton Fall Risk Index, Hendrich II Fall Risk Model, St. Thomas's Risk Assessment Tool in Falling elderly inpatients, Timed Up and Go test, and Tinetti Balance scale showed the opposite results. We concluded that rather than a single measure, two assessment tools used together would better evaluate the characteristics of falls by the elderly that can occur due to a multitude of factors and maximize the advantages of each for predicting the occurrence of falls.

Falls risk assessment begins with hello: lessons learned from the use of one home health agency's fall risk tool.

PubMed

Flemming, Patricia J; Ramsay, Katherine

2012-10-01

Identifying older adults at risk for falls is a challenge all home healthcare agencies (HHAs) face. The process of assessing for falls risk begins with the initial home visit. One HHA affiliated with an academic medical center describes its experience in development and use of a Falls Risk Assessment (FRA) tool over a 10-year period. The FRA tool has been modified since initial development to clarify elements of the tool based on research and to reflect changes in the Outcome and Assessment Information Set (OASIS) document. The primary purpose of this article is to share a validated falls risk assessment tool to facilitate identification of fall-related risk factors in the homebound population. A secondary purpose is to share lessons learned by the HHA during the 10 years using the FRA.

Quantitative risk assessment for skin sensitization: Success or failure?

PubMed

Kimber, Ian; Gerberick, G Frank; Basketter, David A

2017-02-01

Skin sensitization is unique in the world of toxicology. There is a combination of reliable, validated predictive test methods for identification of skin sensitizing chemicals, a clearly documented and transparent approach to risk assessment, and effective feedback from dermatology clinics around the world delivering evidence of the success or failure of the hazard identification/risk assessment/management process. Recent epidemics of contact allergy, particularly to preservatives, have raised questions of whether the safety/risk assessment process is working in an optimal manner (or indeed is working at all!). This review has as its focus skin sensitization quantitative risk assessment (QRA). The core toxicological principles of QRA are reviewed, and evidence of use and misuse examined. What becomes clear is that skin sensitization QRA will only function adequately if two essential criteria are met. The first is that QRA is applied rigourously, and the second is that potential exposure to the sensitizing substance is assessed adequately. This conclusion will come as no surprise to any toxicologist who appreciates the basic premise that "risk = hazard x exposure". Accordingly, use of skin sensitization QRA is encouraged, not least because the essential feedback from dermatology clinics can be used as a tool to refine QRA in situations where this risk assessment tool has not been properly used. Copyright © 2016 Elsevier Inc. All rights reserved.

Work design and management in the manufacturing sector: development and validation of the Work Organisation Assessment Questionnaire.

PubMed

Griffiths, A; Cox, T; Karanika, M; Khan, S; Tomás, J M

2006-10-01

To examine the factor structure, reliability, and validity of a new context-specific questionnaire for the assessment of work and organisational factors. The Work Organisation Assessment Questionnaire (WOAQ) was developed as part of a risk assessment and risk reduction methodology for hazards inherent in the design and management of work in the manufacturing sector. Two studies were conducted. Data were collected from 524 white- and blue-collar employees from a range of manufacturing companies. Exploratory factor analysis was carried out on 28 items that described the most commonly reported failures of work design and management in companies in the manufacturing sector. Concurrent validity data were also collected. A reliability study was conducted with a further 156 employees. Principal component analysis, with varimax rotation, revealed a strong 28-item, five factor structure. The factors were named: quality of relationships with management, reward and recognition, workload, quality of relationships with colleagues, and quality of physical environment. Analyses also revealed a more general summative factor. Results indicated that the questionnaire has good internal consistency and test-retest reliability and validity. Being associated with poor employee health and changes in health related behaviour, the WOAQ factors are possible hazards. It is argued that the strength of those associations offers some estimation of risk. Feedback from the organisations involved indicated that the WOAQ was easy to use and meaningful for them as part of their risk assessment procedures. The studies reported here describe a model of the hazards to employee health and health related behaviour inherent in the design and management of work in the manufacturing sector. It offers an instrument for their assessment. The scales derived which form the WOAQ were shown to be reliable, valid, and meaningful to the user population.

Work design and management in the manufacturing sector: development and validation of the Work Organisation Assessment Questionnaire

PubMed Central

Griffiths, A; Cox, T; Karanika, M; Khan, S; Tomás, J‐M

2006-01-01

Objectives To examine the factor structure, reliability, and validity of a new context‐specific questionnaire for the assessment of work and organisational factors. The Work Organisation Assessment Questionnaire (WOAQ) was developed as part of a risk assessment and risk reduction methodology for hazards inherent in the design and management of work in the manufacturing sector. Method Two studies were conducted. Data were collected from 524 white‐ and blue‐collar employees from a range of manufacturing companies. Exploratory factor analysis was carried out on 28 items that described the most commonly reported failures of work design and management in companies in the manufacturing sector. Concurrent validity data were also collected. A reliability study was conducted with a further 156 employees. Results Principal component analysis, with varimax rotation, revealed a strong 28‐item, five factor structure. The factors were named: quality of relationships with management, reward and recognition, workload, quality of relationships with colleagues, and quality of physical environment. Analyses also revealed a more general summative factor. Results indicated that the questionnaire has good internal consistency and test‐retest reliability and validity. Being associated with poor employee health and changes in health related behaviour, the WOAQ factors are possible hazards. It is argued that the strength of those associations offers some estimation of risk. Feedback from the organisations involved indicated that the WOAQ was easy to use and meaningful for them as part of their risk assessment procedures. Conclusions The studies reported here describe a model of the hazards to employee health and health related behaviour inherent in the design and management of work in the manufacturing sector. It offers an instrument for their assessment. The scales derived which form the WOAQ were shown to be reliable, valid, and meaningful to the user population. PMID:16858081

Cumulative Risk Assessment (CRA): Transforming the Way We Assess Health Risks

PubMed Central

Williams, Pamela R. D.; Dotson, G. Scott; Maier, Andrew

2016-01-01

Human health risk assessments continue to evolve and now focus on the need for cumulative risk assessment (CRA). CRA involves assessing the combined risk from coexposure to multiple chemical and nonchemical stressors for varying health effects. CRAs are broader in scope than traditional chemical risk assessments because they allow for a more comprehensive evaluation of the interaction between different stressors and their combined impact on human health. Future directions of CRA include greater emphasis on local-level community-based assessments; integrating environmental, occupational, community, and individual risk factors; and identifying and implementing common frameworks and risk metrics for incorporating multiple stressors. PMID:22938698

Survey of mental health nurses' attitudes towards risk assessment, risk assessment tools and positive risk.

PubMed

Downes, C; Gill, A; Doyle, L; Morrissey, J; Higgins, A

2016-04-01

WHAT IS KNOWN ON THE SUBJECT?: Risk assessment and safety planning are a core aspect of the role of the mental health nurse. Conflicting views exist on the value of risk assessment tools. Few studies have examined mental health nurses' attitudes towards risk, including use of tools and the role of positive risk in recovery. WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE?: Mental health nurses view risk assessment as a core dimension of their role and not merely an exercise to fulfil organizational clinical safety and governance obligations. The majority of nurses hold positive attitudes towards therapeutic or positive risk, and consider creative risk taking as vital to people's recovery. The majority of nurses believe that risk assessment tools facilitate professional decision making, however, some are concerned that tools may negatively impact upon therapeutic relationships. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Ongoing education on the use of risk assessment tools is required to minimize views that their use is incompatible with therapeutic engagement, and to enable nurses to develop confidence to engage with positive risk and to allow service users make decisions and take responsibility. Introduction Risk assessment and safety planning are considered core components of the role of the mental health nurse; however, little is known about nurses' attitudes towards risk assessment, use of tools to assess risk or therapeutic risk taking. Aim This study aimed to explore mental health nurses' attitudes towards completing risk assessments, use of tools as an aid, and therapeutic or positive risk. Method An anonymous survey which included 13 attitudinal statements, rated on a five-point Likert scale, was completed by 381 mental health nurses working in adult services in Ireland. Findings Findings indicate strong support for the practice of risk assessment in mental health practice. The vast majority of nurses believe that risk assessment tools facilitate professional

Assessment of validity with polytrauma Veteran populations.

PubMed

Bush, Shane S; Bass, Carmela

2015-01-01

Veterans with polytrauma have suffered injuries to multiple body parts and organs systems, including the brain. The injuries can generate a triad of physical, neurologic/cognitive, and emotional symptoms. Accurate diagnosis is essential for the treatment of these conditions and for fair allocation of benefits. To accurately diagnose polytrauma disorders and their related problems, clinicians take into account the validity of reported history and symptoms, as well as clinical presentations. The purpose of this article is to describe the assessment of validity with polytrauma Veteran populations. Review of scholarly and other relevant literature and clinical experience are utilized. A multimethod approach to validity assessment that includes objective, standardized measures increases the confidence that can be placed in the accuracy of self-reported symptoms and physical, cognitive, and emotional test results. Due to the multivariate nature of polytrauma and the multiple disciplines that play a role in diagnosis and treatment, an ideal model of validity assessment with polytrauma Veteran populations utilizes neurocognitive, neurological, neuropsychiatric, and behavioral measures of validity. An overview of these validity assessment approaches as applied to polytrauma Veteran populations is presented. Veterans, the VA, and society are best served when accurate diagnoses are made.

Evaluation of the performance of existing non-laboratory based cardiovascular risk assessment algorithms

PubMed Central

2013-01-01

Background The high burden and rising incidence of cardiovascular disease (CVD) in resource constrained countries necessitates implementation of robust and pragmatic primary and secondary prevention strategies. Many current CVD management guidelines recommend absolute cardiovascular (CV) risk assessment as a clinically sound guide to preventive and treatment strategies. Development of non-laboratory based cardiovascular risk assessment algorithms enable absolute risk assessment in resource constrained countries. The objective of this review is to evaluate the performance of existing non-laboratory based CV risk assessment algorithms using the benchmarks for clinically useful CV risk assessment algorithms outlined by Cooney and colleagues. Methods A literature search to identify non-laboratory based risk prediction algorithms was performed in MEDLINE, CINAHL, Ovid Premier Nursing Journals Plus, and PubMed databases. The identified algorithms were evaluated using the benchmarks for clinically useful cardiovascular risk assessment algorithms outlined by Cooney and colleagues. Results Five non-laboratory based CV risk assessment algorithms were identified. The Gaziano and Framingham algorithms met the criteria for appropriateness of statistical methods used to derive the algorithms and endpoints. The Swedish Consultation, Framingham and Gaziano algorithms demonstrated good discrimination in derivation datasets. Only the Gaziano algorithm was externally validated where it had optimal discrimination. The Gaziano and WHO algorithms had chart formats which made them simple and user friendly for clinical application. Conclusion Both the Gaziano and Framingham non-laboratory based algorithms met most of the criteria outlined by Cooney and colleagues. External validation of the algorithms in diverse samples is needed to ascertain their performance and applicability to different populations and to enhance clinicians’ confidence in them. PMID:24373202

Validity of a family-centered approach for assessing infants' social-emotional wellbeing and their developmental context: a prospective cohort study.

PubMed

Hielkema, Margriet; De Winter, Andrea F; Reijneveld, Sijmen A

2017-06-15

Family-centered care seems promising in preventive pediatrics, but evidence is lacking as to whether this type of care is also valid as a means to identify risks to infants' social-emotional development. We aimed to examine the validity of such a family-centered approach. We conducted a prospective cohort study. During routine well-child visits (2-15 months), Preventive Child Healthcare (PCH) professionals used a family-centered approach, assessing domains as parents' competence, role of the partner, social support, barriers within the care-giving context, and child's wellbeing for 2976 children as protective, indistinct or a risk. If, based on the overall assessment (the families were labeled as "cases", N = 87), an intervention was considered necessary, parents filled in validated questionnaires covering the aforementioned domains. These questionnaires served as gold standards. For each case, two controls, matched by child-age and gender, also filled in questionnaires (N = 172). We compared PCH professionals' assessments with the parent-reported gold standards. Moreover, we evaluated which domain mostly contributed to the overall assessment. Spearman's rank correlation coefficients between PCH professionals' assessments and gold standards were overall reasonable (Spearman's rho 0.17-0.39) except for the domain barriers within the care-giving context. Scores on gold standards were significantly higher when PCH assessments were rated as "at risk" (overall and per domain).We found reasonable to excellent agreement regarding the absence of risk factors (negative agreement rate: 0.40-0.98), but lower agreement regarding the presence of risk factors (positive agreement rate: 0.00-0.67). An "at risk" assessment for the domain Barriers or life events within the care-giving context contributed most to being overall at risk, i.e. a case, odds ratio 100.1, 95%-confidence interval: 22.6 - infinity. Findings partially support the convergent validity of a family

[Selection of risk and diagnosis in diabetic polyneuropathy. Validation of method of new systems].

PubMed

Jurado, Jerónimo; Caula, Jacinto; Pou i Torelló, Josep Maria

2006-06-30

In a previous study we developed a specific algorithm, the polyneuropathy selection method (PSM) with 4 parameters (age, HDL-C, HbA1c, and retinopathy), to select patients at risk of diabetic polyneuropathy (DPN). We also developed a simplified method for DPN diagnosis: outpatient polyneuropathy diagnosis (OPD), with 4 variables (symptoms and 3 objective tests). To confirm the validity of conventional tests for DPN diagnosis; to validate the discriminatory power of the PSM and the diagnostic value of OPD by evaluating their relationship to electrodiagnosis studies and objective clinical neurological assessment; and to evaluate the correlation of DPN and pro-inflammatory status. Cross-sectional, crossed association for PSM validation. Paired samples for OPD validation. Primary care in 3 counties. Random sample of 75 subjects from the type-2 diabetes census for PSM evaluation. Thirty DPN patients and 30 non-DPN patients (from 2 DM2 sub-groups in our earlier study) for OPD evaluation. The gold standard for DPN diagnosis will be studied by means of a clinical neurological study (symptoms, physical examination, and sensitivity tests) and electrodiagnosis studies (sensitivity and motor EMG). Risks of neuropathy, macroangiopathy and pro-inflammatory status (PCR, TNF soluble fraction and total TGF-beta1) will be studied in every subject. Electrodiagnosis studies should confirm the validity of conventional tests for DPN diagnosis. PSM and OPD will be valid methods for selecting patients at risk and diagnosing DPN. There will be a significant relationship between DPN and pro-inflammatory tests.

Identifying gender specific risk/need areas for male and female juvenile offenders: Factor analyses with the Structured Assessment of Violence Risk in Youth (SAVRY).

PubMed

Hilterman, Ed L B; Bongers, Ilja; Nicholls, Tonia L; van Nieuwenhuizen, Chijs

2016-02-01

By constructing risk assessment tools in which the individual items are organized in the same way for male and female juvenile offenders it is assumed that these items and subscales have similar relevance across males and females. The identification of criminogenic needs that vary in relevance for 1 of the genders, could contribute to more meaningful risk assessments, especially for female juvenile offenders. In this study, exploratory factor analyses (EFA) on a construction sample of male (n = 3,130) and female (n = 466) juvenile offenders were used to aggregate the 30 items of the Structured Assessment of Violence Risk in Youth (SAVRY) into empirically based risk/need factors and explore differences between genders. The factor models were cross-validated through confirmatory factor analyses (CFA) on a validation sample of male (n = 2,076) and female (n = 357) juvenile offenders. In both the construction sample and the validation sample, 5 factors were identified: (a) Antisocial behavior; (b) Family functioning; (c) Personality traits; (d) Social support; and (e) Treatability. The male and female models were significantly different and the internal consistency of the factors was good, both in the construction sample and the validation sample. Clustering risk/need items for male and female juvenile offenders into meaningful factors may guide clinicians in the identification of gender-specific treatment interventions. PsycINFO Database Record (c) 2016 APA, all rights reserved.

[Design and validation of an instrument to assess families at risk for health problems].

PubMed

Puschel, Klaus; Repetto, Paula; Solar, María Olga; Soto, Gabriela; González, Karla

2012-04-01

There is a paucity of screening instruments with a high clinical predictive value to identify families at risk and therefore, develop focused interventions in primary care. To develop an easy to apply screening instrument with a high clinical predictive value to identify families with a higher health vulnerability. In the first stage of the study an instrument with a high content validity was designed through a review of existent instruments, qualitative interviews with families and expert opinions following a Delphi approach of three rounds. In the second stage, concurrent validity was tested through a comparative analysis between the pilot instrument and a family clinical interview conducted to 300 families randomly selected from a population registered at a primary care clinic in Santiago. The sampling was blocked based on the presence of diabetes, depression, child asthma, behavioral disorders, presence of an older person or the lack of previous conditions among family members. The third stage, was directed to test the clinical predictive validity of the instrument by comparing the baseline vulnerability obtained by the instrument and the change in clinical status and health related quality of life perceptions of the family members after nine months of follow-up. The final SALUFAM instrument included 13 items and had a high internal consistency (Cronbach's alpha: 0.821), high test re-test reproducibility (Pearson correlation: 0.84) and a high clinical predictive value for clinical deterioration (Odds ratio: 1.826; 95% confidence intervals: 1.101-3.029). SALUFAM instrument is applicable, replicable, has a high content validity, concurrent validity and clinical predictive value.

[Application of three risk assessment models in occupational health risk assessment of dimethylformamide].

PubMed

Wu, Z J; Xu, B; Jiang, H; Zheng, M; Zhang, M; Zhao, W J; Cheng, J

2016-08-20

Objective: To investigate the application of United States Environmental Protection Agency (EPA) inhalation risk assessment model, Singapore semi-quantitative risk assessment model, and occupational hazards risk assessment index method in occupational health risk in enterprises using dimethylformamide (DMF) in a certain area in Jiangsu, China, and to put forward related risk control measures. Methods: The industries involving DMF exposure in Jiangsu province were chosen as the evaluation objects in 2013 and three risk assessment models were used in the evaluation. EPA inhalation risk assessment model: HQ=EC/RfC; Singapore semi-quantitative risk assessment model: Risk= (HR×ER) 1/2 ; Occupational hazards risk assessment index=2 Health effect level ×2 exposure ratio ×Operation condition level. Results: The results of hazard quotient (HQ>1) from EPA inhalation risk assessment model suggested that all the workshops (dry method, wet method and printing) and work positions (pasting, burdening, unreeling, rolling, assisting) were high risk. The results of Singapore semi-quantitative risk assessment model indicated that the workshop risk level of dry method, wet method and printing were 3.5 (high) , 3.5 (high) and 2.8 (general) , and position risk level of pasting, burdening, unreeling, rolling, assisting were 4 (high) , 4 (high) , 2.8 (general) , 2.8 (general) and 2.8 (general) . The results of occupational hazards risk assessment index method demonstrated that the position risk index of pasting, burdening, unreeling, rolling, assisting were 42 (high) , 33 (high) , 23 (middle) , 21 (middle) and 22 (middle) . The results of Singapore semi-quantitative risk assessment model and occupational hazards risk assessment index method were similar, while EPA inhalation risk assessment model indicated all the workshops and positions were high risk. Conclusion: The occupational hazards risk assessment index method fully considers health effects, exposure, and operating conditions

Heuristics structure and pervade formal risk assessment.

PubMed

MacGillivray, Brian H

2014-04-01

Lay perceptions of risk appear rooted more in heuristics than in reason. A major concern of the risk regulation literature is that such "error-strewn" perceptions may be replicated in policy, as governments respond to the (mis)fears of the citizenry. This has led many to advocate a relatively technocratic approach to regulating risk, characterized by high reliance on formal risk and cost-benefit analysis. However, through two studies of chemicals regulation, we show that the formal assessment of risk is pervaded by its own set of heuristics. These include rules to categorize potential threats, define what constitutes valid data, guide causal inference, and to select and apply formal models. Some of these heuristics lay claim to theoretical or empirical justifications, others are more back-of-the-envelope calculations, while still more purport not to reflect some truth but simply to constrain discretion or perform a desk-clearing function. These heuristics can be understood as a way of authenticating or formalizing risk assessment as a scientific practice, representing a series of rules for bounding problems, collecting data, and interpreting evidence (a methodology). Heuristics are indispensable elements of induction. And so they are not problematic per se, but they can become so when treated as laws rather than as contingent and provisional rules. Pitfalls include the potential for systematic error, masking uncertainties, strategic manipulation, and entrenchment. Our central claim is that by studying the rules of risk assessment qua rules, we develop a novel representation of the methods, conventions, and biases of the prior art. © 2013 Society for Risk Analysis.

Validation of a scenario-based assessment of critical thinking using an externally validated tool.

PubMed

Buur, Jennifer L; Schmidt, Peggy; Smylie, Dean; Irizarry, Kris; Crocker, Carlos; Tyler, John; Barr, Margaret

2012-01-01

With medical education transitioning from knowledge-based curricula to competency-based curricula, critical thinking skills have emerged as a major competency. While there are validated external instruments for assessing critical thinking, many educators have created their own custom assessments of critical thinking. However, the face validity of these assessments has not been challenged. The purpose of this study was to compare results from a custom assessment of critical thinking with the results from a validated external instrument of critical thinking. Students from the College of Veterinary Medicine at Western University of Health Sciences were administered a custom assessment of critical thinking (ACT) examination and the externally validated instrument, California Critical Thinking Skills Test (CCTST), in the spring of 2011. Total scores and sub-scores from each exam were analyzed for significant correlations using Pearson correlation coefficients. Significant correlations between ACT Blooms 2 and deductive reasoning and total ACT score and deductive reasoning were demonstrated with correlation coefficients of 0.24 and 0.22, respectively. No other statistically significant correlations were found. The lack of significant correlation between the two examinations illustrates the need in medical education to externally validate internal custom assessments. Ultimately, the development and validation of custom assessments of non-knowledge-based competencies will produce higher quality medical professionals.

Predictive models to assess risk of type 2 diabetes, hypertension and comorbidity: machine-learning algorithms and validation using national health data from Kuwait—a cohort study

PubMed Central

Farran, Bassam; Channanath, Arshad Mohamed; Behbehani, Kazem; Thanaraj, Thangavel Alphonse

2013-01-01

Objective We build classification models and risk assessment tools for diabetes, hypertension and comorbidity using machine-learning algorithms on data from Kuwait. We model the increased proneness in diabetic patients to develop hypertension and vice versa. We ascertain the importance of ethnicity (and natives vs expatriate migrants) and of using regional data in risk assessment. Design Retrospective cohort study. Four machine-learning techniques were used: logistic regression, k-nearest neighbours (k-NN), multifactor dimensionality reduction and support vector machines. The study uses fivefold cross validation to obtain generalisation accuracies and errors. Setting Kuwait Health Network (KHN) that integrates data from primary health centres and hospitals in Kuwait. Participants 270 172 hospital visitors (of which, 89 858 are diabetic, 58 745 hypertensive and 30 522 comorbid) comprising Kuwaiti natives, Asian and Arab expatriates. Outcome measures Incident type 2 diabetes, hypertension and comorbidity. Results Classification accuracies of >85% (for diabetes) and >90% (for hypertension) are achieved using only simple non-laboratory-based parameters. Risk assessment tools based on k-NN classification models are able to assign ‘high’ risk to 75% of diabetic patients and to 94% of hypertensive patients. Only 5% of diabetic patients are seen assigned ‘low’ risk. Asian-specific models and assessments perform even better. Pathological conditions of diabetes in the general population or in hypertensive population and those of hypertension are modelled. Two-stage aggregate classification models and risk assessment tools, built combining both the component models on diabetes (or on hypertension), perform better than individual models. Conclusions Data on diabetes, hypertension and comorbidity from the cosmopolitan State of Kuwait are available for the first time. This enabled us to apply four different case–control models to assess risks. These tools aid

Predictive models to assess risk of type 2 diabetes, hypertension and comorbidity: machine-learning algorithms and validation using national health data from Kuwait--a cohort study.

PubMed

Farran, Bassam; Channanath, Arshad Mohamed; Behbehani, Kazem; Thanaraj, Thangavel Alphonse

2013-05-14

We build classification models and risk assessment tools for diabetes, hypertension and comorbidity using machine-learning algorithms on data from Kuwait. We model the increased proneness in diabetic patients to develop hypertension and vice versa. We ascertain the importance of ethnicity (and natives vs expatriate migrants) and of using regional data in risk assessment. Retrospective cohort study. Four machine-learning techniques were used: logistic regression, k-nearest neighbours (k-NN), multifactor dimensionality reduction and support vector machines. The study uses fivefold cross validation to obtain generalisation accuracies and errors. Kuwait Health Network (KHN) that integrates data from primary health centres and hospitals in Kuwait. 270 172 hospital visitors (of which, 89 858 are diabetic, 58 745 hypertensive and 30 522 comorbid) comprising Kuwaiti natives, Asian and Arab expatriates. Incident type 2 diabetes, hypertension and comorbidity. Classification accuracies of >85% (for diabetes) and >90% (for hypertension) are achieved using only simple non-laboratory-based parameters. Risk assessment tools based on k-NN classification models are able to assign 'high' risk to 75% of diabetic patients and to 94% of hypertensive patients. Only 5% of diabetic patients are seen assigned 'low' risk. Asian-specific models and assessments perform even better. Pathological conditions of diabetes in the general population or in hypertensive population and those of hypertension are modelled. Two-stage aggregate classification models and risk assessment tools, built combining both the component models on diabetes (or on hypertension), perform better than individual models. Data on diabetes, hypertension and comorbidity from the cosmopolitan State of Kuwait are available for the first time. This enabled us to apply four different case-control models to assess risks. These tools aid in the preliminary non-intrusive assessment of the population. Ethnicity is seen significant

The Child Suicide Risk Assessment: A Screening Measure of Suicide Risk in Pre-Adolescents

ERIC Educational Resources Information Center

Larzelere, Robert E.; Andersen, Jamie J.; Ringle, Jay L.; Jorgensen, Dan D.

2004-01-01

This study documents the initial reliability and validity of the Child Suicide Risk Assessment (CSRA) for children under the age of 13. The revised CSRA retained 18 of 20 original items based on item-specific psychometric data from 140 pre-adolescents in out-of-home treatment programs. The CSRA demonstrated adequate internal consistency (alpha =…

The Predictive Validity of Savry Ratings for Assessing Youth Offenders in Singapore

PubMed Central

Chu, Chi Meng; Goh, Mui Leng; Chong, Dominic

2015-01-01

Empirical support for the usage of the SAVRY has been reported in studies conducted in many Western contexts, but not in a Singaporean context. This study compared the predictive validity of the SAVRY ratings for violent and general recidivism against the Youth Level of Service/Case Management Inventory (YLS/CMI) ratings within the Singaporean context. Using a sample of 165 male young offenders (Mfollow-up = 4.54 years), results showed that the SAVRY Total Score and Summary Risk Rating, as well as YLS/CMI Total Score and Overall Risk Rating, predicted violent and general recidivism. SAVRY Protective Total Score was only significantly predictive of desistance from general recidivism, and did not show incremental predictive validity for violent and general recidivism over the SAVRY Total Score. Overall, the results suggest that the SAVRY is suited (to varying degrees) for assessing the risk of violent and general recidivism in young offenders within the Singaporean context, but might not be better than the YLS/CMI. PMID:27231403

78 FR 32255 - HHS-Operated Risk Adjustment Data Validation Stakeholder Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2013-05-29

...-Operated Risk Adjustment Data Validation Stakeholder Meeting AGENCY: Centers for Medicare & Medicaid... Act HHS-operated risk adjustment data validation process. The purpose of this public meeting is to... interested parties about key HHS policy considerations pertaining to the HHS-operated risk adjustment data...

Assessing College-Level Learning Difficulties and "At Riskness" for Learning Disabilities and ADHD: Development and Validation of the Learning Difficulties Assessment

ERIC Educational Resources Information Center

Kane, Steven T.; Walker, John H.; Schmidt, George R.

2011-01-01

This article describes the development and validation of the "Learning Difficulties Assessment" (LDA), a normed and web-based survey that assesses perceived difficulties with reading, writing, spelling, mathematics, listening, concentration, memory, organizational skills, sense of control, and anxiety in college students. The LDA is designed to…

Validation of risk stratification for children with febrile neutropenia in a pediatric oncology unit in India.

PubMed

Das, Anirban; Trehan, Amita; Oberoi, Sapna; Bansal, Deepak

2017-06-01

The study aims to validate a score predicting risk of complications in pediatric patients with chemotherapy-related febrile neutropenia (FN) and evaluate the performance of previously published models for risk stratification. Children diagnosed with cancer and presenting with FN were evaluated in a prospective single-center study. A score predicting the risk of complications, previously derived in the unit, was validated on a prospective cohort. Performance of six predictive models published from geographically distinct settings was assessed on the same cohort. Complications were observed in 109 (26.3%) of 414 episodes of FN over 15 months. A risk score based on undernutrition (two points), time from last chemotherapy (<7 days = two points), presence of a nonupper respiratory focus of infection (two points), C-reactive protein (>60 mg/l = five points), and absolute neutrophil count (<100 per μl = two points) was used to stratify patients into "low risk" (score <7, n = 208) and assessed using the following parameters: overall performance (Nagelkerke R 2 = 34.4%), calibration (calibration slope = 0.39; P = 0.25 in Hosmer-Lemeshow test), discrimination (c-statistic = 0.81), overall sensitivity (86%), negative predictive value (93%), and clinical net benefit (0.43). Six previously published rules demonstrated inferior performance in this cohort. An indigenous decision rule using five simple predefined variables was successful in identifying children at risk for complications. Prediction models derived in developed nations may not be appropriate for low-middle-income settings and need to be validated before use. © 2016 Wiley Periodicals, Inc.

Predictive validity and correlates of self-assessed resilience among U.S. Army soldiers.

PubMed

Campbell-Sills, Laura; Kessler, Ronald C; Ursano, Robert J; Sun, Xiaoying; Taylor, Charles T; Heeringa, Steven G; Nock, Matthew K; Sampson, Nancy A; Jain, Sonia; Stein, Murray B

2018-02-01

Self-assessment of resilience could prove valuable to military and other organizations whose personnel confront foreseen stressors. We evaluated the validity of self-assessed resilience among U.S. Army soldiers, including whether predeployment perceived resilience predicted postdeployment emotional disorder. Resilience was assessed via self-administered questionnaire among new soldiers reporting for basic training (N = 35,807) and experienced soldiers preparing to deploy to Afghanistan (N = 8,558). Concurrent validity of self-assessed resilience was evaluated among recruits by estimating its association with past-month emotional disorder. Predictive validity was examined among 3,526 experienced soldiers with no lifetime emotional disorder predeployment. Predictive models estimated associations of predeployment resilience with incidence of emotional disorder through 9 months postdeployment and with marked improvement in coping at 3 months postdeployment. Weights-adjusted regression models incorporated stringent controls for risk factors. Soldiers characterized themselves as very resilient on average [M = 14.34, SD = 4.20 (recruits); M = 14.75, SD = 4.31 (experienced soldiers); theoretical range = 0-20]. Demographic characteristics exhibited only modest associations with resilience, while severity of childhood maltreatment was negatively associated with resilience in both samples. Among recruits, resilience was inversely associated with past-month emotional disorder [adjusted odds ratio (AOR) = 0.65, 95% CI = 0.62-0.68, P < .0005 (per standard score increase)]. Among deployed soldiers, greater predeployment resilience was associated with decreased incidence of emotional disorder (AOR = 0.91; 95% CI = 0.84-0.98; P = .016) and increased odds of improved coping (AOR = 1.36; 95% CI = 1.24-1.49; P < .0005) postdeployment. Findings supported validity of self-assessed resilience among soldiers, although its predictive effect on incidence of

Risk Factors for Venous Thromboembolism in Pediatric Trauma Patients and Validation of a Novel Scoring System: The Risk of Clots in Kids with Trauma (ROCKIT score)

PubMed Central

Yen, Jennifer; Van Arendonk, Kyle J.; Streiff, Michael B.; McNamara, LeAnn; Stewart, F. Dylan; Conner G, Kim G; Thompson, Richard E.; Haut, Elliott R.; Takemoto, Clifford M.

2017-01-01

OBJECTIVES Identify risk factors for venous thromboembolism (VTE) and develop a VTE risk assessment model for pediatric trauma patients. DESIGN, SETTING, AND PATIENTS We performed a retrospective review of patients 21 years and younger who were hospitalized following traumatic injuries at the John Hopkins level 1 adult and pediatric trauma center (1987-2011). The clinical characteristics of patients with and without VTE were compared, and multivariable logistic regression analysis was used to identify independent risk factors for VTE. Weighted risk assessment scoring systems were developed based on these and previously identified factors from patients in the National Trauma Data Bank (NTDB 2008-2010); the scoring systems were validated in this cohort from Johns Hopkins as well as a cohort of pediatric admissions from the NTDB (2011-2012). MAIN RESULTS Forty-nine of 17,366 pediatric trauma patients (0.28%) were diagnosed with VTE after admission to our trauma center. After adjusting for potential confounders, VTE was independently associated with older age, surgery, blood transfusion, higher Injury Severity Score (ISS), and lower Glasgow Coma Scale (GCS) score. These and additional factors were identified in 402,329 pediatric patients from the NTDB from 2008-2010; independent risk factors from the logistic regression analysis of this NTDB cohort were selected and incorporated into weighted risk assessment scoring systems. Two models were developed and were cross-validated in 2 separate pediatric trauma cohorts: 1) 282,535 patients in the NTDB from 2011 to 2012 2) 17,366 patients from Johns Hopkins. The receiver operator curve using these models in the validation cohorts had area under the curves that ranged 90% to 94%. CONCLUSIONS VTE is infrequent after trauma in pediatric patients. We developed weighted scoring systems to stratify pediatric trauma patients at risk for VTE. These systems may have potential to guide risk-appropriate VTE prophylaxis in children after

Operational risk assessment.

PubMed

McKim, Vicky L

2017-06-01

In the world of risk management, which encompasses the business continuity disciplines, many types of risk require evaluation. Financial risk is most often the primary focus, followed by product and market risks. Another critical area, which typically lacks a thorough review or may be overlooked, is operational risk. This category encompasses many risk exposure types including those around building structures and systems, environmental issues, nature, neighbours, clients, regulatory compliance, network, data security and so on. At times, insurance carriers will assess internal hazards, but seldom do these assessments include more than a cursory look at other types of operational risk. In heavily regulated environments, risk assessments are required but may not always include thorough assessments of operational exposures. Vulnerabilities may linger or go unnoticed, only to become the catalyst for a business disruption at a later time, some of which are so severe that business recovery becomes nearly impossible. Businesses may suffer loss of clients as the result of a prolonged disruption of services. Comprehensive operational risk assessments can assist in identifying such vulnerabilities, exposures and threats so that the risk can be minimised or removed. This paper lays out how an assessment of this type can be successfully conducted.

A Nurse-Initiated Perioperative Pressure Injury Risk Assessment and Prevention Protocol.

PubMed

Meehan, Anita J; Beinlich, Nancy R; Hammonds, Tracy L

2016-12-01

Pressure injuries negatively affect patients physically, emotionally, and economically. Studies report that pressure injuries occur in 69% of inpatients who have undergone a surgical procedure while hospitalized. In 2012, we created a nurse-initiated, perioperative pressure injury risk assessment measure for our midwestern, urban, adult teaching hospital. We retrospectively applied the risk assessment to a random sample of 350 surgical patients which validated the measure. The prospective use of the risk assessment and prevention measures in 350 surgical patients resulted in a 60% reduction in pressure injuries compared with the retrospective group. Our findings support the use of a multipronged approach for the prevention of health care-associated pressure injuries in the surgical population, which includes assessment of risk, implementation of evidence-based prevention interventions for at-risk patients, and continuation of prevention beyond the perioperative setting to the nursing care unit. Copyright © 2016 AORN, Inc. Published by Elsevier Inc. All rights reserved.

Is risk assessment the new clinical model in public mental health?

PubMed

Holmes, Alex

2013-12-01

Australian public mental health services have seen a rapid adoption of risk assessment into clinical practice over the past decade. It is timely to review the role of risk assessment in clinical practice, evidence for its validity and to explore its role in clinical decision-making. There is little evidence to support the current form of risk assessment used in public mental health. The continued focus in risk may lead public psychiatrists into a bind where their specialist role is defined by a capacity that they do not fully possess. Further work is required to find ways of demonstrating our attention to the possibility of adverse outcomes whilst maintaining our skills and capacity to manage mental illness with complexity and balance within the limitations of rational decision-making.

Development and validation of a risk-prediction algorithm for the recurrence of panic disorder.

PubMed

Liu, Yan; Sareen, Jitender; Bolton, James; Wang, JianLi

2015-05-01

To develop and validate a risk prediction algorithm for the recurrence of panic disorder. Three-year longitudinal data were taken from the National Epidemiologic Survey on Alcohol and Related Conditions (2001/2002-2004/2005). One thousand six hundred and eighty one participants with a lifetime panic disorder and who had not had panic attacks for at least 2 months at baseline were included. The development cohort included 949 participants; 732 from different census regions were in the validation cohort. Recurrence of panic disorder over the follow-up period was assessed using the Alcohol Use Disorder and Associated Disabilities Interview Schedule, based on the DSM-IV criteria. Logistic regression was used for deriving the algorithm. Discrimination and calibration were assessed in the development and the validation cohorts. The developed algorithm consisted of 11 predictors: age, sex, panic disorder in the past 12 months, nicotine dependence, rapid heartbeat/tachycardia, taking medication for panic attacks, feelings of choking and persistent worry about having another panic attack, two personality traits, and childhood trauma. The algorithm had good discriminative power (C statistic = 0.7863, 95% CI: 0.7487, 0.8240). The C statistic was 0.7283 (95% CI: 0.6889, 0.7764) in the external validation data set. The developed risk algorithm for predicting the recurrence of panic disorder has good discrimination and excellent calibration. Data related to the predictors can be easily attainable in routine clinical practice. It can be used by clinicians to calculate the probability of recurrence of panic disorder in the next 3 years for individual patients, communicate with patients regarding personal risks, and thus improve personalized treatment approaches. © 2015 Wiley Periodicals, Inc.

Development of risk assessment tool for foundry workers.

PubMed

Mohan, G Madhan; Prasad, P S S; Mokkapati, Anil Kumar; Venkataraman, G

2008-01-01

Occupational ill-health and work-related disorders are predominant in manufacturing industries due to the inevitable presence of manual work even after several waves of industrial automation and technological advancements. Ergonomic risk factors and musculoskeletal disorders like low-back symptoms have been noted amongst foundry workers. The purpose of this study was to formulate and develop a Physical Effort Index to assess risk factor. The questionnaire tool applicable to foundry environment has been designed and validated. The data recorded through survey across the foundries has been subjected to regression analysis to correlate between proposed physical effort index and the standard Borg's Ratings of Perceived Exertion (RPE) scale. The physical efforts of sixty seven workers in various foundry shop floors were assessed subjectively. The 'Job factors' and 'Work environment' were the two major parameters considered in assessing the worker discomfort level at workplace. A relation between Borg's RPE scale and the above two parameters were arrived at, through regression analysis. The study demonstrates the prevalence of risk factors amongst foundry workers and the effectiveness of the proposed index in estimating the risk factor levels. RELEVANCE TO THE INDUSTRY: The proposed tool will assist foundry supervisors and managers to assess the risk factors and helps in better understanding of the workplace to avoid work-related disorders, ensuring better output.

Statistically validated network of portfolio overlaps and systemic risk.

PubMed

Gualdi, Stanislao; Cimini, Giulio; Primicerio, Kevin; Di Clemente, Riccardo; Challet, Damien

2016-12-21

Common asset holding by financial institutions (portfolio overlap) is nowadays regarded as an important channel for financial contagion with the potential to trigger fire sales and severe losses at the systemic level. We propose a method to assess the statistical significance of the overlap between heterogeneously diversified portfolios, which we use to build a validated network of financial institutions where links indicate potential contagion channels. The method is implemented on a historical database of institutional holdings ranging from 1999 to the end of 2013, but can be applied to any bipartite network. We find that the proportion of validated links (i.e. of significant overlaps) increased steadily before the 2007-2008 financial crisis and reached a maximum when the crisis occurred. We argue that the nature of this measure implies that systemic risk from fire sales liquidation was maximal at that time. After a sharp drop in 2008, systemic risk resumed its growth in 2009, with a notable acceleration in 2013. We finally show that market trends tend to be amplified in the portfolios identified by the algorithm, such that it is possible to have an informative signal about institutions that are about to suffer (enjoy) the most significant losses (gains).

Statistically validated network of portfolio overlaps and systemic risk

PubMed Central

Gualdi, Stanislao; Cimini, Giulio; Primicerio, Kevin; Di Clemente, Riccardo; Challet, Damien

2016-01-01

Common asset holding by financial institutions (portfolio overlap) is nowadays regarded as an important channel for financial contagion with the potential to trigger fire sales and severe losses at the systemic level. We propose a method to assess the statistical significance of the overlap between heterogeneously diversified portfolios, which we use to build a validated network of financial institutions where links indicate potential contagion channels. The method is implemented on a historical database of institutional holdings ranging from 1999 to the end of 2013, but can be applied to any bipartite network. We find that the proportion of validated links (i.e. of significant overlaps) increased steadily before the 2007–2008 financial crisis and reached a maximum when the crisis occurred. We argue that the nature of this measure implies that systemic risk from fire sales liquidation was maximal at that time. After a sharp drop in 2008, systemic risk resumed its growth in 2009, with a notable acceleration in 2013. We finally show that market trends tend to be amplified in the portfolios identified by the algorithm, such that it is possible to have an informative signal about institutions that are about to suffer (enjoy) the most significant losses (gains). PMID:28000764

Stroke Risk Stratification and its Validation using Ultrasonic Echolucent Carotid Wall Plaque Morphology: A Machine Learning Paradigm.

PubMed

Araki, Tadashi; Jain, Pankaj K; Suri, Harman S; Londhe, Narendra D; Ikeda, Nobutaka; El-Baz, Ayman; Shrivastava, Vimal K; Saba, Luca; Nicolaides, Andrew; Shafique, Shoaib; Laird, John R; Gupta, Ajay; Suri, Jasjit S

2017-01-01

Stroke risk stratification based on grayscale morphology of the ultrasound carotid wall has recently been shown to have a promise in classification of high risk versus low risk plaque or symptomatic versus asymptomatic plaques. In previous studies, this stratification has been mainly based on analysis of the far wall of the carotid artery. Due to the multifocal nature of atherosclerotic disease, the plaque growth is not restricted to the far wall alone. This paper presents a new approach for stroke risk assessment by integrating assessment of both the near and far walls of the carotid artery using grayscale morphology of the plaque. Further, this paper presents a scientific validation system for stroke risk assessment. Both these innovations have never been presented before. The methodology consists of an automated segmentation system of the near wall and far wall regions in grayscale carotid B-mode ultrasound scans. Sixteen grayscale texture features are computed, and fed into the machine learning system. The training system utilizes the lumen diameter to create ground truth labels for the stratification of stroke risk. The cross-validation procedure is adapted in order to obtain the machine learning testing classification accuracy through the use of three sets of partition protocols: (5, 10, and Jack Knife). The mean classification accuracy over all the sets of partition protocols for the automated system in the far and near walls is 95.08% and 93.47%, respectively. The corresponding accuracies for the manual system are 94.06% and 92.02%, respectively. The precision of merit of the automated machine learning system when compared against manual risk assessment system are 98.05% and 97.53% for the far and near walls, respectively. The ROC of the risk assessment system for the far and near walls is close to 1.0 demonstrating high accuracy. Copyright © 2016 Elsevier Ltd. All rights reserved.

Renal Stone Risk During Space Flight: Assessment and Countermeasure Validation

NASA Technical Reports Server (NTRS)

Whitson, P. A.; Sams, C. F.; Jones, J. A.; Pietrzke, R. A.; Nelman-Gonzalez, M. A.; Hudson, E. K.

2007-01-01

NASA has focused its future on exploration class missions including the goal of returning to the moon and landing on Mars. With these objectives, humans will experience an extended exposure to the harsh environment of microgravity and the associated negative effects on all the physiological systems of the body. Exposure to microgravity affects human physiology and results in changes to the urinary chemical composition during and after space flight. These changes are associated with an increased risk of renal stone formation. The development of a renal stone would have health consequences for the crewmember and negatively impact the success of the mission. As of January 2007, 15 known symptomatic medical events consistent with urinary calculi have been experienced by 13 U.S. astronauts and Russian cosmonauts. Previous results from both MIR and Shuttle missions have demonstrated an increased risk for renal stone formation. These data have shown decreased urine volume, urinary pH and citrate levels and increased urinary calcium. Citrate, an important urinary inhibitor of calcium-containing renal stones binds with calcium in the urine, thereby reducing the amount of calcium available to form calcium oxalate stones. Urinary citrate also prevents calcium oxalate crystals from aggregating into larger crystals and into renal stones. In addition, citrate makes the urine less acidic which inhibits the development of uric acid stones. Potassium citrate supplementation has been successfully used to treat patients who have formed renal stones. The evaluation of potassium citrate as a countermeasure has been performed during the ISS Expeditions 3-6, 8, 11-13 and is currently in progress during the ISS Expedition 14 mission. Together with the assessment of stone risk and the evaluation of a countermeasure, this investigation provides an educational opportunity to all crewmembers. Individual urinary biochemical profiles are generated and the risk of stone formation is estimated

Clinical evaluation of a new pressure ulcer risk assessment instrument, the Pressure Ulcer Risk Primary or Secondary Evaluation Tool (PURPOSE T).

PubMed

Coleman, Susanne; Smith, Isabelle L; McGinnis, Elizabeth; Keen, Justin; Muir, Delia; Wilson, Lyn; Stubbs, Nikki; Dealey, Carol; Brown, Sarah; Nelson, E Andrea; Nixon, Jane

2018-02-01

To test the psychometric properties and clinical usability of a new Pressure Ulcer Risk Assessment Instrument including inter-rater and test-retest reliability, convergent validity and data completeness. Methodological and practical limitations associated with traditional Pressure Ulcer Risk Assessment Instruments, prompted a programme to work to develop a new instrument, as part of the National Institute for Health Research funded, Pressure UlceR Programme Of reSEarch (RP-PG-0407-10056). Observational field test. For this clinical evaluation 230 patients were purposefully sampled across four broad levels of pressure ulcer risk with representation from four secondary care and four community NHS Trusts in England. Blinded and simultaneous paired (ward/community nurse and expert nurse) PURPOSE-T assessments were undertaken. Follow-up retest was undertaken by the expert nurse. Field notes of PURPOSE-T use were collected. Data were collected October 2012-January 2013. The clinical evaluation demonstrated "very good" (kappa) inter-rater and test-retest agreement for PURPOSE-T assessment decision overall. The percentage agreement for "problem/no problem" was over 75% for the main risk factors. Convergent validity demonstrated moderate to high associations with other measures of similar constructs. The PURPOSE-T evaluation facilitated the initial validation and clinical usability of the instrument and demonstrated that PURPOSE-T is suitable of use in clinical practice. Further study is needed to evaluate the impact of using the instrument on care processes and outcomes. © 2017 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Predictive validity of the Hendrich fall risk model II in an acute geriatric unit.

PubMed

Ivziku, Dhurata; Matarese, Maria; Pedone, Claudio

2011-04-01

Falls are the most common adverse events reported in acute care hospitals, and older patients are the most likely to fall. The risk of falling cannot be completely eliminated, but it can be reduced through the implementation of a fall prevention program. A major evidence-based intervention to prevent falls has been the use of fall-risk assessment tools. Many tools have been increasingly developed in recent years, but most instruments have not been investigated regarding reliability, validity and clinical usefulness. This study intends to evaluate the predictive validity and inter-rater reliability of Hendrich fall risk model II (HFRM II) in order to identify older patients at risk of falling in geriatric units and recommend its use in clinical practice. A prospective descriptive design was used. The study was carried out in a geriatric acute care unit of an Italian University hospital. All over 65 years old patients consecutively admitted to a geriatric acute care unit of an Italian University hospital over 8-month period were enrolled. The patients enrolled were screened for the falls risk by nurses with the HFRM II within 24h of admission. The falls occurring during the patient's hospital stay were registered. Inter-rater reliability, area under the ROC curve, sensitivity, specificity, positive and negative predictive values and time for the administration were evaluated. 179 elderly patients were included. The inter-rater reliability was 0.87 (95% CI 0.71-1.00). The administration time was about 1min. The most frequently reported risk factors were depression, incontinence, vertigo. Sensitivity and specificity were respectively 86% and 43%. The optimal cut-off score for screening at risk patients was 5 with an area under the ROC curve of 0.72. The risk factors more strongly associated with falls were confusion and depression. As falls of older patients are a common problem in acute care settings it is necessary that the nurses use specific validate and reliable

Seismic risk assessment and application in the central United States

USGS Publications Warehouse

Wang, Z.

2011-01-01

Seismic risk is a somewhat subjective, but important, concept in earthquake engineering and other related decision-making. Another important concept that is closely related to seismic risk is seismic hazard. Although seismic hazard and seismic risk have often been used interchangeably, they are fundamentally different: seismic hazard describes the natural phenomenon or physical property of an earthquake, whereas seismic risk describes the probability of loss or damage that could be caused by a seismic hazard. The distinction between seismic hazard and seismic risk is of practical significance because measures for seismic hazard mitigation may differ from those for seismic risk reduction. Seismic risk assessment is a complicated process and starts with seismic hazard assessment. Although probabilistic seismic hazard analysis (PSHA) is the most widely used method for seismic hazard assessment, recent studies have found that PSHA is not scientifically valid. Use of PSHA will lead to (1) artifact estimates of seismic risk, (2) misleading use of the annual probability of exccedance (i.e., the probability of exceedance in one year) as a frequency (per year), and (3) numerical creation of extremely high ground motion. An alternative approach, which is similar to those used for flood and wind hazard assessments, has been proposed. ?? 2011 ASCE.

Implementation of health risk assessments with family health history: barriers and benefits.

PubMed

Wu, R Ryanne; Orlando, Lori A

2015-09-01

Health risk assessments provide an opportunity to emphasise health promotion and disease prevention for individuals and populations at large. A key component of health risk assessments is the detailed collection of family health history information. This information is helpful in determining risk both for common chronic conditions and more rare diseases as well. While the concept of health risk assessments has been around since the Framingham Heart Study was launched in the 1950s, and such assessments are commonly performed in the workplace today, the US healthcare system has been slow to embrace them and the emphasis on prevention that they represent. Before wider implementation of health risk assessments within healthcare can be seen, several concerns must be addressed: (1) provider impact, (2) patient impact, (3) validity of patient-entered data and (4) health outcomes effect. Here, we describe recent developments in health risk assessment design that are helping to address these issues. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

The International AIDS Questionnaire-English Version (IAQ-E): Assessing the Validity and Reliability

ERIC Educational Resources Information Center

Davis, Cindy; Sloan, Melissa; MacMaster, Samuel; Hughes, Leslie

2006-01-01

In order to address HIV infection among college students, a comprehensive measure is needed that can be used with samples from culturally diverse populations. Therefore, this paper assessed the reliability and validity of an HIV/AIDS questionnaire that measures fours dimensions of HIV/AIDS awareness--factual knowledge, prejudice, personal risk,…

[Is the suicidal risk assessment scale RSD of predictive value?].

PubMed

Ducher, J L; Terra, J L

2006-10-01

the efficacy of fluvoxamine in reducing the risk of recurrence of depression over 18 months, appears of particular interest. In this multicentre study, patients of both sexes were included, aged between 18 and 70 years, presenting a major depressive episode with a MADRS equal to a minimum of 25, and having had a minimum of two episodes of major depression within the last five years. The resulting analysis carried out on 103 patients showed a satisfactory concurrent validity between the suicidal risk assessment scale RSD and the items "suicide" of the MADRS (rho=0.79; p=0.0001) and the Hamilton Depression Scale (rho=0.70; p=0.0001), and fairly satisfactory concurrent validity with the depression degree assessed by the MADRS overall score (rho=0.40; p=0.0001). The short-term follow-up under treatment revealed enhanced sensitivity of the RSD versus the MADRS. The improvement in suicidal risk, assessed by the RSD, was faster than the improvement in depression, which is interesting from a clinical point of view. The medium-term follow-up tested the predictive validity of RSD and confirmed a greater level of suicidal risk from a score of 7 on the RSD, with the death by suicide of 2 subjects among the 15 who exhibited a score between 7 and 10 on the RSD on inclusion. On the other hand, no acting out, no attempted suicides, and no suicides were noted in the group of 88 subjects whose RSD was lower or equal to 6 on inclusion (p=0.02 using Fisher's exact test). Thus, the RSD appears of interest, from a clinical point of view, by providing a -diagnostic, or a scientific approach.

Development and validation of a melanoma risk score based on pooled data from 16 case-control studies

PubMed Central

Davies, John R; Chang, Yu-mei; Bishop, D Timothy; Armstrong, Bruce K; Bataille, Veronique; Bergman, Wilma; Berwick, Marianne; Bracci, Paige M; Elwood, J Mark; Ernstoff, Marc S; Green, Adele; Gruis, Nelleke A; Holly, Elizabeth A; Ingvar, Christian; Kanetsky, Peter A; Karagas, Margaret R; Lee, Tim K; Le Marchand, Loïc; Mackie, Rona M; Olsson, Håkan; Østerlind, Anne; Rebbeck, Timothy R; Reich, Kristian; Sasieni, Peter; Siskind, Victor; Swerdlow, Anthony J; Titus, Linda; Zens, Michael S; Ziegler, Andreas; Gallagher, Richard P.; Barrett, Jennifer H; Newton-Bishop, Julia

2015-01-01

Background We report the development of a cutaneous melanoma risk algorithm based upon 7 factors; hair colour, skin type, family history, freckling, nevus count, number of large nevi and history of sunburn, intended to form the basis of a self-assessment webtool for the general public. Methods Predicted odds of melanoma were estimated by analysing a pooled dataset from 16 case-control studies using logistic random coefficients models. Risk categories were defined based on the distribution of the predicted odds in the controls from these studies. Imputation was used to estimate missing data in the pooled datasets. The 30th, 60th and 90th centiles were used to distribute individuals into four risk groups for their age, sex and geographic location. Cross-validation was used to test the robustness of the thresholds for each group by leaving out each study one by one. Performance of the model was assessed in an independent UK case-control study dataset. Results Cross-validation confirmed the robustness of the threshold estimates. Cases and controls were well discriminated in the independent dataset (area under the curve 0.75, 95% CI 0.73-0.78). 29% of cases were in the highest risk group compared with 7% of controls, and 43% of controls were in the lowest risk group compared with 13% of cases. Conclusion We have identified a composite score representing an estimate of relative risk and successfully validated this score in an independent dataset. Impact This score may be a useful tool to inform members of the public about their melanoma risk. PMID:25713022

Modifying a Risk Assessment Instrument for Youthful Offenders.

PubMed

Shapiro, Cheri J; Malone, Patrick S; Gavazzi, Stephen M

2018-02-01

High rates of incarceration in the United States are compounded by high rates of recidivism and prison return. One solution is more accurate identification of individual prisoner risks and needs to promote offender rehabilitation and successful community re-entry; this is particularly important for youthful offenders who developmentally are in late adolescence or early adulthood, and who struggle to reengage in education and/or employment after release. Thus, this study examined the feasibility of administration and initial psychometric properties of a risk and needs assessment instrument originally created for a juvenile justice population (the Global Risk Assessment Device or GRAD) with 895 male youthful offenders in one adult correctional system. Initial feasibility of implementation within the correctional system was demonstrated; confirmatory factor analyses support the invariance of the modified GRAD factor structure across age and race. Future studies are needed to examine the predictive validity and the sensitivity of the instrument.

Assessing Risk/Benefit for Trials Using Preclinical Evidence: A Proposal

PubMed Central

Kimmelman, Jonathan; Henderson, Valerie C.

2015-01-01

Abstract Moral evaluation of risk/benefit in early phase studies requires assessing the clinical promise of a candidate intervention using preclinical evidence. Yet there is little to guide ethics committees, investigators, sponsors or other stakeholders morally charged with making these assessments (“evaluators”). In what follows, we draw on published guidelines for preclinical study design to develop a structured process for assessing the clinical promise of new interventions. In the first step, evaluators gather all relevant preclinical studies, assess the magnitude of treatment effects, and determine clinical promise in light of various threats to valid clinical inference. In the second step, evaluators adjust assessments of clinical promise from preclinical studies by examining how other agents in the same reference class-and supported by similar evidence- have fared in clinical development. Assessments of clinical promise can then be fed into moral evaluation of risk and benefit in early phase trials. Though our approach has limitations, it offers a systematic and transparent method for assessing risk/benefit in early phase trials of novel interventions. PMID:26463620

Cost-effectiveness of electronic training in domestic violence risk assessment: ODARA 101.

PubMed

Hilton, N Zoe; Ham, Elke

2015-03-01

The need for domestic violence training has increased with the development of evidence-based risk assessment tools, which must be scored correctly for valid application. Emerging research indicates that training in domestic violence risk assessment can increase scoring accuracy, but despite the increasing popularity of electronic training, it is not yet known whether it can be an effective method of risk assessment training. In the present study, 87 assessors from various professions had training in the Ontario Domestic Assault Risk Assessment either face-to-face or using an electronic training program. The two conditions were equally effective, as measured by performance on a post-training skill acquisition test. Completion rates were 100% for face-to-face and 86% for electronic training, an improvement over a previously evaluated manual-only condition. The estimated per-trainee cost of electronic training was one third that of face-to-face training and expected to decrease. More rigorous evaluations of electronic training for risk assessment are recommended. © The Author(s) 2014.

Development and validation of an instrument to assess imminent risk of homelessness among veterans.

PubMed

Montgomery, Ann Elizabeth; Fargo, Jamison D; Kane, Vincent; Culhane, Dennis P

2014-01-01

Veterans are overrepresented within the homeless population compared with their non-veteran counterparts, particularly when controlling for poverty. The U.S. Department of Veterans Affairs (VA) aims to prevent new episodes of homelessness by targeting households at greatest risk; however, there are no instruments that systematically assess veterans' risk of homelessness. We developed and tested a brief screening instrument to identify imminent risk of homelessness among veterans accessing VA health care. The study team developed initial assessment items, conducted cognitive interviews with veterans experiencing homelessness, refined pilot items based on veterans' and experts' feedback and results of psychometric analyses, and assigned weights to items in the final instrument to indicate a measure of homelessness risk. One-third of veterans who responded to the field instrument reported imminent risk of homelessness (i.e., housing instability in the previous 90 days or expected in the next 90 days). The reliability coefficient for the instrument was 0.85, indicating good internal consistency. Veterans who had a recent change in income, had unpaid housing expenses, were living temporarily with family and friends, needed help to get or keep housing, and had poor rental and credit histories were more likely to report a risk of homelessness than those who did not. This study provides the field with an instrument to identify individuals and households at risk of or experiencing homelessness, which is necessary to prevent and end homelessness. In addition, it supports VA's investment in homelessness prevention and rapid rehousing services for veterans who are experiencing or are at risk for homelessness.

Hepatitis Risk Assessment

MedlinePlus

... please visit this page: About CDC.gov . Hepatitis Risk Assessment Recommend on Facebook Tweet Share Compartir Viral Hepatitis. Are you at risk? Take this 5 minute Hepatitis Risk Assessment developed ...

Personalized Prediction of Psychosis: External validation of the NAPLS2 Psychosis Risk Calculator with the EDIPPP project

PubMed Central

Carrión, Ricardo E.; Cornblatt, Barbara A.; Burton, Cynthia Z.; Tso, Ivy F; Auther, Andrea; Adelsheim, Steven; Calkins, Roderick; Carter, Cameron S.; Niendam, Tara; Taylor, Stephan F.; McFarlane, William R.

2016-01-01

Objective In the current issue, Cannon and colleagues, as part of the second phase of the North American Prodrome Longitudinal Study (NAPLS2), report on a risk calculator for the individualized prediction of developing a psychotic disorder in a 2-year period. The present study represents an external validation of the NAPLS2 psychosis risk calculator using an independent sample of subjects at clinical high risk for psychosis collected as part of the Early Detection, Intervention, and Prevention of Psychosis Program (EDIPPP). Methods 176 subjects with follow-up (from the total EDIPPP sample of 210) rated as clinical high-risk (CHR) based on the Structured Interview for Prodromal Syndromes were used to construct a new prediction model with the 6 significant predictor variables in the NAPLS2 psychosis risk calculator (unusual thoughts, suspiciousness, Symbol Coding, verbal learning, social functioning decline, baseline age, and family history). Discrimination performance was assessed with the area under the receiver operating curve (AUC). The NAPLS2 risk calculator was then used to generate a psychosis risk estimate for each case in the external validation sample. Results The external validation model showed good discrimination, with an AUC of 79% (95% CI 0.644–0.937). In addition, the personalized risk generated by the NAPLS calculator provided a solid estimation of the actual conversion outcome in the validation sample. Conclusions In the companion papers in this issue, two independent samples of CHR subjects converge to validate the NAPLS2 psychosis risk calculator. This prediction calculator represents a meaningful step towards early intervention and personalized treatment of psychotic disorders. PMID:27363511

An examination of the predictive validity of the risk matrix 2000 in England and wales.

PubMed

Barnett, Georgia D; Wakeling, Helen C; Howard, Philip D

2010-12-01

This study examined the predictive validity of an actuarial risk-assessment tool with convicted sexual offenders in England and Wales. A modified version of the RM2000/s scale and the RM2000 v and c scales (Thornton et al., 2003) were examined for accuracy in predicting proven sexual violent, nonsexual violent, and combined sexual and/or nonsexual violent reoffending in a sample of sexual offenders who had either started a community sentence or been released from prison into the community by March 2007. Rates of proven reoffending were examined at 2 years for the majority of the sample (n = 4,946), and 4 years ( n = 578) for those for whom these data were available. The predictive validity of the RM2000 scales was also explored for different subgroups of sexual offenders to assess the robustness of the tool. Both the modified RM2000/s and the complete v and c scales effectively classified offenders into distinct risk categories that differed significantly in rates of proven sexual and/or nonsexual violent reoffending. Survival analyses on the RM2000/s and v scales (N = 9,284) indicated that the higher risk groups offended more quickly and at a higher rate than lower risk groups. The relative predictive validity of the RM2000/s, v, and c, as calculated using Receiver Operating Characteristics (ROC) analyses, were moderate (.68) for RM2000/s and large for both the RM2000/c (.73) and RM2000/v (.80), at the 2-year follow-up. RM2000/s was moderately accurate in predicting relative risk of proven sexual reoffending for a variety of subgroups of sexual offenders.

Development and validation of risk prediction algorithms to estimate future risk of common cancers in men and women: prospective cohort study

PubMed Central

Hippisley-Cox, Julia; Coupland, Carol

2015-01-01

Objective To derive and validate a set of clinical risk prediction algorithm to estimate the 10-year risk of 11 common cancers. Design Prospective open cohort study using routinely collected data from 753 QResearch general practices in England. We used 565 practices to develop the scores and 188 for validation. Subjects 4.96 million patients aged 25–84 years in the derivation cohort; 1.64 million in the validation cohort. Patients were free of the relevant cancer at baseline. Methods Cox proportional hazards models in the derivation cohort to derive 10-year risk algorithms. Risk factors considered included age, ethnicity, deprivation, body mass index, smoking, alcohol, previous cancer diagnoses, family history of cancer, relevant comorbidities and medication. Measures of calibration and discrimination in the validation cohort. Outcomes Incident cases of blood, breast, bowel, gastro-oesophageal, lung, oral, ovarian, pancreas, prostate, renal tract and uterine cancers. Cancers were recorded on any one of four linked data sources (general practitioner (GP), mortality, hospital or cancer records). Results We identified 228 241 incident cases during follow-up of the 11 types of cancer. Of these 25 444 were blood; 41 315 breast; 32 626 bowel, 12 808 gastro-oesophageal; 32 187 lung; 4811 oral; 6635 ovarian; 7119 pancreatic; 35 256 prostate; 23 091 renal tract; 6949 uterine cancers. The lung cancer algorithm had the best performance with an R2 of 64.2%; D statistic of 2.74; receiver operating characteristic curve statistic of 0.91 in women. The sensitivity for the top 10% of women at highest risk of lung cancer was 67%. Performance of the algorithms in men was very similar to that for women. Conclusions We have developed and validated a prediction models to quantify absolute risk of 11 common cancers. They can be used to identify patients at high risk of cancers for prevention or further assessment. The algorithms could be integrated into clinical

Validity of the AUDIT-C screen for at-risk drinking among students utilizing university primary care.

PubMed

Campbell, Clare E; Maisto, Stephen A

2018-03-22

Research is needed to establish the psychometric properties of brief screens in university primary care settings. This study aimed to assess the construct validity of one such screen, the Alcohol Use Disorders Identification Test-Consumption (AUDIT-C), for detecting at-risk drinking among students who have utilized on-campus primary care. 389 students recently seen in university primary care completed a confidential online survey in December 2014. Bivariate correlations between the AUDIT-C and measures of alcohol consumption and negative drinking consequences provided concurrent evidence for construct validity. Receiver Operating Characteristic curve analyses determined optimal cut-off scores for at-risk drinking. The AUDIT-C significantly correlated with measures of alcohol consumption and negative drinking consequences (p < .001). Analyses support optimal AUDIT-C cut-off scores of 5 for females and 7 for males. The AUDIT-C is a valid screen for at-risk drinking among students who utilize university primary care.

Risk of malnutrition (over and under-nutrition): validation of the JaNuS screening tool.

PubMed

Donini, Lorenzo M; Ricciardi, Laura Maria; Neri, Barbara; Lenzi, Andrea; Marchesini, Giulio

2014-12-01

Malnutrition (over and under-nutrition) is highly prevalent in patients admitted to hospital and it is a well-known risk factor for increased morbidity and mortality. Nutritional problems are often misdiagnosed, and especially the coexistence of over and undernutrition is not usually recognized. We aimed to develop and validate a screening tool for the easy detection and reporting of both undernutrition and overnutrition, specifically identifying the clinical conditions where the two types of malnutrition coexist. The study consisted of three phases: 1) selection of an appropriate study population (estimation sample) and of the hospital admission parameters to identify overnutrition and undernutrition; 2) combination of selected variables to create a screening tool to assess the nutritional risk in case of undernutrition, overnutrition, or the copresence of both the conditions, to be used by non-specialist health care professionals; 3) validation of the screening tool in a different patient sample (validation sample). Two groups of variables (12 for undernutrition, 7 for overnutrition) were identified in separate logistic models for their correlation with the outcome variables. Both models showed high efficacy, sensitivity and specificity (overnutrition, 97.7%, 99.6%, 66.6%, respectively; undernutrition, 84.4%, 83.6%, 84.8%). The logistic models were used to construct a two-faced test (named JaNuS - Just A Nutritional Screening) fitting into a two-dimension Cartesian coordinate graphic system. In the validation sample the JaNuS test confirmed its predictive value. Internal consistency and test-retest analysis provide evidence for the reliability of the test. The study provides a screening tool for the assessment of the nutritional risk, based on parameters easy-to-use by health care personnel lacking nutritional competence and characterized by excellent predictive validity. The test might be confidently applied in the clinical setting to determine the importance of

Clinical Validity, Understandability, and Actionability of Online Cardiovascular Disease Risk Calculators: Systematic Review.

PubMed

Bonner, Carissa; Fajardo, Michael Anthony; Hui, Samuel; Stubbs, Renee; Trevena, Lyndal

2018-02-01

Online health information is particularly important for cardiovascular disease (CVD) prevention, where lifestyle changes are recommended until risk becomes high enough to warrant pharmacological intervention. Online information is abundant, but the quality is often poor and many people do not have adequate health literacy to access, understand, and use it effectively. This project aimed to review and evaluate the suitability of online CVD risk calculators for use by low health literate consumers in terms of clinical validity, understandability, and actionability. This systematic review of public websites from August to November 2016 used evaluation of clinical validity based on a high-risk patient profile and assessment of understandability and actionability using Patient Education Material Evaluation Tool for Print Materials. A total of 67 unique webpages and 73 unique CVD risk calculators were identified. The same high-risk patient profile produced widely variable CVD risk estimates, ranging from as little as 3% to as high as a 43% risk of a CVD event over the next 10 years. One-quarter (25%) of risk calculators did not specify what model these estimates were based on. The most common clinical model was Framingham (44%), and most calculators (77%) provided a 10-year CVD risk estimate. The calculators scored moderately on understandability (mean score 64%) and poorly on actionability (mean score 19%). The absolute percentage risk was stated in most (but not all) calculators (79%), and only 18% included graphical formats consistent with recommended risk communication guidelines. There is a plethora of online CVD risk calculators available, but they are not readily understandable and their actionability is poor. Entering the same clinical information produces widely varying results with little explanation. Developers need to address actionability as well as clinical validity and understandability to improve usefulness to consumers with low health literacy. �

Neuroimaging supports behavioral personality assessment: Overlapping activations during reflective and impulsive risk taking.

PubMed

Pletzer, Belinda; M Ortner, Tuulia

2016-09-01

Personality assessment has been challenged by the fact that different assessment methods (implicit measures, behavioral measures and explicit rating scales) show little or no convergence in behavioral studies. In this neuroimaging study we address for the first time, whether different assessment methods rely on separate or overlapping neuronal systems. Fifty nine healthy adult participants completed two objective personality tests of risk propensity: the more implicit Balloon Analogue Risk Task (BART) and the more explicit Game of Dice Task (GDT). Significant differences in activation, as well as connectivity patterns between both tasks were observed. In both tasks, risky decisions yielded significantly stronger activations than safe decisions in the bilateral caudate, as well as the bilateral Insula. The finding of overlapping brain areas validates different assessment methods, despite their behavioral non-convergence. This suggests that neuroimaging can be an important tool of validation in the field of personality assessment. Copyright © 2016 Elsevier B.V. All rights reserved.

GM Risk Assessment

NASA Astrophysics Data System (ADS)

Sparrow, Penny A. C.

GM risk assessments play an important role in the decision-making process surrounding the regulation, notification and permission to handle Genetically Modified Organisms (GMOs). Ultimately the role of a GM risk assessment will be to ensure the safe handling and containment of the GMO; and to assess any potential impacts on the environment and human health. A risk assessment should answer all ‘what if’ scenarios, based on scientific evidence.

Validation of a novel air toxic risk model with air monitoring.

PubMed

Pratt, Gregory C; Dymond, Mary; Ellickson, Kristie; Thé, Jesse

2012-01-01

Three modeling systems were used to estimate human health risks from air pollution: two versions of MNRiskS (for Minnesota Risk Screening), and the USEPA National Air Toxics Assessment (NATA). MNRiskS is a unique cumulative risk modeling system used to assess risks from multiple air toxics, sources, and pathways on a local to a state-wide scale. In addition, ambient outdoor air monitoring data were available for estimation of risks and comparison with the modeled estimates of air concentrations. Highest air concentrations and estimated risks were generally found in the Minneapolis-St. Paul metropolitan area and lowest risks in undeveloped rural areas. Emissions from mobile and area (nonpoint) sources created greater estimated risks than emissions from point sources. Highest cancer risks were via ingestion pathway exposures to dioxins and related compounds. Diesel particles, acrolein, and formaldehyde created the highest estimated inhalation health impacts. Model-estimated air concentrations were generally highest for NATA and lowest for the AERMOD version of MNRiskS. This validation study showed reasonable agreement between available measurements and model predictions, although results varied among pollutants, and predictions were often lower than measurements. The results increased confidence in identifying pollutants, pathways, geographic areas, sources, and receptors of potential concern, and thus provide a basis for informing pollution reduction strategies and focusing efforts on specific pollutants (diesel particles, acrolein, and formaldehyde), geographic areas (urban centers), and source categories (nonpoint sources). The results heighten concerns about risks from food chain exposures to dioxins and PAHs. Risk estimates were sensitive to variations in methodologies for treating emissions, dispersion, deposition, exposure, and toxicity. © 2011 Society for Risk Analysis.

Diagnostic accuracy of different caries risk assessment methods. A systematic review.

PubMed

Senneby, Anna; Mejàre, Ingegerd; Sahlin, Nils-Eric; Svensäter, Gunnel; Rohlin, Madeleine

2015-12-01

To evaluate the accuracy of different methods used to identify individuals with increased risk of developing dental coronal caries. Studies on following methods were included: previous caries experience, tests using microbiota, buffering capacity, salivary flow rate, oral hygiene, dietary habits and sociodemographic variables. QUADAS-2 was used to assess risk of bias. Sensitivity, specificity, predictive values, and likelihood ratios (LR) were calculated. Quality of evidence based on ≥3 studies of a method was rated according to GRADE. PubMed, Cochrane Library, Web of Science and reference lists of included publications were searched up to January 2015. From 5776 identified articles, 18 were included. Assessment of study quality identified methodological limitations concerning study design, test technology and reporting. No study presented low risk of bias in all domains. Three or more studies were found only for previous caries experience and salivary mutans streptococci and quality of evidence for these methods was low. Evidence regarding other methods was lacking. For previous caries experience, sensitivity ranged between 0.21 and 0.94 and specificity between 0.20 and 1. Tests using salivary mutans streptococci resulted in low sensitivity and high specificity. For children with primary teeth at baseline, pooled LR for a positive test was 3 for previous caries experience and 4 for salivary mutans streptococci, given a threshold ≥10(5) CFU/ml. Evidence on the validity of analysed methods used for caries risk assessment is limited. As methodological quality was low, there is a need to improve study design. Low validity for the analysed methods may lead to patients with increased risk not being identified, whereas some are falsely identified as being at risk. As caries risk assessment guides individualized decisions on interventions and intervals for patient recall, improved performance based on best evidence is greatly needed. Copyright © 2015 Elsevier Ltd

A Public-Private Partnership Develops and Externally Validates a 30-Day Hospital Readmission Risk Prediction Model

PubMed Central

Choudhry, Shahid A.; Li, Jing; Davis, Darcy; Erdmann, Cole; Sikka, Rishi; Sutariya, Bharat

2013-01-01

Introduction: Preventing the occurrence of hospital readmissions is needed to improve quality of care and foster population health across the care continuum. Hospitals are being held accountable for improving transitions of care to avert unnecessary readmissions. Advocate Health Care in Chicago and Cerner (ACC) collaborated to develop all-cause, 30-day hospital readmission risk prediction models to identify patients that need interventional resources. Ideally, prediction models should encompass several qualities: they should have high predictive ability; use reliable and clinically relevant data; use vigorous performance metrics to assess the models; be validated in populations where they are applied; and be scalable in heterogeneous populations. However, a systematic review of prediction models for hospital readmission risk determined that most performed poorly (average C-statistic of 0.66) and efforts to improve their performance are needed for widespread usage. Methods: The ACC team incorporated electronic health record data, utilized a mixed-method approach to evaluate risk factors, and externally validated their prediction models for generalizability. Inclusion and exclusion criteria were applied on the patient cohort and then split for derivation and internal validation. Stepwise logistic regression was performed to develop two predictive models: one for admission and one for discharge. The prediction models were assessed for discrimination ability, calibration, overall performance, and then externally validated. Results: The ACC Admission and Discharge Models demonstrated modest discrimination ability during derivation, internal and external validation post-recalibration (C-statistic of 0.76 and 0.78, respectively), and reasonable model fit during external validation for utility in heterogeneous populations. Conclusions: The ACC Admission and Discharge Models embody the design qualities of ideal prediction models. The ACC plans to continue its partnership to

Using Dynamic Risk and Protective Factors to Predict Inpatient Aggression: Reliability and Validity of START Assessments

ERIC Educational Resources Information Center

Desmarais, Sarah L.; Nicholls, Tonia L.; Wilson, Catherine M.; Brink, Johann

2012-01-01

The Short-Term Assessment of Risk and Treatability (START; C. D. Webster, M. L. Martin, J. Brink, T. L. Nicholls, & S. L. Desmarais, 2009; C. D. Webster, M. L. Martin, J. Brink, T. L. Nicholls, & C. Middleton, 2004) is a relatively new structured professional judgment guide for the assessment and management of short-term risks associated…

Development and validation of the Surgical Outcome Risk Tool (SORT)

PubMed Central

Protopapa, K L; Simpson, J C; Smith, N C E; Moonesinghe, S R

2014-01-01

Background Existing risk stratification tools have limitations and clinical experience suggests they are not used routinely. The aim of this study was to develop and validate a preoperative risk stratification tool to predict 30-day mortality after non-cardiac surgery in adults by analysis of data from the observational National Confidential Enquiry into Patient Outcome and Death (NCEPOD) Knowing the Risk study. Methods The data set was split into derivation and validation cohorts. Logistic regression was used to construct a model in the derivation cohort to create the Surgical Outcome Risk Tool (SORT), which was tested in the validation cohort. Results Prospective data for 19 097 cases in 326 hospitals were obtained from the NCEPOD study. Following exclusion of 2309, details of 16 788 patients were analysed (derivation cohort 11 219, validation cohort 5569). A model of 45 risk factors was refined on repeated regression analyses to develop a model comprising six variables: American Society of Anesthesiologists Physical Status (ASA-PS) grade, urgency of surgery (expedited, urgent, immediate), high-risk surgical specialty (gastrointestinal, thoracic, vascular), surgical severity (from minor to complex major), cancer and age 65 years or over. In the validation cohort, the SORT was well calibrated and demonstrated better discrimination than the ASA-PS and Surgical Risk Scale; areas under the receiver operating characteristic (ROC) curve were 0·91 (95 per cent c.i. 0·88 to 0·94), 0·87 (0·84 to 0·91) and 0·88 (0·84 to 0·92) respectively (P < 0·001). Conclusion The SORT allows rapid and simple data entry of six preoperative variables, and provides a percentage mortality risk for individuals undergoing surgery. PMID:25388883

Predicting dementia risk in primary care: development and validation of the Dementia Risk Score using routinely collected data.

PubMed

Walters, K; Hardoon, S; Petersen, I; Iliffe, S; Omar, R Z; Nazareth, I; Rait, G

2016-01-21

Existing dementia risk scores require collection of additional data from patients, limiting their use in practice. Routinely collected healthcare data have the potential to assess dementia risk without the need to collect further information. Our objective was to develop and validate a 5-year dementia risk score derived from primary healthcare data. We used data from general practices in The Health Improvement Network (THIN) database from across the UK, randomly selecting 377 practices for a development cohort and identifying 930,395 patients aged 60-95 years without a recording of dementia, cognitive impairment or memory symptoms at baseline. We developed risk algorithm models for two age groups (60-79 and 80-95 years). An external validation was conducted by validating the model on a separate cohort of 264,224 patients from 95 randomly chosen THIN practices that did not contribute to the development cohort. Our main outcome was 5-year risk of first recorded dementia diagnosis. Potential predictors included sociodemographic, cardiovascular, lifestyle and mental health variables. Dementia incidence was 1.88 (95% CI, 1.83-1.93) and 16.53 (95% CI, 16.15-16.92) per 1000 PYAR for those aged 60-79 (n = 6017) and 80-95 years (n = 7104), respectively. Predictors for those aged 60-79 included age, sex, social deprivation, smoking, BMI, heavy alcohol use, anti-hypertensive drugs, diabetes, stroke/TIA, atrial fibrillation, aspirin, depression. The discrimination and calibration of the risk algorithm were good for the 60-79 years model; D statistic 2.03 (95% CI, 1.95-2.11), C index 0.84 (95% CI, 0.81-0.87), and calibration slope 0.98 (95% CI, 0.93-1.02). The algorithm had a high negative predictive value, but lower positive predictive value at most risk thresholds. Discrimination and calibration were poor for the 80-95 years model. Routinely collected data predicts 5-year risk of recorded diagnosis of dementia for those aged 60-79, but not those aged 80+. This

Risk Assessment Among Prostate Cancer Patients Receiving Primary Androgen Deprivation Therapy

PubMed Central

Cooperberg, Matthew R.; Hinotsu, Shiro; Namiki, Mikio; Ito, Kazuto; Broering, Jeanette; Carroll, Peter R.; Akaza, Hideyuki

2009-01-01

Purpose Prostate cancer epidemiology has been marked overall by a downward risk migration over time. However, in some populations, both in the United States and abroad, many men are still diagnosed with high-risk and/or advanced disease. Primary androgen deprivation therapy (PADT) is frequently offered to these patients, and disease risk prediction is not well-established in this context. We compared risk features between large disease registries from the United States and Japan, and aimed to build and validate a risk prediction model applicable to PADT patients. Methods Data were analyzed from 13,740 men in the United States community-based Cancer of the Prostate Strategic Urologic Research Endeavor (CaPSURE) registry and 19,265 men in the Japan Study Group of Prostate Cancer (J-CaP) database, a national Japanese registry of men receiving androgen deprivation therapy. Risk distribution was compared between the two datasets using three well-described multivariable instruments. A novel instrument (Japan Cancer of the Prostate Risk Assessment [J-CAPRA]) was designed and validated to be specifically applicable to PADT patients, and more relevant to high-risk patients than existing instruments. Results J-CaP patients are more likely than CaPSURE patients to be diagnosed with high-risk features; 43% of J-CaP versus 5% of CaPSURE patients had locally advanced or metastatic disease that could not be stratified with the standard risk assessment tools. J-CAPRA—scored 0 to 12 based on Gleason score, prostate-specific antigen level, and clinical stage—predicts progression-free survival among PADT patients in J-CaP with a c-index of 0.71, and cancer-specific survival among PADT patients in CaPSURE with a c-index of 0.84. Conclusion The novel J-CAPRA is the first risk instrument developed and validated for patients undergoing PADT. It is applicable to those with both localized and advanced disease, and performs well in diverse populations. PMID:19667269

Initial validation and results of the Symptoms in Persons At Risk of Rheumatoid Arthritis (SPARRA) questionnaire: a EULAR project

PubMed Central

van Beers-Tas, Marian H; ter Wee, Marieke M; van Tuyl, Lilian H; Maat, Bertha; Hoogland, Wijnanda; Hensvold, Aase H; Catrina, Anca I; Mosor, Erika; Finckh, Axel; Courvoisier, Delphine S; Filer, Andrew; Sahbudin, Ilfita; Stack, Rebecca J; Raza, Karim; van Schaardenburg, Dirkjan

2018-01-01

Objectives To describe the development and assess the psychometric properties of the novel ‘Symptoms in Persons At Risk of Rheumatoid Arthritis’ (SPARRA) questionnaire in individuals at risk of rheumatoid arthritis (RA) and to quantify their symptoms. Methods The questionnaire items were derived from a qualitative study in patients with seropositive arthralgia. The questionnaire was administered to 219 individuals at risk of RA on the basis of symptoms or autoantibody positivity: 74% rheumatoid factor and/or anticitrullinated protein antibodies positive, 26% seronegative. Validity, reliability and responsiveness were assessed. Eighteen first degree relatives (FDR) of patients with RA were used for comparison. Results Face and content validity were high. The test-retest showed good agreement and reliability (1 week and 6 months). Overall, construct validity was low to moderate, with higher values for concurrent validity, suggesting that some questions reflect symptom content not captured with regular Visual Analogue Scale pain/well-being. Responsiveness was low (small subgroup). Finally, the burden of symptoms in both seronegative and seropositive at risk individuals was high, with pain, stiffness and fatigue being the most common ones with a major impact on daily functioning. The FDR cohort (mostly healthy individuals) showed a lower burden of symptoms; however, the distribution of symptoms was similar. Conclusions The SPARRA questionnaire has good psychometric properties and can add information to currently available clinical measures in individuals at risk of RA. The studied group had a high burden and impact of symptoms. Future studies should evaluate whether SPARRA data can improve the prediction of RA in at risk individuals.

Validity and reliability of the Turkish version of the Optimality Index-US (OI-US) to assess maternity care outcomes.

PubMed

Yucel, Cigdem; Taskin, Lale; Low, Lisa Kane

2015-12-01

Although obstetrical interventions are used commonly in Turkey, there is no standardized evidence-based assessment tool to evaluate maternity care outcomes. The Optimality Index-US (OI-US) is an evidence-based tool that was developed for the purpose of measuring aggregate perinatal care processes and outcomes against an optimal or best possible standard. This index has been validated and used in Netherlands, USA and UK until now. The objective of this study was to adapt the OI-US to assess maternity care outcomes in Turkey. Translation and back translation were used to develop the Optimality Index-Turkey (OI-TR) version. To evaluate the content validity of the OI-TR, an expert panel group (n=10) reviewed the items and evidence-based quality of the OI-TR for application in Turkey. Following the content validity process, the OI-TR was used to assess 150 healthy and 150 high-risk pregnant women who gave birth at a high volume, urban maternity hospital in Turkey. The scores between the two groups were compared to assess the discriminant validity of the OI-TR. The percentage of agreement between two raters and the Kappa statistic were calculated to evaluate the reliability. Content validity was established for the OI-TR by an expert group. Discriminant validity was confirmed by comparing the OI scores of healthy pregnant women (mean OI score=77.65%) and those of high-risk pregnant women (mean OI score=78.60%). The percentage of agreement between the two raters was 96.19, and inter-rater agreement was provided for each item in the OI-TR. OI-TR is a valid and reliable tool that can be used to assess maternity care outcomes in Turkey. The results of this study indicate that although the risk statuses of the women differed, the type of care they received was essentially the same, as measured by the OI-TR. Care was not individualised based on risk and for a majority of items was inconsistent with evidence based practice, which is not optimal. Use of the OI-TR will help to

Assessment of demographic and pathoanatomic risk factors in recurrent patellofemoral instability.

PubMed

Hiemstra, Laurie Anne; Kerslake, Sarah; Lafave, Mark

2017-12-01

The WARPS/STAID classification employs clinical assessment of presenting features and anatomic characteristics to identify two distinct subsets of patients within the patellofemoral instability population. The purpose of this study was to further define the specific demographics and the prevalence of risky pathoanatomies in patients classified as either WARPS or STAID presenting with recurrent patellofemoral instability. A secondary purpose was to further validate the WARPS/STAID classification with the Banff Patella Instability Instrument (BPII), the Marx activity scale and the Patellar Instability Severity Score (ISS). A convenience sample of 50 patients with recurrent patellofemoral instability, including 25 WARPS and 25 STAID subtype patients, were assessed. Clinical data were collected including assessment of demographic risk factors (sex, BMI, bilaterality of symptoms, affected limb side and age at first dislocation) and pathoanatomic risk factors (TT-TG distance, patella height, patellar tilt, grade of trochlear dysplasia, Beighton score and rotational abnormalities of the tibia or femur). Patients completed the BPII and the Marx activity scale. The ISS was calculated from the clinical assessment data. Patients were stratified into the WARPS or STAID subtypes for comparative analysis. An independent t test was used to compare demographics, the pathoanatomic risk factors and subjective measures between the groups. Convergent validity was tested with a Pearson r correlation coefficient between the WARPS/STAID and ISS scores. Demographic risk factors statistically associated with a WARPS subtype included female sex, age at first dislocation and bilaterality. Pathoanatomic risk factors statistically associated with a WARPS subtype included trochlear dysplasia, TT-TG distance, generalized ligamentous laxity, patellar tilt and rotational abnormalities. The independent t test revealed a significant difference between the ISS scores: WARPS subtype (M = 4.4, SD�

Validation of a measurement tool to assess awareness of breast cancer.

PubMed

Linsell, Louise; Forbes, Lindsay J L; Burgess, Caroline; Kapari, Marcia; Thurnham, Angela; Ramirez, Amanda J

2010-05-01

Until now, there has been no universally accepted and validated measure of breast cancer awareness. This study aimed to validate the new Breast Cancer Awareness Measure (BCAM) which assesses, using a self-complete questionnaire, knowledge of breast cancer symptoms and age-related risk, and frequency of breast checking. We measured the psychometric properties of the BCAM in 1035 women attending the NHS Breast Screening Programme: acceptability was assessed using a feedback questionnaire (n=292); sensitivity to change after an intervention promoting breast cancer awareness (n=576), and test-retest reliability (n=167). We also assessed readability, and construct validity using the 'known-groups' method. The readability of the BCAM was high. Over 90% of women found it acceptable. The BCAM was sensitive to change: there was an increase in the proportion of women obtaining the full score for breast cancer awareness one month after receiving the intervention promoting breast cancer awareness; this was greater among those who received a more intensive version (less intensive version (booklet): 9.3%, 95% confidence interval (CI): 4.5-14.1%; more intensive version (interaction with health professional plus booklet): 30%, 95% CI: 23.4-36.6%). Test-retest reliability of the BCAM was moderate to good for most items. Cancer experts had higher levels of cancer awareness than non-medical academics (50% versus 6%, p=0.001), indicating good construct validity. The BCAM is a valid and robust measure of breast cancer awareness suitable for use in surveys of breast cancer awareness in the general population and to evaluate the impact of awareness-raising interventions. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

Rethinking Validation in Complex High-Stakes Assessment Contexts

ERIC Educational Resources Information Center

Koch, Martha J.; DeLuca, Christopher

2012-01-01

In this article we rethink validation within the complex contexts of high-stakes assessment. We begin by considering the utility of existing models for validation and argue that these models tend to overlook some of the complexities inherent to assessment use, including the multiple interpretations of assessment purposes and the potential…

Development and preliminary validation of an index for indicating the risks of the design of working hours to health and wellbeing.

PubMed

Schomann, Carsten; Giebel, Ole; Nachreiner, Friedhelm

2006-01-01

BASS 4, a computer program for the design and evaluation of workings hours, is an example of an ergonomics-based software tool that can be used by safety practitioners at the shop floor with regard to legal, ergonomic, and economic criteria. Based on experiences with this computer program, a less sophisticated Working-Hours-Risk Index for assessing the quality of work schedules (including flexible work hours) to indicate risks to health and wellbeing has been developed to provide a quick and easy applicable tool for legally required risk assessments. The results of a validation study show that this risk index seems to be a promising indicator for predicting risks of health complaints and wellbeing. The purpose of the Risk Index is to simplify the evaluation process at the shop floor and provide some more general information about the quality of a work schedule that can be used for triggering preventive interventions. Such a risk index complies with practitioners' expectations and requests for easy, useful, and valid instruments.

Schedule Risk Assessment

NASA Technical Reports Server (NTRS)

Smith, Greg

2003-01-01

Schedule risk assessments determine the likelihood of finishing on time. Each task in a schedule has a varying degree of probability of being finished on time. A schedule risk assessment quantifies these probabilities by assigning values to each task. This viewgraph presentation contains a flow chart for conducting a schedule risk assessment, and profiles applicable several methods of data analysis.

Work-site cardiovascular risk reduction: a randomized trial of health risk assessment, education, counseling, and incentives.

PubMed Central

Gomel, M; Oldenburg, B; Simpson, J M; Owen, N

1993-01-01

OBJECTIVES. This study reports an efficacy trial of four work-site health promotion programs. It was predicted that strategies making use of behavioral counseling would produce a greater reduction in cardiovascular disease risk factors than screening and educational strategies. METHODS. Twenty-eight work sites were randomly allocated to a health risk assessment, risk factor education, behavioral counseling, or behavioral counseling plus incentives intervention. Participants were assessed before the intervention and at 3, 6, and 12 months. RESULTS. Compared with the average of the health risk assessment and risk factor education conditions, there were significantly higher validated continuous smoking cessation rates and smaller increases in body mass index and estimated percentage of body fat in the two behavioral counseling conditions. The behavioral counseling condition was associated with a greater reduction in mean blood pressure than was the behavioral counseling plus incentives condition. On average among all groups, there was a short-term increase in aerobic capacity followed by a return to baseline levels. CONCLUSIONS. Work-site interventions that use behavioral approaches can produce lasting changes in some cardiovascular risk factors and, if implemented routinely, can have a significant public health impact. PMID:8362997

Hydrological Modelling using HEC-HMS for Flood Risk Assessment of Segamat Town, Malaysia

NASA Astrophysics Data System (ADS)

Romali, N. S.; Yusop, Z.; Ismail, A. Z.

2018-03-01

This paper presents an assessment of the applicability of using Hydrologic Modelling System developed by the Hydrologic Engineering Center (HEC-HMS) for hydrological modelling of Segamat River. The objective of the model application is to assist in the assessment of flood risk by providing the peak flows of 2011 Segamat flood for the generation of flood mapping of Segamat town. The capability of the model was evaluated by comparing the historical observed data with the simulation results of the selected flood events. The model calibration and validation efficiency was verified using Nash-Sutcliffe model efficiency coefficient. The results demonstrate the interest to implement the hydrological model for assessing flood risk where the simulated peak flow result is in agreement with historical observed data. The model efficiency of the calibrated and validated exercises is 0.90 and 0.76 respectively, which is acceptable.

Validity in work-based assessment: expanding our horizons.

PubMed

Govaerts, Marjan; van der Vleuten, Cees P M

2013-12-01

Although work-based assessments (WBA) may come closest to assessing habitual performance, their use for summative purposes is not undisputed. Most criticism of WBA stems from approaches to validity consistent with the quantitative psychometric framework. However, there is increasing research evidence that indicates that the assumptions underlying the predictive, deterministic framework of psychometrics may no longer hold. In this discussion paper we argue that meaningfulness and appropriateness of current validity evidence can be called into question and that we need alternative strategies to assessment and validity inquiry that build on current theories of learning and performance in complex and dynamic workplace settings. Drawing from research in various professional fields we outline key issues within the mechanisms of learning, competence and performance in the context of complex social environments and illustrate their relevance to WBA. In reviewing recent socio-cultural learning theory and research on performance and performance interpretations in work settings, we demonstrate that learning, competence (as inferred from performance) as well as performance interpretations are to be seen as inherently contextualised, and can only be under-stood 'in situ'. Assessment in the context of work settings may, therefore, be more usefully viewed as a socially situated interpretive act. We propose constructivist-interpretivist approaches towards WBA in order to capture and understand contextualised learning and performance in work settings. Theoretical assumptions underlying interpretivist assessment approaches call for a validity theory that provides the theoretical framework and conceptual tools to guide the validation process in the qualitative assessment inquiry. Basic principles of rigour specific to qualitative research have been established, and they can and should be used to determine validity in interpretivist assessment approaches. If used properly, these

Perioperative Respiratory Adverse Events in Pediatric Ambulatory Anesthesia: Development and Validation of a Risk Prediction Tool.

PubMed

Subramanyam, Rajeev; Yeramaneni, Samrat; Hossain, Mohamed Monir; Anneken, Amy M; Varughese, Anna M

2016-05-01

Perioperative respiratory adverse events (PRAEs) are the most common cause of serious adverse events in children receiving anesthesia. Our primary aim of this study was to develop and validate a risk prediction tool for the occurrence of PRAE from the onset of anesthesia induction until discharge from the postanesthesia care unit in children younger than 18 years undergoing elective ambulatory anesthesia for surgery and radiology. The incidence of PRAE was studied. We analyzed data from 19,059 patients from our department's quality improvement database. The predictor variables were age, sex, ASA physical status, morbid obesity, preexisting pulmonary disorder, preexisting neurologic disorder, and location of ambulatory anesthesia (surgery or radiology). Composite PRAE was defined as the presence of any 1 of the following events: intraoperative bronchospasm, intraoperative laryngospasm, postoperative apnea, postoperative laryngospasm, postoperative bronchospasm, or postoperative prolonged oxygen requirement. Development and validation of the risk prediction tool for PRAE were performed using a split sampling technique to split the database into 2 independent cohorts based on the year when the patient received ambulatory anesthesia for surgery and radiology using logistic regression. A risk score was developed based on the regression coefficients from the validation tool. The performance of the risk prediction tool was assessed by using tests of discrimination and calibration. The overall incidence of composite PRAE was 2.8%. The derivation cohort included 8904 patients, and the validation cohort included 10,155 patients. The risk of PRAE was 3.9% in the development cohort and 1.8% in the validation cohort. Age ≤ 3 years (versus >3 years), ASA physical status II or III (versus ASA physical status I), morbid obesity, preexisting pulmonary disorder, and surgery (versus radiology) significantly predicted the occurrence of PRAE in a multivariable logistic regression

External validation of risk prediction models for incident colorectal cancer using UK Biobank

PubMed Central

Usher-Smith, J A; Harshfield, A; Saunders, C L; Sharp, S J; Emery, J; Walter, F M; Muir, K; Griffin, S J

2018-01-01

Background: This study aimed to compare and externally validate risk scores developed to predict incident colorectal cancer (CRC) that include variables routinely available or easily obtainable via self-completed questionnaire. Methods: External validation of fourteen risk models from a previous systematic review in 373 112 men and women within the UK Biobank cohort with 5-year follow-up, no prior history of CRC and data for incidence of CRC through linkage to national cancer registries. Results: There were 1719 (0.46%) cases of incident CRC. The performance of the risk models varied substantially. In men, the QCancer10 model and models by Tao, Driver and Ma all had an area under the receiver operating characteristic curve (AUC) between 0.67 and 0.70. Discrimination was lower in women: the QCancer10, Wells, Tao, Guesmi and Ma models were the best performing with AUCs between 0.63 and 0.66. Assessment of calibration was possible for six models in men and women. All would require country-specific recalibration if estimates of absolute risks were to be given to individuals. Conclusions: Several risk models based on easily obtainable data have relatively good discrimination in a UK population. Modelling studies are now required to estimate the potential health benefits and cost-effectiveness of implementing stratified risk-based CRC screening. PMID:29381683

45 CFR 153.630 - Data validation requirements when HHS operates risk adjustment.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 45 Public Welfare 1 2013-10-01 2013-10-01 false Data validation requirements when HHS operates... Program § 153.630 Data validation requirements when HHS operates risk adjustment. (a) General requirement... performed on its risk adjustment data as described in this section. (b) Initial validation audit. (1) An...

45 CFR 153.630 - Data validation requirements when HHS operates risk adjustment.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 1 2014-10-01 2014-10-01 false Data validation requirements when HHS operates... Program § 153.630 Data validation requirements when HHS operates risk adjustment. (a) General requirement... performed on its risk adjustment data as described in this section. (b) Initial validation audit. (1) An...

Assessing Probabilistic Risk Assessment Approaches for Insect Biological Control Introductions.

PubMed

Kaufman, Leyla V; Wright, Mark G

2017-07-07

The introduction of biological control agents to new environments requires host specificity tests to estimate potential non-target impacts of a prospective agent. Currently, the approach is conservative, and is based on physiological host ranges determined under captive rearing conditions, without consideration for ecological factors that may influence realized host range. We use historical data and current field data from introduced parasitoids that attack an endemic Lepidoptera species in Hawaii to validate a probabilistic risk assessment (PRA) procedure for non-target impacts. We use data on known host range and habitat use in the place of origin of the parasitoids to determine whether contemporary levels of non-target parasitism could have been predicted using PRA. Our results show that reasonable predictions of potential non-target impacts may be made if comprehensive data are available from places of origin of biological control agents, but scant data produce poor predictions. Using apparent mortality data rather than marginal attack rate estimates in PRA resulted in over-estimates of predicted non-target impact. Incorporating ecological data into PRA models improved the predictive power of the risk assessments.

USE OF BROMOERGOCRYPTINE IN THE VALIDATION OF PROTOCOLS FOR THE ASSESSMENT OF MECHANISMS OF EARLY PREGNANCY LOSS IN THE RAT

EPA Science Inventory

Validated protocols for evaluating maternally mediated mechanisms of early pregnancy failure in rodents are needed for use in the risk assessment process. To supplement previous efforts in the validation of a panel of protocols assembled for this purpose, bromoergocryptine (BEC) ...

Dynamic drought risk assessment using crop model and remote sensing techniques

NASA Astrophysics Data System (ADS)

Sun, H.; Su, Z.; Lv, J.; Li, L.; Wang, Y.

2017-02-01

Drought risk assessment is of great significance to reduce the loss of agricultural drought and ensure food security. The normally drought risk assessment method is to evaluate its exposure to the hazard and the vulnerability to extended periods of water shortage for a specific region, which is a static evaluation method. The Dynamic Drought Risk Assessment (DDRA) is to estimate the drought risk according to the crop growth and water stress conditions in real time. In this study, a DDRA method using crop model and remote sensing techniques was proposed. The crop model we employed is DeNitrification and DeComposition (DNDC) model. The drought risk was quantified by the yield losses predicted by the crop model in a scenario-based method. The crop model was re-calibrated to improve the performance by the Leaf Area Index (LAI) retrieved from MODerate Resolution Imaging Spectroradiometer (MODIS) data. And the in-situ station-based crop model was extended to assess the regional drought risk by integrating crop planted mapping. The crop planted area was extracted with extended CPPI method from MODIS data. This study was implemented and validated on maize crop in Liaoning province, China.

Model Development for Risk Assessment of Driving on Freeway under Rainy Weather Conditions

PubMed Central

Cai, Xiaonan; Wang, Chen; Chen, Shengdi; Lu, Jian

2016-01-01

Rainy weather conditions could result in significantly negative impacts on driving on freeways. However, due to lack of enough historical data and monitoring facilities, many regions are not able to establish reliable risk assessment models to identify such impacts. Given the situation, this paper provides an alternative solution where the procedure of risk assessment is developed based on drivers’ subjective questionnaire and its performance is validated by using actual crash data. First, an ordered logit model was developed, based on questionnaire data collected from Freeway G15 in China, to estimate the relationship between drivers’ perceived risk and factors, including vehicle type, rain intensity, traffic volume, and location. Then, weighted driving risk for different conditions was obtained by the model, and further divided into four levels of early warning (specified by colors) using a rank order cluster analysis. After that, a risk matrix was established to determine which warning color should be disseminated to drivers, given a specific condition. Finally, to validate the proposed procedure, actual crash data from Freeway G15 were compared with the safety prediction based on the risk matrix. The results show that the risk matrix obtained in the study is able to predict driving risk consistent with actual safety implications, under rainy weather conditions. PMID:26894434

Validation of educational assessments: a primer for simulation and beyond.

PubMed

Cook, David A; Hatala, Rose

2016-01-01

Simulation plays a vital role in health professions assessment. This review provides a primer on assessment validation for educators and education researchers. We focus on simulation-based assessment of health professionals, but the principles apply broadly to other assessment approaches and topics. Validation refers to the process of collecting validity evidence to evaluate the appropriateness of the interpretations, uses, and decisions based on assessment results. Contemporary frameworks view validity as a hypothesis, and validity evidence is collected to support or refute the validity hypothesis (i.e., that the proposed interpretations and decisions are defensible). In validation, the educator or researcher defines the proposed interpretations and decisions, identifies and prioritizes the most questionable assumptions in making these interpretations and decisions (the "interpretation-use argument"), empirically tests those assumptions using existing or newly-collected evidence, and then summarizes the evidence as a coherent "validity argument." A framework proposed by Messick identifies potential evidence sources: content, response process, internal structure, relationships with other variables, and consequences. Another framework proposed by Kane identifies key inferences in generating useful interpretations: scoring, generalization, extrapolation, and implications/decision. We propose an eight-step approach to validation that applies to either framework: Define the construct and proposed interpretation, make explicit the intended decision(s), define the interpretation-use argument and prioritize needed validity evidence, identify candidate instruments and/or create/adapt a new instrument, appraise existing evidence and collect new evidence as needed, keep track of practical issues, formulate the validity argument, and make a judgment: does the evidence support the intended use? Rigorous validation first prioritizes and then empirically evaluates key

Risk assessment of storm surge disaster based on numerical models and remote sensing

NASA Astrophysics Data System (ADS)

Liu, Qingrong; Ruan, Chengqing; Zhong, Shan; Li, Jian; Yin, Zhonghui; Lian, Xihu

2018-06-01

Storm surge is one of the most serious ocean disasters in the world. Risk assessment of storm surge disaster for coastal areas has important implications for planning economic development and reducing disaster losses. Based on risk assessment theory, this paper uses coastal hydrological observations, a numerical storm surge model and multi-source remote sensing data, proposes methods for valuing hazard and vulnerability for storm surge and builds a storm surge risk assessment model. Storm surges in different recurrence periods are simulated in numerical models and the flooding areas and depth are calculated, which are used for assessing the hazard of storm surge; remote sensing data and GIS technology are used for extraction of coastal key objects and classification of coastal land use are identified, which is used for vulnerability assessment of storm surge disaster. The storm surge risk assessment model is applied for a typical coastal city, and the result shows the reliability and validity of the risk assessment model. The building and application of storm surge risk assessment model provides some basis reference for the city development plan and strengthens disaster prevention and mitigation.

Relapse Risk Assessment for Schizophrenia Patients (RASP): A New Self-Report Screening Tool.

PubMed

Velligan, Dawn; Carpenter, William; Waters, Heidi C; Gerlanc, Nicole M; Legacy, Susan N; Ruetsch, Charles

2018-01-01

The Relapse Assessment for Schizophrenia Patients (RASP) was developed as a six-question self-report screener that measures indicators of Increased Anxiety and Social Isolation to assess patient stability and predict imminent relapse. This paper describes the development and psychometric characteristics of the RASP. The RASP and Positive and Negative Syndrome Scale (PANSS) were administered to patients with schizophrenia (n=166) three separate times. Chart data were collected on a subsample of patients (n=81). Psychometric analyses of RASP included tests of reliability, construct validity, and concurrent validity of items. Factors from RASP were correlated with subscales from PANSS (sensitivity to change and criterion validity [agreement between RASP and evidence of relapse]). Test-retest reliability returned modest to strong agreement at the item level and strong agreement at the questionnaire level. RASP showed good item response curves and internal consistency for the total instrument and within each of the two subscales (Increased Anxiety and Social Isolation). RASP Total Score and subscales showed good concurrent validity when correlated with PANSS Total Score, Positive, Excitement, and Anxiety subscales. RASP correctly predicted relapse in 67% of cases, with good specificity and negative predictive power and acceptable positive predictive power and sensitivity. The reliability and validity data presented support the use of RASP in settings where addition of a brief self-report assessment of relapse risk among patients with schizophrenia may be of benefit. Ease of use and scoring, and the ability to administer without clinical supervision allows for routine administration and assessment of relapse risk.

Obsolescence Risk Assessment Process Best Practice

NASA Astrophysics Data System (ADS)

Romero Rojo, F. J.; Roy, R.; Kelly, S.

2012-05-01

A component becomes obsolete when it is no longer available from the original manufacturer to the original specification. In long-lifecycle projects, obsolescence has become a major problem as it prevents the maintenance of the system. This is the reason why obsolescence management is now an essential part of the product support activities in sectors such as defence, aerospace, nuclear and railway; where systems need to be supported for several decades. The obsolescence risk assessment for the bill of materials (BoM) is a paramount activity in order to manage obsolescence proactively and cost-effectively. This is the reason why it was necessary to undertake a benchmarking study to develop best practice in this process. A total of 22 obsolescence experts from 13 different organisations/projects from across UK and USA have participated in this study. Their current processes and experience have been taken into account in the development of the best practice process for obsolescence risk assessment. The key factors that have to be analysed in the risk assessment process for each component in the BoM are: number of manufacturers, years to end of life, stock available, consumption rate and operational impact criticality. For the very high risk components, a more detailed analysis is required to inform the decisions regarding the most suitable mitigation strategies. On the contrary, for the low risk components, a fully proactive approach is neither appropriate nor cost effective. Therefore, it is advised for these components that obsolescence issues are dealt with reactively. This process has been validated using case studies with several experts from industry and is currently being implemented by the UK Ministry of Defence as technical guidance within the JSP 886 Volume 7 Part 8.13 standards.

A systematic review of balance and fall risk assessments with mobile phone technology.

PubMed

Roeing, Kathleen L; Hsieh, Katherine L; Sosnoff, Jacob J

2017-11-01

Falls are a major health concern for older adults. Preventative measures can help reduce the incidence and severity of falls. Methods for assessing balance and fall risk factors are necessary to effectively implement preventative measures. Research groups are currently developing mobile applications to enable seniors, caregivers, and clinicians to monitor balance and fall risk. The following systematic review assesses the current state of mobile health apps for testing balance as a fall risk factor. Thirteen studies were identified and included in the review and analyzed based on study design, population, sample size, measures of balance, main outcome measures, and evaluation of validity and reliability. All studies successfully tested their applications, but only 38% evaluated the validity, and 23% evaluated the reliability of their applications. Of those, all applications were found to accurately and reliably measure balance on select variables. Four of the 13 studies included special populations groups. Out of the 13 studies, 12 reported clinicians as their intended user and seven reported seniors as their intended user. Further research should examine the validity of mobile health applications as well as report on the application's usability. Copyright © 2017 Elsevier B.V. All rights reserved.

External Validation of a Tool Predicting 7-Year Risk of Developing Cardiovascular Disease, Type 2 Diabetes or Chronic Kidney Disease.

PubMed

Rauh, Simone P; Rutters, Femke; van der Heijden, Amber A W A; Luimes, Thomas; Alssema, Marjan; Heymans, Martijn W; Magliano, Dianna J; Shaw, Jonathan E; Beulens, Joline W; Dekker, Jacqueline M

2018-02-01

Chronic cardiometabolic diseases, including cardiovascular disease (CVD), type 2 diabetes (T2D) and chronic kidney disease (CKD), share many modifiable risk factors and can be prevented using combined prevention programs. Valid risk prediction tools are needed to accurately identify individuals at risk. We aimed to validate a previously developed non-invasive risk prediction tool for predicting the combined 7-year-risk for chronic cardiometabolic diseases. The previously developed tool is stratified for sex and contains the predictors age, BMI, waist circumference, use of antihypertensives, smoking, family history of myocardial infarction/stroke, and family history of diabetes. This tool was externally validated, evaluating model performance using area under the receiver operating characteristic curve (AUC)-assessing discrimination-and Hosmer-Lemeshow goodness-of-fit (HL) statistics-assessing calibration. The intercept was recalibrated to improve calibration performance. The risk prediction tool was validated in 3544 participants from the Australian Diabetes, Obesity and Lifestyle Study (AusDiab). Discrimination was acceptable, with an AUC of 0.78 (95% CI 0.75-0.81) in men and 0.78 (95% CI 0.74-0.81) in women. Calibration was poor (HL statistic: p < 0.001), but improved considerably after intercept recalibration. Examination of individual outcomes showed that in men, AUC was highest for CKD (0.85 [95% CI 0.78-0.91]) and lowest for T2D (0.69 [95% CI 0.65-0.74]). In women, AUC was highest for CVD (0.88 [95% CI 0.83-0.94)]) and lowest for T2D (0.71 [95% CI 0.66-0.75]). Validation of our previously developed tool showed robust discriminative performance across populations. Model recalibration is recommended to account for different disease rates. Our risk prediction tool can be useful in large-scale prevention programs for identifying those in need of further risk profiling because of their increased risk for chronic cardiometabolic diseases.

Assessing ergonomic risks of software: Development of the SEAT.

PubMed

Peres, S Camille; Mehta, Ranjana K; Ritchey, Paul

2017-03-01

Software utilizing interaction designs that require extensive dragging or clicking of icons may increase users' risks for upper extremity cumulative trauma disorders. The purpose of this research is to develop a Self-report Ergonomic Assessment Tool (SEAT) for assessing the risks of software interaction designs and facilitate mitigation of those risks. A 28-item self-report measure was developed by combining and modifying items from existing industrial ergonomic tools. Data were collected from 166 participants after they completed four different tasks that varied by method of input (touch or keyboard and mouse) and type of task (selecting or typing). Principal component analysis found distinct factors associated with stress (i.e., demands) and strain (i.e., response). Repeated measures analyses of variance showed that participants could discriminate the different strain induced by the input methods and tasks. However, participants' ability to discriminate between the stressors associated with that strain was mixed. Further validation of the SEAT is necessary but these results indicate that the SEAT may be a viable method of assessing ergonomics risks presented by software design. Copyright © 2016 Elsevier Ltd. All rights reserved.

The suicide assessment scale: an instrument assessing suicide risk of suicide attempters.

PubMed

Niméus, A; Alsén, M; Träskman-Bendz, L

2000-11-01

The Suicide Assessment Scale (SUAS), a scale constructed to measure suicidality over time, was administered to 191 suicide attempters. Its predictive validity was tested. SUAS ratings were compared to ratings from other scales, and related to age and psychiatric diagnoses including co-morbidity. Eight patients committed suicide within 12 months after the SUAS assessment. Apart from advanced age, high scores in the SUAS were significant predictors of suicide. From a receiver operating characteristic (ROC) analysis, we identified cutoff SUAS scores which alone and in combination with certain diagnostic and demographic factors are of apparent value in the clinical evaluation of suicide risk after a suicide attempt.

Simulated Driving Assessment (SDA) for Teen Drivers: Results from a Validation Study

PubMed Central

McDonald, Catherine C.; Kandadai, Venk; Loeb, Helen; Seacrist, Thomas S.; Lee, Yi-Ching; Winston, Zachary; Winston, Flaura K.

2015-01-01

Background Driver error and inadequate skill are common critical reasons for novice teen driver crashes, yet few validated, standardized assessments of teen driving skills exist. The purpose of this study was to evaluate the construct and criterion validity of a newly developed Simulated Driving Assessment (SDA) for novice teen drivers. Methods The SDA's 35-minute simulated drive incorporates 22 variations of the most common teen driver crash configurations. Driving performance was compared for 21 inexperienced teens (age 16–17 years, provisional license ≤90 days) and 17 experienced adults (age 25–50 years, license ≥5 years, drove ≥100 miles per week, no collisions or moving violations ≤3 years). SDA driving performance (Error Score) was based on driving safety measures derived from simulator and eye-tracking data. Negative driving outcomes included simulated collisions or run-off-the-road incidents. A professional driving evaluator/instructor reviewed videos of SDA performance (DEI Score). Results The SDA demonstrated construct validity: 1.) Teens had a higher Error Score than adults (30 vs. 13, p=0.02); 2.) For each additional error committed, the relative risk of a participant's propensity for a simulated negative driving outcome increased by 8% (95% CI: 1.05–1.10, p<0.01). The SDA demonstrated criterion validity: Error Score was correlated with DEI Score (r=−0.66, p<0.001). Conclusions This study supports the concept of validated simulated driving tests like the SDA to assess novice driver skill in complex and hazardous driving scenarios. The SDA, as a standard protocol to evaluate teen driver performance, has the potential to facilitate screening and assessment of teen driving readiness and could be used to guide targeted skill training. PMID:25740939

Assessing students' communication skills: validation of a global rating.

PubMed

Scheffer, Simone; Muehlinghaus, Isabel; Froehmel, Annette; Ortwein, Heiderose

2008-12-01

Communication skills training is an accepted part of undergraduate medical programs nowadays. In addition to learning experiences its importance should be emphasised by performance-based assessment. As detailed checklists have been shown to be not well suited for the assessment of communication skills for different reasons, this study aimed to validate a global rating scale. A Canadian instrument was translated to German and adapted to assess students' communication skills during an end-of-semester-OSCE. Subjects were second and third year medical students at the reformed track of the Charité-Universitaetsmedizin Berlin. Different groups of raters were trained to assess students' communication skills using the global rating scale. Validity testing included concurrent validity and construct validity: Judgements of different groups of raters were compared to expert ratings as a defined gold standard. Furthermore, the amount of agreement between scores obtained with this global rating scale and a different instrument for assessing communication skills was determined. Results show that communication skills can be validly assessed by trained non-expert raters as well as standardised patients using this instrument.

Risk assessment and risk management of mycotoxins.

PubMed

2012-01-01

Risk assessment is the process of quantifying the magnitude and exposure, or probability, of a harmful effect to individuals or populations from certain agents or activities. Here, we summarize the four steps of risk assessment: hazard identification, dose-response assessment, exposure assessment, and risk characterization. Risk assessments using these principles have been conducted on the major mycotoxins (aflatoxins, fumonisins, ochratoxin A, deoxynivalenol, and zearalenone) by various regulatory agencies for the purpose of setting food safety guidelines. We critically evaluate the impact of these risk assessment parameters on the estimated global burden of the associated diseases as well as the impact of regulatory measures on food supply and international trade. Apart from the well-established risk posed by aflatoxins, many uncertainties still exist about risk assessments for the other major mycotoxins, often reflecting a lack of epidemiological data. Differences exist in the risk management strategies and in the ways different governments impose regulations and technologies to reduce levels of mycotoxins in the food-chain. Regulatory measures have very little impact on remote rural and subsistence farming communities in developing countries, in contrast to developed countries, where regulations are strictly enforced to reduce and/or remove mycotoxin contamination. However, in the absence of the relevant technologies or the necessary infrastructure, we highlight simple intervention practices to reduce mycotoxin contamination in the field and/or prevent mycotoxin formation during storage.

Validation of a Simple Score to Determine Risk of Early Rejection After Pediatric Heart Transplantation.

PubMed

Butts, Ryan J; Savage, Andrew J; Atz, Andrew M; Heal, Elisabeth M; Burnette, Ali L; Kavarana, Minoo M; Bradley, Scott M; Chowdhury, Shahryar M

2015-09-01

This study aimed to develop a reliable and feasible score to assess the risk of rejection in pediatric heart transplantation recipients during the first post-transplant year. The first post-transplant year is the most likely time for rejection to occur in pediatric heart transplantation. Rejection during this period is associated with worse outcomes. The United Network for Organ Sharing database was queried for pediatric patients (age <18 years) who underwent isolated orthotopic heart transplantation from January 1, 2000 to December 31, 2012. Transplantations were divided into a derivation cohort (n = 2,686) and a validation (n = 509) cohort. The validation cohort was randomly selected from 20% of transplantations from 2005 to 2012. Covariates found to be associated with rejection (p < 0.2) were included in the initial multivariable logistic regression model. The final model was derived by including only variables independently associated with rejection. A risk score was then developed using relative magnitudes of the covariates' odds ratio. The score was then tested in the validation cohort. A 9-point risk score using 3 variables (age, cardiac diagnosis, and panel reactive antibody) was developed. Mean score in the derivation and validation cohorts were 4.5 ± 2.6 and 4.8 ± 2.7, respectively. A higher score was associated with an increased rate of rejection (score = 0, 10.6% in the validation cohort vs. score = 9, 40%; p < 0.01). In weighted regression analysis, the model-predicted risk of rejection correlated closely with the actual rates of rejection in the validation cohort (R(2) = 0.86; p < 0.01). The rejection score is accurate in determining the risk of early rejection in pediatric heart transplantation recipients. The score has the potential to be used in clinical practice to aid in determining the immunosuppressant regimen and the frequency of rejection surveillance in the first post-transplant year. Copyright © 2015 American College of Cardiology

Wearable technology and ECG processing for fall risk assessment, prevention and detection.

PubMed

Melillo, Paolo; Castaldo, Rossana; Sannino, Giovanna; Orrico, Ada; de Pietro, Giuseppe; Pecchia, Leandro

2015-01-01

Falls represent one of the most common causes of injury-related morbidity and mortality in later life. Subjects with cardiovascular disorders (e.g., related to autonomic dysfunctions and postural hypotension) are at higher risk of falling. Autonomic dysfunctions increasing the risk of falling in the short and mid-term could be assessed by Heart Rate Variability (HRV) extracted by electrocardiograph (ECG). We developed three trials for assessing the usefulness of ECG monitoring using wearable devices for: risk assessment of falling in the next few weeks; prevention of imminent falls due to standing hypotension; and fall detection. Statistical and data-mining methods are adopted to develop classification and regression models, validated with the cross-validation approach. The first classifier based on HRV features enabled to identify future fallers among hypertensive patients with an accuracy of 72% (sensitivity: 51.1%, specificity: 80.2%). The regression model to predict falls due to orthostatic dropdown from HRV recorded before standing achieved an overall accuracy of 80% (sensitivity: 92%, specificity: 90%). Finally, the classifier to detect simulated falls using ECG achieved an accuracy of 77.3% (sensitivity: 81.8%, specificity: 72.7%). The evidence from these three studies showed that ECG monitoring and processing could achieve satisfactory performances compared to other system for risk assessment, fall prevention and detection. This is interesting as differently from other technologies actually employed to prevent falls, ECG is recommended for many other pathologies of later life and is more accepted by senior citizens.

Cross-cultural validity of a dietary questionnaire for studies of dental caries risk in Japanese.

PubMed

Shinga-Ishihara, Chikako; Nakai, Yukie; Milgrom, Peter; Murakami, Kaori; Matsumoto-Nakano, Michiyo

2014-01-02

Diet is a major modifiable contributing factor in the etiology of dental caries. The purpose of this paper is to examine the reliability and cross-cultural validity of the Japanese version of the Food Frequency Questionnaire to assess dietary intake in relation to dental caries risk in Japanese. The 38-item Food Frequency Questionnaire, in which Japanese food items were added to increase content validity, was translated into Japanese, and administered to two samples. The first sample comprised 355 pregnant women with mean age of 29.2 ± 4.2 years for the internal consistency and criterion validity analyses. Factor analysis (principal components with Varimax rotation) was used to determine dimensionality. The dietary cariogenicity score was calculated from the Food Frequency Questionnaire and used for the analyses. Salivary mutans streptococci level was used as a semi-quantitative assessment of dental caries risk and measured by Dentocult SM. Dentocult SM scores were compared with the dietary cariogenicity score computed from the Food Frequency Questionnaire to examine criterion validity, and assessed by Spearman's correlation coefficient (rs) and Kruskal-Wallis test. Test-retest reliability of the Food Frequency Questionnaire was assessed with a second sample of 25 adults with mean age of 34.0 ± 3.0 years by using the intraclass correlation coefficient analysis. The Japanese language version of the Food Frequency Questionnaire showed high test-retest reliability (ICC = 0.70) and good criterion validity assessed by relationship with salivary mutans streptococci levels (rs = 0.22; p < 0.001). Factor analysis revealed four subscales that construct the questionnaire (solid sugars, solid and starchy sugars, liquid and semisolid sugars, sticky and slowly dissolving sugars). Internal consistency were low to acceptable (Cronbach's alpha = 0.67 for the total scale, 0.46-0.61 for each subscale). Mean dietary cariogenicity scores were 50.8 ± 19.5 in the first sample, 47.4 �

Validation of risk assessment scales and predictors of intentions to quit smoking in Australian Aboriginal and Torres Strait Islander peoples: a cross-sectional survey protocol

PubMed Central

Gould, Gillian Sandra; Watt, Kerrianne; McEwen, Andy; Cadet-James, Yvonne; Clough, Alan R

2014-01-01

Introduction Tobacco smoking is a very significant behavioural risk factor for the health of Australian Aboriginal and Torres Strait Islanders, and is embedded as a social norm. With a focus on women of childbearing age, and men of similar age, this project aims to determine how Aboriginal and Torres Strait Islander smokers assess smoking risks and how these assessments contribute to their intentions to quit. The findings from this pragmatic study should contribute to developing culturally targeted interventions. Methods and analysis A cross-sectional study using quantitative and qualitative data. A total of 120 Aboriginal and Torres Strait Islander community members aged 18–45 years will be recruited at community events and through an Aboriginal Community Controlled Health Service (ACCHS). Participants will be interviewed using a tablet computer or paper survey. The survey instrument uses modified risk behaviour scales, that is, the Risk Behaviour Diagnosis (RBD) scale and the Smoking Risk Assessment Target (SRAT) (adapted from the Risk Acceptance Ladder) to determine whether attitudes of Aboriginal and Torres Strait Islander smokers to health risk messages are predictors of intentions to quit smoking. The questionnaire will be assessed for face and content validity with a panel of Indigenous community members. The internal consistency of the RBD subscales and their patterns of correlation will be explored. Multivariate analyses will examine predictors of intentions to quit. This will include demographics such as age, gender, nicotine dependence, household smoking rules and perceived threat from smoking and efficacy for quitting. The two risk-assessment scales will be examined to see whether participant responses are correlated. Ethics and dissemination The Aboriginal Health & Medical Research Council Ethics Committee and university ethics committees approved the study. The results will be published in a peer-reviewed journal and a community report will be

Validation of risk assessment scales and predictors of intentions to quit smoking in Australian Aboriginal and Torres Strait Islander peoples: a cross-sectional survey protocol.

PubMed

Gould, Gillian Sandra; Watt, Kerrianne; McEwen, Andy; Cadet-James, Yvonne; Clough, Alan R

2014-06-05

Tobacco smoking is a very significant behavioural risk factor for the health of Australian Aboriginal and Torres Strait Islanders, and is embedded as a social norm. With a focus on women of childbearing age, and men of similar age, this project aims to determine how Aboriginal and Torres Strait Islander smokers assess smoking risks and how these assessments contribute to their intentions to quit. The findings from this pragmatic study should contribute to developing culturally targeted interventions. A cross-sectional study using quantitative and qualitative data. A total of 120 Aboriginal and Torres Strait Islander community members aged 18-45 years will be recruited at community events and through an Aboriginal Community Controlled Health Service (ACCHS). Participants will be interviewed using a tablet computer or paper survey. The survey instrument uses modified risk behaviour scales, that is, the Risk Behaviour Diagnosis (RBD) scale and the Smoking Risk Assessment Target (SRAT) (adapted from the Risk Acceptance Ladder) to determine whether attitudes of Aboriginal and Torres Strait Islander smokers to health risk messages are predictors of intentions to quit smoking. The questionnaire will be assessed for face and content validity with a panel of Indigenous community members. The internal consistency of the RBD subscales and their patterns of correlation will be explored. Multivariate analyses will examine predictors of intentions to quit. This will include demographics such as age, gender, nicotine dependence, household smoking rules and perceived threat from smoking and efficacy for quitting. The two risk-assessment scales will be examined to see whether participant responses are correlated. The Aboriginal Health & Medical Research Council Ethics Committee and university ethics committees approved the study. The results will be published in a peer-reviewed journal and a community report will be disseminated by the ACCHS, and at community forums. We use the

Recommendations for assessing the risk of bias in systematic reviews of health-care interventions.

PubMed

Viswanathan, Meera; Patnode, Carrie D; Berkman, Nancy D; Bass, Eric B; Chang, Stephanie; Hartling, Lisa; Murad, M Hassan; Treadwell, Jonathan R; Kane, Robert L

2018-05-01

Risk-of-bias assessment is a central component of systematic reviews, but little conclusive empirical evidence exists on the validity of such assessments. In the context of such uncertainty, we present pragmatic recommendations that promote transparency and reproducibility in processes, address methodological advances in the risk-of-bias assessment, and can be applied consistently across review topics. Epidemiological study design principles; available empirical evidence, risk-of-bias tools, and guidance; and workgroup consensus. We developed recommendations for assessing the risk of bias of studies of health-care interventions specific to framing the focus and scope of risk-of-bias assessment; selecting the risk-of-bias categories; choosing assessment instruments; and conducting, analyzing, and presenting results of risk-of-bias assessments. Key recommendations include transparency and reproducibility of judgments, separating risk of bias from other constructs such as applicability and precision, and evaluating the risk of bias per outcome. We recommend against certain past practices, such as focusing on reporting quality, relying solely on study design or numerical quality scores, and automatically downgrading for industry sponsorship. Risk-of-bias assessment remains a challenging but essential step in systematic reviews. We presented standards to promote transparency of judgments. Copyright © 2017 Elsevier Inc. All rights reserved.

Assessing Peer Entry and Play in Preschoolers at Risk for Maladjustment

ERIC Educational Resources Information Center

Brotman, Laurie Miller; Gouley, Kathleen Kiely; Chesir-Teran, Daniel

2005-01-01

This study evaluated the psychometric properties of an observational rating system for assessing preschoolers' peer entry and play skills: Observed Peer Play in Unfamiliar Settings (OPPUS). Participants were 84 preschoolers at risk for psychopathology. Reliability and concurrent validity are reported. The 30-min paradigm yielded reliable indexes…

Corporate Entrepreneurship Assessment Instrument (CEAI): Systematic Validation of a Measure

DTIC Science & Technology

2006-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE THESIS...the United States Government. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION...DISTRIBUTION UNLIMITED. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE

U.S. EPA Authority to Use Cumulative Risk Assessments in Environmental Decision-Making

PubMed Central

Alves, Sarah; Tilghman, Joan; Rosenbaum, Arlene; Payne-Sturges, Devon C.

2012-01-01

Conventionally, in its decision-making, the U.S. EPA has evaluated the effects and risks associated with a single pollutant in a single exposure medium. In reality, people are exposed to mixtures of pollutants or to the same pollutant through a variety of media, including the air, water, and food. It is now more recognized than before that environmental exposure to pollutants occurs via multiple exposure routes and pathways, including inhalation, ingestion, and dermal absorption. Moreover, chemical, biologic, radiologic, physical, and psychologic stressors are all acknowledged as affecting human health. Although many EPA offices attempt to consider cumulative risk assessment and cumulative effects in various ways, there is no Agency-wide policy for considering these risks and the effects of exposure to these risks when making environmental decisions. This article examines how U.S. courts might assess EPA’s general authority and discretion to use cumulative risk assessment as the basis for developing data in support of environmental decision-making, and how courts might assess the validity of a cumulative risk assessment methodology itself. PMID:22829786

Developing a model for hospital inherent safety assessment: Conceptualization and validation.

PubMed

Yari, Saeed; Akbari, Hesam; Gholami Fesharaki, Mohammad; Khosravizadeh, Omid; Ghasemi, Mohammad; Barsam, Yalda; Akbari, Hamed

2018-01-01

Paying attention to the safety of hospitals, as the most crucial institute for providing medical and health services wherein a bundle of facilities, equipment, and human resource exist, is of significant importance. The present research aims at developing a model for assessing hospitals' safety based on principles of inherent safety design. Face validity (30 experts), content validity (20 experts), construct validity (268 examples), convergent validity, and divergent validity have been employed to validate the prepared questionnaire; and the items analysis, the Cronbach's alpha test, ICC test (to measure reliability of the test), composite reliability coefficient have been used to measure primary reliability. The relationship between variables and factors has been confirmed at 0.05 significance level by conducting confirmatory factor analysis (CFA) and structural equations modeling (SEM) technique with the use of Smart-PLS. R-square and load factors values, which were higher than 0.67 and 0.300 respectively, indicated the strong fit. Moderation (0.970), simplification (0.959), substitution (0.943), and minimization (0.5008) have had the most weights in determining the inherent safety of hospital respectively. Moderation, simplification, and substitution, among the other dimensions, have more weight on the inherent safety, while minimization has the less weight, which could be due do its definition as to minimize the risk.

[German Language Version and Validation of the Risk-Taking Behaviour Scale (RBS-K) for High-Risk Sports].

PubMed

Frühauf, Anika; Niedermeier, Martin; Ruedl, Gerhard; Barlow, Matthew; Woodman, Tim; Kopp, Martin

2017-11-23

Background  High-risk sports, particularly climbing, kayaking and extreme skiing, have become increasingly popular. The most widely used psychological survey instrument with regard to risk behaviour in sports is the Sensation Seeking Model, mostly assessed by the Sensation Seeking Scale (SSS-V). Until recently, the literature discussed risk behaviour solely through this model. However, this scale does not measure risk-taking behaviours. In contrast, the Risk-Taking Behaviour Scale (RBS-K) is a three-item scale that measures risk behaviour in high-risk sports. This study aimed to validate a German language version of the RBS-K. Methods  The RBS-K was translated and back-translated between English and German. High-risk sports participants (n = 2399) completed the German version of the RBS-K. Of those participants, 820 completed the RBS-K in person as part of a field survey and 1579 participated in an online survey. To validate the questionnaire, the SSS-V, accident involvement, age and sex were evaluated. The RBS-K divides the sample into deliberate risk takers (mean + standard deviation) and risk-averse persons (mean - standard deviation). We tested for internal consistency and correlations with SSS-V, age, sex and accident involvement. Group differences were calculated between deliberate risk takers and risk-averse persons. Results  For internal consistency, we obtained a Cronbach's alpha of 0.56 and a McDonald's omega of 0.63. Significant correlations were shown between RBS-K and SSS-V as well as age and sex. Compared to risk-averse persons (n = 643, 26.8 %), deliberate risk takers (n = 319, 13.3 %) scored significantly higher in sensation seeking, were significantly younger and primarily male and had a significantly higher accident involvement. Conclusion  The RBS-K discriminates well for age, sex and accident involvement. Also, correlations between the RBS-K and the well-established SSS-V are acceptable. With regard to the results and its

Risk Assessment in Criminal Sentencing.

PubMed

Monahan, John; Skeem, Jennifer L

2016-01-01

The past several years have seen a surge of interest in using risk assessment in criminal sentencing, both to reduce recidivism by incapacitating or treating high-risk offenders and to reduce prison populations by diverting low-risk offenders from prison. We begin by sketching jurisprudential theories of sentencing, distinguishing those that rely on risk assessment from those that preclude it. We then characterize and illustrate the varying roles that risk assessment may play in the sentencing process. We clarify questions regarding the various meanings of "risk" in sentencing and the appropriate time to assess the risk of convicted offenders. We conclude by addressing four principal problems confronting risk assessment in sentencing: conflating risk and blame, barring individual inferences based on group data, failing adequately to distinguish risk assessment from risk reduction, and ignoring whether, and if so, how, the use of risk assessment in sentencing affects racial and economic disparities in imprisonment.

2007 TOXICOLOGY AND RISK ASSESSMENT ...

EPA Pesticide Factsheets

EPA has announced The 2007 Toxicology and Risk Assessment Conference Cincinnati Marriott North, West Chester (Cincinnati), OHApril 23- 26, 2007 - Click to register!The Annual Toxicology and Risk Assessment Conference is a unique meeting where several Government Agencies come together to discuss toxicology and risk assessment issues that are not only of concern to the government, but also to a broader audience including academia and industry. The theme of this year's conference is Emerging Issues and Challenges in Risk Assessment and the preliminary agenda includes: Plenary Sessions and prominent speakers (tentative) include: Issues of Emerging Chemical ContaminantsUncertainty and Variability in Risk Assessment Use of Mechanistic data in IARC evaluationsParallel Sessions:Uncertainty and Variability in Dose-Response Assessment Recent Advances in Toxicity and Risk Assessment of RDX The Use of Epidemiologic Data for Risk Assessment Applications Cumulative Health Risk Assessment:

Biosafety Risk Assessment Methodology

DOE Office of Scientific and Technical Information (OSTI.GOV)

Caskey, Susan Adele; Gaudioso, Jennifer M.; Salerno, Reynolds Mathewson

2010-10-01

Laboratories that work with biological agents need to manage their safety risks to persons working the laboratories and the human and animal community in the surrounding areas. Biosafety guidance defines a wide variety of biosafety risk mitigation measures, which include measures which fall under the following categories: engineering controls, procedural and administrative controls, and the use of personal protective equipment; the determination of which mitigation measures should be used to address the specific laboratory risks are dependent upon a risk assessment. Ideally, a risk assessment should be conducted in a manner which is standardized and systematic which allows it tomore » be repeatable and comparable. A risk assessment should clearly define the risk being assessed and avoid over complication.« less

The Validity and Reliability of the Violence Risk Scale-Sexual Offender Version: Assessing Sex Offender Risk and Evaluating Therapeutic Change

ERIC Educational Resources Information Center

Olver, Mark E.; Wong, Stephen C. P.; Nicholaichuk, Terry; Gordon, Audrey

2007-01-01

The Violence Risk Scale-Sexual Offender version (VRS-SO) is a rating scale designed to assess risk and predict sexual recidivism, to measure and link treatment changes to sexual recidivism, and to inform the delivery of sexual offender treatment. The VRS-SO comprises 7 static and 17 dynamic items empirically or conceptually linked to sexual…

Validity of the Nintendo Wii® balance board for the assessment of standing balance in Parkinson's disease.

PubMed

Holmes, Jeffrey D; Jenkins, Mary E; Johnson, Andrew M; Hunt, Michael A; Clark, Ross A

2013-04-01

Impaired postural stability places individuals with Parkinson's at an increased risk for falls. Given the high incidence of fall-related injuries within this population, ongoing assessment of postural stability is important. To evaluate the validity of the Nintendo Wii(®) balance board as a measurement tool for the assessment of postural stability in individuals with Parkinson's. Twenty individuals with Parkinson's participated. Subjects completed testing on two balance tasks with eyes open and closed on a Wii(®) balance board and biomechanical force platform. Bland-Altman plots and a two-way, random-effects, single measure intraclass correlation coefficient model were used to assess concurrent validity of centre-of-pressure data. Concurrent validity was demonstrated to be excellent across balance tasks (intraclass correlation coefficients = 0.96, 0.98, 0.92, 0.94). This study suggests that the Wii(®) balance board is a valid tool for the quantification of postural stability among individuals with Parkinson's.

Risk Assessment

EPA Pesticide Factsheets

How the EPA conducts risk assessment to protect human health and the environment. Several assessments are included with the guidelines, models, databases, state-based RSL Tables, local contacts and framework documents used to perform these assessments.

Valid and Reliable Science Content Assessments for Science Teachers

NASA Astrophysics Data System (ADS)

Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

2013-03-01

Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper describes multiple sources of validity and reliability (Cronbach's alpha greater than 0.8) evidence for physical, life, and earth/space science assessments—part of the Diagnostic Teacher Assessments of Mathematics and Science (DTAMS) project. Validity was strengthened by systematic synthesis of relevant documents, extensive use of external reviewers, and field tests with 900 teachers during assessment development process. Subsequent results from 4,400 teachers, analyzed with Rasch IRT modeling techniques, offer construct and concurrent validity evidence.

Exploration Health Risks: Probabilistic Risk Assessment

NASA Technical Reports Server (NTRS)

Rhatigan, Jennifer; Charles, John; Hayes, Judith; Wren, Kiley

2006-01-01

Maintenance of human health on long-duration exploration missions is a primary challenge to mission designers. Indeed, human health risks are currently the largest risk contributors to the risks of evacuation or loss of the crew on long-duration International Space Station missions. We describe a quantitative assessment of the relative probabilities of occurrence of the individual risks to human safety and efficiency during space flight to augment qualitative assessments used in this field to date. Quantitative probabilistic risk assessments will allow program managers to focus resources on those human health risks most likely to occur with undesirable consequences. Truly quantitative assessments are common, even expected, in the engineering and actuarial spheres, but that capability is just emerging in some arenas of life sciences research, such as identifying and minimize the hazards to astronauts during future space exploration missions. Our expectation is that these results can be used to inform NASA mission design trade studies in the near future with the objective of preventing the higher among the human health risks. We identify and discuss statistical techniques to provide this risk quantification based on relevant sets of astronaut biomedical data from short and long duration space flights as well as relevant analog populations. We outline critical assumptions made in the calculations and discuss the rationale for these. Our efforts to date have focussed on quantifying the probabilities of medical risks that are qualitatively perceived as relatively high risks of radiation sickness, cardiac dysrhythmias, medically significant renal stone formation due to increased calcium mobilization, decompression sickness as a result of EVA (extravehicular activity), and bone fracture due to loss of bone mineral density. We present these quantitative probabilities in order-of-magnitude comparison format so that relative risk can be gauged. We address the effects of

External validation of a prehospital risk score for critical illness.

PubMed

Kievlan, Daniel R; Martin-Gill, Christian; Kahn, Jeremy M; Callaway, Clifton W; Yealy, Donald M; Angus, Derek C; Seymour, Christopher W

2016-08-11

Identification of critically ill patients during prehospital care could facilitate early treatment and aid in the regionalization of critical care. Tools to consistently identify those in the field with or at higher risk of developing critical illness do not exist. We sought to validate a prehospital critical illness risk score that uses objective clinical variables in a contemporary cohort of geographically and temporally distinct prehospital encounters. We linked prehospital encounters at 21 emergency medical services (EMS) agencies to inpatient electronic health records at nine hospitals in southwestern Pennsylvania from 2010 to 2012. The primary outcome was critical illness during hospitalization, defined as an intensive care unit stay with delivery of organ support (mechanical ventilation or vasopressor use). We calculated the prehospital risk score using demographics and first vital signs from eligible EMS encounters, and we tested the association between score variables and critical illness using multivariable logistic regression. Discrimination was assessed using the AUROC curve, and calibration was determined by plotting observed versus expected events across score values. Operating characteristics were calculated at score thresholds. Among 42,550 nontrauma, non-cardiac arrest adult EMS patients, 1926 (4.5 %) developed critical illness during hospitalization. We observed moderate discrimination of the prehospital critical illness risk score (AUROC 0.73, 95 % CI 0.72-0.74) and adequate calibration based on observed versus expected plots. At a score threshold of 2, sensitivity was 0.63 (95 % CI 0.61-0.75), specificity was 0.73 (95 % CI 0.72-0.73), negative predictive value was 0.98 (95 % CI 0.98-0.98), and positive predictive value was 0.10 (95 % CI 0.09-0.10). The risk score performance was greater with alternative definitions of critical illness, including in-hospital mortality (AUROC 0.77, 95 % CI 0.7 -0.78). In an external validation cohort, a

Assessing youth who sexually offended: the predictive validity of the ERASOR, J-SOAP-II, and YLS/CMI in a non-Western context.

PubMed

Chu, Chi Meng; Ng, Kynaston; Fong, June; Teoh, Jennifer

2012-04-01

Recent research suggested that the predictive validity of adult sexual offender risk assessment measures can be affected when used cross-culturally, but there is no published study on the predictive validity of risk assessment measures for youth who sexually offended in a non-Western context. This study compared the predictive validity of three youth risk assessment measures (i.e., the Estimate of Risk of Adolescent Sexual Offense Recidivism [ERASOR], the Juvenile Sex Offender Assessment Protocol-II [J-SOAP-II], and the Youth Level of Service/Case Management Inventory [YLS/CMI]) for sexual and nonviolent recidivism in a sample of 104 male youth who sexually offended within a Singaporean context (M (follow-up) = 1,637 days; SD (follow-up) = 491). Results showed that the ERASOR overall clinical rating and total score significantly predicted sexual recidivism but only the former significantly predicted time to sexual reoffense. All of the measures (i.e., the ERASOR overall clinical rating and total score, the J-SOAP-II total score, as well as the YLS/CMI) significantly predicted nonsexual recidivism and time to nonsexual reoffense for this sample of youth who sexually offended. Overall, the results suggest that the ERASOR appears to be suited for assessing youth who sexually offended in a non-Western context, but the J-SOAP-II and the YLS/CMI have limited utility for such a purpose.

Clinical Assessment of Risk Management: an INtegrated Approach (CARMINA).

PubMed

Tricarico, Pierfrancesco; Tardivo, Stefano; Sotgiu, Giovanni; Moretti, Francesca; Poletti, Piera; Fiore, Alberto; Monturano, Massimo; Mura, Ida; Privitera, Gaetano; Brusaferro, Silvio

2016-08-08

Purpose - The European Union recommendations for patient safety calls for shared clinical risk management (CRM) safety standards able to guide organizations in CRM implementation. The purpose of this paper is to develop a self-evaluation tool to measure healthcare organization performance on CRM and guide improvements over time. Design/methodology/approach - A multi-step approach was implemented including: a systematic literature review; consensus meetings with an expert panel from eight Italian leader organizations to get to an agreement on the first version; field testing to test instrument feasibility and flexibility; Delphi strategy with a second expert panel for content validation and balanced scoring system development. Findings - The self-assessment tool - Clinical Assessment of Risk Management: an INtegrated Approach includes seven areas (governance, communication, knowledge and skills, safe environment, care processes, adverse event management, learning from experience) and 52 standards. Each standard is evaluated according to four performance levels: minimum; monitoring; outcomes; and improvement actions, which resulted in a feasible, flexible and valid instrument to be used throughout different organizations. Practical implications - This tool allows practitioners to assess their CRM activities compared to minimum levels, monitor performance, benchmarking with other institutions and spreading results to different stakeholders. Originality/value - The multi-step approach allowed us to identify core minimum CRM levels in a field where no consensus has been reached. Most standards may be easily adopted in other countries.

Comparative assessment of absolute cardiovascular disease risk characterization from non-laboratory-based risk assessment in South African populations

PubMed Central

2013-01-01

correlation between a simple, non-laboratory-based CVD risk score and commonly-used laboratory-based risk scores. The burden of CVD mortality risk was high for men and women in South Africa. The policy and clinical implications are that fast, low-cost screening tools can lead to similar risk assessment results compared to time- and resource-intensive approaches. Until setting-specific cohort studies can derive and validate country-specific risk scores, non-laboratory-based CVD risk assessment could be an effective and efficient primary CVD screening approach in South Africa. PMID:23880010

Prediction models for the risk of spontaneous preterm birth based on maternal characteristics: a systematic review and independent external validation.

PubMed

Meertens, Linda J E; van Montfort, Pim; Scheepers, Hubertina C J; van Kuijk, Sander M J; Aardenburg, Robert; Langenveld, Josje; van Dooren, Ivo M A; Zwaan, Iris M; Spaanderman, Marc E A; Smits, Luc J M

2018-04-17

Prediction models may contribute to personalized risk-based management of women at high risk of spontaneous preterm delivery. Although prediction models are published frequently, often with promising results, external validation generally is lacking. We performed a systematic review of prediction models for the risk of spontaneous preterm birth based on routine clinical parameters. Additionally, we externally validated and evaluated the clinical potential of the models. Prediction models based on routinely collected maternal parameters obtainable during first 16 weeks of gestation were eligible for selection. Risk of bias was assessed according to the CHARMS guidelines. We validated the selected models in a Dutch multicenter prospective cohort study comprising 2614 unselected pregnant women. Information on predictors was obtained by a web-based questionnaire. Predictive performance of the models was quantified by the area under the receiver operating characteristic curve (AUC) and calibration plots for the outcomes spontaneous preterm birth <37 weeks and <34 weeks of gestation. Clinical value was evaluated by means of decision curve analysis and calculating classification accuracy for different risk thresholds. Four studies describing five prediction models fulfilled the eligibility criteria. Risk of bias assessment revealed a moderate to high risk of bias in three studies. The AUC of the models ranged from 0.54 to 0.67 and from 0.56 to 0.70 for the outcomes spontaneous preterm birth <37 weeks and <34 weeks of gestation, respectively. A subanalysis showed that the models discriminated poorly (AUC 0.51-0.56) for nulliparous women. Although we recalibrated the models, two models retained evidence of overfitting. The decision curve analysis showed low clinical benefit for the best performing models. This review revealed several reporting and methodological shortcomings of published prediction models for spontaneous preterm birth. Our external validation study

Where do uncertainties reside within environmental risk assessments? Expert opinion on uncertainty distributions for pesticide risks to surface water organisms.

PubMed

Skinner, Daniel J C; Rocks, Sophie A; Pollard, Simon J T

2016-12-01

A reliable characterisation of uncertainties can aid uncertainty identification during environmental risk assessments (ERAs). However, typologies can be implemented inconsistently, causing uncertainties to go unidentified. We present an approach based on nine structured elicitations, in which subject-matter experts, for pesticide risks to surface water organisms, validate and assess three dimensions of uncertainty: its level (the severity of uncertainty, ranging from determinism to ignorance); nature (whether the uncertainty is epistemic or aleatory); and location (the data source or area in which the uncertainty arises). Risk characterisation contains the highest median levels of uncertainty, associated with estimating, aggregating and evaluating the magnitude of risks. Regarding the locations in which uncertainty is manifest, data uncertainty is dominant in problem formulation, exposure assessment and effects assessment. The comprehensive description of uncertainty described will enable risk analysts to prioritise the required phases, groups of tasks, or individual tasks within a risk analysis according to the highest levels of uncertainty, the potential for uncertainty to be reduced or quantified, or the types of location-based uncertainty, thus aiding uncertainty prioritisation during environmental risk assessments. In turn, it is expected to inform investment in uncertainty reduction or targeted risk management action. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.

Clinical assessment of dysphagia in neurodegeneration (CADN): development, validity and reliability of a bedside tool for dysphagia assessment.

PubMed

Vogel, Adam P; Rommel, Natalie; Sauer, Carina; Horger, Marius; Krumm, Patrick; Himmelbach, Marc; Synofzik, Matthis

2017-06-01

Screening assessments for dysphagia are essential in neurodegenerative disease. Yet there are no purpose-built tools to quantify swallowing deficits at bedside or in clinical trials. A quantifiable, brief, easy to administer assessment that measures the impact of dysphagia and predicts the presence or absence of aspiration is needed. The Clinical Assessment of Dysphagia in Neurodegeneration (CADN) was designed by a multidisciplinary team (neurology, neuropsychology, speech pathology) validated against strict methodological criteria in two neurodegenerative diseases, Parkinson's disease (PD) and degenerative ataxia (DA). CADN comprises two parts, an anamnesis (part one) and consumption (part two). Two-thirds of patients were assessed using reference tests, the SWAL-QOL symptoms subscale (part one) and videofluoroscopic assessment of swallowing (part two). CADN has 11 items and can be administered and scored in an average of 7 min. Test-retest reliability was established using correlation and Bland-Altman plots. 125 patients with a neurodegenerative disease were recruited; 60 PD and 65 DA. Validity was established using ROC graphs and correlations. CADN has sensitivity of 79 and 84% and specificity 71 and 69% for parts one and two, respectively. Significant correlations with disease severity were also observed (p < 0.001) for PD with small to large associations between disease severity and CADN scores for DA. Cutoff scores were identified that signal the presence of clinically meaningful dysphagia symptomatology and risk of aspiration. The CADN is a reliable, valid, brief, quantifiable, and easily deployed assessment of swallowing in neurodegenerative disease. It is thus ideally suited for both clinical bedside assessment and future multicentre clinical trials in neurodegenerative disease.

Development and Validity of Western University's On-Road Assessment.

PubMed

Classen, Sherrilene; Krasniuk, Sarah; Alvarez, Liliana; Monahan, Miriam; Morrow, Sarah A; Danter, Tim

2017-01-01

Although used across North America, many on-road studies do not explicitly document the content and metrics of on-road courses and accompanying assessments. This article discusses the development of the University of Western Ontario's on-road course, and elucidates the validity of its accompanying on-road assessment. We identified main components for developing an on-road course and used measurement theory to establish face, content, and initial construct validity. Five adult volunteer drivers and 30 drivers with multiple sclerosis participated in the study. The road course had face and content validity, representing 100% of roadway components determined through a content validity matrix and index. The known-groups method showed that debilitated drivers (vs. not debilitated), made more driving errors ( W = 463.50, p = .03), and failed the on-road course, indicating preliminary construct validity of the on-road assessment. This research guides and empirically supports a process for developing a road course and its assessment.

Evaluation of the DAVROS (Development And Validation of Risk-adjusted Outcomes for Systems of emergency care) risk-adjustment model as a quality indicator for healthcare

PubMed Central

Wilson, Richard; Goodacre, Steve W; Klingbajl, Marcin; Kelly, Anne-Maree; Rainer, Tim; Coats, Tim; Holloway, Vikki; Townend, Will; Crane, Steve

2014-01-01

Background and objective Risk-adjusted mortality rates can be used as a quality indicator if it is assumed that the discrepancy between predicted and actual mortality can be attributed to the quality of healthcare (ie, the model has attributional validity). The Development And Validation of Risk-adjusted Outcomes for Systems of emergency care (DAVROS) model predicts 7-day mortality in emergency medical admissions. We aimed to test this assumption by evaluating the attributional validity of the DAVROS risk-adjustment model. Methods We selected cases that had the greatest discrepancy between observed mortality and predicted probability of mortality from seven hospitals involved in validation of the DAVROS risk-adjustment model. Reviewers at each hospital assessed hospital records to determine whether the discrepancy between predicted and actual mortality could be explained by the healthcare provided. Results We received 232/280 (83%) completed review forms relating to 179 unexpected deaths and 53 unexpected survivors. The healthcare system was judged to have potentially contributed to 10/179 (8%) of the unexpected deaths and 26/53 (49%) of the unexpected survivors. Failure of the model to appropriately predict risk was judged to be responsible for 135/179 (75%) of the unexpected deaths and 2/53 (4%) of the unexpected survivors. Some 10/53 (19%) of the unexpected survivors died within a few months of the 7-day period of model prediction. Conclusions We found little evidence that deaths occurring in patients with a low predicted mortality from risk-adjustment could be attributed to the quality of healthcare provided. PMID:23605036

Assessing Probabilistic Risk Assessment Approaches for Insect Biological Control Introductions

PubMed Central

Kaufman, Leyla V.; Wright, Mark G.

2017-01-01

The introduction of biological control agents to new environments requires host specificity tests to estimate potential non-target impacts of a prospective agent. Currently, the approach is conservative, and is based on physiological host ranges determined under captive rearing conditions, without consideration for ecological factors that may influence realized host range. We use historical data and current field data from introduced parasitoids that attack an endemic Lepidoptera species in Hawaii to validate a probabilistic risk assessment (PRA) procedure for non-target impacts. We use data on known host range and habitat use in the place of origin of the parasitoids to determine whether contemporary levels of non-target parasitism could have been predicted using PRA. Our results show that reasonable predictions of potential non-target impacts may be made if comprehensive data are available from places of origin of biological control agents, but scant data produce poor predictions. Using apparent mortality data rather than marginal attack rate estimates in PRA resulted in over-estimates of predicted non-target impact. Incorporating ecological data into PRA models improved the predictive power of the risk assessments. PMID:28686180

Reliability and Validity of Ambulatory Cognitive Assessments

PubMed Central

Sliwinski, Martin J.; Mogle, Jacqueline A.; Hyun, Jinshil; Munoz, Elizabeth; Smyth, Joshua M.; Lipton, Richard B.

2017-01-01

Mobile technologies are increasingly used to measure cognitive function outside of traditional clinic and laboratory settings. Although ambulatory assessments of cognitive function conducted in people’s natural environments offer potential advantages over traditional assessment approaches, the psychometrics of cognitive assessment procedures have been understudied. We evaluated the reliability and construct validity of ambulatory assessments of working memory and perceptual speed administered via smartphones as part of an ecological momentary assessment (EMA) protocol in a diverse adult sample (N=219). Results indicated excellent between-person reliability (≥.97) for average scores, and evidence of reliable within-person variability across measurement occasions (.41–.53). The ambulatory tasks also exhibited construct validity, as evidence by their loadings on working memory and perceptual speed factors defined by the in-lab assessments. Our findings demonstrate that averaging across brief cognitive assessments made in uncontrolled naturalistic settings provide measurements that are comparable in reliability to assessments made in controlled laboratory environments. PMID:27084835

Psychometric properties of the Blood-borne Virus Transmission Risk Assessment Questionnaire (BBV-TRAQ).

PubMed

Fry, Craig L; Lintzeris, Nick

2003-02-01

To develop a standard measure of blood-borne virus transmission risk behaviour, and examine the underlying psychometric properties. The Blood-borne Virus Transmission Risk Assessment Questionnaire (BBV-TRAQ) was developed over three consecutive phases of the original BBV-TRAQ study in adherence to classical scale development procedures, culminating in the recruitment of a development sample of current injecting drug users via convenience and snowball sampling. Needle and syringe programmes (NSPs), medical clinics, alcohol/drug agencies, peer-based and outreach organizations across inner and outer metropolitan Melbourne. Two hundred and nine current injecting drug users. The mean age was 27 years, 68% were male, 65% unemployed, 36% with prison history and 25% in methadone maintenance. BBV-TRAQ items cover specific injecting, sexual and skin penetration risk practices. BBV-TRAQ characteristics were assessed via measures of internal and test-retest reliability; collateral validation; and principal components analyses. The BBV-TRAQ has satisfactory psychometric properties. Internal (a=0.87), test-retest (r=0.84) and inter-observer reliability results were high, suggesting that the instrument provides a reliable measure of BBV risk behaviour and is reliable over time and across interviewers. A principal components analysis with varimax rotation produced a parsimonious factor solution despite modest communality, and indicated that three factors (injecting, sex and skin penetration/hygiene risks) are required to describe BBV risk behaviour. The BBV-TRAQ is reliable and represents the first risk assessment tool to incorporate sufficient coverage of injecting, sex and other skin penetration risk practices to be considered truly content valid. The questionnaire is indicated for use in addictions research, clinical, peer education and BBV risk behaviour surveillance settings.

Reliable and valid assessment of Lichtenstein hernia repair skills.

PubMed

Carlsen, C G; Lindorff-Larsen, K; Funch-Jensen, P; Lund, L; Charles, P; Konge, L

2014-08-01

Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia repair, (four experts, three intermediates, and three novices). The videos were blindly and individually assessed by three raters (surgical consultants) using the assessment tool. Based on these assessments, validity and reliability were explored. The internal consistency of the items was high (Cronbach's alpha = 0.97). The inter-rater reliability was very good with an intra-class correlation coefficient (ICC) = 0.93. Generalizability analysis showed a coefficient above 0.8 even with one rater. The coefficient improved to 0.92 if three raters were used. One-way analysis of variance found a significant difference between the three groups which indicates construct validity, p < 0.001. Lichtenstein hernia repair skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment of trainees performing Lichtenstein hernia repair to ensure that the objectives of competency-based surgical training are met.

A framework for global river flood risk assessments

NASA Astrophysics Data System (ADS)

Winsemius, H. C.; Van Beek, L. P. H.; Jongman, B.; Ward, P. J.; Bouwman, A.

2012-08-01

There is an increasing need for strategic global assessments of flood risks in current and future conditions. In this paper, we propose a framework for global flood risk assessment for river floods, which can be applied in current conditions, as well as in future conditions due to climate and socio-economic changes. The framework's goal is to establish flood hazard and impact estimates at a high enough resolution to allow for their combination into a risk estimate. The framework estimates hazard at high resolution (~1 km2) using global forcing datasets of the current (or in scenario mode, future) climate, a global hydrological model, a global flood routing model, and importantly, a flood extent downscaling routine. The second component of the framework combines hazard with flood impact models at the same resolution (e.g. damage, affected GDP, and affected population) to establish indicators for flood risk (e.g. annual expected damage, affected GDP, and affected population). The framework has been applied using the global hydrological model PCR-GLOBWB, which includes an optional global flood routing model DynRout, combined with scenarios from the Integrated Model to Assess the Global Environment (IMAGE). We performed downscaling of the hazard probability distributions to 1 km2 resolution with a new downscaling algorithm, applied on Bangladesh as a first case-study application area. We demonstrate the risk assessment approach in Bangladesh based on GDP per capita data, population, and land use maps for 2010 and 2050. Validation of the hazard and damage estimates has been performed using the Dartmouth Flood Observatory database and damage estimates from the EM-DAT database and World Bank sources. We discuss and show sensitivities of the estimated risks with regard to the use of different climate input sets, decisions made in the downscaling algorithm, and different approaches to establish impact models.

Chemical Risk Assessment

EPA Science Inventory

This course is aimed at providing an overview of the fundamental guiding principles and general methods used in chemical risk assessment. Chemical risk assessment is a complex and ever-evolving process. These principles and methods have been organized by the National Research Cou...

The Validation of a Case-Based, Cumulative Assessment and Progressions Examination

PubMed Central

Coker, Adeola O.; Copeland, Jeffrey T.; Gottlieb, Helmut B.; Horlen, Cheryl; Smith, Helen E.; Urteaga, Elizabeth M.; Ramsinghani, Sushma; Zertuche, Alejandra; Maize, David

2016-01-01

Objective. To assess content and criterion validity, as well as reliability of an internally developed, case-based, cumulative, high-stakes third-year Annual Student Assessment and Progression Examination (P3 ASAP Exam). Methods. Content validity was assessed through the writing-reviewing process. Criterion validity was assessed by comparing student scores on the P3 ASAP Exam with the nationally validated Pharmacy Curriculum Outcomes Assessment (PCOA). Reliability was assessed with psychometric analysis comparing student performance over four years. Results. The P3 ASAP Exam showed content validity through representation of didactic courses and professional outcomes. Similar scores on the P3 ASAP Exam and PCOA with Pearson correlation coefficient established criterion validity. Consistent student performance using Kuder-Richardson coefficient (KR-20) since 2012 reflected reliability of the examination. Conclusion. Pharmacy schools can implement internally developed, high-stakes, cumulative progression examinations that are valid and reliable using a robust writing-reviewing process and psychometric analyses. PMID:26941435

School environment assessment tools to address behavioural risk factors of non-communicable diseases: A scoping review.

PubMed

Saluja, Kiran; Rawal, Tina; Bassi, Shalini; Bhaumik, Soumyadeep; Singh, Ankur; Park, Min Hae; Kinra, Sanjay; Arora, Monika

2018-06-01

We aimed to identify, describe and analyse school environment assessment (SEA) tools that address behavioural risk factors (unhealthy diet, physical inactivity, tobacco and alcohol consumption) for non-communicable diseases (NCD). We searched in MEDLINE and Web of Science, hand-searched reference lists and contacted experts. Basic characteristics, measures assessed and measurement properties (validity, reliability, usability) of identified tools were extracted. We narratively synthesized the data and used content analysis to develop a list of measures used in the SEA tools. Twenty-four SEA tools were identified, mostly from developed countries. Out of these, 15 were questionnaire based, 8 were checklists or observation based tools and one tool used a combined checklist/observation based and telephonic questionnaire approach. Only 1 SEA tool had components related to all the four NCD risk factors, 2 SEA tools has assessed three NCD risk factors (diet/nutrition, physical activity, tobacco), 10 SEA tools has assessed two NCD risk factors (diet/nutrition and physical activity) and 11 SEA tools has assessed only one of the NCD risk factor. Several measures were used in the tools to assess the four NCD risk factors, but tobacco and alcohol was sparingly included. Measurement properties were reported for 14 tools. The review provides a comprehensive list of measures used in SEA tools which could be a valuable resource to guide future development of such tools. A valid and reliable SEA tool which could simultaneously evaluate all NCD risk factors, that has been tested in different settings with varying resource availability is needed.

Renal Stone Risk During Spaceflight: Assessment and Countermeasure Validation

NASA Technical Reports Server (NTRS)

Pietrzyk, Robert A.; Whitson, Peggy A.; Sams, Clarence F.; Jones, Jeffery A.; Smith, Scott M.

2009-01-01

This viewgraph presentation describes the risks of renal stone formation in manned space flight. The contents include: 1) Risk; 2) Evidence; 3) Nephrolithiasis -A Multifactorial Disease; 4) Symptoms/signs; 5) Urolithiasis and Stone Passage; 6) Study Objectives; 7) Subjects; 8) Methods; 9) Investigation Results; 10) Potassium Citrate; 11) Calcium Balance; 12) Case Study; 13) Significant Findings; 14) Risk Mitigation Strategies and Recommended Actions; and 15) Future Potential.

[Design of a risk matrix to assess sterile formulations at health care facilities].

PubMed

Martín de Rosales Cabrera, A M; López Cabezas, C; García Salom, P

2014-05-01

To design a matrix allowing classifying sterile formulations prepared at the hospital with different risk levels. i) Literature search and critical appraisal of the model proposed by the European Resolution CM/Res Ap(2011)1, ii) Identification of the risk associated to the elaboration process by means of the AMFE methodology (Modal Analysis of Failures and Effects), iii) estimation of the severity associated to the risks detected. After initially trying a model of numeric scoring, the classification matrix was changed to an alphabetical classification, grading each criterion from A to D.Each preparation assessed is given a 6-letter combination with three possible risk levels: low, intermediate, and high. This model was easier for risk assignment, and more reproducible. The final model designed analyzes 6 criteria: formulation process, administration route, the drug's safety profile, amount prepared, distribution, and susceptibility for microbiological contamination.The risk level obtained will condition the requirements of the formulation area, validity time, and storing conditions. The matrix model proposed may help health care institutions to better assess the risk of sterile formulations prepared,and provides information about the acceptable validity time according to the storing conditions and the manufacturing area. Its use will increase the safety level of this procedure as well as help in resources planning and distribution. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.